[2025-09-19T17:00:02.673716] [INFO ] [MAIN ] Using last completed trading day: 2025-09-19 [2025-09-19T17:00:02.674231] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-19T17:00:02.674342] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-19T17:00:02.674381] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-19T17:00:04.195485] [DEBUG] [SYMBOL ] Found 2424 valid NYSE symbols. [2025-09-19T17:00:04.195704] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-19T17:00:04.195921] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-19T17:00:04.196581] [INFO ] [LOCAL ] Symbols cache updated with 2372 symbols. [2025-09-19T17:00:04.196672] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-19T17:00:04.196723] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-19T17:00:04.196784] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-19T17:00:04.196915] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-19T17:00:04.197282] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-19T17:00:04.197317] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-19T17:00:04.197485] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-19T17:00:04.197540] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2372 valid symbols. [2025-09-19T17:00:04.197573] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-19T17:00:04.197604] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-19T17:00:04.223546] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-19T17:00:04.250922] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-19T17:00:04.251112] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-19T17:00:04.251150] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-19T17:00:04.251179] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-19T17:00:04.251601] [WARN ] [STATE ] State set to: RUNNING [2025-09-19T17:00:04.251779] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-19T17:00:04.252181] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-19T17:00:04.252233] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-19T17:00:04.252317] [INFO ] [MAIN ] Starting incremental update for 2372 symbols. [2025-09-19T17:00:04.252354] [INFO ] [MAIN ] Running in parallel mode [2025-09-19T17:00:04.252519] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2372 symbols [2025-09-19T17:00:04.825843] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:04.841714] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-09-19T17:00:04.857285] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-09-19T17:00:04.881011] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-19T17:00:04.920042] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-19T17:00:04.944467] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-19T17:00:04.960059] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-19T17:00:04.928683] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:05.057045] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-09-19T17:00:05.089851] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:05.060564] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:05.095228] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-09-19T17:00:05.107908] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-19T17:00:05.107999] [DEBUG] [LOCAL ] AACT: No existing data file found in primary storage. [2025-09-19T17:00:05.119008] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-19T17:00:05.148794] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-19T17:00:05.169908] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-19T17:00:05.154095] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-19T17:00:05.148862] [WARN ] [MAIN ] AACT: No existing data found, performing full refresh instead. [2025-09-19T17:00:05.178136] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-19T17:00:05.182264] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-19T17:00:05.182571] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-19T17:00:05.182662] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-19T17:00:05.246509] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-19T17:00:05.251820] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-19T17:00:05.275526] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-19T17:00:05.295984] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-19T17:00:05.317306] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-19T17:00:06.200795] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:06.243141] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-19T17:00:06.603880] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:06.598804] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:06.616141] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-19T17:00:06.637112] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:06.633213] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-19T17:00:06.638496] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-19T17:00:07.068501] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-19T17:00:07.069771] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-19T17:00:07.088827] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-19T17:00:07.089917] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-19T17:00:07.500402] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-19T17:00:07.501821] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-19T17:00:07.696944] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T17:00:07.698602] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-19T17:00:07.847231] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-19T17:00:07.848619] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-19T17:00:08.112461] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T17:00:08.113500] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-19T17:00:08.304055] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-19T17:00:08.305044] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-19T17:00:08.457341] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T17:00:08.468693] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-19T17:00:08.520474] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T17:00:08.531267] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-19T17:00:08.612878] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-19T17:00:08.613967] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-19T17:00:08.869116] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:00:08.871399] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-19T17:00:08.893172] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-19T17:00:08.894271] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-19T17:00:09.199386] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-19T17:00:09.200302] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-19T17:00:09.881790] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-19T17:00:09.883432] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-19T17:00:09.892492] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T17:00:09.895285] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-19T17:00:10.302833] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T17:00:10.303933] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-19T17:00:10.438043] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:00:10.450088] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-19T17:00:10.923169] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T17:00:10.925868] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-19T17:00:11.030429] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-19T17:00:11.040724] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-19T17:00:11.506590] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-19T17:00:11.510832] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-19T17:00:12.141637] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:00:12.142442] [INFO ] [REMOTE ] AAM: Full fetch complete (999 records). [2025-09-19T17:00:12.142519] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-19T17:00:12.319960] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-19T17:00:12.320191] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:12.320241] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:12.320279] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-19T17:00:12.320337] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-19T17:00:12.320372] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-19T17:00:12.320410] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-19T17:00:12.320470] [INFO ] [MAIN ] Update Progress: 1/2372 symbols completed. AAM took 8.0s. Estimated remaining: 5h 18m 49s. Rate: 7.4 symbols/min [2025-09-19T17:00:12.491011] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:12.491454] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-19T17:00:12.491524] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-19T17:00:12.491762] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-19T17:00:12.492002] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-19T17:00:12.492154] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-19T17:00:12.492427] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-19T17:00:12.651225] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T17:00:12.709538] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-19T17:00:12.933261] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-19T17:00:12.931902] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:12.943699] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-19T17:00:12.947676] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-19T17:00:12.982775] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:00:12.993748] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-19T17:00:13.221742] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:13.222066] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-19T17:00:13.222563] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-19T17:00:13.389468] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T17:00:13.393005] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-19T17:00:14.649632] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:00:14.661915] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-19T17:00:15.144681] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:00:15.156203] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-19T17:00:16.090835] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-19T17:00:16.094758] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-19T17:00:16.159384] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-19T17:00:16.162165] [INFO ] [REMOTE ] AACT: Full fetch complete (10341 records). [2025-09-19T17:00:16.162267] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-19T17:00:16.162744] [FATAL] [VALIDATOR ] AACT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:00:16.162830] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:16.162873] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:16.162915] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-19T17:00:16.162972] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-19T17:00:16.163009] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-19T17:00:16.163048] [DEBUG] [LOCAL ] AACT: No derivative data file found to delete. [2025-09-19T17:00:16.163104] [INFO ] [MAIN ] Update Progress: 2/2372 symbols completed. AACT took 11.9s. Estimated remaining: 3h 55m 14s. Rate: 10.1 symbols/min [2025-09-19T17:00:16.336678] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:16.410640] [DEBUG] [LOCAL ] AAP: Loaded 52568 existing records from primary storage. [2025-09-19T17:00:16.410846] [INFO ] [MAIN ] AAP: Loaded 52568 existing records. [2025-09-19T17:00:16.610873] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:16.611146] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-19T17:00:16.611216] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-19T17:00:16.612848] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-19T17:00:16.612912] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-19T17:00:17.005782] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:17.006222] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-19T17:00:17.265301] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T17:00:17.281205] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-19T17:00:18.063207] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-09-19T17:00:18.074480] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-19T17:00:18.140694] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T17:00:18.144735] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-19T17:00:19.066230] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:00:19.076779] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-19T17:00:19.129103] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T17:00:19.140518] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-19T17:00:19.181748] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T17:00:19.186903] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-19T17:00:19.906575] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T17:00:19.926306] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-19T17:00:20.402884] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T17:00:20.410514] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-19T17:00:20.525429] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T17:00:20.539215] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-19T17:00:20.643872] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T17:00:20.654834] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-19T17:00:21.769191] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T17:00:21.775315] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-19T17:00:22.077150] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T17:00:22.087312] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-19T17:00:22.257037] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T17:00:22.268545] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-19T17:00:22.656780] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T17:00:22.680687] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-19T17:00:22.688200] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T17:00:22.694149] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-19T17:00:23.695688] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T17:00:23.707421] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-19T17:00:23.939552] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:00:23.951917] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-19T17:00:24.171833] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T17:00:24.178001] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-19T17:00:24.327736] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T17:00:24.341891] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-19T17:00:25.064815] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T17:00:25.070138] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-19T17:00:25.666590] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T17:00:25.679846] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-19T17:00:25.939549] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T17:00:25.950525] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-19T17:00:25.995868] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T17:00:26.007115] [INFO ] [REMOTE ] A: Full fetch complete (73119 records). [2025-09-19T17:00:26.007252] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-19T17:00:26.445404] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-19T17:00:26.445528] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-19T17:00:26.446408] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-19T17:00:26.446497] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-19T17:00:26.448712] [DEBUG] [LOCAL ] A: Trimmed 73119 records to 51608 (keeping 200 days of data) [2025-09-19T17:00:26.713342] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T17:00:26.719214] [INFO ] [REMOTE ] AAMI: Full fetch complete (29733 records). [2025-09-19T17:00:26.719570] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-19T17:00:26.720926] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:00:26.721772] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:26.722371] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:26.722709] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-19T17:00:26.723512] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-19T17:00:26.723841] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-19T17:00:26.723955] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-19T17:00:26.724071] [INFO ] [MAIN ] Update Progress: 3/2372 symbols completed. AAMI took 14.4s. Estimated remaining: 4h 55m 45s. Rate: 8.0 symbols/min [2025-09-19T17:00:26.904669] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:27.001049] [DEBUG] [LOCAL ] AAT: Loaded 30832 existing records from primary storage. [2025-09-19T17:00:27.002081] [INFO ] [MAIN ] AAT: Loaded 30832 existing records. [2025-09-19T17:00:27.197605] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:27.203845] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-19T17:00:27.206131] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-19T17:00:27.206018] [DEBUG] [LOCAL ] A: Primary data saved (51608 records). [2025-09-19T17:00:27.206312] [INFO ] [MAIN ] A: Full history saved. [2025-09-19T17:00:27.206604] [INFO ] [MAIN ] Update Progress: 4/2372 symbols completed. A took 23.0s. Estimated remaining: 3h 46m 29s. Rate: 10.5 symbols/min [2025-09-19T17:00:27.212084] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-19T17:00:27.259184] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-19T17:00:27.578258] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:27.640362] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-19T17:00:27.675564] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-19T17:00:27.709252] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-19T17:00:27.712570] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-19T17:00:27.723564] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-19T17:00:27.739179] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-19T17:00:27.914163] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:27.918962] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-19T17:00:28.186173] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:28.186750] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-19T17:00:28.225040] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T17:00:28.237402] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-19T17:00:28.318962] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-19T17:00:28.327632] [INFO ] [REMOTE ] AA: Full fetch complete (77512 records). [2025-09-19T17:00:28.327843] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-19T17:00:28.628487] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:28.631450] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-19T17:00:28.632337] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-19T17:00:28.730909] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-19T17:00:28.730998] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-19T17:00:28.731683] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-19T17:00:28.731752] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-19T17:00:28.733390] [DEBUG] [LOCAL ] AA: Trimmed 77512 records to 54365 (keeping 200 days of data) [2025-09-19T17:00:29.027208] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:29.052545] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-19T17:00:29.053548] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-19T17:00:29.083241] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T17:00:29.089931] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-19T17:00:29.105249] [DEBUG] [LOCAL ] AA: Primary data saved (54365 records). [2025-09-19T17:00:29.105418] [INFO ] [MAIN ] AA: Full history saved. [2025-09-19T17:00:29.105503] [INFO ] [MAIN ] Update Progress: 5/2372 symbols completed. AA took 24.8s. Estimated remaining: 3h 16m 5s. Rate: 12.1 symbols/min [2025-09-19T17:00:29.288258] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:29.288480] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-09-19T17:00:29.288524] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-09-19T17:00:29.288898] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-19T17:00:29.288954] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-19T17:00:29.289000] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-09-19T17:00:29.289036] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-19T17:00:29.322955] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:29.361391] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-19T17:00:29.373936] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-19T17:00:29.698680] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:29.699324] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-19T17:00:29.698886] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:29.700611] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-19T17:00:29.701157] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-19T17:00:30.340737] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:30.341577] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-19T17:00:30.342486] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-19T17:00:30.360968] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T17:00:30.367155] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-19T17:00:30.398920] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T17:00:30.411289] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-19T17:00:30.592531] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:00:30.592918] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-19T17:00:30.593460] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-19T17:00:30.962853] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T17:00:30.972007] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-19T17:00:31.351231] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T17:00:31.353578] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-19T17:00:31.689070] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T17:00:31.694867] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-19T17:00:31.921790] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T17:00:31.924495] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-19T17:00:32.032318] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:00:32.044263] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-19T17:00:32.270923] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T17:00:32.279024] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-19T17:00:32.586851] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T17:00:32.593597] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-19T17:00:33.041058] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T17:00:33.045240] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-19T17:00:33.590242] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T17:00:33.599553] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-19T17:00:33.801760] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:00:33.813556] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-19T17:00:33.861426] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T17:00:33.869236] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-19T17:00:34.269188] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T17:00:34.272714] [INFO ] [REMOTE ] AAUC: Full fetch complete (6975 records). [2025-09-19T17:00:34.272866] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-19T17:00:34.454248] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-19T17:00:34.454490] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:34.454573] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:34.454622] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-19T17:00:34.454729] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-19T17:00:34.454801] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-19T17:00:34.454865] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-19T17:00:34.454960] [INFO ] [MAIN ] Update Progress: 6/2372 symbols completed. AAUC took 7.2s. Estimated remaining: 3h 18m 30s. Rate: 11.9 symbols/min [2025-09-19T17:00:34.631372] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:34.698288] [DEBUG] [LOCAL ] ABBV: Loaded 54077 existing records from primary storage. [2025-09-19T17:00:34.698445] [INFO ] [MAIN ] ABBV: Loaded 54077 existing records. [2025-09-19T17:00:34.896344] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:34.896626] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-19T17:00:34.896711] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-19T17:00:34.898624] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-19T17:00:34.898715] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-19T17:00:35.292171] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:35.295994] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-19T17:00:35.322032] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T17:00:35.328912] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-19T17:00:35.492741] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T17:00:35.502945] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-19T17:00:35.735250] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T17:00:35.742567] [INFO ] [REMOTE ] AAP: Full fetch complete (74849 records). [2025-09-19T17:00:35.742753] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-19T17:00:35.747250] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:00:35.747407] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:35.747459] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:35.747525] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-19T17:00:35.747609] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-19T17:00:35.747695] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-09-19T17:00:35.748116] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-09-19T17:00:35.748266] [INFO ] [MAIN ] Update Progress: 7/2372 symbols completed. AAP took 19.6s. Estimated remaining: 2h 57m 21s. Rate: 13.3 symbols/min [2025-09-19T17:00:35.923465] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:35.963532] [DEBUG] [LOCAL ] ABCB: Loaded 31012 existing records from primary storage. [2025-09-19T17:00:35.963696] [INFO ] [MAIN ] ABCB: Loaded 31012 existing records. [2025-09-19T17:00:36.149588] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:36.149883] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-19T17:00:36.149935] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-19T17:00:36.150873] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-19T17:00:36.150937] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-19T17:00:36.520794] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:36.521315] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-19T17:00:36.540510] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T17:00:36.547764] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-19T17:00:37.043058] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:00:37.054377] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-19T17:00:37.206729] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T17:00:37.215348] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-19T17:00:37.553980] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T17:00:37.561438] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-19T17:00:38.007129] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T17:00:38.013979] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-19T17:00:38.170009] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:00:38.176913] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-19T17:00:38.980242] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T17:00:38.986307] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-19T17:00:39.057793] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:00:39.066520] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-19T17:00:39.233904] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T17:00:39.247416] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-19T17:00:39.747850] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T17:00:39.755084] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-19T17:00:40.366918] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T17:00:40.371244] [INFO ] [REMOTE ] AAT: Full fetch complete (42541 records). [2025-09-19T17:00:40.371334] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-19T17:00:40.371990] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:00:40.372079] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:00:40.372126] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:00:40.372205] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-19T17:00:40.372341] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-19T17:00:40.372398] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-19T17:00:40.372750] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-09-19T17:00:40.373660] [INFO ] [MAIN ] Update Progress: 8/2372 symbols completed. AAT took 13.6s. Estimated remaining: 2h 57m 54s. Rate: 13.3 symbols/min [2025-09-19T17:00:40.551314] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:40.621365] [DEBUG] [LOCAL ] ABEV: Loaded 53660 existing records from primary storage. [2025-09-19T17:00:40.621587] [INFO ] [MAIN ] ABEV: Loaded 53660 existing records. [2025-09-19T17:00:40.820174] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:40.830259] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-19T17:00:40.830039] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T17:00:40.835449] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-19T17:00:40.836368] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-19T17:00:40.837492] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-19T17:00:40.837583] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-19T17:00:41.224159] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:41.224720] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-19T17:00:41.315012] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T17:00:41.326853] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-19T17:00:41.497362] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T17:00:41.503919] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-19T17:00:42.138901] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T17:00:42.144255] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-19T17:00:42.669276] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T17:00:42.678260] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-19T17:00:42.791418] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-19T17:00:42.803585] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-19T17:00:43.637405] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-19T17:00:43.649227] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-19T17:00:43.660578] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T17:00:43.664881] [INFO ] [REMOTE ] AB: Full fetch complete (46093 records). [2025-09-19T17:00:43.664982] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-19T17:00:44.069931] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-19T17:00:44.070056] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-19T17:00:44.070586] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-19T17:00:44.070666] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-19T17:00:44.071748] [DEBUG] [LOCAL ] AB: Trimmed 46093 records to 29406 (keeping 200 days of data) [2025-09-19T17:00:44.185635] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T17:00:44.197949] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-19T17:00:44.294500] [DEBUG] [LOCAL ] AB: Primary data saved (29406 records). [2025-09-19T17:00:44.294744] [INFO ] [MAIN ] AB: Full history saved. [2025-09-19T17:00:44.294846] [INFO ] [MAIN ] Update Progress: 9/2372 symbols completed. AB took 15.2s. Estimated remaining: 2h 55m 13s. Rate: 13.5 symbols/min [2025-09-19T17:00:44.475617] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:44.496234] [DEBUG] [LOCAL ] ABG: Loaded 19091 existing records from primary storage. [2025-09-19T17:00:44.496374] [INFO ] [MAIN ] ABG: Loaded 19091 existing records. [2025-09-19T17:00:44.708611] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:00:44.715374] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:44.727211] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-19T17:00:44.726827] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-19T17:00:44.727365] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-19T17:00:44.729075] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-19T17:00:44.729160] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-19T17:00:45.103143] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:45.103548] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-19T17:00:45.523049] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T17:00:45.534550] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-19T17:00:45.644602] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T17:00:45.651353] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-19T17:00:46.066007] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T17:00:46.069885] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-19T17:00:46.768967] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T17:00:46.774149] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-19T17:00:46.808887] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T17:00:46.819217] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-19T17:00:47.096290] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T17:00:47.102433] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-19T17:00:47.391634] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T17:00:47.403580] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-19T17:00:48.052676] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T17:00:48.056421] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-19T17:00:48.250626] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T17:00:48.257989] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-19T17:00:48.413686] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T17:00:48.425256] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-19T17:00:49.299391] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T17:00:49.304507] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-19T17:00:49.596950] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:00:49.609575] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-19T17:00:49.908470] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T17:00:49.917437] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-19T17:00:50.283390] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T17:00:50.290004] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-19T17:00:50.705714] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T17:00:50.717278] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-19T17:00:51.072481] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T17:00:51.078997] [INFO ] [REMOTE ] ABCB: Full fetch complete (44236 records). [2025-09-19T17:00:51.079353] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-19T17:00:51.535881] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-19T17:00:51.536075] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-19T17:00:51.536762] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-19T17:00:51.536996] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-19T17:00:51.547883] [DEBUG] [LOCAL ] ABCB: Trimmed 44236 records to 31310 (keeping 200 days of data) [2025-09-19T17:00:51.548831] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T17:00:51.553306] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-19T17:00:51.709870] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:00:51.724739] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-19T17:00:51.827608] [DEBUG] [LOCAL ] ABCB: Primary data saved (31310 records). [2025-09-19T17:00:51.827821] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-19T17:00:51.828003] [INFO ] [MAIN ] Update Progress: 10/2372 symbols completed. ABCB took 16.1s. Estimated remaining: 3h 7m 17s. Rate: 12.6 symbols/min [2025-09-19T17:00:52.026629] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:52.060059] [DEBUG] [LOCAL ] ABM: Loaded 32511 existing records from primary storage. [2025-09-19T17:00:52.060224] [INFO ] [MAIN ] ABM: Loaded 32511 existing records. [2025-09-19T17:00:52.253704] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:52.254053] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-19T17:00:52.254114] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-19T17:00:52.255150] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-19T17:00:52.255217] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-19T17:00:52.625928] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:52.626287] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-19T17:00:52.664455] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T17:00:52.670361] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-19T17:00:52.809204] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T17:00:52.821184] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-19T17:00:53.551309] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T17:00:53.558124] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-19T17:00:53.592349] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:00:53.608712] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-19T17:00:53.667789] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T17:00:53.674819] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-19T17:00:54.832411] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:00:54.837159] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-19T17:00:55.064615] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T17:00:55.075575] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-19T17:00:55.178524] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T17:00:55.184515] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-19T17:00:55.427960] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T17:00:55.437237] [INFO ] [REMOTE ] ABBV: Full fetch complete (77721 records). [2025-09-19T17:00:55.437407] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-19T17:00:55.859558] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-19T17:00:55.859701] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-19T17:00:55.860545] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-19T17:00:55.860686] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-19T17:00:55.865045] [DEBUG] [LOCAL ] ABBV: Trimmed 77721 records to 54467 (keeping 200 days of data) [2025-09-19T17:00:56.206273] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T17:00:56.212885] [INFO ] [REMOTE ] ABG: Full fetch complete (26323 records). [2025-09-19T17:00:56.215875] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-19T17:00:56.427813] [DEBUG] [LOCAL ] ABBV: Primary data saved (54467 records). [2025-09-19T17:00:56.462425] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-19T17:00:56.487929] [INFO ] [MAIN ] Update Progress: 11/2372 symbols completed. ABBV took 22.0s. Estimated remaining: 3h 6m 52s. Rate: 12.6 symbols/min [2025-09-19T17:00:56.845940] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T17:00:56.880136] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:56.880522] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-19T17:00:56.881752] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-19T17:00:56.881624] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-19T17:00:56.882764] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-19T17:00:56.884280] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-19T17:00:56.887286] [DEBUG] [LOCAL ] ABG: Trimmed 26323 records to 19221 (keeping 200 days of data) [2025-09-19T17:00:57.022719] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T17:00:57.045598] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-19T17:00:57.101845] [DEBUG] [LOCAL ] ABR: Loaded 52531 existing records from primary storage. [2025-09-19T17:00:57.102880] [INFO ] [MAIN ] ABR: Loaded 52531 existing records. [2025-09-19T17:00:57.258111] [DEBUG] [LOCAL ] ABG: Primary data saved (19221 records). [2025-09-19T17:00:57.289807] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-19T17:00:57.296000] [INFO ] [MAIN ] Update Progress: 12/2372 symbols completed. ABG took 13.0s. Estimated remaining: 2h 53m 52s. Rate: 13.6 symbols/min [2025-09-19T17:00:57.295856] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:57.378074] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-19T17:00:57.397733] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-19T17:00:57.406475] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-19T17:00:57.416830] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-19T17:00:57.574919] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:00:57.892926] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:57.908484] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-19T17:00:57.912667] [DEBUG] [LOCAL ] ABT: Loaded 54011 existing records from primary storage. [2025-09-19T17:00:57.912915] [INFO ] [MAIN ] ABT: Loaded 54011 existing records. [2025-09-19T17:00:58.094926] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:00:58.095207] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-19T17:00:58.095260] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-19T17:00:58.097543] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-19T17:00:58.097610] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-19T17:00:58.454762] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:00:58.455091] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-19T17:00:58.717583] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T17:00:58.726290] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-19T17:00:59.227053] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T17:00:59.238897] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-19T17:00:59.588689] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:00:59.600521] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-19T17:00:59.835464] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T17:00:59.843203] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-19T17:01:00.652347] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T17:01:00.669366] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-19T17:01:01.132589] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T17:01:01.144922] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-19T17:01:01.418987] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:01:01.425634] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-19T17:01:01.761133] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-19T17:01:01.770831] [INFO ] [REMOTE ] ABEV: Full fetch complete (77195 records). [2025-09-19T17:01:01.771307] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-19T17:01:02.185709] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-19T17:01:02.185821] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-19T17:01:02.186620] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-19T17:01:02.186740] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-19T17:01:02.188556] [DEBUG] [LOCAL ] ABEV: Trimmed 77195 records to 54050 (keeping 200 days of data) [2025-09-19T17:01:02.455700] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:01:02.524830] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-19T17:01:02.567414] [DEBUG] [LOCAL ] ABEV: Primary data saved (54050 records). [2025-09-19T17:01:02.569068] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-19T17:01:02.570065] [INFO ] [MAIN ] Update Progress: 13/2372 symbols completed. ABEV took 22.2s. Estimated remaining: 2h 56m 22s. Rate: 13.4 symbols/min [2025-09-19T17:01:02.744788] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:02.781182] [DEBUG] [LOCAL ] ACA: Loaded 24478 existing records from primary storage. [2025-09-19T17:01:02.781540] [INFO ] [MAIN ] ACA: Loaded 24478 existing records. [2025-09-19T17:01:02.962905] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:02.963411] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-19T17:01:02.963486] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-19T17:01:02.964499] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-19T17:01:02.964563] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-19T17:01:03.395601] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T17:01:03.394130] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:03.403592] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-19T17:01:03.405284] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-19T17:01:03.439826] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T17:01:03.450818] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-19T17:01:04.210901] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T17:01:04.222889] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-19T17:01:04.861826] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T17:01:04.866428] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-19T17:01:05.012718] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T17:01:05.443314] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-19T17:01:05.649505] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:01:05.975389] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:01:06.243267] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-19T17:01:06.408625] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T17:01:07.035367] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T17:01:07.043221] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-19T17:01:07.843263] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-19T17:01:08.163477] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T17:01:08.643303] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-19T17:01:09.205338] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:01:09.448524] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-19T17:01:09.465005] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T17:01:10.243268] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-19T17:01:10.620952] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:01:10.626842] [INFO ] [REMOTE ] ABM: Full fetch complete (44314 records). [2025-09-19T17:01:10.626959] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-19T17:01:11.014074] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-19T17:01:11.014180] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-19T17:01:11.014627] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-19T17:01:11.014712] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-19T17:01:11.015896] [DEBUG] [LOCAL ] ABM: Trimmed 44314 records to 32750 (keeping 200 days of data) [2025-09-19T17:01:11.079052] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-19T17:01:11.157241] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T17:01:11.258381] [DEBUG] [LOCAL ] ABM: Primary data saved (32750 records). [2025-09-19T17:01:11.258556] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-19T17:01:11.258709] [INFO ] [MAIN ] Update Progress: 14/2372 symbols completed. ABM took 19.4s. Estimated remaining: 3h 8m 6s. Rate: 12.5 symbols/min [2025-09-19T17:01:11.445976] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:11.487523] [DEBUG] [LOCAL ] ACCO: Loaded 38341 existing records from primary storage. [2025-09-19T17:01:11.487730] [INFO ] [MAIN ] ACCO: Loaded 38341 existing records. [2025-09-19T17:01:11.668224] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:11.668494] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-19T17:01:11.668563] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-19T17:01:11.670314] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-19T17:01:11.670379] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-19T17:01:11.848898] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-19T17:01:12.043982] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:12.410226] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T17:01:12.643274] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-19T17:01:13.443304] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-19T17:01:13.550357] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-19T17:01:13.637594] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:01:14.243290] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-19T17:01:14.668934] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T17:01:14.860855] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T17:01:15.043284] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-19T17:01:15.204574] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T17:01:15.843276] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-19T17:01:16.643270] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-19T17:01:16.763849] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T17:01:17.443293] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-19T17:01:17.677555] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T17:01:17.755236] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T17:01:18.243273] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-19T17:01:18.551127] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T17:01:19.043283] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-19T17:01:19.641214] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T17:01:19.843281] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-19T17:01:20.643276] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-19T17:01:20.848674] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T17:01:21.366914] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T17:01:21.443232] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-19T17:01:21.831415] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T17:01:22.243279] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-19T17:01:23.043275] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-19T17:01:23.341059] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T17:01:23.468478] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T17:01:23.843307] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-19T17:01:24.308687] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:01:24.643297] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-19T17:01:25.443278] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-19T17:01:25.567977] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-19T17:01:26.243301] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-19T17:01:26.836007] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T17:01:26.965134] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-19T17:01:26.973350] [INFO ] [REMOTE ] ABT: Full fetch complete (77583 records). [2025-09-19T17:01:26.973520] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-19T17:01:27.048381] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-19T17:01:27.255880] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T17:01:27.299009] [INFO ] [REMOTE ] ACA: Full fetch complete (34282 records). [2025-09-19T17:01:27.311216] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-19T17:01:27.558725] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-19T17:01:27.574528] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-19T17:01:27.580740] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-19T17:01:27.580866] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-19T17:01:27.637848] [DEBUG] [LOCAL ] ABT: Trimmed 77583 records to 54400 (keeping 200 days of data) [2025-09-19T17:01:27.844256] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-19T17:01:27.953267] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-19T17:01:27.956038] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-19T17:01:27.958934] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-19T17:01:27.959752] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-19T17:01:27.964982] [DEBUG] [LOCAL ] ACA: Trimmed 34282 records to 24626 (keeping 200 days of data) [2025-09-19T17:01:28.254435] [DEBUG] [LOCAL ] ACA: Primary data saved (24626 records). [2025-09-19T17:01:28.255153] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-19T17:01:28.255538] [INFO ] [MAIN ] Update Progress: 15/2372 symbols completed. ACA took 25.7s. Estimated remaining: 3h 39m 60s. Rate: 10.7 symbols/min [2025-09-19T17:01:28.468997] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:28.556389] [DEBUG] [LOCAL ] ACEL: Loaded 27701 existing records from primary storage. [2025-09-19T17:01:28.578581] [INFO ] [MAIN ] ACEL: Loaded 27701 existing records. [2025-09-19T17:01:28.700463] [DEBUG] [LOCAL ] ABT: Primary data saved (54400 records). [2025-09-19T17:01:28.711197] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-19T17:01:28.711404] [INFO ] [MAIN ] Update Progress: 16/2372 symbols completed. ABT took 31.4s. Estimated remaining: 3h 27m 17s. Rate: 11.4 symbols/min [2025-09-19T17:01:28.935372] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:28.971428] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-19T17:01:28.979258] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-19T17:01:28.997205] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-19T17:01:28.997135] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:28.997709] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-19T17:01:29.383758] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-09-19T17:01:29.394768] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-09-19T17:01:29.519494] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:29.553856] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-19T17:01:29.621184] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T17:01:29.695687] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:29.695943] [INFO ] [REMOTE ] ABR: Full fetch complete (75175 records). [2025-09-19T17:01:29.696415] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-19T17:01:29.697101] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-19T17:01:29.697338] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-19T17:01:29.733939] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-19T17:01:29.761626] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-19T17:01:30.155765] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-19T17:01:30.271520] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-19T17:01:30.529529] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:30.535126] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-19T17:01:30.554879] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-19T17:01:30.554965] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-19T17:01:30.555686] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-19T17:01:30.555755] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-19T17:01:30.557397] [DEBUG] [LOCAL ] ABR: Trimmed 75175 records to 52915 (keeping 200 days of data) [2025-09-19T17:01:30.870981] [DEBUG] [LOCAL ] ABR: Primary data saved (52915 records). [2025-09-19T17:01:30.871115] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-19T17:01:30.871198] [INFO ] [MAIN ] Update Progress: 17/2372 symbols completed. ABR took 34.3s. Estimated remaining: 3h 19m 59s. Rate: 11.8 symbols/min [2025-09-19T17:01:31.039244] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:31.073634] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T17:01:31.080062] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-19T17:01:31.123121] [DEBUG] [LOCAL ] ACI: Loaded 53663 existing records from primary storage. [2025-09-19T17:01:31.123280] [INFO ] [MAIN ] ACI: Loaded 53663 existing records. [2025-09-19T17:01:31.306793] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:31.307116] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-19T17:01:31.307186] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-19T17:01:31.308425] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-19T17:01:31.308485] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-19T17:01:31.660612] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:31.843261] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-19T17:01:32.194984] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T17:01:32.480156] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T17:01:32.643332] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-19T17:01:33.443248] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-19T17:01:33.558525] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T17:01:33.683985] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (3.15 seconds). [2025-09-19T17:01:33.974551] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:01:34.243285] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-19T17:01:34.642902] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T17:01:35.043282] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-19T17:01:35.765606] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:01:35.843263] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-19T17:01:36.643242] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-19T17:01:37.195580] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T17:01:37.443291] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-19T17:01:37.483586] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T17:01:38.243272] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-19T17:01:38.753520] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T17:01:38.758576] [INFO ] [REMOTE ] ACCO: Full fetch complete (54261 records). [2025-09-19T17:01:38.758718] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-19T17:01:39.051165] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-19T17:01:39.151011] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-19T17:01:39.151193] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-19T17:01:39.151944] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-19T17:01:39.152058] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-19T17:01:39.153780] [DEBUG] [LOCAL ] ACCO: Trimmed 54261 records to 38568 (keeping 200 days of data) [2025-09-19T17:01:39.382170] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-19T17:01:39.419404] [DEBUG] [LOCAL ] ACCO: Primary data saved (38568 records). [2025-09-19T17:01:39.419564] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-19T17:01:39.419696] [INFO ] [MAIN ] Update Progress: 18/2372 symbols completed. ACCO took 28.2s. Estimated remaining: 3h 27m 26s. Rate: 11.3 symbols/min [2025-09-19T17:01:39.615759] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:39.660672] [DEBUG] [LOCAL ] ACM: Loaded 43495 existing records from primary storage. [2025-09-19T17:01:39.660843] [INFO ] [MAIN ] ACM: Loaded 43495 existing records. [2025-09-19T17:01:39.860125] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-19T17:01:39.908948] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:39.910062] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-19T17:01:39.910139] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-19T17:01:39.911257] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-19T17:01:39.911338] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-19T17:01:40.291108] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:40.320398] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T17:01:40.643304] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-19T17:01:40.661919] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T17:01:41.443282] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-19T17:01:42.098084] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T17:01:42.243302] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-19T17:01:42.373203] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T17:01:42.620874] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-19T17:01:43.043322] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-19T17:01:43.843277] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-19T17:01:43.929472] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T17:01:44.643271] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-19T17:01:45.012102] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T17:01:45.443275] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-19T17:01:46.243351] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-19T17:01:46.634303] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-19T17:01:46.827401] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T17:01:46.870129] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T17:01:47.043239] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-19T17:01:47.085865] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-19T17:01:47.843267] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-19T17:01:48.491933] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T17:01:48.643284] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-19T17:01:49.247446] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T17:01:49.443271] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-19T17:01:50.243294] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-19T17:01:51.043255] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-19T17:01:51.402302] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T17:01:51.542115] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-09-19T17:01:51.744775] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:01:51.843267] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-19T17:01:52.456614] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:01:52.643377] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-19T17:01:52.986406] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T17:01:52.991276] [INFO ] [REMOTE ] ACEL: Full fetch complete (39025 records). [2025-09-19T17:01:52.991464] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-19T17:01:53.448538] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-19T17:01:53.551910] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-19T17:01:53.552088] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-19T17:01:53.552829] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-19T17:01:53.552913] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-19T17:01:53.554455] [DEBUG] [LOCAL ] ACEL: Trimmed 39025 records to 27839 (keeping 200 days of data) [2025-09-19T17:01:53.775940] [DEBUG] [LOCAL ] ACEL: Primary data saved (27839 records). [2025-09-19T17:01:53.776125] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-19T17:01:53.776234] [INFO ] [MAIN ] Update Progress: 19/2372 symbols completed. ACEL took 25.5s. Estimated remaining: 3h 46m 4s. Rate: 10.4 symbols/min [2025-09-19T17:01:53.975334] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:01:54.034571] [DEBUG] [LOCAL ] ACN: Loaded 53809 existing records from primary storage. [2025-09-19T17:01:54.034774] [INFO ] [MAIN ] ACN: Loaded 53809 existing records. [2025-09-19T17:01:54.230538] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:01:54.230879] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-19T17:01:54.230931] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-19T17:01:54.232416] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-19T17:01:54.232490] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-19T17:01:54.266133] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-19T17:01:54.636270] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:01:54.988421] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T17:01:55.042236] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-19T17:01:55.052932] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-19T17:01:55.843280] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-19T17:01:56.643301] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-19T17:01:56.663457] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T17:01:56.717204] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T17:01:57.443253] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-19T17:01:57.934248] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T17:01:58.243311] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-19T17:01:59.046323] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (3.20 seconds). [2025-09-19T17:01:59.043758] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-19T17:01:59.644292] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-19T17:01:59.760495] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:01:59.843293] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-19T17:02:00.640075] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:02:00.644423] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-19T17:02:01.443320] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-19T17:02:01.871484] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:02:02.243328] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-19T17:02:02.756622] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:02:03.043281] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-19T17:02:03.851016] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-19T17:02:03.857894] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-09-19T17:02:03.948610] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T17:02:03.957217] [INFO ] [REMOTE ] ACI: Full fetch complete (77024 records). [2025-09-19T17:02:03.957440] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-19T17:02:04.413345] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-19T17:02:04.413447] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-19T17:02:04.414216] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-19T17:02:04.414294] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-19T17:02:04.416109] [DEBUG] [LOCAL ] ACI: Trimmed 77024 records to 54052 (keeping 200 days of data) [2025-09-19T17:02:04.644605] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-19T17:02:04.805204] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T17:02:04.827739] [DEBUG] [LOCAL ] ACI: Primary data saved (54052 records). [2025-09-19T17:02:04.827889] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-19T17:02:04.828169] [INFO ] [MAIN ] Update Progress: 20/2372 symbols completed. ACI took 34.0s. Estimated remaining: 3h 56m 20s. Rate: 10.0 symbols/min [2025-09-19T17:02:04.998539] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:05.028386] [DEBUG] [LOCAL ] ACP: Loaded 31597 existing records from primary storage. [2025-09-19T17:02:05.028521] [INFO ] [MAIN ] ACP: Loaded 31597 existing records. [2025-09-19T17:02:05.203773] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:05.204021] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-19T17:02:05.204067] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-19T17:02:05.204873] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-19T17:02:05.204933] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-19T17:02:05.450486] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-19T17:02:05.576067] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:06.100139] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T17:02:06.107835] [INFO ] [REMOTE ] ACM: Full fetch complete (62539 records). [2025-09-19T17:02:06.108042] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-19T17:02:06.248438] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-19T17:02:06.520788] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-19T17:02:06.520902] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-19T17:02:06.521531] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-19T17:02:06.521579] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-19T17:02:06.523135] [DEBUG] [LOCAL ] ACM: Trimmed 62539 records to 43847 (keeping 200 days of data) [2025-09-19T17:02:06.793339] [DEBUG] [LOCAL ] ACM: Primary data saved (43847 records). [2025-09-19T17:02:06.793477] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-19T17:02:06.793578] [INFO ] [MAIN ] Update Progress: 21/2372 symbols completed. ACM took 27.4s. Estimated remaining: 3h 48m 39s. Rate: 10.3 symbols/min [2025-09-19T17:02:06.963374] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:06.971857] [DEBUG] [LOCAL ] ACR: Loaded 6525 existing records from primary storage. [2025-09-19T17:02:06.971962] [INFO ] [MAIN ] ACR: Loaded 6525 existing records. [2025-09-19T17:02:07.155289] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:07.155559] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-19T17:02:07.155615] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-19T17:02:07.155937] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-19T17:02:07.155996] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-19T17:02:07.525070] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:07.525818] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-19T17:02:07.569071] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-19T17:02:07.616395] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T17:02:07.659553] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T17:02:07.843286] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-19T17:02:08.066685] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T17:02:08.643283] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-19T17:02:09.149255] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T17:02:09.443259] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-19T17:02:09.576470] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T17:02:10.020372] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T17:02:10.243259] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-19T17:02:11.043287] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-19T17:02:11.804117] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:02:11.843273] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-19T17:02:12.435805] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:02:12.643264] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-19T17:02:13.443275] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-19T17:02:14.055593] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T17:02:14.243278] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-19T17:02:14.504261] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:02:14.960399] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-09-19T17:02:14.969632] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-19T17:02:14.969850] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-19T17:02:15.048329] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-19T17:02:15.340718] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T17:02:15.393255] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-19T17:02:15.393344] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-19T17:02:15.394127] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-19T17:02:15.394196] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-19T17:02:15.395873] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54598 (keeping 200 days of data) [2025-09-19T17:02:15.722485] [DEBUG] [LOCAL ] ACHR: Primary data saved (54598 records). [2025-09-19T17:02:15.722667] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-19T17:02:15.722779] [INFO ] [MAIN ] Update Progress: 22/2372 symbols completed. ACHR took 47.0s. Estimated remaining: 3h 54m 3s. Rate: 10.0 symbols/min [2025-09-19T17:02:15.848341] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-19T17:02:15.914561] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:15.914732] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-09-19T17:02:15.914778] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-09-19T17:02:15.914917] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-19T17:02:15.914959] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-19T17:02:15.915000] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-19T17:02:15.915032] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-19T17:02:16.278081] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:16.368619] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:02:16.643264] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-19T17:02:17.443266] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-19T17:02:18.243294] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-19T17:02:18.348989] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:02:18.531327] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-19T17:02:19.043320] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-19T17:02:19.265952] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:02:19.279169] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T17:02:19.843286] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-19T17:02:20.632849] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T17:02:20.643213] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-19T17:02:20.876471] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:02:20.885283] [INFO ] [REMOTE ] ACN: Full fetch complete (77092 records). [2025-09-19T17:02:20.885468] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-19T17:02:21.222850] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T17:02:21.305537] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-19T17:02:21.305663] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-19T17:02:21.306435] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-19T17:02:21.306484] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-19T17:02:21.308217] [DEBUG] [LOCAL ] ACN: Trimmed 77092 records to 54199 (keeping 200 days of data) [2025-09-19T17:02:21.443671] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-19T17:02:21.669902] [DEBUG] [LOCAL ] ACN: Primary data saved (54199 records). [2025-09-19T17:02:21.670060] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-19T17:02:21.670166] [INFO ] [MAIN ] Update Progress: 23/2372 symbols completed. ACN took 27.9s. Estimated remaining: 3h 53m 55s. Rate: 10.0 symbols/min [2025-09-19T17:02:21.844126] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:21.844345] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-09-19T17:02:21.844398] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-09-19T17:02:21.844540] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-19T17:02:21.844583] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-19T17:02:21.844624] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-09-19T17:02:21.844692] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-19T17:02:22.192088] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:22.243225] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-19T17:02:22.394084] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T17:02:22.395347] [INFO ] [REMOTE ] ACR: Full fetch complete (8582 records). [2025-09-19T17:02:22.395422] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-19T17:02:22.757322] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-19T17:02:22.757406] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-19T17:02:22.757600] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-19T17:02:22.757637] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-19T17:02:22.758114] [DEBUG] [LOCAL ] ACR: Trimmed 8582 records to 6555 (keeping 200 days of data) [2025-09-19T17:02:22.795429] [DEBUG] [LOCAL ] ACR: Primary data saved (6555 records). [2025-09-19T17:02:22.795550] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-19T17:02:22.795668] [INFO ] [MAIN ] Update Progress: 24/2372 symbols completed. ACR took 16.0s. Estimated remaining: 3h 45m 54s. Rate: 10.4 symbols/min [2025-09-19T17:02:22.968296] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:23.017205] [DEBUG] [LOCAL ] ACVA: Loaded 49750 existing records from primary storage. [2025-09-19T17:02:23.017363] [INFO ] [MAIN ] ACVA: Loaded 49750 existing records. [2025-09-19T17:02:23.049501] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-19T17:02:23.260849] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:23.261145] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-19T17:02:23.261196] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-19T17:02:23.262375] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-19T17:02:23.262445] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-19T17:02:23.419310] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T17:02:23.643416] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:23.843308] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-19T17:02:24.555867] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T17:02:24.643239] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-19T17:02:25.443317] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-19T17:02:25.536552] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T17:02:26.243289] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-19T17:02:26.343137] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T17:02:26.365004] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T17:02:27.043299] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-19T17:02:27.687777] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T17:02:27.694956] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T17:02:27.843224] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-19T17:02:28.643278] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-19T17:02:29.371923] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T17:02:29.443259] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-19T17:02:29.534228] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T17:02:30.243285] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-19T17:02:31.043267] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-19T17:02:31.279197] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T17:02:31.843327] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-19T17:02:32.242274] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T17:02:32.468835] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-19T17:02:32.643291] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-19T17:02:32.826870] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T17:02:33.443271] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-19T17:02:34.243251] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-19T17:02:34.417477] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T17:02:34.444907] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:02:35.043284] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-19T17:02:35.735317] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T17:02:35.843270] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-19T17:02:36.253600] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T17:02:36.643276] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-19T17:02:36.947352] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T17:02:37.443287] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-19T17:02:38.243324] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-19T17:02:38.609168] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T17:02:38.675726] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-19T17:02:39.049456] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-19T17:02:39.065986] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T17:02:39.657463] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T17:02:39.843281] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-19T17:02:40.643285] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-19T17:02:41.448339] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-19T17:02:41.461131] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:02:41.770363] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T17:02:42.243225] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-19T17:02:42.573886] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T17:02:42.575635] [INFO ] [REMOTE ] ACV: Full fetch complete (9618 records). [2025-09-19T17:02:42.575737] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-19T17:02:42.991154] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-19T17:02:42.991241] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-19T17:02:42.991461] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-19T17:02:42.991535] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-19T17:02:42.992072] [DEBUG] [LOCAL ] ACV: Trimmed 9618 records to 7006 (keeping 200 days of data) [2025-09-19T17:02:43.037981] [DEBUG] [LOCAL ] ACV: Primary data saved (7006 records). [2025-09-19T17:02:43.038127] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-19T17:02:43.038225] [INFO ] [MAIN ] Update Progress: 25/2372 symbols completed. ACV took 21.4s. Estimated remaining: 4h 8m 27s. Rate: 9.4 symbols/min [2025-09-19T17:02:43.050551] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-19T17:02:43.224272] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:43.224431] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-19T17:02:43.224469] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-19T17:02:43.224718] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-19T17:02:43.224775] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-19T17:02:43.224820] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-19T17:02:43.224865] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-19T17:02:43.609898] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:43.843276] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-19T17:02:44.302156] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:02:44.502550] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T17:02:44.643301] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-19T17:02:44.888211] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:44.888534] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-19T17:02:45.000313] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T17:02:45.443291] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-19T17:02:45.670164] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:45.670589] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-19T17:02:46.243318] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-19T17:02:47.043322] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-19T17:02:47.721828] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T17:02:47.843271] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-19T17:02:48.549359] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:02:48.554464] [INFO ] [REMOTE ] ACRE: Full fetch complete (50461 records). [2025-09-19T17:02:48.554580] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-19T17:02:48.648519] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-19T17:02:48.986717] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-19T17:02:48.986812] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-19T17:02:48.987469] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-19T17:02:48.987545] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-19T17:02:48.988851] [DEBUG] [LOCAL ] ACRE: Trimmed 50461 records to 34131 (keeping 200 days of data) [2025-09-19T17:02:49.195559] [DEBUG] [LOCAL ] ACRE: Primary data saved (34131 records). [2025-09-19T17:02:49.195769] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-19T17:02:49.195911] [INFO ] [MAIN ] Update Progress: 26/2372 symbols completed. ACRE took 33.5s. Estimated remaining: 4h 8m 3s. Rate: 9.5 symbols/min [2025-09-19T17:02:49.363533] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:49.411227] [DEBUG] [LOCAL ] ADC: Loaded 46911 existing records from primary storage. [2025-09-19T17:02:49.411433] [INFO ] [MAIN ] ADC: Loaded 46911 existing records. [2025-09-19T17:02:49.448542] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-19T17:02:49.613764] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:49.614028] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-19T17:02:49.614081] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-19T17:02:49.615375] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-19T17:02:49.615440] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-19T17:02:49.732452] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:49.759278] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-19T17:02:50.013889] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:50.046466] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T17:02:50.221796] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T17:02:50.243286] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-19T17:02:51.043287] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-19T17:02:51.783913] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T17:02:51.789050] [INFO ] [REMOTE ] ACP: Full fetch complete (47894 records). [2025-09-19T17:02:51.789229] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-19T17:02:51.843320] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-19T17:02:52.133091] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:52.165506] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-19T17:02:52.183548] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-19T17:02:52.183638] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-19T17:02:52.184214] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-19T17:02:52.184276] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-19T17:02:52.186892] [DEBUG] [LOCAL ] ACP: Trimmed 47894 records to 31749 (keeping 200 days of data) [2025-09-19T17:02:52.383006] [DEBUG] [LOCAL ] ACP: Primary data saved (31749 records). [2025-09-19T17:02:52.383159] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-19T17:02:52.383246] [INFO ] [MAIN ] Update Progress: 27/2372 symbols completed. ACP took 47.6s. Estimated remaining: 4h 3m 22s. Rate: 9.6 symbols/min [2025-09-19T17:02:52.587769] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:02:52.646748] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-19T17:02:52.650546] [DEBUG] [LOCAL ] ADCT: Loaded 33823 existing records from primary storage. [2025-09-19T17:02:52.652331] [INFO ] [MAIN ] ADCT: Loaded 33823 existing records. [2025-09-19T17:02:52.694546] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T17:02:52.851938] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:02:52.852230] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-19T17:02:52.852309] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-19T17:02:52.853182] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-19T17:02:52.853260] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-19T17:02:52.932517] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:52.959037] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-19T17:02:53.239359] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:02:53.443278] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-19T17:02:54.243293] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-19T17:02:55.043268] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-19T17:02:55.273392] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:55.273889] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-19T17:02:55.441361] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T17:02:55.546218] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T17:02:55.843318] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-19T17:02:56.643284] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-19T17:02:57.443305] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-19T17:02:57.675537] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T17:02:57.930174] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:02:58.243281] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-19T17:02:58.980431] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T17:02:59.043260] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-19T17:02:59.299686] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:02:59.300003] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-19T17:02:59.587607] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T17:02:59.843266] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-19T17:03:00.074694] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:03:00.074999] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-19T17:03:00.643268] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-19T17:03:01.443274] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-19T17:03:02.243274] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-19T17:03:02.605890] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:03:03.043288] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-19T17:03:03.843286] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-19T17:03:04.474541] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-09-19T17:03:04.653220] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-19T17:03:04.655789] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T17:03:05.443277] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-19T17:03:05.770470] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-19T17:03:06.243335] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-19T17:03:06.300412] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-19T17:03:06.652467] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T17:03:06.656614] [INFO ] [REMOTE ] AD: Full fetch complete (5589 records). [2025-09-19T17:03:06.656771] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-19T17:03:06.870111] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 28 unique days, need 200 days [2025-09-19T17:03:06.870453] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:03:06.870543] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:03:06.870665] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-19T17:03:06.870784] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-19T17:03:06.870862] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-19T17:03:06.870951] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-19T17:03:06.871094] [INFO ] [MAIN ] Update Progress: 28/2372 symbols completed. AD took 23.8s. Estimated remaining: 4h 14m 48s. Rate: 9.2 symbols/min [2025-09-19T17:03:07.044274] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-19T17:03:07.069593] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:07.107614] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-19T17:03:07.142863] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:03:07.197036] [DEBUG] [LOCAL ] ADM: Loaded 53786 existing records from primary storage. [2025-09-19T17:03:07.197316] [INFO ] [MAIN ] ADM: Loaded 53786 existing records. [2025-09-19T17:03:07.398851] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:07.399193] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-19T17:03:07.399248] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-19T17:03:07.401235] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-19T17:03:07.401309] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-19T17:03:07.818603] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:07.843221] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-19T17:03:08.643290] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-19T17:03:09.376913] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-19T17:03:09.384769] [INFO ] [REMOTE ] ACVA: Full fetch complete (70133 records). [2025-09-19T17:03:09.384941] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-19T17:03:09.449426] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-19T17:03:09.825533] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-19T17:03:09.826068] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-19T17:03:09.826914] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-19T17:03:09.827049] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-19T17:03:09.838287] [DEBUG] [LOCAL ] ACVA: Trimmed 70133 records to 50110 (keeping 200 days of data) [2025-09-19T17:03:09.853560] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T17:03:10.127044] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T17:03:10.209386] [DEBUG] [LOCAL ] ACVA: Primary data saved (50110 records). [2025-09-19T17:03:10.209559] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-19T17:03:10.209677] [INFO ] [MAIN ] Update Progress: 29/2372 symbols completed. ACVA took 47.4s. Estimated remaining: 4h 10m 24s. Rate: 9.4 symbols/min [2025-09-19T17:03:10.252564] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-19T17:03:10.392225] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:10.439040] [DEBUG] [LOCAL ] ADNT: Loaded 48010 existing records from primary storage. [2025-09-19T17:03:10.439195] [INFO ] [MAIN ] ADNT: Loaded 48010 existing records. [2025-09-19T17:03:10.622896] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:10.623233] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-19T17:03:10.623290] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-19T17:03:10.624460] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-19T17:03:10.624523] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-19T17:03:10.980892] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:11.043273] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-19T17:03:11.309728] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T17:03:11.843245] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-19T17:03:11.927636] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T17:03:12.643257] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-19T17:03:12.733954] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T17:03:13.443258] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-19T17:03:14.243237] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-19T17:03:14.308697] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T17:03:15.043261] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-19T17:03:15.979534] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-19T17:03:15.994126] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-19T17:03:16.084154] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (3.44 seconds). [2025-09-19T17:03:16.605699] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-19T17:03:16.643223] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-19T17:03:17.443283] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-19T17:03:17.719720] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T17:03:17.829307] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-19T17:03:18.243266] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-19T17:03:18.486904] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T17:03:19.043291] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-19T17:03:19.633238] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T17:03:19.725031] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T17:03:19.843294] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-19T17:03:20.643273] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-19T17:03:20.900000] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T17:03:21.443296] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-19T17:03:22.069045] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T17:03:22.243329] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-19T17:03:22.303370] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:03:22.309411] [INFO ] [REMOTE ] ADCT: Full fetch complete (51527 records). [2025-09-19T17:03:22.309555] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-19T17:03:22.735383] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-19T17:03:22.735560] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-19T17:03:22.736146] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-19T17:03:22.736214] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-19T17:03:22.737831] [DEBUG] [LOCAL ] ADCT: Trimmed 51527 records to 34128 (keeping 200 days of data) [2025-09-19T17:03:22.932786] [DEBUG] [LOCAL ] ADCT: Primary data saved (34128 records). [2025-09-19T17:03:22.932926] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-19T17:03:22.933012] [INFO ] [MAIN ] Update Progress: 30/2372 symbols completed. ADCT took 30.5s. Estimated remaining: 4h 18m 30s. Rate: 9.1 symbols/min [2025-09-19T17:03:23.048424] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-19T17:03:23.111375] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:23.165867] [DEBUG] [LOCAL ] ADT: Loaded 53843 existing records from primary storage. [2025-09-19T17:03:23.166042] [INFO ] [MAIN ] ADT: Loaded 53843 existing records. [2025-09-19T17:03:23.351065] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:23.351387] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-19T17:03:23.351439] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-19T17:03:23.352623] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-19T17:03:23.352717] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-19T17:03:23.718565] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:23.818105] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T17:03:23.843211] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-19T17:03:24.529795] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-19T17:03:24.643283] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-19T17:03:24.995258] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T17:03:25.001666] [INFO ] [REMOTE ] ADC: Full fetch complete (65638 records). [2025-09-19T17:03:25.001783] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-19T17:03:25.005484] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:03:25.005582] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:03:25.005627] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:03:25.005713] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-19T17:03:25.005778] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-19T17:03:25.005815] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-09-19T17:03:25.006308] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-09-19T17:03:25.006405] [INFO ] [MAIN ] Update Progress: 31/2372 symbols completed. ADC took 35.8s. Estimated remaining: 4h 12m 40s. Rate: 9.3 symbols/min [2025-09-19T17:03:25.179398] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:25.217877] [DEBUG] [LOCAL ] ADX: Loaded 28341 existing records from primary storage. [2025-09-19T17:03:25.218106] [INFO ] [MAIN ] ADX: Loaded 28341 existing records. [2025-09-19T17:03:25.396738] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:25.396990] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-19T17:03:25.397039] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-19T17:03:25.398042] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-19T17:03:25.398104] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-19T17:03:25.461190] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-19T17:03:25.766959] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:25.796264] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T17:03:26.243320] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-19T17:03:27.043249] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-19T17:03:27.144722] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-19T17:03:27.843331] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-19T17:03:28.272585] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T17:03:28.643344] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-19T17:03:28.979975] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (3.52 seconds). [2025-09-19T17:03:29.099791] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T17:03:29.440638] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T17:03:29.451627] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-19T17:03:29.839062] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T17:03:30.243319] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-19T17:03:31.043281] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-19T17:03:31.436385] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T17:03:31.843301] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-19T17:03:32.264547] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T17:03:32.643309] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-19T17:03:33.443278] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-19T17:03:33.623434] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-19T17:03:33.823498] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T17:03:33.952329] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T17:03:34.243303] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-19T17:03:34.558098] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T17:03:35.043299] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-19T17:03:35.843272] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-19T17:03:36.137814] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T17:03:36.403154] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T17:03:36.643329] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-19T17:03:37.227994] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T17:03:37.235323] [INFO ] [REMOTE ] ADNT: Full fetch complete (68162 records). [2025-09-19T17:03:37.235490] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-19T17:03:37.448464] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-19T17:03:37.641694] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-19T17:03:37.641781] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-19T17:03:37.642520] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-19T17:03:37.642622] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-19T17:03:37.644065] [DEBUG] [LOCAL ] ADNT: Trimmed 68162 records to 48333 (keeping 200 days of data) [2025-09-19T17:03:37.757886] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T17:03:37.952336] [DEBUG] [LOCAL ] ADNT: Primary data saved (48333 records). [2025-09-19T17:03:37.952509] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-19T17:03:37.952625] [INFO ] [MAIN ] Update Progress: 32/2372 symbols completed. ADNT took 27.7s. Estimated remaining: 4h 20m 27s. Rate: 9.0 symbols/min [2025-09-19T17:03:38.122012] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:38.182672] [DEBUG] [LOCAL ] AEE: Loaded 50683 existing records from primary storage. [2025-09-19T17:03:38.182828] [INFO ] [MAIN ] AEE: Loaded 50683 existing records. [2025-09-19T17:03:38.248398] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-19T17:03:38.385135] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:38.385417] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-19T17:03:38.385476] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-19T17:03:38.386687] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-19T17:03:38.386753] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-19T17:03:38.813509] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:39.044583] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-19T17:03:39.843343] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-19T17:03:40.014304] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-19T17:03:40.044966] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T17:03:40.096110] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T17:03:40.104710] [INFO ] [REMOTE ] ADM: Full fetch complete (77213 records). [2025-09-19T17:03:40.104907] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-19T17:03:40.499134] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-19T17:03:40.499226] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-19T17:03:40.499950] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-19T17:03:40.500014] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-19T17:03:40.501452] [DEBUG] [LOCAL ] ADM: Trimmed 77213 records to 54176 (keeping 200 days of data) [2025-09-19T17:03:40.684105] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-19T17:03:40.839549] [DEBUG] [LOCAL ] ADM: Primary data saved (54176 records). [2025-09-19T17:03:40.839737] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-19T17:03:40.839838] [INFO ] [MAIN ] Update Progress: 33/2372 symbols completed. ADM took 34.0s. Estimated remaining: 4h 15m 51s. Rate: 9.1 symbols/min [2025-09-19T17:03:41.016408] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:41.026424] [DEBUG] [LOCAL ] AEFC: Loaded 8742 existing records from primary storage. [2025-09-19T17:03:41.026546] [INFO ] [MAIN ] AEFC: Loaded 8742 existing records. [2025-09-19T17:03:41.207877] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:41.208206] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-19T17:03:41.208281] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-19T17:03:41.208795] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-19T17:03:41.208861] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-19T17:03:41.455270] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-19T17:03:41.604157] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:41.902263] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:03:42.243273] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-19T17:03:42.734228] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T17:03:43.049479] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-19T17:03:43.054416] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T17:03:43.069783] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T17:03:43.843265] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-19T17:03:44.643276] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-19T17:03:45.057389] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:03:45.443322] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-19T17:03:45.623756] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T17:03:45.677029] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T17:03:46.243298] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-19T17:03:47.043330] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-19T17:03:47.190295] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T17:03:47.340072] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T17:03:47.843293] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-19T17:03:48.232096] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T17:03:48.643285] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-19T17:03:49.443301] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-19T17:03:49.613429] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T17:03:49.996365] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:03:50.243260] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-19T17:03:50.382291] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T17:03:50.386773] [INFO ] [REMOTE ] ADX: Full fetch complete (42182 records). [2025-09-19T17:03:50.386904] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-19T17:03:50.776626] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-19T17:03:50.776746] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-19T17:03:50.777220] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-19T17:03:50.777265] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-19T17:03:50.778391] [DEBUG] [LOCAL ] ADX: Trimmed 42182 records to 28540 (keeping 200 days of data) [2025-09-19T17:03:50.956622] [DEBUG] [LOCAL ] ADX: Primary data saved (28540 records). [2025-09-19T17:03:50.956826] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-19T17:03:50.957010] [INFO ] [MAIN ] Update Progress: 34/2372 symbols completed. ADX took 26.0s. Estimated remaining: 4h 19m 49s. Rate: 9.0 symbols/min [2025-09-19T17:03:51.048391] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-19T17:03:51.127255] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:51.171973] [DEBUG] [LOCAL ] AEG: Loaded 49975 existing records from primary storage. [2025-09-19T17:03:51.172115] [INFO ] [MAIN ] AEG: Loaded 49975 existing records. [2025-09-19T17:03:51.347872] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:51.348125] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-19T17:03:51.348171] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-19T17:03:51.349366] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-19T17:03:51.349428] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-19T17:03:51.724850] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:51.843281] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-19T17:03:52.260773] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:03:52.268541] [INFO ] [REMOTE ] ADT: Full fetch complete (77202 records). [2025-09-19T17:03:52.268737] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-19T17:03:52.648449] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-19T17:03:52.672208] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-19T17:03:52.672366] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-19T17:03:52.674684] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-19T17:03:52.674949] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-19T17:03:52.676636] [DEBUG] [LOCAL ] ADT: Trimmed 77202 records to 54231 (keeping 200 days of data) [2025-09-19T17:03:52.897842] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T17:03:53.015858] [DEBUG] [LOCAL ] ADT: Primary data saved (54231 records). [2025-09-19T17:03:53.016024] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-19T17:03:53.016113] [INFO ] [MAIN ] Update Progress: 35/2372 symbols completed. ADT took 30.1s. Estimated remaining: 4h 14m 35s. Rate: 9.2 symbols/min [2025-09-19T17:03:53.191721] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:03:53.237603] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T17:03:53.289422] [DEBUG] [LOCAL ] AEM: Loaded 53854 existing records from primary storage. [2025-09-19T17:03:53.289568] [INFO ] [MAIN ] AEM: Loaded 53854 existing records. [2025-09-19T17:03:53.448342] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-19T17:03:53.482626] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:03:53.482972] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-19T17:03:53.483030] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-19T17:03:53.485783] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-19T17:03:53.485850] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-19T17:03:53.858989] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:03:54.243284] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-19T17:03:54.560871] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T17:03:54.581791] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T17:03:55.043269] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-19T17:03:55.843269] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-19T17:03:55.969917] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T17:03:56.325608] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T17:03:56.643269] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-19T17:03:57.443313] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-19T17:03:57.953318] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T17:03:58.108546] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T17:03:58.243263] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-19T17:03:58.394458] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:03:59.043294] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-19T17:03:59.848385] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-19T17:03:59.864141] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T17:04:00.643290] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-19T17:04:01.343552] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T17:04:01.443296] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-19T17:04:01.838158] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T17:04:02.243263] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-19T17:04:02.436111] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T17:04:03.043273] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-19T17:04:03.416128] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-19T17:04:03.793333] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T17:04:03.794871] [INFO ] [REMOTE ] AEFC: Full fetch complete (12443 records). [2025-09-19T17:04:03.794947] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-19T17:04:03.851948] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-19T17:04:04.181118] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:04:04.205960] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-19T17:04:04.214611] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-19T17:04:04.215319] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-19T17:04:04.215707] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-19T17:04:04.216243] [DEBUG] [LOCAL ] AEFC: Trimmed 12443 records to 8763 (keeping 200 days of data) [2025-09-19T17:04:04.268833] [DEBUG] [LOCAL ] AEFC: Primary data saved (8763 records). [2025-09-19T17:04:04.268974] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-19T17:04:04.269059] [INFO ] [MAIN ] Update Progress: 36/2372 symbols completed. AEFC took 23.4s. Estimated remaining: 4h 19m 34s. Rate: 9.0 symbols/min [2025-09-19T17:04:04.448312] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:04.507123] [DEBUG] [LOCAL ] AEO: Loaded 53947 existing records from primary storage. [2025-09-19T17:04:04.507274] [INFO ] [MAIN ] AEO: Loaded 53947 existing records. [2025-09-19T17:04:04.651184] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-19T17:04:04.693384] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:04.693680] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-19T17:04:04.693754] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-19T17:04:04.695015] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-19T17:04:04.695075] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-19T17:04:05.069212] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:05.443281] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-19T17:04:06.243290] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-19T17:04:06.288768] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T17:04:06.346543] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T17:04:07.043279] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-19T17:04:07.230900] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:04:07.779372] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T17:04:07.843237] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-19T17:04:08.643268] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-19T17:04:09.443277] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-19T17:04:09.629155] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-19T17:04:10.166265] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T17:04:10.243243] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-19T17:04:10.715188] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T17:04:10.998263] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T17:04:11.043234] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-19T17:04:11.843272] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-19T17:04:12.270702] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:04:12.643274] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-19T17:04:13.398672] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T17:04:13.443219] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-19T17:04:14.089529] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T17:04:14.243262] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-19T17:04:14.473023] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T17:04:15.043303] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-19T17:04:15.386828] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:04:15.621894] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:04:15.843315] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-19T17:04:16.594701] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T17:04:16.643241] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-19T17:04:17.443323] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-19T17:04:18.207330] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-19T17:04:18.243231] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-19T17:04:18.840553] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T17:04:19.043303] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-19T17:04:19.654725] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T17:04:19.843271] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-19T17:04:20.167336] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T17:04:20.643371] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-19T17:04:21.139877] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:04:21.443320] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-19T17:04:21.877775] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T17:04:22.243332] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-19T17:04:22.610675] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T17:04:22.618091] [INFO ] [REMOTE ] AEM: Full fetch complete (76712 records). [2025-09-19T17:04:22.618241] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-19T17:04:22.619541] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:04:22.619684] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:04:22.619740] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:04:22.619821] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-19T17:04:22.619905] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-19T17:04:22.619944] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-09-19T17:04:22.620371] [DEBUG] [LOCAL ] AEM: Deleted derivative data file. [2025-09-19T17:04:22.620494] [INFO ] [MAIN ] Update Progress: 37/2372 symbols completed. AEM took 29.6s. Estimated remaining: 4h 31m 45s. Rate: 8.6 symbols/min [2025-09-19T17:04:23.043274] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-19T17:04:23.637761] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T17:04:23.843309] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-19T17:04:24.228413] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T17:04:24.235464] [INFO ] [REMOTE ] AEE: Full fetch complete (72162 records). [2025-09-19T17:04:24.235606] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-19T17:04:24.236452] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:04:24.236544] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:04:24.236589] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:04:24.236635] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-19T17:04:24.236736] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-19T17:04:24.236776] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-09-19T17:04:24.237159] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-09-19T17:04:24.238223] [INFO ] [MAIN ] Update Progress: 38/2372 symbols completed. AEE took 46.3s. Estimated remaining: 4h 26m 9s. Rate: 8.8 symbols/min [2025-09-19T17:04:25.646027] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T17:04:25.657046] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-19T17:04:25.761833] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-19T17:04:25.774202] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-19T17:04:27.676699] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:04:27.686526] [INFO ] [REMOTE ] AEG: Full fetch complete (70121 records). [2025-09-19T17:04:27.686798] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-19T17:04:27.814520] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T17:04:27.881914] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-19T17:04:28.146820] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-19T17:04:28.146919] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-19T17:04:28.147697] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-19T17:04:28.147767] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-19T17:04:28.149317] [DEBUG] [LOCAL ] AEG: Trimmed 70121 records to 50293 (keeping 200 days of data) [2025-09-19T17:04:28.441349] [DEBUG] [LOCAL ] AEG: Primary data saved (50293 records). [2025-09-19T17:04:28.441494] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-19T17:04:28.441595] [INFO ] [MAIN ] Update Progress: 39/2372 symbols completed. AEG took 37.5s. Estimated remaining: 4h 23m 24s. Rate: 8.9 symbols/min [2025-09-19T17:04:30.499108] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-19T17:04:30.507722] [INFO ] [REMOTE ] AEO: Full fetch complete (77446 records). [2025-09-19T17:04:30.507894] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-19T17:04:30.906914] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-19T17:04:30.907004] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-19T17:04:30.907791] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-19T17:04:30.907874] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-19T17:04:30.909471] [DEBUG] [LOCAL ] AEO: Trimmed 77446 records to 54337 (keeping 200 days of data) [2025-09-19T17:04:31.239948] [DEBUG] [LOCAL ] AEO: Primary data saved (54337 records). [2025-09-19T17:04:31.240098] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-19T17:04:31.240209] [INFO ] [MAIN ] Update Progress: 40/2372 symbols completed. AEO took 27.0s. Estimated remaining: 4h 19m 25s. Rate: 9.0 symbols/min [2025-09-19T17:04:31.933084] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:31.967467] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:32.004104] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:32.042404] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-09-19T17:04:32.042820] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-09-19T17:04:32.079104] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-19T17:04:32.087536] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:32.088171] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-09-19T17:04:32.087889] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-19T17:04:32.088405] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-09-19T17:04:32.088637] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-09-19T17:04:32.088937] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-19T17:04:32.089005] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-19T17:04:32.089177] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-19T17:04:32.089283] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-19T17:04:32.089362] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-19T17:04:32.677770] [DEBUG] [LOCAL ] AES: Loaded 54064 existing records from primary storage. [2025-09-19T17:04:32.736065] [DEBUG] [LOCAL ] AER: Loaded 49227 existing records from primary storage. [2025-09-19T17:04:32.740938] [INFO ] [MAIN ] AES: Loaded 54064 existing records. [2025-09-19T17:04:32.816804] [INFO ] [MAIN ] AER: Loaded 49227 existing records. [2025-09-19T17:04:33.465487] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:33.481349] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-19T17:04:33.560620] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:33.627941] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-19T17:04:33.622948] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:33.665129] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-19T17:04:33.665030] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:33.665845] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-19T17:04:33.665546] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-19T17:04:33.666085] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-19T17:04:33.667017] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-19T17:04:33.667098] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-19T17:04:33.678992] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-19T17:04:33.688586] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-19T17:04:34.398280] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:34.415870] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-19T17:04:34.419708] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:34.420955] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-19T17:04:34.714750] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T17:04:34.717602] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-19T17:04:35.676088] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:04:35.685417] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-19T17:04:35.721107] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T17:04:35.724252] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-19T17:04:36.251697] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T17:04:36.260956] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-19T17:04:36.794813] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T17:04:36.797856] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-19T17:04:37.186845] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-19T17:04:37.197774] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-19T17:04:37.480202] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:04:37.489622] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-19T17:04:37.559830] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:04:37.563556] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-19T17:04:37.637329] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T17:04:37.646885] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-19T17:04:38.821863] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T17:04:38.825621] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-19T17:04:39.080278] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T17:04:39.090175] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-19T17:04:39.355088] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-19T17:04:39.357997] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-19T17:04:39.578452] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:04:39.843306] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-19T17:04:39.884623] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T17:04:39.902806] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:04:40.566861] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T17:04:40.643286] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-19T17:04:41.217388] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T17:04:41.443284] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-19T17:04:41.943333] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T17:04:42.243277] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-19T17:04:42.405817] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T17:04:43.043293] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-19T17:04:43.843285] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-19T17:04:44.220911] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T17:04:44.643292] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-19T17:04:44.676125] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:04:45.443270] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-19T17:04:45.960151] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T17:04:46.017727] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T17:04:46.243322] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-19T17:04:46.731276] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T17:04:47.043316] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-19T17:04:47.843286] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-19T17:04:47.870419] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T17:04:47.873184] [INFO ] [REMOTE ] AFB: Full fetch complete (16523 records). [2025-09-19T17:04:47.873467] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-19T17:04:48.075283] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T17:04:48.298661] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-19T17:04:48.298772] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-19T17:04:48.299043] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-19T17:04:48.299085] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-19T17:04:48.299723] [DEBUG] [LOCAL ] AFB: Trimmed 16523 records to 11692 (keeping 200 days of data) [2025-09-19T17:04:48.373214] [DEBUG] [LOCAL ] AFB: Primary data saved (11692 records). [2025-09-19T17:04:48.373357] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-19T17:04:48.373435] [INFO ] [MAIN ] Update Progress: 41/2372 symbols completed. AFB took 17.1s. Estimated remaining: 4h 29m 13s. Rate: 8.7 symbols/min [2025-09-19T17:04:48.542474] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:48.580607] [DEBUG] [LOCAL ] AFG: Loaded 32981 existing records from primary storage. [2025-09-19T17:04:48.580786] [INFO ] [MAIN ] AFG: Loaded 32981 existing records. [2025-09-19T17:04:48.651873] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-19T17:04:48.792548] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:48.792826] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-19T17:04:48.792882] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-19T17:04:48.794925] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-19T17:04:48.794988] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-19T17:04:49.189747] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:49.443311] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-19T17:04:49.846615] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T17:04:50.243281] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-19T17:04:50.554852] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T17:04:51.043263] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-19T17:04:51.127304] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:04:51.843260] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-19T17:04:52.586411] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:04:52.629389] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-19T17:04:52.643224] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-19T17:04:53.278453] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:04:53.443255] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-19T17:04:54.248368] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-19T17:04:54.264614] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:04:55.043266] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-19T17:04:55.477249] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T17:04:55.484831] [INFO ] [REMOTE ] AESI: Full fetch complete (70177 records). [2025-09-19T17:04:55.484965] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-19T17:04:55.844266] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-19T17:04:55.890261] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-19T17:04:55.890440] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-19T17:04:55.891223] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-19T17:04:55.891307] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-19T17:04:55.893059] [DEBUG] [LOCAL ] AESI: Trimmed 70177 records to 50259 (keeping 200 days of data) [2025-09-19T17:04:56.007383] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:04:56.235900] [DEBUG] [LOCAL ] AESI: Primary data saved (50259 records). [2025-09-19T17:04:56.236052] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-19T17:04:56.236136] [INFO ] [MAIN ] Update Progress: 42/2372 symbols completed. AESI took 25.0s. Estimated remaining: 4h 29m 58s. Rate: 8.6 symbols/min [2025-09-19T17:04:56.414252] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:04:56.418571] [DEBUG] [LOCAL ] AFGB: Loaded 2536 existing records from primary storage. [2025-09-19T17:04:56.418692] [INFO ] [MAIN ] AFGB: Loaded 2536 existing records. [2025-09-19T17:04:56.604080] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:04:56.604438] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-19T17:04:56.604546] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-19T17:04:56.614287] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-19T17:04:56.627555] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-19T17:04:56.661502] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-19T17:04:56.675705] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T17:04:57.011125] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:04:57.443277] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-19T17:04:57.772515] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T17:04:58.243298] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-19T17:04:58.476498] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:04:59.043238] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-19T17:04:59.754349] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-19T17:04:59.762267] [INFO ] [REMOTE ] AER: Full fetch complete (69468 records). [2025-09-19T17:04:59.762459] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-19T17:04:59.857974] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-19T17:05:00.183604] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-19T17:05:00.183769] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-19T17:05:00.184696] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-19T17:05:00.184795] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-19T17:05:00.186495] [DEBUG] [LOCAL ] AER: Trimmed 69468 records to 49562 (keeping 200 days of data) [2025-09-19T17:05:00.358055] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T17:05:00.552364] [DEBUG] [LOCAL ] AER: Primary data saved (49562 records). [2025-09-19T17:05:00.552502] [INFO ] [MAIN ] AER: Full history saved. [2025-09-19T17:05:00.552603] [INFO ] [MAIN ] Update Progress: 43/2372 symbols completed. AER took 29.3s. Estimated remaining: 4h 27m 28s. Rate: 8.7 symbols/min [2025-09-19T17:05:00.648989] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-19T17:05:00.723546] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T17:05:00.727188] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:00.732884] [DEBUG] [LOCAL ] AFGC: Loaded 2566 existing records from primary storage. [2025-09-19T17:05:00.732957] [INFO ] [MAIN ] AFGC: Loaded 2566 existing records. [2025-09-19T17:05:00.913303] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:00.913780] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-19T17:05:00.913860] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-19T17:05:00.914169] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-19T17:05:00.914314] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-19T17:05:01.144316] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T17:05:01.305185] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:01.443267] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-19T17:05:02.023404] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T17:05:02.243279] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-19T17:05:03.043311] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-19T17:05:03.148371] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-19T17:05:03.650607] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T17:05:03.653040] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:05:03.843316] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-19T17:05:04.643311] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-19T17:05:05.208361] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T17:05:05.443344] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-19T17:05:06.010128] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T17:05:06.243277] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-19T17:05:06.537160] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T17:05:07.043279] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-19T17:05:07.843233] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-19T17:05:08.172566] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-19T17:05:08.624620] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T17:05:08.643231] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-19T17:05:08.723461] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T17:05:09.222363] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T17:05:09.443239] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-19T17:05:10.243260] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-19T17:05:10.278037] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T17:05:11.043257] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-19T17:05:11.586573] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T17:05:11.812054] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T17:05:11.843217] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-19T17:05:12.643261] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-19T17:05:13.035263] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:05:13.040300] [INFO ] [REMOTE ] AFG: Full fetch complete (45703 records). [2025-09-19T17:05:13.040394] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-19T17:05:13.411200] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-19T17:05:13.411277] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-19T17:05:13.411751] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-19T17:05:13.411814] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-19T17:05:13.412790] [DEBUG] [LOCAL ] AFG: Trimmed 45703 records to 33259 (keeping 200 days of data) [2025-09-19T17:05:13.468010] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-19T17:05:13.625376] [DEBUG] [LOCAL ] AFG: Primary data saved (33259 records). [2025-09-19T17:05:13.625544] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-19T17:05:13.625735] [INFO ] [MAIN ] Update Progress: 44/2372 symbols completed. AFG took 25.3s. Estimated remaining: 4h 32m 49s. Rate: 8.5 symbols/min [2025-09-19T17:05:13.794664] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:13.798380] [DEBUG] [LOCAL ] AFGD: Loaded 1906 existing records from primary storage. [2025-09-19T17:05:13.798488] [INFO ] [MAIN ] AFGD: Loaded 1906 existing records. [2025-09-19T17:05:13.975525] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:13.975795] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-19T17:05:13.975849] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-19T17:05:13.976108] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-19T17:05:13.976176] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-19T17:05:14.259744] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-19T17:05:14.360023] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:14.413880] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:05:14.751847] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-19T17:05:14.964168] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-19T17:05:14.973083] [INFO ] [REMOTE ] AES: Full fetch complete (77726 records). [2025-09-19T17:05:14.973232] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-19T17:05:15.048362] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-19T17:05:15.369060] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-19T17:05:15.369160] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-19T17:05:15.369955] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-19T17:05:15.370023] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-19T17:05:15.372490] [DEBUG] [LOCAL ] AES: Trimmed 77726 records to 54454 (keeping 200 days of data) [2025-09-19T17:05:15.721165] [DEBUG] [LOCAL ] AES: Primary data saved (54454 records). [2025-09-19T17:05:15.721407] [INFO ] [MAIN ] AES: Full history saved. [2025-09-19T17:05:15.721537] [INFO ] [MAIN ] Update Progress: 45/2372 symbols completed. AES took 44.5s. Estimated remaining: 4h 28m 26s. Rate: 8.7 symbols/min [2025-09-19T17:05:15.810286] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T17:05:15.848343] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-19T17:05:15.910360] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:15.916798] [DEBUG] [LOCAL ] AFGE: Loaded 2533 existing records from primary storage. [2025-09-19T17:05:15.916905] [INFO ] [MAIN ] AFGE: Loaded 2533 existing records. [2025-09-19T17:05:16.091833] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:16.092106] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-19T17:05:16.092155] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-19T17:05:16.092386] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-19T17:05:16.092462] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-19T17:05:16.446867] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:16.640555] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T17:05:16.643201] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-19T17:05:17.221339] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T17:05:17.443265] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-19T17:05:18.243272] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-19T17:05:18.353474] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T17:05:18.651675] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T17:05:19.043310] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-19T17:05:19.559866] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-19T17:05:19.843278] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-19T17:05:20.429102] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:05:20.643297] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-19T17:05:21.376706] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T17:05:21.443322] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-19T17:05:22.172142] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T17:05:22.243235] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-19T17:05:23.043244] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-19T17:05:23.136224] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T17:05:23.137301] [INFO ] [REMOTE ] AFGC: Full fetch complete (3697 records). [2025-09-19T17:05:23.137410] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-19T17:05:23.137912] [FATAL] [VALIDATOR ] AFGC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:05:23.137996] [FATAL] [MAIN ] AFGC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:05:23.138048] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:05:23.138131] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-19T17:05:23.138227] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-09-19T17:05:23.138315] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-09-19T17:05:23.138766] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-09-19T17:05:23.139010] [INFO ] [MAIN ] Update Progress: 46/2372 symbols completed. AFGC took 22.6s. Estimated remaining: 4h 28m 45s. Rate: 8.7 symbols/min [2025-09-19T17:05:23.308619] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:23.385011] [DEBUG] [LOCAL ] AFL: Loaded 53537 existing records from primary storage. [2025-09-19T17:05:23.385196] [INFO ] [MAIN ] AFL: Loaded 53537 existing records. [2025-09-19T17:05:23.567926] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:23.568370] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-19T17:05:23.568425] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-19T17:05:23.569879] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-19T17:05:23.569951] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-19T17:05:23.685665] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-19T17:05:23.848382] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-19T17:05:23.940069] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:24.534364] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-19T17:05:24.643267] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-19T17:05:25.443281] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-19T17:05:26.014214] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-19T17:05:26.243260] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-19T17:05:26.625742] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-19T17:05:26.791691] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T17:05:27.043277] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-19T17:05:27.843287] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-19T17:05:28.231933] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-19T17:05:28.643255] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-19T17:05:29.209324] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T17:05:29.252159] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T17:05:29.443273] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-19T17:05:30.108189] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T17:05:30.109357] [INFO ] [REMOTE ] AFGB: Full fetch complete (3632 records). [2025-09-19T17:05:30.109428] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-19T17:05:30.109846] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:05:30.109931] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:05:30.109973] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:05:30.110054] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-19T17:05:30.110134] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-09-19T17:05:30.110200] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-09-19T17:05:30.110554] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-09-19T17:05:30.110688] [INFO ] [MAIN ] Update Progress: 47/2372 symbols completed. AFGB took 33.9s. Estimated remaining: 4h 28m 40s. Rate: 8.7 symbols/min [2025-09-19T17:05:30.250886] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-19T17:05:30.285867] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:30.359993] [DEBUG] [LOCAL ] AG: Loaded 54031 existing records from primary storage. [2025-09-19T17:05:30.360188] [INFO ] [MAIN ] AG: Loaded 54031 existing records. [2025-09-19T17:05:30.553382] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:30.553680] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-19T17:05:30.553740] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-19T17:05:30.555057] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-19T17:05:30.555121] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-19T17:05:30.931453] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:30.967308] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T17:05:31.043293] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-19T17:05:31.843267] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-19T17:05:32.384016] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T17:05:32.643264] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-19T17:05:33.022542] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T17:05:33.172953] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T17:05:33.443286] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-19T17:05:34.243326] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-19T17:05:34.740798] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T17:05:35.043279] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-19T17:05:35.655299] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T17:05:35.843276] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-19T17:05:36.643320] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-19T17:05:36.985722] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-19T17:05:37.080110] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T17:05:37.443242] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-19T17:05:37.956945] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T17:05:37.997296] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T17:05:38.243259] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-19T17:05:38.650987] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-19T17:05:39.043300] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-19T17:05:39.843265] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-19T17:05:40.494554] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-19T17:05:40.643343] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-19T17:05:41.276140] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T17:05:41.277477] [INFO ] [REMOTE ] AFGD: Full fetch complete (3231 records). [2025-09-19T17:05:41.277589] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-19T17:05:41.445594] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-19T17:05:41.607489] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-19T17:05:41.698129] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-19T17:05:41.698225] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-19T17:05:41.698387] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-19T17:05:41.698434] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-19T17:05:41.698828] [DEBUG] [LOCAL ] AFGD: Trimmed 3231 records to 1913 (keeping 200 days of data) [2025-09-19T17:05:41.713839] [DEBUG] [LOCAL ] AFGD: Primary data saved (1913 records). [2025-09-19T17:05:41.713940] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-19T17:05:41.714039] [INFO ] [MAIN ] Update Progress: 48/2372 symbols completed. AFGD took 28.1s. Estimated remaining: 4h 32m 19s. Rate: 8.5 symbols/min [2025-09-19T17:05:41.896774] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:41.952488] [DEBUG] [LOCAL ] AGCO: Loaded 43138 existing records from primary storage. [2025-09-19T17:05:41.952671] [INFO ] [MAIN ] AGCO: Loaded 43138 existing records. [2025-09-19T17:05:42.137152] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T17:05:42.145107] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:42.145408] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-19T17:05:42.145485] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-19T17:05:42.147285] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-19T17:05:42.147376] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-19T17:05:42.248363] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-19T17:05:42.502881] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:43.043303] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-19T17:05:43.843341] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-19T17:05:44.643337] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-19T17:05:44.762417] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-19T17:05:45.210599] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T17:05:45.387998] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T17:05:45.443315] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-19T17:05:45.869196] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T17:05:46.243289] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-19T17:05:47.043283] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-19T17:05:47.723351] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-19T17:05:47.841304] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T17:05:47.849628] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-19T17:05:47.855538] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T17:05:48.643263] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-19T17:05:49.365330] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T17:05:49.366324] [INFO ] [REMOTE ] AFGE: Full fetch complete (3498 records). [2025-09-19T17:05:49.366396] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-19T17:05:49.448444] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-19T17:05:49.763343] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-19T17:05:49.763568] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-19T17:05:49.763828] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-19T17:05:49.763934] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-19T17:05:49.764617] [DEBUG] [LOCAL ] AFGE: Trimmed 3498 records to 2548 (keeping 200 days of data) [2025-09-19T17:05:49.780779] [DEBUG] [LOCAL ] AFGE: Primary data saved (2548 records). [2025-09-19T17:05:49.780878] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-19T17:05:49.781010] [INFO ] [MAIN ] Update Progress: 49/2372 symbols completed. AFGE took 34.1s. Estimated remaining: 4h 33m 1s. Rate: 8.5 symbols/min [2025-09-19T17:05:49.965115] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:49.997699] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-19T17:05:50.023603] [DEBUG] [LOCAL ] AGD: Loaded 17701 existing records from primary storage. [2025-09-19T17:05:50.023771] [INFO ] [MAIN ] AGD: Loaded 17701 existing records. [2025-09-19T17:05:50.202910] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:50.203194] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-19T17:05:50.203243] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-19T17:05:50.203824] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-19T17:05:50.203885] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-19T17:05:50.248357] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-19T17:05:50.624054] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:05:51.043267] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-19T17:05:51.617612] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T17:05:51.843282] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-19T17:05:52.176428] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:05:52.508211] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T17:05:52.643267] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-19T17:05:53.443250] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-19T17:05:53.609364] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T17:05:53.857916] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T17:05:54.243272] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-19T17:05:55.043312] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-19T17:05:55.739151] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T17:05:55.843237] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-19T17:05:55.881355] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T17:05:56.643269] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-19T17:05:56.999895] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T17:05:57.443270] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-19T17:05:57.950920] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T17:05:58.243267] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-19T17:05:58.427077] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T17:05:58.436325] [INFO ] [REMOTE ] AG: Full fetch complete (77570 records). [2025-09-19T17:05:58.436477] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-19T17:05:58.842779] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-19T17:05:58.843084] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-19T17:05:58.843826] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-19T17:05:58.843890] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-19T17:05:58.845441] [DEBUG] [LOCAL ] AG: Trimmed 77570 records to 54421 (keeping 200 days of data) [2025-09-19T17:05:59.054857] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-19T17:05:59.177842] [DEBUG] [LOCAL ] AG: Primary data saved (54421 records). [2025-09-19T17:05:59.177984] [INFO ] [MAIN ] AG: Full history saved. [2025-09-19T17:05:59.178069] [INFO ] [MAIN ] Update Progress: 50/2372 symbols completed. AG took 29.1s. Estimated remaining: 4h 34m 43s. Rate: 8.5 symbols/min [2025-09-19T17:05:59.357203] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:05:59.386696] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T17:05:59.440579] [DEBUG] [LOCAL ] AGI: Loaded 53802 existing records from primary storage. [2025-09-19T17:05:59.440752] [INFO ] [MAIN ] AGI: Loaded 53802 existing records. [2025-09-19T17:05:59.623431] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:05:59.623743] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-19T17:05:59.623849] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-19T17:05:59.625700] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-19T17:05:59.625764] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-19T17:05:59.849415] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-19T17:05:59.988797] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:00.336597] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T17:06:00.423440] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T17:06:00.643259] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-19T17:06:01.443281] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-19T17:06:01.788068] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T17:06:01.897222] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T17:06:02.243277] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-19T17:06:03.043282] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-19T17:06:03.843247] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-19T17:06:04.572905] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (3.13 seconds). [2025-09-19T17:06:04.643287] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-19T17:06:04.730610] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T17:06:04.944323] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-19T17:06:05.443275] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-19T17:06:06.184681] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T17:06:06.243239] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-19T17:06:06.725069] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T17:06:06.832447] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T17:06:07.043260] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-19T17:06:07.843254] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-19T17:06:08.383833] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T17:06:08.392066] [INFO ] [REMOTE ] AFL: Full fetch complete (76933 records). [2025-09-19T17:06:08.392221] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-19T17:06:08.649773] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-19T17:06:08.831503] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-19T17:06:08.831616] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-19T17:06:08.832501] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-19T17:06:08.832601] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-19T17:06:08.834344] [DEBUG] [LOCAL ] AFL: Trimmed 76933 records to 53927 (keeping 200 days of data) [2025-09-19T17:06:08.956964] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:06:09.221408] [DEBUG] [LOCAL ] AFL: Primary data saved (53927 records). [2025-09-19T17:06:09.221592] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-19T17:06:09.221726] [INFO ] [MAIN ] Update Progress: 51/2372 symbols completed. AFL took 46.1s. Estimated remaining: 4h 36m 50s. Rate: 8.4 symbols/min [2025-09-19T17:06:09.403524] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:09.446738] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-19T17:06:09.480495] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T17:06:09.493141] [DEBUG] [LOCAL ] AGL: Loaded 52793 existing records from primary storage. [2025-09-19T17:06:09.493510] [INFO ] [MAIN ] AGL: Loaded 52793 existing records. [2025-09-19T17:06:09.684012] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:09.684298] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-19T17:06:09.684394] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-19T17:06:09.685596] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-19T17:06:09.685682] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-19T17:06:10.060747] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:10.062010] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:06:10.243285] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-19T17:06:10.778162] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T17:06:11.043255] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-19T17:06:11.525251] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T17:06:11.843276] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-19T17:06:12.643266] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-19T17:06:12.685681] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-19T17:06:12.883041] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:06:12.889492] [INFO ] [REMOTE ] AGCO: Full fetch complete (62201 records). [2025-09-19T17:06:12.889612] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-19T17:06:13.283477] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-19T17:06:13.283575] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-19T17:06:13.284289] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-19T17:06:13.284357] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-19T17:06:13.285907] [DEBUG] [LOCAL ] AGCO: Trimmed 62201 records to 43447 (keeping 200 days of data) [2025-09-19T17:06:13.489883] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-19T17:06:13.589321] [DEBUG] [LOCAL ] AGCO: Primary data saved (43447 records). [2025-09-19T17:06:13.589461] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-19T17:06:13.589544] [INFO ] [MAIN ] Update Progress: 52/2372 symbols completed. AGCO took 31.9s. Estimated remaining: 4h 34m 38s. Rate: 8.4 symbols/min [2025-09-19T17:06:13.763018] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:13.763194] [DEBUG] [LOCAL ] AGM: No existing data file found in primary storage. [2025-09-19T17:06:13.763249] [WARN ] [MAIN ] AGM: No existing data found, performing full refresh instead. [2025-09-19T17:06:13.763405] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-19T17:06:13.763449] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-19T17:06:13.763491] [DEBUG] [LOCAL ] AGM: No primary data file found to delete. [2025-09-19T17:06:13.763523] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-19T17:06:14.121247] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:14.243255] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-19T17:06:14.799503] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T17:06:14.997972] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:06:15.007201] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T17:06:15.006925] [INFO ] [REMOTE ] AGD: Full fetch complete (25150 records). [2025-09-19T17:06:15.009675] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-19T17:06:15.048363] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-19T17:06:15.390951] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-19T17:06:15.391077] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-19T17:06:15.391420] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-19T17:06:15.391460] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-19T17:06:15.392128] [DEBUG] [LOCAL ] AGD: Trimmed 25150 records to 17845 (keeping 200 days of data) [2025-09-19T17:06:15.506053] [DEBUG] [LOCAL ] AGD: Primary data saved (17845 records). [2025-09-19T17:06:15.506198] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-19T17:06:15.506283] [INFO ] [MAIN ] Update Progress: 53/2372 symbols completed. AGD took 25.7s. Estimated remaining: 4h 30m 44s. Rate: 8.6 symbols/min [2025-09-19T17:06:15.675315] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:15.714742] [DEBUG] [LOCAL ] AGO: Loaded 28350 existing records from primary storage. [2025-09-19T17:06:15.714897] [INFO ] [MAIN ] AGO: Loaded 28350 existing records. [2025-09-19T17:06:15.848337] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-19T17:06:15.903827] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:15.904099] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-19T17:06:15.904152] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-19T17:06:15.905133] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-19T17:06:15.905197] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-19T17:06:16.269280] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:16.643277] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-19T17:06:17.443337] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-19T17:06:18.035688] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-09-19T17:06:18.243300] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-19T17:06:18.630405] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-19T17:06:18.739931] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T17:06:18.967534] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T17:06:19.043318] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-19T17:06:19.843239] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-19T17:06:19.994051] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T17:06:20.643282] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-19T17:06:20.843436] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T17:06:21.443279] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-19T17:06:21.691023] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T17:06:21.992334] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T17:06:22.239488] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T17:06:22.251244] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-19T17:06:23.043261] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-19T17:06:23.701855] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T17:06:23.792742] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T17:06:23.843279] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-19T17:06:24.643270] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-19T17:06:25.443244] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-19T17:06:25.479810] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T17:06:26.062078] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T17:06:26.243283] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-19T17:06:27.043308] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-19T17:06:27.223002] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T17:06:27.815424] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:06:27.843240] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-19T17:06:28.643323] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-19T17:06:29.443281] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-19T17:06:30.139706] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T17:06:30.243285] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-19T17:06:30.767071] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (3.72 seconds). [2025-09-19T17:06:30.804214] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-19T17:06:30.975156] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T17:06:31.043247] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-19T17:06:31.843295] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-19T17:06:31.881057] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T17:06:32.107240] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T17:06:32.643293] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-19T17:06:33.443280] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-19T17:06:33.933857] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T17:06:34.023720] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:06:34.243245] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-19T17:06:35.043304] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-19T17:06:35.089581] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T17:06:35.380900] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T17:06:35.843255] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-19T17:06:36.144402] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T17:06:36.643309] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-19T17:06:37.443325] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-19T17:06:37.631722] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T17:06:38.050730] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T17:06:38.059617] [INFO ] [REMOTE ] AGI: Full fetch complete (76677 records). [2025-09-19T17:06:38.059814] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-19T17:06:38.243635] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-19T17:06:38.459254] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-19T17:06:38.459349] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-19T17:06:38.460123] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-19T17:06:38.460191] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-19T17:06:38.461809] [DEBUG] [LOCAL ] AGI: Trimmed 76677 records to 54192 (keeping 200 days of data) [2025-09-19T17:06:38.806195] [DEBUG] [LOCAL ] AGI: Primary data saved (54192 records). [2025-09-19T17:06:38.806365] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-19T17:06:38.806518] [INFO ] [MAIN ] Update Progress: 54/2372 symbols completed. AGI took 39.6s. Estimated remaining: 4h 42m 17s. Rate: 8.2 symbols/min [2025-09-19T17:06:38.990019] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:39.037231] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T17:06:39.051329] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-19T17:06:39.062920] [DEBUG] [LOCAL ] AGRO: Loaded 34245 existing records from primary storage. [2025-09-19T17:06:39.063691] [INFO ] [MAIN ] AGRO: Loaded 34245 existing records. [2025-09-19T17:06:39.257505] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:39.257845] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-19T17:06:39.257908] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-19T17:06:39.258878] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-19T17:06:39.258939] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-19T17:06:39.621048] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:39.843283] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-19T17:06:40.102983] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T17:06:40.105770] [INFO ] [REMOTE ] AGM: Full fetch complete (12461 records). [2025-09-19T17:06:40.105863] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-19T17:06:40.485715] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-19T17:06:40.485817] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-19T17:06:40.486059] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-19T17:06:40.486165] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-19T17:06:40.486950] [DEBUG] [LOCAL ] AGM: Trimmed 12461 records to 9993 (keeping 200 days of data) [2025-09-19T17:06:40.562289] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-19T17:06:40.588124] [DEBUG] [LOCAL ] AGM: Primary data saved (9993 records). [2025-09-19T17:06:40.588308] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-19T17:06:40.588404] [INFO ] [MAIN ] Update Progress: 55/2372 symbols completed. AGM took 27.0s. Estimated remaining: 4h 38m 17s. Rate: 8.3 symbols/min [2025-09-19T17:06:40.652390] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-19T17:06:40.762194] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:40.801074] [DEBUG] [LOCAL ] AGX: Loaded 33860 existing records from primary storage. [2025-09-19T17:06:40.801257] [INFO ] [MAIN ] AGX: Loaded 33860 existing records. [2025-09-19T17:06:40.991262] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:40.991538] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-19T17:06:40.991592] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-19T17:06:40.992706] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-19T17:06:40.992793] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-19T17:06:41.279680] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:06:41.315959] [INFO ] [REMOTE ] AGO: Full fetch complete (39301 records). [2025-09-19T17:06:41.316101] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-19T17:06:41.447160] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-19T17:06:41.489886] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:41.801517] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-19T17:06:41.801697] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-19T17:06:41.802432] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-19T17:06:41.802517] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-19T17:06:41.805534] [DEBUG] [LOCAL ] AGO: Trimmed 39301 records to 28590 (keeping 200 days of data) [2025-09-19T17:06:41.986382] [DEBUG] [LOCAL ] AGO: Primary data saved (28590 records). [2025-09-19T17:06:41.986521] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-19T17:06:41.986606] [INFO ] [MAIN ] Update Progress: 56/2372 symbols completed. AGO took 26.5s. Estimated remaining: 4h 34m 9s. Rate: 8.4 symbols/min [2025-09-19T17:06:42.158984] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:42.202772] [DEBUG] [LOCAL ] AHH: Loaded 41921 existing records from primary storage. [2025-09-19T17:06:42.202949] [INFO ] [MAIN ] AHH: Loaded 41921 existing records. [2025-09-19T17:06:42.264717] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-19T17:06:42.425443] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:06:42.426032] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-19T17:06:42.426151] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-19T17:06:42.427306] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-19T17:06:42.427380] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-19T17:06:42.559727] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:06:42.839903] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:43.043323] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-19T17:06:43.201506] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:06:43.843276] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-19T17:06:44.056102] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T17:06:44.643285] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-19T17:06:44.778004] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:06:44.810293] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T17:06:45.443260] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-19T17:06:46.116435] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T17:06:46.243263] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-19T17:06:46.419341] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T17:06:47.043273] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-19T17:06:47.843287] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-19T17:06:48.195165] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T17:06:48.291800] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T17:06:48.643260] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-19T17:06:49.443318] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-19T17:06:49.994917] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T17:06:50.005586] [INFO ] [REMOTE ] AGL: Full fetch complete (75403 records). [2025-09-19T17:06:50.005877] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-19T17:06:50.254326] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-19T17:06:50.431252] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-19T17:06:50.431377] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-19T17:06:50.432255] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-19T17:06:50.432385] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-19T17:06:50.440984] [DEBUG] [LOCAL ] AGL: Trimmed 75403 records to 53174 (keeping 200 days of data) [2025-09-19T17:06:50.453857] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:06:50.762075] [DEBUG] [LOCAL ] AGL: Primary data saved (53174 records). [2025-09-19T17:06:50.762250] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-19T17:06:50.762402] [INFO ] [MAIN ] Update Progress: 57/2372 symbols completed. AGL took 41.5s. Estimated remaining: 4h 35m 10s. Rate: 8.4 symbols/min [2025-09-19T17:06:50.935701] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:06:50.935911] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-19T17:06:50.935965] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-19T17:06:50.936108] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-19T17:06:50.936151] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-19T17:06:50.936193] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-19T17:06:50.936225] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-19T17:06:51.048524] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-19T17:06:51.301764] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:06:51.454477] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:06:51.843280] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-19T17:06:52.039740] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:06:52.459484] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T17:06:52.643287] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-19T17:06:52.872027] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:06:52.872366] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-19T17:06:53.443275] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-19T17:06:53.726098] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T17:06:54.243278] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-19T17:06:55.043300] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-19T17:06:55.276846] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:06:55.277167] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-19T17:06:55.309267] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T17:06:55.699445] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:06:55.843267] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-19T17:06:56.643268] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-19T17:06:57.114742] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T17:06:57.443264] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-19T17:06:58.243274] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-19T17:06:58.382758] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T17:06:58.789571] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T17:06:59.043301] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-19T17:06:59.843291] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-19T17:07:00.000495] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:07:00.433453] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T17:07:00.643268] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-19T17:07:00.994066] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T17:07:01.443274] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-19T17:07:02.243279] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-19T17:07:02.357804] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T17:07:02.551402] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T17:07:02.556121] [INFO ] [REMOTE ] AGRO: Full fetch complete (49991 records). [2025-09-19T17:07:02.556231] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-19T17:07:02.973882] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-19T17:07:02.973964] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-19T17:07:02.974492] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-19T17:07:02.974535] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-19T17:07:02.975719] [DEBUG] [LOCAL ] AGRO: Trimmed 49991 records to 34460 (keeping 200 days of data) [2025-09-19T17:07:03.065482] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-19T17:07:03.183997] [DEBUG] [LOCAL ] AGRO: Primary data saved (34460 records). [2025-09-19T17:07:03.184157] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-19T17:07:03.184268] [INFO ] [MAIN ] Update Progress: 58/2372 symbols completed. AGRO took 24.4s. Estimated remaining: 4h 38m 34s. Rate: 8.3 symbols/min [2025-09-19T17:07:03.370685] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:03.343532] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:03.371565] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-19T17:07:03.429935] [DEBUG] [LOCAL ] AHR: Loaded 49738 existing records from primary storage. [2025-09-19T17:07:03.430114] [INFO ] [MAIN ] AHR: Loaded 49738 existing records. [2025-09-19T17:07:03.612275] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:03.612512] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-19T17:07:03.612560] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-19T17:07:03.613937] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-19T17:07:03.613999] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-19T17:07:03.855978] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-19T17:07:03.978413] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:04.224489] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T17:07:04.643274] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-19T17:07:05.443279] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-19T17:07:05.580864] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T17:07:05.586105] [INFO ] [REMOTE ] AGX: Full fetch complete (49032 records). [2025-09-19T17:07:05.586194] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-19T17:07:05.964581] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-19T17:07:05.964693] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-19T17:07:05.965240] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-19T17:07:05.965284] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-19T17:07:05.966358] [DEBUG] [LOCAL ] AGX: Trimmed 49032 records to 34119 (keeping 200 days of data) [2025-09-19T17:07:06.182400] [DEBUG] [LOCAL ] AGX: Primary data saved (34119 records). [2025-09-19T17:07:06.182547] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-19T17:07:06.182632] [INFO ] [MAIN ] Update Progress: 59/2372 symbols completed. AGX took 25.6s. Estimated remaining: 4h 35m 41s. Rate: 8.4 symbols/min [2025-09-19T17:07:06.252831] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-19T17:07:06.356288] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:06.365499] [DEBUG] [LOCAL ] AHT: Loaded 5997 existing records from primary storage. [2025-09-19T17:07:06.365615] [INFO ] [MAIN ] AHT: Loaded 5997 existing records. [2025-09-19T17:07:06.555547] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:06.555879] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-19T17:07:06.555930] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-19T17:07:06.557361] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-19T17:07:06.557424] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-19T17:07:06.590938] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:06.630691] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-19T17:07:06.933943] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:06.962984] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-19T17:07:07.001622] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:07:07.043220] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-19T17:07:07.843319] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-19T17:07:08.643261] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-19T17:07:08.896969] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:08.908957] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-19T17:07:08.911057] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:07:09.022022] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T17:07:09.443277] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-19T17:07:10.243264] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-19T17:07:10.909952] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:07:11.043690] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-19T17:07:11.044574] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T17:07:11.843259] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-19T17:07:12.643265] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-19T17:07:13.287200] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-19T17:07:13.376286] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T17:07:13.443283] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-19T17:07:13.466237] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:07:14.243279] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-19T17:07:14.826561] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T17:07:15.043254] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-19T17:07:15.316727] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T17:07:15.479289] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T17:07:15.843278] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-19T17:07:16.643274] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-19T17:07:17.443260] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-19T17:07:17.505965] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:07:18.042621] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T17:07:18.243308] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-19T17:07:18.784978] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T17:07:19.043305] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-19T17:07:19.813422] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T17:07:19.843228] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-19T17:07:20.190375] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:07:20.643251] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-19T17:07:20.716419] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T17:07:21.443278] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-19T17:07:22.180738] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:07:22.243268] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-19T17:07:23.043273] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-19T17:07:23.172546] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T17:07:23.807325] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T17:07:23.843280] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-19T17:07:24.350581] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:07:24.643321] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-19T17:07:25.443282] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-19T17:07:25.838449] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T17:07:26.052016] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T17:07:26.243302] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-19T17:07:26.489310] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T17:07:26.497559] [INFO ] [REMOTE ] AHH: Full fetch complete (60393 records). [2025-09-19T17:07:26.497781] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-19T17:07:26.903790] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-19T17:07:26.903874] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-19T17:07:26.904466] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-19T17:07:26.904528] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-19T17:07:26.905844] [DEBUG] [LOCAL ] AHH: Trimmed 60393 records to 42133 (keeping 200 days of data) [2025-09-19T17:07:27.076536] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-19T17:07:27.158949] [DEBUG] [LOCAL ] AHH: Primary data saved (42133 records). [2025-09-19T17:07:27.159091] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-19T17:07:27.161748] [INFO ] [MAIN ] Update Progress: 60/2372 symbols completed. AHH took 45.2s. Estimated remaining: 4h 44m 27s. Rate: 8.1 symbols/min [2025-09-19T17:07:27.357313] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:27.417849] [DEBUG] [LOCAL ] AI: Loaded 54139 existing records from primary storage. [2025-09-19T17:07:27.418021] [INFO ] [MAIN ] AI: Loaded 54139 existing records. [2025-09-19T17:07:27.624539] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:27.625614] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-19T17:07:27.625786] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-19T17:07:27.632307] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-19T17:07:27.644274] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T17:07:27.643531] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-19T17:07:27.651131] [INFO ] [REMOTE ] AHL: Full fetch complete (16826 records). [2025-09-19T17:07:27.656513] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-19T17:07:27.740135] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-19T17:07:27.863623] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-19T17:07:28.133065] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 93 unique days, need 200 days [2025-09-19T17:07:28.144807] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:07:28.166421] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:07:28.166614] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-19T17:07:28.166763] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-19T17:07:28.166853] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-19T17:07:28.167265] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-19T17:07:28.178247] [INFO ] [MAIN ] Update Progress: 61/2372 symbols completed. AHL took 37.4s. Estimated remaining: 4h 40m 18s. Rate: 8.2 symbols/min [2025-09-19T17:07:28.361000] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:28.424109] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:28.475950] [DEBUG] [LOCAL ] AIG: Loaded 53867 existing records from primary storage. [2025-09-19T17:07:28.476104] [INFO ] [MAIN ] AIG: Loaded 53867 existing records. [2025-09-19T17:07:28.653280] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-19T17:07:28.660816] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:28.661020] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-19T17:07:28.661080] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-19T17:07:28.662883] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-19T17:07:28.662950] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-19T17:07:29.045086] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:29.443345] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-19T17:07:29.645166] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T17:07:29.648951] [INFO ] [REMOTE ] AHT: Full fetch complete (9521 records). [2025-09-19T17:07:29.649209] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-19T17:07:30.204578] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-19T17:07:30.224071] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-19T17:07:30.242130] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-19T17:07:30.244999] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T17:07:30.245228] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-19T17:07:30.243100] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-19T17:07:30.260778] [DEBUG] [LOCAL ] AHT: Trimmed 9521 records to 6046 (keeping 200 days of data) [2025-09-19T17:07:30.310010] [DEBUG] [LOCAL ] AHT: Primary data saved (6046 records). [2025-09-19T17:07:30.310241] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-19T17:07:30.310375] [INFO ] [MAIN ] Update Progress: 62/2372 symbols completed. AHT took 24.1s. Estimated remaining: 4h 36m 59s. Rate: 8.3 symbols/min [2025-09-19T17:07:30.533298] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:30.533619] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-19T17:07:30.533711] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-19T17:07:30.533947] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-19T17:07:30.534012] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-19T17:07:30.534063] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-19T17:07:30.534116] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-19T17:07:30.958534] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:31.043309] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-19T17:07:31.284628] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:31.284998] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-19T17:07:31.843286] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-19T17:07:32.105425] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:32.105828] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-19T17:07:32.350276] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T17:07:32.393357] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-09-19T17:07:32.643286] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-19T17:07:32.872316] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:32.872627] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-19T17:07:33.443287] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-19T17:07:34.243255] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-19T17:07:34.488137] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:34.488543] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-19T17:07:35.043273] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-19T17:07:35.270218] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:07:35.270529] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-19T17:07:35.843283] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-19T17:07:36.262960] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-09-19T17:07:36.643246] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-19T17:07:36.952513] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T17:07:37.443287] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-19T17:07:38.243313] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-19T17:07:38.678921] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T17:07:38.931970] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T17:07:39.043296] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-19T17:07:39.843284] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-19T17:07:40.536239] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T17:07:40.643328] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-19T17:07:40.884634] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T17:07:41.184196] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T17:07:41.443324] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-19T17:07:42.243324] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-19T17:07:42.323426] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T17:07:42.839763] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:07:43.043320] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-19T17:07:43.843383] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-19T17:07:44.232721] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:07:44.235893] [INFO ] [REMOTE ] AII: Full fetch complete (10120 records). [2025-09-19T17:07:44.236150] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-19T17:07:44.434631] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 93 unique days, need 200 days [2025-09-19T17:07:44.435285] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:07:44.435421] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:07:44.435705] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-19T17:07:44.436023] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-19T17:07:44.436177] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-19T17:07:44.436286] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-19T17:07:44.436468] [INFO ] [MAIN ] Update Progress: 63/2372 symbols completed. AII took 14.1s. Estimated remaining: 4h 41m 6s. Rate: 8.2 symbols/min [2025-09-19T17:07:44.623614] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-19T17:07:44.648967] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-19T17:07:44.641573] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:44.653120] [INFO ] [REMOTE ] AHR: Full fetch complete (71077 records). [2025-09-19T17:07:44.653254] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-19T17:07:44.852058] [DEBUG] [LOCAL ] AIN: Loaded 24805 existing records from primary storage. [2025-09-19T17:07:44.875100] [INFO ] [MAIN ] AIN: Loaded 24805 existing records. [2025-09-19T17:07:45.290874] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-19T17:07:45.306676] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-19T17:07:45.312381] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:45.313185] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-19T17:07:45.313281] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-19T17:07:45.313556] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-19T17:07:45.313610] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-19T17:07:45.314401] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-19T17:07:45.314465] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-19T17:07:45.346859] [DEBUG] [LOCAL ] AHR: Trimmed 71077 records to 50104 (keeping 200 days of data) [2025-09-19T17:07:45.806789] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:45.815041] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-19T17:07:45.994852] [DEBUG] [LOCAL ] AHR: Primary data saved (50104 records). [2025-09-19T17:07:45.995036] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-19T17:07:45.995206] [INFO ] [MAIN ] Update Progress: 64/2372 symbols completed. AHR took 42.8s. Estimated remaining: 4h 37m 32s. Rate: 8.3 symbols/min [2025-09-19T17:07:46.227499] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:07:46.289186] [DEBUG] [LOCAL ] AIO: Loaded 13488 existing records from primary storage. [2025-09-19T17:07:46.289762] [INFO ] [MAIN ] AIO: Loaded 13488 existing records. [2025-09-19T17:07:46.294318] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T17:07:46.405480] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-19T17:07:46.489085] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:07:46.489368] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-19T17:07:46.489418] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-19T17:07:46.490029] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-19T17:07:46.490089] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-19T17:07:46.848476] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:07:46.868706] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:07:46.901505] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-19T17:07:47.043239] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-19T17:07:47.843268] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-19T17:07:48.643276] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-19T17:07:49.084154] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T17:07:49.119170] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-19T17:07:49.165000] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T17:07:49.393263] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:07:49.443279] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-19T17:07:50.243276] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-19T17:07:50.621853] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:07:51.043313] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-19T17:07:51.843327] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-19T17:07:51.980527] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T17:07:52.175996] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T17:07:52.643271] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-19T17:07:53.443274] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-19T17:07:54.181813] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T17:07:54.224941] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:07:54.243231] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-19T17:07:54.456603] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-19T17:07:55.043271] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-19T17:07:55.843284] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-19T17:07:56.434638] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:07:56.643272] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-19T17:07:57.006841] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T17:07:57.443277] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-19T17:07:58.114567] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-19T17:07:58.243318] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-19T17:07:58.821246] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:07:59.043276] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-19T17:07:59.058424] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T17:07:59.821958] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T17:07:59.843225] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-19T17:08:00.643292] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-19T17:08:00.884260] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T17:08:01.417084] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T17:08:01.443221] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-19T17:08:02.243269] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-19T17:08:03.043291] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-19T17:08:03.267699] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-19T17:08:03.293532] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T17:08:03.527005] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T17:08:03.535180] [INFO ] [REMOTE ] AIG: Full fetch complete (77375 records). [2025-09-19T17:08:03.535348] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-19T17:08:03.848395] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-19T17:08:03.942671] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-19T17:08:03.942762] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-19T17:08:03.943504] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-19T17:08:03.943547] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-19T17:08:03.945402] [DEBUG] [LOCAL ] AIG: Trimmed 77375 records to 54257 (keeping 200 days of data) [2025-09-19T17:08:04.298730] [DEBUG] [LOCAL ] AIG: Primary data saved (54257 records). [2025-09-19T17:08:04.299278] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-19T17:08:04.299523] [INFO ] [MAIN ] Update Progress: 65/2372 symbols completed. AIG took 36.1s. Estimated remaining: 4h 43m 58s. Rate: 8.1 symbols/min [2025-09-19T17:08:04.472477] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T17:08:04.491791] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:04.523807] [DEBUG] [LOCAL ] AIR: Loaded 27262 existing records from primary storage. [2025-09-19T17:08:04.523949] [INFO ] [MAIN ] AIR: Loaded 27262 existing records. [2025-09-19T17:08:04.648426] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-19T17:08:04.704629] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:04.704916] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-19T17:08:04.704965] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-19T17:08:04.705753] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-19T17:08:04.705819] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-19T17:08:05.084016] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:05.353629] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T17:08:05.443277] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-19T17:08:05.956006] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T17:08:06.243251] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-19T17:08:06.335314] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T17:08:07.043264] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-19T17:08:07.843267] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-19T17:08:08.519992] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T17:08:08.648459] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-19T17:08:08.659488] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-19T17:08:08.669793] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-19T17:08:08.669965] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-19T17:08:09.080842] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-19T17:08:09.081169] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-19T17:08:09.081945] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-19T17:08:09.082080] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-19T17:08:09.083805] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54529 (keeping 200 days of data) [2025-09-19T17:08:09.202614] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T17:08:09.440453] [DEBUG] [LOCAL ] AI: Primary data saved (54529 records). [2025-09-19T17:08:09.440605] [INFO ] [MAIN ] AI: Full history saved. [2025-09-19T17:08:09.441449] [INFO ] [MAIN ] Update Progress: 66/2372 symbols completed. AI took 42.3s. Estimated remaining: 4h 42m 32s. Rate: 8.2 symbols/min [2025-09-19T17:08:09.453021] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-19T17:08:09.616321] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:09.634185] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T17:08:09.666830] [DEBUG] [LOCAL ] AIT: Loaded 28647 existing records from primary storage. [2025-09-19T17:08:09.667021] [INFO ] [MAIN ] AIT: Loaded 28647 existing records. [2025-09-19T17:08:09.850131] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:09.850409] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-19T17:08:09.850461] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-19T17:08:09.851535] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-19T17:08:09.851595] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-19T17:08:10.221729] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:10.243229] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-19T17:08:10.625911] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T17:08:11.043275] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-19T17:08:11.757069] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T17:08:11.843381] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-19T17:08:12.346722] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T17:08:12.643302] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-19T17:08:12.975274] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T17:08:13.443301] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-19T17:08:13.764113] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T17:08:14.243267] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-19T17:08:14.927754] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:08:14.931293] [INFO ] [REMOTE ] AIN: Full fetch complete (33239 records). [2025-09-19T17:08:14.931375] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-19T17:08:15.048354] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-19T17:08:15.323064] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-19T17:08:15.323181] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-19T17:08:15.323601] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-19T17:08:15.323665] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-19T17:08:15.324758] [DEBUG] [LOCAL ] AIN: Trimmed 33239 records to 24971 (keeping 200 days of data) [2025-09-19T17:08:15.489770] [DEBUG] [LOCAL ] AIN: Primary data saved (24971 records). [2025-09-19T17:08:15.489906] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-19T17:08:15.489993] [INFO ] [MAIN ] Update Progress: 67/2372 symbols completed. AIN took 31.1s. Estimated remaining: 4h 41m 40s. Rate: 8.2 symbols/min [2025-09-19T17:08:15.664449] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:15.708682] [DEBUG] [LOCAL ] AIV: Loaded 40482 existing records from primary storage. [2025-09-19T17:08:15.708859] [INFO ] [MAIN ] AIV: Loaded 40482 existing records. [2025-09-19T17:08:15.852860] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-19T17:08:15.895342] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:15.895767] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-19T17:08:15.895831] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-19T17:08:15.902055] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-19T17:08:15.909397] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-19T17:08:15.947534] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T17:08:16.283541] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:16.304233] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T17:08:16.643294] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-19T17:08:16.719314] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T17:08:17.443302] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-19T17:08:18.243285] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-19T17:08:18.386951] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T17:08:18.917784] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:08:19.043337] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-19T17:08:19.174384] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T17:08:19.843271] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-19T17:08:20.406751] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T17:08:20.643300] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-19T17:08:21.189499] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T17:08:21.443273] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-19T17:08:21.854635] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T17:08:21.857350] [INFO ] [REMOTE ] AIO: Full fetch complete (20114 records). [2025-09-19T17:08:21.857486] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-19T17:08:22.256060] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-19T17:08:22.326721] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-19T17:08:22.326863] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-19T17:08:22.327426] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-19T17:08:22.327525] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-19T17:08:22.328801] [DEBUG] [LOCAL ] AIO: Trimmed 20114 records to 13548 (keeping 200 days of data) [2025-09-19T17:08:22.452504] [DEBUG] [LOCAL ] AIO: Primary data saved (13548 records). [2025-09-19T17:08:22.452710] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-19T17:08:22.452833] [INFO ] [MAIN ] Update Progress: 68/2372 symbols completed. AIO took 36.5s. Estimated remaining: 4h 41m 20s. Rate: 8.2 symbols/min [2025-09-19T17:08:22.740498] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:22.796448] [DEBUG] [LOCAL ] AIZ: Loaded 30647 existing records from primary storage. [2025-09-19T17:08:22.796685] [INFO ] [MAIN ] AIZ: Loaded 30647 existing records. [2025-09-19T17:08:23.059498] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-19T17:08:23.074219] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:23.075843] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-19T17:08:23.075932] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-19T17:08:23.077053] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-19T17:08:23.077433] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-19T17:08:23.250705] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:08:23.574874] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:23.687734] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T17:08:23.843261] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-19T17:08:24.643267] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-19T17:08:24.903002] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T17:08:25.024929] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T17:08:25.443305] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-19T17:08:25.691601] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:08:26.243256] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-19T17:08:27.043274] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-19T17:08:27.178328] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T17:08:27.843269] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-19T17:08:27.844564] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T17:08:28.204538] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T17:08:28.643311] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-19T17:08:29.203983] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:08:29.443272] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-19T17:08:29.716439] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T17:08:30.243337] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-19T17:08:31.043276] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-19T17:08:31.184460] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T17:08:31.403166] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T17:08:31.843294] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-19T17:08:32.643310] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-19T17:08:32.711991] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T17:08:32.716109] [INFO ] [REMOTE ] AIR: Full fetch complete (37070 records). [2025-09-19T17:08:32.716199] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-19T17:08:32.716819] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:08:32.716906] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:08:32.716949] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:08:32.717014] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-19T17:08:32.717080] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-19T17:08:32.717118] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-09-19T17:08:32.717594] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-09-19T17:08:32.717920] [INFO ] [MAIN ] Update Progress: 69/2372 symbols completed. AIR took 28.4s. Estimated remaining: 4h 42m 51s. Rate: 8.1 symbols/min [2025-09-19T17:08:32.901294] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:32.901535] [DEBUG] [LOCAL ] AIZN: No existing data file found in primary storage. [2025-09-19T17:08:32.901591] [WARN ] [MAIN ] AIZN: No existing data found, performing full refresh instead. [2025-09-19T17:08:32.901770] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-19T17:08:32.901818] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-19T17:08:32.901859] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-09-19T17:08:32.901892] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-19T17:08:33.307107] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:08:33.328961] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:33.443230] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-19T17:08:34.044481] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-19T17:08:34.243291] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-19T17:08:34.381624] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T17:08:35.043280] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-19T17:08:35.452869] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T17:08:35.843274] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-19T17:08:36.643393] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-19T17:08:36.871867] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T17:08:37.340595] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T17:08:37.443280] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-19T17:08:37.559433] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T17:08:38.243299] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-19T17:08:39.043310] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-19T17:08:39.108934] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T17:08:39.800876] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T17:08:39.843225] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-19T17:08:40.193314] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T17:08:40.643296] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-19T17:08:40.876518] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T17:08:41.443324] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-19T17:08:42.243282] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-19T17:08:42.573634] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T17:08:42.585485] [INFO ] [REMOTE ] AIV: Full fetch complete (58982 records). [2025-09-19T17:08:42.585738] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-19T17:08:42.944278] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:08:42.984553] [INFO ] [REMOTE ] AIT: Full fetch complete (39621 records). [2025-09-19T17:08:43.001922] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-19T17:08:43.005421] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-19T17:08:43.011114] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-19T17:08:43.011870] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-19T17:08:43.046912] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-19T17:08:43.046772] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-19T17:08:43.127673] [DEBUG] [LOCAL ] AIV: Trimmed 58982 records to 40790 (keeping 200 days of data) [2025-09-19T17:08:43.539534] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-19T17:08:43.542997] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-19T17:08:43.544102] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-19T17:08:43.544716] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-19T17:08:43.549577] [DEBUG] [LOCAL ] AIT: Trimmed 39621 records to 28788 (keeping 200 days of data) [2025-09-19T17:08:43.783293] [DEBUG] [LOCAL ] AIV: Primary data saved (40790 records). [2025-09-19T17:08:43.784778] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-19T17:08:43.785039] [INFO ] [MAIN ] Update Progress: 70/2372 symbols completed. AIV took 28.3s. Estimated remaining: 4h 44m 45s. Rate: 8.1 symbols/min [2025-09-19T17:08:43.867088] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:08:43.891980] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T17:08:43.905353] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-19T17:08:44.013627] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:44.014575] [DEBUG] [LOCAL ] AJG: No existing data file found in primary storage. [2025-09-19T17:08:44.014934] [WARN ] [MAIN ] AJG: No existing data found, performing full refresh instead. [2025-09-19T17:08:44.015884] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-19T17:08:44.016228] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-19T17:08:44.017060] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-19T17:08:44.017118] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-19T17:08:44.405112] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:44.460890] [DEBUG] [LOCAL ] AIT: Primary data saved (28788 records). [2025-09-19T17:08:44.461019] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-19T17:08:44.461104] [INFO ] [MAIN ] Update Progress: 71/2372 symbols completed. AIT took 35.0s. Estimated remaining: 4h 40m 59s. Rate: 8.2 symbols/min [2025-09-19T17:08:44.641202] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:44.641498] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-19T17:08:44.641556] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-19T17:08:44.641852] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-19T17:08:44.641925] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-19T17:08:44.641995] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-19T17:08:44.642032] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-19T17:08:44.653715] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-19T17:08:44.943519] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T17:08:45.032263] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:45.443272] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-19T17:08:46.127488] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T17:08:46.243298] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-19T17:08:47.039615] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T17:08:47.049664] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-19T17:08:47.776328] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T17:08:47.843282] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-19T17:08:47.890390] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T17:08:48.643263] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-19T17:08:49.383093] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T17:08:49.443306] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-19T17:08:49.889517] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T17:08:50.243320] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-19T17:08:50.953596] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:08:50.958017] [INFO ] [REMOTE ] AIZ: Full fetch complete (43065 records). [2025-09-19T17:08:50.958114] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-19T17:08:51.048475] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-19T17:08:51.356755] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-19T17:08:51.356854] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-19T17:08:51.357320] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-19T17:08:51.357361] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-19T17:08:51.358392] [DEBUG] [LOCAL ] AIZ: Trimmed 43065 records to 30801 (keeping 200 days of data) [2025-09-19T17:08:51.462250] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-19T17:08:51.564716] [DEBUG] [LOCAL ] AIZ: Primary data saved (30801 records). [2025-09-19T17:08:51.564868] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-19T17:08:51.564958] [INFO ] [MAIN ] Update Progress: 72/2372 symbols completed. AIZ took 29.1s. Estimated remaining: 4h 40m 45s. Rate: 8.2 symbols/min [2025-09-19T17:08:51.743841] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:51.775119] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T17:08:51.833057] [DEBUG] [LOCAL ] AKR: Loaded 46021 existing records from primary storage. [2025-09-19T17:08:51.833209] [INFO ] [MAIN ] AKR: Loaded 46021 existing records. [2025-09-19T17:08:51.848368] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-19T17:08:52.016365] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:52.016706] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-19T17:08:52.016765] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-19T17:08:52.018055] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-19T17:08:52.018119] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-19T17:08:52.386036] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:52.643264] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-19T17:08:52.676318] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T17:08:53.443297] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-19T17:08:54.147877] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T17:08:54.243293] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-19T17:08:54.276528] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:08:55.043294] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-19T17:08:55.843294] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-19T17:08:56.169969] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T17:08:56.626102] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T17:08:56.627169] [INFO ] [REMOTE ] AIZN: Full fetch complete (5722 records). [2025-09-19T17:08:56.627240] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-19T17:08:56.648428] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-19T17:08:57.049548] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-19T17:08:57.049701] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-19T17:08:57.050121] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-19T17:08:57.050204] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-19T17:08:57.050998] [DEBUG] [LOCAL ] AIZN: Trimmed 5722 records to 4012 (keeping 200 days of data) [2025-09-19T17:08:57.077538] [DEBUG] [LOCAL ] AIZN: Primary data saved (4012 records). [2025-09-19T17:08:57.077688] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-19T17:08:57.077782] [INFO ] [MAIN ] Update Progress: 73/2372 symbols completed. AIZN took 24.4s. Estimated remaining: 4h 39m 40s. Rate: 8.2 symbols/min [2025-09-19T17:08:57.266547] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:08:57.298727] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T17:08:57.349917] [DEBUG] [LOCAL ] AL: Loaded 44281 existing records from primary storage. [2025-09-19T17:08:57.350117] [INFO ] [MAIN ] AL: Loaded 44281 existing records. [2025-09-19T17:08:57.453257] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-19T17:08:57.541500] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:08:57.541824] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-19T17:08:57.541879] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-19T17:08:57.543175] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-19T17:08:57.543238] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-19T17:08:57.943341] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:08:58.243294] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-19T17:08:58.648300] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:08:58.916312] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T17:08:59.043289] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-19T17:08:59.455284] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T17:08:59.458167] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T17:08:59.843267] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-19T17:09:00.470929] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-19T17:09:00.643282] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-19T17:09:01.038197] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-19T17:09:01.443469] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-19T17:09:02.243329] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-19T17:09:03.043267] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-19T17:09:03.843262] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-19T17:09:04.770240] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T17:09:04.772586] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-19T17:09:05.316274] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:09:05.443265] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-19T17:09:05.859739] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-19T17:09:06.066822] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (4.62 seconds). [2025-09-19T17:09:06.138391] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (3.10 seconds). [2025-09-19T17:09:06.243243] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-19T17:09:06.367376] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-19T17:09:07.043307] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-19T17:09:07.843277] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-19T17:09:08.323927] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T17:09:08.361273] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:09:08.438073] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T17:09:08.643294] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-19T17:09:09.176472] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-19T17:09:09.177347] [INFO ] [REMOTE ] AKA: Full fetch complete (2450 records). [2025-09-19T17:09:09.177429] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-19T17:09:09.396183] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T17:09:09.396535] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:09:09.396590] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:09:09.396745] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-19T17:09:09.396856] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-19T17:09:09.396917] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-19T17:09:09.396977] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-19T17:09:09.397098] [INFO ] [MAIN ] Update Progress: 74/2372 symbols completed. AKA took 24.9s. Estimated remaining: 4h 42m 9s. Rate: 8.1 symbols/min [2025-09-19T17:09:09.448541] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-19T17:09:09.583446] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:09.651346] [DEBUG] [LOCAL ] ALB: Loaded 53627 existing records from primary storage. [2025-09-19T17:09:09.651549] [INFO ] [MAIN ] ALB: Loaded 53627 existing records. [2025-09-19T17:09:09.835144] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:09.835515] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-19T17:09:09.835569] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-19T17:09:09.836944] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-19T17:09:09.837010] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-19T17:09:10.217669] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:10.243243] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-19T17:09:11.043331] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-19T17:09:11.363320] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:09:11.843239] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-19T17:09:12.643279] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-19T17:09:12.681288] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-19T17:09:13.443364] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-19T17:09:13.693244] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-19T17:09:14.074204] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T17:09:14.243306] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-19T17:09:15.043266] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-19T17:09:15.667978] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (3.02 seconds). [2025-09-19T17:09:15.843270] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-19T17:09:16.168490] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T17:09:16.309163] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-19T17:09:16.556343] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T17:09:16.643266] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-19T17:09:17.444179] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-19T17:09:17.445576] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T17:09:17.453613] [INFO ] [REMOTE ] AJG: Full fetch complete (69694 records). [2025-09-19T17:09:17.453798] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-19T17:09:17.860742] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-19T17:09:17.860838] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-19T17:09:17.861486] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-19T17:09:17.861530] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-19T17:09:17.863096] [DEBUG] [LOCAL ] AJG: Trimmed 69694 records to 47861 (keeping 200 days of data) [2025-09-19T17:09:18.178481] [DEBUG] [LOCAL ] AJG: Primary data saved (47861 records). [2025-09-19T17:09:18.178619] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-19T17:09:18.178752] [INFO ] [MAIN ] Update Progress: 75/2372 symbols completed. AJG took 34.4s. Estimated remaining: 4h 42m 45s. Rate: 8.1 symbols/min [2025-09-19T17:09:18.253525] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-19T17:09:18.356563] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:18.423904] [DEBUG] [LOCAL ] ALC: Loaded 51186 existing records from primary storage. [2025-09-19T17:09:18.424087] [INFO ] [MAIN ] ALC: Loaded 51186 existing records. [2025-09-19T17:09:18.601693] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:18.601976] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-19T17:09:18.602026] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-19T17:09:18.603107] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-19T17:09:18.603196] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-19T17:09:19.010289] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:19.039974] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-19T17:09:19.049721] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-19T17:09:19.522145] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T17:09:19.662484] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:09:19.843277] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-19T17:09:20.643263] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-19T17:09:21.038840] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T17:09:21.443281] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-19T17:09:21.545608] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T17:09:22.029320] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T17:09:22.243277] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-19T17:09:23.043291] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-19T17:09:23.843281] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-19T17:09:24.275787] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-19T17:09:24.478531] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T17:09:24.517976] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T17:09:24.643248] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-19T17:09:25.443323] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-19T17:09:25.637401] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T17:09:26.243309] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-19T17:09:26.526131] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T17:09:26.725295] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T17:09:27.043279] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-19T17:09:27.843234] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-19T17:09:28.222351] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T17:09:28.326682] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T17:09:28.643266] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-19T17:09:29.443288] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-19T17:09:29.886938] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T17:09:29.893957] [INFO ] [REMOTE ] AKR: Full fetch complete (65315 records). [2025-09-19T17:09:29.894106] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-19T17:09:30.248393] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-19T17:09:30.295418] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-19T17:09:30.295503] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-19T17:09:30.296197] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-19T17:09:30.296262] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-19T17:09:30.297938] [DEBUG] [LOCAL ] AKR: Trimmed 65315 records to 46371 (keeping 200 days of data) [2025-09-19T17:09:30.603151] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T17:09:30.622361] [DEBUG] [LOCAL ] AKR: Primary data saved (46371 records). [2025-09-19T17:09:30.622508] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-19T17:09:30.622610] [INFO ] [MAIN ] Update Progress: 76/2372 symbols completed. AKR took 39.1s. Estimated remaining: 4h 45m 10s. Rate: 8.1 symbols/min [2025-09-19T17:09:30.796272] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:30.832919] [DEBUG] [LOCAL ] ALE: Loaded 30334 existing records from primary storage. [2025-09-19T17:09:30.833152] [INFO ] [MAIN ] ALE: Loaded 30334 existing records. [2025-09-19T17:09:31.018857] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:31.019173] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-19T17:09:31.019230] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-19T17:09:31.020021] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-19T17:09:31.020082] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-19T17:09:31.051225] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-19T17:09:31.412893] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:31.634785] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T17:09:31.642518] [INFO ] [REMOTE ] AL: Full fetch complete (61981 records). [2025-09-19T17:09:31.642750] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-19T17:09:31.848434] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-19T17:09:32.053004] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-19T17:09:32.053107] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-19T17:09:32.053739] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-19T17:09:32.053805] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-19T17:09:32.055094] [DEBUG] [LOCAL ] AL: Trimmed 61981 records to 44621 (keeping 200 days of data) [2025-09-19T17:09:32.335725] [DEBUG] [LOCAL ] AL: Primary data saved (44621 records). [2025-09-19T17:09:32.335878] [INFO ] [MAIN ] AL: Full history saved. [2025-09-19T17:09:32.335965] [INFO ] [MAIN ] Update Progress: 77/2372 symbols completed. AL took 35.3s. Estimated remaining: 4h 42m 12s. Rate: 8.1 symbols/min [2025-09-19T17:09:33.375528] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T17:09:33.387787] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-19T17:09:33.556000] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T17:09:33.561762] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-19T17:09:35.097611] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:09:35.107510] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-19T17:09:35.454667] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T17:09:35.465721] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-19T17:09:35.866046] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T17:09:35.871680] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-19T17:09:37.283420] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T17:09:37.289638] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-19T17:09:37.402196] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:09:37.443230] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-19T17:09:38.965099] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T17:09:38.972338] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-19T17:09:39.374872] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T17:09:39.402600] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-19T17:09:39.416997] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (9.17 seconds). [2025-09-19T17:09:39.843266] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-19T17:09:40.501857] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T17:09:40.643264] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-19T17:09:41.527537] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T17:09:41.541097] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-19T17:09:42.122672] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-19T17:09:42.153201] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T17:09:42.243261] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-19T17:09:43.043339] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-19T17:09:43.729266] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T17:09:43.737143] [INFO ] [REMOTE ] ALC: Full fetch complete (72474 records). [2025-09-19T17:09:43.737300] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-19T17:09:44.166087] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-19T17:09:44.166239] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-19T17:09:44.167029] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-19T17:09:44.167204] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-19T17:09:44.189521] [DEBUG] [LOCAL ] ALC: Trimmed 72474 records to 51559 (keeping 200 days of data) [2025-09-19T17:09:44.190780] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T17:09:44.199972] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-19T17:09:44.529669] [DEBUG] [LOCAL ] ALC: Primary data saved (51559 records). [2025-09-19T17:09:44.529842] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-19T17:09:44.530016] [INFO ] [MAIN ] Update Progress: 78/2372 symbols completed. ALC took 26.4s. Estimated remaining: 4h 44m 26s. Rate: 8.1 symbols/min [2025-09-19T17:09:45.650547] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-19T17:09:45.662710] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-19T17:09:46.222040] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T17:09:46.230281] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-19T17:09:47.809179] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:09:47.814848] [INFO ] [REMOTE ] ALE: Full fetch complete (42045 records). [2025-09-19T17:09:47.814993] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-19T17:09:48.206295] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-19T17:09:48.206405] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-19T17:09:48.206961] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-19T17:09:48.207116] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-19T17:09:48.209255] [DEBUG] [LOCAL ] ALE: Trimmed 42045 records to 30622 (keeping 200 days of data) [2025-09-19T17:09:48.331997] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-19T17:09:48.345934] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-19T17:09:48.445355] [DEBUG] [LOCAL ] ALE: Primary data saved (30622 records). [2025-09-19T17:09:48.445509] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-19T17:09:48.445599] [INFO ] [MAIN ] Update Progress: 79/2372 symbols completed. ALE took 17.8s. Estimated remaining: 4h 42m 36s. Rate: 8.1 symbols/min [2025-09-19T17:09:50.981061] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-19T17:09:50.989016] [INFO ] [REMOTE ] ALB: Full fetch complete (76755 records). [2025-09-19T17:09:50.989150] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-19T17:09:51.386852] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-19T17:09:51.386949] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-19T17:09:51.387726] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-19T17:09:51.387819] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-19T17:09:51.389446] [DEBUG] [LOCAL ] ALB: Trimmed 76755 records to 54006 (keeping 200 days of data) [2025-09-19T17:09:51.739063] [DEBUG] [LOCAL ] ALB: Primary data saved (54006 records). [2025-09-19T17:09:51.739224] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-19T17:09:51.742795] [INFO ] [MAIN ] Update Progress: 80/2372 symbols completed. ALB took 42.3s. Estimated remaining: 4h 40m 32s. Rate: 8.2 symbols/min [2025-09-19T17:09:52.372516] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:52.376557] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:52.497706] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:52.516967] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:09:52.544781] [DEBUG] [LOCAL ] ALG: Loaded 10773 existing records from primary storage. [2025-09-19T17:09:52.545024] [INFO ] [MAIN ] ALG: Loaded 10773 existing records. [2025-09-19T17:09:52.617345] [DEBUG] [LOCAL ] ALEX: Loaded 31856 existing records from primary storage. [2025-09-19T17:09:52.671180] [INFO ] [MAIN ] ALEX: Loaded 31856 existing records. [2025-09-19T17:09:52.909611] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:52.926901] [DEBUG] [LOCAL ] ALIT: Loaded 53112 existing records from primary storage. [2025-09-19T17:09:52.942970] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-19T17:09:52.937751] [INFO ] [MAIN ] ALIT: Loaded 53112 existing records. [2025-09-19T17:09:52.969130] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-19T17:09:52.981193] [DEBUG] [LOCAL ] ALK: Loaded 53456 existing records from primary storage. [2025-09-19T17:09:53.016331] [INFO ] [MAIN ] ALK: Loaded 53456 existing records. [2025-09-19T17:09:53.021626] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-19T17:09:53.061850] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-19T17:09:53.154531] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:53.313906] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-19T17:09:53.356039] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-19T17:09:53.452889] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-19T17:09:53.487026] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-19T17:09:53.526988] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:53.666080] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:09:53.733282] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-19T17:09:53.740998] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-19T17:09:53.780710] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-19T17:09:53.775457] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-19T17:09:53.840178] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-19T17:09:53.855891] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-19T17:09:53.855785] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-19T17:09:53.892501] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-19T17:09:54.366084] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:54.409140] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-19T17:09:54.752806] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:54.796826] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-19T17:09:54.975825] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:54.977402] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-19T17:09:55.014956] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:09:55.015382] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-19T17:09:55.828058] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:09:55.831029] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-19T17:09:56.112429] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T17:09:56.119509] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-19T17:09:56.579225] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T17:09:56.589773] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-19T17:09:57.016854] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T17:09:57.028523] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-19T17:09:57.038123] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T17:09:57.041510] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-19T17:09:57.934586] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T17:09:57.940751] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-19T17:09:58.136735] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T17:09:58.139737] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-19T17:09:58.508727] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T17:09:58.526232] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-19T17:09:58.642281] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T17:09:58.653057] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-19T17:09:58.726236] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-19T17:09:58.731547] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-19T17:09:59.022843] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T17:09:59.028610] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-19T17:10:00.016040] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:10:00.026173] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-19T17:10:00.394172] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:10:00.402308] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-19T17:10:00.414985] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T17:10:00.470511] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:10:00.643262] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-19T17:10:01.443319] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-19T17:10:02.199098] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:10:02.243281] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-19T17:10:02.339828] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-19T17:10:02.424556] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T17:10:02.495354] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T17:10:03.043281] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-19T17:10:03.266590] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T17:10:03.843272] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-19T17:10:04.643293] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-19T17:10:04.766378] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T17:10:05.171495] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T17:10:05.443266] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-19T17:10:06.243315] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-19T17:10:06.707683] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:10:06.890278] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T17:10:07.043312] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-19T17:10:07.832095] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T17:10:07.843420] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-19T17:10:08.579025] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:10:08.643260] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-19T17:10:09.227213] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:10:09.443302] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-19T17:10:10.243284] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-19T17:10:10.277901] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:10:10.283150] [INFO ] [REMOTE ] ALEX: Full fetch complete (44523 records). [2025-09-19T17:10:10.283327] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-19T17:10:10.686501] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-19T17:10:10.697848] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-19T17:10:10.698734] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-19T17:10:10.699410] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-19T17:10:10.699848] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T17:10:10.705492] [DEBUG] [LOCAL ] ALEX: Trimmed 44523 records to 32090 (keeping 200 days of data) [2025-09-19T17:10:10.916332] [DEBUG] [LOCAL ] ALEX: Primary data saved (32090 records). [2025-09-19T17:10:10.916493] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-19T17:10:10.916670] [INFO ] [MAIN ] Update Progress: 81/2372 symbols completed. ALEX took 19.2s. Estimated remaining: 4h 45m 59s. Rate: 8.0 symbols/min [2025-09-19T17:10:11.055519] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-19T17:10:11.088930] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:11.150237] [DEBUG] [LOCAL ] ALL: Loaded 50589 existing records from primary storage. [2025-09-19T17:10:11.150410] [INFO ] [MAIN ] ALL: Loaded 50589 existing records. [2025-09-19T17:10:11.331415] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:11.331928] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-19T17:10:11.331981] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-19T17:10:11.333593] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-19T17:10:11.333688] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-19T17:10:11.686638] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:11.843264] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-19T17:10:12.131519] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T17:10:12.643310] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-19T17:10:13.443268] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-19T17:10:13.848155] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T17:10:14.243268] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-19T17:10:14.407375] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (4.16 seconds). [2025-09-19T17:10:14.634822] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T17:10:15.043283] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-19T17:10:15.081807] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T17:10:15.843287] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-19T17:10:16.276604] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T17:10:16.546728] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T17:10:16.548592] [INFO ] [REMOTE ] ALG: Full fetch complete (15829 records). [2025-09-19T17:10:16.548715] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-19T17:10:16.650736] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-19T17:10:16.956062] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-19T17:10:16.956196] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-19T17:10:16.956486] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-19T17:10:16.956530] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-19T17:10:16.957130] [DEBUG] [LOCAL ] ALG: Trimmed 15829 records to 10840 (keeping 200 days of data) [2025-09-19T17:10:17.033554] [DEBUG] [LOCAL ] ALG: Primary data saved (10840 records). [2025-09-19T17:10:17.033725] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-19T17:10:17.033875] [INFO ] [MAIN ] Update Progress: 82/2372 symbols completed. ALG took 25.3s. Estimated remaining: 4h 45m 13s. Rate: 8.0 symbols/min [2025-09-19T17:10:17.226945] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:17.262073] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T17:10:17.327477] [DEBUG] [LOCAL ] ALLE: Loaded 45630 existing records from primary storage. [2025-09-19T17:10:17.327639] [INFO ] [MAIN ] ALLE: Loaded 45630 existing records. [2025-09-19T17:10:17.448475] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-19T17:10:17.530873] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:17.531123] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-19T17:10:17.531174] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-19T17:10:17.538713] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-19T17:10:17.539300] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-19T17:10:17.916166] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:18.243287] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-19T17:10:18.560387] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T17:10:19.043281] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-19T17:10:19.642084] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T17:10:19.843226] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-19T17:10:20.242674] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T17:10:20.643277] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-19T17:10:20.698220] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T17:10:20.709464] [INFO ] [REMOTE ] ALK: Full fetch complete (76789 records). [2025-09-19T17:10:20.709824] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-19T17:10:21.138139] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-19T17:10:21.138264] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-19T17:10:21.139037] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-19T17:10:21.139105] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-19T17:10:21.141551] [DEBUG] [LOCAL ] ALK: Trimmed 76789 records to 53840 (keeping 200 days of data) [2025-09-19T17:10:21.457235] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-19T17:10:21.484043] [DEBUG] [LOCAL ] ALK: Primary data saved (53840 records). [2025-09-19T17:10:21.484216] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-19T17:10:21.485576] [INFO ] [MAIN ] Update Progress: 83/2372 symbols completed. ALK took 29.7s. Estimated remaining: 4h 43m 42s. Rate: 8.1 symbols/min [2025-09-19T17:10:21.656124] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:21.717940] [DEBUG] [LOCAL ] ALLY: Loaded 53607 existing records from primary storage. [2025-09-19T17:10:21.718097] [INFO ] [MAIN ] ALLY: Loaded 53607 existing records. [2025-09-19T17:10:21.902037] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:21.902609] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-19T17:10:21.902782] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-19T17:10:21.904897] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-19T17:10:21.904970] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-19T17:10:22.048763] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T17:10:22.246584] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-19T17:10:22.333340] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:22.366628] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T17:10:23.043287] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-19T17:10:23.435237] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T17:10:23.843272] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-19T17:10:24.213108] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T17:10:24.221423] [INFO ] [REMOTE ] ALIT: Full fetch complete (76413 records). [2025-09-19T17:10:24.221676] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-19T17:10:24.650012] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-19T17:10:24.650171] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-19T17:10:24.648916] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-19T17:10:24.651078] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-19T17:10:24.651427] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-19T17:10:24.654261] [DEBUG] [LOCAL ] ALIT: Trimmed 76413 records to 53499 (keeping 200 days of data) [2025-09-19T17:10:25.005292] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T17:10:25.036134] [DEBUG] [LOCAL ] ALIT: Primary data saved (53499 records). [2025-09-19T17:10:25.036292] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-19T17:10:25.036382] [INFO ] [MAIN ] Update Progress: 84/2372 symbols completed. ALIT took 33.3s. Estimated remaining: 4h 41m 49s. Rate: 8.1 symbols/min [2025-09-19T17:10:25.216430] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:25.268739] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T17:10:25.292662] [DEBUG] [LOCAL ] ALSN: Loaded 43709 existing records from primary storage. [2025-09-19T17:10:25.292858] [INFO ] [MAIN ] ALSN: Loaded 43709 existing records. [2025-09-19T17:10:25.452717] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-19T17:10:25.484893] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:25.485158] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-19T17:10:25.485210] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-19T17:10:25.486485] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-19T17:10:25.486559] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-19T17:10:25.853150] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:26.243281] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-19T17:10:26.767954] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T17:10:27.001413] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T17:10:27.043247] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-19T17:10:27.843334] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-19T17:10:28.285057] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T17:10:28.643300] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-19T17:10:29.013525] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T17:10:29.443258] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-19T17:10:29.843205] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T17:10:30.243281] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-19T17:10:31.043328] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-19T17:10:31.375128] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:10:31.843264] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-19T17:10:32.048885] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:10:32.643291] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-19T17:10:33.082123] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:10:33.443684] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-19T17:10:33.449754] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T17:10:34.243255] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-19T17:10:34.931133] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-19T17:10:35.043273] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-19T17:10:35.405097] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T17:10:35.848589] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-19T17:10:35.873705] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T17:10:36.232303] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:10:36.531070] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (8.69 seconds). [2025-09-19T17:10:36.643268] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-19T17:10:37.443289] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-19T17:10:37.882095] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:10:38.243299] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-19T17:10:38.630189] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T17:10:39.024222] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:10:39.043209] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-19T17:10:39.709424] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:10:39.843259] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-19T17:10:40.643312] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-19T17:10:41.124382] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T17:10:41.443265] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-19T17:10:41.875814] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T17:10:42.243263] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-19T17:10:42.491837] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T17:10:43.043330] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-19T17:10:43.106847] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T17:10:43.843320] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-19T17:10:44.046369] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T17:10:44.643284] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-19T17:10:45.250633] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T17:10:45.426998] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T17:10:45.443223] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-19T17:10:46.000523] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T17:10:46.243264] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-19T17:10:47.043279] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-19T17:10:47.544766] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T17:10:47.553457] [INFO ] [REMOTE ] ALL: Full fetch complete (72491 records). [2025-09-19T17:10:47.553631] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-19T17:10:47.844588] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-19T17:10:47.976365] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-19T17:10:47.976477] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-19T17:10:47.977425] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-19T17:10:47.977517] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-19T17:10:47.979694] [DEBUG] [LOCAL ] ALL: Trimmed 72491 records to 50961 (keeping 200 days of data) [2025-09-19T17:10:48.171371] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T17:10:48.424453] [DEBUG] [LOCAL ] ALL: Primary data saved (50961 records). [2025-09-19T17:10:48.424614] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-19T17:10:48.426536] [INFO ] [MAIN ] Update Progress: 85/2372 symbols completed. ALL took 37.5s. Estimated remaining: 4h 48m 52s. Rate: 7.9 symbols/min [2025-09-19T17:10:48.605300] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:48.630577] [DEBUG] [LOCAL ] ALTG: Loaded 24477 existing records from primary storage. [2025-09-19T17:10:48.630746] [INFO ] [MAIN ] ALTG: Loaded 24477 existing records. [2025-09-19T17:10:48.664279] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-19T17:10:48.823537] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:48.824021] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-19T17:10:48.824179] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-19T17:10:48.825116] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-19T17:10:48.825178] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-19T17:10:49.222575] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:49.251837] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T17:10:49.443276] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-19T17:10:49.842880] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T17:10:49.850188] [INFO ] [REMOTE ] ALSN: Full fetch complete (61967 records). [2025-09-19T17:10:49.850329] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-19T17:10:50.250748] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-19T17:10:50.252451] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-19T17:10:50.252544] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-19T17:10:50.253168] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-19T17:10:50.253303] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-19T17:10:50.254723] [DEBUG] [LOCAL ] ALSN: Trimmed 61967 records to 44026 (keeping 200 days of data) [2025-09-19T17:10:50.496611] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:10:50.541432] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T17:10:50.551426] [INFO ] [REMOTE ] ALLY: Full fetch complete (76869 records). [2025-09-19T17:10:50.552396] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-19T17:10:50.711236] [DEBUG] [LOCAL ] ALSN: Primary data saved (44026 records). [2025-09-19T17:10:50.730181] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-19T17:10:50.740552] [INFO ] [MAIN ] Update Progress: 86/2372 symbols completed. ALSN took 25.7s. Estimated remaining: 4h 46m 25s. Rate: 8.0 symbols/min [2025-09-19T17:10:51.058415] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-19T17:10:51.159429] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:51.186524] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-19T17:10:51.186756] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-19T17:10:51.188799] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-19T17:10:51.189497] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-19T17:10:51.191479] [DEBUG] [LOCAL ] ALLY: Trimmed 76869 records to 53994 (keeping 200 days of data) [2025-09-19T17:10:51.295078] [DEBUG] [LOCAL ] ALUR: Loaded 11174 existing records from primary storage. [2025-09-19T17:10:51.295719] [INFO ] [MAIN ] ALUR: Loaded 11174 existing records. [2025-09-19T17:10:51.499962] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:51.506561] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-19T17:10:51.507696] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-19T17:10:51.512871] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-19T17:10:51.513214] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-19T17:10:52.030557] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:52.031376] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-19T17:10:52.132020] [DEBUG] [LOCAL ] ALLY: Primary data saved (53994 records). [2025-09-19T17:10:52.132162] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-19T17:10:52.132313] [INFO ] [MAIN ] Update Progress: 87/2372 symbols completed. ALLY took 30.6s. Estimated remaining: 4h 43m 36s. Rate: 8.1 symbols/min [2025-09-19T17:10:52.304936] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:52.330227] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T17:10:52.384698] [DEBUG] [LOCAL ] ALV: Loaded 43233 existing records from primary storage. [2025-09-19T17:10:52.384886] [INFO ] [MAIN ] ALV: Loaded 43233 existing records. [2025-09-19T17:10:52.569706] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:52.570217] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-19T17:10:52.570441] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-19T17:10:52.580395] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-19T17:10:52.581039] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-19T17:10:52.581355] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:10:52.645145] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-19T17:10:52.957482] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:53.443277] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-19T17:10:53.757829] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T17:10:54.125333] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:10:54.132178] [INFO ] [REMOTE ] ALLE: Full fetch complete (65139 records). [2025-09-19T17:10:54.132374] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-19T17:10:54.248497] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-19T17:10:54.558715] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-19T17:10:54.558805] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-19T17:10:54.559421] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-19T17:10:54.559467] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-19T17:10:54.561044] [DEBUG] [LOCAL ] ALLE: Trimmed 65139 records to 46000 (keeping 200 days of data) [2025-09-19T17:10:54.828424] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T17:10:54.891248] [DEBUG] [LOCAL ] ALLE: Primary data saved (46000 records). [2025-09-19T17:10:54.891415] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-19T17:10:54.891518] [INFO ] [MAIN ] Update Progress: 88/2372 symbols completed. ALLE took 37.9s. Estimated remaining: 4h 41m 27s. Rate: 8.1 symbols/min [2025-09-19T17:10:55.048627] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-19T17:10:55.066196] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:10:55.075329] [DEBUG] [LOCAL ] ALX: Loaded 5828 existing records from primary storage. [2025-09-19T17:10:55.075446] [INFO ] [MAIN ] ALX: Loaded 5828 existing records. [2025-09-19T17:10:55.254712] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:10:55.254987] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-19T17:10:55.255036] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-19T17:10:55.255468] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-19T17:10:55.255528] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-19T17:10:55.630317] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:10:55.770509] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T17:10:55.843279] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-19T17:10:56.540572] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T17:10:56.643264] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-19T17:10:56.697182] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T17:10:57.443263] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-19T17:10:58.049138] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T17:10:58.243272] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-19T17:10:58.387523] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T17:10:59.043279] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-19T17:10:59.618813] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T17:10:59.843269] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-19T17:11:00.353241] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T17:11:00.643272] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-19T17:11:01.177769] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T17:11:01.323004] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T17:11:01.443277] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-19T17:11:02.151413] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T17:11:02.243266] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-19T17:11:02.836733] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-19T17:11:03.043278] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-19T17:11:03.843282] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-19T17:11:04.395857] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:11:04.643307] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-19T17:11:05.443283] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-19T17:11:05.704131] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T17:11:05.976574] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-19T17:11:06.019958] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:11:06.243313] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-19T17:11:07.043226] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-19T17:11:07.275487] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T17:11:07.843283] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-19T17:11:08.643278] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-19T17:11:08.998572] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:11:09.070468] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T17:11:09.443315] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-19T17:11:09.605225] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T17:11:10.243268] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-19T17:11:10.616960] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T17:11:11.043274] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-19T17:11:11.730733] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T17:11:11.843293] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-19T17:11:12.136233] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T17:11:12.643305] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-19T17:11:12.867092] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T17:11:13.443286] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-19T17:11:14.117776] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:11:14.121883] [INFO ] [REMOTE ] ALTG: Full fetch complete (33619 records). [2025-09-19T17:11:14.121979] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-19T17:11:14.248412] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-19T17:11:14.537467] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-19T17:11:14.537622] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-19T17:11:14.538375] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-19T17:11:14.538456] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-19T17:11:14.540022] [DEBUG] [LOCAL ] ALTG: Trimmed 33619 records to 24604 (keeping 200 days of data) [2025-09-19T17:11:14.592616] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T17:11:14.603975] [INFO ] [REMOTE ] ALX: Full fetch complete (6714 records). [2025-09-19T17:11:14.630981] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-19T17:11:14.984701] [DEBUG] [LOCAL ] ALTG: Primary data saved (24604 records). [2025-09-19T17:11:14.990542] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-19T17:11:14.995876] [INFO ] [MAIN ] Update Progress: 89/2372 symbols completed. ALTG took 26.6s. Estimated remaining: 4h 46m 46s. Rate: 8.0 symbols/min [2025-09-19T17:11:15.048446] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-19T17:11:15.178349] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-19T17:11:15.181851] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-19T17:11:15.182213] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-19T17:11:15.188078] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-19T17:11:15.209344] [DEBUG] [LOCAL ] ALX: Trimmed 6714 records to 5880 (keeping 200 days of data) [2025-09-19T17:11:15.291394] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:15.294914] [DEBUG] [LOCAL ] ALX: Primary data saved (5880 records). [2025-09-19T17:11:15.295508] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-19T17:11:15.295612] [INFO ] [MAIN ] Update Progress: 90/2372 symbols completed. ALX took 20.4s. Estimated remaining: 4h 43m 35s. Rate: 8.0 symbols/min [2025-09-19T17:11:15.472123] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:15.515312] [DEBUG] [LOCAL ] AM: Loaded 52557 existing records from primary storage. [2025-09-19T17:11:15.515598] [INFO ] [MAIN ] AM: Loaded 52557 existing records. [2025-09-19T17:11:15.666821] [DEBUG] [LOCAL ] AMBC: Loaded 37906 existing records from primary storage. [2025-09-19T17:11:15.691470] [INFO ] [MAIN ] AMBC: Loaded 37906 existing records. [2025-09-19T17:11:15.753801] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:15.790865] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-19T17:11:15.816869] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-19T17:11:15.840074] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-19T17:11:15.840348] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-19T17:11:16.001059] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:16.053827] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-19T17:11:16.059917] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-19T17:11:16.102974] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-19T17:11:16.109010] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-19T17:11:16.527986] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:16.564546] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-19T17:11:16.576571] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T17:11:16.649740] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-19T17:11:16.771723] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:16.792613] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T17:11:17.443272] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-19T17:11:18.243356] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-19T17:11:18.446159] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T17:11:18.558916] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T17:11:18.820716] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-19T17:11:18.862442] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T17:11:19.043272] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-19T17:11:19.843299] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-19T17:11:20.145237] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T17:11:20.643325] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-19T17:11:21.443372] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-19T17:11:21.796389] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:11:22.160294] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T17:11:22.243402] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-19T17:11:22.674489] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T17:11:23.043310] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-19T17:11:23.843294] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-19T17:11:24.241495] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:11:24.643333] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-19T17:11:24.962944] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T17:11:25.074378] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:11:25.443260] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-19T17:11:25.578588] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T17:11:26.243271] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-19T17:11:27.043275] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-19T17:11:27.150637] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T17:11:27.843250] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-19T17:11:27.968861] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T17:11:27.970298] [INFO ] [REMOTE ] ALUR: Full fetch complete (21460 records). [2025-09-19T17:11:27.970374] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-19T17:11:28.358385] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-19T17:11:28.358464] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-19T17:11:28.358797] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-19T17:11:28.358859] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-19T17:11:28.359427] [DEBUG] [LOCAL ] ALUR: Trimmed 21460 records to 11223 (keeping 200 days of data) [2025-09-19T17:11:28.422589] [DEBUG] [LOCAL ] ALUR: Primary data saved (11223 records). [2025-09-19T17:11:28.422751] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-19T17:11:28.422847] [INFO ] [MAIN ] Update Progress: 91/2372 symbols completed. ALUR took 37.7s. Estimated remaining: 4h 45m 49s. Rate: 8.0 symbols/min [2025-09-19T17:11:28.609273] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:28.644388] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-19T17:11:28.644300] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-19T17:11:28.694329] [DEBUG] [LOCAL ] AMBP: Loaded 45660 existing records from primary storage. [2025-09-19T17:11:28.694468] [INFO ] [MAIN ] AMBP: Loaded 45660 existing records. [2025-09-19T17:11:28.873560] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:28.873825] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-19T17:11:28.873876] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-19T17:11:28.875290] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-19T17:11:28.875354] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-19T17:11:29.234362] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:29.443337] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-19T17:11:29.679060] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T17:11:30.243266] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-19T17:11:30.496450] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T17:11:31.043291] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-19T17:11:31.372848] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T17:11:31.851396] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-19T17:11:31.870614] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:11:32.048701] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T17:11:32.643284] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-19T17:11:33.443259] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-19T17:11:33.709908] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T17:11:33.716088] [INFO ] [REMOTE ] ALV: Full fetch complete (61919 records). [2025-09-19T17:11:33.716228] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-19T17:11:34.108315] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-19T17:11:34.108400] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-19T17:11:34.109249] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-19T17:11:34.109319] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-19T17:11:34.110681] [DEBUG] [LOCAL ] ALV: Trimmed 61919 records to 43481 (keeping 200 days of data) [2025-09-19T17:11:34.294446] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-19T17:11:34.392146] [DEBUG] [LOCAL ] ALV: Primary data saved (43481 records). [2025-09-19T17:11:34.392338] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-19T17:11:34.392981] [INFO ] [MAIN ] Update Progress: 92/2372 symbols completed. ALV took 42.3s. Estimated remaining: 4h 45m 3s. Rate: 8.0 symbols/min [2025-09-19T17:11:34.575549] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:34.576003] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-19T17:11:34.576115] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-19T17:11:34.576388] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-19T17:11:34.576437] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-19T17:11:34.576480] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-19T17:11:34.576513] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-19T17:11:34.952494] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T17:11:35.027328] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:35.056666] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-19T17:11:35.060798] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T17:11:35.345098] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T17:11:35.843275] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-19T17:11:36.643284] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-19T17:11:37.138730] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T17:11:37.443276] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-19T17:11:37.545390] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T17:11:37.681454] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:37.687709] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T17:11:37.687910] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-19T17:11:38.243325] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-19T17:11:39.043325] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-19T17:11:39.843274] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-19T17:11:40.143132] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T17:11:40.253287] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T17:11:40.258162] [INFO ] [REMOTE ] AMBC: Full fetch complete (51070 records). [2025-09-19T17:11:40.258291] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-19T17:11:40.631874] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-19T17:11:40.631958] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-19T17:11:40.632477] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-19T17:11:40.632538] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-19T17:11:40.633608] [DEBUG] [LOCAL ] AMBC: Trimmed 51070 records to 38086 (keeping 200 days of data) [2025-09-19T17:11:40.680937] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-19T17:11:40.845161] [DEBUG] [LOCAL ] AMBC: Primary data saved (38086 records). [2025-09-19T17:11:40.845301] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-19T17:11:40.845382] [INFO ] [MAIN ] Update Progress: 93/2372 symbols completed. AMBC took 25.5s. Estimated remaining: 4h 44m 30s. Rate: 8.0 symbols/min [2025-09-19T17:11:41.012903] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:41.066020] [DEBUG] [LOCAL ] AMC: Loaded 54147 existing records from primary storage. [2025-09-19T17:11:41.066164] [INFO ] [MAIN ] AMC: Loaded 54147 existing records. [2025-09-19T17:11:41.239623] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:41.239918] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-19T17:11:41.239965] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-19T17:11:41.241483] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-19T17:11:41.241543] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-19T17:11:41.472732] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-19T17:11:41.619582] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:41.690063] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:11:41.754049] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:41.754315] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-19T17:11:42.243260] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-19T17:11:42.856318] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:11:43.043270] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-19T17:11:43.709825] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T17:11:43.843256] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-19T17:11:44.082237] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:44.082619] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-19T17:11:44.643270] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-19T17:11:44.978753] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T17:11:45.443266] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-19T17:11:46.243273] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-19T17:11:46.491491] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:46.491849] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-19T17:11:47.043306] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-19T17:11:47.164330] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-19T17:11:47.321510] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T17:11:47.843270] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-19T17:11:48.643331] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-19T17:11:48.884529] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:48.884933] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-19T17:11:49.000345] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T17:11:49.008594] [INFO ] [REMOTE ] AM: Full fetch complete (75627 records). [2025-09-19T17:11:49.008842] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-19T17:11:49.450797] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-19T17:11:49.454625] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-19T17:11:49.454747] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-19T17:11:49.456492] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-19T17:11:49.456581] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-19T17:11:49.458251] [DEBUG] [LOCAL ] AM: Trimmed 75627 records to 52944 (keeping 200 days of data) [2025-09-19T17:11:49.769466] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:49.793566] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-19T17:11:49.817862] [DEBUG] [LOCAL ] AM: Primary data saved (52944 records). [2025-09-19T17:11:49.818022] [INFO ] [MAIN ] AM: Full history saved. [2025-09-19T17:11:49.818111] [INFO ] [MAIN ] Update Progress: 94/2372 symbols completed. AM took 34.8s. Estimated remaining: 4h 44m 59s. Rate: 8.0 symbols/min [2025-09-19T17:11:49.984842] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:11:50.039133] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-09-19T17:11:50.039381] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-09-19T17:11:50.247686] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-19T17:11:50.277371] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:11:50.279567] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-19T17:11:50.290488] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-19T17:11:50.290883] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-19T17:11:50.294482] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-19T17:11:50.294568] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-19T17:11:50.689528] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:11:51.043272] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-19T17:11:51.272786] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:11:51.273106] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-19T17:11:51.843281] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-19T17:11:52.075257] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T17:11:52.643260] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-19T17:11:53.443297] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-19T17:11:54.243295] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-19T17:11:54.352030] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-19T17:11:54.382811] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T17:11:54.398025] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:11:55.043257] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-19T17:11:55.843278] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-19T17:11:56.036548] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T17:11:56.643262] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-19T17:11:56.945261] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T17:11:57.103777] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:11:57.443275] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-19T17:11:58.243294] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-19T17:11:58.894032] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T17:11:59.043268] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-19T17:11:59.702630] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:11:59.706698] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7476 records). [2025-09-19T17:11:59.706773] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-19T17:11:59.848464] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-19T17:11:59.893000] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 37 unique days, need 200 days [2025-09-19T17:11:59.893239] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:11:59.893309] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:11:59.893381] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-19T17:11:59.893461] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-19T17:11:59.893518] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-19T17:11:59.893563] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-19T17:11:59.893624] [INFO ] [MAIN ] Update Progress: 95/2372 symbols completed. AMBQ took 25.5s. Estimated remaining: 4h 45m 53s. Rate: 8.0 symbols/min [2025-09-19T17:12:00.067049] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:00.130754] [DEBUG] [LOCAL ] AME: Loaded 48968 existing records from primary storage. [2025-09-19T17:12:00.130920] [INFO ] [MAIN ] AME: Loaded 48968 existing records. [2025-09-19T17:12:00.318283] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:00.334452] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-19T17:12:00.347092] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-19T17:12:00.348820] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-09-19T17:12:00.349021] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-19T17:12:00.359838] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-19T17:12:00.650433] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-19T17:12:00.733204] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:00.849104] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T17:12:00.855476] [INFO ] [REMOTE ] AMBP: Full fetch complete (66090 records). [2025-09-19T17:12:00.855602] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-19T17:12:01.237781] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-19T17:12:01.237867] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-19T17:12:01.238503] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-19T17:12:01.238544] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-19T17:12:01.239905] [DEBUG] [LOCAL ] AMBP: Trimmed 66090 records to 46014 (keeping 200 days of data) [2025-09-19T17:12:01.452004] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-19T17:12:01.508502] [DEBUG] [LOCAL ] AMBP: Primary data saved (46014 records). [2025-09-19T17:12:01.508688] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-19T17:12:01.508820] [INFO ] [MAIN ] Update Progress: 96/2372 symbols completed. AMBP took 33.1s. Estimated remaining: 4h 43m 25s. Rate: 8.0 symbols/min [2025-09-19T17:12:01.687371] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:01.710337] [DEBUG] [LOCAL ] AMG: Loaded 21044 existing records from primary storage. [2025-09-19T17:12:01.710487] [INFO ] [MAIN ] AMG: Loaded 21044 existing records. [2025-09-19T17:12:01.879875] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:12:01.951784] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:01.952035] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-19T17:12:01.952083] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-19T17:12:01.952975] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-19T17:12:01.953065] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-19T17:12:02.248461] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-19T17:12:02.320264] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:03.043323] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-19T17:12:03.870247] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (3.22 seconds). [2025-09-19T17:12:03.881932] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-19T17:12:04.700318] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T17:12:04.705174] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-19T17:12:05.812956] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:12:05.817751] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-19T17:12:05.869675] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (3.62 seconds). [2025-09-19T17:12:05.963952] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (4.51 seconds). [2025-09-19T17:12:06.243300] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-19T17:12:07.051177] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-19T17:12:07.058346] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-09-19T17:12:07.198272] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T17:12:07.848879] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-19T17:12:07.852210] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T17:12:08.556236] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T17:12:08.643319] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-19T17:12:09.368444] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:12:09.443280] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-19T17:12:10.243333] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-19T17:12:11.043334] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-19T17:12:11.231055] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:12:11.320894] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-19T17:12:11.843272] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-19T17:12:12.518288] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T17:12:12.643279] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-19T17:12:13.443347] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-19T17:12:14.370996] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (3.33 seconds). [2025-09-19T17:12:14.385109] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-19T17:12:15.115579] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (3.27 seconds). [2025-09-19T17:12:15.128936] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-19T17:12:15.221126] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-19T17:12:15.565462] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T17:12:15.843285] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-19T17:12:16.104224] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T17:12:16.643288] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-19T17:12:17.420039] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T17:12:17.443212] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-19T17:12:17.702063] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-19T17:12:18.243272] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-19T17:12:18.763957] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T17:12:18.814424] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T17:12:19.043270] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-19T17:12:19.843273] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-19T17:12:20.014791] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T17:12:20.235889] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T17:12:20.643283] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-19T17:12:21.443280] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-19T17:12:22.071601] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T17:12:22.079874] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-19T17:12:22.080094] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-19T17:12:22.245909] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-19T17:12:22.522772] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-19T17:12:22.523034] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-19T17:12:22.523853] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-19T17:12:22.523961] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-19T17:12:22.528014] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54537 (keeping 200 days of data) [2025-09-19T17:12:22.673215] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:12:22.881714] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:12:22.887336] [INFO ] [REMOTE ] AMG: Full fetch complete (29594 records). [2025-09-19T17:12:22.888234] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-19T17:12:22.889677] [FATAL] [VALIDATOR ] AMG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:12:22.890237] [FATAL] [MAIN ] AMG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:12:22.890795] [WARN ] [MAIN ] AMG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:12:22.892073] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-19T17:12:22.892572] [DEBUG] [LOCAL ] AMG: No primary data file found to delete. [2025-09-19T17:12:22.893111] [INFO ] [LOCAL ] AMG: Starting deletion of derivative data. [2025-09-19T17:12:22.894002] [DEBUG] [LOCAL ] AMG: Deleted derivative data file. [2025-09-19T17:12:22.894563] [INFO ] [MAIN ] Update Progress: 97/2372 symbols completed. AMG took 21.4s. Estimated remaining: 4h 48m 44s. Rate: 7.9 symbols/min [2025-09-19T17:12:23.045757] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-19T17:12:23.116268] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:23.127579] [DEBUG] [LOCAL ] AMC: Primary data saved (54537 records). [2025-09-19T17:12:23.127748] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-19T17:12:23.127864] [INFO ] [MAIN ] Update Progress: 98/2372 symbols completed. AMC took 42.3s. Estimated remaining: 4h 45m 45s. Rate: 8.0 symbols/min [2025-09-19T17:12:23.311544] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:23.346129] [DEBUG] [LOCAL ] AMH: Loaded 52077 existing records from primary storage. [2025-09-19T17:12:23.346359] [INFO ] [MAIN ] AMH: Loaded 52077 existing records. [2025-09-19T17:12:23.573517] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:23.573380] [DEBUG] [LOCAL ] AMN: Loaded 42501 existing records from primary storage. [2025-09-19T17:12:23.573853] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-19T17:12:23.573938] [INFO ] [MAIN ] AMN: Loaded 42501 existing records. [2025-09-19T17:12:23.574008] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-19T17:12:23.668032] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-19T17:12:23.679478] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-19T17:12:23.896958] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:23.912616] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-19T17:12:23.933406] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-19T17:12:23.953868] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-19T17:12:23.981033] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-19T17:12:24.345986] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:24.381491] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-19T17:12:24.556999] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:24.590171] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T17:12:24.643222] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-19T17:12:25.298132] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T17:12:25.443255] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-19T17:12:25.977202] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T17:12:26.243290] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-19T17:12:27.008516] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T17:12:27.016940] [INFO ] [REMOTE ] AMCR: Full fetch complete (77678 records). [2025-09-19T17:12:27.017126] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-19T17:12:27.050594] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-19T17:12:27.428514] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-19T17:12:27.428626] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-19T17:12:27.429421] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-19T17:12:27.429570] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-19T17:12:27.431345] [DEBUG] [LOCAL ] AMCR: Trimmed 77678 records to 54449 (keeping 200 days of data) [2025-09-19T17:12:27.541623] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T17:12:27.795763] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-09-19T17:12:27.795986] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-19T17:12:27.796155] [INFO ] [MAIN ] Update Progress: 99/2372 symbols completed. AMCR took 38.0s. Estimated remaining: 4h 44m 31s. Rate: 8.0 symbols/min [2025-09-19T17:12:27.863586] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-19T17:12:27.974432] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:28.013178] [DEBUG] [LOCAL ] AMP: Loaded 33159 existing records from primary storage. [2025-09-19T17:12:28.013341] [INFO ] [MAIN ] AMP: Loaded 33159 existing records. [2025-09-19T17:12:28.191936] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:28.192180] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-19T17:12:28.192258] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-19T17:12:28.193710] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-19T17:12:28.193773] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-19T17:12:28.571785] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:28.599924] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-19T17:12:28.643213] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-19T17:12:29.010349] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T17:12:29.443294] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-19T17:12:29.618080] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T17:12:30.025073] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T17:12:30.243289] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-19T17:12:31.043274] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-19T17:12:31.343667] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T17:12:31.452030] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T17:12:31.843263] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-19T17:12:32.643304] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-19T17:12:33.092051] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T17:12:33.223057] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T17:12:33.443296] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-19T17:12:33.906586] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T17:12:34.243304] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-19T17:12:35.043327] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-19T17:12:35.382825] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T17:12:35.843251] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-19T17:12:35.877476] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-19T17:12:35.885111] [INFO ] [REMOTE ] AME: Full fetch complete (69624 records). [2025-09-19T17:12:35.885281] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-19T17:12:36.288295] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-19T17:12:36.288479] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-19T17:12:36.289348] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-19T17:12:36.289602] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-19T17:12:36.291849] [DEBUG] [LOCAL ] AME: Trimmed 69624 records to 49312 (keeping 200 days of data) [2025-09-19T17:12:36.324129] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:12:36.643076] [DEBUG] [LOCAL ] AME: Primary data saved (49312 records). [2025-09-19T17:12:36.643212] [INFO ] [MAIN ] AME: Full history saved. [2025-09-19T17:12:36.643270] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-19T17:12:36.645124] [INFO ] [MAIN ] Update Progress: 100/2372 symbols completed. AME took 36.8s. Estimated remaining: 4h 44m 54s. Rate: 8.0 symbols/min [2025-09-19T17:12:36.818566] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:36.876414] [DEBUG] [LOCAL ] AMPX: Loaded 52458 existing records from primary storage. [2025-09-19T17:12:36.876565] [INFO ] [MAIN ] AMPX: Loaded 52458 existing records. [2025-09-19T17:12:37.052271] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:37.052512] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-19T17:12:37.052565] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-19T17:12:37.053784] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-19T17:12:37.053845] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-19T17:12:37.409434] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:37.443229] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-19T17:12:37.726322] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:12:38.243291] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-19T17:12:38.655602] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:12:39.043528] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-19T17:12:39.315078] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T17:12:39.628635] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T17:12:39.843281] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-19T17:12:40.643270] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-19T17:12:41.073574] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:12:41.191233] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:12:41.443284] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-19T17:12:42.243289] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-19T17:12:42.681166] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T17:12:43.043323] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-19T17:12:43.149823] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T17:12:43.570802] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T17:12:43.843281] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-19T17:12:44.643257] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-19T17:12:44.763899] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:12:45.443276] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-19T17:12:45.748010] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T17:12:45.880975] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:12:46.243270] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-19T17:12:47.043328] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-19T17:12:47.082879] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:12:47.843269] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-19T17:12:48.162392] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T17:12:48.643250] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-19T17:12:49.154816] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T17:12:49.224117] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:12:49.443259] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-19T17:12:50.243274] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-19T17:12:50.525151] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T17:12:51.043302] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-19T17:12:51.419631] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T17:12:51.843267] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-19T17:12:52.062673] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:12:52.643338] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-19T17:12:52.954256] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T17:12:52.960824] [INFO ] [REMOTE ] AMN: Full fetch complete (60525 records). [2025-09-19T17:12:52.960944] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-19T17:12:53.443355] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-19T17:12:53.443239] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-19T17:12:53.444567] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-19T17:12:53.445225] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-19T17:12:53.445307] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-19T17:12:53.453992] [DEBUG] [LOCAL ] AMN: Trimmed 60525 records to 42768 (keeping 200 days of data) [2025-09-19T17:12:53.467931] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T17:12:53.533818] [INFO ] [REMOTE ] AMH: Full fetch complete (74655 records). [2025-09-19T17:12:53.561442] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-19T17:12:54.064188] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-19T17:12:54.064855] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-19T17:12:54.066738] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-19T17:12:54.067114] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-19T17:12:54.071365] [DEBUG] [LOCAL ] AMH: Trimmed 74655 records to 52456 (keeping 200 days of data) [2025-09-19T17:12:54.445301] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:12:54.464681] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-19T17:12:54.508711] [DEBUG] [LOCAL ] AMN: Primary data saved (42768 records). [2025-09-19T17:12:54.510458] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-19T17:12:54.510867] [INFO ] [MAIN ] Update Progress: 101/2372 symbols completed. AMN took 31.4s. Estimated remaining: 4h 48m 39s. Rate: 7.9 symbols/min [2025-09-19T17:12:54.736449] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:54.818613] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T17:12:54.863135] [DEBUG] [LOCAL ] AMPY: Loaded 37679 existing records from primary storage. [2025-09-19T17:12:54.862502] [DEBUG] [LOCAL ] AMH: Primary data saved (52456 records). [2025-09-19T17:12:54.863281] [INFO ] [MAIN ] AMPY: Loaded 37679 existing records. [2025-09-19T17:12:54.863380] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-19T17:12:54.895829] [INFO ] [MAIN ] Update Progress: 102/2372 symbols completed. AMH took 32.0s. Estimated remaining: 4h 45m 51s. Rate: 7.9 symbols/min [2025-09-19T17:12:55.044631] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-19T17:12:55.197466] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:55.211038] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-19T17:12:55.212578] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-19T17:12:55.229975] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:55.230750] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-19T17:12:55.230815] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-19T17:12:55.546904] [DEBUG] [LOCAL ] AMR: Loaded 29544 existing records from primary storage. [2025-09-19T17:12:55.557979] [INFO ] [MAIN ] AMR: Loaded 29544 existing records. [2025-09-19T17:12:55.728753] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:55.808605] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:55.808858] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-19T17:12:55.808922] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-19T17:12:55.809776] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-19T17:12:55.809839] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-19T17:12:55.852083] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-19T17:12:56.169234] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:56.208771] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T17:12:56.643264] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-19T17:12:56.824203] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T17:12:56.829487] [INFO ] [REMOTE ] AMP: Full fetch complete (47622 records). [2025-09-19T17:12:56.829603] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-19T17:12:57.222148] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T17:12:57.245502] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-19T17:12:57.245584] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-19T17:12:57.246143] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-19T17:12:57.246206] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-19T17:12:57.250529] [DEBUG] [LOCAL ] AMP: Trimmed 47622 records to 33358 (keeping 200 days of data) [2025-09-19T17:12:57.445698] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-19T17:12:57.467807] [DEBUG] [LOCAL ] AMP: Primary data saved (33358 records). [2025-09-19T17:12:57.467911] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-19T17:12:57.467992] [INFO ] [MAIN ] Update Progress: 103/2372 symbols completed. AMP took 29.7s. Estimated remaining: 4h 43m 53s. Rate: 8.0 symbols/min [2025-09-19T17:12:57.637900] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:12:57.679685] [DEBUG] [LOCAL ] AMRC: Loaded 39026 existing records from primary storage. [2025-09-19T17:12:57.679835] [INFO ] [MAIN ] AMRC: Loaded 39026 existing records. [2025-09-19T17:12:57.859328] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:12:57.859707] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-19T17:12:57.859763] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-19T17:12:57.861113] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-19T17:12:57.861174] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-19T17:12:58.180717] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T17:12:58.245150] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-19T17:12:58.267263] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:12:59.026020] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T17:12:59.043214] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-19T17:12:59.548557] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T17:12:59.843260] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-19T17:13:00.008498] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T17:13:00.643263] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-19T17:13:01.443281] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-19T17:13:01.643740] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-19T17:13:02.012078] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T17:13:02.243311] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-19T17:13:02.504234] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T17:13:03.043272] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-19T17:13:03.843289] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-19T17:13:04.643332] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-19T17:13:04.802488] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T17:13:05.072019] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-19T17:13:05.182082] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T17:13:05.443290] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-19T17:13:05.884587] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T17:13:06.243289] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-19T17:13:07.043280] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-19T17:13:07.408772] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T17:13:07.446980] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T17:13:07.843279] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-19T17:13:07.993019] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T17:13:08.643307] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-19T17:13:09.443289] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-19T17:13:09.651683] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T17:13:10.243253] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-19T17:13:10.394435] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T17:13:11.051835] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-19T17:13:11.056927] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T17:13:11.843287] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-19T17:13:12.319514] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T17:13:12.468522] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T17:13:12.478569] [INFO ] [REMOTE ] AMPX: Full fetch complete (74494 records). [2025-09-19T17:13:12.478781] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-19T17:13:12.667696] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-19T17:13:12.890592] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-19T17:13:12.890724] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-19T17:13:12.891456] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-19T17:13:12.891507] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-19T17:13:12.893226] [DEBUG] [LOCAL ] AMPX: Trimmed 74494 records to 52848 (keeping 200 days of data) [2025-09-19T17:13:13.017131] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:13:13.230360] [DEBUG] [LOCAL ] AMPX: Primary data saved (52848 records). [2025-09-19T17:13:13.230505] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-19T17:13:13.231479] [INFO ] [MAIN ] Update Progress: 104/2372 symbols completed. AMPX took 36.6s. Estimated remaining: 4h 46m 46s. Rate: 7.9 symbols/min [2025-09-19T17:13:13.406750] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:13.406991] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-19T17:13:13.407046] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-19T17:13:13.407195] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-19T17:13:13.407247] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-19T17:13:13.407314] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-19T17:13:13.407357] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-19T17:13:13.449379] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-19T17:13:13.765447] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:13.861234] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T17:13:14.243285] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-19T17:13:14.606932] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T17:13:15.043304] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-19T17:13:15.329170] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:15.329516] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-19T17:13:15.533821] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T17:13:15.843302] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-19T17:13:16.643267] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-19T17:13:17.443306] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-19T17:13:17.484968] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T17:13:17.715287] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:17.715601] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-19T17:13:17.925618] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:13:18.243275] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-19T17:13:19.043283] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-19T17:13:19.329536] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:19.329904] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-19T17:13:19.843263] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-19T17:13:20.072985] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:20.073410] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-19T17:13:20.075707] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T17:13:20.643277] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-19T17:13:21.443279] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-19T17:13:22.243295] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-19T17:13:22.424371] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T17:13:22.469145] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:22.469561] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-19T17:13:22.560660] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T17:13:22.565609] [INFO ] [REMOTE ] AMPY: Full fetch complete (50087 records). [2025-09-19T17:13:22.565736] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-19T17:13:22.954541] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-19T17:13:22.954624] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-19T17:13:22.955193] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-19T17:13:22.955246] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-19T17:13:22.956411] [DEBUG] [LOCAL ] AMPY: Trimmed 50087 records to 37926 (keeping 200 days of data) [2025-09-19T17:13:23.044718] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-19T17:13:23.169167] [DEBUG] [LOCAL ] AMPY: Primary data saved (37926 records). [2025-09-19T17:13:23.169318] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-19T17:13:23.169418] [INFO ] [MAIN ] Update Progress: 105/2372 symbols completed. AMPY took 28.7s. Estimated remaining: 4h 47m 29s. Rate: 7.9 symbols/min [2025-09-19T17:13:23.340454] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:23.398936] [DEBUG] [LOCAL ] AMT: Loaded 52847 existing records from primary storage. [2025-09-19T17:13:23.399084] [INFO ] [MAIN ] AMT: Loaded 52847 existing records. [2025-09-19T17:13:23.650158] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:23.650521] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-19T17:13:23.650586] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-19T17:13:23.652403] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-19T17:13:23.652474] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-19T17:13:23.855044] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-19T17:13:24.068269] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:24.643304] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-19T17:13:24.835483] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T17:13:24.840582] [INFO ] [REMOTE ] AMR: Full fetch complete (39435 records). [2025-09-19T17:13:24.840748] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-19T17:13:24.912957] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:13:24.946912] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-19T17:13:25.231922] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-19T17:13:25.232018] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-19T17:13:25.232595] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-19T17:13:25.232686] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-19T17:13:25.233874] [DEBUG] [LOCAL ] AMR: Trimmed 39435 records to 29761 (keeping 200 days of data) [2025-09-19T17:13:25.439273] [DEBUG] [LOCAL ] AMR: Primary data saved (29761 records). [2025-09-19T17:13:25.439637] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-19T17:13:25.439790] [INFO ] [MAIN ] Update Progress: 106/2372 symbols completed. AMR took 30.5s. Estimated remaining: 4h 45m 27s. Rate: 7.9 symbols/min [2025-09-19T17:13:25.452192] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-19T17:13:25.631803] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T17:13:25.726979] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:25.759871] [DEBUG] [LOCAL ] AMTB: Loaded 20824 existing records from primary storage. [2025-09-19T17:13:25.760068] [INFO ] [MAIN ] AMTB: Loaded 20824 existing records. [2025-09-19T17:13:26.048054] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:26.048379] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-19T17:13:26.048457] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-19T17:13:26.049216] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-19T17:13:26.049280] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-19T17:13:26.261092] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-19T17:13:26.596862] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:27.043271] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-19T17:13:27.695387] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:13:27.735613] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T17:13:27.843268] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-19T17:13:28.333573] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T17:13:28.643280] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-19T17:13:29.443327] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-19T17:13:29.942118] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:13:30.149446] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T17:13:30.243262] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-19T17:13:31.043247] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-19T17:13:31.123680] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T17:13:31.843279] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-19T17:13:32.060470] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T17:13:32.643325] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-19T17:13:32.917524] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:13:32.974748] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T17:13:33.443271] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-19T17:13:34.243318] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-19T17:13:34.794600] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T17:13:34.895907] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T17:13:34.902295] [INFO ] [REMOTE ] AMRC: Full fetch complete (52175 records). [2025-09-19T17:13:34.902491] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-19T17:13:34.989235] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T17:13:35.058664] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-19T17:13:35.309395] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-19T17:13:35.309483] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-19T17:13:35.310088] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-19T17:13:35.310154] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-19T17:13:35.311465] [DEBUG] [LOCAL ] AMRC: Trimmed 52175 records to 39283 (keeping 200 days of data) [2025-09-19T17:13:35.541419] [DEBUG] [LOCAL ] AMRC: Primary data saved (39283 records). [2025-09-19T17:13:35.541604] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-19T17:13:35.541750] [INFO ] [MAIN ] Update Progress: 107/2372 symbols completed. AMRC took 38.1s. Estimated remaining: 4h 46m 14s. Rate: 7.9 symbols/min [2025-09-19T17:13:35.717230] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:35.722821] [DEBUG] [LOCAL ] AMTD: Loaded 3564 existing records from primary storage. [2025-09-19T17:13:35.722930] [INFO ] [MAIN ] AMTD: Loaded 3564 existing records. [2025-09-19T17:13:35.848406] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-19T17:13:35.909092] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:35.909333] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-19T17:13:35.909384] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-19T17:13:35.909686] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-19T17:13:35.909748] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-19T17:13:36.267217] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:36.391824] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T17:13:36.643264] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-19T17:13:37.443312] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-19T17:13:38.003255] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T17:13:38.243263] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-19T17:13:38.821456] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T17:13:38.829108] [INFO ] [REMOTE ] AMRZ: Full fetch complete (23806 records). [2025-09-19T17:13:38.829199] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-19T17:13:39.018095] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 63 unique days, need 200 days [2025-09-19T17:13:39.018549] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:13:39.018770] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:13:39.018887] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-19T17:13:39.019065] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-19T17:13:39.019136] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-19T17:13:39.019275] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-19T17:13:39.024699] [INFO ] [MAIN ] Update Progress: 108/2372 symbols completed. AMRZ took 25.8s. Estimated remaining: 4h 44m 40s. Rate: 8.0 symbols/min [2025-09-19T17:13:39.060743] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-19T17:13:39.079490] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T17:13:39.221949] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:39.263039] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T17:13:39.283536] [DEBUG] [LOCAL ] AMTM: Loaded 51128 existing records from primary storage. [2025-09-19T17:13:39.283721] [INFO ] [MAIN ] AMTM: Loaded 51128 existing records. [2025-09-19T17:13:39.465859] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:39.466168] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-19T17:13:39.466225] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-19T17:13:39.467780] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-19T17:13:39.467842] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-19T17:13:39.839491] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:39.843216] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-19T17:13:40.643271] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-19T17:13:40.788848] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T17:13:41.194331] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T17:13:41.443254] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-19T17:13:42.092789] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-19T17:13:42.207803] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T17:13:42.243302] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-19T17:13:43.043267] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-19T17:13:43.843268] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-19T17:13:44.426883] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T17:13:44.523251] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T17:13:44.643305] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-19T17:13:45.198359] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T17:13:45.269209] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T17:13:45.443268] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-19T17:13:46.243297] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-19T17:13:47.043345] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-19T17:13:47.364023] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T17:13:47.444012] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T17:13:47.843269] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-19T17:13:48.643251] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-19T17:13:48.732919] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T17:13:49.265183] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T17:13:49.443238] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-19T17:13:49.539155] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:13:50.144020] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T17:13:50.243261] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-19T17:13:51.043265] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-19T17:13:51.566004] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T17:13:51.569119] [INFO ] [REMOTE ] AMTB: Full fetch complete (30430 records). [2025-09-19T17:13:51.569330] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-19T17:13:51.848466] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-19T17:13:51.980100] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-19T17:13:51.980196] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-19T17:13:51.980704] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-19T17:13:51.980781] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-19T17:13:51.981559] [DEBUG] [LOCAL ] AMTB: Trimmed 30430 records to 20984 (keeping 200 days of data) [2025-09-19T17:13:52.110513] [DEBUG] [LOCAL ] AMTB: Primary data saved (20984 records). [2025-09-19T17:13:52.110671] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-19T17:13:52.110776] [INFO ] [MAIN ] Update Progress: 109/2372 symbols completed. AMTB took 26.7s. Estimated remaining: 4h 46m 28s. Rate: 7.9 symbols/min [2025-09-19T17:13:52.277796] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:13:52.288020] [DEBUG] [LOCAL ] AMWL: Loaded 8740 existing records from primary storage. [2025-09-19T17:13:52.288137] [INFO ] [MAIN ] AMWL: Loaded 8740 existing records. [2025-09-19T17:13:52.473816] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:13:52.474358] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-19T17:13:52.474486] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-19T17:13:52.475059] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-19T17:13:52.475129] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-19T17:13:52.685863] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-19T17:13:52.869374] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T17:13:52.920497] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:13:53.357128] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T17:13:53.443259] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-19T17:13:53.983536] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T17:13:54.243280] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-19T17:13:54.274446] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T17:13:55.043270] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-19T17:13:55.843267] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-19T17:13:56.261389] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:13:56.344550] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T17:13:56.643269] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-19T17:13:57.228711] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:13:57.447115] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-19T17:13:57.454082] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T17:13:58.243278] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-19T17:13:58.302413] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T17:13:59.043264] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-19T17:13:59.843277] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-19T17:14:00.073893] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T17:14:00.075440] [INFO ] [REMOTE ] AMTD: Full fetch complete (5594 records). [2025-09-19T17:14:00.075513] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-19T17:14:00.441989] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-19T17:14:00.442101] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-19T17:14:00.442522] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-19T17:14:00.442583] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-19T17:14:00.443080] [DEBUG] [LOCAL ] AMTD: Trimmed 5594 records to 3591 (keeping 200 days of data) [2025-09-19T17:14:00.468981] [DEBUG] [LOCAL ] AMTD: Primary data saved (3591 records). [2025-09-19T17:14:00.469314] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-19T17:14:00.469464] [INFO ] [MAIN ] Update Progress: 110/2372 symbols completed. AMTD took 24.9s. Estimated remaining: 4h 46m 36s. Rate: 7.9 symbols/min [2025-09-19T17:14:00.646627] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:00.643861] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-19T17:14:00.683875] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T17:14:00.739357] [DEBUG] [LOCAL ] AMX: Loaded 49447 existing records from primary storage. [2025-09-19T17:14:00.739504] [INFO ] [MAIN ] AMX: Loaded 49447 existing records. [2025-09-19T17:14:00.927098] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:14:00.927557] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-19T17:14:00.927607] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-19T17:14:00.929041] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-19T17:14:00.929111] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-19T17:14:01.075550] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T17:14:01.386619] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:01.443212] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-19T17:14:02.243276] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-19T17:14:03.043322] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-19T17:14:03.439076] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T17:14:03.470350] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-19T17:14:03.478198] [INFO ] [REMOTE ] AMT: Full fetch complete (75992 records). [2025-09-19T17:14:03.478329] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-19T17:14:03.861597] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-19T17:14:03.890955] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-19T17:14:03.891091] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-19T17:14:03.892004] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-19T17:14:03.892350] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-19T17:14:03.894856] [DEBUG] [LOCAL ] AMT: Trimmed 75992 records to 53223 (keeping 200 days of data) [2025-09-19T17:14:04.025808] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T17:14:04.173982] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T17:14:04.300955] [DEBUG] [LOCAL ] AMT: Primary data saved (53223 records). [2025-09-19T17:14:04.301122] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-19T17:14:04.301240] [INFO ] [MAIN ] Update Progress: 111/2372 symbols completed. AMT took 41.1s. Estimated remaining: 4h 45m 11s. Rate: 7.9 symbols/min [2025-09-19T17:14:04.473172] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:04.473357] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-09-19T17:14:04.473610] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-09-19T17:14:04.473791] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-19T17:14:04.473833] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-19T17:14:04.473873] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-09-19T17:14:04.473915] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-19T17:14:04.664578] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-19T17:14:04.861188] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:05.443273] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-19T17:14:05.782549] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T17:14:06.180527] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:14:06.243251] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-19T17:14:06.661382] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T17:14:07.043289] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-19T17:14:07.843284] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-19T17:14:08.067270] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T17:14:08.346768] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T17:14:08.643330] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-19T17:14:09.443268] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-19T17:14:09.585369] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T17:14:10.243267] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-19T17:14:10.452438] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T17:14:10.782246] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T17:14:11.043314] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-19T17:14:11.403457] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T17:14:11.843264] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-19T17:14:12.643294] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-19T17:14:13.162169] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T17:14:13.443264] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-19T17:14:13.963259] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T17:14:13.972092] [INFO ] [REMOTE ] AMTM: Full fetch complete (73947 records). [2025-09-19T17:14:13.972392] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-19T17:14:14.266416] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-19T17:14:14.410409] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-19T17:14:14.410680] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-19T17:14:14.411678] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-19T17:14:14.412493] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-19T17:14:14.423485] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T17:14:14.429234] [DEBUG] [LOCAL ] AMTM: Trimmed 73947 records to 51512 (keeping 200 days of data) [2025-09-19T17:14:14.501377] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T17:14:14.774868] [DEBUG] [LOCAL ] AMTM: Primary data saved (51512 records). [2025-09-19T17:14:14.775015] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-19T17:14:14.778999] [INFO ] [MAIN ] Update Progress: 112/2372 symbols completed. AMTM took 35.8s. Estimated remaining: 4h 46m 2s. Rate: 7.9 symbols/min [2025-09-19T17:14:14.963280] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:14.963473] [DEBUG] [LOCAL ] ANET: No existing data file found in primary storage. [2025-09-19T17:14:14.963512] [WARN ] [MAIN ] ANET: No existing data found, performing full refresh instead. [2025-09-19T17:14:14.963696] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-19T17:14:14.963750] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-19T17:14:14.963796] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-09-19T17:14:14.963841] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-19T17:14:15.048483] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-19T17:14:15.332461] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:15.843254] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-19T17:14:16.292821] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:14:16.448068] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T17:14:16.643324] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-19T17:14:17.443317] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-19T17:14:18.167481] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-19T17:14:18.243312] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-19T17:14:18.638252] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T17:14:19.038029] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T17:14:19.043222] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-19T17:14:19.478341] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T17:14:19.843287] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-19T17:14:20.017032] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T17:14:20.643282] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-19T17:14:21.443321] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-19T17:14:21.753976] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T17:14:21.756198] [INFO ] [REMOTE ] AMWL: Full fetch complete (13993 records). [2025-09-19T17:14:21.756293] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-19T17:14:22.167427] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-19T17:14:22.167507] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-19T17:14:22.167780] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-19T17:14:22.167842] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-19T17:14:22.168326] [DEBUG] [LOCAL ] AMWL: Trimmed 13993 records to 8803 (keeping 200 days of data) [2025-09-19T17:14:22.226490] [DEBUG] [LOCAL ] AMWL: Primary data saved (8803 records). [2025-09-19T17:14:22.226639] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-19T17:14:22.226767] [INFO ] [MAIN ] Update Progress: 113/2372 symbols completed. AMWL took 30.1s. Estimated remaining: 4h 45m 52s. Rate: 7.9 symbols/min [2025-09-19T17:14:22.258588] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-19T17:14:22.402084] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:22.477067] [DEBUG] [LOCAL ] ANF: Loaded 52666 existing records from primary storage. [2025-09-19T17:14:22.477513] [INFO ] [MAIN ] ANF: Loaded 52666 existing records. [2025-09-19T17:14:22.667439] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:14:22.668151] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-19T17:14:22.668458] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-19T17:14:22.678980] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-19T17:14:22.694477] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-19T17:14:22.783787] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.94 seconds). [2025-09-19T17:14:23.043349] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-19T17:14:23.081966] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:23.325115] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T17:14:23.843284] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-19T17:14:24.047836] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T17:14:24.643371] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-19T17:14:25.038322] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T17:14:25.443277] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-19T17:14:26.052839] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T17:14:26.243281] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-19T17:14:26.728783] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T17:14:26.845328] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T17:14:27.043354] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-19T17:14:27.843284] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-19T17:14:28.643329] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-19T17:14:29.047513] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:14:29.099248] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-19T17:14:29.302989] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T17:14:29.443311] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-19T17:14:30.243254] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-19T17:14:30.907857] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T17:14:31.043269] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-19T17:14:31.527979] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T17:14:31.843359] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-19T17:14:32.643256] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-19T17:14:32.914830] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T17:14:32.995834] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T17:14:33.059365] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:14:33.066533] [INFO ] [REMOTE ] AMX: Full fetch complete (70776 records). [2025-09-19T17:14:33.066693] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-19T17:14:33.443997] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-19T17:14:33.461301] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-19T17:14:33.462339] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-19T17:14:33.463079] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-19T17:14:33.463146] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-19T17:14:33.465588] [DEBUG] [LOCAL ] AMX: Trimmed 70776 records to 49778 (keeping 200 days of data) [2025-09-19T17:14:33.775619] [DEBUG] [LOCAL ] AMX: Primary data saved (49778 records). [2025-09-19T17:14:33.775781] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-19T17:14:33.775885] [INFO ] [MAIN ] Update Progress: 114/2372 symbols completed. AMX took 33.3s. Estimated remaining: 4h 47m 3s. Rate: 7.9 symbols/min [2025-09-19T17:14:33.945352] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:33.945548] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-19T17:14:33.945602] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-19T17:14:33.945792] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-19T17:14:33.945834] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-19T17:14:33.945901] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-19T17:14:33.945976] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-19T17:14:34.248362] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-19T17:14:34.312426] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:34.740759] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T17:14:34.911609] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:14:34.917157] [INFO ] [REMOTE ] AN: Full fetch complete (47833 records). [2025-09-19T17:14:34.917326] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-19T17:14:35.046020] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-19T17:14:35.322396] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-19T17:14:35.322477] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-19T17:14:35.322992] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-19T17:14:35.323052] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-19T17:14:35.324052] [DEBUG] [LOCAL ] AN: Trimmed 47833 records to 33301 (keeping 200 days of data) [2025-09-19T17:14:35.537963] [DEBUG] [LOCAL ] AN: Primary data saved (33301 records). [2025-09-19T17:14:35.538118] [INFO ] [MAIN ] AN: Full history saved. [2025-09-19T17:14:35.538200] [INFO ] [MAIN ] Update Progress: 115/2372 symbols completed. AN took 31.2s. Estimated remaining: 4h 44m 60s. Rate: 7.9 symbols/min [2025-09-19T17:14:35.710281] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:35.731100] [DEBUG] [LOCAL ] ANRO: Loaded 20424 existing records from primary storage. [2025-09-19T17:14:35.731288] [INFO ] [MAIN ] ANRO: Loaded 20424 existing records. [2025-09-19T17:14:35.848353] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-19T17:14:35.911417] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:14:35.911624] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-19T17:14:35.911719] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-19T17:14:35.912342] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-19T17:14:35.912401] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-19T17:14:36.159297] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:36.190460] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-19T17:14:36.269209] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:36.643220] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-19T17:14:36.859256] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T17:14:37.126061] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:37.126381] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-19T17:14:37.156813] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-19T17:14:37.443254] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-19T17:14:38.243254] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-19T17:14:39.043257] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-19T17:14:39.086241] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T17:14:39.843305] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-19T17:14:40.073519] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:40.073896] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-19T17:14:40.643298] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-19T17:14:40.871269] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-19T17:14:40.942199] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T17:14:41.350114] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T17:14:41.443272] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-19T17:14:42.243288] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-19T17:14:43.015087] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T17:14:43.043321] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-19T17:14:43.843268] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-19T17:14:44.548967] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T17:14:44.621959] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T17:14:44.643250] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-19T17:14:45.340472] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T17:14:45.443234] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-19T17:14:46.243259] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-19T17:14:46.818760] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T17:14:47.043260] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-19T17:14:47.420759] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-19T17:14:47.807320] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T17:14:47.843276] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-19T17:14:48.198258] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:48.198593] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-19T17:14:48.484759] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T17:14:48.643267] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-19T17:14:48.889259] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:48.889892] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-19T17:14:49.443288] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-19T17:14:50.243303] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-19T17:14:50.961054] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:50.961581] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-19T17:14:50.978815] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T17:14:51.043275] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-19T17:14:51.689345] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T17:14:51.843269] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-19T17:14:52.643325] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-19T17:14:52.888923] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:52.889246] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-19T17:14:53.443340] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-19T17:14:53.534981] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T17:14:53.700984] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:53.701317] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-19T17:14:54.243264] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-19T17:14:55.043271] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-19T17:14:55.843288] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-19T17:14:56.077410] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:14:56.077757] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-19T17:14:56.643251] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-19T17:14:56.946931] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-09-19T17:14:56.957887] [INFO ] [REMOTE ] ANET: Full fetch complete (77822 records). [2025-09-19T17:14:56.958045] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-19T17:14:57.319051] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T17:14:57.384689] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-19T17:14:57.385541] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-19T17:14:57.386464] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-19T17:14:57.387105] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-19T17:14:57.408725] [DEBUG] [LOCAL ] ANET: Trimmed 77822 records to 54546 (keeping 200 days of data) [2025-09-19T17:14:57.408575] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T17:14:57.417975] [INFO ] [REMOTE ] ANF: Full fetch complete (75653 records). [2025-09-19T17:14:57.418103] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-19T17:14:57.502598] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-19T17:14:58.042858] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-19T17:14:58.045987] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-19T17:14:58.048200] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-19T17:14:58.048293] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-19T17:14:58.061094] [DEBUG] [LOCAL ] ANF: Trimmed 75653 records to 53051 (keeping 200 days of data) [2025-09-19T17:14:58.243534] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-19T17:14:58.274617] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-09-19T17:14:58.275264] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-19T17:14:58.275602] [INFO ] [MAIN ] Update Progress: 116/2372 symbols completed. ANET took 43.5s. Estimated remaining: 4h 49m 47s. Rate: 7.8 symbols/min [2025-09-19T17:14:58.525378] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:14:58.587534] [DEBUG] [LOCAL ] ANVS: Loaded 23530 existing records from primary storage. [2025-09-19T17:14:58.589325] [INFO ] [MAIN ] ANVS: Loaded 23530 existing records. [2025-09-19T17:14:58.781473] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:14:58.782697] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-19T17:14:58.783078] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-19T17:14:58.784052] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-19T17:14:58.784346] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-19T17:14:58.976144] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T17:14:59.024436] [INFO ] [REMOTE ] ANRO: Full fetch complete (30941 records). [2025-09-19T17:14:59.043382] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-19T17:14:59.482737] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:14:59.527935] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-19T17:14:59.668743] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T17:14:59.676832] [INFO ] [REMOTE ] ANGX: Full fetch complete (2445 records). [2025-09-19T17:14:59.672883] [DEBUG] [LOCAL ] ANF: Primary data saved (53051 records). [2025-09-19T17:14:59.672702] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-19T17:14:59.677022] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-19T17:14:59.677094] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-19T17:14:59.682800] [INFO ] [MAIN ] Update Progress: 117/2372 symbols completed. ANF took 37.5s. Estimated remaining: 4h 47m 38s. Rate: 7.8 symbols/min [2025-09-19T17:14:59.677205] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-19T17:14:59.745193] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-19T17:14:59.756586] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-19T17:14:59.783516] [DEBUG] [LOCAL ] ANRO: Trimmed 30941 records to 20526 (keeping 200 days of data) [2025-09-19T17:14:59.941662] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-19T17:14:59.950610] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:14:59.954870] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:14:59.963400] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-19T17:14:59.967929] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-19T17:14:59.975508] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-19T17:14:59.977193] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-19T17:14:59.978208] [INFO ] [MAIN ] Update Progress: 118/2372 symbols completed. ANGX took 26.2s. Estimated remaining: 4h 45m 10s. Rate: 7.9 symbols/min [2025-09-19T17:14:59.979062] [DEBUG] [LOCAL ] ANRO: Primary data saved (20526 records). [2025-09-19T17:14:59.979216] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-19T17:14:59.979373] [INFO ] [MAIN ] Update Progress: 119/2372 symbols completed. ANRO took 24.4s. Estimated remaining: 4h 42m 39s. Rate: 8.0 symbols/min [2025-09-19T17:15:01.346146] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:15:01.352772] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-19T17:15:04.185819] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-19T17:15:04.192014] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-19T17:15:06.554148] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T17:15:06.561297] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-19T17:15:07.473431] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T17:15:07.478883] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-19T17:15:08.842447] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:15:08.848326] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-19T17:15:10.287016] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T17:15:10.294056] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-19T17:15:11.530180] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:15:11.540872] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-19T17:15:13.137246] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T17:15:13.146011] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-19T17:15:15.237068] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T17:15:15.241892] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-19T17:15:16.286684] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T17:15:16.289619] [INFO ] [REMOTE ] ANVS: Full fetch complete (37042 records). [2025-09-19T17:15:16.289749] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-19T17:15:16.664345] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-19T17:15:16.664490] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-19T17:15:16.664957] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-19T17:15:16.665020] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-19T17:15:16.666028] [DEBUG] [LOCAL ] ANVS: Trimmed 37042 records to 23662 (keeping 200 days of data) [2025-09-19T17:15:16.793997] [DEBUG] [LOCAL ] ANVS: Primary data saved (23662 records). [2025-09-19T17:15:16.794122] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-19T17:15:16.794203] [INFO ] [MAIN ] Update Progress: 120/2372 symbols completed. ANVS took 18.5s. Estimated remaining: 4h 45m 25s. Rate: 7.9 symbols/min [2025-09-19T17:15:17.403537] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:17.452479] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-09-19T17:15:17.458726] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-09-19T17:15:17.479837] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:17.504061] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:17.515034] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-19T17:15:17.518943] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:17.519418] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-09-19T17:15:17.519789] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-19T17:15:17.519887] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-19T17:15:17.520048] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-19T17:15:17.519689] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-09-19T17:15:17.520183] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-09-19T17:15:17.520490] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-19T17:15:17.520703] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-19T17:15:17.520862] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-19T17:15:17.520988] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-19T17:15:17.521238] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-19T17:15:17.532904] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-19T17:15:17.551774] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-19T17:15:17.562360] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-09-19T17:15:17.568347] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-19T17:15:18.081224] [DEBUG] [LOCAL ] AON: Loaded 46012 existing records from primary storage. [2025-09-19T17:15:18.213428] [INFO ] [MAIN ] AON: Loaded 46012 existing records. [2025-09-19T17:15:18.765428] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:18.831060] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-19T17:15:18.856450] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:18.859627] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:15:18.904947] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-19T17:15:18.905220] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-19T17:15:18.905388] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-19T17:15:18.931111] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-19T17:15:18.931287] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-19T17:15:18.930963] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:18.972670] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-19T17:15:19.299922] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:19.300386] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-19T17:15:19.402698] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:19.402942] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-19T17:15:19.403304] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-19T17:15:19.641780] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:19.642140] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-19T17:15:19.642710] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-19T17:15:19.883300] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:19.883626] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-19T17:15:19.884105] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-19T17:15:19.997410] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T17:15:20.000507] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-19T17:15:20.115064] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:20.115399] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-19T17:15:20.115914] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-19T17:15:20.537186] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:15:20.537853] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-19T17:15:20.538850] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-19T17:15:20.558609] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T17:15:20.564948] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-19T17:15:21.047702] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T17:15:21.051460] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-19T17:15:21.216200] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T17:15:21.217479] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-19T17:15:21.269809] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T17:15:21.280155] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-19T17:15:21.630735] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T17:15:21.632587] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-19T17:15:21.719096] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T17:15:21.726895] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-19T17:15:21.738996] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T17:15:21.743286] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-19T17:15:22.205192] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T17:15:22.206493] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-19T17:15:22.722936] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T17:15:22.728871] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-19T17:15:22.752077] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T17:15:22.753462] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-19T17:15:22.925039] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T17:15:22.994095] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T17:15:23.043274] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-19T17:15:23.545851] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T17:15:23.547246] [INFO ] [REMOTE ] AOMD: Full fetch complete (1721 records). [2025-09-19T17:15:23.547339] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-19T17:15:23.748541] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 81 unique days, need 200 days [2025-09-19T17:15:23.748751] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:15:23.748828] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:15:23.748896] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-19T17:15:23.748961] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-19T17:15:23.748996] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-19T17:15:23.749057] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-19T17:15:23.749136] [INFO ] [MAIN ] Update Progress: 121/2372 symbols completed. AOMD took 7.0s. Estimated remaining: 4h 45m 6s. Rate: 7.9 symbols/min [2025-09-19T17:15:23.847865] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-19T17:15:23.920118] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:23.920271] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-09-19T17:15:23.920308] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-09-19T17:15:23.920444] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-19T17:15:23.920486] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-19T17:15:23.920526] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-09-19T17:15:23.920556] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-19T17:15:24.292509] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:24.310999] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T17:15:24.496211] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T17:15:24.643276] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-19T17:15:25.443274] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-19T17:15:25.715106] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T17:15:25.830169] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:15:26.243264] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-19T17:15:26.373401] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T17:15:27.043270] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-19T17:15:27.583232] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T17:15:27.843274] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-19T17:15:28.643296] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-19T17:15:28.954786] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:15:29.107809] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T17:15:29.443298] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-19T17:15:29.736716] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T17:15:30.243329] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-19T17:15:30.559067] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T17:15:30.880859] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T17:15:31.043309] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-19T17:15:31.843295] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-19T17:15:31.975954] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T17:15:32.643315] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-19T17:15:33.379321] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T17:15:33.443279] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-19T17:15:34.243260] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-19T17:15:34.551715] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T17:15:34.868634] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T17:15:35.045907] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-19T17:15:35.050462] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T17:15:35.843310] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-19T17:15:36.004387] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T17:15:36.643305] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-19T17:15:37.443333] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-19T17:15:37.513389] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:15:37.966449] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:15:38.243253] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-19T17:15:39.043286] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-19T17:15:39.216400] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T17:15:39.843315] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-19T17:15:40.222617] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T17:15:40.253563] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T17:15:40.643300] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-19T17:15:41.193261] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:15:41.443275] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-19T17:15:41.699003] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T17:15:41.703917] [INFO ] [REMOTE ] AOD: Full fetch complete (44012 records). [2025-09-19T17:15:41.704013] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-19T17:15:42.083835] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-19T17:15:42.083923] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-19T17:15:42.084387] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-19T17:15:42.084427] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-19T17:15:42.085417] [DEBUG] [LOCAL ] AOD: Trimmed 44012 records to 30803 (keeping 200 days of data) [2025-09-19T17:15:42.247370] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-19T17:15:42.266893] [DEBUG] [LOCAL ] AOD: Primary data saved (30803 records). [2025-09-19T17:15:42.267025] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-19T17:15:42.267101] [INFO ] [MAIN ] Update Progress: 122/2372 symbols completed. AOD took 25.5s. Estimated remaining: 4h 48m 19s. Rate: 7.8 symbols/min [2025-09-19T17:15:42.437475] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:42.489752] [DEBUG] [LOCAL ] AOS: Loaded 49823 existing records from primary storage. [2025-09-19T17:15:42.489953] [INFO ] [MAIN ] AOS: Loaded 49823 existing records. [2025-09-19T17:15:42.684194] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:15:42.684463] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-19T17:15:42.684532] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-19T17:15:42.687028] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-19T17:15:42.687091] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-19T17:15:43.051281] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-19T17:15:43.055984] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:43.248704] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T17:15:43.583547] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T17:15:43.843321] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-19T17:15:44.447705] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T17:15:44.450664] [INFO ] [REMOTE ] AOMR: Full fetch complete (23080 records). [2025-09-19T17:15:44.450762] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-19T17:15:44.649395] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-19T17:15:44.840952] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-19T17:15:44.841035] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-19T17:15:44.841359] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-19T17:15:44.841396] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-19T17:15:44.842189] [DEBUG] [LOCAL ] AOMR: Trimmed 23080 records to 17257 (keeping 200 days of data) [2025-09-19T17:15:44.942750] [DEBUG] [LOCAL ] AOMR: Primary data saved (17257 records). [2025-09-19T17:15:44.942901] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-19T17:15:44.942982] [INFO ] [MAIN ] Update Progress: 123/2372 symbols completed. AOMR took 28.1s. Estimated remaining: 4h 46m 40s. Rate: 7.8 symbols/min [2025-09-19T17:15:45.115790] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:45.115956] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-09-19T17:15:45.115992] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-09-19T17:15:45.116210] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-19T17:15:45.116266] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-19T17:15:45.116308] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-19T17:15:45.116339] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-19T17:15:45.446448] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-19T17:15:45.492265] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:45.565575] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T17:15:46.194369] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T17:15:46.243259] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-19T17:15:46.820592] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T17:15:46.827605] [INFO ] [REMOTE ] AON: Full fetch complete (64937 records). [2025-09-19T17:15:46.827770] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-19T17:15:47.048338] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-19T17:15:47.223201] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-19T17:15:47.223289] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-19T17:15:47.223945] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-19T17:15:47.224009] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-19T17:15:47.225328] [DEBUG] [LOCAL ] AON: Trimmed 64937 records to 46389 (keeping 200 days of data) [2025-09-19T17:15:47.526970] [DEBUG] [LOCAL ] AON: Primary data saved (46389 records). [2025-09-19T17:15:47.527112] [INFO ] [MAIN ] AON: Full history saved. [2025-09-19T17:15:47.527226] [INFO ] [MAIN ] Update Progress: 124/2372 symbols completed. AON took 30.7s. Estimated remaining: 4h 45m 1s. Rate: 7.9 symbols/min [2025-09-19T17:15:47.701333] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:47.739745] [DEBUG] [LOCAL ] APAM: Loaded 37094 existing records from primary storage. [2025-09-19T17:15:47.739890] [INFO ] [MAIN ] APAM: Loaded 37094 existing records. [2025-09-19T17:15:47.848327] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-19T17:15:47.918530] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:15:47.918817] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-19T17:15:47.918885] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-19T17:15:47.921123] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-19T17:15:47.921188] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-19T17:15:48.296584] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:48.335275] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T17:15:48.391073] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T17:15:48.643266] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-19T17:15:48.780635] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:15:49.389473] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:15:49.443273] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-19T17:15:50.243247] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-19T17:15:50.888128] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T17:15:51.043280] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-19T17:15:51.843306] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-19T17:15:51.977930] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T17:15:51.982851] [INFO ] [REMOTE ] AORT: Full fetch complete (41607 records). [2025-09-19T17:15:51.982969] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-19T17:15:52.360945] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-19T17:15:52.361032] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-19T17:15:52.361537] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-19T17:15:52.361596] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-19T17:15:52.362814] [DEBUG] [LOCAL ] AORT: Trimmed 41607 records to 30407 (keeping 200 days of data) [2025-09-19T17:15:52.546349] [DEBUG] [LOCAL ] AORT: Primary data saved (30407 records). [2025-09-19T17:15:52.546521] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-19T17:15:52.546623] [INFO ] [MAIN ] Update Progress: 125/2372 symbols completed. AORT took 28.8s. Estimated remaining: 4h 44m 7s. Rate: 7.9 symbols/min [2025-09-19T17:15:52.624338] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T17:15:52.647104] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-19T17:15:52.755413] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:15:52.800970] [DEBUG] [LOCAL ] APD: Loaded 45876 existing records from primary storage. [2025-09-19T17:15:52.801148] [INFO ] [MAIN ] APD: Loaded 45876 existing records. [2025-09-19T17:15:52.980370] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:15:52.980918] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-19T17:15:52.980989] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-19T17:15:52.983396] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-19T17:15:52.983462] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-19T17:15:53.096051] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-19T17:15:53.322187] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T17:15:53.404492] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:15:53.443221] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-19T17:15:54.243246] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-19T17:15:55.043264] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-19T17:15:55.530374] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T17:15:55.730372] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T17:15:55.803849] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T17:15:55.843248] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-19T17:15:56.643272] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-19T17:15:56.837190] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T17:15:57.443275] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-19T17:15:58.243255] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-19T17:15:58.478508] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T17:15:58.660224] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T17:15:59.043279] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-19T17:15:59.843280] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-19T17:16:00.066056] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-19T17:16:00.125793] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T17:16:00.643320] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-19T17:16:01.443289] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-19T17:16:01.802137] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T17:16:01.863321] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T17:16:02.243315] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-19T17:16:03.043287] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-19T17:16:03.788782] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T17:16:03.843235] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-19T17:16:04.394390] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T17:16:04.395926] [INFO ] [REMOTE ] AP: Full fetch complete (8670 records). [2025-09-19T17:16:04.395999] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-19T17:16:04.665233] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-19T17:16:04.866519] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-19T17:16:04.866875] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-19T17:16:04.867341] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-19T17:16:04.867445] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-19T17:16:04.871616] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-19T17:16:04.886026] [DEBUG] [LOCAL ] AP: Trimmed 8670 records to 6911 (keeping 200 days of data) [2025-09-19T17:16:04.954422] [DEBUG] [LOCAL ] AP: Primary data saved (6911 records). [2025-09-19T17:16:04.954625] [INFO ] [MAIN ] AP: Full history saved. [2025-09-19T17:16:04.954772] [INFO ] [MAIN ] Update Progress: 126/2372 symbols completed. AP took 20.0s. Estimated remaining: 4h 45m 25s. Rate: 7.9 symbols/min [2025-09-19T17:16:05.183772] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:05.261625] [DEBUG] [LOCAL ] APG: Loaded 50625 existing records from primary storage. [2025-09-19T17:16:05.262127] [INFO ] [MAIN ] APG: Loaded 50625 existing records. [2025-09-19T17:16:05.452930] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-19T17:16:05.491751] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T17:16:05.615419] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:05.615795] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-19T17:16:05.615853] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-19T17:16:05.620732] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-19T17:16:05.620944] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-19T17:16:06.012036] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:06.056738] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T17:16:06.243267] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-19T17:16:07.043264] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-19T17:16:07.615898] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T17:16:07.735141] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T17:16:07.843233] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-19T17:16:08.643272] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-19T17:16:08.959170] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T17:16:09.443284] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-19T17:16:09.729727] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T17:16:10.243271] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-19T17:16:10.641549] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T17:16:10.760013] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:16:11.043281] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-19T17:16:11.843280] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-19T17:16:12.136559] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T17:16:12.508546] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:16:12.516241] [INFO ] [REMOTE ] AOS: Full fetch complete (70773 records). [2025-09-19T17:16:12.516385] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-19T17:16:12.648402] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-19T17:16:12.950418] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-19T17:16:12.950540] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-19T17:16:12.951352] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-19T17:16:12.952105] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-19T17:16:12.953858] [DEBUG] [LOCAL ] AOS: Trimmed 70773 records to 50129 (keeping 200 days of data) [2025-09-19T17:16:13.290780] [DEBUG] [LOCAL ] AOS: Primary data saved (50129 records). [2025-09-19T17:16:13.290934] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-19T17:16:13.291026] [INFO ] [MAIN ] Update Progress: 127/2372 symbols completed. AOS took 31.0s. Estimated remaining: 4h 45m 30s. Rate: 7.9 symbols/min [2025-09-19T17:16:13.456437] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-19T17:16:13.460433] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:13.517638] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-09-19T17:16:13.517817] [INFO ] [MAIN ] APH: Loaded 54081 existing records. [2025-09-19T17:16:13.707670] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:13.708007] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-19T17:16:13.708069] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-19T17:16:13.711322] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-19T17:16:13.711404] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-19T17:16:14.094370] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:14.124804] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T17:16:14.243258] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-19T17:16:14.282045] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T17:16:14.714187] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T17:16:15.043291] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-19T17:16:15.843312] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-19T17:16:16.213561] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:16:16.451432] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T17:16:16.643281] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-19T17:16:17.443266] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-19T17:16:17.960753] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T17:16:18.007881] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:16:18.243238] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-19T17:16:18.869066] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T17:16:19.043265] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-19T17:16:19.843315] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-19T17:16:20.142753] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T17:16:20.643317] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-19T17:16:21.299073] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T17:16:21.443301] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-19T17:16:21.948335] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T17:16:21.993537] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T17:16:22.243259] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-19T17:16:23.043273] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-19T17:16:23.352271] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:16:23.843269] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-19T17:16:24.184836] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T17:16:24.643237] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-19T17:16:25.268106] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T17:16:25.443278] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-19T17:16:25.691043] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:16:26.033564] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T17:16:26.243319] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-19T17:16:26.463128] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T17:16:26.469368] [INFO ] [REMOTE ] APAM: Full fetch complete (51598 records). [2025-09-19T17:16:26.469553] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-19T17:16:26.872305] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-19T17:16:26.872395] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-19T17:16:26.872972] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-19T17:16:26.873045] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-19T17:16:26.876950] [DEBUG] [LOCAL ] APAM: Trimmed 51598 records to 37305 (keeping 200 days of data) [2025-09-19T17:16:27.049503] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-19T17:16:27.102404] [DEBUG] [LOCAL ] APAM: Primary data saved (37305 records). [2025-09-19T17:16:27.102550] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-19T17:16:27.103832] [INFO ] [MAIN ] Update Progress: 128/2372 symbols completed. APAM took 39.6s. Estimated remaining: 4h 47m 11s. Rate: 7.8 symbols/min [2025-09-19T17:16:27.278243] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:27.333346] [DEBUG] [LOCAL ] APLE: Loaded 52448 existing records from primary storage. [2025-09-19T17:16:27.333519] [INFO ] [MAIN ] APLE: Loaded 52448 existing records. [2025-09-19T17:16:27.519088] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:27.519440] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-19T17:16:27.519524] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-19T17:16:27.522682] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-19T17:16:27.522770] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-19T17:16:27.849888] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-19T17:16:27.889203] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:27.933142] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T17:16:27.947316] [INFO ] [REMOTE ] APD: Full fetch complete (66539 records). [2025-09-19T17:16:27.947575] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-19T17:16:28.340767] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-19T17:16:28.340880] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-19T17:16:28.341560] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-19T17:16:28.341617] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-19T17:16:28.343254] [DEBUG] [LOCAL ] APD: Trimmed 66539 records to 46133 (keeping 200 days of data) [2025-09-19T17:16:28.639279] [DEBUG] [LOCAL ] APD: Primary data saved (46133 records). [2025-09-19T17:16:28.639424] [INFO ] [MAIN ] APD: Full history saved. [2025-09-19T17:16:28.639524] [INFO ] [MAIN ] Update Progress: 129/2372 symbols completed. APD took 36.1s. Estimated remaining: 4h 45m 16s. Rate: 7.9 symbols/min [2025-09-19T17:16:28.648800] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-19T17:16:28.826243] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:28.902450] [DEBUG] [LOCAL ] APO: Loaded 53772 existing records from primary storage. [2025-09-19T17:16:28.902709] [INFO ] [MAIN ] APO: Loaded 53772 existing records. [2025-09-19T17:16:29.089191] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:29.089637] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-19T17:16:29.089870] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-19T17:16:29.092866] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-19T17:16:29.092941] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-19T17:16:29.490140] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:29.503893] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-19T17:16:29.518064] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T17:16:29.742012] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T17:16:30.243279] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-19T17:16:30.878773] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T17:16:31.043300] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-19T17:16:31.845978] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-19T17:16:31.848689] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T17:16:32.327379] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T17:16:32.643233] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-19T17:16:33.364202] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:16:33.443279] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-19T17:16:33.487944] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T17:16:34.243265] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-19T17:16:34.548868] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T17:16:35.043315] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-19T17:16:35.385092] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:16:35.843277] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-19T17:16:36.341860] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:16:36.643292] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-19T17:16:36.824855] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T17:16:37.430097] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T17:16:37.437544] [INFO ] [REMOTE ] APG: Full fetch complete (71437 records). [2025-09-19T17:16:37.437708] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-19T17:16:37.449710] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-19T17:16:37.843355] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-19T17:16:37.843441] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-19T17:16:37.844216] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-19T17:16:37.844281] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-19T17:16:37.849447] [DEBUG] [LOCAL ] APG: Trimmed 71437 records to 51009 (keeping 200 days of data) [2025-09-19T17:16:38.168331] [DEBUG] [LOCAL ] APG: Primary data saved (51009 records). [2025-09-19T17:16:38.168471] [INFO ] [MAIN ] APG: Full history saved. [2025-09-19T17:16:38.168568] [INFO ] [MAIN ] Update Progress: 130/2372 symbols completed. APG took 33.2s. Estimated remaining: 4h 45m 41s. Rate: 7.8 symbols/min [2025-09-19T17:16:38.248384] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-19T17:16:38.344683] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:38.355335] [DEBUG] [LOCAL ] APOS: Loaded 7503 existing records from primary storage. [2025-09-19T17:16:38.355475] [INFO ] [MAIN ] APOS: Loaded 7503 existing records. [2025-09-19T17:16:38.553426] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:38.554046] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-19T17:16:38.554107] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-19T17:16:38.555018] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-19T17:16:38.555083] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-19T17:16:38.825400] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:16:38.985392] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:39.043257] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-19T17:16:39.615752] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:16:39.843250] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-19T17:16:40.229248] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:16:40.256060] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T17:16:40.643275] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-19T17:16:41.443246] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-19T17:16:41.516760] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:16:42.239020] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T17:16:42.243231] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-19T17:16:43.043258] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-19T17:16:43.095522] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-19T17:16:43.161399] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T17:16:43.843260] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-19T17:16:44.454385] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:16:44.643261] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-19T17:16:45.443267] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-19T17:16:46.243246] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-19T17:16:46.282387] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T17:16:46.307039] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T17:16:46.317069] [INFO ] [REMOTE ] APH: Full fetch complete (77682 records). [2025-09-19T17:16:46.317245] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-19T17:16:46.715265] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-19T17:16:46.715450] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-19T17:16:46.716306] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-19T17:16:46.716387] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-19T17:16:46.718356] [DEBUG] [LOCAL ] APH: Trimmed 77682 records to 54471 (keeping 200 days of data) [2025-09-19T17:16:46.747617] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:16:47.060755] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-19T17:16:47.116556] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-09-19T17:16:47.116723] [INFO ] [MAIN ] APH: Full history saved. [2025-09-19T17:16:47.116850] [INFO ] [MAIN ] Update Progress: 131/2372 symbols completed. APH took 33.8s. Estimated remaining: 4h 45m 56s. Rate: 7.8 symbols/min [2025-09-19T17:16:47.291723] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:47.347734] [DEBUG] [LOCAL ] APTV: Loaded 52636 existing records from primary storage. [2025-09-19T17:16:47.347884] [INFO ] [MAIN ] APTV: Loaded 52636 existing records. [2025-09-19T17:16:47.528981] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:47.529232] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-19T17:16:47.529281] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-19T17:16:47.533517] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-19T17:16:47.533583] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-19T17:16:47.848385] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-19T17:16:47.904224] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:48.418938] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:16:48.643280] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-19T17:16:48.691763] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-19T17:16:49.112297] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-19T17:16:49.416953] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T17:16:49.443217] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-19T17:16:50.243353] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-19T17:16:51.043303] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-19T17:16:51.199251] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T17:16:51.234254] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T17:16:51.843266] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-19T17:16:52.640744] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T17:16:52.643224] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-19T17:16:52.825268] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T17:16:53.443272] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-19T17:16:53.552141] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T17:16:54.243274] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-19T17:16:55.043260] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-19T17:16:55.104862] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T17:16:55.106740] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T17:16:55.108877] [INFO ] [REMOTE ] APOS: Full fetch complete (10418 records). [2025-09-19T17:16:55.119777] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-19T17:16:55.496426] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-19T17:16:55.496517] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-19T17:16:55.496785] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-19T17:16:55.496871] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-19T17:16:55.497379] [DEBUG] [LOCAL ] APOS: Trimmed 10418 records to 7543 (keeping 200 days of data) [2025-09-19T17:16:55.543570] [DEBUG] [LOCAL ] APOS: Primary data saved (7543 records). [2025-09-19T17:16:55.543729] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-19T17:16:55.543821] [INFO ] [MAIN ] Update Progress: 132/2372 symbols completed. APOS took 17.4s. Estimated remaining: 4h 46m 1s. Rate: 7.8 symbols/min [2025-09-19T17:16:55.718284] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:16:55.773094] [DEBUG] [LOCAL ] AQN: Loaded 52366 existing records from primary storage. [2025-09-19T17:16:55.773251] [INFO ] [MAIN ] AQN: Loaded 52366 existing records. [2025-09-19T17:16:55.848376] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-19T17:16:55.956080] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:16:55.956339] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-19T17:16:55.956386] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-19T17:16:55.959528] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-19T17:16:55.959592] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-19T17:16:56.329106] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:16:56.643256] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-19T17:16:57.178717] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T17:16:57.443281] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-19T17:16:57.886892] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T17:16:57.977664] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T17:16:58.243309] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-19T17:16:59.043271] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-19T17:16:59.180711] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:16:59.843242] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-19T17:16:59.939931] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T17:17:00.643237] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-19T17:17:01.167174] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T17:17:01.302820] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:17:01.314022] [INFO ] [REMOTE ] APLE: Full fetch complete (73871 records). [2025-09-19T17:17:01.314322] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-19T17:17:01.315956] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:17:01.316088] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:17:01.316159] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:17:01.316231] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-19T17:17:01.316309] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-09-19T17:17:01.316364] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-09-19T17:17:01.317222] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-09-19T17:17:01.317367] [INFO ] [MAIN ] Update Progress: 133/2372 symbols completed. APLE took 34.2s. Estimated remaining: 4h 45m 22s. Rate: 7.8 symbols/min [2025-09-19T17:17:01.448402] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-19T17:17:01.508850] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:01.515731] [DEBUG] [LOCAL ] AQNB: Loaded 4254 existing records from primary storage. [2025-09-19T17:17:01.515847] [INFO ] [MAIN ] AQNB: Loaded 4254 existing records. [2025-09-19T17:17:01.713519] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:01.713958] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-19T17:17:01.714058] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-19T17:17:01.714578] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-19T17:17:01.714682] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-19T17:17:02.110314] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:02.243287] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-19T17:17:02.824897] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T17:17:02.955118] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T17:17:03.043279] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-19T17:17:03.377533] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:17:03.843286] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-19T17:17:04.643308] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-19T17:17:05.265551] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T17:17:05.443240] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-19T17:17:05.879258] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:17:06.066696] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T17:17:06.243269] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-19T17:17:06.599096] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T17:17:07.043264] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-19T17:17:07.739687] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T17:17:07.843232] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-19T17:17:08.643310] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-19T17:17:08.965687] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-19T17:17:09.043538] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:17:09.123782] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T17:17:09.443263] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-19T17:17:10.243322] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-19T17:17:11.031257] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T17:17:11.043216] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-19T17:17:11.843276] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-19T17:17:11.872807] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-19T17:17:11.881615] [INFO ] [REMOTE ] APO: Full fetch complete (77286 records). [2025-09-19T17:17:11.881833] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-19T17:17:12.202724] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T17:17:12.338279] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-19T17:17:12.338368] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-19T17:17:12.339169] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-19T17:17:12.339239] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-19T17:17:12.340856] [DEBUG] [LOCAL ] APO: Trimmed 77286 records to 54162 (keeping 200 days of data) [2025-09-19T17:17:12.659893] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-19T17:17:12.721011] [DEBUG] [LOCAL ] APO: Primary data saved (54162 records). [2025-09-19T17:17:12.721169] [INFO ] [MAIN ] APO: Full history saved. [2025-09-19T17:17:12.723704] [INFO ] [MAIN ] Update Progress: 134/2372 symbols completed. APO took 44.1s. Estimated remaining: 4h 46m 17s. Rate: 7.8 symbols/min [2025-09-19T17:17:12.896324] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:12.896505] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-09-19T17:17:12.896542] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-09-19T17:17:12.896728] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-19T17:17:12.896811] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-19T17:17:12.896901] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-09-19T17:17:12.896970] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-19T17:17:13.189385] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-19T17:17:13.259286] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:13.443258] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-19T17:17:13.952408] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T17:17:14.243303] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-19T17:17:15.018108] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T17:17:15.043248] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-19T17:17:15.613007] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T17:17:15.679161] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T17:17:15.843286] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-19T17:17:16.509597] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T17:17:16.643379] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-19T17:17:17.443283] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-19T17:17:18.243326] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-19T17:17:18.537368] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T17:17:19.043283] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-19T17:17:19.791800] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T17:17:19.843225] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-19T17:17:20.330549] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T17:17:20.643290] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-19T17:17:21.052294] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T17:17:21.176010] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:17:21.443280] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-19T17:17:22.243271] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-19T17:17:23.046788] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T17:17:23.046575] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-19T17:17:23.049155] [INFO ] [REMOTE ] AQNB: Full fetch complete (5954 records). [2025-09-19T17:17:23.049229] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-19T17:17:23.259759] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T17:17:23.485383] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-19T17:17:23.485467] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-19T17:17:23.485663] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-19T17:17:23.485723] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-19T17:17:23.486102] [DEBUG] [LOCAL ] AQNB: Trimmed 5954 records to 4281 (keeping 200 days of data) [2025-09-19T17:17:23.513124] [DEBUG] [LOCAL ] AQNB: Primary data saved (4281 records). [2025-09-19T17:17:23.513195] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-19T17:17:23.513269] [INFO ] [MAIN ] Update Progress: 135/2372 symbols completed. AQNB took 22.2s. Estimated remaining: 4h 47m 1s. Rate: 7.8 symbols/min [2025-09-19T17:17:23.681085] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:23.738380] [DEBUG] [LOCAL ] ARCO: Loaded 45022 existing records from primary storage. [2025-09-19T17:17:23.738582] [INFO ] [MAIN ] ARCO: Loaded 45022 existing records. [2025-09-19T17:17:23.844848] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-19T17:17:23.986958] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:24.002528] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-19T17:17:24.002837] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-19T17:17:24.005344] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-19T17:17:24.016165] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-19T17:17:24.016637] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-19T17:17:24.409769] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:24.643298] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-19T17:17:25.331770] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-19T17:17:25.392604] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:17:25.443251] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-19T17:17:26.243317] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-19T17:17:26.541315] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T17:17:27.043297] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-19T17:17:27.357498] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T17:17:27.365160] [INFO ] [REMOTE ] AQN: Full fetch complete (75260 records). [2025-09-19T17:17:27.365293] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-19T17:17:27.764950] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-19T17:17:27.765039] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-19T17:17:27.765824] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-19T17:17:27.765889] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-19T17:17:27.767398] [DEBUG] [LOCAL ] AQN: Trimmed 75260 records to 52736 (keeping 200 days of data) [2025-09-19T17:17:27.855810] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-19T17:17:28.091395] [DEBUG] [LOCAL ] AQN: Primary data saved (52736 records). [2025-09-19T17:17:28.091542] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-19T17:17:28.091670] [INFO ] [MAIN ] Update Progress: 136/2372 symbols completed. AQN took 32.5s. Estimated remaining: 4h 46m 2s. Rate: 7.8 symbols/min [2025-09-19T17:17:28.269438] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:28.269668] [DEBUG] [LOCAL ] ARDC: No existing data file found in primary storage. [2025-09-19T17:17:28.269726] [WARN ] [MAIN ] ARDC: No existing data found, performing full refresh instead. [2025-09-19T17:17:28.269892] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-19T17:17:28.269943] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-19T17:17:28.269984] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-09-19T17:17:28.270016] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-19T17:17:28.636884] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:28.643212] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-19T17:17:28.746731] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T17:17:28.913987] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:17:29.341311] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T17:17:29.443289] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-19T17:17:29.662858] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T17:17:29.670067] [INFO ] [REMOTE ] APTV: Full fetch complete (75694 records). [2025-09-19T17:17:29.670196] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-19T17:17:29.671080] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:17:29.671179] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:17:29.671222] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:17:29.671261] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-19T17:17:29.671318] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-09-19T17:17:29.671352] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-09-19T17:17:29.671876] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-09-19T17:17:29.671973] [INFO ] [MAIN ] Update Progress: 137/2372 symbols completed. APTV took 42.6s. Estimated remaining: 4h 44m 15s. Rate: 7.9 symbols/min [2025-09-19T17:17:29.842794] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:29.872690] [DEBUG] [LOCAL ] ARDT: Loaded 28901 existing records from primary storage. [2025-09-19T17:17:29.872838] [INFO ] [MAIN ] ARDT: Loaded 28901 existing records. [2025-09-19T17:17:30.059080] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:30.059361] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-19T17:17:30.059410] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-19T17:17:30.060695] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-19T17:17:30.060758] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-19T17:17:30.253082] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-19T17:17:30.429466] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:30.443707] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T17:17:31.043270] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-19T17:17:31.843327] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-19T17:17:32.029694] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T17:17:32.380414] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T17:17:32.643273] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-19T17:17:33.443245] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-19T17:17:33.507869] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T17:17:34.243256] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-19T17:17:34.594851] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T17:17:34.722999] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T17:17:35.043263] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-19T17:17:35.843287] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-19T17:17:36.407292] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T17:17:36.643270] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-19T17:17:37.064382] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:17:37.098469] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T17:17:37.443265] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-19T17:17:38.198728] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:17:38.243223] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-19T17:17:39.043304] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-19T17:17:39.383526] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:17:39.777504] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T17:17:39.789325] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T17:17:39.843234] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-19T17:17:40.643283] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-19T17:17:41.443270] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-19T17:17:42.115152] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T17:17:42.123076] [INFO ] [REMOTE ] AR: Full fetch complete (77524 records). [2025-09-19T17:17:42.123220] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-19T17:17:42.248336] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-19T17:17:42.548048] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-19T17:17:42.557356] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-19T17:17:42.558557] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-19T17:17:42.560034] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T17:17:42.563572] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-19T17:17:42.601737] [DEBUG] [LOCAL ] AR: Trimmed 77524 records to 54365 (keeping 200 days of data) [2025-09-19T17:17:42.604261] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T17:17:42.945422] [DEBUG] [LOCAL ] AR: Primary data saved (54365 records). [2025-09-19T17:17:42.945566] [INFO ] [MAIN ] AR: Full history saved. [2025-09-19T17:17:42.945684] [INFO ] [MAIN ] Update Progress: 138/2372 symbols completed. AR took 30.2s. Estimated remaining: 4h 45m 39s. Rate: 7.8 symbols/min [2025-09-19T17:17:43.046138] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-19T17:17:43.122355] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:43.175848] [DEBUG] [LOCAL ] ARE: Loaded 50937 existing records from primary storage. [2025-09-19T17:17:43.176024] [INFO ] [MAIN ] ARE: Loaded 50937 existing records. [2025-09-19T17:17:43.356227] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:43.356493] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-19T17:17:43.356543] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-19T17:17:43.358709] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-19T17:17:43.358772] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-19T17:17:43.718157] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:43.843261] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-19T17:17:43.881716] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:17:43.995235] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:17:44.643262] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-19T17:17:45.443243] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-19T17:17:45.704744] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T17:17:46.016372] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T17:17:46.243300] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-19T17:17:46.998213] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T17:17:47.043230] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-19T17:17:47.843224] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-19T17:17:48.146497] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T17:17:48.414154] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T17:17:48.643300] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-19T17:17:49.443281] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-19T17:17:49.837509] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:17:49.840083] [INFO ] [REMOTE ] ARDC: Full fetch complete (20228 records). [2025-09-19T17:17:49.840171] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-19T17:17:50.219756] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-19T17:17:50.220014] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-19T17:17:50.220344] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-19T17:17:50.229788] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-19T17:17:50.246464] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-19T17:17:50.251458] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-19T17:17:50.248476] [DEBUG] [LOCAL ] ARDC: Trimmed 20228 records to 14872 (keeping 200 days of data) [2025-09-19T17:17:50.360294] [DEBUG] [LOCAL ] ARDC: Primary data saved (14872 records). [2025-09-19T17:17:50.360504] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-19T17:17:50.360622] [INFO ] [MAIN ] Update Progress: 139/2372 symbols completed. ARDC took 22.3s. Estimated remaining: 4h 45m 27s. Rate: 7.8 symbols/min [2025-09-19T17:17:50.544102] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:50.566173] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T17:17:50.623053] [DEBUG] [LOCAL ] ARES: Loaded 50098 existing records from primary storage. [2025-09-19T17:17:50.623246] [INFO ] [MAIN ] ARES: Loaded 50098 existing records. [2025-09-19T17:17:50.806264] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:50.806509] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-19T17:17:50.806559] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-19T17:17:50.809579] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-19T17:17:50.809683] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-19T17:17:51.048599] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-19T17:17:51.197752] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:51.511701] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T17:17:51.843273] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-19T17:17:52.643273] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-19T17:17:53.008169] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:17:53.443298] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-19T17:17:53.787695] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T17:17:54.189243] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T17:17:54.243274] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-19T17:17:54.803454] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T17:17:54.811859] [INFO ] [REMOTE ] ARCO: Full fetch complete (65757 records). [2025-09-19T17:17:54.812046] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-19T17:17:55.048404] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-19T17:17:55.243255] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-19T17:17:55.243344] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-19T17:17:55.244128] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-19T17:17:55.244197] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-19T17:17:55.245872] [DEBUG] [LOCAL ] ARCO: Trimmed 65757 records to 45295 (keeping 200 days of data) [2025-09-19T17:17:55.537215] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T17:17:55.544166] [DEBUG] [LOCAL ] ARCO: Primary data saved (45295 records). [2025-09-19T17:17:55.544565] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-19T17:17:55.545361] [INFO ] [MAIN ] Update Progress: 140/2372 symbols completed. ARCO took 32.0s. Estimated remaining: 4h 44m 39s. Rate: 7.8 symbols/min [2025-09-19T17:17:55.723732] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:17:55.770464] [DEBUG] [LOCAL ] ARI: Loaded 43621 existing records from primary storage. [2025-09-19T17:17:55.770620] [INFO ] [MAIN ] ARI: Loaded 43621 existing records. [2025-09-19T17:17:55.851591] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-19T17:17:55.971391] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:17:55.971783] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-19T17:17:55.971843] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-19T17:17:55.973865] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-19T17:17:55.973928] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-19T17:17:56.351339] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:17:56.643266] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-19T17:17:57.274788] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T17:17:57.443236] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-19T17:17:57.915295] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T17:17:58.013502] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T17:17:58.243260] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-19T17:17:58.712613] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T17:17:59.043273] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-19T17:17:59.492527] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T17:17:59.843291] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-19T17:18:00.396604] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T17:18:00.643277] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-19T17:18:01.370910] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T17:18:01.443269] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-19T17:18:02.243280] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-19T17:18:02.405975] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T17:18:03.043272] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-19T17:18:03.843271] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-19T17:18:04.620597] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-19T17:18:04.643224] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-19T17:18:04.729603] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (3.29 seconds). [2025-09-19T17:18:05.103034] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:18:05.443268] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-19T17:18:05.711615] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:18:06.243309] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-19T17:18:07.049708] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-19T17:18:07.069961] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:18:07.843260] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-19T17:18:08.028420] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T17:18:08.032741] [INFO ] [REMOTE ] ARDT: Full fetch complete (41202 records). [2025-09-19T17:18:08.032838] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-19T17:18:08.410893] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-19T17:18:08.411116] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-19T17:18:08.411711] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-19T17:18:08.412026] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-19T17:18:08.414145] [DEBUG] [LOCAL ] ARDT: Trimmed 41202 records to 29081 (keeping 200 days of data) [2025-09-19T17:18:08.589830] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T17:18:08.628393] [DEBUG] [LOCAL ] ARDT: Primary data saved (29081 records). [2025-09-19T17:18:08.629128] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-19T17:18:08.629700] [INFO ] [MAIN ] Update Progress: 141/2372 symbols completed. ARDT took 39.0s. Estimated remaining: 4h 45m 58s. Rate: 7.8 symbols/min [2025-09-19T17:18:08.651488] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-19T17:18:08.790693] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (4.15 seconds). [2025-09-19T17:18:08.859341] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:08.900747] [DEBUG] [LOCAL ] ARIS: Loaded 42356 existing records from primary storage. [2025-09-19T17:18:08.900895] [INFO ] [MAIN ] ARIS: Loaded 42356 existing records. [2025-09-19T17:18:09.088770] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:09.089172] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-19T17:18:09.089306] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-19T17:18:09.098683] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-19T17:18:09.112542] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-19T17:18:09.178661] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T17:18:09.446047] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-19T17:18:09.482159] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:10.243323] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-19T17:18:10.738664] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T17:18:10.855074] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T17:18:11.043323] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-19T17:18:11.742957] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:18:11.843295] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-19T17:18:12.643290] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-19T17:18:12.913178] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T17:18:12.971580] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T17:18:13.443282] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-19T17:18:14.243274] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-19T17:18:14.578513] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:18:15.043283] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-19T17:18:15.518974] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T17:18:15.557785] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T17:18:15.843276] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-19T17:18:16.217968] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:18:16.643268] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-19T17:18:17.105977] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T17:18:17.443327] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-19T17:18:18.243254] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-19T17:18:18.345104] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T17:18:18.973875] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T17:18:18.981506] [INFO ] [REMOTE ] ARE: Full fetch complete (72678 records). [2025-09-19T17:18:18.981741] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-19T17:18:19.055412] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-19T17:18:19.408169] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-19T17:18:19.408259] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-19T17:18:19.409552] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-19T17:18:19.409631] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-19T17:18:19.411235] [DEBUG] [LOCAL ] ARE: Trimmed 72678 records to 51282 (keeping 200 days of data) [2025-09-19T17:18:19.725978] [DEBUG] [LOCAL ] ARE: Primary data saved (51282 records). [2025-09-19T17:18:19.726128] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-19T17:18:19.726213] [INFO ] [MAIN ] Update Progress: 142/2372 symbols completed. ARE took 36.8s. Estimated remaining: 4h 46m 44s. Rate: 7.8 symbols/min [2025-09-19T17:18:19.848420] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-19T17:18:19.904246] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:19.949110] [DEBUG] [LOCAL ] ARLO: Loaded 44533 existing records from primary storage. [2025-09-19T17:18:19.949294] [INFO ] [MAIN ] ARLO: Loaded 44533 existing records. [2025-09-19T17:18:20.145212] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:20.145462] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-19T17:18:20.145511] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-19T17:18:20.147728] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-19T17:18:20.147807] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-19T17:18:20.561286] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:20.643293] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-19T17:18:20.683770] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T17:18:21.076042] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T17:18:21.443281] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-19T17:18:21.734719] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T17:18:21.742621] [INFO ] [REMOTE ] ARES: Full fetch complete (70557 records). [2025-09-19T17:18:21.742789] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-19T17:18:22.146781] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-19T17:18:22.146888] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-19T17:18:22.147616] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-19T17:18:22.147707] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-19T17:18:22.150019] [DEBUG] [LOCAL ] ARES: Trimmed 70557 records to 50464 (keeping 200 days of data) [2025-09-19T17:18:22.244237] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-19T17:18:22.476180] [DEBUG] [LOCAL ] ARES: Primary data saved (50464 records). [2025-09-19T17:18:22.476323] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-19T17:18:22.476425] [INFO ] [MAIN ] Update Progress: 143/2372 symbols completed. ARES took 32.1s. Estimated remaining: 4h 45m 18s. Rate: 7.8 symbols/min [2025-09-19T17:18:22.656390] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:18:22.690993] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:22.691166] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-09-19T17:18:22.691221] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-09-19T17:18:22.691444] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-19T17:18:22.691522] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-19T17:18:22.691602] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-09-19T17:18:22.691699] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-19T17:18:23.066366] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-19T17:18:23.066258] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:23.095434] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T17:18:23.505818] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T17:18:23.843271] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-19T17:18:24.643280] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-19T17:18:25.070932] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:18:25.193767] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T17:18:25.443269] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-19T17:18:26.243327] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-19T17:18:26.482898] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:18:26.496354] [INFO ] [REMOTE ] ARI: Full fetch complete (62735 records). [2025-09-19T17:18:26.496627] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-19T17:18:26.935409] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-19T17:18:26.935533] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-19T17:18:26.936462] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-19T17:18:26.936567] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-19T17:18:26.938247] [DEBUG] [LOCAL ] ARI: Trimmed 62735 records to 43976 (keeping 200 days of data) [2025-09-19T17:18:27.047685] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-19T17:18:27.070063] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T17:18:27.260097] [DEBUG] [LOCAL ] ARI: Primary data saved (43976 records). [2025-09-19T17:18:27.260240] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-19T17:18:27.262900] [INFO ] [MAIN ] Update Progress: 144/2372 symbols completed. ARI took 31.7s. Estimated remaining: 4h 44m 26s. Rate: 7.8 symbols/min [2025-09-19T17:18:27.449756] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:27.505479] [DEBUG] [LOCAL ] AROC: Loaded 49382 existing records from primary storage. [2025-09-19T17:18:27.505672] [INFO ] [MAIN ] AROC: Loaded 49382 existing records. [2025-09-19T17:18:27.702893] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:27.703422] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-19T17:18:27.703583] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-19T17:18:27.706041] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-19T17:18:27.706140] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-19T17:18:27.848432] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-19T17:18:28.051756] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T17:18:28.147219] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:28.288415] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T17:18:28.643311] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-19T17:18:29.443322] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-19T17:18:29.758877] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:18:30.250416] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-19T17:18:30.253807] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T17:18:31.043268] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-19T17:18:31.304838] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T17:18:31.437908] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T17:18:31.843271] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-19T17:18:32.643276] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-19T17:18:32.875363] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T17:18:33.261441] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T17:18:33.443277] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-19T17:18:34.201727] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:18:34.243257] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-19T17:18:35.043277] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-19T17:18:35.588760] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T17:18:35.843279] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-19T17:18:35.970049] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T17:18:36.643265] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-19T17:18:37.094713] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T17:18:37.145676] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T17:18:37.443269] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-19T17:18:37.862121] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T17:18:38.243264] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-19T17:18:39.043285] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-19T17:18:39.468062] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T17:18:39.561934] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T17:18:39.572922] [INFO ] [REMOTE ] ARIS: Full fetch complete (59696 records). [2025-09-19T17:18:39.573133] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-19T17:18:39.848350] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-19T17:18:39.977214] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-19T17:18:39.977318] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-19T17:18:39.977983] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-19T17:18:39.978047] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-19T17:18:39.979266] [DEBUG] [LOCAL ] ARIS: Trimmed 59696 records to 42669 (keeping 200 days of data) [2025-09-19T17:18:40.257481] [DEBUG] [LOCAL ] ARIS: Primary data saved (42669 records). [2025-09-19T17:18:40.257626] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-19T17:18:40.257787] [INFO ] [MAIN ] Update Progress: 145/2372 symbols completed. ARIS took 31.6s. Estimated remaining: 4h 45m 40s. Rate: 7.8 symbols/min [2025-09-19T17:18:40.430102] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:40.490586] [DEBUG] [LOCAL ] ARR: Loaded 52416 existing records from primary storage. [2025-09-19T17:18:40.490779] [INFO ] [MAIN ] ARR: Loaded 52416 existing records. [2025-09-19T17:18:40.653734] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-19T17:18:40.676441] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:40.676727] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-19T17:18:40.676784] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-19T17:18:40.678798] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-19T17:18:40.679050] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-19T17:18:41.056747] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:41.088365] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T17:18:41.284077] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T17:18:41.443229] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-19T17:18:42.243276] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-19T17:18:42.677926] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T17:18:43.043279] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-19T17:18:43.272630] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T17:18:43.843279] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-19T17:18:43.880330] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T17:18:44.369869] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T17:18:44.643268] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-19T17:18:45.443277] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-19T17:18:45.658120] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:18:46.243260] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-19T17:18:46.580531] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:18:46.755898] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:18:47.043315] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-19T17:18:47.843318] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-19T17:18:48.259718] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T17:18:48.420243] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T17:18:48.428459] [INFO ] [REMOTE ] ARLO: Full fetch complete (62559 records). [2025-09-19T17:18:48.428563] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-19T17:18:48.651274] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-19T17:18:48.832780] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-19T17:18:48.832868] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-19T17:18:48.833479] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-19T17:18:48.833519] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-19T17:18:48.834801] [DEBUG] [LOCAL ] ARLO: Trimmed 62559 records to 44833 (keeping 200 days of data) [2025-09-19T17:18:49.099935] [DEBUG] [LOCAL ] ARLO: Primary data saved (44833 records). [2025-09-19T17:18:49.100074] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-19T17:18:49.100188] [INFO ] [MAIN ] Update Progress: 146/2372 symbols completed. ARLO took 29.4s. Estimated remaining: 4h 45m 50s. Rate: 7.8 symbols/min [2025-09-19T17:18:49.283812] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:49.325162] [DEBUG] [LOCAL ] ARW: Loaded 33464 existing records from primary storage. [2025-09-19T17:18:49.325397] [INFO ] [MAIN ] ARW: Loaded 33464 existing records. [2025-09-19T17:18:49.449862] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-19T17:18:49.463675] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T17:18:49.555593] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:18:49.555854] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-19T17:18:49.555902] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-19T17:18:49.557321] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-19T17:18:49.557382] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-19T17:18:49.924438] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:50.243278] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-19T17:18:50.704266] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T17:18:50.714721] [INFO ] [REMOTE ] ARMK: Full fetch complete (72506 records). [2025-09-19T17:18:50.714888] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-19T17:18:51.048385] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-19T17:18:51.126336] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-19T17:18:51.126439] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-19T17:18:51.127197] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-19T17:18:51.127265] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-19T17:18:51.128753] [DEBUG] [LOCAL ] ARMK: Trimmed 72506 records to 51064 (keeping 200 days of data) [2025-09-19T17:18:51.400834] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:18:51.440599] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T17:18:51.524278] [DEBUG] [LOCAL ] ARMK: Primary data saved (51064 records). [2025-09-19T17:18:51.524417] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-19T17:18:51.524496] [INFO ] [MAIN ] Update Progress: 147/2372 symbols completed. ARMK took 29.0s. Estimated remaining: 4h 44m 22s. Rate: 7.8 symbols/min [2025-09-19T17:18:51.704980] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:18:51.705149] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-19T17:18:51.705187] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-19T17:18:51.705370] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-19T17:18:51.705413] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-19T17:18:51.705475] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-19T17:18:51.705509] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-19T17:18:51.853524] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-19T17:18:52.065110] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:18:52.643279] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-19T17:18:53.275031] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-19T17:18:53.443261] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-19T17:18:53.776533] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T17:18:53.951729] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:18:54.243303] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-19T17:18:54.459330] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:18:54.459683] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-19T17:18:55.043241] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-19T17:18:55.108233] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:18:55.251504] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:18:55.251874] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-19T17:18:55.843285] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-19T17:18:56.643264] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-19T17:18:57.443281] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-19T17:18:57.673239] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:18:57.673585] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-19T17:18:57.830947] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T17:18:57.934219] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T17:18:58.243278] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-19T17:18:59.043312] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-19T17:18:59.843286] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-19T17:19:00.210194] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T17:19:00.643276] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-19T17:19:01.056461] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T17:19:01.064475] [INFO ] [REMOTE ] AROC: Full fetch complete (70507 records). [2025-09-19T17:19:01.064620] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-19T17:19:01.458255] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-19T17:19:01.500059] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-19T17:19:01.500189] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-19T17:19:01.500978] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-19T17:19:01.501188] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-19T17:19:01.503285] [DEBUG] [LOCAL ] AROC: Trimmed 70507 records to 49755 (keeping 200 days of data) [2025-09-19T17:19:01.765530] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T17:19:01.766143] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:19:01.783373] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-19T17:19:01.881699] [DEBUG] [LOCAL ] AROC: Primary data saved (49755 records). [2025-09-19T17:19:01.881849] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-19T17:19:01.882465] [INFO ] [MAIN ] Update Progress: 148/2372 symbols completed. AROC took 34.6s. Estimated remaining: 4h 44m 55s. Rate: 7.8 symbols/min [2025-09-19T17:19:02.061397] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:02.122351] [DEBUG] [LOCAL ] AS: Loaded 53456 existing records from primary storage. [2025-09-19T17:19:02.122515] [INFO ] [MAIN ] AS: Loaded 53456 existing records. [2025-09-19T17:19:02.248477] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-19T17:19:02.310748] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:02.310989] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-19T17:19:02.311037] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-19T17:19:02.312751] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-19T17:19:02.312817] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-19T17:19:02.708151] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:02.736467] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T17:19:03.043294] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-19T17:19:03.843288] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-19T17:19:03.953148] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T17:19:04.063319] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:19:04.063660] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-19T17:19:04.643264] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-19T17:19:04.881448] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:19:04.881836] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-19T17:19:05.079585] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T17:19:05.443300] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-19T17:19:06.243275] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-19T17:19:06.499601] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:19:06.500026] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-19T17:19:07.043325] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-19T17:19:07.452390] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T17:19:07.843269] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-19T17:19:08.643280] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-19T17:19:08.894118] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T17:19:09.443248] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-19T17:19:09.816912] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T17:19:09.911990] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T17:19:10.243295] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-19T17:19:11.043291] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-19T17:19:11.187294] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:19:11.807494] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T17:19:11.843225] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-19T17:19:12.643272] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-19T17:19:12.777949] [DEBUG] [REMOTE ] ARW: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-19T17:19:12.778274] [WARN ] [REMOTE ] ARW: No data returned for month 2025-07 [2025-09-19T17:19:13.443322] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-19T17:19:13.515303] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T17:19:13.580048] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T17:19:14.243300] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-19T17:19:14.984241] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:19:15.043258] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-19T17:19:15.843275] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-19T17:19:16.167398] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T17:19:16.643273] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-19T17:19:16.849477] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T17:19:16.854711] [INFO ] [REMOTE ] ARW: Full fetch complete (43089 records). [2025-09-19T17:19:16.854815] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-19T17:19:17.048292] [WARN ] [VALIDATOR ] ARW: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T17:19:17.049041] [FATAL] [MAIN ] ARW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:19:17.049114] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:19:17.049214] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-19T17:19:17.049348] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-09-19T17:19:17.049418] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-09-19T17:19:17.050133] [DEBUG] [LOCAL ] ARW: Deleted derivative data file. [2025-09-19T17:19:17.050242] [INFO ] [MAIN ] Update Progress: 149/2372 symbols completed. ARW took 27.9s. Estimated remaining: 4h 46m 39s. Rate: 7.8 symbols/min [2025-09-19T17:19:17.223452] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:17.239249] [DEBUG] [LOCAL ] ASA: Loaded 13569 existing records from primary storage. [2025-09-19T17:19:17.239374] [INFO ] [MAIN ] ASA: Loaded 13569 existing records. [2025-09-19T17:19:17.438053] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:17.438298] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-19T17:19:17.438345] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-19T17:19:17.439067] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-19T17:19:17.439141] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-19T17:19:17.457195] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-19T17:19:17.837760] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:18.243283] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-19T17:19:18.421969] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T17:19:18.748493] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:19:18.754975] [INFO ] [REMOTE ] ARX: Full fetch complete (12696 records). [2025-09-19T17:19:18.755101] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-19T17:19:18.755634] [FATAL] [VALIDATOR ] ARX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:19:18.755749] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:19:18.755794] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:19:18.755833] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-19T17:19:18.755894] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-19T17:19:18.755930] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-19T17:19:18.755971] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-19T17:19:18.756028] [INFO ] [MAIN ] Update Progress: 150/2372 symbols completed. ARX took 27.2s. Estimated remaining: 4h 45m 2s. Rate: 7.8 symbols/min [2025-09-19T17:19:18.942858] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:18.999851] [DEBUG] [LOCAL ] ASAN: Loaded 53150 existing records from primary storage. [2025-09-19T17:19:19.000078] [INFO ] [MAIN ] ASAN: Loaded 53150 existing records. [2025-09-19T17:19:19.068709] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-19T17:19:19.196811] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:19.197173] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-19T17:19:19.197247] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-19T17:19:19.198385] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-19T17:19:19.198449] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-19T17:19:19.532920] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T17:19:19.608788] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:19.843282] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-19T17:19:19.887432] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-19T17:19:20.643292] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-19T17:19:20.871288] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T17:19:21.333911] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-19T17:19:21.443265] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-19T17:19:22.223924] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T17:19:22.243274] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-19T17:19:23.043272] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-19T17:19:23.082746] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-19T17:19:23.843269] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-19T17:19:23.989311] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T17:19:24.086080] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:19:24.094031] [INFO ] [REMOTE ] ARR: Full fetch complete (75038 records). [2025-09-19T17:19:24.094174] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-19T17:19:24.484631] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-19T17:19:24.484763] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-19T17:19:24.485506] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-19T17:19:24.485564] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-19T17:19:24.487256] [DEBUG] [LOCAL ] ARR: Trimmed 75038 records to 52797 (keeping 200 days of data) [2025-09-19T17:19:24.669695] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-19T17:19:24.819578] [DEBUG] [LOCAL ] ARR: Primary data saved (52797 records). [2025-09-19T17:19:24.819757] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-19T17:19:24.819864] [INFO ] [MAIN ] Update Progress: 151/2372 symbols completed. ARR took 44.6s. Estimated remaining: 4h 44m 30s. Rate: 7.8 symbols/min [2025-09-19T17:19:24.986941] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:25.035218] [DEBUG] [LOCAL ] ASB: Loaded 50015 existing records from primary storage. [2025-09-19T17:19:25.035371] [INFO ] [MAIN ] ASB: Loaded 50015 existing records. [2025-09-19T17:19:25.224257] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:25.224717] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-19T17:19:25.225009] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-19T17:19:25.226409] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-19T17:19:25.226497] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-19T17:19:25.459380] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-19T17:19:25.479248] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:19:25.664933] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:25.918967] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T17:19:26.243271] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-19T17:19:27.043336] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-19T17:19:27.076145] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T17:19:27.843341] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-19T17:19:28.056747] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:19:28.475558] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:19:28.643252] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-19T17:19:29.443271] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-19T17:19:29.912189] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T17:19:30.243267] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-19T17:19:30.549735] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:19:31.043281] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-19T17:19:31.440245] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T17:19:31.601938] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T17:19:31.843266] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-19T17:19:32.643245] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-19T17:19:32.724529] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T17:19:33.443270] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-19T17:19:33.622330] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T17:19:34.243274] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-19T17:19:34.725531] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T17:19:34.734707] [INFO ] [REMOTE ] AS: Full fetch complete (76510 records). [2025-09-19T17:19:34.734891] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-19T17:19:35.056217] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-19T17:19:35.199188] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-19T17:19:35.199282] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-19T17:19:35.200060] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-19T17:19:35.200125] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-19T17:19:35.201894] [DEBUG] [LOCAL ] AS: Trimmed 76510 records to 53846 (keeping 200 days of data) [2025-09-19T17:19:35.232422] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:19:35.573021] [DEBUG] [LOCAL ] AS: Primary data saved (53846 records). [2025-09-19T17:19:35.573203] [INFO ] [MAIN ] AS: Full history saved. [2025-09-19T17:19:35.573923] [INFO ] [MAIN ] Update Progress: 152/2372 symbols completed. AS took 33.7s. Estimated remaining: 4h 45m 7s. Rate: 7.8 symbols/min [2025-09-19T17:19:35.750929] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:35.756714] [DEBUG] [LOCAL ] ASBA: Loaded 3449 existing records from primary storage. [2025-09-19T17:19:35.756806] [INFO ] [MAIN ] ASBA: Loaded 3449 existing records. [2025-09-19T17:19:35.850331] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-19T17:19:35.943664] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:35.943949] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-19T17:19:35.944003] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-19T17:19:35.944318] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-19T17:19:35.944379] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-19T17:19:36.140901] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T17:19:36.339992] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:36.371827] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T17:19:36.643265] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-19T17:19:37.443320] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-19T17:19:37.937878] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T17:19:38.243260] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-19T17:19:38.489163] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T17:19:38.643078] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:19:39.043257] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-19T17:19:39.843268] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-19T17:19:40.403794] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T17:19:40.447870] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T17:19:40.489084] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T17:19:40.643276] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-19T17:19:41.443261] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-19T17:19:41.591225] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T17:19:42.243266] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-19T17:19:42.899624] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:19:42.903341] [INFO ] [REMOTE ] ASA: Full fetch complete (18344 records). [2025-09-19T17:19:42.903431] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-19T17:19:43.048713] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-19T17:19:43.285740] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-19T17:19:43.285822] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-19T17:19:43.286120] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-19T17:19:43.286159] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-19T17:19:43.286749] [DEBUG] [LOCAL ] ASA: Trimmed 18344 records to 13682 (keeping 200 days of data) [2025-09-19T17:19:43.367103] [DEBUG] [LOCAL ] ASA: Primary data saved (13682 records). [2025-09-19T17:19:43.367251] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-19T17:19:43.367378] [INFO ] [MAIN ] Update Progress: 153/2372 symbols completed. ASA took 26.3s. Estimated remaining: 4h 45m 1s. Rate: 7.8 symbols/min [2025-09-19T17:19:43.539018] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:43.576561] [DEBUG] [LOCAL ] ASC: Loaded 38414 existing records from primary storage. [2025-09-19T17:19:43.576735] [INFO ] [MAIN ] ASC: Loaded 38414 existing records. [2025-09-19T17:19:43.683434] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-19T17:19:43.762804] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:43.763097] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-19T17:19:43.763152] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-19T17:19:43.764048] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-19T17:19:43.764112] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-19T17:19:43.848517] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-19T17:19:44.150116] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:44.179106] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:19:44.643281] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-19T17:19:45.056995] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T17:19:45.443265] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-19T17:19:46.243238] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-19T17:19:46.295773] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T17:19:46.865434] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T17:19:47.043331] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-19T17:19:47.843261] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-19T17:19:48.206898] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T17:19:48.416516] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:19:48.569561] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T17:19:48.643236] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-19T17:19:49.443306] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-19T17:19:50.243318] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-19T17:19:50.415822] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T17:19:50.442088] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T17:19:51.043345] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-19T17:19:51.535111] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-19T17:19:51.843274] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-19T17:19:52.187528] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T17:19:52.195124] [INFO ] [REMOTE ] ASB: Full fetch complete (71575 records). [2025-09-19T17:19:52.195292] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-19T17:19:52.583197] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-19T17:19:52.583282] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-19T17:19:52.584063] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-19T17:19:52.584128] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-19T17:19:52.585542] [DEBUG] [LOCAL ] ASB: Trimmed 71575 records to 50356 (keeping 200 days of data) [2025-09-19T17:19:52.647785] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-19T17:19:52.898525] [DEBUG] [LOCAL ] ASB: Primary data saved (50356 records). [2025-09-19T17:19:52.898753] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-19T17:19:52.898879] [INFO ] [MAIN ] Update Progress: 154/2372 symbols completed. ASB took 28.1s. Estimated remaining: 4h 45m 20s. Rate: 7.8 symbols/min [2025-09-19T17:19:53.070401] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:53.091463] [DEBUG] [LOCAL ] ASG: Loaded 21240 existing records from primary storage. [2025-09-19T17:19:53.091597] [INFO ] [MAIN ] ASG: Loaded 21240 existing records. [2025-09-19T17:19:53.270191] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:53.270461] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-19T17:19:53.270521] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-19T17:19:53.271098] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-19T17:19:53.271158] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-19T17:19:53.455475] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-19T17:19:53.640733] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:54.099502] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T17:19:54.154553] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:19:54.188828] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T17:19:54.243247] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-19T17:19:55.043299] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-19T17:19:55.709578] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:19:55.843276] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-19T17:19:56.643342] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-19T17:19:57.136978] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:19:57.418133] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T17:19:57.426042] [INFO ] [REMOTE ] ASAN: Full fetch complete (76548 records). [2025-09-19T17:19:57.426178] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-19T17:19:57.448346] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-19T17:19:57.500949] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T17:19:57.821876] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-19T17:19:57.821959] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-19T17:19:57.822730] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-19T17:19:57.822794] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-19T17:19:57.824330] [DEBUG] [LOCAL ] ASAN: Trimmed 76548 records to 53526 (keeping 200 days of data) [2025-09-19T17:19:58.141816] [DEBUG] [LOCAL ] ASAN: Primary data saved (53526 records). [2025-09-19T17:19:58.141983] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-19T17:19:58.142098] [INFO ] [MAIN ] Update Progress: 155/2372 symbols completed. ASAN took 39.4s. Estimated remaining: 4h 44m 36s. Rate: 7.8 symbols/min [2025-09-19T17:19:58.248343] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-19T17:19:58.312587] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:19:58.335789] [DEBUG] [LOCAL ] ASGI: Loaded 22345 existing records from primary storage. [2025-09-19T17:19:58.335943] [INFO ] [MAIN ] ASGI: Loaded 22345 existing records. [2025-09-19T17:19:58.509711] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:19:58.509943] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-19T17:19:58.509990] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-19T17:19:58.510543] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-19T17:19:58.510603] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-19T17:19:58.862948] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:19:59.007100] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T17:19:59.043218] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-19T17:19:59.403684] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T17:19:59.720134] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T17:19:59.721222] [INFO ] [REMOTE ] ASBA: Full fetch complete (5281 records). [2025-09-19T17:19:59.721292] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-19T17:19:59.848341] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-19T17:20:00.093454] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-19T17:20:00.093544] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-19T17:20:00.093731] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-19T17:20:00.093793] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-19T17:20:00.094313] [DEBUG] [LOCAL ] ASBA: Trimmed 5281 records to 3461 (keeping 200 days of data) [2025-09-19T17:20:00.118328] [DEBUG] [LOCAL ] ASBA: Primary data saved (3461 records). [2025-09-19T17:20:00.118490] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-19T17:20:00.118611] [INFO ] [MAIN ] Update Progress: 156/2372 symbols completed. ASBA took 24.5s. Estimated remaining: 4h 43m 7s. Rate: 7.8 symbols/min [2025-09-19T17:20:00.295477] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:00.337813] [DEBUG] [LOCAL ] ASGN: Loaded 36292 existing records from primary storage. [2025-09-19T17:20:00.337957] [INFO ] [MAIN ] ASGN: Loaded 36292 existing records. [2025-09-19T17:20:00.513372] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:20:00.513711] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-19T17:20:00.513769] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-19T17:20:00.514550] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-19T17:20:00.514610] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-19T17:20:00.652021] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-19T17:20:00.869297] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:01.383001] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T17:20:01.443315] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-19T17:20:01.946811] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:20:02.243334] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-19T17:20:02.963802] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:20:03.043270] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-19T17:20:03.423361] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T17:20:03.843234] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-19T17:20:04.384245] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T17:20:04.643307] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-19T17:20:05.451600] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-19T17:20:05.452899] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T17:20:05.477547] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T17:20:06.243222] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-19T17:20:06.691088] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T17:20:07.043298] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-19T17:20:07.782176] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:20:07.823486] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T17:20:07.843223] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-19T17:20:08.643270] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-19T17:20:09.443290] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-19T17:20:09.858256] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T17:20:09.969153] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T17:20:10.243290] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-19T17:20:10.343014] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:20:11.043267] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-19T17:20:11.107995] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T17:20:11.843278] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-19T17:20:12.643284] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-19T17:20:12.779151] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T17:20:13.165703] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T17:20:13.443277] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-19T17:20:14.243278] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-19T17:20:14.337360] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T17:20:14.526352] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T17:20:15.043264] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-19T17:20:15.564025] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T17:20:15.843280] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-19T17:20:16.522732] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:20:16.526889] [INFO ] [REMOTE ] ASGI: Full fetch complete (33297 records). [2025-09-19T17:20:16.527004] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-19T17:20:16.648471] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-19T17:20:16.910179] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-19T17:20:16.910273] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-19T17:20:16.910711] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-19T17:20:16.910773] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-19T17:20:16.912380] [DEBUG] [LOCAL ] ASGI: Trimmed 33297 records to 22591 (keeping 200 days of data) [2025-09-19T17:20:17.047725] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T17:20:17.085216] [DEBUG] [LOCAL ] ASGI: Primary data saved (22591 records). [2025-09-19T17:20:17.085360] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-19T17:20:17.085454] [INFO ] [MAIN ] Update Progress: 157/2372 symbols completed. ASGI took 18.9s. Estimated remaining: 4h 45m 11s. Rate: 7.8 symbols/min [2025-09-19T17:20:17.443284] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-19T17:20:17.820705] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:20:18.243341] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-19T17:20:18.953356] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T17:20:19.043214] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-19T17:20:19.679611] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T17:20:19.843286] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-19T17:20:20.587307] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T17:20:20.643299] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-19T17:20:21.129573] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T17:20:21.443313] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-19T17:20:22.243302] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-19T17:20:22.522053] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T17:20:23.043390] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-19T17:20:23.113897] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:20:23.205511] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T17:20:23.843273] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-19T17:20:24.643255] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-19T17:20:24.769579] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:20:25.182962] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T17:20:25.186546] [INFO ] [REMOTE ] ASG: Full fetch complete (31560 records). [2025-09-19T17:20:25.186676] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-19T17:20:25.461561] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-19T17:20:25.585872] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-19T17:20:25.585976] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-19T17:20:25.586399] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-19T17:20:25.586493] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-19T17:20:25.587405] [DEBUG] [LOCAL ] ASG: Trimmed 31560 records to 21328 (keeping 200 days of data) [2025-09-19T17:20:25.715255] [DEBUG] [LOCAL ] ASG: Primary data saved (21328 records). [2025-09-19T17:20:25.715391] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-19T17:20:25.715476] [INFO ] [MAIN ] Update Progress: 158/2372 symbols completed. ASG took 32.8s. Estimated remaining: 4h 45m 16s. Rate: 7.8 symbols/min [2025-09-19T17:20:26.036801] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T17:20:26.243273] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-19T17:20:27.279168] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T17:20:27.286973] [INFO ] [REMOTE ] ASGN: Full fetch complete (51466 records). [2025-09-19T17:20:27.287155] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-19T17:20:27.699360] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:20:27.750252] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-19T17:20:27.750476] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-19T17:20:27.751222] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-19T17:20:27.751461] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-19T17:20:27.751403] [INFO ] [REMOTE ] ASC: Full fetch complete (57458 records). [2025-09-19T17:20:27.751773] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-19T17:20:27.774940] [DEBUG] [LOCAL ] ASGN: Trimmed 51466 records to 36601 (keeping 200 days of data) [2025-09-19T17:20:28.282799] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-19T17:20:28.283521] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-19T17:20:28.284465] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-19T17:20:28.284895] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-19T17:20:28.288729] [DEBUG] [LOCAL ] ASC: Trimmed 57458 records to 38686 (keeping 200 days of data) [2025-09-19T17:20:28.616608] [DEBUG] [LOCAL ] ASGN: Primary data saved (36601 records). [2025-09-19T17:20:28.617469] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-19T17:20:28.617679] [INFO ] [MAIN ] Update Progress: 159/2372 symbols completed. ASGN took 28.5s. Estimated remaining: 4h 44m 1s. Rate: 7.8 symbols/min [2025-09-19T17:20:28.651441] [DEBUG] [LOCAL ] ASC: Primary data saved (38686 records). [2025-09-19T17:20:28.651611] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-19T17:20:28.651759] [INFO ] [MAIN ] Update Progress: 160/2372 symbols completed. ASC took 45.3s. Estimated remaining: 4h 42m 7s. Rate: 7.8 symbols/min [2025-09-19T17:20:29.326638] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:29.334736] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:29.382429] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-09-19T17:20:29.405210] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:29.425040] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-09-19T17:20:29.425662] [DEBUG] [LOCAL ] ASPN: No existing data file found in primary storage. [2025-09-19T17:20:29.424952] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:29.425573] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-19T17:20:29.425738] [WARN ] [MAIN ] ASPN: No existing data found, performing full refresh instead. [2025-09-19T17:20:29.426387] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-19T17:20:29.426534] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-19T17:20:29.426601] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-19T17:20:29.426903] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-09-19T17:20:29.426816] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-19T17:20:29.427274] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-19T17:20:29.427326] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-19T17:20:29.619398] [DEBUG] [LOCAL ] ASR: Loaded 9250 existing records from primary storage. [2025-09-19T17:20:29.645688] [INFO ] [MAIN ] ASR: Loaded 9250 existing records. [2025-09-19T17:20:29.738868] [DEBUG] [LOCAL ] ASH: Loaded 38304 existing records from primary storage. [2025-09-19T17:20:29.791346] [INFO ] [MAIN ] ASH: Loaded 38304 existing records. [2025-09-19T17:20:30.413748] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:20:30.489728] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-19T17:20:30.498708] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-19T17:20:30.569631] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:20:30.622775] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:30.613485] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-19T17:20:30.643826] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-19T17:20:30.681523] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-19T17:20:30.678185] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-19T17:20:30.685009] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-19T17:20:30.684736] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:30.686668] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-19T17:20:30.700312] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-19T17:20:30.740671] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-19T17:20:31.403017] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:31.413779] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-19T17:20:31.474763] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:31.475720] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-19T17:20:31.490283] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T17:20:31.494533] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-19T17:20:32.611014] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T17:20:32.613395] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-19T17:20:32.735393] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:20:32.741681] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-19T17:20:32.989977] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T17:20:33.001311] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-19T17:20:33.023003] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T17:20:33.443304] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-19T17:20:33.476920] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T17:20:33.650165] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T17:20:34.243270] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-19T17:20:34.383946] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T17:20:35.043266] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-19T17:20:35.189061] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T17:20:35.213628] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T17:20:35.843247] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-19T17:20:36.332438] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T17:20:36.643286] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-19T17:20:37.443300] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-19T17:20:37.687912] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T17:20:37.787994] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T17:20:38.243302] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-19T17:20:39.043270] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-19T17:20:39.132737] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T17:20:39.505871] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-19T17:20:39.843247] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-19T17:20:39.865981] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T17:20:40.643300] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-19T17:20:41.443277] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-19T17:20:41.667168] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:20:41.839816] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T17:20:42.098461] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T17:20:42.243266] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-19T17:20:43.043237] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-19T17:20:43.315988] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T17:20:43.843273] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-19T17:20:44.643291] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-19T17:20:45.088712] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T17:20:45.155246] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T17:20:45.380598] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T17:20:45.443222] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-19T17:20:46.243304] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-19T17:20:46.308140] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T17:20:47.043334] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-19T17:20:47.843270] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-19T17:20:48.241369] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:20:48.450754] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T17:20:48.454319] [INFO ] [REMOTE ] ASIX: Full fetch complete (29542 records). [2025-09-19T17:20:48.454460] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-19T17:20:48.455034] [FATAL] [VALIDATOR ] ASIX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:20:48.455148] [FATAL] [MAIN ] ASIX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:20:48.455203] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:20:48.455277] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-19T17:20:48.455363] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-19T17:20:48.455418] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-09-19T17:20:48.455497] [DEBUG] [LOCAL ] ASIX: No derivative data file found to delete. [2025-09-19T17:20:48.455587] [INFO ] [MAIN ] Update Progress: 161/2372 symbols completed. ASIX took 19.8s. Estimated remaining: 4h 44m 47s. Rate: 7.8 symbols/min [2025-09-19T17:20:48.632241] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:48.643254] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-19T17:20:48.695325] [DEBUG] [LOCAL ] ASX: Loaded 53316 existing records from primary storage. [2025-09-19T17:20:48.695509] [INFO ] [MAIN ] ASX: Loaded 53316 existing records. [2025-09-19T17:20:48.931552] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:20:48.932023] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-19T17:20:48.932107] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-19T17:20:48.935762] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-19T17:20:48.935839] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-19T17:20:49.209062] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:20:49.321190] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:49.443286] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-19T17:20:50.243286] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-19T17:20:50.296812] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T17:20:50.545563] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T17:20:51.043283] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-19T17:20:51.848425] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-19T17:20:51.871405] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T17:20:52.165579] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T17:20:52.168263] [INFO ] [REMOTE ] ASR: Full fetch complete (12256 records). [2025-09-19T17:20:52.168366] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-19T17:20:52.534862] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-19T17:20:52.534955] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-19T17:20:52.535291] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-19T17:20:52.535353] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-19T17:20:52.535925] [DEBUG] [LOCAL ] ASR: Trimmed 12256 records to 9307 (keeping 200 days of data) [2025-09-19T17:20:52.603230] [DEBUG] [LOCAL ] ASR: Primary data saved (9307 records). [2025-09-19T17:20:52.603376] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-19T17:20:52.603494] [INFO ] [MAIN ] Update Progress: 162/2372 symbols completed. ASR took 23.9s. Estimated remaining: 4h 43m 50s. Rate: 7.8 symbols/min [2025-09-19T17:20:52.648489] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-19T17:20:52.776290] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:20:52.776475] [DEBUG] [LOCAL ] ATEN: No existing data file found in primary storage. [2025-09-19T17:20:52.776512] [WARN ] [MAIN ] ATEN: No existing data found, performing full refresh instead. [2025-09-19T17:20:52.776693] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-19T17:20:52.776757] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-19T17:20:52.776808] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-09-19T17:20:52.776846] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-19T17:20:53.130793] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:20:53.257373] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:20:53.443308] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-19T17:20:54.243283] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-19T17:20:55.033997] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T17:20:55.044477] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-19T17:20:55.145953] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T17:20:55.843278] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-19T17:20:55.889828] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T17:20:56.643254] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-19T17:20:56.682866] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T17:20:57.142276] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T17:20:57.443301] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-19T17:20:58.104854] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T17:20:58.243291] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-19T17:20:59.043313] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-19T17:20:59.509719] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T17:20:59.843237] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-19T17:21:00.473251] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T17:21:00.585396] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:21:00.643218] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-19T17:21:01.443269] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-19T17:21:01.605726] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:21:02.243265] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-19T17:21:02.663562] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:21:02.669191] [INFO ] [REMOTE ] ASH: Full fetch complete (54407 records). [2025-09-19T17:21:02.669335] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-19T17:21:03.048693] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-19T17:21:03.051896] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-19T17:21:03.052835] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-19T17:21:03.053440] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-19T17:21:03.053503] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-19T17:21:03.057519] [DEBUG] [LOCAL ] ASH: Trimmed 54407 records to 38526 (keeping 200 days of data) [2025-09-19T17:21:03.300713] [DEBUG] [LOCAL ] ASH: Primary data saved (38526 records). [2025-09-19T17:21:03.300853] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-19T17:21:03.300967] [INFO ] [MAIN ] Update Progress: 163/2372 symbols completed. ASH took 34.6s. Estimated remaining: 4h 44m 23s. Rate: 7.8 symbols/min [2025-09-19T17:21:03.473284] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:03.511502] [DEBUG] [LOCAL ] ATGE: Loaded 32387 existing records from primary storage. [2025-09-19T17:21:03.511636] [INFO ] [MAIN ] ATGE: Loaded 32387 existing records. [2025-09-19T17:21:03.688292] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:03.688672] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-19T17:21:03.688733] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-19T17:21:03.690764] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-19T17:21:03.690828] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-19T17:21:04.041867] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:04.042177] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-19T17:21:04.767168] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (3.32 seconds). [2025-09-19T17:21:04.780448] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-19T17:21:05.159047] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T17:21:05.211090] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-09-19T17:21:05.443297] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-19T17:21:06.099104] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (3.05 seconds). [2025-09-19T17:21:06.243276] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-19T17:21:06.844363] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T17:21:06.851772] [INFO ] [REMOTE ] ASPN: Full fetch complete (72344 records). [2025-09-19T17:21:06.851940] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-19T17:21:07.051875] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-19T17:21:07.312307] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:21:07.312700] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-19T17:21:07.312848] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-19T17:21:07.320753] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-19T17:21:07.321199] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-19T17:21:07.322852] [DEBUG] [LOCAL ] ASPN: Trimmed 72344 records to 50351 (keeping 200 days of data) [2025-09-19T17:21:07.632797] [DEBUG] [LOCAL ] ASPN: Primary data saved (50351 records). [2025-09-19T17:21:07.632934] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-19T17:21:07.633011] [INFO ] [MAIN ] Update Progress: 164/2372 symbols completed. ASPN took 39.0s. Estimated remaining: 4h 43m 29s. Rate: 7.8 symbols/min [2025-09-19T17:21:07.808968] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:07.843594] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-19T17:21:07.843481] [DEBUG] [LOCAL ] ATHM: Loaded 33337 existing records from primary storage. [2025-09-19T17:21:07.844855] [INFO ] [MAIN ] ATHM: Loaded 33337 existing records. [2025-09-19T17:21:08.036456] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:08.036766] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-19T17:21:08.036824] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-19T17:21:08.038444] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-19T17:21:08.038505] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-19T17:21:08.399755] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:08.425142] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T17:21:08.643266] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-19T17:21:09.428593] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T17:21:09.443210] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-19T17:21:09.568760] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T17:21:10.243325] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-19T17:21:10.459461] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T17:21:11.043304] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-19T17:21:11.843451] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-19T17:21:12.088467] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-19T17:21:12.205695] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T17:21:12.643336] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-19T17:21:13.443318] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-19T17:21:13.700294] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T17:21:14.109744] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (3.07 seconds). [2025-09-19T17:21:14.243301] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-19T17:21:15.043299] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-19T17:21:15.765375] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-19T17:21:15.843291] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-19T17:21:15.892138] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-19T17:21:16.326384] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T17:21:16.643282] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-19T17:21:16.767957] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T17:21:17.443284] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-19T17:21:18.056481] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:21:18.184888] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-19T17:21:18.243271] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-19T17:21:19.043289] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-19T17:21:19.236825] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T17:21:19.336441] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T17:21:19.843280] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-19T17:21:20.188336] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T17:21:20.643272] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-19T17:21:20.990273] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T17:21:20.996204] [INFO ] [REMOTE ] ATEN: Full fetch complete (57608 records). [2025-09-19T17:21:20.996359] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-19T17:21:21.397555] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-19T17:21:21.397909] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-19T17:21:21.398708] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-19T17:21:21.398772] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-19T17:21:21.400119] [DEBUG] [LOCAL ] ATEN: Trimmed 57608 records to 40681 (keeping 200 days of data) [2025-09-19T17:21:21.463691] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-19T17:21:21.665844] [DEBUG] [LOCAL ] ATEN: Primary data saved (40681 records). [2025-09-19T17:21:21.665981] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-19T17:21:21.666059] [INFO ] [MAIN ] Update Progress: 165/2372 symbols completed. ATEN took 29.1s. Estimated remaining: 4h 44m 46s. Rate: 7.8 symbols/min [2025-09-19T17:21:21.838087] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:21.847928] [DEBUG] [LOCAL ] ATHS: Loaded 7270 existing records from primary storage. [2025-09-19T17:21:21.848084] [INFO ] [MAIN ] ATHS: Loaded 7270 existing records. [2025-09-19T17:21:22.029808] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:22.030195] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-19T17:21:22.030280] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-19T17:21:22.031094] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-19T17:21:22.031202] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-19T17:21:22.251758] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-19T17:21:22.409144] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:22.470139] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T17:21:22.515032] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T17:21:23.043266] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-19T17:21:23.843299] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-19T17:21:24.269774] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T17:21:24.322042] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T17:21:24.420552] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T17:21:24.643329] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-19T17:21:25.443288] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-19T17:21:25.630117] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T17:21:25.635119] [INFO ] [REMOTE ] ATGE: Full fetch complete (46313 records). [2025-09-19T17:21:25.635355] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-19T17:21:26.045267] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-19T17:21:26.045397] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-19T17:21:26.045949] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-19T17:21:26.046012] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-19T17:21:26.047204] [DEBUG] [LOCAL ] ATGE: Trimmed 46313 records to 32625 (keeping 200 days of data) [2025-09-19T17:21:26.243311] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-19T17:21:26.246696] [DEBUG] [LOCAL ] ATGE: Primary data saved (32625 records). [2025-09-19T17:21:26.246855] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-19T17:21:26.246951] [INFO ] [MAIN ] Update Progress: 166/2372 symbols completed. ATGE took 22.9s. Estimated remaining: 4h 43m 57s. Rate: 7.8 symbols/min [2025-09-19T17:21:26.419091] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:26.467882] [DEBUG] [LOCAL ] ATI: Loaded 52046 existing records from primary storage. [2025-09-19T17:21:26.468032] [INFO ] [MAIN ] ATI: Loaded 52046 existing records. [2025-09-19T17:21:26.652547] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:26.652824] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-19T17:21:26.652875] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-19T17:21:26.655482] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-19T17:21:26.655559] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-19T17:21:27.041596] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:27.043220] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-19T17:21:27.198523] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:21:27.843312] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-19T17:21:28.105172] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T17:21:28.643317] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-19T17:21:28.915106] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T17:21:29.337057] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T17:21:29.348054] [INFO ] [REMOTE ] ASX: Full fetch complete (76648 records). [2025-09-19T17:21:29.348343] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-19T17:21:29.450767] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-19T17:21:29.754760] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-19T17:21:29.754853] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-19T17:21:29.755673] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-19T17:21:29.755737] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-19T17:21:29.757258] [DEBUG] [LOCAL ] ASX: Trimmed 76648 records to 53698 (keeping 200 days of data) [2025-09-19T17:21:30.109522] [DEBUG] [LOCAL ] ASX: Primary data saved (53698 records). [2025-09-19T17:21:30.109719] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-19T17:21:30.109821] [INFO ] [MAIN ] Update Progress: 167/2372 symbols completed. ASX took 41.7s. Estimated remaining: 4h 42m 58s. Rate: 7.8 symbols/min [2025-09-19T17:21:30.252904] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-19T17:21:30.288343] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:30.288565] [DEBUG] [LOCAL ] ATKR: No existing data file found in primary storage. [2025-09-19T17:21:30.288615] [WARN ] [MAIN ] ATKR: No existing data found, performing full refresh instead. [2025-09-19T17:21:30.288810] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-19T17:21:30.288867] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-19T17:21:30.288911] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-09-19T17:21:30.288945] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-19T17:21:30.670245] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:30.693530] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T17:21:30.924809] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T17:21:31.043311] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-19T17:21:31.102369] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T17:21:31.843266] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-19T17:21:32.643277] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-19T17:21:32.769824] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T17:21:33.443279] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-19T17:21:33.789807] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T17:21:34.241519] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T17:21:34.247727] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-19T17:21:35.043245] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-19T17:21:35.166329] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T17:21:35.183367] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T17:21:35.843270] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-19T17:21:36.643261] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-19T17:21:36.965998] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T17:21:37.443230] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-19T17:21:37.726391] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T17:21:37.990086] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T17:21:38.243268] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-19T17:21:39.043268] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-19T17:21:39.490966] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T17:21:39.839977] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:21:39.846706] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-19T17:21:39.967946] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T17:21:40.643294] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-19T17:21:41.443286] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-19T17:21:41.593949] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:21:41.871328] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-19T17:21:42.126296] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:21:42.130359] [INFO ] [REMOTE ] ATHM: Full fetch complete (52285 records). [2025-09-19T17:21:42.130458] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-19T17:21:42.248475] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-19T17:21:42.551919] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-19T17:21:42.552084] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-19T17:21:42.553201] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-19T17:21:42.553282] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-19T17:21:42.554572] [DEBUG] [LOCAL ] ATHM: Trimmed 52285 records to 33480 (keeping 200 days of data) [2025-09-19T17:21:42.797056] [DEBUG] [LOCAL ] ATHM: Primary data saved (33480 records). [2025-09-19T17:21:42.797241] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-19T17:21:42.797338] [INFO ] [MAIN ] Update Progress: 168/2372 symbols completed. ATHM took 35.2s. Estimated remaining: 4h 43m 56s. Rate: 7.8 symbols/min [2025-09-19T17:21:42.974586] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:43.014780] [DEBUG] [LOCAL ] ATMU: Loaded 40021 existing records from primary storage. [2025-09-19T17:21:43.014937] [INFO ] [MAIN ] ATMU: Loaded 40021 existing records. [2025-09-19T17:21:43.048394] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-19T17:21:43.200522] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:43.200824] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-19T17:21:43.200879] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-19T17:21:43.206315] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-19T17:21:43.206432] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-19T17:21:43.593962] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:43.843243] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-19T17:21:44.643334] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-19T17:21:44.713484] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-19T17:21:44.713866] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T17:21:45.056685] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:21:45.443295] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-19T17:21:45.802375] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T17:21:46.243276] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-19T17:21:46.473810] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T17:21:47.043324] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-19T17:21:47.843244] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-19T17:21:47.961302] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:21:47.973014] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T17:21:48.643504] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-19T17:21:49.443314] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-19T17:21:49.513703] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T17:21:50.235703] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T17:21:50.243204] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-19T17:21:50.293507] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T17:21:51.043304] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-19T17:21:51.843247] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-19T17:21:51.950472] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T17:21:52.572304] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T17:21:52.574195] [INFO ] [REMOTE ] ATHS: Full fetch complete (10035 records). [2025-09-19T17:21:52.574281] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-19T17:21:52.651149] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-19T17:21:52.868015] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:21:52.993596] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-19T17:21:52.993726] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-19T17:21:52.993999] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-19T17:21:52.994041] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-19T17:21:52.994480] [DEBUG] [LOCAL ] ATHS: Trimmed 10035 records to 7291 (keeping 200 days of data) [2025-09-19T17:21:53.040386] [DEBUG] [LOCAL ] ATHS: Primary data saved (7291 records). [2025-09-19T17:21:53.040512] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-19T17:21:53.040620] [INFO ] [MAIN ] Update Progress: 169/2372 symbols completed. ATHS took 31.4s. Estimated remaining: 4h 44m 21s. Rate: 7.7 symbols/min [2025-09-19T17:21:53.217763] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:53.274861] [DEBUG] [LOCAL ] ATO: Loaded 42420 existing records from primary storage. [2025-09-19T17:21:53.275008] [INFO ] [MAIN ] ATO: Loaded 42420 existing records. [2025-09-19T17:21:53.448672] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-19T17:21:53.451776] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:53.455900] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-19T17:21:53.456003] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-19T17:21:53.458037] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-19T17:21:53.458099] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-19T17:21:53.835333] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:54.243268] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-19T17:21:54.746440] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:21:55.043334] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-19T17:21:55.596168] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:21:55.843334] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-19T17:21:56.436331] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T17:21:56.643322] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-19T17:21:56.834733] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T17:21:57.443371] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-19T17:21:57.499153] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:21:57.504988] [INFO ] [REMOTE ] ATKR: Full fetch complete (53591 records). [2025-09-19T17:21:57.505134] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-19T17:21:57.907803] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-19T17:21:57.907937] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-19T17:21:57.908559] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-19T17:21:57.908609] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-19T17:21:57.909974] [DEBUG] [LOCAL ] ATKR: Trimmed 53591 records to 36395 (keeping 200 days of data) [2025-09-19T17:21:58.145405] [DEBUG] [LOCAL ] ATKR: Primary data saved (36395 records). [2025-09-19T17:21:58.145569] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-19T17:21:58.145679] [INFO ] [MAIN ] Update Progress: 170/2372 symbols completed. ATKR took 28.0s. Estimated remaining: 4h 43m 39s. Rate: 7.8 symbols/min [2025-09-19T17:21:58.253847] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-19T17:21:58.333707] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:21:58.381862] [DEBUG] [LOCAL ] ATR: Loaded 30720 existing records from primary storage. [2025-09-19T17:21:58.382082] [INFO ] [MAIN ] ATR: Loaded 30720 existing records. [2025-09-19T17:21:58.568826] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:21:58.569254] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-19T17:21:58.569368] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-19T17:21:58.578731] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-19T17:21:58.583970] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-19T17:21:58.688800] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T17:21:59.004886] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:21:59.043216] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-19T17:21:59.552875] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T17:21:59.843315] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-19T17:22:00.245426] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T17:22:00.530528] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T17:22:00.643272] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-19T17:22:01.255689] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T17:22:01.443260] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-19T17:22:02.243254] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-19T17:22:02.333844] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T17:22:03.043270] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-19T17:22:03.295546] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:22:03.843739] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-19T17:22:03.855391] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T17:22:04.284860] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T17:22:04.643317] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-19T17:22:05.443342] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-19T17:22:05.650889] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T17:22:06.243324] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-19T17:22:06.276847] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:22:06.573286] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T17:22:07.043283] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-19T17:22:07.843338] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-19T17:22:08.396967] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T17:22:08.643285] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-19T17:22:09.233903] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T17:22:09.242485] [INFO ] [REMOTE ] ATI: Full fetch complete (73408 records). [2025-09-19T17:22:09.242684] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-19T17:22:09.243767] [FATAL] [VALIDATOR ] ATI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:22:09.243877] [FATAL] [MAIN ] ATI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:22:09.243925] [WARN ] [MAIN ] ATI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:22:09.243964] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-19T17:22:09.244024] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-09-19T17:22:09.244060] [INFO ] [LOCAL ] ATI: Starting deletion of derivative data. [2025-09-19T17:22:09.244679] [DEBUG] [LOCAL ] ATI: Deleted derivative data file. [2025-09-19T17:22:09.244790] [INFO ] [MAIN ] Update Progress: 171/2372 symbols completed. ATI took 43.0s. Estimated remaining: 4h 44m 14s. Rate: 7.7 symbols/min [2025-09-19T17:22:09.431513] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:09.448223] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-19T17:22:09.452914] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T17:22:09.473756] [DEBUG] [LOCAL ] ATS: Loaded 18391 existing records from primary storage. [2025-09-19T17:22:09.473892] [INFO ] [MAIN ] ATS: Loaded 18391 existing records. [2025-09-19T17:22:09.653267] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:09.653540] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-19T17:22:09.653589] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-19T17:22:09.654801] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-19T17:22:09.654864] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-19T17:22:10.022939] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:10.243273] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-19T17:22:10.287514] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:22:10.801494] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T17:22:11.043274] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-19T17:22:11.843305] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-19T17:22:12.208456] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T17:22:12.643315] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-19T17:22:13.163446] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T17:22:13.185011] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:22:13.443299] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-19T17:22:13.755444] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T17:22:14.243285] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-19T17:22:14.680008] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:22:15.043272] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-19T17:22:15.843276] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-19T17:22:16.073349] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T17:22:16.109147] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:22:16.643271] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-19T17:22:17.443310] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-19T17:22:17.513362] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T17:22:18.185745] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:22:18.243272] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-19T17:22:19.043270] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-19T17:22:19.236022] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T17:22:19.242710] [INFO ] [REMOTE ] ATO: Full fetch complete (60379 records). [2025-09-19T17:22:19.242899] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-19T17:22:19.673704] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-19T17:22:19.673877] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-19T17:22:19.675476] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-19T17:22:19.675677] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-19T17:22:19.698042] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T17:22:19.705821] [DEBUG] [LOCAL ] ATO: Trimmed 60379 records to 42708 (keeping 200 days of data) [2025-09-19T17:22:19.890571] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-19T17:22:19.984474] [DEBUG] [LOCAL ] ATO: Primary data saved (42708 records). [2025-09-19T17:22:19.984610] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-19T17:22:19.984740] [INFO ] [MAIN ] Update Progress: 172/2372 symbols completed. ATO took 26.9s. Estimated remaining: 4h 44m 45s. Rate: 7.7 symbols/min [2025-09-19T17:22:20.151503] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:20.196859] [DEBUG] [LOCAL ] ATUS: Loaded 49567 existing records from primary storage. [2025-09-19T17:22:20.197030] [INFO ] [MAIN ] ATUS: Loaded 49567 existing records. [2025-09-19T17:22:20.400944] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:20.402298] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T17:22:20.409099] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-19T17:22:20.409169] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-19T17:22:20.410854] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-19T17:22:20.410922] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-19T17:22:20.648353] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-19T17:22:20.765063] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:21.258062] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T17:22:21.443248] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-19T17:22:22.052561] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T17:22:22.243238] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-19T17:22:22.370758] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T17:22:22.377907] [INFO ] [REMOTE ] ATMU: Full fetch complete (56770 records). [2025-09-19T17:22:22.378100] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-19T17:22:22.774091] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-19T17:22:22.774194] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-19T17:22:22.774818] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-19T17:22:22.774886] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-19T17:22:22.776115] [DEBUG] [LOCAL ] ATMU: Trimmed 56770 records to 40306 (keeping 200 days of data) [2025-09-19T17:22:23.018087] [DEBUG] [LOCAL ] ATMU: Primary data saved (40306 records). [2025-09-19T17:22:23.018253] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-19T17:22:23.018438] [INFO ] [MAIN ] Update Progress: 173/2372 symbols completed. ATMU took 40.2s. Estimated remaining: 4h 43m 37s. Rate: 7.8 symbols/min [2025-09-19T17:22:23.049340] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-19T17:22:23.195075] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:23.253761] [DEBUG] [LOCAL ] AU: Loaded 53292 existing records from primary storage. [2025-09-19T17:22:23.253948] [INFO ] [MAIN ] AU: Loaded 53292 existing records. [2025-09-19T17:22:23.461152] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:23.461458] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-19T17:22:23.461516] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-19T17:22:23.463954] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-19T17:22:23.464021] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-19T17:22:23.839350] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T17:22:23.858564] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-19T17:22:23.870215] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:24.333601] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T17:22:24.643290] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-19T17:22:25.443267] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-19T17:22:25.765707] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T17:22:26.243350] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-19T17:22:26.393365] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T17:22:26.711591] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:22:27.043281] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-19T17:22:27.561806] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:22:27.843317] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-19T17:22:28.250952] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T17:22:28.255836] [INFO ] [REMOTE ] ATS: Full fetch complete (25939 records). [2025-09-19T17:22:28.256151] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-19T17:22:28.648443] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-19T17:22:28.705613] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-19T17:22:28.705790] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-19T17:22:28.706331] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-19T17:22:28.706413] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-19T17:22:28.707850] [DEBUG] [LOCAL ] ATS: Trimmed 25939 records to 18502 (keeping 200 days of data) [2025-09-19T17:22:28.816625] [DEBUG] [LOCAL ] ATS: Primary data saved (18502 records). [2025-09-19T17:22:28.816824] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-19T17:22:28.816918] [INFO ] [MAIN ] Update Progress: 174/2372 symbols completed. ATS took 19.6s. Estimated remaining: 4h 43m 5s. Rate: 7.8 symbols/min [2025-09-19T17:22:28.989923] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:29.035325] [DEBUG] [LOCAL ] AUB: Loaded 46863 existing records from primary storage. [2025-09-19T17:22:29.035507] [INFO ] [MAIN ] AUB: Loaded 46863 existing records. [2025-09-19T17:22:29.231734] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:29.232343] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-19T17:22:29.232525] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-19T17:22:29.239693] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-19T17:22:29.247816] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-19T17:22:29.255132] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T17:22:29.347993] [INFO ] [REMOTE ] ATR: Full fetch complete (43250 records). [2025-09-19T17:22:29.371359] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-19T17:22:29.483380] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-19T17:22:29.974185] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:30.058082] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-19T17:22:30.058180] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-19T17:22:30.058916] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-19T17:22:30.058988] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-19T17:22:30.060203] [DEBUG] [LOCAL ] ATR: Trimmed 43250 records to 30949 (keeping 200 days of data) [2025-09-19T17:22:30.249250] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-19T17:22:30.271242] [DEBUG] [LOCAL ] ATR: Primary data saved (30949 records). [2025-09-19T17:22:30.271396] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-19T17:22:30.271500] [INFO ] [MAIN ] Update Progress: 175/2372 symbols completed. ATR took 32.1s. Estimated remaining: 4h 41m 38s. Rate: 7.8 symbols/min [2025-09-19T17:22:30.446365] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:30.446581] [DEBUG] [LOCAL ] AUNA: No existing data file found in primary storage. [2025-09-19T17:22:30.446636] [WARN ] [MAIN ] AUNA: No existing data found, performing full refresh instead. [2025-09-19T17:22:30.446806] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-19T17:22:30.446848] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-19T17:22:30.446888] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-09-19T17:22:30.446921] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-19T17:22:30.838956] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:30.867141] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-19T17:22:31.043256] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-19T17:22:31.114884] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:22:31.843291] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-19T17:22:32.190855] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T17:22:32.643259] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-19T17:22:32.785423] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T17:22:32.868527] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T17:22:33.443304] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-19T17:22:34.243260] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-19T17:22:34.387623] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T17:22:34.467635] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T17:22:35.043259] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-19T17:22:35.843278] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-19T17:22:36.228368] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T17:22:36.375322] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T17:22:36.580255] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T17:22:36.643218] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-19T17:22:37.443257] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-19T17:22:38.219219] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T17:22:38.243230] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-19T17:22:38.686628] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T17:22:38.720380] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T17:22:39.043284] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-19T17:22:39.843264] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-19T17:22:39.885506] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T17:22:40.643266] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-19T17:22:41.443313] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-19T17:22:41.793347] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:22:42.243284] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-19T17:22:42.620595] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T17:22:43.043310] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-19T17:22:43.494611] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T17:22:43.748191] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T17:22:43.843318] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-19T17:22:44.056153] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T17:22:44.643275] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-19T17:22:45.383403] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:22:45.443223] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-19T17:22:45.943782] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T17:22:46.217893] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T17:22:46.243231] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-19T17:22:46.916865] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T17:22:46.918169] [INFO ] [REMOTE ] AUNA: Full fetch complete (7332 records). [2025-09-19T17:22:46.918240] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-19T17:22:46.918740] [FATAL] [VALIDATOR ] AUNA: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:22:46.918824] [FATAL] [MAIN ] AUNA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:22:46.918867] [WARN ] [MAIN ] AUNA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:22:46.918904] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-19T17:22:46.918982] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-09-19T17:22:46.919038] [INFO ] [LOCAL ] AUNA: Starting deletion of derivative data. [2025-09-19T17:22:46.919081] [DEBUG] [LOCAL ] AUNA: No derivative data file found to delete. [2025-09-19T17:22:46.919135] [INFO ] [MAIN ] Update Progress: 176/2372 symbols completed. AUNA took 16.6s. Estimated remaining: 4h 43m 22s. Rate: 7.7 symbols/min [2025-09-19T17:22:47.048350] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-19T17:22:47.099436] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:47.141820] [DEBUG] [LOCAL ] AVA: Loaded 40043 existing records from primary storage. [2025-09-19T17:22:47.141987] [INFO ] [MAIN ] AVA: Loaded 40043 existing records. [2025-09-19T17:22:47.336908] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:47.337291] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-19T17:22:47.337353] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-19T17:22:47.340923] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-19T17:22:47.340989] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-19T17:22:47.724730] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:47.843259] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-19T17:22:48.643276] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-19T17:22:48.984797] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:22:49.443288] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-19T17:22:49.596915] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:22:49.977504] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T17:22:50.243280] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-19T17:22:51.043291] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-19T17:22:51.113001] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:22:51.843265] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-19T17:22:52.079470] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T17:22:52.643295] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-19T17:22:52.793425] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T17:22:53.443315] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-19T17:22:53.478022] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T17:22:54.243248] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-19T17:22:54.295246] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T17:22:54.943806] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:22:55.043273] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-19T17:22:55.253437] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T17:22:55.843287] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-19T17:22:56.643320] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-19T17:22:56.945626] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T17:22:56.953768] [INFO ] [REMOTE ] ATUS: Full fetch complete (70915 records). [2025-09-19T17:22:56.953955] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-19T17:22:57.429783] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-19T17:22:57.429923] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-19T17:22:57.431293] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-19T17:22:57.431395] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-19T17:22:57.433780] [DEBUG] [LOCAL ] ATUS: Trimmed 70915 records to 49936 (keeping 200 days of data) [2025-09-19T17:22:57.507714] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-19T17:22:57.836628] [DEBUG] [LOCAL ] ATUS: Primary data saved (49936 records). [2025-09-19T17:22:57.836859] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-19T17:22:57.836969] [INFO ] [MAIN ] Update Progress: 177/2372 symbols completed. ATUS took 37.9s. Estimated remaining: 4h 43m 54s. Rate: 7.7 symbols/min [2025-09-19T17:22:58.158199] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:22:58.186127] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:22:58.209595] [DEBUG] [LOCAL ] AVAL: Loaded 9597 existing records from primary storage. [2025-09-19T17:22:58.209820] [INFO ] [MAIN ] AVAL: Loaded 9597 existing records. [2025-09-19T17:22:58.243880] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-19T17:22:58.441674] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-19T17:22:58.558333] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:22:58.558667] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-19T17:22:58.558748] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-19T17:22:58.559960] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-19T17:22:58.560071] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-19T17:22:58.955179] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:22:59.043300] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-19T17:22:59.458128] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T17:22:59.613710] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T17:22:59.843287] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-19T17:23:00.147497] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T17:23:00.643278] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-19T17:23:01.443320] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-19T17:23:01.720458] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T17:23:02.119295] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T17:23:02.243314] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-19T17:23:02.922085] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-19T17:23:03.043284] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-19T17:23:03.173623] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T17:23:03.843271] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-19T17:23:04.643264] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-19T17:23:05.443289] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-19T17:23:05.730558] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T17:23:06.243297] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-19T17:23:06.364746] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:23:06.671827] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T17:23:06.678256] [INFO ] [REMOTE ] AUB: Full fetch complete (65043 records). [2025-09-19T17:23:06.678381] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-19T17:23:06.679083] [FATAL] [VALIDATOR ] AUB: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:23:06.679169] [FATAL] [MAIN ] AUB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:23:06.679223] [WARN ] [MAIN ] AUB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:23:06.679286] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-19T17:23:06.679358] [DEBUG] [LOCAL ] AUB: No primary data file found to delete. [2025-09-19T17:23:06.679414] [INFO ] [LOCAL ] AUB: Starting deletion of derivative data. [2025-09-19T17:23:06.679863] [DEBUG] [LOCAL ] AUB: Deleted derivative data file. [2025-09-19T17:23:06.679989] [INFO ] [MAIN ] Update Progress: 178/2372 symbols completed. AUB took 37.9s. Estimated remaining: 4h 43m 60s. Rate: 7.7 symbols/min [2025-09-19T17:23:06.867912] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:06.916450] [DEBUG] [LOCAL ] AVB: Loaded 41875 existing records from primary storage. [2025-09-19T17:23:06.916624] [INFO ] [MAIN ] AVB: Loaded 41875 existing records. [2025-09-19T17:23:07.046754] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-19T17:23:07.112955] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:07.113388] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-19T17:23:07.113580] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-19T17:23:07.116894] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-19T17:23:07.116996] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-19T17:23:07.367071] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (3.52 seconds). [2025-09-19T17:23:07.488777] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T17:23:07.574073] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:07.843297] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-19T17:23:08.235432] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T17:23:08.643308] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-19T17:23:09.443277] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-19T17:23:10.235366] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T17:23:10.243233] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-19T17:23:10.243406] [INFO ] [REMOTE ] AU: Full fetch complete (76253 records). [2025-09-19T17:23:10.244304] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-19T17:23:10.754755] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-19T17:23:10.760188] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-19T17:23:10.761555] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-19T17:23:10.763943] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-19T17:23:10.763800] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T17:23:10.775174] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T17:23:10.780084] [DEBUG] [LOCAL ] AU: Trimmed 76253 records to 53682 (keeping 200 days of data) [2025-09-19T17:23:11.044946] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-19T17:23:11.132852] [DEBUG] [LOCAL ] AU: Primary data saved (53682 records). [2025-09-19T17:23:11.133005] [INFO ] [MAIN ] AU: Full history saved. [2025-09-19T17:23:11.134522] [INFO ] [MAIN ] Update Progress: 179/2372 symbols completed. AU took 48.1s. Estimated remaining: 4h 43m 11s. Rate: 7.7 symbols/min [2025-09-19T17:23:11.312213] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:11.312434] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-19T17:23:11.312505] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-19T17:23:11.312930] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-19T17:23:11.312997] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-19T17:23:11.313065] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-19T17:23:11.313121] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-19T17:23:11.680263] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:11.819027] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T17:23:11.842524] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T17:23:11.849466] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-19T17:23:12.643279] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-19T17:23:13.105356] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T17:23:13.443262] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-19T17:23:14.243279] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-19T17:23:14.329825] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T17:23:14.375847] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T17:23:14.483437] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:14.483939] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-19T17:23:15.043324] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-19T17:23:15.843297] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-19T17:23:15.923806] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T17:23:15.926236] [INFO ] [REMOTE ] AVAL: Full fetch complete (14664 records). [2025-09-19T17:23:15.926369] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-19T17:23:16.311012] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-19T17:23:16.311115] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-19T17:23:16.311416] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-19T17:23:16.311502] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-19T17:23:16.312441] [DEBUG] [LOCAL ] AVAL: Trimmed 14664 records to 9642 (keeping 200 days of data) [2025-09-19T17:23:16.379714] [DEBUG] [LOCAL ] AVAL: Primary data saved (9642 records). [2025-09-19T17:23:16.379857] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-19T17:23:16.380041] [INFO ] [MAIN ] Update Progress: 180/2372 symbols completed. AVAL took 18.5s. Estimated remaining: 4h 42m 33s. Rate: 7.8 symbols/min [2025-09-19T17:23:16.550843] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:16.578402] [DEBUG] [LOCAL ] AVD: Loaded 23445 existing records from primary storage. [2025-09-19T17:23:16.578557] [INFO ] [MAIN ] AVD: Loaded 23445 existing records. [2025-09-19T17:23:16.652264] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-19T17:23:16.759278] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:16.759506] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-19T17:23:16.759559] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-19T17:23:16.760881] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-19T17:23:16.760960] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-19T17:23:17.142017] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:17.443323] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-19T17:23:17.674620] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:17.675015] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-19T17:23:17.777455] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:23:17.900860] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T17:23:18.243311] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-19T17:23:19.043314] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-19T17:23:19.843298] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-19T17:23:20.125717] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:23:20.488613] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:20.488983] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-19T17:23:20.514285] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:23:20.643265] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-19T17:23:20.880373] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:20.880704] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-19T17:23:21.443285] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-19T17:23:21.905969] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:21.906294] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-19T17:23:22.243263] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-19T17:23:23.043284] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-19T17:23:23.843267] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-19T17:23:23.949346] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T17:23:23.955720] [INFO ] [REMOTE ] AVA: Full fetch complete (55499 records). [2025-09-19T17:23:23.955835] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-19T17:23:24.353741] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-19T17:23:24.353833] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-19T17:23:24.354415] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-19T17:23:24.354456] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-19T17:23:24.355792] [DEBUG] [LOCAL ] AVA: Trimmed 55499 records to 40280 (keeping 200 days of data) [2025-09-19T17:23:24.631909] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T17:23:24.643242] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-19T17:23:24.653857] [DEBUG] [LOCAL ] AVA: Primary data saved (40280 records). [2025-09-19T17:23:24.654007] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-19T17:23:24.654111] [INFO ] [MAIN ] Update Progress: 181/2372 symbols completed. AVA took 37.7s. Estimated remaining: 4h 42m 32s. Rate: 7.8 symbols/min [2025-09-19T17:23:24.839728] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:24.875605] [DEBUG] [LOCAL ] AVK: Loaded 18339 existing records from primary storage. [2025-09-19T17:23:24.875976] [INFO ] [MAIN ] AVK: Loaded 18339 existing records. [2025-09-19T17:23:24.955857] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:24.983876] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-19T17:23:25.074276] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:25.074697] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-19T17:23:25.074757] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-19T17:23:25.076075] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-19T17:23:25.076137] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-19T17:23:25.449495] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-19T17:23:25.455842] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:25.799175] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T17:23:26.243247] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-19T17:23:26.827576] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T17:23:27.043263] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-19T17:23:27.581486] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:23:27.843283] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-19T17:23:28.073351] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:28.073725] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-19T17:23:28.643292] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-19T17:23:28.808628] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T17:23:29.443262] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-19T17:23:29.857193] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T17:23:30.243262] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-19T17:23:31.043276] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-19T17:23:31.297160] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:23:31.297802] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-19T17:23:31.300182] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T17:23:31.786853] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:23:31.843261] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-19T17:23:32.643281] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-19T17:23:33.203443] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:23:33.443248] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-19T17:23:33.949014] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:23:34.243271] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-19T17:23:34.710258] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T17:23:35.043278] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-19T17:23:35.493352] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T17:23:35.497344] [INFO ] [REMOTE ] AVBC: Full fetch complete (4364 records). [2025-09-19T17:23:35.497475] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-19T17:23:35.679787] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 35 unique days, need 200 days [2025-09-19T17:23:35.679994] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:23:35.680040] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:23:35.680124] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-19T17:23:35.680204] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-19T17:23:35.680253] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-19T17:23:35.680335] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-19T17:23:35.680415] [INFO ] [MAIN ] Update Progress: 182/2372 symbols completed. AVBC took 24.5s. Estimated remaining: 4h 43m 4s. Rate: 7.7 symbols/min [2025-09-19T17:23:35.861992] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:35.858147] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-19T17:23:35.911594] [DEBUG] [LOCAL ] AVNS: Loaded 33953 existing records from primary storage. [2025-09-19T17:23:35.911792] [INFO ] [MAIN ] AVNS: Loaded 33953 existing records. [2025-09-19T17:23:36.104893] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:36.106074] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-19T17:23:36.106132] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-19T17:23:36.108822] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-19T17:23:36.108885] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-19T17:23:36.471820] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:36.643261] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-19T17:23:36.937760] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T17:23:37.076936] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T17:23:37.443286] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-19T17:23:37.873218] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T17:23:38.243317] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-19T17:23:39.043287] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-19T17:23:39.274324] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T17:23:39.517052] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T17:23:39.843321] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-19T17:23:39.875556] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T17:23:40.643311] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-19T17:23:41.146691] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:23:41.443275] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-19T17:23:42.138056] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T17:23:42.243334] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-19T17:23:42.857149] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T17:23:42.882267] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T17:23:43.043293] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-19T17:23:43.843302] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-19T17:23:43.960324] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T17:23:44.643267] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-19T17:23:45.383536] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:23:45.400190] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T17:23:45.403689] [INFO ] [REMOTE ] AVD: Full fetch complete (33994 records). [2025-09-19T17:23:45.403808] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-19T17:23:45.448542] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-19T17:23:45.787320] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-19T17:23:45.787414] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-19T17:23:45.787911] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-19T17:23:45.787973] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-19T17:23:45.788833] [DEBUG] [LOCAL ] AVD: Trimmed 33994 records to 23590 (keeping 200 days of data) [2025-09-19T17:23:45.923204] [DEBUG] [LOCAL ] AVD: Primary data saved (23590 records). [2025-09-19T17:23:45.923347] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-19T17:23:45.923434] [INFO ] [MAIN ] Update Progress: 183/2372 symbols completed. AVD took 29.5s. Estimated remaining: 4h 43m 26s. Rate: 7.7 symbols/min [2025-09-19T17:23:46.092484] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:46.143774] [DEBUG] [LOCAL ] AVNT: Loaded 39891 existing records from primary storage. [2025-09-19T17:23:46.143988] [INFO ] [MAIN ] AVNT: Loaded 39891 existing records. [2025-09-19T17:23:46.247896] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-19T17:23:46.332681] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:46.333006] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-19T17:23:46.333069] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-19T17:23:46.334628] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-19T17:23:46.334731] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-19T17:23:46.696021] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:47.043259] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-19T17:23:47.250270] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T17:23:47.555378] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T17:23:47.561425] [INFO ] [REMOTE ] AVB: Full fetch complete (57645 records). [2025-09-19T17:23:47.561520] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-19T17:23:47.562135] [FATAL] [VALIDATOR ] AVB: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:23:47.562257] [FATAL] [MAIN ] AVB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:23:47.562315] [WARN ] [MAIN ] AVB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:23:47.562367] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-19T17:23:47.562459] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-09-19T17:23:47.562516] [INFO ] [LOCAL ] AVB: Starting deletion of derivative data. [2025-09-19T17:23:47.563013] [DEBUG] [LOCAL ] AVB: Deleted derivative data file. [2025-09-19T17:23:47.563140] [INFO ] [MAIN ] Update Progress: 184/2372 symbols completed. AVB took 40.9s. Estimated remaining: 4h 42m 5s. Rate: 7.8 symbols/min [2025-09-19T17:23:47.737441] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:47.805106] [DEBUG] [LOCAL ] AVTR: Loaded 53961 existing records from primary storage. [2025-09-19T17:23:47.805271] [INFO ] [MAIN ] AVTR: Loaded 53961 existing records. [2025-09-19T17:23:47.848462] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-19T17:23:47.994678] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:47.995012] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-19T17:23:47.995066] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-19T17:23:47.998930] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-19T17:23:47.998992] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-19T17:23:48.350729] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:48.643361] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-19T17:23:48.786571] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T17:23:49.443220] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-19T17:23:49.467577] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T17:23:49.600231] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:23:50.243279] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-19T17:23:50.754212] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T17:23:51.043357] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-19T17:23:51.771114] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T17:23:51.843332] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-19T17:23:52.173573] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T17:23:52.643267] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-19T17:23:53.035019] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:23:53.038292] [INFO ] [REMOTE ] AVK: Full fetch complete (26638 records). [2025-09-19T17:23:53.038382] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-19T17:23:53.430268] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-19T17:23:53.430347] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-19T17:23:53.430724] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-19T17:23:53.430803] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-19T17:23:53.431507] [DEBUG] [LOCAL ] AVK: Trimmed 26638 records to 18451 (keeping 200 days of data) [2025-09-19T17:23:53.479878] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-19T17:23:53.549015] [DEBUG] [LOCAL ] AVK: Primary data saved (18451 records). [2025-09-19T17:23:53.549166] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-19T17:23:53.549255] [INFO ] [MAIN ] Update Progress: 185/2372 symbols completed. AVK took 28.9s. Estimated remaining: 4h 41m 37s. Rate: 7.8 symbols/min [2025-09-19T17:23:53.728782] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:23:53.783428] [DEBUG] [LOCAL ] AVY: Loaded 38091 existing records from primary storage. [2025-09-19T17:23:53.783564] [INFO ] [MAIN ] AVY: Loaded 38091 existing records. [2025-09-19T17:23:53.971504] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:23:53.971845] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-19T17:23:53.971916] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-19T17:23:53.973788] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-19T17:23:53.973852] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-19T17:23:54.250528] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-19T17:23:54.354040] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:23:54.704196] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:23:54.809194] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T17:23:55.043262] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-19T17:23:55.843240] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-19T17:23:55.865387] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T17:23:56.643266] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-19T17:23:57.198474] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-19T17:23:57.443263] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-19T17:23:57.495611] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T17:23:57.686096] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T17:23:58.243274] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-19T17:23:59.043304] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-19T17:23:59.351433] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:23:59.843305] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-19T17:23:59.876553] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T17:24:00.643263] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-19T17:24:00.889784] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:24:01.443338] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-19T17:24:01.882443] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:24:02.243287] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-19T17:24:03.043342] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-19T17:24:04.117097] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (3.47 seconds). [2025-09-19T17:24:04.126401] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-19T17:24:04.913867] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-09-19T17:24:04.926342] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-19T17:24:05.006869] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:24:05.443276] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-19T17:24:05.626769] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (3.38 seconds). [2025-09-19T17:24:06.168036] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T17:24:06.243226] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-19T17:24:06.296225] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T17:24:06.533999] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T17:24:06.539561] [INFO ] [REMOTE ] AVNS: Full fetch complete (47724 records). [2025-09-19T17:24:06.539739] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-19T17:24:06.946945] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-19T17:24:06.947056] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-19T17:24:06.947619] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-19T17:24:06.947697] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-19T17:24:06.949236] [DEBUG] [LOCAL ] AVNS: Trimmed 47724 records to 34169 (keeping 200 days of data) [2025-09-19T17:24:07.043883] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-19T17:24:07.175387] [DEBUG] [LOCAL ] AVNS: Primary data saved (34169 records). [2025-09-19T17:24:07.175579] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-19T17:24:07.175709] [INFO ] [MAIN ] Update Progress: 186/2372 symbols completed. AVNS took 31.5s. Estimated remaining: 4h 42m 38s. Rate: 7.7 symbols/min [2025-09-19T17:24:07.355010] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:07.355279] [DEBUG] [LOCAL ] AWF: No existing data file found in primary storage. [2025-09-19T17:24:07.355336] [WARN ] [MAIN ] AWF: No existing data found, performing full refresh instead. [2025-09-19T17:24:07.355499] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-19T17:24:07.355542] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-19T17:24:07.355582] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-09-19T17:24:07.355614] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-19T17:24:07.723454] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:07.843354] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-19T17:24:08.113601] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T17:24:08.439447] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T17:24:08.643313] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-19T17:24:09.449033] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-19T17:24:09.466982] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T17:24:10.243328] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-19T17:24:10.498120] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T17:24:11.043286] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-19T17:24:11.446959] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:24:11.843302] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-19T17:24:12.089590] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T17:24:12.643313] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-19T17:24:13.198944] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T17:24:13.443269] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-19T17:24:14.243342] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-19T17:24:14.451679] [DEBUG] [REMOTE ] AVNT: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-19T17:24:14.452099] [WARN ] [REMOTE ] AVNT: No data returned for month 2025-08 [2025-09-19T17:24:14.748958] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-19T17:24:15.043305] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-19T17:24:15.684710] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-09-19T17:24:15.843245] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-19T17:24:16.409118] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T17:24:16.643300] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-19T17:24:16.799861] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-19T17:24:17.443279] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-19T17:24:17.574665] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T17:24:17.580070] [INFO ] [REMOTE ] AVNT: Full fetch complete (49986 records). [2025-09-19T17:24:17.580200] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-19T17:24:17.769587] [WARN ] [VALIDATOR ] AVNT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-19T17:24:17.770249] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:24:17.770325] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:24:17.770412] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-19T17:24:17.770508] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-19T17:24:17.770555] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-09-19T17:24:17.770944] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-09-19T17:24:17.771062] [INFO ] [MAIN ] Update Progress: 187/2372 symbols completed. AVNT took 31.8s. Estimated remaining: 4h 43m 4s. Rate: 7.7 symbols/min [2025-09-19T17:24:17.947570] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:17.976704] [DEBUG] [LOCAL ] AWI: Loaded 26410 existing records from primary storage. [2025-09-19T17:24:17.976842] [INFO ] [MAIN ] AWI: Loaded 26410 existing records. [2025-09-19T17:24:18.155532] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:18.155832] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-19T17:24:18.155884] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-19T17:24:18.157381] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-19T17:24:18.157443] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-19T17:24:18.253008] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-19T17:24:18.477004] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T17:24:18.565580] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:19.043298] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-19T17:24:19.509805] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T17:24:19.553871] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:24:19.561892] [INFO ] [REMOTE ] AVTR: Full fetch complete (77440 records). [2025-09-19T17:24:19.562036] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-19T17:24:19.848333] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-19T17:24:19.970997] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-19T17:24:19.971091] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-19T17:24:19.971862] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-19T17:24:19.971928] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-19T17:24:19.973480] [DEBUG] [LOCAL ] AVTR: Trimmed 77440 records to 54351 (keeping 200 days of data) [2025-09-19T17:24:20.090000] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T17:24:20.335814] [DEBUG] [LOCAL ] AVTR: Primary data saved (54351 records). [2025-09-19T17:24:20.336011] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-19T17:24:20.336139] [INFO ] [MAIN ] Update Progress: 188/2372 symbols completed. AVTR took 32.8s. Estimated remaining: 4h 41m 55s. Rate: 7.7 symbols/min [2025-09-19T17:24:20.512109] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:20.565760] [DEBUG] [LOCAL ] AWK: Loaded 49258 existing records from primary storage. [2025-09-19T17:24:20.565910] [INFO ] [MAIN ] AWK: Loaded 49258 existing records. [2025-09-19T17:24:20.648534] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-19T17:24:20.744874] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:20.745155] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-19T17:24:20.745208] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-19T17:24:20.747973] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-19T17:24:20.748034] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-19T17:24:21.131361] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:21.132995] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T17:24:21.443265] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-19T17:24:21.632620] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T17:24:22.243262] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-19T17:24:22.743970] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T17:24:23.043286] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-19T17:24:23.843277] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-19T17:24:24.580442] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T17:24:24.643278] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-19T17:24:24.676371] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-19T17:24:24.990263] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T17:24:25.443269] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-19T17:24:26.243272] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-19T17:24:26.282068] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T17:24:27.043346] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-19T17:24:27.694190] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-19T17:24:27.738867] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T17:24:27.843311] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-19T17:24:28.598559] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:24:28.643277] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-19T17:24:29.443269] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-19T17:24:29.629063] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T17:24:29.972535] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T17:24:30.243226] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-19T17:24:30.378437] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T17:24:31.043260] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-19T17:24:31.843284] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-19T17:24:31.878586] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-19T17:24:31.913528] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T17:24:32.643314] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-19T17:24:33.248734] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:24:33.443224] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-19T17:24:34.243275] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-19T17:24:34.505430] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T17:24:34.905836] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T17:24:35.043276] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-19T17:24:35.800026] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:24:35.843248] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-19T17:24:36.605182] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T17:24:36.643211] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-19T17:24:37.299015] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T17:24:37.443345] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-19T17:24:37.656700] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T17:24:37.661141] [INFO ] [REMOTE ] AWI: Full fetch complete (35421 records). [2025-09-19T17:24:37.661353] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-19T17:24:38.052144] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-19T17:24:38.052241] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-19T17:24:38.052718] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-19T17:24:38.052780] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-19T17:24:38.053684] [DEBUG] [LOCAL ] AWI: Trimmed 35421 records to 26546 (keeping 200 days of data) [2025-09-19T17:24:38.218139] [DEBUG] [LOCAL ] AWI: Primary data saved (26546 records). [2025-09-19T17:24:38.218283] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-19T17:24:38.218380] [INFO ] [MAIN ] Update Progress: 189/2372 symbols completed. AWI took 20.4s. Estimated remaining: 4h 43m 45s. Rate: 7.7 symbols/min [2025-09-19T17:24:38.249520] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-19T17:24:38.400207] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:38.423110] [DEBUG] [LOCAL ] AWP: Loaded 22372 existing records from primary storage. [2025-09-19T17:24:38.423303] [INFO ] [MAIN ] AWP: Loaded 22372 existing records. [2025-09-19T17:24:38.626023] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:38.626341] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-19T17:24:38.626398] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-19T17:24:38.627141] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-19T17:24:38.627201] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-19T17:24:39.018437] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:39.043361] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-19T17:24:39.043234] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:24:39.575328] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T17:24:39.583386] [INFO ] [REMOTE ] AVY: Full fetch complete (56007 records). [2025-09-19T17:24:39.583570] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-19T17:24:39.855734] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-19T17:24:40.011135] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-19T17:24:40.011225] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-19T17:24:40.011991] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-19T17:24:40.012058] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-19T17:24:40.013351] [DEBUG] [LOCAL ] AVY: Trimmed 56007 records to 38393 (keeping 200 days of data) [2025-09-19T17:24:40.270938] [DEBUG] [LOCAL ] AVY: Primary data saved (38393 records). [2025-09-19T17:24:40.271087] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-19T17:24:40.271191] [INFO ] [MAIN ] Update Progress: 190/2372 symbols completed. AVY took 46.7s. Estimated remaining: 4h 42m 31s. Rate: 7.7 symbols/min [2025-09-19T17:24:40.509120] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:40.524783] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T17:24:40.549701] [DEBUG] [LOCAL ] AWR: Loaded 22621 existing records from primary storage. [2025-09-19T17:24:40.549836] [INFO ] [MAIN ] AWR: Loaded 22621 existing records. [2025-09-19T17:24:40.648903] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-19T17:24:40.736793] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:40.737075] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-19T17:24:40.737132] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-19T17:24:40.737816] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-19T17:24:40.737878] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-19T17:24:41.030390] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T17:24:41.066314] [INFO ] [REMOTE ] AWF: Full fetch complete (36025 records). [2025-09-19T17:24:41.082099] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-19T17:24:41.222770] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:41.448426] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-19T17:24:41.540215] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-19T17:24:41.540318] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-19T17:24:41.540915] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-19T17:24:41.540981] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-19T17:24:41.542108] [DEBUG] [LOCAL ] AWF: Trimmed 36025 records to 24565 (keeping 200 days of data) [2025-09-19T17:24:41.697089] [DEBUG] [LOCAL ] AWF: Primary data saved (24565 records). [2025-09-19T17:24:41.697232] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-19T17:24:41.697308] [INFO ] [MAIN ] Update Progress: 191/2372 symbols completed. AWF took 34.5s. Estimated remaining: 4h 41m 11s. Rate: 7.8 symbols/min [2025-09-19T17:24:41.874549] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:41.903679] [DEBUG] [LOCAL ] AX: Loaded 29039 existing records from primary storage. [2025-09-19T17:24:41.903824] [INFO ] [MAIN ] AX: Loaded 29039 existing records. [2025-09-19T17:24:42.092072] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:42.092676] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-19T17:24:42.092787] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-19T17:24:42.098771] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-19T17:24:42.101984] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-19T17:24:42.176284] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T17:24:42.248330] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-19T17:24:42.501908] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:42.855467] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:24:43.043256] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-19T17:24:43.628627] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T17:24:43.843261] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-19T17:24:44.521318] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T17:24:44.643302] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-19T17:24:45.124804] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:24:45.443316] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-19T17:24:46.084251] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:24:46.243353] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-19T17:24:47.043277] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-19T17:24:47.115909] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T17:24:47.806684] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:24:47.843233] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-19T17:24:48.650558] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-19T17:24:48.656326] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T17:24:48.671862] [INFO ] [REMOTE ] AWK: Full fetch complete (70531 records). [2025-09-19T17:24:48.672032] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-19T17:24:49.081125] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-19T17:24:49.081229] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-19T17:24:49.082039] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-19T17:24:49.082121] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-19T17:24:49.083806] [DEBUG] [LOCAL ] AWK: Trimmed 70531 records to 49612 (keeping 200 days of data) [2025-09-19T17:24:49.396430] [DEBUG] [LOCAL ] AWK: Primary data saved (49612 records). [2025-09-19T17:24:49.396579] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-19T17:24:49.396696] [INFO ] [MAIN ] Update Progress: 192/2372 symbols completed. AWK took 29.1s. Estimated remaining: 4h 41m 3s. Rate: 7.8 symbols/min [2025-09-19T17:24:49.453484] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-19T17:24:49.569016] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T17:24:49.617521] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:24:49.668617] [DEBUG] [LOCAL ] AXL: Loaded 50932 existing records from primary storage. [2025-09-19T17:24:49.668789] [INFO ] [MAIN ] AXL: Loaded 50932 existing records. [2025-09-19T17:24:49.853810] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:24:49.854125] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-19T17:24:49.854183] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-19T17:24:49.855255] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-19T17:24:49.855319] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-19T17:24:50.217237] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:24:50.230798] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T17:24:50.243213] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-19T17:24:50.357698] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T17:24:51.043280] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-19T17:24:51.137113] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T17:24:51.843262] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-19T17:24:52.643308] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-19T17:24:52.989802] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T17:24:53.036802] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T17:24:53.443274] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-19T17:24:54.234318] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T17:24:54.243236] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-19T17:24:54.762353] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T17:24:55.043273] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-19T17:24:55.843285] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-19T17:24:56.137968] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T17:24:56.175940] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T17:24:56.643260] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-19T17:24:57.130606] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T17:24:57.443314] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-19T17:24:58.007261] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T17:24:58.240930] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-19T17:24:58.246551] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-19T17:24:59.043300] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-19T17:24:59.843318] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-19T17:25:00.150478] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T17:25:00.643276] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-19T17:25:00.918822] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T17:25:01.059609] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:25:01.443277] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-19T17:25:02.214073] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T17:25:02.243309] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-19T17:25:03.041674] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T17:25:03.051984] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-19T17:25:03.484884] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:25:03.843431] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-19T17:25:04.040796] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T17:25:04.044619] [INFO ] [REMOTE ] AWP: Full fetch complete (32575 records). [2025-09-19T17:25:04.044827] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-19T17:25:04.482246] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-19T17:25:04.482354] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-19T17:25:04.482858] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-19T17:25:04.482923] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-19T17:25:04.483992] [DEBUG] [LOCAL ] AWP: Trimmed 32575 records to 22526 (keeping 200 days of data) [2025-09-19T17:25:04.618616] [DEBUG] [LOCAL ] AWP: Primary data saved (22526 records). [2025-09-19T17:25:04.618774] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-19T17:25:04.618863] [INFO ] [MAIN ] Update Progress: 193/2372 symbols completed. AWP took 26.4s. Estimated remaining: 4h 42m 19s. Rate: 7.7 symbols/min [2025-09-19T17:25:04.650514] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-19T17:25:04.796893] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:04.856484] [DEBUG] [LOCAL ] AXP: Loaded 53656 existing records from primary storage. [2025-09-19T17:25:04.856659] [INFO ] [MAIN ] AXP: Loaded 53656 existing records. [2025-09-19T17:25:05.041905] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:05.042243] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-19T17:25:05.042300] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-19T17:25:05.045509] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-19T17:25:05.045574] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-19T17:25:05.407029] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:05.426091] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:25:05.443220] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-19T17:25:06.086573] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T17:25:06.243258] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-19T17:25:07.043268] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-19T17:25:07.623265] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T17:25:07.737732] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T17:25:07.843276] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-19T17:25:08.481058] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T17:25:08.643265] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-19T17:25:09.331509] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T17:25:09.443264] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-19T17:25:10.202978] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:25:10.243220] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-19T17:25:10.801353] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:25:11.043316] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-19T17:25:11.843313] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-19T17:25:12.121203] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T17:25:12.467369] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T17:25:12.643324] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-19T17:25:13.443372] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-19T17:25:14.087300] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:25:14.092108] [INFO ] [REMOTE ] AX: Full fetch complete (42785 records). [2025-09-19T17:25:14.092258] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-19T17:25:14.250076] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-19T17:25:14.530752] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-19T17:25:14.530998] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-19T17:25:14.533162] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T17:25:14.532004] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-19T17:25:14.543365] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-19T17:25:14.544888] [DEBUG] [LOCAL ] AX: Trimmed 42785 records to 29273 (keeping 200 days of data) [2025-09-19T17:25:14.715068] [DEBUG] [LOCAL ] AX: Primary data saved (29273 records). [2025-09-19T17:25:14.715206] [INFO ] [MAIN ] AX: Full history saved. [2025-09-19T17:25:14.715290] [INFO ] [MAIN ] Update Progress: 194/2372 symbols completed. AX took 33.0s. Estimated remaining: 4h 42m 38s. Rate: 7.7 symbols/min [2025-09-19T17:25:14.904991] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:14.910417] [DEBUG] [LOCAL ] AXR: Loaded 3173 existing records from primary storage. [2025-09-19T17:25:14.910522] [INFO ] [MAIN ] AXR: Loaded 3173 existing records. [2025-09-19T17:25:15.052050] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-19T17:25:15.095626] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:15.097552] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-19T17:25:15.109804] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-19T17:25:15.110873] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-19T17:25:15.111370] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T17:25:15.111470] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-19T17:25:15.137452] [INFO ] [REMOTE ] AWR: Full fetch complete (31620 records). [2025-09-19T17:25:15.161704] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-19T17:25:15.942377] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:15.942831] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-19T17:25:15.943862] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-19T17:25:15.943960] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-19T17:25:15.944469] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-19T17:25:15.944511] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-19T17:25:15.945537] [DEBUG] [LOCAL ] AWR: Trimmed 31620 records to 22805 (keeping 200 days of data) [2025-09-19T17:25:16.087663] [DEBUG] [LOCAL ] AWR: Primary data saved (22805 records). [2025-09-19T17:25:16.087818] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-19T17:25:16.087927] [INFO ] [MAIN ] Update Progress: 195/2372 symbols completed. AWR took 35.8s. Estimated remaining: 4h 41m 18s. Rate: 7.7 symbols/min [2025-09-19T17:25:16.295846] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:16.297978] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T17:25:16.349800] [DEBUG] [LOCAL ] AXS: Loaded 38587 existing records from primary storage. [2025-09-19T17:25:16.349955] [INFO ] [MAIN ] AXS: Loaded 38587 existing records. [2025-09-19T17:25:16.530979] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:16.531209] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-19T17:25:16.531257] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-19T17:25:16.532207] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-19T17:25:16.532269] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-19T17:25:16.648391] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-19T17:25:16.895162] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:16.900235] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T17:25:17.266539] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-19T17:25:17.443268] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-19T17:25:18.149338] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:25:18.243229] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-19T17:25:18.403481] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T17:25:19.043270] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-19T17:25:19.843273] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-19T17:25:20.643261] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-19T17:25:20.679184] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T17:25:20.727875] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-19T17:25:20.817870] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T17:25:20.825609] [INFO ] [REMOTE ] AXL: Full fetch complete (72362 records). [2025-09-19T17:25:20.825801] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-19T17:25:21.252127] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-19T17:25:21.252266] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-19T17:25:21.253180] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-19T17:25:21.253259] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-19T17:25:21.255282] [DEBUG] [LOCAL ] AXL: Trimmed 72362 records to 51287 (keeping 200 days of data) [2025-09-19T17:25:21.453968] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-19T17:25:21.556617] [DEBUG] [LOCAL ] AXL: Primary data saved (51287 records). [2025-09-19T17:25:21.556794] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-19T17:25:21.556938] [INFO ] [MAIN ] Update Progress: 196/2372 symbols completed. AXL took 32.2s. Estimated remaining: 4h 40m 45s. Rate: 7.8 symbols/min [2025-09-19T17:25:21.738035] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:21.792505] [DEBUG] [LOCAL ] AXTA: Loaded 52428 existing records from primary storage. [2025-09-19T17:25:21.792752] [INFO ] [MAIN ] AXTA: Loaded 52428 existing records. [2025-09-19T17:25:21.987162] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:21.987499] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-19T17:25:21.987560] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-19T17:25:21.988631] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-19T17:25:21.988738] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-19T17:25:22.244377] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-19T17:25:22.272518] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T17:25:22.353196] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:22.580328] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T17:25:23.043299] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-19T17:25:23.843307] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-19T17:25:24.592731] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T17:25:24.643274] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-19T17:25:24.741968] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T17:25:24.836860] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-19T17:25:25.321238] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T17:25:25.443286] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-19T17:25:26.243262] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-19T17:25:27.043265] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-19T17:25:27.843271] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-19T17:25:27.902452] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-19T17:25:27.946872] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T17:25:28.121287] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T17:25:28.643270] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-19T17:25:28.712463] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-19T17:25:29.443298] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-19T17:25:30.243285] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-19T17:25:30.814107] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T17:25:30.979576] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:25:31.043218] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-19T17:25:31.139740] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-19T17:25:31.612560] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T17:25:31.843280] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-19T17:25:32.643312] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-19T17:25:33.354804] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T17:25:33.356144] [INFO ] [REMOTE ] AXR: Full fetch complete (5013 records). [2025-09-19T17:25:33.356235] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-19T17:25:33.450525] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-19T17:25:33.734218] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-19T17:25:33.734320] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-19T17:25:33.734511] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-19T17:25:33.734563] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-19T17:25:33.734972] [DEBUG] [LOCAL ] AXR: Trimmed 5013 records to 3219 (keeping 200 days of data) [2025-09-19T17:25:33.753940] [DEBUG] [LOCAL ] AXR: Primary data saved (3219 records). [2025-09-19T17:25:33.754011] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-19T17:25:33.754102] [INFO ] [MAIN ] Update Progress: 197/2372 symbols completed. AXR took 19.0s. Estimated remaining: 4h 41m 27s. Rate: 7.7 symbols/min [2025-09-19T17:25:34.244036] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-19T17:25:34.247018] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T17:25:35.043280] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-19T17:25:35.320034] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T17:25:35.843299] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-19T17:25:36.091769] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T17:25:36.643281] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-19T17:25:36.792102] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T17:25:37.443319] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-19T17:25:37.604268] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:25:38.243274] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-19T17:25:38.831013] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T17:25:39.043299] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-19T17:25:39.454622] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T17:25:39.843246] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-19T17:25:39.917185] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-19T17:25:39.930560] [INFO ] [REMOTE ] AXP: Full fetch complete (76928 records). [2025-09-19T17:25:39.930785] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-19T17:25:40.330275] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-19T17:25:40.330360] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-19T17:25:40.331147] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-19T17:25:40.331229] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-19T17:25:40.332809] [DEBUG] [LOCAL ] AXP: Trimmed 76928 records to 54046 (keeping 200 days of data) [2025-09-19T17:25:40.707527] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:25:40.722379] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-19T17:25:40.732389] [DEBUG] [LOCAL ] AXP: Primary data saved (54046 records). [2025-09-19T17:25:40.732543] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-19T17:25:40.732688] [INFO ] [MAIN ] Update Progress: 198/2372 symbols completed. AXP took 36.1s. Estimated remaining: 4h 41m 10s. Rate: 7.7 symbols/min [2025-09-19T17:25:41.614384] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T17:25:41.623780] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-19T17:25:42.120183] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T17:25:42.243337] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-19T17:25:43.497507] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T17:25:43.507336] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-19T17:25:44.123473] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T17:25:44.134384] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-19T17:25:45.205443] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T17:25:45.217061] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-19T17:25:45.554440] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T17:25:45.567529] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-19T17:25:46.814737] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T17:25:46.820632] [INFO ] [REMOTE ] AXS: Full fetch complete (55309 records). [2025-09-19T17:25:46.820808] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-19T17:25:47.209713] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-19T17:25:47.209806] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-19T17:25:47.210393] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-19T17:25:47.210436] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-19T17:25:47.211714] [DEBUG] [LOCAL ] AXS: Trimmed 55309 records to 38897 (keeping 200 days of data) [2025-09-19T17:25:47.476523] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T17:25:47.492530] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-19T17:25:47.511388] [DEBUG] [LOCAL ] AXS: Primary data saved (38897 records). [2025-09-19T17:25:47.511556] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-19T17:25:47.511695] [INFO ] [MAIN ] Update Progress: 199/2372 symbols completed. AXS took 31.4s. Estimated remaining: 4h 40m 52s. Rate: 7.7 symbols/min [2025-09-19T17:25:49.441998] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T17:25:49.450213] [INFO ] [REMOTE ] AXTA: Full fetch complete (74701 records). [2025-09-19T17:25:49.450367] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-19T17:25:49.867288] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-19T17:25:49.867431] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-19T17:25:49.868239] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-19T17:25:49.868303] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-19T17:25:49.869832] [DEBUG] [LOCAL ] AXTA: Trimmed 74701 records to 52811 (keeping 200 days of data) [2025-09-19T17:25:50.186612] [DEBUG] [LOCAL ] AXTA: Primary data saved (52811 records). [2025-09-19T17:25:50.186785] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-19T17:25:50.186878] [INFO ] [MAIN ] Update Progress: 200/2372 symbols completed. AXTA took 28.6s. Estimated remaining: 4h 39m 49s. Rate: 7.8 symbols/min [2025-09-19T17:25:50.783546] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:50.885126] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:50.903286] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-19T17:25:50.925077] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:50.928980] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:25:50.929339] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-19T17:25:50.931962] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-19T17:25:50.932034] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-19T17:25:50.932082] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-19T17:25:50.932127] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-19T17:25:51.080572] [DEBUG] [LOCAL ] AZO: Loaded 11696 existing records from primary storage. [2025-09-19T17:25:51.099263] [INFO ] [MAIN ] AZO: Loaded 11696 existing records. [2025-09-19T17:25:51.180383] [DEBUG] [LOCAL ] AZZ: Loaded 22399 existing records from primary storage. [2025-09-19T17:25:51.263976] [INFO ] [MAIN ] AZZ: Loaded 22399 existing records. [2025-09-19T17:25:51.320484] [DEBUG] [LOCAL ] AYI: Loaded 25741 existing records from primary storage. [2025-09-19T17:25:51.369621] [INFO ] [MAIN ] AYI: Loaded 25741 existing records. [2025-09-19T17:25:51.649179] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:51.727621] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-19T17:25:51.747665] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-19T17:25:51.804490] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-19T17:25:51.812893] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:51.804666] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-19T17:25:51.852610] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-19T17:25:51.969472] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:52.064509] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-19T17:25:52.090190] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-19T17:25:52.103599] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:25:52.108835] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-19T17:25:52.128866] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-19T17:25:52.114222] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-19T17:25:52.134147] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-19T17:25:52.161274] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-19T17:25:52.222676] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-19T17:25:52.810934] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:52.864862] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-19T17:25:53.116212] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:53.116859] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-19T17:25:53.138312] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:25:53.138747] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-19T17:25:53.708760] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T17:25:53.715554] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-19T17:25:54.480881] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T17:25:54.484368] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-19T17:25:54.537241] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:25:54.543534] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-19T17:25:54.659870] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T17:25:54.666149] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-19T17:25:54.686197] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T17:25:54.691559] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-19T17:25:54.922119] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:25:54.922504] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-19T17:25:54.922987] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-19T17:25:55.087925] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T17:25:55.090827] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-19T17:25:55.162179] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:25:55.162524] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-19T17:25:55.301160] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T17:25:55.637870] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T17:25:55.790243] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T17:25:55.843265] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-19T17:25:56.078287] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:25:56.078608] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-19T17:25:56.643326] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-19T17:25:57.443285] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-19T17:25:57.881857] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T17:25:58.122568] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T17:25:58.243254] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-19T17:25:59.043312] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-19T17:25:59.568811] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T17:25:59.843276] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-19T17:26:00.528505] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T17:26:00.643277] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-19T17:26:00.781457] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T17:26:01.443306] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-19T17:26:02.243299] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-19T17:26:02.678756] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T17:26:02.738388] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T17:26:03.043233] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-19T17:26:03.166074] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T17:26:03.843268] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-19T17:26:04.549777] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T17:26:04.643302] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-19T17:26:05.443279] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-19T17:26:05.520508] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-19T17:26:05.966696] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:26:06.183680] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T17:26:06.243240] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-19T17:26:07.043343] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-19T17:26:07.704711] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T17:26:07.843281] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-19T17:26:08.254766] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T17:26:08.643265] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-19T17:26:09.443246] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-19T17:26:09.638451] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T17:26:10.248365] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-19T17:26:10.258597] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T17:26:10.861465] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T17:26:11.043255] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-19T17:26:11.453571] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:26:11.843263] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-19T17:26:12.643299] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-19T17:26:12.720438] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T17:26:12.723166] [INFO ] [REMOTE ] AZO: Full fetch complete (16398 records). [2025-09-19T17:26:12.723331] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-19T17:26:13.168101] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-19T17:26:13.168363] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-19T17:26:13.169007] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-19T17:26:13.169174] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-19T17:26:13.170819] [DEBUG] [LOCAL ] AZO: Trimmed 16398 records to 11785 (keeping 200 days of data) [2025-09-19T17:26:13.188451] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:26:13.279076] [DEBUG] [LOCAL ] AZO: Primary data saved (11785 records). [2025-09-19T17:26:13.279329] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-19T17:26:13.279451] [INFO ] [MAIN ] Update Progress: 201/2372 symbols completed. AZO took 23.1s. Estimated remaining: 4h 42m 27s. Rate: 7.7 symbols/min [2025-09-19T17:26:13.453372] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-19T17:26:13.486433] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:13.573531] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T17:26:13.581135] [DEBUG] [LOCAL ] BA: Loaded 54181 existing records from primary storage. [2025-09-19T17:26:13.581384] [INFO ] [MAIN ] BA: Loaded 54181 existing records. [2025-09-19T17:26:13.765507] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:13.765871] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-19T17:26:13.765927] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-19T17:26:13.769936] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-19T17:26:13.770008] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-19T17:26:14.177597] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:14.243296] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-19T17:26:15.043271] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-19T17:26:15.843324] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-19T17:26:16.108330] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T17:26:16.139231] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T17:26:16.349205] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T17:26:16.643260] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-19T17:26:16.761546] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T17:26:16.764965] [INFO ] [REMOTE ] AZZ: Full fetch complete (30866 records). [2025-09-19T17:26:16.765052] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-19T17:26:17.151341] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-19T17:26:17.151429] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-19T17:26:17.151837] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-19T17:26:17.151909] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-19T17:26:17.152742] [DEBUG] [LOCAL ] AZZ: Trimmed 30866 records to 22536 (keeping 200 days of data) [2025-09-19T17:26:17.298454] [DEBUG] [LOCAL ] AZZ: Primary data saved (22536 records). [2025-09-19T17:26:17.298630] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-19T17:26:17.298763] [INFO ] [MAIN ] Update Progress: 202/2372 symbols completed. AZZ took 27.1s. Estimated remaining: 4h 41m 39s. Rate: 7.7 symbols/min [2025-09-19T17:26:17.453159] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-19T17:26:17.479923] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:17.547052] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-09-19T17:26:17.547233] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-09-19T17:26:17.732123] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:17.732569] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-19T17:26:17.732619] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-19T17:26:17.735093] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-19T17:26:17.735156] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-19T17:26:18.121086] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:18.243275] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-19T17:26:18.756887] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:26:18.764954] [INFO ] [REMOTE ] B: Full fetch complete (44641 records). [2025-09-19T17:26:18.765106] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-19T17:26:18.958750] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-19T17:26:18.959430] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:26:18.959516] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:26:18.959620] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-19T17:26:18.959908] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-19T17:26:18.960112] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-19T17:26:18.960258] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-19T17:26:18.960422] [INFO ] [MAIN ] Update Progress: 203/2372 symbols completed. B took 28.8s. Estimated remaining: 4h 40m 25s. Rate: 7.7 symbols/min [2025-09-19T17:26:19.062898] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-19T17:26:19.078268] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T17:26:19.159149] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:19.217912] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-09-19T17:26:19.218118] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-09-19T17:26:19.394079] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:19.394343] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-19T17:26:19.394391] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-19T17:26:19.397284] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-19T17:26:19.397348] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-19T17:26:19.749861] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:19.843232] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-19T17:26:20.643277] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-19T17:26:21.069348] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-19T17:26:21.443279] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-19T17:26:21.911682] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:26:21.963350] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.90 seconds). [2025-09-19T17:26:22.243274] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-19T17:26:22.594591] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-19T17:26:23.043269] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-19T17:26:23.843265] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-19T17:26:24.213189] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-09-19T17:26:24.315412] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T17:26:24.643235] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-19T17:26:24.852969] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T17:26:24.856331] [INFO ] [REMOTE ] AYI: Full fetch complete (36811 records). [2025-09-19T17:26:24.856429] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-19T17:26:25.258427] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-19T17:26:25.258564] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-19T17:26:25.259047] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-19T17:26:25.259125] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-19T17:26:25.260465] [DEBUG] [LOCAL ] AYI: Trimmed 36811 records to 25858 (keeping 200 days of data) [2025-09-19T17:26:25.395662] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T17:26:25.444381] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-19T17:26:25.483836] [DEBUG] [LOCAL ] AYI: Primary data saved (25858 records). [2025-09-19T17:26:25.483959] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-19T17:26:25.484048] [INFO ] [MAIN ] Update Progress: 204/2372 symbols completed. AYI took 35.3s. Estimated remaining: 4h 40m 4s. Rate: 7.7 symbols/min [2025-09-19T17:26:25.665807] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:25.665996] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-09-19T17:26:25.666034] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-09-19T17:26:25.666180] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-19T17:26:25.666223] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-19T17:26:25.666266] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-19T17:26:25.666299] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-19T17:26:26.020001] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:26.243269] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-19T17:26:26.952599] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-19T17:26:27.043303] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-19T17:26:27.843269] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-19T17:26:28.282610] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-19T17:26:28.328307] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T17:26:28.643267] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-19T17:26:29.443260] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-19T17:26:30.117483] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T17:26:30.244358] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-19T17:26:30.247556] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (3.20 seconds). [2025-09-19T17:26:31.043266] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-19T17:26:31.314086] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-19T17:26:31.843236] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-19T17:26:32.164872] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T17:26:32.214619] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-19T17:26:32.643312] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-19T17:26:33.443309] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-19T17:26:34.113529] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-19T17:26:34.243265] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-19T17:26:34.308421] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T17:26:35.043335] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-19T17:26:35.204628] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:26:35.309568] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-19T17:26:35.843266] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-19T17:26:36.643268] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-19T17:26:37.105930] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T17:26:37.360968] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-19T17:26:37.443231] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-19T17:26:38.243302] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-19T17:26:38.812529] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:26:38.864942] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-09-19T17:26:39.043281] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-19T17:26:39.843307] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-19T17:26:39.922097] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-19T17:26:40.643296] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-19T17:26:40.847259] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-19T17:26:40.970436] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T17:26:41.443279] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-19T17:26:42.243289] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-19T17:26:42.635041] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-19T17:26:42.813159] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T17:26:43.043223] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-19T17:26:43.091541] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T17:26:43.843276] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-19T17:26:44.468914] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:26:44.558299] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T17:26:44.643260] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-19T17:26:45.443263] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-19T17:26:46.243284] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-19T17:26:46.752799] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T17:26:46.875791] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-09-19T17:26:47.043244] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-19T17:26:47.243618] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T17:26:47.843296] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-19T17:26:48.643312] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-19T17:26:48.917538] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-19T17:26:49.443282] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-19T17:26:50.057579] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-19T17:26:50.071841] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-19T17:26:50.072157] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-19T17:26:50.676147] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-19T17:26:50.736627] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-19T17:26:50.737015] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-19T17:26:50.737229] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-19T17:26:50.739078] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-19T17:26:50.739371] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-19T17:26:50.739198] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-19T17:26:50.927867] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54600 (keeping 200 days of data) [2025-09-19T17:26:50.936873] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T17:26:51.072544] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-19T17:26:51.449194] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-19T17:26:51.449566] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-19T17:26:51.450848] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-19T17:26:51.451522] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-19T17:26:51.457017] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54588 (keeping 200 days of data) [2025-09-19T17:26:51.876637] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-19T17:26:51.894716] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-19T17:26:51.896587] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-19T17:26:52.479160] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-19T17:26:52.480343] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-19T17:26:52.482637] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-19T17:26:52.483042] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-19T17:26:52.522737] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 54571 (keeping 200 days of data) [2025-09-19T17:26:52.521972] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-09-19T17:26:52.523998] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-19T17:26:52.524949] [INFO ] [MAIN ] Update Progress: 205/2372 symbols completed. BABA took 35.2s. Estimated remaining: 4h 43m 21s. Rate: 7.6 symbols/min [2025-09-19T17:26:52.835384] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:52.856302] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-09-19T17:26:52.857011] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-19T17:26:52.857272] [INFO ] [MAIN ] Update Progress: 206/2372 symbols completed. BAC took 33.9s. Estimated remaining: 4h 41m 54s. Rate: 7.7 symbols/min [2025-09-19T17:26:53.179479] [DEBUG] [LOCAL ] BAK: Loaded 39196 existing records from primary storage. [2025-09-19T17:26:53.180751] [INFO ] [MAIN ] BAK: Loaded 39196 existing records. [2025-09-19T17:26:53.177500] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:53.401398] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:53.415975] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-19T17:26:53.416136] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-19T17:26:53.434759] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-19T17:26:53.436240] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-19T17:26:53.458945] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T17:26:53.519833] [INFO ] [REMOTE ] BAH: Full fetch complete (74827 records). [2025-09-19T17:26:53.567532] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-19T17:26:53.737289] [DEBUG] [LOCAL ] BALL: Loaded 52223 existing records from primary storage. [2025-09-19T17:26:53.766937] [INFO ] [MAIN ] BALL: Loaded 52223 existing records. [2025-09-19T17:26:54.458560] [DEBUG] [LOCAL ] BA: Primary data saved (54571 records). [2025-09-19T17:26:54.387616] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:26:54.454616] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:54.464153] [INFO ] [MAIN ] BA: Full history saved. [2025-09-19T17:26:54.464558] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-19T17:26:54.491284] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-19T17:26:54.475118] [INFO ] [MAIN ] Update Progress: 207/2372 symbols completed. BA took 41.2s. Estimated remaining: 4h 40m 41s. Rate: 7.7 symbols/min [2025-09-19T17:26:54.491597] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-19T17:26:54.534592] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-19T17:26:54.534751] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-19T17:26:54.890282] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-19T17:26:54.942699] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-19T17:26:54.968496] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:54.964818] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-19T17:26:54.968669] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-19T17:26:55.002783] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-19T17:26:55.023409] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-19T17:26:55.023871] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-19T17:26:55.024036] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-19T17:26:55.024243] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-19T17:26:55.024306] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-19T17:26:55.035935] [DEBUG] [LOCAL ] BAH: Trimmed 74827 records to 52533 (keeping 200 days of data) [2025-09-19T17:26:55.439237] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:55.467937] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-19T17:26:55.670665] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:55.671487] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-19T17:26:55.907007] [DEBUG] [LOCAL ] BAH: Primary data saved (52533 records). [2025-09-19T17:26:55.907200] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-19T17:26:55.907318] [INFO ] [MAIN ] Update Progress: 208/2372 symbols completed. BAH took 30.4s. Estimated remaining: 4h 39m 27s. Rate: 7.7 symbols/min [2025-09-19T17:26:56.083191] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:26:56.083421] [DEBUG] [LOCAL ] BAM: No existing data file found in primary storage. [2025-09-19T17:26:56.083465] [WARN ] [MAIN ] BAM: No existing data found, performing full refresh instead. [2025-09-19T17:26:56.083612] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-19T17:26:56.083697] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-19T17:26:56.083764] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-09-19T17:26:56.083799] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-19T17:26:56.450992] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:26:56.451346] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-19T17:26:56.483797] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T17:26:56.494607] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-19T17:26:56.762285] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T17:26:56.767198] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-19T17:26:57.530450] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:26:57.540933] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-19T17:26:57.620392] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T17:26:57.626991] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-19T17:26:58.255414] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:26:58.263597] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-19T17:26:58.410461] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T17:26:58.412839] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-19T17:26:58.439136] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T17:26:59.043271] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-19T17:26:59.450378] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:26:59.486489] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T17:26:59.553684] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T17:26:59.843271] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-19T17:27:00.643272] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-19T17:27:00.853340] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T17:27:00.882564] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T17:27:01.443257] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-19T17:27:02.243270] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-19T17:27:02.279069] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T17:27:03.043267] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-19T17:27:03.843267] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-19T17:27:04.114794] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T17:27:04.361253] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-09-19T17:27:04.643276] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-19T17:27:05.443295] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-19T17:27:05.500046] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:27:05.570058] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-19T17:27:06.243277] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-19T17:27:06.638326] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T17:27:06.704373] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T17:27:07.043324] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-19T17:27:07.786619] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:27:07.843237] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-19T17:27:08.101923] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T17:27:08.250912] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-19T17:27:08.643298] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-19T17:27:09.443275] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-19T17:27:09.881585] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:27:10.243246] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-19T17:27:10.405852] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T17:27:10.407715] [INFO ] [REMOTE ] BALY: Full fetch complete (17573 records). [2025-09-19T17:27:10.407793] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-19T17:27:10.408299] [FATAL] [VALIDATOR ] BALY: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:27:10.408386] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:27:10.408430] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:27:10.408494] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-19T17:27:10.408560] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-19T17:27:10.408601] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-19T17:27:10.408707] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-19T17:27:10.408827] [INFO ] [MAIN ] Update Progress: 209/2372 symbols completed. BALY took 15.9s. Estimated remaining: 4h 40m 30s. Rate: 7.7 symbols/min [2025-09-19T17:27:10.599996] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:10.657454] [DEBUG] [LOCAL ] BANC: Loaded 51659 existing records from primary storage. [2025-09-19T17:27:10.657623] [INFO ] [MAIN ] BANC: Loaded 51659 existing records. [2025-09-19T17:27:10.840617] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:27:10.840929] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-19T17:27:10.840988] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-19T17:27:10.843489] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-19T17:27:10.843554] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-19T17:27:11.048547] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-19T17:27:11.197028] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:11.843334] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-19T17:27:12.033546] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T17:27:12.643278] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-19T17:27:13.443331] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-19T17:27:14.514884] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T17:27:14.531909] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-19T17:27:14.770496] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T17:27:14.813212] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (3.76 seconds). [2025-09-19T17:27:15.043239] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-19T17:27:15.571154] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T17:27:15.843286] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-19T17:27:15.992576] [DEBUG] [REMOTE ] BANC: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T17:27:15.992924] [WARN ] [REMOTE ] BANC: No data returned for month 2025-01 [2025-09-19T17:27:16.461865] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T17:27:16.561766] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:27:16.643274] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-19T17:27:17.443280] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-19T17:27:18.243295] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-19T17:27:18.650931] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:27:19.030962] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T17:27:19.043224] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-19T17:27:19.543975] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T17:27:19.549527] [INFO ] [REMOTE ] BAK: Full fetch complete (56861 records). [2025-09-19T17:27:19.549715] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-19T17:27:19.550521] [FATAL] [VALIDATOR ] BAK: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:27:19.550614] [FATAL] [MAIN ] BAK: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:27:19.550693] [WARN ] [MAIN ] BAK: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:27:19.550748] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-19T17:27:19.550809] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-09-19T17:27:19.550846] [INFO ] [LOCAL ] BAK: Starting deletion of derivative data. [2025-09-19T17:27:19.551306] [DEBUG] [LOCAL ] BAK: Deleted derivative data file. [2025-09-19T17:27:19.551411] [INFO ] [MAIN ] Update Progress: 210/2372 symbols completed. BAK took 27.0s. Estimated remaining: 4h 40m 36s. Rate: 7.7 symbols/min [2025-09-19T17:27:19.725446] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:19.725671] [DEBUG] [LOCAL ] BAP: No existing data file found in primary storage. [2025-09-19T17:27:19.725729] [WARN ] [MAIN ] BAP: No existing data found, performing full refresh instead. [2025-09-19T17:27:19.725871] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-19T17:27:19.725915] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-19T17:27:19.725957] [DEBUG] [LOCAL ] BAP: No primary data file found to delete. [2025-09-19T17:27:19.725989] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-19T17:27:19.848485] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-19T17:27:20.103884] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:20.600327] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T17:27:20.643258] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-19T17:27:21.443277] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-19T17:27:22.100070] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T17:27:22.243265] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-19T17:27:22.547427] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T17:27:22.644106] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:27:23.043294] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-19T17:27:23.789454] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T17:27:23.843264] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-19T17:27:24.643263] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-19T17:27:25.216799] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:27:25.443313] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-19T17:27:25.517865] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T17:27:25.588475] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T17:27:26.243273] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-19T17:27:27.043284] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-19T17:27:27.423181] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T17:27:27.843233] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-19T17:27:28.558124] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T17:27:28.643267] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-19T17:27:29.049900] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T17:27:29.057595] [INFO ] [REMOTE ] BAM: Full fetch complete (73914 records). [2025-09-19T17:27:29.057744] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-19T17:27:29.458543] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-19T17:27:29.454919] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-19T17:27:29.458783] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-19T17:27:29.460621] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-19T17:27:29.460877] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-19T17:27:29.477361] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:27:29.476580] [DEBUG] [LOCAL ] BAM: Trimmed 73914 records to 52787 (keeping 200 days of data) [2025-09-19T17:27:29.807309] [DEBUG] [LOCAL ] BAM: Primary data saved (52787 records). [2025-09-19T17:27:29.807452] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-19T17:27:29.807529] [INFO ] [MAIN ] Update Progress: 211/2372 symbols completed. BAM took 33.9s. Estimated remaining: 4h 40m 53s. Rate: 7.7 symbols/min [2025-09-19T17:27:29.980734] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:30.026023] [DEBUG] [LOCAL ] BARK: Loaded 38908 existing records from primary storage. [2025-09-19T17:27:30.026158] [INFO ] [MAIN ] BARK: Loaded 38908 existing records. [2025-09-19T17:27:30.206922] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:27:30.207324] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-19T17:27:30.207430] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-19T17:27:30.218076] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-19T17:27:30.236011] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-19T17:27:30.248998] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-19T17:27:30.270042] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T17:27:30.642161] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:31.043264] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-19T17:27:31.584372] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T17:27:31.615073] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T17:27:31.843296] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-19T17:27:32.643255] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-19T17:27:33.159040] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T17:27:33.166610] [INFO ] [REMOTE ] BALL: Full fetch complete (75316 records). [2025-09-19T17:27:33.166780] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-19T17:27:33.444351] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-19T17:27:33.574629] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-19T17:27:33.583254] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-19T17:27:33.598639] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-19T17:27:33.598903] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-19T17:27:33.601460] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T17:27:33.611671] [DEBUG] [LOCAL ] BALL: Trimmed 75316 records to 52602 (keeping 200 days of data) [2025-09-19T17:27:33.929879] [DEBUG] [LOCAL ] BALL: Primary data saved (52602 records). [2025-09-19T17:27:33.930005] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-19T17:27:33.930108] [INFO ] [MAIN ] Update Progress: 212/2372 symbols completed. BALL took 41.1s. Estimated remaining: 4h 40m 8s. Rate: 7.7 symbols/min [2025-09-19T17:27:34.097177] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:34.151308] [DEBUG] [LOCAL ] BAX: Loaded 53879 existing records from primary storage. [2025-09-19T17:27:34.151463] [INFO ] [MAIN ] BAX: Loaded 53879 existing records. [2025-09-19T17:27:34.251432] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-19T17:27:34.348016] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:27:34.348350] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-19T17:27:34.348417] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-19T17:27:34.351363] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-19T17:27:34.351451] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-19T17:27:34.738461] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:34.769018] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T17:27:35.003429] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T17:27:35.043218] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-19T17:27:35.843302] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-19T17:27:35.916722] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T17:27:36.007276] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T17:27:36.643310] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-19T17:27:37.443299] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-19T17:27:38.020144] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T17:27:38.082684] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T17:27:38.243291] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-19T17:27:39.043238] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-19T17:27:39.077368] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:27:39.249988] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T17:27:39.843264] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-19T17:27:40.432960] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T17:27:40.643285] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-19T17:27:41.443257] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-19T17:27:42.030991] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T17:27:42.243241] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-19T17:27:42.276546] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T17:27:42.306438] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:27:43.043323] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-19T17:27:43.843352] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-19T17:27:44.133908] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T17:27:44.142430] [INFO ] [REMOTE ] BANC: Full fetch complete (66483 records). [2025-09-19T17:27:44.142689] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-19T17:27:44.368121] [WARN ] [VALIDATOR ] BANC: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T17:27:44.369184] [FATAL] [MAIN ] BANC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:27:44.369496] [WARN ] [MAIN ] BANC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:27:44.369592] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-19T17:27:44.369868] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-09-19T17:27:44.369981] [INFO ] [LOCAL ] BANC: Starting deletion of derivative data. [2025-09-19T17:27:44.375997] [DEBUG] [LOCAL ] BANC: Deleted derivative data file. [2025-09-19T17:27:44.376165] [INFO ] [MAIN ] Update Progress: 213/2372 symbols completed. BANC took 34.0s. Estimated remaining: 4h 40m 27s. Rate: 7.7 symbols/min [2025-09-19T17:27:44.413419] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T17:27:44.463480] [INFO ] [REMOTE ] BAP: Full fetch complete (38228 records). [2025-09-19T17:27:44.484844] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-19T17:27:44.662618] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-19T17:27:44.704877] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:45.034983] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-19T17:27:45.036234] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-19T17:27:45.036845] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-19T17:27:45.036964] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-19T17:27:45.038002] [DEBUG] [LOCAL ] BB: Loaded 53314 existing records from primary storage. [2025-09-19T17:27:45.038493] [INFO ] [MAIN ] BB: Loaded 53314 existing records. [2025-09-19T17:27:45.105379] [DEBUG] [LOCAL ] BAP: Trimmed 38228 records to 26919 (keeping 200 days of data) [2025-09-19T17:27:45.320464] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:27:45.321841] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-19T17:27:45.322489] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-19T17:27:45.326878] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-19T17:27:45.327197] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-19T17:27:45.717376] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:45.721200] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-19T17:27:45.777184] [DEBUG] [LOCAL ] BAP: Primary data saved (26919 records). [2025-09-19T17:27:45.777353] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-19T17:27:45.777514] [INFO ] [MAIN ] Update Progress: 214/2372 symbols completed. BAP took 26.2s. Estimated remaining: 4h 39m 15s. Rate: 7.7 symbols/min [2025-09-19T17:27:45.910455] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T17:27:45.991406] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:27:45.991603] [DEBUG] [LOCAL ] BBAI: No existing data file found in primary storage. [2025-09-19T17:27:45.991683] [WARN ] [MAIN ] BBAI: No existing data found, performing full refresh instead. [2025-09-19T17:27:45.991837] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-19T17:27:45.991883] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-19T17:27:45.991962] [DEBUG] [LOCAL ] BBAI: No primary data file found to delete. [2025-09-19T17:27:45.992010] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-19T17:27:46.248387] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-19T17:27:46.401714] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:27:46.555636] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T17:27:47.043327] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-19T17:27:47.843308] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-19T17:27:48.069173] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T17:27:48.381047] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T17:27:48.643260] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-19T17:27:49.443277] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-19T17:27:49.543917] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T17:27:49.951495] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-19T17:27:50.243277] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-19T17:27:50.806229] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T17:27:50.998485] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T17:27:51.043304] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-19T17:27:51.843318] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-19T17:27:52.595809] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T17:27:52.643253] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-19T17:27:53.443323] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-19T17:27:53.643771] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-19T17:27:53.952728] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T17:27:54.243278] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-19T17:27:55.043307] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-19T17:27:55.507139] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-09-19T17:27:55.609977] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T17:27:55.843368] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-19T17:27:56.171600] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T17:27:56.643258] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-19T17:27:57.311412] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-19T17:27:57.443284] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-19T17:27:58.243232] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-19T17:27:58.679251] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-19T17:27:58.921363] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T17:27:59.043238] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-19T17:27:59.109856] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:27:59.607509] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:27:59.843279] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-19T17:28:00.643267] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-19T17:28:00.932814] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:28:00.966218] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T17:28:01.443288] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-19T17:28:02.243280] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-19T17:28:03.011893] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T17:28:03.022540] [INFO ] [REMOTE ] BAX: Full fetch complete (77436 records). [2025-09-19T17:28:03.022742] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-19T17:28:03.057661] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-19T17:28:03.447601] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-19T17:28:03.447866] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-19T17:28:03.448746] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-19T17:28:03.448872] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-19T17:28:03.450928] [DEBUG] [LOCAL ] BAX: Trimmed 77436 records to 54268 (keeping 200 days of data) [2025-09-19T17:28:03.714168] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-19T17:28:03.843710] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-19T17:28:03.854071] [DEBUG] [LOCAL ] BAX: Primary data saved (54268 records). [2025-09-19T17:28:03.854529] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-19T17:28:03.854745] [INFO ] [MAIN ] Update Progress: 215/2372 symbols completed. BAX took 29.9s. Estimated remaining: 4h 40m 51s. Rate: 7.7 symbols/min [2025-09-19T17:28:03.903345] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:28:03.977229] [INFO ] [REMOTE ] BARK: Full fetch complete (57265 records). [2025-09-19T17:28:03.979826] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-19T17:28:04.154234] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:04.484730] [DEBUG] [LOCAL ] BBAR: Loaded 41348 existing records from primary storage. [2025-09-19T17:28:04.505509] [INFO ] [MAIN ] BBAR: Loaded 41348 existing records. [2025-09-19T17:28:04.563248] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-19T17:28:04.586018] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-19T17:28:04.603359] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-19T17:28:04.614080] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-19T17:28:04.676919] [DEBUG] [LOCAL ] BARK: Trimmed 57265 records to 39179 (keeping 200 days of data) [2025-09-19T17:28:04.758115] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:04.767727] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-19T17:28:04.793322] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-19T17:28:04.795413] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-19T17:28:04.796318] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-19T17:28:05.280621] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:05.281511] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-19T17:28:05.310627] [DEBUG] [LOCAL ] BARK: Primary data saved (39179 records). [2025-09-19T17:28:05.310822] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-19T17:28:05.311794] [INFO ] [MAIN ] Update Progress: 216/2372 symbols completed. BARK took 35.5s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-19T17:28:05.491775] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:05.550072] [DEBUG] [LOCAL ] BBD: Loaded 53566 existing records from primary storage. [2025-09-19T17:28:05.550221] [INFO ] [MAIN ] BBD: Loaded 53566 existing records. [2025-09-19T17:28:05.740205] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:05.740581] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-19T17:28:05.740637] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-19T17:28:05.759280] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-19T17:28:05.759574] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-19T17:28:05.866142] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-19T17:28:05.898914] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-19T17:28:06.160172] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:06.243275] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-19T17:28:06.794520] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T17:28:06.837679] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-09-19T17:28:07.043272] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-19T17:28:07.843242] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-19T17:28:08.326290] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-19T17:28:08.447369] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T17:28:08.643263] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-19T17:28:09.361549] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:28:09.443233] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-19T17:28:09.876429] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-09-19T17:28:10.243272] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-19T17:28:10.695635] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T17:28:10.901580] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T17:28:11.043260] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-19T17:28:11.843267] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-19T17:28:12.174319] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T17:28:12.322700] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:28:12.643285] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-19T17:28:13.443280] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-19T17:28:13.582499] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T17:28:14.243270] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-19T17:28:15.043260] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-19T17:28:15.454586] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T17:28:15.758082] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:28:15.767974] [INFO ] [REMOTE ] BB: Full fetch complete (76947 records). [2025-09-19T17:28:15.768215] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-19T17:28:15.848722] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-19T17:28:16.198473] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.56 seconds). [2025-09-19T17:28:16.234375] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-19T17:28:16.234551] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-19T17:28:16.235625] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-19T17:28:16.235878] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-19T17:28:16.237862] [DEBUG] [LOCAL ] BB: Trimmed 76947 records to 53703 (keeping 200 days of data) [2025-09-19T17:28:16.559851] [DEBUG] [LOCAL ] BB: Primary data saved (53703 records). [2025-09-19T17:28:16.560011] [INFO ] [MAIN ] BB: Full history saved. [2025-09-19T17:28:16.560159] [INFO ] [MAIN ] Update Progress: 217/2372 symbols completed. BB took 32.2s. Estimated remaining: 4h 40m 6s. Rate: 7.7 symbols/min [2025-09-19T17:28:16.653833] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-19T17:28:16.744290] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:16.780823] [DEBUG] [LOCAL ] BBDC: Loaded 33755 existing records from primary storage. [2025-09-19T17:28:16.780959] [INFO ] [MAIN ] BBDC: Loaded 33755 existing records. [2025-09-19T17:28:16.997603] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:28:16.995859] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:17.007001] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-19T17:28:17.007086] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-19T17:28:17.008851] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-19T17:28:17.008932] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-19T17:28:17.386964] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:17.419392] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:28:17.443223] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-19T17:28:18.243270] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-19T17:28:19.043239] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-19T17:28:19.504821] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:28:19.768728] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (3.11 seconds). [2025-09-19T17:28:19.843219] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-19T17:28:20.052822] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:28:20.533588] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T17:28:20.643268] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-19T17:28:21.443289] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-19T17:28:21.806771] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T17:28:22.243264] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-19T17:28:22.885862] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:28:23.043279] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-19T17:28:23.120386] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (3.28 seconds). [2025-09-19T17:28:23.131879] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-19T17:28:23.132167] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-19T17:28:23.557715] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-19T17:28:23.557931] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-19T17:28:23.558991] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-19T17:28:23.559082] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-19T17:28:23.561577] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-19T17:28:23.702006] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T17:28:23.844694] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-19T17:28:23.956124] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-09-19T17:28:23.956354] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-19T17:28:23.956459] [INFO ] [MAIN ] Update Progress: 218/2372 symbols completed. BBAI took 38.2s. Estimated remaining: 4h 39m 54s. Rate: 7.7 symbols/min [2025-09-19T17:28:24.139659] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:24.147892] [DEBUG] [LOCAL ] BBDO: Loaded 5090 existing records from primary storage. [2025-09-19T17:28:24.148040] [INFO ] [MAIN ] BBDO: Loaded 5090 existing records. [2025-09-19T17:28:24.350131] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:24.350529] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-19T17:28:24.350584] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-19T17:28:24.351020] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-19T17:28:24.351084] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-19T17:28:24.648860] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-19T17:28:24.747368] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:25.114469] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T17:28:25.443278] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-19T17:28:25.558014] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T17:28:26.243267] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-19T17:28:26.293780] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T17:28:27.043303] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-19T17:28:27.387012] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:28:27.789627] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T17:28:27.797234] [INFO ] [REMOTE ] BBAR: Full fetch complete (60459 records). [2025-09-19T17:28:27.797425] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-19T17:28:27.848466] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-19T17:28:28.205612] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-19T17:28:28.211391] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-19T17:28:28.212797] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-19T17:28:28.213244] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-19T17:28:28.213135] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T17:28:28.217109] [DEBUG] [LOCAL ] BBAR: Trimmed 60459 records to 41690 (keeping 200 days of data) [2025-09-19T17:28:28.479806] [DEBUG] [LOCAL ] BBAR: Primary data saved (41690 records). [2025-09-19T17:28:28.479943] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-19T17:28:28.480028] [INFO ] [MAIN ] Update Progress: 219/2372 symbols completed. BBAR took 24.6s. Estimated remaining: 4h 39m 14s. Rate: 7.7 symbols/min [2025-09-19T17:28:28.652905] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-19T17:28:28.656468] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:28.677699] [DEBUG] [LOCAL ] BBN: Loaded 18195 existing records from primary storage. [2025-09-19T17:28:28.677838] [INFO ] [MAIN ] BBN: Loaded 18195 existing records. [2025-09-19T17:28:28.853639] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:28.853963] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-19T17:28:28.854013] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-19T17:28:28.855462] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-19T17:28:28.855525] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-19T17:28:29.216925] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:29.325706] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T17:28:29.443240] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-19T17:28:30.243324] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-19T17:28:30.293843] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T17:28:30.419879] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-19T17:28:31.043344] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-19T17:28:31.836686] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T17:28:31.843204] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-19T17:28:32.592613] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:28:32.643217] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-19T17:28:33.046778] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T17:28:33.443292] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-19T17:28:34.243277] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-19T17:28:34.473053] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:28:34.483406] [INFO ] [REMOTE ] BBD: Full fetch complete (77118 records). [2025-09-19T17:28:34.483597] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-19T17:28:34.878934] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-19T17:28:34.879035] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-19T17:28:34.879838] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-19T17:28:34.879907] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-19T17:28:34.881609] [DEBUG] [LOCAL ] BBD: Trimmed 77118 records to 53954 (keeping 200 days of data) [2025-09-19T17:28:34.999956] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T17:28:35.080354] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-19T17:28:35.247396] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T17:28:35.265436] [DEBUG] [LOCAL ] BBD: Primary data saved (53954 records). [2025-09-19T17:28:35.265556] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-19T17:28:35.266568] [INFO ] [MAIN ] Update Progress: 220/2372 symbols completed. BBD took 30.0s. Estimated remaining: 4h 38m 57s. Rate: 7.7 symbols/min [2025-09-19T17:28:35.436516] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:35.436721] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-19T17:28:35.436769] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-19T17:28:35.436965] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-19T17:28:35.437018] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-19T17:28:35.437060] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-19T17:28:35.437092] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-19T17:28:35.804043] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:35.843230] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-19T17:28:36.238207] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:36.238537] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-19T17:28:36.249673] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T17:28:36.643301] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-19T17:28:37.130745] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:37.131066] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-19T17:28:37.443265] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-19T17:28:37.663982] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:37.664350] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-19T17:28:38.243271] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-19T17:28:39.043311] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-19T17:28:39.176103] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T17:28:39.277410] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:39.277801] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-19T17:28:39.843273] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-19T17:28:40.643321] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-19T17:28:40.741754] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:28:41.443298] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-19T17:28:42.243307] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-19T17:28:42.338515] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T17:28:42.381556] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T17:28:42.489087] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:42.489507] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-19T17:28:43.043282] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-19T17:28:43.622952] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T17:28:43.843261] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-19T17:28:44.581022] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T17:28:44.643230] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-19T17:28:45.378811] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:28:45.443345] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-19T17:28:45.680513] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:45.680964] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-19T17:28:46.243311] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-19T17:28:47.043293] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-19T17:28:47.548329] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T17:28:47.773316] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T17:28:47.843230] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-19T17:28:48.630492] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T17:28:48.631747] [INFO ] [REMOTE ] BBDO: Full fetch complete (7835 records). [2025-09-19T17:28:48.631822] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-19T17:28:48.648396] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-19T17:28:48.984254] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:49.010235] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-19T17:28:49.010445] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-19T17:28:49.010524] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-19T17:28:49.011067] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-19T17:28:49.011128] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-19T17:28:49.011540] [DEBUG] [LOCAL ] BBDO: Trimmed 7835 records to 5129 (keeping 200 days of data) [2025-09-19T17:28:49.041064] [DEBUG] [LOCAL ] BBDO: Primary data saved (5129 records). [2025-09-19T17:28:49.041140] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-19T17:28:49.041218] [INFO ] [MAIN ] Update Progress: 221/2372 symbols completed. BBDO took 25.1s. Estimated remaining: 4h 39m 47s. Rate: 7.7 symbols/min [2025-09-19T17:28:49.207201] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:28:49.213189] [DEBUG] [LOCAL ] BBU: Loaded 4094 existing records from primary storage. [2025-09-19T17:28:49.213284] [INFO ] [MAIN ] BBU: Loaded 4094 existing records. [2025-09-19T17:28:49.391940] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:28:49.392219] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-19T17:28:49.392318] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-19T17:28:49.392609] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-19T17:28:49.392696] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-19T17:28:49.452927] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-19T17:28:49.744601] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:28:50.243263] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-19T17:28:51.042300] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T17:28:51.044124] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-19T17:28:51.206928] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T17:28:51.836930] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T17:28:51.843213] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-19T17:28:52.585464] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T17:28:52.643319] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-19T17:28:53.443240] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-19T17:28:53.866719] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T17:28:53.930291] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T17:28:54.243330] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-19T17:28:54.855152] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T17:28:55.043348] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-19T17:28:55.273152] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:55.273551] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-19T17:28:55.843266] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-19T17:28:56.643273] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-19T17:28:57.452753] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-19T17:28:57.454678] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T17:28:57.582755] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:28:57.696427] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:28:57.696855] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-19T17:28:58.243263] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-19T17:28:59.043268] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-19T17:28:59.831602] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-19T17:28:59.843223] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-19T17:29:00.161541] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T17:29:00.168050] [INFO ] [REMOTE ] BBT: Full fetch complete (4305 records). [2025-09-19T17:29:00.168162] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-19T17:29:00.356210] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 14 unique days, need 200 days [2025-09-19T17:29:00.356430] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:29:00.356499] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:29:00.356569] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-19T17:29:00.356637] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-19T17:29:00.356717] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-19T17:29:00.356786] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-19T17:29:00.356848] [INFO ] [MAIN ] Update Progress: 222/2372 symbols completed. BBT took 25.1s. Estimated remaining: 4h 40m 14s. Rate: 7.7 symbols/min [2025-09-19T17:29:00.533892] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:00.550170] [DEBUG] [LOCAL ] BBUC: Loaded 13344 existing records from primary storage. [2025-09-19T17:29:00.550311] [INFO ] [MAIN ] BBUC: Loaded 13344 existing records. [2025-09-19T17:29:00.651269] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-19T17:29:00.740462] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:00.740785] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-19T17:29:00.740839] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-19T17:29:00.742745] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-19T17:29:00.742807] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-19T17:29:01.124941] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:01.126311] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T17:29:01.130319] [INFO ] [REMOTE ] BBN: Full fetch complete (27003 records). [2025-09-19T17:29:01.130415] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-19T17:29:01.437547] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T17:29:01.449942] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-19T17:29:01.512448] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-19T17:29:01.512535] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-19T17:29:01.513002] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-19T17:29:01.513078] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-19T17:29:01.513907] [DEBUG] [LOCAL ] BBN: Trimmed 27003 records to 18292 (keeping 200 days of data) [2025-09-19T17:29:01.630252] [DEBUG] [LOCAL ] BBN: Primary data saved (18292 records). [2025-09-19T17:29:01.630409] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-19T17:29:01.630495] [INFO ] [MAIN ] Update Progress: 223/2372 symbols completed. BBN took 33.2s. Estimated remaining: 4h 39m 3s. Rate: 7.7 symbols/min [2025-09-19T17:29:01.801664] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:01.852335] [DEBUG] [LOCAL ] BBVA: Loaded 49977 existing records from primary storage. [2025-09-19T17:29:01.852509] [INFO ] [MAIN ] BBVA: Loaded 49977 existing records. [2025-09-19T17:29:02.031534] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:02.031804] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-19T17:29:02.031861] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-19T17:29:02.035636] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-19T17:29:02.035722] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-19T17:29:02.144766] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T17:29:02.251208] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-19T17:29:02.411733] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:03.043267] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-19T17:29:03.376931] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T17:29:03.843273] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-19T17:29:03.996100] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:29:04.643282] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-19T17:29:05.443271] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-19T17:29:05.678060] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T17:29:06.200578] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T17:29:06.242163] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T17:29:06.248390] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-19T17:29:06.842103] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T17:29:06.843725] [INFO ] [REMOTE ] BBU: Full fetch complete (6042 records). [2025-09-19T17:29:06.843810] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-19T17:29:07.048491] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-19T17:29:07.224284] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-19T17:29:07.224370] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-19T17:29:07.224598] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-19T17:29:07.224682] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-19T17:29:07.225130] [DEBUG] [LOCAL ] BBU: Trimmed 6042 records to 4115 (keeping 200 days of data) [2025-09-19T17:29:07.250532] [DEBUG] [LOCAL ] BBU: Primary data saved (4115 records). [2025-09-19T17:29:07.250627] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-19T17:29:07.250788] [INFO ] [MAIN ] Update Progress: 224/2372 symbols completed. BBU took 18.2s. Estimated remaining: 4h 38m 34s. Rate: 7.7 symbols/min [2025-09-19T17:29:07.432797] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:07.462055] [DEBUG] [LOCAL ] BBW: Loaded 26696 existing records from primary storage. [2025-09-19T17:29:07.462250] [INFO ] [MAIN ] BBW: Loaded 26696 existing records. [2025-09-19T17:29:07.652950] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:07.653232] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-19T17:29:07.653284] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-19T17:29:07.655542] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-19T17:29:07.655606] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-19T17:29:07.852725] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-19T17:29:08.021437] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:08.643277] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-19T17:29:09.069964] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T17:29:09.176822] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T17:29:09.443284] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-19T17:29:09.694528] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T17:29:10.243272] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-19T17:29:11.043281] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-19T17:29:11.318447] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T17:29:11.662683] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:29:11.843302] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-19T17:29:12.067698] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T17:29:12.643285] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-19T17:29:13.443250] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-19T17:29:13.966425] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T17:29:14.161050] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T17:29:14.167728] [INFO ] [REMOTE ] BBDC: Full fetch complete (49067 records). [2025-09-19T17:29:14.167987] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-19T17:29:14.248581] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-19T17:29:14.597829] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-19T17:29:14.597937] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-19T17:29:14.598549] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-19T17:29:14.598594] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-19T17:29:14.600251] [DEBUG] [LOCAL ] BBDC: Trimmed 49067 records to 33965 (keeping 200 days of data) [2025-09-19T17:29:14.716226] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T17:29:14.828665] [DEBUG] [LOCAL ] BBDC: Primary data saved (33965 records). [2025-09-19T17:29:14.828824] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-19T17:29:14.828919] [INFO ] [MAIN ] Update Progress: 225/2372 symbols completed. BBDC took 58.3s. Estimated remaining: 4h 38m 24s. Rate: 7.7 symbols/min [2025-09-19T17:29:14.998147] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:15.049631] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-19T17:29:15.053170] [DEBUG] [LOCAL ] BBWI: Loaded 53964 existing records from primary storage. [2025-09-19T17:29:15.053353] [INFO ] [MAIN ] BBWI: Loaded 53964 existing records. [2025-09-19T17:29:15.230230] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:15.230528] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-19T17:29:15.230578] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-19T17:29:15.234231] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-19T17:29:15.234295] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-19T17:29:15.591363] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:15.843275] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-19T17:29:16.153446] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T17:29:16.430205] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T17:29:16.643271] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-19T17:29:17.443287] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-19T17:29:18.007481] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T17:29:18.033593] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T17:29:18.243269] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-19T17:29:18.989755] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T17:29:19.043219] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-19T17:29:19.721694] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T17:29:19.843263] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-19T17:29:20.643255] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-19T17:29:21.103247] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:29:21.213297] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T17:29:21.443278] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-19T17:29:21.793706] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T17:29:22.243268] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-19T17:29:22.929451] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T17:29:23.043233] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-19T17:29:23.843245] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-19T17:29:24.144238] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T17:29:24.369998] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T17:29:24.561205] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T17:29:24.643265] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-19T17:29:25.443246] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-19T17:29:25.902746] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T17:29:26.243290] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-19T17:29:27.043286] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-19T17:29:27.610669] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:29:27.816283] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T17:29:27.843210] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-19T17:29:28.269782] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:29:28.643276] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-19T17:29:29.063238] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T17:29:29.443254] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-19T17:29:30.243282] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-19T17:29:30.631917] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T17:29:30.713373] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T17:29:30.715688] [INFO ] [REMOTE ] BBUC: Full fetch complete (17234 records). [2025-09-19T17:29:30.715764] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-19T17:29:31.048365] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-19T17:29:31.091444] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-19T17:29:31.091578] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-19T17:29:31.091952] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-19T17:29:31.092016] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-19T17:29:31.092709] [DEBUG] [LOCAL ] BBUC: Trimmed 17234 records to 13440 (keeping 200 days of data) [2025-09-19T17:29:31.175475] [DEBUG] [LOCAL ] BBUC: Primary data saved (13440 records). [2025-09-19T17:29:31.175614] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-19T17:29:31.175823] [INFO ] [MAIN ] Update Progress: 226/2372 symbols completed. BBUC took 30.8s. Estimated remaining: 4h 39m 38s. Rate: 7.7 symbols/min [2025-09-19T17:29:31.344447] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:31.403845] [DEBUG] [LOCAL ] BBY: Loaded 53876 existing records from primary storage. [2025-09-19T17:29:31.404017] [INFO ] [MAIN ] BBY: Loaded 53876 existing records. [2025-09-19T17:29:31.588284] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:31.588636] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-19T17:29:31.588727] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-19T17:29:31.591461] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-19T17:29:31.591526] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-19T17:29:31.852385] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-19T17:29:31.994105] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:32.623381] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T17:29:32.648623] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-19T17:29:32.652424] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:29:33.443234] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-19T17:29:34.139607] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T17:29:34.243243] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-19T17:29:34.787570] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T17:29:35.043280] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-19T17:29:35.602952] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T17:29:35.843248] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-19T17:29:36.484719] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T17:29:36.548668] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T17:29:36.643252] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-19T17:29:37.443256] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-19T17:29:37.758113] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T17:29:38.243272] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-19T17:29:38.975682] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T17:29:39.043224] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-19T17:29:39.301679] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T17:29:39.307047] [INFO ] [REMOTE ] BBW: Full fetch complete (39110 records). [2025-09-19T17:29:39.307143] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-19T17:29:39.701192] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-19T17:29:39.701297] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-19T17:29:39.701857] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-19T17:29:39.701923] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-19T17:29:39.703054] [DEBUG] [LOCAL ] BBW: Trimmed 39110 records to 26896 (keeping 200 days of data) [2025-09-19T17:29:39.851314] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-19T17:29:39.865003] [DEBUG] [LOCAL ] BBW: Primary data saved (26896 records). [2025-09-19T17:29:39.865141] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-19T17:29:39.865249] [INFO ] [MAIN ] Update Progress: 227/2372 symbols completed. BBW took 32.6s. Estimated remaining: 4h 39m 38s. Rate: 7.7 symbols/min [2025-09-19T17:29:40.042242] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:40.092568] [DEBUG] [LOCAL ] BC: Loaded 45007 existing records from primary storage. [2025-09-19T17:29:40.092752] [INFO ] [MAIN ] BC: Loaded 45007 existing records. [2025-09-19T17:29:40.295274] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:40.295627] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-19T17:29:40.295729] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-19T17:29:40.299077] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-19T17:29:40.299228] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-19T17:29:40.688297] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:40.688766] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-19T17:29:40.740322] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-19T17:29:40.968803] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T17:29:41.443254] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-19T17:29:42.243253] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-19T17:29:42.391800] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-19T17:29:42.404569] [INFO ] [REMOTE ] BBVA: Full fetch complete (71578 records). [2025-09-19T17:29:42.404875] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-19T17:29:42.846871] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-19T17:29:42.847022] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-19T17:29:42.847786] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-19T17:29:42.847928] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-19T17:29:42.851108] [DEBUG] [LOCAL ] BBVA: Trimmed 71578 records to 50331 (keeping 200 days of data) [2025-09-19T17:29:42.963738] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T17:29:43.052061] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-19T17:29:43.181257] [DEBUG] [LOCAL ] BBVA: Primary data saved (50331 records). [2025-09-19T17:29:43.181396] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-19T17:29:43.181491] [INFO ] [MAIN ] Update Progress: 228/2372 symbols completed. BBVA took 41.6s. Estimated remaining: 4h 38m 48s. Rate: 7.7 symbols/min [2025-09-19T17:29:43.352003] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:43.352268] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-09-19T17:29:43.352325] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-09-19T17:29:43.352469] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-19T17:29:43.352514] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-19T17:29:43.352557] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-19T17:29:43.352590] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-19T17:29:43.731985] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:43.765808] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T17:29:43.843234] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-19T17:29:43.878996] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T17:29:44.159580] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:29:44.643283] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-19T17:29:45.443279] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-19T17:29:46.149484] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T17:29:46.243267] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-19T17:29:46.391385] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T17:29:47.043342] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-19T17:29:47.243291] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T17:29:47.668611] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:29:47.843292] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-19T17:29:48.392903] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T17:29:48.643281] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-19T17:29:49.443306] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-19T17:29:49.667765] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T17:29:50.243345] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-19T17:29:50.412368] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T17:29:50.420431] [INFO ] [REMOTE ] BBWI: Full fetch complete (77410 records). [2025-09-19T17:29:50.420586] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-19T17:29:50.827933] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-19T17:29:50.828056] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-19T17:29:50.829250] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-19T17:29:50.829333] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-19T17:29:50.831486] [DEBUG] [LOCAL ] BBWI: Trimmed 77410 records to 54354 (keeping 200 days of data) [2025-09-19T17:29:51.048359] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-19T17:29:51.177468] [DEBUG] [LOCAL ] BBWI: Primary data saved (54354 records). [2025-09-19T17:29:51.177620] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-19T17:29:51.177749] [INFO ] [MAIN ] Update Progress: 229/2372 symbols completed. BBWI took 36.3s. Estimated remaining: 4h 38m 42s. Rate: 7.7 symbols/min [2025-09-19T17:29:51.351910] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:51.381771] [DEBUG] [LOCAL ] BCC: Loaded 28653 existing records from primary storage. [2025-09-19T17:29:51.381908] [INFO ] [MAIN ] BCC: Loaded 28653 existing records. [2025-09-19T17:29:51.607527] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:51.607905] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-19T17:29:51.607972] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-19T17:29:51.609062] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-19T17:29:51.609124] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-19T17:29:52.005449] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:52.006031] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-19T17:29:52.009160] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-19T17:29:52.039346] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T17:29:52.643273] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-19T17:29:53.220760] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T17:29:53.297718] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T17:29:53.443261] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-19T17:29:54.243274] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-19T17:29:54.376438] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T17:29:55.043275] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-19T17:29:55.612203] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T17:29:55.620019] [INFO ] [REMOTE ] BBY: Full fetch complete (77254 records). [2025-09-19T17:29:55.620144] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-19T17:29:55.852810] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-19T17:29:56.027252] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-19T17:29:56.027425] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-19T17:29:56.028341] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-19T17:29:56.028459] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-19T17:29:56.048529] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:29:56.055714] [DEBUG] [LOCAL ] BBY: Trimmed 77254 records to 54263 (keeping 200 days of data) [2025-09-19T17:29:56.404874] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T17:29:56.441219] [DEBUG] [LOCAL ] BBY: Primary data saved (54263 records). [2025-09-19T17:29:56.441360] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-19T17:29:56.443189] [INFO ] [MAIN ] Update Progress: 230/2372 symbols completed. BBY took 25.3s. Estimated remaining: 4h 38m 11s. Rate: 7.7 symbols/min [2025-09-19T17:29:56.614543] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:29:56.647986] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-19T17:29:56.669941] [DEBUG] [LOCAL ] BCE: Loaded 52752 existing records from primary storage. [2025-09-19T17:29:56.670108] [INFO ] [MAIN ] BCE: Loaded 52752 existing records. [2025-09-19T17:29:56.855589] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:29:56.855865] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-19T17:29:56.855923] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-19T17:29:56.857252] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-19T17:29:56.857325] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-19T17:29:57.223706] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:29:57.388966] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:29:57.443229] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-19T17:29:58.243263] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-19T17:29:58.457104] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T17:29:58.995159] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T17:29:59.043226] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-19T17:29:59.843262] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-19T17:29:59.998836] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T17:30:00.619905] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T17:30:00.643212] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-19T17:30:01.201589] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T17:30:01.443287] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-19T17:30:02.243317] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-19T17:30:02.719858] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T17:30:03.043298] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-19T17:30:03.843326] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-19T17:30:04.294883] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-09-19T17:30:04.643281] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-19T17:30:05.645992] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (3.40 seconds). [2025-09-19T17:30:05.659473] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-19T17:30:05.752745] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-19T17:30:06.243355] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-19T17:30:06.435692] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-19T17:30:07.031072] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T17:30:07.040288] [INFO ] [REMOTE ] BC: Full fetch complete (63325 records). [2025-09-19T17:30:07.040444] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-19T17:30:07.042458] [FATAL] [VALIDATOR ] BC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:30:07.042572] [FATAL] [MAIN ] BC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:30:07.042639] [WARN ] [MAIN ] BC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:30:07.042724] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-19T17:30:07.042821] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-09-19T17:30:07.042878] [INFO ] [LOCAL ] BC: Starting deletion of derivative data. [2025-09-19T17:30:07.043301] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-19T17:30:07.043541] [DEBUG] [LOCAL ] BC: Deleted derivative data file. [2025-09-19T17:30:07.043808] [INFO ] [MAIN ] Update Progress: 231/2372 symbols completed. BC took 27.2s. Estimated remaining: 4h 38m 29s. Rate: 7.7 symbols/min [2025-09-19T17:30:07.229257] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:07.229499] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-09-19T17:30:07.229583] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-09-19T17:30:07.229829] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-19T17:30:07.229898] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-19T17:30:07.229967] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-19T17:30:07.230048] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-19T17:30:07.684549] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:07.775210] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T17:30:07.843299] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-19T17:30:08.048272] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-19T17:30:08.643286] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-19T17:30:09.142879] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:30:09.268940] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:30:09.443273] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-19T17:30:10.051015] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T17:30:10.243278] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-19T17:30:11.019765] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T17:30:11.043229] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-19T17:30:11.552512] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T17:30:11.843266] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-19T17:30:12.643250] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-19T17:30:13.064396] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:30:13.069134] [INFO ] [REMOTE ] BCC: Full fetch complete (40036 records). [2025-09-19T17:30:13.069274] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-19T17:30:13.452900] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-19T17:30:13.457054] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-19T17:30:13.457124] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-19T17:30:13.457708] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-19T17:30:13.457799] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-19T17:30:13.459550] [DEBUG] [LOCAL ] BCC: Trimmed 40036 records to 28900 (keeping 200 days of data) [2025-09-19T17:30:13.653465] [DEBUG] [LOCAL ] BCC: Primary data saved (28900 records). [2025-09-19T17:30:13.653611] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-19T17:30:13.653792] [INFO ] [MAIN ] Update Progress: 232/2372 symbols completed. BCC took 22.5s. Estimated remaining: 4h 38m 10s. Rate: 7.7 symbols/min [2025-09-19T17:30:13.831639] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:13.851603] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:30:13.879198] [DEBUG] [LOCAL ] BCO: Loaded 26698 existing records from primary storage. [2025-09-19T17:30:13.879337] [INFO ] [MAIN ] BCO: Loaded 26698 existing records. [2025-09-19T17:30:14.062785] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:14.063059] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-19T17:30:14.063108] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-19T17:30:14.063930] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-19T17:30:14.064002] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-19T17:30:14.253522] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-19T17:30:14.438273] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:15.043264] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-19T17:30:15.123950] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-19T17:30:15.843275] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-19T17:30:15.940487] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T17:30:16.643278] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-19T17:30:17.612482] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T17:30:17.618110] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-19T17:30:17.877345] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T17:30:17.886828] [INFO ] [REMOTE ] BCAT: Full fetch complete (49927 records). [2025-09-19T17:30:17.887071] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-19T17:30:18.278755] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (3.24 seconds). [2025-09-19T17:30:18.306102] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-19T17:30:18.401442] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-19T17:30:18.402120] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-19T17:30:18.407234] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-19T17:30:18.407961] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-19T17:30:18.409728] [DEBUG] [LOCAL ] BCAT: Trimmed 49927 records to 35198 (keeping 200 days of data) [2025-09-19T17:30:18.677515] [DEBUG] [LOCAL ] BCAT: Primary data saved (35198 records). [2025-09-19T17:30:18.678275] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-19T17:30:18.678409] [INFO ] [MAIN ] Update Progress: 233/2372 symbols completed. BCAT took 35.5s. Estimated remaining: 4h 37m 37s. Rate: 7.7 symbols/min [2025-09-19T17:30:18.695598] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (5.24 seconds). [2025-09-19T17:30:18.890848] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:18.889295] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T17:30:18.957896] [DEBUG] [LOCAL ] BCS: Loaded 53865 existing records from primary storage. [2025-09-19T17:30:18.958049] [INFO ] [MAIN ] BCS: Loaded 53865 existing records. [2025-09-19T17:30:19.048406] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-19T17:30:19.141590] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:19.141866] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-19T17:30:19.141914] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-19T17:30:19.143210] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-19T17:30:19.143273] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-19T17:30:19.489751] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:30:19.528717] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:19.843275] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-19T17:30:20.643247] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-19T17:30:21.163599] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T17:30:21.335024] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T17:30:21.443286] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-19T17:30:22.243237] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-19T17:30:22.322539] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:30:22.879379] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T17:30:23.043302] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-19T17:30:23.843265] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-19T17:30:24.435387] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T17:30:24.643266] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-19T17:30:25.443267] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-19T17:30:25.642804] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:30:25.732679] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T17:30:26.243233] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-19T17:30:26.828292] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:30:26.946599] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T17:30:27.043270] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-19T17:30:27.765367] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T17:30:27.843271] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-19T17:30:27.961060] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T17:30:28.643315] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-19T17:30:29.443268] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-19T17:30:29.603488] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T17:30:29.909761] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T17:30:30.243285] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-19T17:30:31.043304] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-19T17:30:31.344554] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T17:30:31.843309] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-19T17:30:32.525107] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T17:30:32.643283] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-19T17:30:33.207231] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T17:30:33.350711] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T17:30:33.443302] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-19T17:30:34.243294] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-19T17:30:34.806334] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:30:35.043242] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-19T17:30:35.272237] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-19T17:30:35.843277] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-19T17:30:35.994175] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T17:30:36.566442] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:30:36.643290] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-19T17:30:37.443305] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-19T17:30:38.223745] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-19T17:30:38.243227] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-19T17:30:38.317385] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T17:30:39.043285] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-19T17:30:39.560249] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T17:30:39.575401] [INFO ] [REMOTE ] BCE: Full fetch complete (76183 records). [2025-09-19T17:30:39.575638] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-19T17:30:39.849371] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-19T17:30:40.004773] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-19T17:30:40.004884] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-19T17:30:40.005638] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-19T17:30:40.005734] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-19T17:30:40.007377] [DEBUG] [LOCAL ] BCE: Trimmed 76183 records to 53142 (keeping 200 days of data) [2025-09-19T17:30:40.400585] [DEBUG] [LOCAL ] BCE: Primary data saved (53142 records). [2025-09-19T17:30:40.401002] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-19T17:30:40.402349] [INFO ] [MAIN ] Update Progress: 234/2372 symbols completed. BCE took 44.0s. Estimated remaining: 4h 39m 36s. Rate: 7.6 symbols/min [2025-09-19T17:30:40.653197] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:40.676909] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:30:40.685545] [INFO ] [REMOTE ] BCH: Full fetch complete (40790 records). [2025-09-19T17:30:40.685840] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-19T17:30:40.910757] [DEBUG] [LOCAL ] BCSF: Loaded 28159 existing records from primary storage. [2025-09-19T17:30:40.917460] [INFO ] [MAIN ] BCSF: Loaded 28159 existing records. [2025-09-19T17:30:40.928539] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-19T17:30:41.083007] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-19T17:30:41.452398] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:41.490177] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-19T17:30:41.490883] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-19T17:30:41.506670] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-19T17:30:41.512143] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-19T17:30:41.724921] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-19T17:30:41.737213] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-19T17:30:41.739026] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-19T17:30:41.744792] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-19T17:30:41.799454] [DEBUG] [LOCAL ] BCH: Trimmed 40790 records to 30018 (keeping 200 days of data) [2025-09-19T17:30:41.890315] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T17:30:42.050039] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-19T17:30:42.167146] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:42.242931] [DEBUG] [LOCAL ] BCH: Primary data saved (30018 records). [2025-09-19T17:30:42.243166] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-19T17:30:42.243362] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-19T17:30:42.243278] [INFO ] [MAIN ] Update Progress: 235/2372 symbols completed. BCH took 35.2s. Estimated remaining: 4h 38m 34s. Rate: 7.7 symbols/min [2025-09-19T17:30:42.425373] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:42.449900] [DEBUG] [LOCAL ] BCX: Loaded 22175 existing records from primary storage. [2025-09-19T17:30:42.450096] [INFO ] [MAIN ] BCX: Loaded 22175 existing records. [2025-09-19T17:30:42.637086] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:42.637433] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-19T17:30:42.637490] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-19T17:30:42.638208] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-19T17:30:42.638278] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-19T17:30:43.014007] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:43.043306] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-19T17:30:43.110671] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T17:30:43.565519] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T17:30:43.569554] [INFO ] [REMOTE ] BCO: Full fetch complete (36851 records). [2025-09-19T17:30:43.569709] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-19T17:30:43.849426] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-19T17:30:43.977598] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-19T17:30:43.977923] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-19T17:30:43.978534] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-19T17:30:43.978630] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-19T17:30:43.993338] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:30:43.998896] [DEBUG] [LOCAL ] BCO: Trimmed 36851 records to 26929 (keeping 200 days of data) [2025-09-19T17:30:44.173804] [DEBUG] [LOCAL ] BCO: Primary data saved (26929 records). [2025-09-19T17:30:44.173954] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-19T17:30:44.174047] [INFO ] [MAIN ] Update Progress: 236/2372 symbols completed. BCO took 30.5s. Estimated remaining: 4h 37m 33s. Rate: 7.7 symbols/min [2025-09-19T17:30:44.345565] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:30:44.373049] [DEBUG] [LOCAL ] BDC: Loaded 25249 existing records from primary storage. [2025-09-19T17:30:44.373194] [INFO ] [MAIN ] BDC: Loaded 25249 existing records. [2025-09-19T17:30:44.555942] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:30:44.556249] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-19T17:30:44.556303] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-19T17:30:44.556957] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-19T17:30:44.557017] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-19T17:30:44.659456] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-19T17:30:44.962226] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:30:44.956326] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T17:30:45.443271] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-19T17:30:46.227750] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T17:30:46.243228] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-19T17:30:46.363975] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T17:30:46.392931] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-19T17:30:46.401337] [INFO ] [REMOTE ] BCS: Full fetch complete (77247 records). [2025-09-19T17:30:46.401556] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-19T17:30:46.836222] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-19T17:30:46.836330] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-19T17:30:46.837261] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-19T17:30:46.837331] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-19T17:30:46.838919] [DEBUG] [LOCAL ] BCS: Trimmed 77247 records to 54253 (keeping 200 days of data) [2025-09-19T17:30:47.045983] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-19T17:30:47.201452] [DEBUG] [LOCAL ] BCS: Primary data saved (54253 records). [2025-09-19T17:30:47.201611] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-19T17:30:47.201744] [INFO ] [MAIN ] Update Progress: 237/2372 symbols completed. BCS took 28.5s. Estimated remaining: 4h 36m 42s. Rate: 7.7 symbols/min [2025-09-19T17:30:47.506299] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T17:30:47.843282] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-19T17:30:47.924385] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T17:30:48.643294] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-19T17:30:49.443321] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-19T17:30:49.566908] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T17:30:49.641571] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T17:30:50.243317] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-19T17:30:50.826352] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T17:30:51.043273] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-19T17:30:51.758331] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T17:30:51.843279] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-19T17:30:52.597198] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T17:30:52.643240] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-19T17:30:52.673921] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T17:30:53.443271] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-19T17:30:53.861914] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T17:30:54.243312] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-19T17:30:55.043284] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-19T17:30:55.159620] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:30:55.670096] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:30:55.843295] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-19T17:30:56.205689] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T17:30:56.643236] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-19T17:30:57.359791] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T17:30:57.443247] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-19T17:30:58.015939] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:30:58.243262] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-19T17:30:58.378581] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T17:30:59.039968] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-19T17:30:59.044434] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-19T17:30:59.843328] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-19T17:31:00.388486] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:31:00.643293] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-19T17:31:01.168789] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T17:31:01.172112] [INFO ] [REMOTE ] BCX: Full fetch complete (34093 records). [2025-09-19T17:31:01.172252] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-19T17:31:01.451077] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-19T17:31:01.575659] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-19T17:31:01.575765] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-19T17:31:01.576241] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-19T17:31:01.576285] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-19T17:31:01.577238] [DEBUG] [LOCAL ] BCX: Trimmed 34093 records to 22297 (keeping 200 days of data) [2025-09-19T17:31:01.708216] [DEBUG] [LOCAL ] BCX: Primary data saved (22297 records). [2025-09-19T17:31:01.708361] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-19T17:31:01.708446] [INFO ] [MAIN ] Update Progress: 238/2372 symbols completed. BCX took 19.5s. Estimated remaining: 4h 37m 35s. Rate: 7.7 symbols/min [2025-09-19T17:31:02.078673] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:31:02.083036] [INFO ] [REMOTE ] BCSF: Full fetch complete (37699 records). [2025-09-19T17:31:02.083127] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-19T17:31:02.526717] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-19T17:31:02.526820] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-19T17:31:02.527292] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-19T17:31:02.527333] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-19T17:31:02.528176] [DEBUG] [LOCAL ] BCSF: Trimmed 37699 records to 28369 (keeping 200 days of data) [2025-09-19T17:31:02.700405] [DEBUG] [LOCAL ] BCSF: Primary data saved (28369 records). [2025-09-19T17:31:02.700540] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-19T17:31:02.700624] [INFO ] [MAIN ] Update Progress: 239/2372 symbols completed. BCSF took 22.3s. Estimated remaining: 4h 36m 26s. Rate: 7.7 symbols/min [2025-09-19T17:31:02.758144] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T17:31:02.764319] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-19T17:31:04.419836] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:31:04.426478] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-19T17:31:05.773550] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:31:05.779330] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-19T17:31:06.528780] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T17:31:06.537608] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-19T17:31:08.347603] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:31:08.353670] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-19T17:31:09.877369] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T17:31:09.883244] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-19T17:31:11.445871] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T17:31:11.449630] [INFO ] [REMOTE ] BDC: Full fetch complete (35613 records). [2025-09-19T17:31:11.449789] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-19T17:31:11.829665] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-19T17:31:11.829761] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-19T17:31:11.830233] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-19T17:31:11.830282] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-19T17:31:11.831239] [DEBUG] [LOCAL ] BDC: Trimmed 35613 records to 25371 (keeping 200 days of data) [2025-09-19T17:31:11.991739] [DEBUG] [LOCAL ] BDC: Primary data saved (25371 records). [2025-09-19T17:31:11.991882] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-19T17:31:11.991965] [INFO ] [MAIN ] Update Progress: 240/2372 symbols completed. BDC took 27.8s. Estimated remaining: 4h 36m 32s. Rate: 7.7 symbols/min [2025-09-19T17:31:12.643256] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:12.649327] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:12.733452] [DEBUG] [LOCAL ] BDJ: No existing data file found in primary storage. [2025-09-19T17:31:12.733319] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:12.712308] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:12.734356] [WARN ] [MAIN ] BDJ: No existing data found, performing full refresh instead. [2025-09-19T17:31:12.734827] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-19T17:31:12.734968] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-19T17:31:12.735187] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-09-19T17:31:12.735282] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-19T17:31:13.180804] [DEBUG] [LOCAL ] BDN: Loaded 48037 existing records from primary storage. [2025-09-19T17:31:13.179835] [DEBUG] [LOCAL ] BDX: Loaded 52896 existing records from primary storage. [2025-09-19T17:31:13.206245] [INFO ] [MAIN ] BDN: Loaded 48037 existing records. [2025-09-19T17:31:13.206059] [INFO ] [MAIN ] BDX: Loaded 52896 existing records. [2025-09-19T17:31:13.212602] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-09-19T17:31:13.312923] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:13.328059] [INFO ] [MAIN ] BE: Loaded 54043 existing records. [2025-09-19T17:31:13.393604] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-19T17:31:13.834283] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:13.840154] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:13.840625] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-19T17:31:13.834143] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:13.840784] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-19T17:31:13.841139] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-19T17:31:13.841384] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-19T17:31:13.841336] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-19T17:31:13.841531] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-19T17:31:13.842582] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-19T17:31:13.842683] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-19T17:31:13.854260] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-19T17:31:13.864599] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-19T17:31:13.854446] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-19T17:31:13.886226] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-19T17:31:14.878909] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:14.911383] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:14.927114] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-19T17:31:14.908341] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-19T17:31:14.998762] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:14.999211] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-19T17:31:15.306705] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T17:31:15.314626] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-19T17:31:16.616597] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T17:31:16.627584] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-19T17:31:16.872688] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T17:31:16.879375] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-19T17:31:17.004422] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:31:17.014553] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-19T17:31:17.273722] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T17:31:17.284636] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-19T17:31:17.858628] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T17:31:17.864898] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-19T17:31:18.024046] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T17:31:18.034819] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-19T17:31:18.453040] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:31:18.463497] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-19T17:31:19.340249] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T17:31:19.346683] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-19T17:31:19.606618] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T17:31:19.617739] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-19T17:31:19.749612] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T17:31:19.759612] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-19T17:31:19.890193] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T17:31:19.899942] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-19T17:31:20.330540] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T17:31:20.338618] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-19T17:31:21.392053] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T17:31:21.402560] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-19T17:31:21.488212] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T17:31:21.500060] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-19T17:31:21.616207] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T17:31:21.821412] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T17:31:22.243340] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-19T17:31:23.043423] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-19T17:31:23.459143] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T17:31:23.603705] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:31:23.843335] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-19T17:31:23.953227] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T17:31:24.584810] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T17:31:24.643248] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-19T17:31:25.194935] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:31:25.443270] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-19T17:31:26.243299] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-19T17:31:26.410194] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T17:31:27.043271] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-19T17:31:27.438050] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T17:31:27.843290] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-19T17:31:28.146207] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T17:31:28.508716] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T17:31:28.643260] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-19T17:31:29.272243] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:31:29.443261] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-19T17:31:30.243320] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-19T17:31:30.932385] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-19T17:31:31.043231] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-19T17:31:31.838526] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T17:31:31.843124] [INFO ] [REMOTE ] BDJ: Full fetch complete (42828 records). [2025-09-19T17:31:31.843250] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-19T17:31:31.843431] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-19T17:31:32.249663] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-19T17:31:32.249868] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-19T17:31:32.250451] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-19T17:31:32.250525] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-19T17:31:32.251990] [DEBUG] [LOCAL ] BDJ: Trimmed 42828 records to 29626 (keeping 200 days of data) [2025-09-19T17:31:32.375464] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-19T17:31:32.472195] [DEBUG] [LOCAL ] BDJ: Primary data saved (29626 records). [2025-09-19T17:31:32.472346] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-19T17:31:32.472428] [INFO ] [MAIN ] Update Progress: 241/2372 symbols completed. BDJ took 20.5s. Estimated remaining: 4h 38m 16s. Rate: 7.7 symbols/min [2025-09-19T17:31:32.648013] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-19T17:31:32.647924] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:32.648281] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-19T17:31:32.648361] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-19T17:31:32.649730] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-19T17:31:32.649784] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-19T17:31:32.650016] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-19T17:31:32.650048] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-19T17:31:33.107717] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:33.149183] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T17:31:33.211074] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:31:33.443336] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-19T17:31:34.243318] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-19T17:31:34.365146] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T17:31:34.749728] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-19T17:31:35.043270] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-19T17:31:35.314447] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-19T17:31:35.425277] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:31:35.432785] [INFO ] [REMOTE ] BDN: Full fetch complete (69267 records). [2025-09-19T17:31:35.432928] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-19T17:31:35.846390] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-19T17:31:35.846517] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-19T17:31:35.847378] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-19T17:31:35.847510] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-19T17:31:35.845958] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-19T17:31:35.850718] [DEBUG] [LOCAL ] BDN: Trimmed 69267 records to 48364 (keeping 200 days of data) [2025-09-19T17:31:36.147870] [DEBUG] [LOCAL ] BDN: Primary data saved (48364 records). [2025-09-19T17:31:36.148010] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-19T17:31:36.148162] [INFO ] [MAIN ] Update Progress: 242/2372 symbols completed. BDN took 24.2s. Estimated remaining: 4h 37m 32s. Rate: 7.7 symbols/min [2025-09-19T17:31:36.345001] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:36.402875] [DEBUG] [LOCAL ] BEKE: Loaded 53656 existing records from primary storage. [2025-09-19T17:31:36.403054] [INFO ] [MAIN ] BEKE: Loaded 53656 existing records. [2025-09-19T17:31:36.602268] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:36.602542] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-19T17:31:36.602592] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-19T17:31:36.604137] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-19T17:31:36.604200] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-19T17:31:36.652525] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-19T17:31:37.005261] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:37.194557] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T17:31:37.443258] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-19T17:31:37.498481] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T17:31:38.243298] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-19T17:31:39.043291] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-19T17:31:39.726814] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T17:31:39.843266] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-19T17:31:40.007328] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:31:40.643286] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-19T17:31:41.443291] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-19T17:31:41.620869] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-19T17:31:42.017796] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:31:42.243300] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-19T17:31:42.275834] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:31:42.283742] [INFO ] [REMOTE ] BDX: Full fetch complete (75924 records). [2025-09-19T17:31:42.283915] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-19T17:31:42.727154] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-19T17:31:42.729163] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-19T17:31:42.729376] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-19T17:31:42.741060] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-19T17:31:42.741676] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-19T17:31:42.743695] [DEBUG] [LOCAL ] BDX: Trimmed 75924 records to 53259 (keeping 200 days of data) [2025-09-19T17:31:43.051161] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-19T17:31:43.077518] [DEBUG] [LOCAL ] BDX: Primary data saved (53259 records). [2025-09-19T17:31:43.077697] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-19T17:31:43.077798] [INFO ] [MAIN ] Update Progress: 243/2372 symbols completed. BDX took 31.1s. Estimated remaining: 4h 37m 16s. Rate: 7.7 symbols/min [2025-09-19T17:31:43.257158] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:43.312679] [DEBUG] [LOCAL ] BEN: Loaded 53466 existing records from primary storage. [2025-09-19T17:31:43.312829] [INFO ] [MAIN ] BEN: Loaded 53466 existing records. [2025-09-19T17:31:43.494308] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:43.494593] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-19T17:31:43.494671] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-19T17:31:43.496075] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-19T17:31:43.496135] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-19T17:31:43.845734] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-19T17:31:43.848960] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:44.296659] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T17:31:44.375062] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T17:31:44.643290] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-19T17:31:45.191224] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T17:31:45.443244] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-19T17:31:45.713582] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-19T17:31:45.792561] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-19T17:31:45.800572] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-19T17:31:45.800759] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-19T17:31:46.202140] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-19T17:31:46.202250] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-19T17:31:46.203111] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-19T17:31:46.203177] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-19T17:31:46.204744] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54433 (keeping 200 days of data) [2025-09-19T17:31:46.257389] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-19T17:31:46.539701] [DEBUG] [LOCAL ] BE: Primary data saved (54433 records). [2025-09-19T17:31:46.539976] [INFO ] [MAIN ] BE: Full history saved. [2025-09-19T17:31:46.540127] [INFO ] [MAIN ] Update Progress: 244/2372 symbols completed. BE took 34.5s. Estimated remaining: 4h 36m 30s. Rate: 7.7 symbols/min [2025-09-19T17:31:46.615482] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-19T17:31:46.719177] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:46.758212] [DEBUG] [LOCAL ] BEP: Loaded 39066 existing records from primary storage. [2025-09-19T17:31:46.758354] [INFO ] [MAIN ] BEP: Loaded 39066 existing records. [2025-09-19T17:31:46.939324] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:46.939697] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-19T17:31:46.939779] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-19T17:31:46.940841] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-19T17:31:46.940914] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-19T17:31:47.047278] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-19T17:31:47.318624] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:47.346423] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-19T17:31:47.843263] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-19T17:31:48.207936] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-19T17:31:48.208815] [INFO ] [REMOTE ] BEDU: Full fetch complete (1395 records). [2025-09-19T17:31:48.208888] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-19T17:31:48.400164] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-19T17:31:48.400352] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:31:48.400422] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:31:48.400494] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-19T17:31:48.400575] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-19T17:31:48.400633] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-19T17:31:48.400734] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-19T17:31:48.400816] [INFO ] [MAIN ] Update Progress: 245/2372 symbols completed. BEDU took 15.9s. Estimated remaining: 4h 35m 31s. Rate: 7.7 symbols/min [2025-09-19T17:31:48.578194] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:31:48.626367] [DEBUG] [LOCAL ] BEPC: Loaded 46987 existing records from primary storage. [2025-09-19T17:31:48.626515] [INFO ] [MAIN ] BEPC: Loaded 46987 existing records. [2025-09-19T17:31:48.648375] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-19T17:31:48.860458] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:31:48.860737] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-19T17:31:48.860794] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-19T17:31:48.863554] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-19T17:31:48.863615] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-19T17:31:49.242857] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:31:49.443254] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-19T17:31:50.243272] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-19T17:31:50.600399] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T17:31:51.043266] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-19T17:31:51.258690] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:31:51.843274] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-19T17:31:52.158913] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T17:31:52.643280] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-19T17:31:53.443242] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-19T17:31:53.619457] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-19T17:31:53.995985] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T17:31:54.100332] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T17:31:54.243344] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-19T17:31:54.996571] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T17:31:55.043253] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-19T17:31:55.843289] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-19T17:31:56.077684] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T17:31:56.643260] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-19T17:31:56.820263] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T17:31:57.443261] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-19T17:31:57.964523] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T17:31:58.243226] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-19T17:31:58.347275] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T17:31:59.043302] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-19T17:31:59.494634] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T17:31:59.589472] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T17:31:59.843270] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-19T17:32:00.643317] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-19T17:32:01.272066] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T17:32:01.443263] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-19T17:32:02.248323] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-19T17:32:02.265500] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T17:32:02.463018] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T17:32:02.803557] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:32:03.043331] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-19T17:32:03.843295] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-19T17:32:04.546301] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T17:32:04.653565] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-19T17:32:04.659355] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:32:05.443261] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-19T17:32:05.636809] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T17:32:06.190953] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T17:32:06.243251] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-19T17:32:06.767115] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:32:07.043263] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-19T17:32:07.674040] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:32:07.843256] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-19T17:32:08.643310] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-19T17:32:09.054858] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T17:32:09.084150] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T17:32:09.443288] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-19T17:32:10.243312] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-19T17:32:10.745425] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T17:32:10.833061] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T17:32:11.043299] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-19T17:32:11.494210] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T17:32:11.499778] [INFO ] [REMOTE ] BEP: Full fetch complete (58332 records). [2025-09-19T17:32:11.499928] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-19T17:32:11.868496] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-19T17:32:11.889564] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-19T17:32:11.889633] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-19T17:32:11.890440] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-19T17:32:11.890612] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-19T17:32:11.891927] [DEBUG] [LOCAL ] BEP: Trimmed 58332 records to 39400 (keeping 200 days of data) [2025-09-19T17:32:12.131231] [DEBUG] [LOCAL ] BEP: Primary data saved (39400 records). [2025-09-19T17:32:12.131381] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-19T17:32:12.131469] [INFO ] [MAIN ] Update Progress: 246/2372 symbols completed. BEP took 25.6s. Estimated remaining: 4h 37m 41s. Rate: 7.7 symbols/min [2025-09-19T17:32:12.300355] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:12.307750] [DEBUG] [LOCAL ] BEPH: Loaded 5249 existing records from primary storage. [2025-09-19T17:32:12.307865] [INFO ] [MAIN ] BEPH: Loaded 5249 existing records. [2025-09-19T17:32:12.487245] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:12.487515] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-19T17:32:12.487563] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-19T17:32:12.487928] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-19T17:32:12.487998] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-19T17:32:12.650284] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-19T17:32:12.852881] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:12.879518] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T17:32:12.887483] [INFO ] [REMOTE ] BEPC: Full fetch complete (68421 records). [2025-09-19T17:32:12.887751] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-19T17:32:13.301616] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-19T17:32:13.301746] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-19T17:32:13.302490] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-19T17:32:13.302561] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-19T17:32:13.304126] [DEBUG] [LOCAL ] BEPC: Trimmed 68421 records to 47318 (keeping 200 days of data) [2025-09-19T17:32:13.481380] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-19T17:32:13.602276] [DEBUG] [LOCAL ] BEPC: Primary data saved (47318 records). [2025-09-19T17:32:13.602436] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-19T17:32:13.602531] [INFO ] [MAIN ] Update Progress: 247/2372 symbols completed. BEPC took 25.2s. Estimated remaining: 4h 36m 39s. Rate: 7.7 symbols/min [2025-09-19T17:32:13.786725] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:13.793066] [DEBUG] [LOCAL ] BEPI: Loaded 3451 existing records from primary storage. [2025-09-19T17:32:13.793178] [INFO ] [MAIN ] BEPI: Loaded 3451 existing records. [2025-09-19T17:32:13.996328] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:13.996585] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-19T17:32:13.996665] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-19T17:32:13.997001] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-19T17:32:13.997062] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-19T17:32:14.363934] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T17:32:14.393738] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-19T17:32:14.440612] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:14.476167] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-19T17:32:15.048340] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-19T17:32:15.065211] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-19T17:32:15.280684] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T17:32:15.843277] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-19T17:32:16.643279] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-19T17:32:16.702765] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T17:32:17.203312] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T17:32:17.339117] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T17:32:17.443253] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-19T17:32:18.243277] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-19T17:32:18.690157] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-19T17:32:19.043301] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-19T17:32:19.421042] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T17:32:19.611283] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:32:19.843277] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-19T17:32:20.643293] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-19T17:32:20.685350] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T17:32:21.215732] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T17:32:21.443264] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-19T17:32:22.242980] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T17:32:22.243927] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-19T17:32:22.811397] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:32:23.043272] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-19T17:32:23.843301] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-19T17:32:24.643288] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-19T17:32:24.899924] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T17:32:25.306728] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T17:32:25.443236] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-19T17:32:26.243273] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-19T17:32:26.941501] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-19T17:32:27.043243] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-19T17:32:27.135768] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T17:32:27.792693] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-19T17:32:27.843324] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-19T17:32:28.643300] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-19T17:32:29.119914] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T17:32:29.128273] [INFO ] [REMOTE ] BEKE: Full fetch complete (77209 records). [2025-09-19T17:32:29.128441] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-19T17:32:29.270296] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-19T17:32:29.448466] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-19T17:32:29.547526] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-19T17:32:29.547614] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-19T17:32:29.548422] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-19T17:32:29.548487] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-19T17:32:29.550062] [DEBUG] [LOCAL ] BEKE: Trimmed 77209 records to 54042 (keeping 200 days of data) [2025-09-19T17:32:29.670797] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:32:29.680342] [INFO ] [REMOTE ] BEN: Full fetch complete (76893 records). [2025-09-19T17:32:29.681629] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-19T17:32:30.133078] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-19T17:32:30.133871] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-19T17:32:30.135584] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-19T17:32:30.135728] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-19T17:32:30.143404] [DEBUG] [LOCAL ] BEN: Trimmed 76893 records to 53847 (keeping 200 days of data) [2025-09-19T17:32:30.251429] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-19T17:32:30.328832] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T17:32:30.592593] [DEBUG] [LOCAL ] BEKE: Primary data saved (54042 records). [2025-09-19T17:32:30.593817] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-19T17:32:30.594237] [INFO ] [MAIN ] Update Progress: 248/2372 symbols completed. BEKE took 54.4s. Estimated remaining: 4h 37m 49s. Rate: 7.6 symbols/min [2025-09-19T17:32:30.788966] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:30.798749] [DEBUG] [LOCAL ] BEPJ: Loaded 3312 existing records from primary storage. [2025-09-19T17:32:30.799383] [INFO ] [MAIN ] BEPJ: Loaded 3312 existing records. [2025-09-19T17:32:31.047809] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-19T17:32:31.082713] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:31.084874] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-19T17:32:31.085216] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-19T17:32:31.086145] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-19T17:32:31.086489] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-19T17:32:31.295258] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T17:32:31.468348] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T17:32:31.509456] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:31.515513] [DEBUG] [LOCAL ] BEN: Primary data saved (53847 records). [2025-09-19T17:32:31.515770] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-19T17:32:31.518754] [INFO ] [MAIN ] Update Progress: 249/2372 symbols completed. BEN took 48.4s. Estimated remaining: 4h 36m 43s. Rate: 7.7 symbols/min [2025-09-19T17:32:31.708819] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:31.760262] [DEBUG] [LOCAL ] BFAM: Loaded 33173 existing records from primary storage. [2025-09-19T17:32:31.760516] [INFO ] [MAIN ] BFAM: Loaded 33173 existing records. [2025-09-19T17:32:31.848690] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-19T17:32:31.985628] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:31.986098] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-19T17:32:31.986206] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-19T17:32:31.987143] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-19T17:32:31.987262] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-19T17:32:32.361709] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:32.643262] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-19T17:32:32.842439] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T17:32:33.068594] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-19T17:32:33.443253] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-19T17:32:34.243277] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-19T17:32:34.920606] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T17:32:35.043288] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-19T17:32:35.180900] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T17:32:35.485035] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T17:32:35.486451] [INFO ] [REMOTE ] BEPI: Full fetch complete (4988 records). [2025-09-19T17:32:35.486539] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-19T17:32:35.850699] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-19T17:32:35.868125] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-19T17:32:35.868230] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-19T17:32:35.868438] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-19T17:32:35.868501] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-19T17:32:35.869117] [DEBUG] [LOCAL ] BEPI: Trimmed 4988 records to 3470 (keeping 200 days of data) [2025-09-19T17:32:35.893515] [DEBUG] [LOCAL ] BEPI: Primary data saved (3470 records). [2025-09-19T17:32:35.893707] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-19T17:32:35.893822] [INFO ] [MAIN ] Update Progress: 250/2372 symbols completed. BEPI took 22.3s. Estimated remaining: 4h 36m 6s. Rate: 7.7 symbols/min [2025-09-19T17:32:36.071815] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:36.125063] [DEBUG] [LOCAL ] BFH: Loaded 42319 existing records from primary storage. [2025-09-19T17:32:36.125254] [INFO ] [MAIN ] BFH: Loaded 42319 existing records. [2025-09-19T17:32:36.303011] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:36.303284] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-19T17:32:36.303371] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-19T17:32:36.304820] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-19T17:32:36.304882] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-19T17:32:36.647933] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-19T17:32:36.687465] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:36.688521] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-19T17:32:37.041574] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T17:32:37.443286] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-19T17:32:38.011411] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:32:38.243325] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-19T17:32:39.043357] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-19T17:32:39.629927] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T17:32:39.631394] [INFO ] [REMOTE ] BEPH: Full fetch complete (7534 records). [2025-09-19T17:32:39.631470] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-19T17:32:39.848466] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-19T17:32:40.067493] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-19T17:32:40.069938] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-19T17:32:40.069808] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T17:32:40.070311] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-19T17:32:40.070564] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-19T17:32:40.082033] [DEBUG] [LOCAL ] BEPH: Trimmed 7534 records to 5269 (keeping 200 days of data) [2025-09-19T17:32:40.121152] [DEBUG] [LOCAL ] BEPH: Primary data saved (5269 records). [2025-09-19T17:32:40.121415] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-19T17:32:40.121632] [INFO ] [MAIN ] Update Progress: 251/2372 symbols completed. BEPH took 28.0s. Estimated remaining: 4h 35m 27s. Rate: 7.7 symbols/min [2025-09-19T17:32:40.343797] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:32:40.368945] [DEBUG] [LOCAL ] BFK: Loaded 14147 existing records from primary storage. [2025-09-19T17:32:40.369150] [INFO ] [MAIN ] BFK: Loaded 14147 existing records. [2025-09-19T17:32:40.575316] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:32:40.575774] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-19T17:32:40.575834] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-19T17:32:40.576523] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-19T17:32:40.576585] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-19T17:32:40.652485] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-19T17:32:40.978396] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:32:41.443282] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-19T17:32:41.638913] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T17:32:41.743373] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T17:32:42.243281] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-19T17:32:42.779949] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:32:43.043294] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-19T17:32:43.762202] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T17:32:43.843301] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-19T17:32:44.093191] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T17:32:44.643308] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-19T17:32:45.443298] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-19T17:32:45.630757] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T17:32:46.109254] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-19T17:32:46.243305] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-19T17:32:46.401750] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:32:46.753703] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T17:32:47.043274] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-19T17:32:47.843264] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-19T17:32:48.384953] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T17:32:48.643347] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-19T17:32:49.443267] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-19T17:32:49.526926] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T17:32:49.608339] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T17:32:50.116122] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T17:32:50.243258] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-19T17:32:51.043280] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-19T17:32:51.358446] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T17:32:51.843288] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-19T17:32:52.541121] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T17:32:52.643269] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-19T17:32:53.076445] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T17:32:53.443278] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-19T17:32:53.451629] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T17:32:54.243272] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-19T17:32:54.963859] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T17:32:55.043261] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-19T17:32:55.759005] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T17:32:55.843235] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-19T17:32:56.643268] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-19T17:32:56.803105] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T17:32:57.029758] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-19T17:32:57.443264] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-19T17:32:57.535019] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T17:32:58.243299] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-19T17:32:58.445721] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T17:32:59.043276] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-19T17:32:59.753410] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T17:32:59.843292] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-19T17:32:59.971857] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T17:33:00.643303] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-19T17:33:00.838216] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T17:33:01.443677] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T17:33:01.443508] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-19T17:33:01.445969] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4557 records). [2025-09-19T17:33:01.446062] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-19T17:33:01.858704] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-19T17:33:01.858800] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-19T17:33:01.858941] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-19T17:33:01.858979] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-19T17:33:01.859368] [DEBUG] [LOCAL ] BEPJ: Trimmed 4557 records to 3320 (keeping 200 days of data) [2025-09-19T17:33:01.883324] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3320 records). [2025-09-19T17:33:01.883463] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-19T17:33:01.883577] [INFO ] [MAIN ] Update Progress: 252/2372 symbols completed. BEPJ took 31.3s. Estimated remaining: 4h 37m 17s. Rate: 7.6 symbols/min [2025-09-19T17:33:02.059167] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:02.120521] [DEBUG] [LOCAL ] BFLY: Loaded 52218 existing records from primary storage. [2025-09-19T17:33:02.120724] [INFO ] [MAIN ] BFLY: Loaded 52218 existing records. [2025-09-19T17:33:02.248375] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-19T17:33:02.307487] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:02.307818] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-19T17:33:02.307869] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-19T17:33:02.309291] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-19T17:33:02.309355] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-19T17:33:02.711519] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:03.043262] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-19T17:33:03.843266] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-19T17:33:04.459337] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-19T17:33:04.643288] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-19T17:33:04.966831] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-19T17:33:05.183104] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:33:05.443261] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-19T17:33:05.657535] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T17:33:06.243257] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-19T17:33:06.803415] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (3.76 seconds). [2025-09-19T17:33:07.049904] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-19T17:33:07.051811] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T17:33:07.056488] [INFO ] [REMOTE ] BFK: Full fetch complete (19368 records). [2025-09-19T17:33:07.056639] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-19T17:33:07.424406] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:33:07.463483] [INFO ] [REMOTE ] BFAM: Full fetch complete (47023 records). [2025-09-19T17:33:07.463610] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-19T17:33:07.463736] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-19T17:33:07.464190] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-19T17:33:07.463839] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-19T17:33:07.464399] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-19T17:33:07.538982] [DEBUG] [LOCAL ] BFK: Trimmed 19368 records to 14286 (keeping 200 days of data) [2025-09-19T17:33:07.847940] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-19T17:33:07.938879] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-19T17:33:07.939575] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-19T17:33:07.941011] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-19T17:33:07.941385] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-19T17:33:07.945736] [DEBUG] [LOCAL ] BFAM: Trimmed 47023 records to 33457 (keeping 200 days of data) [2025-09-19T17:33:07.951207] [DEBUG] [LOCAL ] BFK: Primary data saved (14286 records). [2025-09-19T17:33:07.951321] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-19T17:33:07.951424] [INFO ] [MAIN ] Update Progress: 253/2372 symbols completed. BFK took 27.8s. Estimated remaining: 4h 36m 54s. Rate: 7.7 symbols/min [2025-09-19T17:33:08.222612] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:08.241937] [DEBUG] [LOCAL ] BFS: Loaded 9113 existing records from primary storage. [2025-09-19T17:33:08.245820] [INFO ] [MAIN ] BFS: Loaded 9113 existing records. [2025-09-19T17:33:08.545236] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:08.546737] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:33:08.547342] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-19T17:33:08.552806] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-19T17:33:08.557800] [INFO ] [REMOTE ] BFH: Full fetch complete (59578 records). [2025-09-19T17:33:08.567511] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-19T17:33:08.568386] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-19T17:33:08.569208] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-19T17:33:08.583101] [DEBUG] [LOCAL ] BFAM: Primary data saved (33457 records). [2025-09-19T17:33:08.629109] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-19T17:33:08.657018] [INFO ] [MAIN ] Update Progress: 254/2372 symbols completed. BFAM took 37.1s. Estimated remaining: 4h 35m 47s. Rate: 7.7 symbols/min [2025-09-19T17:33:09.170487] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:09.426927] [DEBUG] [LOCAL ] BFZ: Loaded 11514 existing records from primary storage. [2025-09-19T17:33:09.471711] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:09.488558] [INFO ] [MAIN ] BFZ: Loaded 11514 existing records. [2025-09-19T17:33:09.483272] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-19T17:33:09.671165] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-19T17:33:09.682178] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-19T17:33:09.682935] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-19T17:33:09.683061] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-19T17:33:09.770838] [DEBUG] [LOCAL ] BFH: Trimmed 59578 records to 42563 (keeping 200 days of data) [2025-09-19T17:33:09.770532] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:09.771731] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-19T17:33:09.772123] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-19T17:33:09.772792] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-19T17:33:09.772854] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-19T17:33:10.263731] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:10.323508] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-19T17:33:10.404058] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T17:33:10.410784] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-19T17:33:10.414635] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-19T17:33:10.472683] [DEBUG] [LOCAL ] BFH: Primary data saved (42563 records). [2025-09-19T17:33:10.472848] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-19T17:33:10.472939] [INFO ] [MAIN ] Update Progress: 255/2372 symbols completed. BFH took 34.6s. Estimated remaining: 4h 34m 50s. Rate: 7.7 symbols/min [2025-09-19T17:33:10.642383] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:10.692386] [DEBUG] [LOCAL ] BG: Loaded 50741 existing records from primary storage. [2025-09-19T17:33:10.692538] [INFO ] [MAIN ] BG: Loaded 50741 existing records. [2025-09-19T17:33:10.869508] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:10.869781] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-19T17:33:10.869833] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-19T17:33:10.871191] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-19T17:33:10.871252] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-19T17:33:11.049296] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-19T17:33:11.232548] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:11.271370] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T17:33:11.362787] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T17:33:11.843335] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-19T17:33:12.643261] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-19T17:33:12.825883] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T17:33:13.328153] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T17:33:13.443219] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-19T17:33:14.243280] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-19T17:33:14.361481] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T17:33:15.043330] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-19T17:33:15.791785] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T17:33:15.843357] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-19T17:33:16.017721] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T17:33:16.050743] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-19T17:33:16.643290] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-19T17:33:16.676192] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-19T17:33:17.443337] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-19T17:33:18.132355] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T17:33:18.243292] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-19T17:33:18.282970] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T17:33:19.043283] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-19T17:33:19.843280] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-19T17:33:19.963765] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T17:33:20.014865] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T17:33:20.643379] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-19T17:33:21.443341] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-19T17:33:21.531960] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T17:33:22.243324] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-19T17:33:22.475394] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T17:33:22.948418] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-19T17:33:23.043291] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-19T17:33:23.532056] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T17:33:23.843289] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-19T17:33:24.556936] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T17:33:24.643273] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-19T17:33:24.917413] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-19T17:33:25.443298] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-19T17:33:26.044898] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T17:33:26.243264] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-19T17:33:26.292110] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T17:33:27.043300] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-19T17:33:27.300851] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T17:33:27.843258] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-19T17:33:28.643256] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-19T17:33:28.794263] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T17:33:29.098985] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:33:29.443346] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-19T17:33:30.122362] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T17:33:30.124564] [INFO ] [REMOTE ] BFS: Full fetch complete (12384 records). [2025-09-19T17:33:30.124673] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-19T17:33:30.253240] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-19T17:33:30.527517] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-19T17:33:30.527635] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-19T17:33:30.528059] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-19T17:33:30.528201] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-19T17:33:30.528992] [DEBUG] [LOCAL ] BFS: Trimmed 12384 records to 9166 (keeping 200 days of data) [2025-09-19T17:33:30.597372] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:33:30.624496] [DEBUG] [LOCAL ] BFS: Primary data saved (9166 records). [2025-09-19T17:33:30.624624] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-19T17:33:30.624740] [INFO ] [MAIN ] Update Progress: 256/2372 symbols completed. BFS took 22.7s. Estimated remaining: 4h 36m 24s. Rate: 7.7 symbols/min [2025-09-19T17:33:30.804194] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:30.823973] [DEBUG] [LOCAL ] BGB: Loaded 17754 existing records from primary storage. [2025-09-19T17:33:30.824105] [INFO ] [MAIN ] BGB: Loaded 17754 existing records. [2025-09-19T17:33:31.017601] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:31.017900] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-19T17:33:31.017975] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-19T17:33:31.018639] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-19T17:33:31.018735] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-19T17:33:31.053031] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-19T17:33:31.385736] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:31.751879] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T17:33:31.843273] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-19T17:33:32.643241] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-19T17:33:33.018520] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T17:33:33.152956] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:33:33.443288] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-19T17:33:34.067957] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:33:34.180417] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T17:33:34.183145] [INFO ] [REMOTE ] BFZ: Full fetch complete (17865 records). [2025-09-19T17:33:34.183217] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-19T17:33:34.248460] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-19T17:33:34.589397] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-19T17:33:34.589524] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-19T17:33:34.589927] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-19T17:33:34.589991] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-19T17:33:34.590831] [DEBUG] [LOCAL ] BFZ: Trimmed 17865 records to 11653 (keeping 200 days of data) [2025-09-19T17:33:34.662961] [DEBUG] [LOCAL ] BFZ: Primary data saved (11653 records). [2025-09-19T17:33:34.663111] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-19T17:33:34.663198] [INFO ] [MAIN ] Update Progress: 257/2372 symbols completed. BFZ took 26.0s. Estimated remaining: 4h 35m 45s. Rate: 7.7 symbols/min [2025-09-19T17:33:34.841690] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:34.860093] [DEBUG] [LOCAL ] BGH: Loaded 16601 existing records from primary storage. [2025-09-19T17:33:34.860222] [INFO ] [MAIN ] BGH: Loaded 16601 existing records. [2025-09-19T17:33:35.048952] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-19T17:33:35.048824] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:35.050425] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-19T17:33:35.050544] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-19T17:33:35.051273] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-19T17:33:35.051335] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-19T17:33:35.424217] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:35.618948] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T17:33:35.843271] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-19T17:33:36.643279] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-19T17:33:36.968984] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T17:33:37.442997] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T17:33:37.446036] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-19T17:33:38.243265] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-19T17:33:38.822986] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-19T17:33:39.043312] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-19T17:33:39.555978] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T17:33:39.576052] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:33:39.741309] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-19T17:33:39.843282] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-19T17:33:40.643299] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-19T17:33:40.871566] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T17:33:41.443289] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-19T17:33:42.243276] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-19T17:33:42.669159] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T17:33:43.043284] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-19T17:33:43.479959] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T17:33:43.488462] [INFO ] [REMOTE ] BG: Full fetch complete (72750 records). [2025-09-19T17:33:43.499060] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-19T17:33:43.500946] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T17:33:43.847229] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-19T17:33:43.905706] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-19T17:33:43.905826] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-19T17:33:43.906726] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-19T17:33:43.906794] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-19T17:33:43.908446] [DEBUG] [LOCAL ] BG: Trimmed 72750 records to 51108 (keeping 200 days of data) [2025-09-19T17:33:44.233087] [DEBUG] [LOCAL ] BG: Primary data saved (51108 records). [2025-09-19T17:33:44.233274] [INFO ] [MAIN ] BG: Full history saved. [2025-09-19T17:33:44.233379] [INFO ] [MAIN ] Update Progress: 258/2372 symbols completed. BG took 33.8s. Estimated remaining: 4h 35m 51s. Rate: 7.7 symbols/min [2025-09-19T17:33:44.402159] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:44.416565] [DEBUG] [LOCAL ] BGR: Loaded 13714 existing records from primary storage. [2025-09-19T17:33:44.416734] [INFO ] [MAIN ] BGR: Loaded 13714 existing records. [2025-09-19T17:33:44.607526] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:44.609102] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-19T17:33:44.608833] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:33:44.613279] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-19T17:33:44.614220] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-19T17:33:44.614297] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-19T17:33:44.648364] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-19T17:33:44.895295] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T17:33:45.024556] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:45.443273] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-19T17:33:46.088379] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T17:33:46.243284] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-19T17:33:46.296193] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T17:33:47.043284] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-19T17:33:47.843283] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-19T17:33:48.224781] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T17:33:48.516609] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:33:48.643252] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-19T17:33:48.988975] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T17:33:49.443330] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-19T17:33:50.243238] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-19T17:33:50.402884] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T17:33:50.410139] [INFO ] [REMOTE ] BFLY: Full fetch complete (75196 records). [2025-09-19T17:33:50.410260] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-19T17:33:50.804694] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-19T17:33:50.804816] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-19T17:33:50.806721] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-19T17:33:50.806786] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-19T17:33:50.808273] [DEBUG] [LOCAL ] BFLY: Trimmed 75196 records to 52606 (keeping 200 days of data) [2025-09-19T17:33:51.026495] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:33:51.044839] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-19T17:33:51.046791] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T17:33:51.140476] [DEBUG] [LOCAL ] BFLY: Primary data saved (52606 records). [2025-09-19T17:33:51.140611] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-19T17:33:51.140724] [INFO ] [MAIN ] Update Progress: 259/2372 symbols completed. BFLY took 49.3s. Estimated remaining: 4h 35m 36s. Rate: 7.7 symbols/min [2025-09-19T17:33:51.307933] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:51.356549] [DEBUG] [LOCAL ] BGS: Loaded 50790 existing records from primary storage. [2025-09-19T17:33:51.356713] [INFO ] [MAIN ] BGS: Loaded 50790 existing records. [2025-09-19T17:33:51.537543] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:51.537855] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-19T17:33:51.537913] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-19T17:33:51.539310] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-19T17:33:51.539372] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-19T17:33:51.852338] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-19T17:33:51.892705] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:52.136934] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T17:33:52.643239] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-19T17:33:52.862192] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T17:33:53.443285] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-19T17:33:53.822220] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T17:33:54.243242] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-19T17:33:54.319480] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T17:33:55.043285] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-19T17:33:55.843283] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-19T17:33:56.481711] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T17:33:56.502442] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T17:33:56.643234] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-19T17:33:57.096775] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-19T17:33:57.443269] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-19T17:33:57.752811] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T17:33:57.755477] [INFO ] [REMOTE ] BGB: Full fetch complete (26945 records). [2025-09-19T17:33:57.755560] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-19T17:33:58.138416] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-19T17:33:58.138498] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-19T17:33:58.138902] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-19T17:33:58.138965] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-19T17:33:58.139612] [DEBUG] [LOCAL ] BGB: Trimmed 26945 records to 17835 (keeping 200 days of data) [2025-09-19T17:33:58.249441] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-19T17:33:58.249351] [DEBUG] [LOCAL ] BGB: Primary data saved (17835 records). [2025-09-19T17:33:58.249747] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-19T17:33:58.250618] [INFO ] [MAIN ] Update Progress: 260/2372 symbols completed. BGB took 27.6s. Estimated remaining: 4h 35m 22s. Rate: 7.7 symbols/min [2025-09-19T17:33:58.430713] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:33:58.438700] [DEBUG] [LOCAL ] BGSF: Loaded 6142 existing records from primary storage. [2025-09-19T17:33:58.438820] [INFO ] [MAIN ] BGSF: Loaded 6142 existing records. [2025-09-19T17:33:58.618917] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:33:58.619260] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-19T17:33:58.619330] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-19T17:33:58.619740] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-19T17:33:58.619803] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-19T17:33:58.980776] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T17:33:59.013258] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:33:59.043258] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-19T17:33:59.693448] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:33:59.843272] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-19T17:34:00.643277] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-19T17:34:00.827058] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T17:34:00.864092] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T17:34:01.435872] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T17:34:01.443212] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-19T17:34:02.110874] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-19T17:34:02.243262] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-19T17:34:03.043271] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-19T17:34:03.305825] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T17:34:03.698848] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T17:34:03.843277] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-19T17:34:04.643285] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-19T17:34:04.972074] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T17:34:04.975107] [INFO ] [REMOTE ] BGH: Full fetch complete (21752 records). [2025-09-19T17:34:04.975213] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-19T17:34:05.365237] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-19T17:34:05.365317] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-19T17:34:05.365684] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-19T17:34:05.365745] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-19T17:34:05.366388] [DEBUG] [LOCAL ] BGH: Trimmed 21752 records to 16671 (keeping 200 days of data) [2025-09-19T17:34:05.443627] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-19T17:34:05.467246] [DEBUG] [LOCAL ] BGH: Primary data saved (16671 records). [2025-09-19T17:34:05.467393] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-19T17:34:05.467501] [INFO ] [MAIN ] Update Progress: 261/2372 symbols completed. BGH took 30.8s. Estimated remaining: 4h 35m 10s. Rate: 7.7 symbols/min [2025-09-19T17:34:05.652016] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:05.676860] [DEBUG] [LOCAL ] BGT: Loaded 16821 existing records from primary storage. [2025-09-19T17:34:05.677009] [INFO ] [MAIN ] BGT: Loaded 16821 existing records. [2025-09-19T17:34:05.855606] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:05.855900] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-19T17:34:05.855957] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-19T17:34:05.856607] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-19T17:34:05.856698] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-19T17:34:05.999259] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T17:34:06.233070] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:06.243270] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-19T17:34:06.452328] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T17:34:06.945512] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T17:34:07.043312] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-19T17:34:07.843289] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-19T17:34:08.407080] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T17:34:08.643293] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-19T17:34:09.068274] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T17:34:09.443319] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-19T17:34:09.829033] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-19T17:34:10.243323] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-19T17:34:10.736373] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T17:34:11.004552] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T17:34:11.043279] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-19T17:34:11.843292] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-19T17:34:12.029090] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T17:34:12.643320] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-19T17:34:13.443454] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-19T17:34:13.589514] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:34:13.898995] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:34:14.243271] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-19T17:34:14.988109] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T17:34:15.043300] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-19T17:34:15.166352] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T17:34:15.843273] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-19T17:34:16.144204] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T17:34:16.146728] [INFO ] [REMOTE ] BGR: Full fetch complete (20352 records). [2025-09-19T17:34:16.146831] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-19T17:34:16.526366] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-19T17:34:16.526480] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-19T17:34:16.526853] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-19T17:34:16.526914] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-19T17:34:16.527530] [DEBUG] [LOCAL ] BGR: Trimmed 20352 records to 13798 (keeping 200 days of data) [2025-09-19T17:34:16.610691] [DEBUG] [LOCAL ] BGR: Primary data saved (13798 records). [2025-09-19T17:34:16.610836] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-19T17:34:16.610940] [INFO ] [MAIN ] Update Progress: 262/2372 symbols completed. BGR took 32.4s. Estimated remaining: 4h 35m 29s. Rate: 7.7 symbols/min [2025-09-19T17:34:16.648444] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-19T17:34:16.782214] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:16.794629] [DEBUG] [LOCAL ] BGX: Loaded 10952 existing records from primary storage. [2025-09-19T17:34:16.794776] [INFO ] [MAIN ] BGX: Loaded 10952 existing records. [2025-09-19T17:34:16.974813] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:16.975120] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-19T17:34:16.975179] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-19T17:34:16.975814] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-19T17:34:16.975874] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-19T17:34:17.332060] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:17.443315] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-19T17:34:17.932318] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T17:34:18.005150] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T17:34:18.243274] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-19T17:34:18.766037] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T17:34:18.768791] [INFO ] [REMOTE ] BGSF: Full fetch complete (7707 records). [2025-09-19T17:34:18.768863] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-19T17:34:19.051407] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-19T17:34:19.141178] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-19T17:34:19.141271] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-19T17:34:19.141485] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-19T17:34:19.141526] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-19T17:34:19.142073] [DEBUG] [LOCAL ] BGSF: Trimmed 7707 records to 6327 (keeping 200 days of data) [2025-09-19T17:34:19.177495] [DEBUG] [LOCAL ] BGSF: Primary data saved (6327 records). [2025-09-19T17:34:19.177628] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-19T17:34:19.177748] [INFO ] [MAIN ] Update Progress: 263/2372 symbols completed. BGSF took 20.9s. Estimated remaining: 4h 34m 38s. Rate: 7.7 symbols/min [2025-09-19T17:34:19.346736] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:19.369510] [DEBUG] [LOCAL ] BGY: Loaded 23265 existing records from primary storage. [2025-09-19T17:34:19.369630] [INFO ] [MAIN ] BGY: Loaded 23265 existing records. [2025-09-19T17:34:19.552034] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:19.552368] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-19T17:34:19.552442] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-19T17:34:19.562435] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-19T17:34:19.563161] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-19T17:34:19.563529] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T17:34:19.848400] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-19T17:34:19.956732] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:20.643297] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-19T17:34:21.134460] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:34:21.307381] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T17:34:21.364462] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-19T17:34:21.443295] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-19T17:34:22.234011] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T17:34:22.243215] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-19T17:34:23.043267] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-19T17:34:23.547752] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T17:34:23.843288] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-19T17:34:23.993741] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T17:34:24.643274] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-19T17:34:25.319704] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T17:34:25.443247] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-19T17:34:25.788723] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T17:34:26.243265] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-19T17:34:27.043275] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-19T17:34:27.456796] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T17:34:27.541777] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:34:27.801448] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:34:27.843257] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-19T17:34:28.643268] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-19T17:34:28.816637] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T17:34:29.443263] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-19T17:34:29.643370] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T17:34:30.243285] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-19T17:34:30.685744] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T17:34:31.043234] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-19T17:34:31.066703] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T17:34:31.843334] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-19T17:34:32.643347] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-19T17:34:33.022410] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:34:33.030046] [INFO ] [REMOTE ] BGS: Full fetch complete (72438 records). [2025-09-19T17:34:33.030177] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-19T17:34:33.355412] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T17:34:33.447923] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-19T17:34:33.473494] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-19T17:34:33.473380] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T17:34:33.473657] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-19T17:34:33.477705] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-19T17:34:33.477917] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-19T17:34:33.478013] [INFO ] [REMOTE ] BGT: Full fetch complete (24421 records). [2025-09-19T17:34:33.478215] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-19T17:34:33.585799] [DEBUG] [LOCAL ] BGS: Trimmed 72438 records to 51172 (keeping 200 days of data) [2025-09-19T17:34:33.979223] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-19T17:34:33.979846] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-19T17:34:33.980809] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-19T17:34:33.981164] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-19T17:34:33.983837] [DEBUG] [LOCAL ] BGT: Trimmed 24421 records to 16885 (keeping 200 days of data) [2025-09-19T17:34:34.095598] [DEBUG] [LOCAL ] BGT: Primary data saved (16885 records). [2025-09-19T17:34:34.099197] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-19T17:34:34.100011] [INFO ] [MAIN ] Update Progress: 264/2372 symbols completed. BGT took 28.6s. Estimated remaining: 4h 35m 27s. Rate: 7.7 symbols/min [2025-09-19T17:34:34.275026] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-19T17:34:34.394369] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:34:34.395592] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:34.422536] [DEBUG] [LOCAL ] BH: Loaded 15344 existing records from primary storage. [2025-09-19T17:34:34.423570] [INFO ] [MAIN ] BH: Loaded 15344 existing records. [2025-09-19T17:34:34.632828] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:34.633981] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-19T17:34:34.634334] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-19T17:34:34.636305] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-19T17:34:34.636388] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-19T17:34:35.043392] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-19T17:34:35.127011] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:35.133628] [DEBUG] [LOCAL ] BGS: Primary data saved (51172 records). [2025-09-19T17:34:35.133745] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-19T17:34:35.133823] [INFO ] [MAIN ] Update Progress: 265/2372 symbols completed. BGS took 44.0s. Estimated remaining: 4h 34m 25s. Rate: 7.7 symbols/min [2025-09-19T17:34:35.310926] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:35.355031] [DEBUG] [LOCAL ] BHC: Loaded 47122 existing records from primary storage. [2025-09-19T17:34:35.355198] [INFO ] [MAIN ] BHC: Loaded 47122 existing records. [2025-09-19T17:34:35.544743] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:35.545080] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-19T17:34:35.545166] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-19T17:34:35.551676] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-19T17:34:35.560202] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-19T17:34:35.593203] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T17:34:35.848354] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-19T17:34:35.932283] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:36.099270] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T17:34:36.643240] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-19T17:34:37.105835] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T17:34:37.284691] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T17:34:37.443277] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-19T17:34:38.243277] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-19T17:34:38.643858] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T17:34:39.043292] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-19T17:34:39.148410] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T17:34:39.843259] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-19T17:34:40.308832] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:34:40.568870] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T17:34:40.643279] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-19T17:34:41.443276] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-19T17:34:42.218303] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T17:34:42.245495] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-19T17:34:42.248918] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T17:34:43.043282] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-19T17:34:43.843325] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-19T17:34:44.023472] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T17:34:44.643224] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-19T17:34:44.734561] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T17:34:44.737062] [INFO ] [REMOTE ] BGX: Full fetch complete (15713 records). [2025-09-19T17:34:44.737134] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-19T17:34:45.119773] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-19T17:34:45.119878] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-19T17:34:45.120366] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-19T17:34:45.120492] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-19T17:34:45.121356] [DEBUG] [LOCAL ] BGX: Trimmed 15713 records to 10987 (keeping 200 days of data) [2025-09-19T17:34:45.195794] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T17:34:45.225057] [DEBUG] [LOCAL ] BGX: Primary data saved (10987 records). [2025-09-19T17:34:45.225219] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-19T17:34:45.225311] [INFO ] [MAIN ] Update Progress: 266/2372 symbols completed. BGX took 28.6s. Estimated remaining: 4h 34m 36s. Rate: 7.7 symbols/min [2025-09-19T17:34:45.403583] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:45.429971] [DEBUG] [LOCAL ] BHE: Loaded 25630 existing records from primary storage. [2025-09-19T17:34:45.430114] [INFO ] [MAIN ] BHE: Loaded 25630 existing records. [2025-09-19T17:34:45.450977] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-19T17:34:45.616381] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:45.622252] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-19T17:34:45.630565] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-19T17:34:45.631683] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T17:34:45.636511] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-19T17:34:45.637076] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-19T17:34:46.003076] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:34:46.243287] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-19T17:34:46.772807] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T17:34:47.043280] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-19T17:34:47.501563] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T17:34:47.843295] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-19T17:34:48.319513] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T17:34:48.643234] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-19T17:34:49.187847] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T17:34:49.443266] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-19T17:34:49.956092] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T17:34:50.243260] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-19T17:34:50.832350] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T17:34:51.043274] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-19T17:34:51.843285] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-19T17:34:52.031230] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T17:34:52.184547] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:34:52.643272] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-19T17:34:53.443279] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-19T17:34:53.595037] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:34:53.897921] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T17:34:54.212384] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T17:34:54.243331] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-19T17:34:55.043266] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-19T17:34:55.570503] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T17:34:55.843265] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-19T17:34:56.051487] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T17:34:56.643262] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-19T17:34:57.443266] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-19T17:34:57.638911] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T17:34:58.115926] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:34:58.243271] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-19T17:34:58.800307] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T17:34:58.803468] [INFO ] [REMOTE ] BH: Full fetch complete (19196 records). [2025-09-19T17:34:58.803546] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-19T17:34:59.050574] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-19T17:34:59.180063] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-19T17:34:59.180155] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-19T17:34:59.180581] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-19T17:34:59.180631] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-19T17:34:59.181473] [DEBUG] [LOCAL ] BH: Trimmed 19196 records to 15496 (keeping 200 days of data) [2025-09-19T17:34:59.279679] [DEBUG] [LOCAL ] BH: Primary data saved (15496 records). [2025-09-19T17:34:59.279844] [INFO ] [MAIN ] BH: Full history saved. [2025-09-19T17:34:59.279953] [INFO ] [MAIN ] Update Progress: 267/2372 symbols completed. BH took 25.2s. Estimated remaining: 4h 35m 17s. Rate: 7.6 symbols/min [2025-09-19T17:34:59.463333] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:34:59.489283] [DEBUG] [LOCAL ] BHK: Loaded 22566 existing records from primary storage. [2025-09-19T17:34:59.489433] [INFO ] [MAIN ] BHK: Loaded 22566 existing records. [2025-09-19T17:34:59.683358] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:34:59.701276] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:34:59.701616] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-19T17:34:59.701700] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-19T17:34:59.702571] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-19T17:34:59.702676] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-19T17:34:59.749193] [INFO ] [REMOTE ] BGY: Full fetch complete (33529 records). [2025-09-19T17:34:59.771713] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-19T17:34:59.868631] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-19T17:35:00.462800] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:00.539242] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-19T17:35:00.539403] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-19T17:35:00.540029] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-19T17:35:00.540152] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-19T17:35:00.559544] [DEBUG] [LOCAL ] BGY: Trimmed 33529 records to 23356 (keeping 200 days of data) [2025-09-19T17:35:00.560829] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T17:35:00.666112] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-19T17:35:00.719593] [DEBUG] [LOCAL ] BGY: Primary data saved (23356 records). [2025-09-19T17:35:00.719769] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-19T17:35:00.719866] [INFO ] [MAIN ] Update Progress: 268/2372 symbols completed. BGY took 41.5s. Estimated remaining: 4h 34m 19s. Rate: 7.7 symbols/min [2025-09-19T17:35:00.893767] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:00.958017] [DEBUG] [LOCAL ] BHP: Loaded 53780 existing records from primary storage. [2025-09-19T17:35:00.958209] [INFO ] [MAIN ] BHP: Loaded 53780 existing records. [2025-09-19T17:35:01.134486] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:01.134795] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-19T17:35:01.134857] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-19T17:35:01.136574] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-19T17:35:01.136663] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-19T17:35:01.451375] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-19T17:35:01.491905] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:01.529593] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:35:02.206153] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T17:35:02.243294] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-19T17:35:02.920505] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T17:35:03.043246] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-19T17:35:03.129090] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T17:35:03.843345] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-19T17:35:04.016090] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T17:35:04.643263] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-19T17:35:05.443277] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-19T17:35:05.942987] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T17:35:06.018991] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T17:35:06.023168] [INFO ] [REMOTE ] BHE: Full fetch complete (36571 records). [2025-09-19T17:35:06.023385] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-19T17:35:06.248362] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-19T17:35:06.417979] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-19T17:35:06.418074] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-19T17:35:06.418841] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-19T17:35:06.418927] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-19T17:35:06.420533] [DEBUG] [LOCAL ] BHE: Trimmed 36571 records to 25840 (keeping 200 days of data) [2025-09-19T17:35:06.582919] [DEBUG] [LOCAL ] BHE: Primary data saved (25840 records). [2025-09-19T17:35:06.583051] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-19T17:35:06.583212] [INFO ] [MAIN ] Update Progress: 269/2372 symbols completed. BHE took 21.4s. Estimated remaining: 4h 33m 56s. Rate: 7.7 symbols/min [2025-09-19T17:35:06.750984] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:06.774988] [DEBUG] [LOCAL ] BHR: Loaded 21610 existing records from primary storage. [2025-09-19T17:35:06.775122] [INFO ] [MAIN ] BHR: Loaded 21610 existing records. [2025-09-19T17:35:06.955914] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:06.965258] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-19T17:35:06.966565] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T17:35:06.966042] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-19T17:35:06.970590] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-19T17:35:06.970730] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-19T17:35:07.048328] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-19T17:35:07.343824] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:07.843232] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-19T17:35:08.430757] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T17:35:08.553430] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T17:35:08.643245] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-19T17:35:09.306215] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T17:35:09.443273] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-19T17:35:10.243258] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-19T17:35:10.336950] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T17:35:10.767221] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T17:35:11.043283] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-19T17:35:11.450719] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T17:35:11.843267] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-19T17:35:12.643253] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-19T17:35:12.683794] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:35:13.037693] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T17:35:13.443267] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-19T17:35:14.049622] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T17:35:14.243272] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-19T17:35:15.043297] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-19T17:35:15.620461] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T17:35:15.779753] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:35:15.843228] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-19T17:35:16.565601] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:35:16.604950] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T17:35:16.643224] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-19T17:35:17.443307] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-19T17:35:18.008739] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:35:18.243284] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-19T17:35:19.043295] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-19T17:35:19.651560] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T17:35:19.764789] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T17:35:19.843323] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-19T17:35:20.455538] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T17:35:20.643272] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-19T17:35:21.443266] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-19T17:35:22.101904] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T17:35:22.143191] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:35:22.156758] [INFO ] [REMOTE ] BHC: Full fetch complete (66688 records). [2025-09-19T17:35:22.156939] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-19T17:35:22.251144] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-19T17:35:22.582989] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-19T17:35:22.583092] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-19T17:35:22.583815] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-19T17:35:22.583883] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-19T17:35:22.585342] [DEBUG] [LOCAL ] BHC: Trimmed 66688 records to 47463 (keeping 200 days of data) [2025-09-19T17:35:22.877611] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T17:35:22.890616] [DEBUG] [LOCAL ] BHC: Primary data saved (47463 records). [2025-09-19T17:35:22.890742] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-19T17:35:22.890867] [INFO ] [MAIN ] Update Progress: 270/2372 symbols completed. BHC took 47.8s. Estimated remaining: 4h 34m 54s. Rate: 7.6 symbols/min [2025-09-19T17:35:23.060944] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:23.043235] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-19T17:35:23.061945] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-19T17:35:23.061997] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-19T17:35:23.062183] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-19T17:35:23.062236] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-19T17:35:23.062278] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-19T17:35:23.062309] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-19T17:35:23.438216] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:23.691424] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:35:23.843215] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-19T17:35:23.867841] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T17:35:24.383920] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T17:35:24.643268] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-19T17:35:25.443330] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-19T17:35:25.807027] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T17:35:25.865351] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-19T17:35:26.243336] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-19T17:35:27.043291] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-19T17:35:27.813698] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T17:35:27.843229] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-19T17:35:28.643309] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-19T17:35:29.213600] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T17:35:29.237878] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T17:35:29.242581] [INFO ] [REMOTE ] BHR: Full fetch complete (30488 records). [2025-09-19T17:35:29.242769] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-19T17:35:29.457488] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-19T17:35:29.675676] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-19T17:35:29.675788] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-19T17:35:29.676341] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-19T17:35:29.676419] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-19T17:35:29.695021] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T17:35:29.701144] [DEBUG] [LOCAL ] BHR: Trimmed 30488 records to 21774 (keeping 200 days of data) [2025-09-19T17:35:29.703742] [INFO ] [REMOTE ] BHK: Full fetch complete (29604 records). [2025-09-19T17:35:29.703910] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-19T17:35:30.194692] [DEBUG] [LOCAL ] BHR: Primary data saved (21774 records). [2025-09-19T17:35:30.223533] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-19T17:35:30.243243] [INFO ] [MAIN ] Update Progress: 271/2372 symbols completed. BHR took 23.7s. Estimated remaining: 4h 34m 42s. Rate: 7.6 symbols/min [2025-09-19T17:35:30.276994] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-19T17:35:30.276251] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-19T17:35:30.277541] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-19T17:35:30.279089] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-19T17:35:30.284357] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-19T17:35:30.376382] [DEBUG] [LOCAL ] BHK: Trimmed 29604 records to 22707 (keeping 200 days of data) [2025-09-19T17:35:30.523920] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:30.625239] [DEBUG] [LOCAL ] BHK: Primary data saved (22707 records). [2025-09-19T17:35:30.625393] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-19T17:35:30.625490] [INFO ] [MAIN ] Update Progress: 272/2372 symbols completed. BHK took 31.3s. Estimated remaining: 4h 33m 37s. Rate: 7.7 symbols/min [2025-09-19T17:35:30.743974] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-19T17:35:30.760231] [DEBUG] [LOCAL ] BHVN: Loaded 49937 existing records from primary storage. [2025-09-19T17:35:30.839722] [INFO ] [MAIN ] BHVN: Loaded 49937 existing records. [2025-09-19T17:35:30.987546] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:31.044012] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-19T17:35:31.106581] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:31.106871] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-19T17:35:31.106923] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-19T17:35:31.108471] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-19T17:35:31.108535] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-19T17:35:31.400718] [DEBUG] [LOCAL ] BILL: Loaded 52709 existing records from primary storage. [2025-09-19T17:35:31.412803] [INFO ] [MAIN ] BILL: Loaded 52709 existing records. [2025-09-19T17:35:31.556502] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T17:35:31.656843] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:31.729005] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:31.729406] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-19T17:35:31.729514] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-19T17:35:31.731543] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-19T17:35:31.731603] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-19T17:35:31.847687] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-19T17:35:32.153999] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-19T17:35:32.158728] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:32.643259] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-19T17:35:33.443307] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-19T17:35:33.841025] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T17:35:33.870837] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-19T17:35:34.253996] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-19T17:35:34.257163] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T17:35:34.643111] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T17:35:35.043305] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-19T17:35:35.337220] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-19T17:35:35.843308] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-19T17:35:36.643281] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-19T17:35:37.443298] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-19T17:35:37.648969] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:35:38.243313] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-19T17:35:38.289513] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T17:35:39.043286] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-19T17:35:39.442742] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:35:39.843302] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-19T17:35:40.643260] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-19T17:35:40.692780] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T17:35:40.888203] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-19T17:35:41.071629] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-19T17:35:41.443287] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-19T17:35:42.243273] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-19T17:35:42.289887] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-19T17:35:42.679691] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-19T17:35:43.043270] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-19T17:35:43.196997] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:35:43.843279] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-19T17:35:44.643287] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-19T17:35:44.819919] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T17:35:45.295519] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-19T17:35:45.296462] [INFO ] [REMOTE ] BHV: Full fetch complete (1394 records). [2025-09-19T17:35:45.296531] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-19T17:35:45.448419] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-19T17:35:45.488363] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-19T17:35:45.488730] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:35:45.488816] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:35:45.488930] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-19T17:35:45.489033] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-19T17:35:45.489090] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-19T17:35:45.489154] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-19T17:35:45.489254] [INFO ] [MAIN ] Update Progress: 273/2372 symbols completed. BHV took 22.6s. Estimated remaining: 4h 34m 23s. Rate: 7.6 symbols/min [2025-09-19T17:35:45.671097] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:45.701189] [DEBUG] [LOCAL ] BIO: Loaded 25946 existing records from primary storage. [2025-09-19T17:35:45.701338] [INFO ] [MAIN ] BIO: Loaded 25946 existing records. [2025-09-19T17:35:45.888418] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:45.888915] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-19T17:35:45.889017] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-19T17:35:45.889719] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-19T17:35:45.889781] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-19T17:35:46.259242] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T17:35:46.306131] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:46.264447] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-19T17:35:47.043264] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-19T17:35:47.562371] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T17:35:47.843283] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-19T17:35:48.458987] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:35:48.604279] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T17:35:48.614279] [INFO ] [REMOTE ] BHP: Full fetch complete (77242 records). [2025-09-19T17:35:48.614460] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-19T17:35:48.648527] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-19T17:35:49.016037] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-19T17:35:49.016123] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-19T17:35:49.017042] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-19T17:35:49.017119] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-19T17:35:49.018590] [DEBUG] [LOCAL ] BHP: Trimmed 77242 records to 54166 (keeping 200 days of data) [2025-09-19T17:35:49.371508] [DEBUG] [LOCAL ] BHP: Primary data saved (54166 records). [2025-09-19T17:35:49.371709] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-19T17:35:49.371810] [INFO ] [MAIN ] Update Progress: 274/2372 symbols completed. BHP took 48.7s. Estimated remaining: 4h 33m 45s. Rate: 7.7 symbols/min [2025-09-19T17:35:49.448422] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-19T17:35:49.545299] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:35:49.584140] [DEBUG] [LOCAL ] BIP: Loaded 40063 existing records from primary storage. [2025-09-19T17:35:49.584278] [INFO ] [MAIN ] BIP: Loaded 40063 existing records. [2025-09-19T17:35:49.763728] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:35:49.764050] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-19T17:35:49.764113] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-19T17:35:49.765141] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-19T17:35:49.765201] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-19T17:35:50.084540] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T17:35:50.169263] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:35:50.179340] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T17:35:50.243251] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-19T17:35:51.043270] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-19T17:35:51.231273] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T17:35:51.843284] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-19T17:35:52.052278] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:35:52.431243] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T17:35:52.643224] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-19T17:35:53.159957] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T17:35:53.443241] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-19T17:35:54.187607] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:35:54.243221] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-19T17:35:54.951452] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T17:35:55.043272] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-19T17:35:55.843261] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-19T17:35:55.871143] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:35:56.541739] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T17:35:56.643270] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-19T17:35:57.133304] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:35:57.443268] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-19T17:35:58.243281] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-19T17:35:58.576980] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T17:35:59.043270] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-19T17:35:59.673503] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T17:35:59.843269] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-19T17:36:00.181221] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T17:36:00.643278] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-19T17:36:01.128427] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T17:36:01.223054] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T17:36:01.443309] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-19T17:36:01.796779] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T17:36:02.243308] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-19T17:36:03.043278] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-19T17:36:03.843284] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-19T17:36:04.676099] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (3.23 seconds). [2025-09-19T17:36:04.687870] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-19T17:36:05.169681] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T17:36:05.342887] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (3.10 seconds). [2025-09-19T17:36:05.443276] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-19T17:36:06.243329] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-19T17:36:06.422913] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T17:36:06.555049] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (3.51 seconds). [2025-09-19T17:36:06.562610] [INFO ] [REMOTE ] BHVN: Full fetch complete (69169 records). [2025-09-19T17:36:06.562775] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-19T17:36:06.965599] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-19T17:36:06.966049] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-19T17:36:06.966873] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-19T17:36:06.966981] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-19T17:36:06.988361] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-19T17:36:06.987332] [DEBUG] [LOCAL ] BHVN: Trimmed 69169 records to 50308 (keeping 200 days of data) [2025-09-19T17:36:06.996420] [INFO ] [REMOTE ] BILL: Full fetch complete (75177 records). [2025-09-19T17:36:06.996897] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-19T17:36:06.998337] [FATAL] [VALIDATOR ] BILL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:36:06.998510] [FATAL] [MAIN ] BILL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:36:06.998612] [WARN ] [MAIN ] BILL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:36:06.998744] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-19T17:36:06.998872] [DEBUG] [LOCAL ] BILL: No primary data file found to delete. [2025-09-19T17:36:06.998963] [INFO ] [LOCAL ] BILL: Starting deletion of derivative data. [2025-09-19T17:36:06.999623] [DEBUG] [LOCAL ] BILL: Deleted derivative data file. [2025-09-19T17:36:06.999814] [INFO ] [MAIN ] Update Progress: 275/2372 symbols completed. BILL took 36.4s. Estimated remaining: 4h 34m 52s. Rate: 7.6 symbols/min [2025-09-19T17:36:07.051714] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-19T17:36:07.282862] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:07.439017] [DEBUG] [LOCAL ] BIPC: Loaded 42113 existing records from primary storage. [2025-09-19T17:36:07.440189] [INFO ] [MAIN ] BIPC: Loaded 42113 existing records. [2025-09-19T17:36:07.688765] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:07.719314] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-19T17:36:07.719126] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T17:36:07.732475] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-19T17:36:07.744580] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-19T17:36:07.745027] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-19T17:36:07.860513] [DEBUG] [LOCAL ] BHVN: Primary data saved (50308 records). [2025-09-19T17:36:07.864058] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-19T17:36:07.860396] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-19T17:36:07.864279] [INFO ] [MAIN ] Update Progress: 276/2372 symbols completed. BHVN took 37.6s. Estimated remaining: 4h 33m 51s. Rate: 7.7 symbols/min [2025-09-19T17:36:08.302523] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:08.307745] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:08.312452] [DEBUG] [LOCAL ] BIPH: Loaded 2641 existing records from primary storage. [2025-09-19T17:36:08.312540] [INFO ] [MAIN ] BIPH: Loaded 2641 existing records. [2025-09-19T17:36:08.502928] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:08.503383] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-19T17:36:08.503479] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-19T17:36:08.503876] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-19T17:36:08.504010] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-19T17:36:08.670667] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-19T17:36:08.672234] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T17:36:08.891988] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:09.443316] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-19T17:36:09.775183] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:36:10.243317] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-19T17:36:10.275240] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T17:36:10.477591] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:36:11.043305] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-19T17:36:11.524891] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T17:36:11.843291] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-19T17:36:12.026907] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T17:36:12.643303] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-19T17:36:13.443287] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-19T17:36:14.134268] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T17:36:14.243262] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-19T17:36:14.368989] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T17:36:14.859688] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T17:36:14.866111] [INFO ] [REMOTE ] BIP: Full fetch complete (56260 records). [2025-09-19T17:36:14.866262] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-19T17:36:15.054326] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-19T17:36:15.270146] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-19T17:36:15.270263] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-19T17:36:15.271841] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-19T17:36:15.271908] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-19T17:36:15.273199] [DEBUG] [LOCAL ] BIP: Trimmed 56260 records to 40386 (keeping 200 days of data) [2025-09-19T17:36:15.520503] [DEBUG] [LOCAL ] BIP: Primary data saved (40386 records). [2025-09-19T17:36:15.520636] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-19T17:36:15.520775] [INFO ] [MAIN ] Update Progress: 277/2372 symbols completed. BIP took 26.1s. Estimated remaining: 4h 33m 42s. Rate: 7.7 symbols/min [2025-09-19T17:36:15.843252] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-19T17:36:15.906614] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T17:36:16.114216] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T17:36:16.117446] [INFO ] [REMOTE ] BIO: Full fetch complete (34177 records). [2025-09-19T17:36:16.117536] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-19T17:36:16.503566] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-19T17:36:16.503678] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-19T17:36:16.504221] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-19T17:36:16.504282] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-19T17:36:16.505227] [DEBUG] [LOCAL ] BIO: Trimmed 34177 records to 26070 (keeping 200 days of data) [2025-09-19T17:36:16.654463] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-19T17:36:16.654629] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T17:36:16.669814] [DEBUG] [LOCAL ] BIO: Primary data saved (26070 records). [2025-09-19T17:36:16.670002] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-19T17:36:16.670115] [INFO ] [MAIN ] Update Progress: 278/2372 symbols completed. BIO took 31.2s. Estimated remaining: 4h 32m 43s. Rate: 7.7 symbols/min [2025-09-19T17:36:17.443393] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-19T17:36:18.157386] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-19T17:36:18.243264] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-19T17:36:18.567276] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T17:36:18.856873] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-19T17:36:19.043300] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-19T17:36:19.705322] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T17:36:19.843249] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-19T17:36:20.381615] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T17:36:20.643275] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-19T17:36:21.443314] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-19T17:36:21.791691] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-19T17:36:22.243289] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-19T17:36:22.352552] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T17:36:23.043265] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-19T17:36:23.103260] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T17:36:23.104241] [INFO ] [REMOTE ] BIPH: Full fetch complete (4341 records). [2025-09-19T17:36:23.104312] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-19T17:36:23.467180] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-19T17:36:23.467259] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-19T17:36:23.467405] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-19T17:36:23.467445] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-19T17:36:23.467845] [DEBUG] [LOCAL ] BIPH: Trimmed 4341 records to 2654 (keeping 200 days of data) [2025-09-19T17:36:23.484237] [DEBUG] [LOCAL ] BIPH: Primary data saved (2654 records). [2025-09-19T17:36:23.484329] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-19T17:36:23.484408] [INFO ] [MAIN ] Update Progress: 279/2372 symbols completed. BIPH took 15.6s. Estimated remaining: 4h 32m 28s. Rate: 7.7 symbols/min [2025-09-19T17:36:24.927605] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T17:36:24.937265] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-19T17:36:26.574824] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T17:36:26.583379] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-19T17:36:27.951959] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:36:27.961325] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-19T17:36:29.728248] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T17:36:29.737535] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-19T17:36:31.945946] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T17:36:31.954255] [INFO ] [REMOTE ] BIPC: Full fetch complete (59409 records). [2025-09-19T17:36:31.954435] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-19T17:36:32.360703] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-19T17:36:32.360794] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-19T17:36:32.361435] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-19T17:36:32.361477] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-19T17:36:32.362767] [DEBUG] [LOCAL ] BIPC: Trimmed 59409 records to 42343 (keeping 200 days of data) [2025-09-19T17:36:32.618936] [DEBUG] [LOCAL ] BIPC: Primary data saved (42343 records). [2025-09-19T17:36:32.619069] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-19T17:36:32.619911] [INFO ] [MAIN ] Update Progress: 280/2372 symbols completed. BIPC took 25.6s. Estimated remaining: 4h 32m 30s. Rate: 7.7 symbols/min [2025-09-19T17:36:33.277608] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:33.346832] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:33.374681] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:33.379212] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:33.390470] [DEBUG] [LOCAL ] BIPI: Loaded 3452 existing records from primary storage. [2025-09-19T17:36:33.392517] [DEBUG] [LOCAL ] BIPJ: Loaded 2902 existing records from primary storage. [2025-09-19T17:36:33.392773] [INFO ] [MAIN ] BIPI: Loaded 3452 existing records. [2025-09-19T17:36:33.392690] [INFO ] [MAIN ] BIPJ: Loaded 2902 existing records. [2025-09-19T17:36:33.571038] [DEBUG] [LOCAL ] BIT: Loaded 22188 existing records from primary storage. [2025-09-19T17:36:33.592583] [INFO ] [MAIN ] BIT: Loaded 22188 existing records. [2025-09-19T17:36:33.822745] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:33.972868] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:33.949972] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-19T17:36:33.979237] [DEBUG] [LOCAL ] BIRK: Loaded 51180 existing records from primary storage. [2025-09-19T17:36:33.989912] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-19T17:36:34.006584] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-19T17:36:33.989813] [INFO ] [MAIN ] BIRK: Loaded 51180 existing records. [2025-09-19T17:36:34.021721] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-19T17:36:34.054042] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-19T17:36:34.077139] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-19T17:36:34.071965] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-19T17:36:34.110879] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:34.088330] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-19T17:36:34.221703] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-19T17:36:34.270182] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-19T17:36:34.297523] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-19T17:36:34.342081] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-19T17:36:34.528600] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:34.621769] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-19T17:36:34.637922] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-19T17:36:34.714526] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-19T17:36:34.714715] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-19T17:36:35.453102] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:35.527382] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:35.554384] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-19T17:36:35.563198] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-19T17:36:35.640742] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:35.653852] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-19T17:36:35.735257] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:35.735619] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-19T17:36:36.502828] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T17:36:36.504584] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-19T17:36:36.633522] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T17:36:36.637097] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-19T17:36:36.907371] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-19T17:36:36.909147] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-19T17:36:36.927962] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T17:36:36.933156] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-19T17:36:37.076865] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-19T17:36:37.078307] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-19T17:36:37.493810] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T17:36:37.496498] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-19T17:36:37.771371] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T17:36:37.773371] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-19T17:36:37.821490] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T17:36:37.836423] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-19T17:36:37.961366] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T17:36:37.967996] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-19T17:36:38.192823] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T17:36:38.195981] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-19T17:36:38.318266] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T17:36:38.320158] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-19T17:36:38.815173] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T17:36:38.925376] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T17:36:39.043253] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-19T17:36:39.234204] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T17:36:39.608747] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T17:36:39.843290] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-19T17:36:39.960311] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T17:36:40.615176] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T17:36:40.643231] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-19T17:36:41.443268] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-19T17:36:41.974416] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T17:36:42.243266] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-19T17:36:43.043269] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-19T17:36:43.266665] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:36:43.534350] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T17:36:43.579157] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:36:43.843266] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-19T17:36:44.643267] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-19T17:36:45.443292] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-19T17:36:45.482869] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-19T17:36:45.722436] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:36:45.825118] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T17:36:46.243273] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-19T17:36:47.043281] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-19T17:36:47.649772] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T17:36:47.843317] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-19T17:36:48.316505] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T17:36:48.643313] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-19T17:36:48.888672] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T17:36:49.443305] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-19T17:36:50.243305] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-19T17:36:50.672636] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:36:50.854323] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T17:36:51.043287] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-19T17:36:51.081615] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T17:36:51.522037] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T17:36:51.523275] [INFO ] [REMOTE ] BIPI: Full fetch complete (5300 records). [2025-09-19T17:36:51.523346] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-19T17:36:51.848362] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-19T17:36:51.893279] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-19T17:36:51.893370] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-19T17:36:51.893567] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-19T17:36:51.893605] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-19T17:36:51.894017] [DEBUG] [LOCAL ] BIPI: Trimmed 5300 records to 3466 (keeping 200 days of data) [2025-09-19T17:36:51.916262] [DEBUG] [LOCAL ] BIPI: Primary data saved (3466 records). [2025-09-19T17:36:51.916365] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-19T17:36:51.916456] [INFO ] [MAIN ] Update Progress: 281/2372 symbols completed. BIPI took 19.3s. Estimated remaining: 4h 33m 48s. Rate: 7.6 symbols/min [2025-09-19T17:36:52.086627] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:52.141203] [DEBUG] [LOCAL ] BJ: Loaded 51813 existing records from primary storage. [2025-09-19T17:36:52.141398] [INFO ] [MAIN ] BJ: Loaded 51813 existing records. [2025-09-19T17:36:52.322792] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:52.323044] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-19T17:36:52.323093] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-19T17:36:52.324549] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-19T17:36:52.324611] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-19T17:36:52.648401] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-19T17:36:52.689801] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:53.443273] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-19T17:36:53.547533] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T17:36:53.984160] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T17:36:54.243308] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-19T17:36:54.715698] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T17:36:55.043271] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-19T17:36:55.326706] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T17:36:55.332225] [INFO ] [REMOTE ] BIT: Full fetch complete (30965 records). [2025-09-19T17:36:55.332313] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-19T17:36:55.709738] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-19T17:36:55.709884] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-19T17:36:55.710346] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-19T17:36:55.710388] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-19T17:36:55.711159] [DEBUG] [LOCAL ] BIT: Trimmed 30965 records to 22461 (keeping 200 days of data) [2025-09-19T17:36:55.845014] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-19T17:36:55.850194] [DEBUG] [LOCAL ] BIT: Primary data saved (22461 records). [2025-09-19T17:36:55.850316] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-19T17:36:55.850407] [INFO ] [MAIN ] Update Progress: 282/2372 symbols completed. BIT took 23.2s. Estimated remaining: 4h 33m 11s. Rate: 7.7 symbols/min [2025-09-19T17:36:56.019988] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:56.079856] [DEBUG] [LOCAL ] BK: Loaded 53955 existing records from primary storage. [2025-09-19T17:36:56.080006] [INFO ] [MAIN ] BK: Loaded 53955 existing records. [2025-09-19T17:36:56.259014] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:56.259405] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-19T17:36:56.259470] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-19T17:36:56.261921] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-19T17:36:56.261984] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-19T17:36:56.355830] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T17:36:56.635150] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T17:36:56.651688] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-19T17:36:56.656826] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:57.014261] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-19T17:36:57.443275] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-19T17:36:58.117398] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T17:36:58.118789] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4263 records). [2025-09-19T17:36:58.118871] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-19T17:36:58.248359] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-19T17:36:58.495738] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-19T17:36:58.495830] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-19T17:36:58.496008] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-19T17:36:58.496047] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-19T17:36:58.496425] [DEBUG] [LOCAL ] BIPJ: Trimmed 4263 records to 2913 (keeping 200 days of data) [2025-09-19T17:36:58.514395] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2913 records). [2025-09-19T17:36:58.514471] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-19T17:36:58.514545] [INFO ] [MAIN ] Update Progress: 283/2372 symbols completed. BIPJ took 25.9s. Estimated remaining: 4h 32m 25s. Rate: 7.7 symbols/min [2025-09-19T17:36:58.683919] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:36:58.737364] [DEBUG] [LOCAL ] BKD: Loaded 50478 existing records from primary storage. [2025-09-19T17:36:58.737513] [INFO ] [MAIN ] BKD: Loaded 50478 existing records. [2025-09-19T17:36:58.920344] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:36:58.920593] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-19T17:36:58.920662] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-19T17:36:58.922175] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-19T17:36:58.922237] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-19T17:36:59.048521] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-19T17:36:59.304896] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:36:59.843262] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-19T17:37:00.643301] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-19T17:37:00.758109] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-19T17:37:01.443285] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-19T17:37:01.624289] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T17:37:01.834846] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T17:37:02.243249] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-19T17:37:02.649619] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:37:02.992400] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T17:37:03.043228] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-19T17:37:03.843312] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-19T17:37:04.413125] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:37:04.643291] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-19T17:37:05.027963] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:37:05.443271] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-19T17:37:05.834080] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T17:37:06.243274] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-19T17:37:06.400604] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:37:06.962209] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:37:07.043260] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-19T17:37:07.843269] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-19T17:37:08.415753] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T17:37:08.507457] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:37:08.516103] [INFO ] [REMOTE ] BIRK: Full fetch complete (72674 records). [2025-09-19T17:37:08.516259] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-19T17:37:08.648398] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-19T17:37:08.928174] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-19T17:37:08.928260] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-19T17:37:08.929151] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-19T17:37:08.929236] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-19T17:37:08.930943] [DEBUG] [LOCAL ] BIRK: Trimmed 72674 records to 51561 (keeping 200 days of data) [2025-09-19T17:37:09.228253] [DEBUG] [LOCAL ] BIRK: Primary data saved (51561 records). [2025-09-19T17:37:09.228393] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-19T17:37:09.228495] [INFO ] [MAIN ] Update Progress: 284/2372 symbols completed. BIRK took 36.6s. Estimated remaining: 4h 32m 38s. Rate: 7.7 symbols/min [2025-09-19T17:37:09.402675] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:09.402874] [DEBUG] [LOCAL ] BKE: No existing data file found in primary storage. [2025-09-19T17:37:09.402928] [WARN ] [MAIN ] BKE: No existing data found, performing full refresh instead. [2025-09-19T17:37:09.403082] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-19T17:37:09.403132] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-19T17:37:09.403174] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-09-19T17:37:09.403216] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-19T17:37:09.466358] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-19T17:37:09.760231] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:09.971402] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T17:37:10.243292] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-19T17:37:10.722451] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T17:37:10.761367] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T17:37:11.043283] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-19T17:37:11.843267] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-19T17:37:12.511230] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T17:37:12.643282] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-19T17:37:13.078803] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:37:13.163554] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T17:37:13.443378] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-19T17:37:13.886613] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T17:37:14.243334] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-19T17:37:15.043289] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-19T17:37:15.549938] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T17:37:15.843272] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-19T17:37:16.316298] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T17:37:16.643267] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-19T17:37:17.014510] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T17:37:17.443286] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-19T17:37:18.240796] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T17:37:18.251830] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-19T17:37:18.760518] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T17:37:19.018265] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T17:37:19.043231] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-19T17:37:19.645683] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T17:37:19.843295] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-19T17:37:20.270520] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:37:20.643304] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-19T17:37:21.443282] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-19T17:37:22.055582] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T17:37:22.243287] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-19T17:37:22.433026] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:37:23.043228] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-19T17:37:23.544893] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:37:23.843265] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-19T17:37:23.906137] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T17:37:24.643261] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-19T17:37:24.889809] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T17:37:25.443350] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-19T17:37:25.724050] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T17:37:26.243284] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-19T17:37:26.516459] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T17:37:26.778575] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T17:37:26.786757] [INFO ] [REMOTE ] BK: Full fetch complete (77490 records). [2025-09-19T17:37:26.786931] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-19T17:37:27.048422] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-19T17:37:27.198002] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-19T17:37:27.198141] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-19T17:37:27.199043] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-19T17:37:27.199157] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-19T17:37:27.201224] [DEBUG] [LOCAL ] BK: Trimmed 77490 records to 54345 (keeping 200 days of data) [2025-09-19T17:37:27.557993] [DEBUG] [LOCAL ] BK: Primary data saved (54345 records). [2025-09-19T17:37:27.558146] [INFO ] [MAIN ] BK: Full history saved. [2025-09-19T17:37:27.559338] [INFO ] [MAIN ] Update Progress: 285/2372 symbols completed. BK took 31.7s. Estimated remaining: 4h 33m 47s. Rate: 7.6 symbols/min [2025-09-19T17:37:27.736214] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:27.774460] [DEBUG] [LOCAL ] BKH: Loaded 37008 existing records from primary storage. [2025-09-19T17:37:27.774597] [INFO ] [MAIN ] BKH: Loaded 37008 existing records. [2025-09-19T17:37:27.848445] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-19T17:37:27.960301] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:37:27.960882] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-19T17:37:27.960973] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-19T17:37:27.962289] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-19T17:37:27.962378] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-19T17:37:28.313619] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:28.434690] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T17:37:28.444123] [INFO ] [REMOTE ] BJ: Full fetch complete (73716 records). [2025-09-19T17:37:28.444307] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-19T17:37:28.664791] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-19T17:37:28.897222] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-19T17:37:28.897419] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-19T17:37:28.898337] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-19T17:37:28.898445] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-19T17:37:28.926706] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T17:37:28.930115] [DEBUG] [LOCAL ] BJ: Trimmed 73716 records to 52202 (keeping 200 days of data) [2025-09-19T17:37:29.251270] [DEBUG] [LOCAL ] BJ: Primary data saved (52202 records). [2025-09-19T17:37:29.251407] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-19T17:37:29.251492] [INFO ] [MAIN ] Update Progress: 286/2372 symbols completed. BJ took 37.3s. Estimated remaining: 4h 32m 54s. Rate: 7.6 symbols/min [2025-09-19T17:37:29.423454] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:29.448137] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-19T17:37:29.465690] [DEBUG] [LOCAL ] BKKT: Loaded 34296 existing records from primary storage. [2025-09-19T17:37:29.465813] [INFO ] [MAIN ] BKKT: Loaded 34296 existing records. [2025-09-19T17:37:29.641586] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:37:29.641854] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-19T17:37:29.641908] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-19T17:37:29.642906] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-19T17:37:29.642967] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-19T17:37:29.999076] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:30.038369] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T17:37:30.162532] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:37:30.243212] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-19T17:37:31.043349] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-19T17:37:31.108449] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T17:37:31.843368] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-19T17:37:32.337000] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T17:37:32.344304] [INFO ] [REMOTE ] BKD: Full fetch complete (71361 records). [2025-09-19T17:37:32.344427] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-19T17:37:32.645289] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-19T17:37:32.741917] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-19T17:37:32.742152] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-19T17:37:32.743108] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-19T17:37:32.743177] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-19T17:37:32.744824] [DEBUG] [LOCAL ] BKD: Trimmed 71361 records to 50838 (keeping 200 days of data) [2025-09-19T17:37:33.059122] [DEBUG] [LOCAL ] BKD: Primary data saved (50838 records). [2025-09-19T17:37:33.059492] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-19T17:37:33.059681] [INFO ] [MAIN ] Update Progress: 287/2372 symbols completed. BKD took 34.5s. Estimated remaining: 4h 32m 17s. Rate: 7.7 symbols/min [2025-09-19T17:37:33.150807] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T17:37:33.183273] [INFO ] [REMOTE ] BKE: Full fetch complete (50318 records). [2025-09-19T17:37:33.209252] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-19T17:37:33.253904] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:33.445889] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-19T17:37:33.428075] [DEBUG] [LOCAL ] BKN: Loaded 7722 existing records from primary storage. [2025-09-19T17:37:33.446432] [INFO ] [MAIN ] BKN: Loaded 7722 existing records. [2025-09-19T17:37:33.512380] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-19T17:37:33.829533] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:37:33.886396] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-19T17:37:33.886228] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-19T17:37:33.886549] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-19T17:37:33.887414] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-19T17:37:33.887693] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-19T17:37:33.887505] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-19T17:37:33.889558] [DEBUG] [LOCAL ] BKE: Trimmed 50318 records to 35441 (keeping 200 days of data) [2025-09-19T17:37:33.890201] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-19T17:37:33.890612] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-19T17:37:34.143540] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T17:37:34.253263] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-19T17:37:34.472473] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:34.520337] [DEBUG] [LOCAL ] BKE: Primary data saved (35441 records). [2025-09-19T17:37:34.520455] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-19T17:37:34.520530] [INFO ] [MAIN ] Update Progress: 288/2372 symbols completed. BKE took 25.3s. Estimated remaining: 4h 31m 23s. Rate: 7.7 symbols/min [2025-09-19T17:37:34.692068] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:34.747692] [DEBUG] [LOCAL ] BKSY: Loaded 48677 existing records from primary storage. [2025-09-19T17:37:34.747848] [INFO ] [MAIN ] BKSY: Loaded 48677 existing records. [2025-09-19T17:37:34.928029] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:37:34.928263] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-19T17:37:34.928318] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-19T17:37:34.929762] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-19T17:37:34.929822] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-19T17:37:35.048341] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-19T17:37:35.306755] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:35.631639] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T17:37:35.843313] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-19T17:37:36.005008] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T17:37:36.299313] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T17:37:36.643280] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-19T17:37:37.047563] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T17:37:37.443320] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-19T17:37:38.243276] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-19T17:37:38.386856] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T17:37:38.445573] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T17:37:39.043311] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-19T17:37:39.607029] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T17:37:39.843285] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-19T17:37:40.643304] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-19T17:37:40.872937] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T17:37:40.902150] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T17:37:41.374599] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T17:37:41.443350] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-19T17:37:42.243302] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-19T17:37:43.030343] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T17:37:43.043207] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-19T17:37:43.843264] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-19T17:37:44.324139] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T17:37:44.426512] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:37:44.643271] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-19T17:37:45.066225] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T17:37:45.443292] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-19T17:37:46.243279] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-19T17:37:46.398713] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:37:46.471294] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T17:37:47.043339] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-19T17:37:47.800748] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:37:47.843229] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-19T17:37:48.643299] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-19T17:37:49.155006] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T17:37:49.291962] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T17:37:49.443222] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-19T17:37:49.574901] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T17:37:50.243264] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-19T17:37:51.043282] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-19T17:37:51.696082] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-19T17:37:51.731195] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T17:37:51.739985] [INFO ] [REMOTE ] BKH: Full fetch complete (52009 records). [2025-09-19T17:37:51.740166] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-19T17:37:51.849462] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-19T17:37:52.135274] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-19T17:37:52.135371] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-19T17:37:52.136084] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-19T17:37:52.136152] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-19T17:37:52.137302] [DEBUG] [LOCAL ] BKH: Trimmed 52009 records to 37246 (keeping 200 days of data) [2025-09-19T17:37:52.364004] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:37:52.398084] [DEBUG] [LOCAL ] BKH: Primary data saved (37246 records). [2025-09-19T17:37:52.398230] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-19T17:37:52.398735] [INFO ] [MAIN ] Update Progress: 289/2372 symbols completed. BKH took 24.8s. Estimated remaining: 4h 32m 28s. Rate: 7.6 symbols/min [2025-09-19T17:37:52.568465] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:37:52.568848] [DEBUG] [LOCAL ] BKT: No existing data file found in primary storage. [2025-09-19T17:37:52.568914] [WARN ] [MAIN ] BKT: No existing data found, performing full refresh instead. [2025-09-19T17:37:52.569147] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-19T17:37:52.569224] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-19T17:37:52.569315] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-09-19T17:37:52.569388] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-19T17:37:52.648337] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-19T17:37:52.943274] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:37:53.443297] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-19T17:37:53.851234] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T17:37:53.896561] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T17:37:54.243260] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-19T17:37:54.811790] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T17:37:55.043257] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-19T17:37:55.760315] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T17:37:55.843222] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-19T17:37:55.907638] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T17:37:56.643255] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-19T17:37:57.443240] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-19T17:37:57.520034] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T17:37:57.723374] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T17:37:58.243276] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-19T17:37:59.043280] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-19T17:37:59.180171] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T17:37:59.446683] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T17:37:59.843337] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-19T17:37:59.974623] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T17:38:00.618399] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T17:38:00.620182] [INFO ] [REMOTE ] BKN: Full fetch complete (12025 records). [2025-09-19T17:38:00.620253] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-19T17:38:00.649791] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-19T17:38:00.991099] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-19T17:38:00.991189] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-19T17:38:00.991564] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-19T17:38:00.991625] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-19T17:38:00.992269] [DEBUG] [LOCAL ] BKN: Trimmed 12025 records to 7752 (keeping 200 days of data) [2025-09-19T17:38:01.041610] [DEBUG] [LOCAL ] BKN: Primary data saved (7752 records). [2025-09-19T17:38:01.041804] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-19T17:38:01.041912] [INFO ] [MAIN ] Update Progress: 290/2372 symbols completed. BKN took 28.0s. Estimated remaining: 4h 32m 26s. Rate: 7.6 symbols/min [2025-09-19T17:38:01.225903] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:01.270196] [DEBUG] [LOCAL ] BKU: Loaded 42458 existing records from primary storage. [2025-09-19T17:38:01.270347] [INFO ] [MAIN ] BKU: Loaded 42458 existing records. [2025-09-19T17:38:01.447716] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-19T17:38:01.447936] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:01.449287] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-19T17:38:01.449350] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-19T17:38:01.450579] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-19T17:38:01.450670] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-19T17:38:01.815209] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:02.243262] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-19T17:38:02.899502] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T17:38:02.906159] [INFO ] [REMOTE ] BKKT: Full fetch complete (49434 records). [2025-09-19T17:38:02.906270] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-19T17:38:03.048791] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-19T17:38:03.306150] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-19T17:38:03.306267] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-19T17:38:03.306926] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-19T17:38:03.307000] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-19T17:38:03.308099] [DEBUG] [LOCAL ] BKKT: Trimmed 49434 records to 34629 (keeping 200 days of data) [2025-09-19T17:38:03.495676] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T17:38:03.521134] [DEBUG] [LOCAL ] BKKT: Primary data saved (34629 records). [2025-09-19T17:38:03.521290] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-19T17:38:03.521929] [INFO ] [MAIN ] Update Progress: 291/2372 symbols completed. BKKT took 34.3s. Estimated remaining: 4h 31m 40s. Rate: 7.7 symbols/min [2025-09-19T17:38:03.699400] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:03.731493] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-19T17:38:03.762498] [DEBUG] [LOCAL ] BKV: Loaded 30424 existing records from primary storage. [2025-09-19T17:38:03.762670] [INFO ] [MAIN ] BKV: Loaded 30424 existing records. [2025-09-19T17:38:03.851174] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-19T17:38:03.945944] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:03.946257] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-19T17:38:03.946339] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-19T17:38:03.947161] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-19T17:38:03.947258] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-19T17:38:04.320115] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:04.390506] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:38:04.643267] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-19T17:38:05.443307] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-19T17:38:05.556191] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T17:38:05.759223] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:38:06.243283] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-19T17:38:07.043478] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-19T17:38:07.506939] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:38:07.843279] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-19T17:38:07.982961] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T17:38:08.643241] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-19T17:38:08.687239] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T17:38:09.443240] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-19T17:38:09.540291] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T17:38:09.851701] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T17:38:10.243271] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-19T17:38:11.043271] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-19T17:38:11.249623] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T17:38:11.843262] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-19T17:38:12.353586] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T17:38:12.643260] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-19T17:38:12.761699] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T17:38:12.924730] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-19T17:38:12.932076] [INFO ] [REMOTE ] BKSY: Full fetch complete (69255 records). [2025-09-19T17:38:12.932227] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-19T17:38:13.319598] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-19T17:38:13.319725] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-19T17:38:13.320460] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-19T17:38:13.320504] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-19T17:38:13.322026] [DEBUG] [LOCAL ] BKSY: Trimmed 69255 records to 49065 (keeping 200 days of data) [2025-09-19T17:38:13.486635] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-19T17:38:13.609354] [DEBUG] [LOCAL ] BKSY: Primary data saved (49065 records). [2025-09-19T17:38:13.609493] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-19T17:38:13.609576] [INFO ] [MAIN ] Update Progress: 292/2372 symbols completed. BKSY took 39.1s. Estimated remaining: 4h 31m 48s. Rate: 7.7 symbols/min [2025-09-19T17:38:13.776338] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:13.812243] [DEBUG] [LOCAL ] BLCO: Loaded 36511 existing records from primary storage. [2025-09-19T17:38:13.812832] [INFO ] [MAIN ] BLCO: Loaded 36511 existing records. [2025-09-19T17:38:13.988555] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:13.988867] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-19T17:38:13.988921] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-19T17:38:13.989883] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-19T17:38:13.989943] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-19T17:38:14.248383] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-19T17:38:14.349440] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:14.463849] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T17:38:14.513802] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T17:38:15.043259] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-19T17:38:15.843269] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-19T17:38:16.066264] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:38:16.347518] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T17:38:16.643234] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-19T17:38:17.062280] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T17:38:17.443321] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-19T17:38:18.243274] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-19T17:38:18.650539] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:38:18.917616] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T17:38:19.043254] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-19T17:38:19.218170] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T17:38:19.693624] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T17:38:19.843236] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-19T17:38:20.627906] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T17:38:20.631328] [INFO ] [REMOTE ] BKT: Full fetch complete (14672 records). [2025-09-19T17:38:20.631435] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-19T17:38:20.631952] [FATAL] [VALIDATOR ] BKT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:38:20.632058] [FATAL] [MAIN ] BKT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:38:20.632155] [WARN ] [MAIN ] BKT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:38:20.632239] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-19T17:38:20.632307] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-09-19T17:38:20.632343] [INFO ] [LOCAL ] BKT: Starting deletion of derivative data. [2025-09-19T17:38:20.632399] [DEBUG] [LOCAL ] BKT: No derivative data file found to delete. [2025-09-19T17:38:20.632480] [INFO ] [MAIN ] Update Progress: 293/2372 symbols completed. BKT took 28.2s. Estimated remaining: 4h 31m 34s. Rate: 7.7 symbols/min [2025-09-19T17:38:20.653110] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-19T17:38:20.817980] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:20.856167] [DEBUG] [LOCAL ] BLD: Loaded 28388 existing records from primary storage. [2025-09-19T17:38:20.856332] [INFO ] [MAIN ] BLD: Loaded 28388 existing records. [2025-09-19T17:38:21.045302] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:21.045713] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-19T17:38:21.045773] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-19T17:38:21.046842] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-19T17:38:21.046905] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-19T17:38:21.448444] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-19T17:38:21.454741] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:22.243283] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-19T17:38:22.300766] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T17:38:22.793578] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T17:38:23.043262] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-19T17:38:23.843350] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-19T17:38:24.061327] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:38:24.177973] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T17:38:24.643279] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-19T17:38:25.443263] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-19T17:38:25.636209] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:38:26.243264] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-19T17:38:26.368557] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T17:38:26.780676] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:38:27.043288] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-19T17:38:27.843271] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-19T17:38:27.878632] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T17:38:28.108458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T17:38:28.643269] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-19T17:38:29.443276] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-19T17:38:29.860977] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:38:29.867470] [INFO ] [REMOTE ] BKU: Full fetch complete (59736 records). [2025-09-19T17:38:29.867633] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-19T17:38:30.249605] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-19T17:38:30.252675] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-19T17:38:30.253537] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-19T17:38:30.254264] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-19T17:38:30.254330] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-19T17:38:30.255729] [DEBUG] [LOCAL ] BKU: Trimmed 59736 records to 42752 (keeping 200 days of data) [2025-09-19T17:38:30.516806] [DEBUG] [LOCAL ] BKU: Primary data saved (42752 records). [2025-09-19T17:38:30.516940] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-19T17:38:30.517026] [INFO ] [MAIN ] Update Progress: 294/2372 symbols completed. BKU took 29.5s. Estimated remaining: 4h 31m 41s. Rate: 7.6 symbols/min [2025-09-19T17:38:30.729036] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:30.730389] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T17:38:30.760307] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:38:30.815001] [DEBUG] [LOCAL ] BLDR: Loaded 52011 existing records from primary storage. [2025-09-19T17:38:30.815172] [INFO ] [MAIN ] BLDR: Loaded 52011 existing records. [2025-09-19T17:38:31.008163] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:31.008489] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-19T17:38:31.008557] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-19T17:38:31.009895] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-19T17:38:31.009956] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-19T17:38:31.048354] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-19T17:38:31.395989] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:31.414779] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T17:38:31.843261] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-19T17:38:32.512617] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T17:38:32.643264] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-19T17:38:33.443283] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-19T17:38:33.599329] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T17:38:34.128670] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T17:38:34.243267] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-19T17:38:35.020004] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T17:38:35.043241] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-19T17:38:35.843277] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-19T17:38:36.305446] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T17:38:36.420922] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T17:38:36.643302] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-19T17:38:37.443332] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-19T17:38:37.598801] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:38:37.760230] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T17:38:38.243317] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-19T17:38:39.043277] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-19T17:38:39.170274] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:38:39.681696] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T17:38:39.843322] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-19T17:38:40.408330] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T17:38:40.643266] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-19T17:38:41.070398] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T17:38:41.075232] [INFO ] [REMOTE ] BLCO: Full fetch complete (52583 records). [2025-09-19T17:38:41.075391] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-19T17:38:41.445466] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-19T17:38:41.464553] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-19T17:38:41.464633] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-19T17:38:41.465341] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-19T17:38:41.465419] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-19T17:38:41.466726] [DEBUG] [LOCAL ] BLCO: Trimmed 52583 records to 36678 (keeping 200 days of data) [2025-09-19T17:38:41.675549] [DEBUG] [LOCAL ] BLCO: Primary data saved (36678 records). [2025-09-19T17:38:41.675723] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-19T17:38:41.675820] [INFO ] [MAIN ] Update Progress: 295/2372 symbols completed. BLCO took 28.1s. Estimated remaining: 4h 31m 56s. Rate: 7.6 symbols/min [2025-09-19T17:38:41.850247] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:41.866191] [DEBUG] [LOCAL ] BLE: Loaded 14919 existing records from primary storage. [2025-09-19T17:38:41.866313] [INFO ] [MAIN ] BLE: Loaded 14919 existing records. [2025-09-19T17:38:42.043662] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:42.043969] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-19T17:38:42.044028] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-19T17:38:42.044602] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-19T17:38:42.044703] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-19T17:38:42.251633] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-19T17:38:42.401542] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:42.793726] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T17:38:43.015458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T17:38:43.043221] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-19T17:38:43.681853] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T17:38:43.843278] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-19T17:38:44.643306] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-19T17:38:44.918819] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T17:38:45.443299] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-19T17:38:45.638271] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T17:38:45.928089] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T17:38:45.932714] [INFO ] [REMOTE ] BKV: Full fetch complete (44975 records). [2025-09-19T17:38:45.932898] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-19T17:38:46.243815] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-19T17:38:46.335314] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-19T17:38:46.335398] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-19T17:38:46.336071] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-19T17:38:46.336136] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-19T17:38:46.337168] [DEBUG] [LOCAL ] BKV: Trimmed 44975 records to 30602 (keeping 200 days of data) [2025-09-19T17:38:46.512220] [DEBUG] [LOCAL ] BKV: Primary data saved (30602 records). [2025-09-19T17:38:46.512386] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-19T17:38:46.512497] [INFO ] [MAIN ] Update Progress: 296/2372 symbols completed. BKV took 43.0s. Estimated remaining: 4h 31m 27s. Rate: 7.6 symbols/min [2025-09-19T17:38:46.682620] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:46.724974] [DEBUG] [LOCAL ] BLK: Loaded 35664 existing records from primary storage. [2025-09-19T17:38:46.725116] [INFO ] [MAIN ] BLK: Loaded 35664 existing records. [2025-09-19T17:38:46.911931] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:46.912300] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-19T17:38:46.912361] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-19T17:38:46.913227] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-19T17:38:46.913287] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-19T17:38:47.045781] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-19T17:38:47.294109] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:47.312001] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T17:38:47.717185] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T17:38:47.843262] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-19T17:38:48.379328] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T17:38:48.643265] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-19T17:38:49.309868] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:38:49.443255] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-19T17:38:50.243279] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-19T17:38:50.687124] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T17:38:51.043257] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-19T17:38:51.534716] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T17:38:51.843262] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-19T17:38:51.943599] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T17:38:51.947914] [INFO ] [REMOTE ] BLD: Full fetch complete (40405 records). [2025-09-19T17:38:51.948015] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-19T17:38:52.327555] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-19T17:38:52.327697] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-19T17:38:52.328267] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-19T17:38:52.328338] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-19T17:38:52.329865] [DEBUG] [LOCAL ] BLD: Trimmed 40405 records to 28606 (keeping 200 days of data) [2025-09-19T17:38:52.507525] [DEBUG] [LOCAL ] BLD: Primary data saved (28606 records). [2025-09-19T17:38:52.507696] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-19T17:38:52.507819] [INFO ] [MAIN ] Update Progress: 297/2372 symbols completed. BLD took 31.9s. Estimated remaining: 4h 31m 6s. Rate: 7.7 symbols/min [2025-09-19T17:38:52.648343] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-19T17:38:52.680256] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:38:52.730582] [DEBUG] [LOCAL ] BLND: Loaded 49897 existing records from primary storage. [2025-09-19T17:38:52.730776] [INFO ] [MAIN ] BLND: Loaded 49897 existing records. [2025-09-19T17:38:52.908058] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:38:52.908454] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-19T17:38:52.908719] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-19T17:38:52.909960] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-19T17:38:52.910024] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-19T17:38:53.277178] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:38:53.306675] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T17:38:53.403260] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T17:38:53.443235] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-19T17:38:53.736735] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T17:38:54.243263] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-19T17:38:54.829871] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T17:38:55.043304] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-19T17:38:55.604925] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T17:38:55.843285] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-19T17:38:56.389859] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T17:38:56.643281] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-19T17:38:57.076755] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T17:38:57.443310] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-19T17:38:58.243249] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-19T17:38:58.476883] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T17:38:58.934042] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T17:38:59.043270] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-19T17:38:59.664455] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T17:38:59.843295] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-19T17:39:00.362228] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T17:39:00.643321] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-19T17:39:01.281828] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:39:01.443305] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-19T17:39:02.192274] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:39:02.243221] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-19T17:39:03.043306] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-19T17:39:03.843287] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-19T17:39:04.906403] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (3.46 seconds). [2025-09-19T17:39:04.921271] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-19T17:39:04.924327] [INFO ] [REMOTE ] BLDR: Full fetch complete (74130 records). [2025-09-19T17:39:04.924940] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-19T17:39:04.925265] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-19T17:39:05.333724] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-19T17:39:05.333840] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-19T17:39:05.334728] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-19T17:39:05.334795] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-19T17:39:05.336365] [DEBUG] [LOCAL ] BLDR: Trimmed 74130 records to 52400 (keeping 200 days of data) [2025-09-19T17:39:05.655621] [DEBUG] [LOCAL ] BLDR: Primary data saved (52400 records). [2025-09-19T17:39:05.655795] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-19T17:39:05.655898] [INFO ] [MAIN ] Update Progress: 298/2372 symbols completed. BLDR took 35.1s. Estimated remaining: 4h 31m 36s. Rate: 7.6 symbols/min [2025-09-19T17:39:05.830548] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:05.830759] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-19T17:39:05.830808] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-19T17:39:05.830951] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-19T17:39:05.830993] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-19T17:39:05.831033] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-19T17:39:05.831065] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-19T17:39:06.214070] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T17:39:06.212963] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:06.218037] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-19T17:39:06.219114] [INFO ] [REMOTE ] BLE: Full fetch complete (20610 records). [2025-09-19T17:39:06.219250] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-19T17:39:06.539415] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-19T17:39:06.536223] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:06.562121] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (3.52 seconds). [2025-09-19T17:39:06.590168] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-19T17:39:06.575930] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-19T17:39:06.676078] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-19T17:39:06.676158] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-19T17:39:06.676561] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-19T17:39:06.676602] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-19T17:39:06.677190] [DEBUG] [LOCAL ] BLE: Trimmed 20610 records to 14973 (keeping 200 days of data) [2025-09-19T17:39:06.765389] [DEBUG] [LOCAL ] BLE: Primary data saved (14973 records). [2025-09-19T17:39:06.765530] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-19T17:39:06.765629] [INFO ] [MAIN ] Update Progress: 299/2372 symbols completed. BLE took 25.1s. Estimated remaining: 4h 30m 41s. Rate: 7.7 symbols/min [2025-09-19T17:39:06.959163] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:06.975951] [DEBUG] [LOCAL ] BLW: Loaded 13018 existing records from primary storage. [2025-09-19T17:39:06.976080] [INFO ] [MAIN ] BLW: Loaded 13018 existing records. [2025-09-19T17:39:07.049399] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-19T17:39:07.156574] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:07.156880] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-19T17:39:07.156932] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-19T17:39:07.157497] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-19T17:39:07.157557] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-19T17:39:07.506700] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:07.843280] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-19T17:39:08.643297] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-19T17:39:08.820378] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T17:39:08.872181] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:08.872625] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-19T17:39:08.891959] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:39:09.064480] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:39:09.443301] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-19T17:39:10.243279] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-19T17:39:10.459743] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:10.460153] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-19T17:39:10.859047] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T17:39:11.043356] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-19T17:39:11.263929] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:11.264293] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-19T17:39:11.843307] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-19T17:39:12.554555] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:12.555121] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-19T17:39:12.643250] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-19T17:39:13.443275] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-19T17:39:14.176022] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:14.176367] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-19T17:39:14.243234] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-19T17:39:14.497179] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:14.497477] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-19T17:39:15.043283] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-19T17:39:15.082370] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-19T17:39:15.843279] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-19T17:39:16.077321] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T17:39:16.369606] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:39:16.370048] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-19T17:39:16.643335] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-19T17:39:17.443283] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-19T17:39:18.224459] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:39:18.243253] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-19T17:39:19.043306] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-19T17:39:19.304244] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T17:39:19.843350] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-19T17:39:20.040028] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T17:39:20.069016] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T17:39:20.643302] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-19T17:39:21.443251] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-19T17:39:21.819805] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T17:39:21.935264] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T17:39:22.243267] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-19T17:39:22.989639] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:39:23.043224] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-19T17:39:23.513572] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T17:39:23.843330] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-19T17:39:24.643292] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-19T17:39:24.932246] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:39:25.443297] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-19T17:39:25.640998] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T17:39:26.017188] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T17:39:26.243279] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-19T17:39:27.043292] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-19T17:39:27.256354] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-19T17:39:27.263583] [INFO ] [REMOTE ] BLSH: Full fetch complete (9882 records). [2025-09-19T17:39:27.263792] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-19T17:39:27.264291] [FATAL] [VALIDATOR ] BLSH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:39:27.264377] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:39:27.264423] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:39:27.264502] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-19T17:39:27.264590] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-19T17:39:27.264692] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-19T17:39:27.264791] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-19T17:39:27.264898] [INFO ] [MAIN ] Update Progress: 300/2372 symbols completed. BLSH took 21.6s. Estimated remaining: 4h 32m 1s. Rate: 7.6 symbols/min [2025-09-19T17:39:27.435383] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:27.452725] [DEBUG] [LOCAL ] BLX: Loaded 16165 existing records from primary storage. [2025-09-19T17:39:27.452853] [INFO ] [MAIN ] BLX: Loaded 16165 existing records. [2025-09-19T17:39:27.657790] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:27.658085] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-19T17:39:27.658156] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-19T17:39:27.658764] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-19T17:39:27.658856] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-19T17:39:27.872565] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-19T17:39:28.022190] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:28.275868] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T17:39:28.283330] [INFO ] [REMOTE ] BLND: Full fetch complete (71952 records). [2025-09-19T17:39:28.283507] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-19T17:39:28.284443] [FATAL] [VALIDATOR ] BLND: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:39:28.284545] [FATAL] [MAIN ] BLND: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:39:28.284604] [WARN ] [MAIN ] BLND: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:39:28.284717] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-19T17:39:28.284789] [DEBUG] [LOCAL ] BLND: No primary data file found to delete. [2025-09-19T17:39:28.284825] [INFO ] [LOCAL ] BLND: Starting deletion of derivative data. [2025-09-19T17:39:28.285349] [DEBUG] [LOCAL ] BLND: Deleted derivative data file. [2025-09-19T17:39:28.289423] [INFO ] [MAIN ] Update Progress: 301/2372 symbols completed. BLND took 35.8s. Estimated remaining: 4h 31m 6s. Rate: 7.6 symbols/min [2025-09-19T17:39:28.428004] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:39:28.481212] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:28.522056] [DEBUG] [LOCAL ] BMA: Loaded 34794 existing records from primary storage. [2025-09-19T17:39:28.522239] [INFO ] [MAIN ] BMA: Loaded 34794 existing records. [2025-09-19T17:39:28.648478] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-19T17:39:28.701530] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:28.701754] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-19T17:39:28.701814] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-19T17:39:28.702723] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-19T17:39:28.702783] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-19T17:39:29.052996] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:29.443289] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-19T17:39:29.693882] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:39:30.023588] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T17:39:30.028688] [INFO ] [REMOTE ] BLK: Full fetch complete (53304 records). [2025-09-19T17:39:30.028802] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-19T17:39:30.248517] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-19T17:39:30.409863] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-19T17:39:30.409953] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-19T17:39:30.410563] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-19T17:39:30.410603] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-19T17:39:30.411949] [DEBUG] [LOCAL ] BLK: Trimmed 53304 records to 35876 (keeping 200 days of data) [2025-09-19T17:39:30.624729] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T17:39:30.657586] [DEBUG] [LOCAL ] BLK: Primary data saved (35876 records). [2025-09-19T17:39:30.657763] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-19T17:39:30.657859] [INFO ] [MAIN ] Update Progress: 302/2372 symbols completed. BLK took 44.1s. Estimated remaining: 4h 30m 20s. Rate: 7.7 symbols/min [2025-09-19T17:39:30.824619] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:30.835935] [DEBUG] [LOCAL ] BME: Loaded 10989 existing records from primary storage. [2025-09-19T17:39:30.836070] [INFO ] [MAIN ] BME: Loaded 10989 existing records. [2025-09-19T17:39:31.018099] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:31.018341] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-19T17:39:31.018389] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-19T17:39:31.018960] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-19T17:39:31.019019] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-19T17:39:31.049237] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-19T17:39:31.388044] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:31.843269] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-19T17:39:32.133378] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T17:39:32.168216] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T17:39:32.643311] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-19T17:39:33.091218] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T17:39:33.443241] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-19T17:39:33.777851] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T17:39:33.780835] [INFO ] [REMOTE ] BLW: Full fetch complete (18879 records). [2025-09-19T17:39:33.780942] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-19T17:39:34.147897] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-19T17:39:34.147976] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-19T17:39:34.148325] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-19T17:39:34.148365] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-19T17:39:34.148969] [DEBUG] [LOCAL ] BLW: Trimmed 18879 records to 13093 (keeping 200 days of data) [2025-09-19T17:39:34.236273] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T17:39:34.243331] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-19T17:39:34.246944] [DEBUG] [LOCAL ] BLW: Primary data saved (13093 records). [2025-09-19T17:39:34.247065] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-19T17:39:34.247165] [INFO ] [MAIN ] Update Progress: 303/2372 symbols completed. BLW took 27.5s. Estimated remaining: 4h 29m 43s. Rate: 7.7 symbols/min [2025-09-19T17:39:34.423016] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:34.450612] [DEBUG] [LOCAL ] BMEZ: Loaded 26386 existing records from primary storage. [2025-09-19T17:39:34.450772] [INFO ] [MAIN ] BMEZ: Loaded 26386 existing records. [2025-09-19T17:39:34.626168] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:34.626469] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-19T17:39:34.626526] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-19T17:39:34.627541] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-19T17:39:34.627613] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-19T17:39:34.983614] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:35.043223] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-19T17:39:35.300169] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T17:39:35.843257] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-19T17:39:36.192492] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T17:39:36.643260] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-19T17:39:36.729607] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T17:39:37.443317] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-19T17:39:37.695414] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T17:39:38.243286] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-19T17:39:39.043298] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-19T17:39:39.349422] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T17:39:39.373237] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T17:39:39.843231] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-19T17:39:40.061096] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T17:39:40.643271] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-19T17:39:41.443249] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-19T17:39:41.551899] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:39:41.624624] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T17:39:42.243307] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-19T17:39:42.347903] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:39:42.792770] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T17:39:43.043281] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-19T17:39:43.843260] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-19T17:39:44.137306] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:39:44.643237] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-19T17:39:45.072638] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T17:39:45.443266] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-19T17:39:45.627256] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T17:39:46.243296] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-19T17:39:46.544032] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T17:39:46.958699] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T17:39:47.043447] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-19T17:39:47.676686] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-19T17:39:47.843296] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-19T17:39:48.600872] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T17:39:48.643274] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-19T17:39:49.443300] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-19T17:39:50.166843] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T17:39:50.169091] [INFO ] [REMOTE ] BME: Full fetch complete (16166 records). [2025-09-19T17:39:50.169201] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-19T17:39:50.247744] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-19T17:39:50.547587] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T17:39:50.588555] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-19T17:39:50.588666] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-19T17:39:50.589046] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-19T17:39:50.589130] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-19T17:39:50.591582] [DEBUG] [LOCAL ] BME: Trimmed 16166 records to 11052 (keeping 200 days of data) [2025-09-19T17:39:50.664972] [DEBUG] [LOCAL ] BME: Primary data saved (11052 records). [2025-09-19T17:39:50.665104] [INFO ] [MAIN ] BME: Full history saved. [2025-09-19T17:39:50.665260] [INFO ] [MAIN ] Update Progress: 304/2372 symbols completed. BME took 20.0s. Estimated remaining: 4h 30m 34s. Rate: 7.6 symbols/min [2025-09-19T17:39:50.853208] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:50.881561] [DEBUG] [LOCAL ] BMI: Loaded 24204 existing records from primary storage. [2025-09-19T17:39:50.881717] [INFO ] [MAIN ] BMI: Loaded 24204 existing records. [2025-09-19T17:39:51.059976] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-19T17:39:51.065923] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:51.067728] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-19T17:39:51.067786] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-19T17:39:51.068576] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-19T17:39:51.068683] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-19T17:39:51.430605] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:51.674939] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:39:51.843260] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-19T17:39:52.643295] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-19T17:39:53.182088] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T17:39:53.443289] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-19T17:39:53.555258] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T17:39:54.076866] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T17:39:54.208692] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T17:39:54.243254] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-19T17:39:55.043289] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-19T17:39:55.843263] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-19T17:39:55.908932] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:39:56.586774] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T17:39:56.604388] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T17:39:56.608368] [INFO ] [REMOTE ] BLX: Full fetch complete (22769 records). [2025-09-19T17:39:56.608457] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-19T17:39:56.648374] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-19T17:39:56.986514] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-19T17:39:56.986591] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-19T17:39:56.986983] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-19T17:39:56.987044] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-19T17:39:56.987670] [DEBUG] [LOCAL ] BLX: Trimmed 22769 records to 16264 (keeping 200 days of data) [2025-09-19T17:39:57.101063] [DEBUG] [LOCAL ] BLX: Primary data saved (16264 records). [2025-09-19T17:39:57.101215] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-19T17:39:57.101303] [INFO ] [MAIN ] Update Progress: 305/2372 symbols completed. BLX took 29.8s. Estimated remaining: 4h 30m 16s. Rate: 7.6 symbols/min [2025-09-19T17:39:57.274457] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:39:57.279139] [DEBUG] [LOCAL ] BMN: Loaded 2590 existing records from primary storage. [2025-09-19T17:39:57.279221] [INFO ] [MAIN ] BMN: Loaded 2590 existing records. [2025-09-19T17:39:57.452033] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-19T17:39:57.458006] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:39:57.459204] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-19T17:39:57.459257] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-19T17:39:57.459619] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-19T17:39:57.459726] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-19T17:39:57.827987] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:39:57.872849] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T17:39:58.243288] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-19T17:39:58.845723] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T17:39:59.043260] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-19T17:39:59.529315] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T17:39:59.594829] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:39:59.843288] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-19T17:40:00.643286] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-19T17:40:01.025186] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T17:40:01.150234] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T17:40:01.443301] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-19T17:40:02.243313] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-19T17:40:02.280215] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T17:40:03.043272] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-19T17:40:03.603849] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T17:40:03.843268] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-19T17:40:04.646735] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-19T17:40:04.648872] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T17:40:05.194935] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T17:40:05.219566] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:40:05.443307] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-19T17:40:06.243313] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-19T17:40:06.994338] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:40:07.043221] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-19T17:40:07.843282] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-19T17:40:08.052876] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T17:40:08.559883] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T17:40:08.643235] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-19T17:40:09.375348] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-19T17:40:09.382060] [INFO ] [REMOTE ] BMA: Full fetch complete (50838 records). [2025-09-19T17:40:09.382235] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-19T17:40:09.448329] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-19T17:40:09.785046] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-19T17:40:09.785252] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-19T17:40:09.785981] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-19T17:40:09.791912] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-19T17:40:09.803813] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T17:40:09.811019] [DEBUG] [LOCAL ] BMA: Trimmed 50838 records to 35145 (keeping 200 days of data) [2025-09-19T17:40:10.046227] [DEBUG] [LOCAL ] BMA: Primary data saved (35145 records). [2025-09-19T17:40:10.046383] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-19T17:40:10.046486] [INFO ] [MAIN ] Update Progress: 306/2372 symbols completed. BMA took 41.8s. Estimated remaining: 4h 30m 43s. Rate: 7.6 symbols/min [2025-09-19T17:40:10.215283] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:10.249953] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-19T17:40:10.268633] [DEBUG] [LOCAL ] BMO: Loaded 41787 existing records from primary storage. [2025-09-19T17:40:10.268814] [INFO ] [MAIN ] BMO: Loaded 41787 existing records. [2025-09-19T17:40:10.449500] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:10.449814] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-19T17:40:10.449864] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-19T17:40:10.451258] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-19T17:40:10.451319] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-19T17:40:10.809420] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:11.043241] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-19T17:40:11.073844] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T17:40:11.199273] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:40:11.843264] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-19T17:40:12.333275] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T17:40:12.643261] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-19T17:40:13.214690] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:40:13.443305] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-19T17:40:14.243312] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-19T17:40:14.490070] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T17:40:14.494168] [INFO ] [REMOTE ] BMEZ: Full fetch complete (41019 records). [2025-09-19T17:40:14.494292] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-19T17:40:14.814228] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T17:40:14.951467] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-19T17:40:14.951681] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-19T17:40:14.952268] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-19T17:40:14.952346] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-19T17:40:14.953994] [DEBUG] [LOCAL ] BMEZ: Trimmed 41019 records to 26566 (keeping 200 days of data) [2025-09-19T17:40:15.045869] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-19T17:40:15.111549] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-19T17:40:15.190487] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26566 records). [2025-09-19T17:40:15.190664] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-19T17:40:15.190795] [INFO ] [MAIN ] Update Progress: 307/2372 symbols completed. BMEZ took 40.9s. Estimated remaining: 4h 30m 17s. Rate: 7.6 symbols/min [2025-09-19T17:40:15.380741] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:15.441963] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-09-19T17:40:15.442145] [INFO ] [MAIN ] BMY: Loaded 54147 existing records. [2025-09-19T17:40:15.639141] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:15.643084] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T17:40:15.643350] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-19T17:40:15.645223] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-19T17:40:15.646972] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-19T17:40:15.647037] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-19T17:40:15.853314] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-19T17:40:16.012332] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:16.643275] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-19T17:40:17.443298] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-19T17:40:17.646522] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:40:17.684667] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T17:40:18.243268] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-19T17:40:18.786556] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-19T17:40:18.787624] [INFO ] [REMOTE ] BMN: Full fetch complete (3720 records). [2025-09-19T17:40:18.787726] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-19T17:40:19.043567] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-19T17:40:19.175554] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-19T17:40:19.175699] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-19T17:40:19.175855] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-19T17:40:19.175946] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-19T17:40:19.176565] [DEBUG] [LOCAL ] BMN: Trimmed 3720 records to 2604 (keeping 200 days of data) [2025-09-19T17:40:19.218833] [DEBUG] [LOCAL ] BMN: Primary data saved (2604 records). [2025-09-19T17:40:19.222400] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-19T17:40:19.222595] [INFO ] [MAIN ] Update Progress: 308/2372 symbols completed. BMN took 22.1s. Estimated remaining: 4h 29m 43s. Rate: 7.7 symbols/min [2025-09-19T17:40:19.298723] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:40:19.426399] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:19.488726] [DEBUG] [LOCAL ] BN: Loaded 53396 existing records from primary storage. [2025-09-19T17:40:19.488894] [INFO ] [MAIN ] BN: Loaded 53396 existing records. [2025-09-19T17:40:19.690258] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:19.690547] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-19T17:40:19.690598] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-19T17:40:19.692054] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-19T17:40:19.692136] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-19T17:40:19.847108] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-19T17:40:20.050733] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:20.643290] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-19T17:40:21.073375] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:40:21.405257] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T17:40:21.443309] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-19T17:40:21.589987] [DEBUG] [REMOTE ] BMI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-19T17:40:21.590318] [WARN ] [REMOTE ] BMI: No data returned for month 2025-09 [2025-09-19T17:40:21.590420] [INFO ] [REMOTE ] BMI: Full fetch complete (29457 records). [2025-09-19T17:40:21.590497] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-19T17:40:21.591334] [FATAL] [VALIDATOR ] BMI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:40:21.591414] [FATAL] [MAIN ] BMI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:40:21.591479] [WARN ] [MAIN ] BMI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:40:21.591547] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-19T17:40:21.591612] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-19T17:40:21.591686] [INFO ] [LOCAL ] BMI: Starting deletion of derivative data. [2025-09-19T17:40:21.592166] [DEBUG] [LOCAL ] BMI: Deleted derivative data file. [2025-09-19T17:40:21.592275] [INFO ] [MAIN ] Update Progress: 309/2372 symbols completed. BMI took 30.9s. Estimated remaining: 4h 28m 59s. Rate: 7.7 symbols/min [2025-09-19T17:40:21.773247] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:21.804733] [DEBUG] [LOCAL ] BNED: Loaded 30247 existing records from primary storage. [2025-09-19T17:40:21.804894] [INFO ] [MAIN ] BNED: Loaded 30247 existing records. [2025-09-19T17:40:21.986452] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:21.986812] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-19T17:40:21.986896] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-19T17:40:21.987627] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-19T17:40:21.987715] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-19T17:40:22.246420] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-19T17:40:22.361772] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:22.453988] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:40:23.043277] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-19T17:40:23.715386] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T17:40:23.843255] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-19T17:40:24.643305] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-19T17:40:25.459997] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-19T17:40:25.464046] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T17:40:25.795977] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:40:26.243292] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-19T17:40:26.686391] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T17:40:26.802998] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T17:40:27.043305] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-19T17:40:27.843294] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-19T17:40:28.389914] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T17:40:28.483461] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:40:28.643284] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-19T17:40:29.443340] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-19T17:40:29.804211] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-19T17:40:30.015669] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T17:40:30.243283] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-19T17:40:30.360853] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T17:40:31.043261] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-19T17:40:31.314374] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T17:40:31.843279] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-19T17:40:32.643310] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-19T17:40:33.115256] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T17:40:33.191910] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T17:40:33.443263] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-19T17:40:33.876006] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:40:34.243288] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-19T17:40:34.779364] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:40:35.043266] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-19T17:40:35.809245] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T17:40:35.843230] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-19T17:40:36.643270] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-19T17:40:36.920578] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:40:37.443332] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-19T17:40:37.546568] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T17:40:38.153448] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:40:38.160194] [INFO ] [REMOTE ] BMO: Full fetch complete (60008 records). [2025-09-19T17:40:38.160316] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-19T17:40:38.253052] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-19T17:40:38.572362] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-19T17:40:38.572502] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-19T17:40:38.573357] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-19T17:40:38.573429] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-19T17:40:38.575622] [DEBUG] [LOCAL ] BMO: Trimmed 60008 records to 42068 (keeping 200 days of data) [2025-09-19T17:40:38.842297] [DEBUG] [LOCAL ] BMO: Primary data saved (42068 records). [2025-09-19T17:40:38.842420] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-19T17:40:38.843054] [INFO ] [MAIN ] Update Progress: 310/2372 symbols completed. BMO took 28.8s. Estimated remaining: 4h 29m 54s. Rate: 7.6 symbols/min [2025-09-19T17:40:39.024110] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:39.035723] [DEBUG] [LOCAL ] BNH: Loaded 4853 existing records from primary storage. [2025-09-19T17:40:39.035901] [INFO ] [MAIN ] BNH: Loaded 4853 existing records. [2025-09-19T17:40:39.049770] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-19T17:40:39.240699] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:39.252207] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-19T17:40:39.257430] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-19T17:40:39.267373] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-19T17:40:39.270356] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-19T17:40:39.277239] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T17:40:39.653515] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:39.843268] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-19T17:40:40.599849] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T17:40:40.643222] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-19T17:40:40.705219] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T17:40:40.756611] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-19T17:40:41.443266] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-19T17:40:41.768579] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T17:40:42.243267] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-19T17:40:43.043241] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-19T17:40:43.239353] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:40:43.843272] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-19T17:40:44.331030] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T17:40:44.519960] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T17:40:44.643262] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-19T17:40:45.443265] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-19T17:40:46.161131] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T17:40:46.233529] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T17:40:46.244403] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-19T17:40:46.360214] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T17:40:46.725050] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T17:40:47.043275] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-19T17:40:47.843262] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-19T17:40:48.643264] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-19T17:40:49.359047] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T17:40:49.428961] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T17:40:49.433730] [INFO ] [REMOTE ] BNED: Full fetch complete (44385 records). [2025-09-19T17:40:49.433844] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-19T17:40:49.448360] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-19T17:40:49.830149] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-19T17:40:49.830269] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-19T17:40:49.830891] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-19T17:40:49.830962] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-19T17:40:49.833315] [DEBUG] [LOCAL ] BNED: Trimmed 44385 records to 30481 (keeping 200 days of data) [2025-09-19T17:40:50.013762] [DEBUG] [LOCAL ] BNED: Primary data saved (30481 records). [2025-09-19T17:40:50.013899] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-19T17:40:50.013983] [INFO ] [MAIN ] Update Progress: 311/2372 symbols completed. BNED took 28.4s. Estimated remaining: 4h 30m 8s. Rate: 7.6 symbols/min [2025-09-19T17:40:50.186094] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:50.190507] [DEBUG] [LOCAL ] BNJ: Loaded 2643 existing records from primary storage. [2025-09-19T17:40:50.190591] [INFO ] [MAIN ] BNJ: Loaded 2643 existing records. [2025-09-19T17:40:50.253016] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-19T17:40:50.310416] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T17:40:50.385369] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:50.385699] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-19T17:40:50.385856] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-19T17:40:50.386281] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-19T17:40:50.386357] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-19T17:40:50.751918] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:50.796960] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-19T17:40:51.043298] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-19T17:40:51.612788] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-19T17:40:51.843258] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-19T17:40:52.263792] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T17:40:52.643263] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-19T17:40:53.443282] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-19T17:40:53.867789] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-19T17:40:53.904111] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T17:40:54.243308] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-19T17:40:54.616070] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T17:40:54.623844] [INFO ] [REMOTE ] BN: Full fetch complete (76613 records). [2025-09-19T17:40:54.623971] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-19T17:40:55.032217] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-19T17:40:55.032316] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-19T17:40:55.033134] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-19T17:40:55.033205] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-19T17:40:55.034876] [DEBUG] [LOCAL ] BN: Trimmed 76613 records to 53777 (keeping 200 days of data) [2025-09-19T17:40:55.043339] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-19T17:40:55.393560] [DEBUG] [LOCAL ] BN: Primary data saved (53777 records). [2025-09-19T17:40:55.393753] [INFO ] [MAIN ] BN: Full history saved. [2025-09-19T17:40:55.393855] [INFO ] [MAIN ] Update Progress: 312/2372 symbols completed. BN took 36.2s. Estimated remaining: 4h 29m 44s. Rate: 7.6 symbols/min [2025-09-19T17:40:55.578706] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:40:55.626578] [DEBUG] [LOCAL ] BNL: Loaded 47287 existing records from primary storage. [2025-09-19T17:40:55.626768] [INFO ] [MAIN ] BNL: Loaded 47287 existing records. [2025-09-19T17:40:55.807848] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:40:55.808158] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-19T17:40:55.808207] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-19T17:40:55.809343] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-19T17:40:55.809403] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-19T17:40:55.853866] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-19T17:40:56.223636] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:40:56.232161] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:40:56.271158] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T17:40:56.306715] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-19T17:40:56.643269] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-19T17:40:57.377328] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T17:40:57.443322] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-19T17:40:57.854608] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-19T17:40:58.243283] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-19T17:40:59.043309] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-19T17:40:59.498043] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-19T17:40:59.539112] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T17:40:59.843280] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-19T17:41:00.643261] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-19T17:41:01.007015] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-19T17:41:01.443288] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-19T17:41:01.478271] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:41:01.487303] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-19T17:41:01.487491] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-19T17:41:01.890529] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-19T17:41:01.890663] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-19T17:41:01.891515] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-19T17:41:01.891671] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-19T17:41:01.897028] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-19T17:41:01.899675] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54537 (keeping 200 days of data) [2025-09-19T17:41:02.243416] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-19T17:41:02.262311] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-09-19T17:41:02.262538] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-19T17:41:02.262771] [INFO ] [MAIN ] Update Progress: 313/2372 symbols completed. BMY took 47.1s. Estimated remaining: 4h 29m 29s. Rate: 7.6 symbols/min [2025-09-19T17:41:02.457031] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:02.510129] [DEBUG] [LOCAL ] BNS: Loaded 51882 existing records from primary storage. [2025-09-19T17:41:02.510280] [INFO ] [MAIN ] BNS: Loaded 51882 existing records. [2025-09-19T17:41:02.696697] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:02.696945] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-19T17:41:02.696996] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-19T17:41:02.698148] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-19T17:41:02.698212] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-19T17:41:03.004776] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T17:41:03.043761] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-19T17:41:03.084105] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:03.843283] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-19T17:41:04.643264] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-19T17:41:05.160749] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T17:41:05.209162] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T17:41:05.443263] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-19T17:41:05.910447] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-19T17:41:06.243262] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-19T17:41:06.781489] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:41:06.806550] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:41:07.043269] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-19T17:41:07.637243] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:41:07.843297] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-19T17:41:08.643290] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-19T17:41:09.444515] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-19T17:41:09.449923] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T17:41:09.999469] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T17:41:10.243281] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-19T17:41:10.512430] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:41:11.043265] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-19T17:41:11.578456] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-19T17:41:11.579887] [INFO ] [REMOTE ] BNH: Full fetch complete (6794 records). [2025-09-19T17:41:11.579964] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-19T17:41:11.848346] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-19T17:41:11.910309] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:41:12.005963] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-19T17:41:12.006044] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-19T17:41:12.006244] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-19T17:41:12.006295] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-19T17:41:12.006730] [DEBUG] [LOCAL ] BNH: Trimmed 6794 records to 4881 (keeping 200 days of data) [2025-09-19T17:41:12.035566] [DEBUG] [LOCAL ] BNH: Primary data saved (4881 records). [2025-09-19T17:41:12.035706] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-19T17:41:12.035836] [INFO ] [MAIN ] Update Progress: 314/2372 symbols completed. BNH took 33.2s. Estimated remaining: 4h 29m 34s. Rate: 7.6 symbols/min [2025-09-19T17:41:12.208421] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:12.214460] [DEBUG] [LOCAL ] BNT: Loaded 3411 existing records from primary storage. [2025-09-19T17:41:12.214552] [INFO ] [MAIN ] BNT: Loaded 3411 existing records. [2025-09-19T17:41:12.390762] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:12.391021] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-19T17:41:12.391068] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-19T17:41:12.391307] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-19T17:41:12.391366] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-19T17:41:12.648375] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-19T17:41:12.773153] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:13.371622] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T17:41:13.372782] [INFO ] [REMOTE ] BNJ: Full fetch complete (4433 records). [2025-09-19T17:41:13.372860] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-19T17:41:13.450306] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-19T17:41:13.745830] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-19T17:41:13.746002] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-19T17:41:13.746182] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-19T17:41:13.746258] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-19T17:41:13.746939] [DEBUG] [LOCAL ] BNJ: Trimmed 4433 records to 2658 (keeping 200 days of data) [2025-09-19T17:41:13.764515] [DEBUG] [LOCAL ] BNJ: Primary data saved (2658 records). [2025-09-19T17:41:13.764734] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-19T17:41:13.764851] [INFO ] [MAIN ] Update Progress: 315/2372 symbols completed. BNJ took 23.8s. Estimated remaining: 4h 28m 46s. Rate: 7.7 symbols/min [2025-09-19T17:41:13.967706] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:13.966035] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T17:41:13.985335] [DEBUG] [LOCAL ] BNY: Loaded 7463 existing records from primary storage. [2025-09-19T17:41:13.985449] [INFO ] [MAIN ] BNY: Loaded 7463 existing records. [2025-09-19T17:41:14.163054] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:14.163332] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-19T17:41:14.163413] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-19T17:41:14.163833] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-19T17:41:14.163917] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-19T17:41:14.248393] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-19T17:41:14.539632] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:14.801008] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:41:15.043282] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-19T17:41:15.843265] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-19T17:41:16.117177] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T17:41:16.353521] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T17:41:16.643270] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-19T17:41:17.283946] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-19T17:41:17.443309] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-19T17:41:17.658731] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T17:41:18.243312] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-19T17:41:18.767992] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T17:41:19.043248] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-19T17:41:19.097423] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T17:41:19.843297] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-19T17:41:19.882771] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T17:41:20.643291] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-19T17:41:21.218366] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T17:41:21.443284] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-19T17:41:21.750867] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:41:21.935899] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T17:41:22.243331] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-19T17:41:22.643980] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-19T17:41:23.043327] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-19T17:41:23.843286] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-19T17:41:24.440427] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T17:41:24.643267] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-19T17:41:24.695777] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T17:41:25.443278] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-19T17:41:26.181906] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T17:41:26.233844] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T17:41:26.243987] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-19T17:41:26.997073] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T17:41:27.043255] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-19T17:41:27.843299] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-19T17:41:27.997624] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:41:28.527439] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T17:41:28.643260] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-19T17:41:29.202626] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-19T17:41:29.443330] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-19T17:41:30.243304] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-19T17:41:31.043270] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-19T17:41:31.353495] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T17:41:31.822422] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:41:31.829510] [INFO ] [REMOTE ] BNL: Full fetch complete (66586 records). [2025-09-19T17:41:31.829706] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-19T17:41:31.851550] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-19T17:41:31.958205] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T17:41:32.243585] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-19T17:41:32.243691] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-19T17:41:32.244472] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-19T17:41:32.244518] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-19T17:41:32.245882] [DEBUG] [LOCAL ] BNL: Trimmed 66586 records to 47607 (keeping 200 days of data) [2025-09-19T17:41:32.538902] [DEBUG] [LOCAL ] BNL: Primary data saved (47607 records). [2025-09-19T17:41:32.539091] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-19T17:41:32.539240] [INFO ] [MAIN ] Update Progress: 316/2372 symbols completed. BNL took 37.1s. Estimated remaining: 4h 29m 50s. Rate: 7.6 symbols/min [2025-09-19T17:41:32.649307] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-19T17:41:32.721077] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:32.745025] [DEBUG] [LOCAL ] BOC: Loaded 18551 existing records from primary storage. [2025-09-19T17:41:32.745172] [INFO ] [MAIN ] BOC: Loaded 18551 existing records. [2025-09-19T17:41:32.923213] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:32.923470] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-19T17:41:32.923524] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-19T17:41:32.924077] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-19T17:41:32.924139] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-19T17:41:33.296699] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:33.443273] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-19T17:41:33.624348] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T17:41:34.005832] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T17:41:34.243265] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-19T17:41:34.923687] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T17:41:35.043281] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-19T17:41:35.061061] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T17:41:35.843266] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-19T17:41:36.591119] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:41:36.643278] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-19T17:41:37.205120] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T17:41:37.233032] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T17:41:37.234692] [INFO ] [REMOTE ] BNY: Full fetch complete (10602 records). [2025-09-19T17:41:37.234765] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-19T17:41:37.448396] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-19T17:41:37.644581] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-19T17:41:37.644687] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-19T17:41:37.645006] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-19T17:41:37.645086] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-19T17:41:37.645560] [DEBUG] [LOCAL ] BNY: Trimmed 10602 records to 7500 (keeping 200 days of data) [2025-09-19T17:41:37.691961] [DEBUG] [LOCAL ] BNY: Primary data saved (7500 records). [2025-09-19T17:41:37.692135] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-19T17:41:37.692244] [INFO ] [MAIN ] Update Progress: 317/2372 symbols completed. BNY took 23.9s. Estimated remaining: 4h 29m 24s. Rate: 7.6 symbols/min [2025-09-19T17:41:38.243290] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-19T17:41:38.754702] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T17:41:39.043271] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-19T17:41:39.648606] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T17:41:39.672184] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T17:41:39.680378] [INFO ] [REMOTE ] BNS: Full fetch complete (74226 records). [2025-09-19T17:41:39.680568] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-19T17:41:39.844522] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-19T17:41:40.097830] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-19T17:41:40.097921] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-19T17:41:40.098767] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-19T17:41:40.098837] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-19T17:41:40.100509] [DEBUG] [LOCAL ] BNS: Trimmed 74226 records to 52257 (keeping 200 days of data) [2025-09-19T17:41:40.429904] [DEBUG] [LOCAL ] BNS: Primary data saved (52257 records). [2025-09-19T17:41:40.430064] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-19T17:41:40.430250] [INFO ] [MAIN ] Update Progress: 318/2372 symbols completed. BNS took 38.2s. Estimated remaining: 4h 28m 43s. Rate: 7.6 symbols/min [2025-09-19T17:41:40.643297] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-19T17:41:40.708989] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T17:41:40.710457] [INFO ] [REMOTE ] BNT: Full fetch complete (4416 records). [2025-09-19T17:41:40.710542] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-19T17:41:41.106017] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-19T17:41:41.106125] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-19T17:41:41.106307] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-19T17:41:41.106367] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-19T17:41:41.107034] [DEBUG] [LOCAL ] BNT: Trimmed 4416 records to 3487 (keeping 200 days of data) [2025-09-19T17:41:41.135966] [DEBUG] [LOCAL ] BNT: Primary data saved (3487 records). [2025-09-19T17:41:41.136115] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-19T17:41:41.136205] [INFO ] [MAIN ] Update Progress: 319/2372 symbols completed. BNT took 29.1s. Estimated remaining: 4h 27m 49s. Rate: 7.7 symbols/min [2025-09-19T17:41:41.417303] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T17:41:41.443267] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-19T17:41:42.719544] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T17:41:42.723732] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-19T17:41:44.336978] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T17:41:44.342380] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-19T17:41:45.575179] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T17:41:45.579116] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-19T17:41:46.703458] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T17:41:46.707432] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-19T17:41:47.485978] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T17:41:47.490575] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-19T17:41:48.847543] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T17:41:48.852756] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-19T17:41:50.087598] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T17:41:50.090763] [INFO ] [REMOTE ] BOC: Full fetch complete (25786 records). [2025-09-19T17:41:50.090859] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-19T17:41:50.465959] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-19T17:41:50.466059] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-19T17:41:50.466471] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-19T17:41:50.466539] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-19T17:41:50.467229] [DEBUG] [LOCAL ] BOC: Trimmed 25786 records to 18648 (keeping 200 days of data) [2025-09-19T17:41:50.574179] [DEBUG] [LOCAL ] BOC: Primary data saved (18648 records). [2025-09-19T17:41:50.574328] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-19T17:41:50.574439] [INFO ] [MAIN ] Update Progress: 320/2372 symbols completed. BOC took 18.0s. Estimated remaining: 4h 27m 52s. Rate: 7.7 symbols/min [2025-09-19T17:41:51.310940] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:51.309972] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:51.366469] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:51.362771] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:41:51.400781] [DEBUG] [LOCAL ] BOE: Loaded 17840 existing records from primary storage. [2025-09-19T17:41:51.404864] [INFO ] [MAIN ] BOE: Loaded 17840 existing records. [2025-09-19T17:41:51.573102] [DEBUG] [LOCAL ] BOND: Loaded 32453 existing records from primary storage. [2025-09-19T17:41:51.590149] [INFO ] [MAIN ] BOND: Loaded 32453 existing records. [2025-09-19T17:41:51.590035] [DEBUG] [LOCAL ] BOH: Loaded 31739 existing records from primary storage. [2025-09-19T17:41:51.618168] [INFO ] [MAIN ] BOH: Loaded 31739 existing records. [2025-09-19T17:41:51.732343] [DEBUG] [LOCAL ] BOOT: Loaded 41664 existing records from primary storage. [2025-09-19T17:41:51.816790] [INFO ] [MAIN ] BOOT: Loaded 41664 existing records. [2025-09-19T17:41:51.907499] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:52.071240] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-19T17:41:52.098590] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-19T17:41:52.148742] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:52.165058] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-19T17:41:52.200198] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-19T17:41:52.216672] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-19T17:41:52.206349] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:52.202688] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-19T17:41:52.256353] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-19T17:41:52.265810] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-19T17:41:52.269788] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-19T17:41:52.279200] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:41:52.289819] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-19T17:41:52.295283] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-19T17:41:52.300556] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-19T17:41:52.327675] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-19T17:41:52.362916] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-19T17:41:52.409787] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-19T17:41:52.455704] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-19T17:41:53.579164] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:53.573479] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:53.593949] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-19T17:41:53.637006] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-19T17:41:53.710630] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:53.726300] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-19T17:41:53.758424] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:41:53.758852] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-19T17:41:54.877848] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T17:41:54.883702] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-19T17:41:54.948618] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T17:41:54.955689] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-19T17:41:55.125871] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T17:41:55.131515] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-19T17:41:55.533713] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T17:41:55.541853] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-19T17:41:55.960317] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T17:41:55.967685] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-19T17:41:56.076000] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T17:41:56.084251] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-19T17:41:56.371168] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:41:56.375982] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-19T17:41:57.091428] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T17:41:57.097509] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-19T17:41:57.154893] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T17:41:57.164247] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-19T17:41:57.592291] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T17:41:57.599386] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-19T17:41:57.611181] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T17:41:58.243248] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-19T17:41:58.325429] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:41:58.452890] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T17:41:58.687521] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T17:41:59.043270] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-19T17:41:59.472164] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:41:59.843271] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-19T17:42:00.184857] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T17:42:00.643259] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-19T17:42:01.443318] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-19T17:42:02.243299] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-19T17:42:02.310136] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T17:42:02.445687] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:42:03.043276] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-19T17:42:03.843284] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-19T17:42:04.198400] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-19T17:42:04.643271] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-19T17:42:05.555992] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (3.31 seconds). [2025-09-19T17:42:05.563608] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-19T17:42:06.048128] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-19T17:42:06.110080] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:42:06.243287] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-19T17:42:06.439116] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T17:42:06.471271] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T17:42:07.043280] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-19T17:42:07.650488] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T17:42:07.843267] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-19T17:42:08.643270] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-19T17:42:09.054485] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T17:42:09.213258] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:42:09.443275] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-19T17:42:10.051200] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T17:42:10.243305] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-19T17:42:11.050481] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-19T17:42:11.056164] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T17:42:11.741532] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T17:42:11.843237] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-19T17:42:12.643299] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-19T17:42:12.912356] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T17:42:13.102100] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T17:42:13.443268] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-19T17:42:14.243282] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-19T17:42:15.043402] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-19T17:42:15.490839] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T17:42:15.496557] [INFO ] [REMOTE ] BOND: Full fetch complete (46296 records). [2025-09-19T17:42:15.496790] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-19T17:42:15.984964] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-19T17:42:15.985125] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-19T17:42:15.985785] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-19T17:42:16.001783] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-19T17:42:16.006134] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:42:16.013465] [DEBUG] [LOCAL ] BOND: Trimmed 46296 records to 32694 (keeping 200 days of data) [2025-09-19T17:42:16.015262] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-19T17:42:16.238925] [DEBUG] [LOCAL ] BOND: Primary data saved (32694 records). [2025-09-19T17:42:16.239094] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-19T17:42:16.239230] [INFO ] [MAIN ] Update Progress: 321/2372 symbols completed. BOND took 25.6s. Estimated remaining: 4h 29m 38s. Rate: 7.6 symbols/min [2025-09-19T17:42:16.383622] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T17:42:16.438934] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:16.465251] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (3.82 seconds). [2025-09-19T17:42:16.532398] [DEBUG] [LOCAL ] BORR: Loaded 51586 existing records from primary storage. [2025-09-19T17:42:16.532552] [INFO ] [MAIN ] BORR: Loaded 51586 existing records. [2025-09-19T17:42:16.648356] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-19T17:42:16.721241] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:16.721560] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-19T17:42:16.721612] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-19T17:42:16.723501] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-19T17:42:16.723742] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-19T17:42:17.089379] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:17.443244] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-19T17:42:17.818167] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T17:42:17.824078] [INFO ] [REMOTE ] BOH: Full fetch complete (44755 records). [2025-09-19T17:42:17.824225] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-19T17:42:18.229544] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-19T17:42:18.229693] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-19T17:42:18.230374] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-19T17:42:18.230457] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-19T17:42:18.247169] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-19T17:42:18.256342] [DEBUG] [LOCAL ] BOH: Trimmed 44755 records to 32007 (keeping 200 days of data) [2025-09-19T17:42:18.266028] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T17:42:18.478136] [DEBUG] [LOCAL ] BOH: Primary data saved (32007 records). [2025-09-19T17:42:18.478439] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-19T17:42:18.478564] [INFO ] [MAIN ] Update Progress: 322/2372 symbols completed. BOH took 27.9s. Estimated remaining: 4h 28m 54s. Rate: 7.6 symbols/min [2025-09-19T17:42:18.653197] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:18.680097] [DEBUG] [LOCAL ] BOW: Loaded 23934 existing records from primary storage. [2025-09-19T17:42:18.680248] [INFO ] [MAIN ] BOW: Loaded 23934 existing records. [2025-09-19T17:42:18.861729] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:18.862045] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-19T17:42:18.862133] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-19T17:42:18.863104] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-19T17:42:18.863170] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-19T17:42:19.048851] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-19T17:42:19.262504] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:19.274677] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T17:42:19.278435] [INFO ] [REMOTE ] BOE: Full fetch complete (26771 records). [2025-09-19T17:42:19.278525] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-19T17:42:19.658291] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-19T17:42:19.658411] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-19T17:42:19.659042] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-19T17:42:19.659155] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-19T17:42:19.660327] [DEBUG] [LOCAL ] BOE: Trimmed 26771 records to 17919 (keeping 200 days of data) [2025-09-19T17:42:19.738467] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T17:42:19.814428] [DEBUG] [LOCAL ] BOE: Primary data saved (17919 records). [2025-09-19T17:42:19.814599] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-19T17:42:19.814748] [INFO ] [MAIN ] Update Progress: 323/2372 symbols completed. BOE took 29.2s. Estimated remaining: 4h 28m 5s. Rate: 7.6 symbols/min [2025-09-19T17:42:19.848363] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-19T17:42:19.992812] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:20.059612] [DEBUG] [LOCAL ] BOX: Loaded 50755 existing records from primary storage. [2025-09-19T17:42:20.059782] [INFO ] [MAIN ] BOX: Loaded 50755 existing records. [2025-09-19T17:42:20.239263] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:20.239562] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-19T17:42:20.239609] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-19T17:42:20.240990] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-19T17:42:20.241050] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-19T17:42:20.551501] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:42:20.596285] [INFO ] [REMOTE ] BOOT: Full fetch complete (60394 records). [2025-09-19T17:42:20.615577] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-19T17:42:20.637707] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:20.651022] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-19T17:42:21.082327] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-19T17:42:21.082422] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-19T17:42:21.083153] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-19T17:42:21.083220] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-19T17:42:21.084577] [DEBUG] [LOCAL ] BOOT: Trimmed 60394 records to 41895 (keeping 200 days of data) [2025-09-19T17:42:21.355473] [DEBUG] [LOCAL ] BOOT: Primary data saved (41895 records). [2025-09-19T17:42:21.355900] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-19T17:42:21.356008] [INFO ] [MAIN ] Update Progress: 324/2372 symbols completed. BOOT took 30.8s. Estimated remaining: 4h 27m 17s. Rate: 7.7 symbols/min [2025-09-19T17:42:21.449054] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-19T17:42:21.536125] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:21.551763] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T17:42:21.612684] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-09-19T17:42:21.612868] [INFO ] [MAIN ] BP: Loaded 54101 existing records. [2025-09-19T17:42:21.788886] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:21.789173] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-19T17:42:21.789221] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-19T17:42:21.791125] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-19T17:42:21.791187] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-19T17:42:22.150480] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:22.243275] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-19T17:42:23.043283] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-19T17:42:23.141411] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T17:42:23.610308] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-19T17:42:23.843271] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-19T17:42:24.016445] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T17:42:24.501818] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T17:42:24.643257] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-19T17:42:25.443256] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-19T17:42:25.947460] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T17:42:26.010779] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T17:42:26.243299] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-19T17:42:26.915584] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T17:42:27.043295] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-19T17:42:27.416591] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T17:42:27.843265] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-19T17:42:28.594107] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T17:42:28.643223] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-19T17:42:29.443248] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-19T17:42:30.149401] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-19T17:42:30.243260] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-19T17:42:30.303120] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:42:31.043271] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-19T17:42:31.275164] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T17:42:31.843282] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-19T17:42:32.643252] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-19T17:42:32.761967] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-19T17:42:33.194906] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T17:42:33.265538] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T17:42:33.443267] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-19T17:42:34.243276] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-19T17:42:34.773915] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T17:42:35.043262] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-19T17:42:35.396951] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:42:35.843278] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-19T17:42:35.956527] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T17:42:36.643293] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-19T17:42:37.443306] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-19T17:42:37.656439] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T17:42:37.822418] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-19T17:42:37.959958] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T17:42:38.243276] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-19T17:42:39.043275] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-19T17:42:39.125811] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T17:42:39.494527] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T17:42:39.843300] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-19T17:42:40.643304] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-19T17:42:41.443252] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-19T17:42:41.558040] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-19T17:42:41.880160] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T17:42:42.150917] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T17:42:42.243264] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-19T17:42:43.043261] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-19T17:42:43.614467] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T17:42:43.716412] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T17:42:43.843260] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-19T17:42:44.643292] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-19T17:42:44.869142] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T17:42:44.888773] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T17:42:44.892355] [INFO ] [REMOTE ] BOW: Full fetch complete (30969 records). [2025-09-19T17:42:44.892440] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-19T17:42:44.893007] [FATAL] [VALIDATOR ] BOW: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:42:44.893097] [FATAL] [MAIN ] BOW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:42:44.893196] [WARN ] [MAIN ] BOW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:42:44.893271] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-19T17:42:44.893336] [DEBUG] [LOCAL ] BOW: No primary data file found to delete. [2025-09-19T17:42:44.893373] [INFO ] [LOCAL ] BOW: Starting deletion of derivative data. [2025-09-19T17:42:44.893889] [DEBUG] [LOCAL ] BOW: Deleted derivative data file. [2025-09-19T17:42:44.893985] [INFO ] [MAIN ] Update Progress: 325/2372 symbols completed. BOW took 26.4s. Estimated remaining: 4h 28m 48s. Rate: 7.6 symbols/min [2025-09-19T17:42:45.065858] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:45.066054] [DEBUG] [LOCAL ] BR: No existing data file found in primary storage. [2025-09-19T17:42:45.066091] [WARN ] [MAIN ] BR: No existing data found, performing full refresh instead. [2025-09-19T17:42:45.066236] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-19T17:42:45.066279] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-19T17:42:45.066318] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-09-19T17:42:45.066349] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-19T17:42:45.425761] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:45.443227] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-19T17:42:46.243287] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-19T17:42:46.968877] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T17:42:47.043272] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-19T17:42:47.843284] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-19T17:42:51.678074] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (6.23 seconds). [2025-09-19T17:42:51.685824] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-19T17:42:52.631065] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (6.39 seconds). [2025-09-19T17:42:52.638346] [INFO ] [REMOTE ] BORR: Full fetch complete (74440 records). [2025-09-19T17:42:52.638472] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-19T17:42:52.639319] [FATAL] [VALIDATOR ] BORR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:42:52.639406] [FATAL] [MAIN ] BORR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:42:52.639449] [WARN ] [MAIN ] BORR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:42:52.639487] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-19T17:42:52.639547] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-09-19T17:42:52.639582] [INFO ] [LOCAL ] BORR: Starting deletion of derivative data. [2025-09-19T17:42:52.640028] [DEBUG] [LOCAL ] BORR: Deleted derivative data file. [2025-09-19T17:42:52.640766] [INFO ] [MAIN ] Update Progress: 326/2372 symbols completed. BORR took 36.4s. Estimated remaining: 4h 28m 39s. Rate: 7.6 symbols/min [2025-09-19T17:42:52.815735] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:52.872886] [DEBUG] [LOCAL ] BRBR: Loaded 51577 existing records from primary storage. [2025-09-19T17:42:52.873041] [INFO ] [MAIN ] BRBR: Loaded 51577 existing records. [2025-09-19T17:42:53.056805] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:53.057221] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-19T17:42:53.057360] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-19T17:42:53.058811] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-19T17:42:53.058948] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-19T17:42:53.385349] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (6.34 seconds). [2025-09-19T17:42:53.521588] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:53.522698] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-19T17:42:53.523788] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-19T17:42:53.527269] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (5.68 seconds). [2025-09-19T17:42:53.542919] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-19T17:42:53.573471] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T17:42:53.581243] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-19T17:42:55.233488] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T17:42:55.239869] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-19T17:42:55.577823] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T17:42:55.587148] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-19T17:42:55.618282] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T17:42:55.630300] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-19T17:42:55.854200] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:42:55.865792] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-19T17:42:56.382060] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T17:42:56.390178] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-19T17:42:57.093831] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:42:57.101471] [INFO ] [REMOTE ] BOX: Full fetch complete (72181 records). [2025-09-19T17:42:57.101592] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-19T17:42:57.510182] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-19T17:42:57.510410] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-19T17:42:57.511451] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-19T17:42:57.511621] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-19T17:42:57.514258] [DEBUG] [LOCAL ] BOX: Trimmed 72181 records to 51127 (keeping 200 days of data) [2025-09-19T17:42:57.632066] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T17:42:57.645715] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-19T17:42:57.680678] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:42:57.692668] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-19T17:42:57.828865] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T17:42:57.845764] [INFO ] [REMOTE ] BP: Full fetch complete (77762 records). [2025-09-19T17:42:57.850224] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-19T17:42:58.174370] [DEBUG] [LOCAL ] BOX: Primary data saved (51127 records). [2025-09-19T17:42:58.207006] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-19T17:42:58.223357] [INFO ] [MAIN ] Update Progress: 327/2372 symbols completed. BOX took 38.4s. Estimated remaining: 4h 28m 17s. Rate: 7.6 symbols/min [2025-09-19T17:42:58.495285] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-19T17:42:58.510724] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-19T17:42:58.514345] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:58.515203] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-19T17:42:58.515286] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-19T17:42:58.517201] [DEBUG] [LOCAL ] BP: Trimmed 77762 records to 54491 (keeping 200 days of data) [2025-09-19T17:42:58.589924] [DEBUG] [LOCAL ] BRC: Loaded 19955 existing records from primary storage. [2025-09-19T17:42:58.598980] [INFO ] [MAIN ] BRC: Loaded 19955 existing records. [2025-09-19T17:42:58.834302] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:58.835075] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-19T17:42:58.835384] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-19T17:42:58.836815] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-19T17:42:58.836887] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-19T17:42:59.224017] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:42:59.228016] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-19T17:42:59.369202] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T17:42:59.379338] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-19T17:42:59.413269] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T17:42:59.509536] [DEBUG] [LOCAL ] BP: Primary data saved (54491 records). [2025-09-19T17:42:59.510720] [INFO ] [MAIN ] BP: Full history saved. [2025-09-19T17:42:59.510837] [INFO ] [MAIN ] Update Progress: 328/2372 symbols completed. BP took 38.2s. Estimated remaining: 4h 27m 28s. Rate: 7.6 symbols/min [2025-09-19T17:42:59.688906] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:42:59.731588] [DEBUG] [LOCAL ] BRCC: Loaded 40797 existing records from primary storage. [2025-09-19T17:42:59.731761] [INFO ] [MAIN ] BRCC: Loaded 40797 existing records. [2025-09-19T17:42:59.848493] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-19T17:42:59.913702] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:42:59.913972] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-19T17:42:59.914031] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-19T17:42:59.915097] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-19T17:42:59.915159] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-19T17:43:00.284481] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:00.301711] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T17:43:00.643278] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-19T17:43:01.114692] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:43:01.388083] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:43:01.443242] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-19T17:43:02.243317] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-19T17:43:02.394526] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:43:03.043238] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-19T17:43:03.396178] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T17:43:03.621478] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T17:43:03.843271] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-19T17:43:04.271441] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T17:43:04.643262] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-19T17:43:05.443312] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-19T17:43:05.919342] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T17:43:06.027110] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T17:43:06.243264] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-19T17:43:06.396303] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T17:43:07.043312] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-19T17:43:07.843343] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-19T17:43:08.070139] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T17:43:08.273569] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T17:43:08.643284] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-19T17:43:09.178186] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:43:09.443276] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-19T17:43:10.023578] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:43:10.243303] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-19T17:43:10.983820] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:43:11.043275] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-19T17:43:11.843293] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-19T17:43:12.006634] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:43:12.106548] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T17:43:12.643305] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-19T17:43:13.116845] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T17:43:13.122444] [INFO ] [REMOTE ] BR: Full fetch complete (48850 records). [2025-09-19T17:43:13.122555] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-19T17:43:13.457293] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-19T17:43:13.510378] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-19T17:43:13.510465] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-19T17:43:13.511075] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-19T17:43:13.511143] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-19T17:43:13.512351] [DEBUG] [LOCAL ] BR: Trimmed 48850 records to 35370 (keeping 200 days of data) [2025-09-19T17:43:13.732883] [DEBUG] [LOCAL ] BR: Primary data saved (35370 records). [2025-09-19T17:43:13.733037] [INFO ] [MAIN ] BR: Full history saved. [2025-09-19T17:43:13.733117] [INFO ] [MAIN ] Update Progress: 329/2372 symbols completed. BR took 28.8s. Estimated remaining: 4h 27m 60s. Rate: 7.6 symbols/min [2025-09-19T17:43:13.913639] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:13.913984] [DEBUG] [LOCAL ] BRFS: No existing data file found in primary storage. [2025-09-19T17:43:13.914057] [WARN ] [MAIN ] BRFS: No existing data found, performing full refresh instead. [2025-09-19T17:43:13.914356] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-19T17:43:13.914462] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-19T17:43:13.914583] [DEBUG] [LOCAL ] BRFS: No primary data file found to delete. [2025-09-19T17:43:13.914737] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-19T17:43:14.185552] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T17:43:14.248504] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-19T17:43:14.313973] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:15.043296] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-12. [2025-09-19T17:43:15.494501] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T17:43:15.843290] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-19T17:43:16.308253] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T17:43:16.551839] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T17:43:16.643251] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-19T17:43:17.336500] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T17:43:17.443280] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-01. [2025-09-19T17:43:18.243315] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-19T17:43:18.760510] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T17:43:18.838780] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T17:43:18.927939] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-19T17:43:19.043278] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-19T17:43:19.843292] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-19T17:43:20.643301] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-19T17:43:21.076235] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T17:43:21.093854] [INFO ] [REMOTE ] BRBR: Full fetch complete (71631 records). [2025-09-19T17:43:21.094949] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T17:43:21.095041] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-19T17:43:21.449227] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-19T17:43:21.499040] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-19T17:43:21.499125] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-19T17:43:21.499981] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-19T17:43:21.500049] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-19T17:43:21.501578] [DEBUG] [LOCAL ] BRBR: Trimmed 71631 records to 51940 (keeping 200 days of data) [2025-09-19T17:43:21.814865] [DEBUG] [LOCAL ] BRBR: Primary data saved (51940 records). [2025-09-19T17:43:21.815035] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-19T17:43:21.815722] [INFO ] [MAIN ] Update Progress: 330/2372 symbols completed. BRBR took 29.2s. Estimated remaining: 4h 27m 53s. Rate: 7.6 symbols/min [2025-09-19T17:43:21.987575] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:22.052296] [DEBUG] [LOCAL ] BRO: Loaded 52306 existing records from primary storage. [2025-09-19T17:43:22.052451] [INFO ] [MAIN ] BRO: Loaded 52306 existing records. [2025-09-19T17:43:22.242364] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:43:22.242707] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-19T17:43:22.242776] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-19T17:43:22.243241] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-19T17:43:22.244333] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-19T17:43:22.244408] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-19T17:43:22.633324] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:22.656893] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:43:23.043262] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-19T17:43:23.110137] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T17:43:23.644963] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T17:43:23.648407] [INFO ] [REMOTE ] BRC: Full fetch complete (29193 records). [2025-09-19T17:43:23.648521] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-19T17:43:23.854717] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-19T17:43:24.035171] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-19T17:43:24.035290] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-19T17:43:24.036131] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-19T17:43:24.036212] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-19T17:43:24.037455] [DEBUG] [LOCAL ] BRC: Trimmed 29193 records to 20122 (keeping 200 days of data) [2025-09-19T17:43:24.175051] [DEBUG] [LOCAL ] BRC: Primary data saved (20122 records). [2025-09-19T17:43:24.175188] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-19T17:43:24.175274] [INFO ] [MAIN ] Update Progress: 331/2372 symbols completed. BRC took 25.9s. Estimated remaining: 4h 27m 12s. Rate: 7.6 symbols/min [2025-09-19T17:43:24.371698] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:24.371880] [DEBUG] [LOCAL ] BROS: No existing data file found in primary storage. [2025-09-19T17:43:24.371917] [WARN ] [MAIN ] BROS: No existing data found, performing full refresh instead. [2025-09-19T17:43:24.372202] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-19T17:43:24.372256] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-19T17:43:24.372299] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-19T17:43:24.372332] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-19T17:43:24.647178] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-19T17:43:24.774635] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:24.804758] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T17:43:25.373038] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:43:25.443264] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-19T17:43:26.243273] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-19T17:43:26.547085] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T17:43:26.922055] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T17:43:27.043257] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-19T17:43:27.843323] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-19T17:43:28.146472] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T17:43:28.653709] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-19T17:43:28.659525] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T17:43:29.443276] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-19T17:43:29.667855] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T17:43:30.243233] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-19T17:43:30.856249] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T17:43:30.973095] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T17:43:30.979697] [INFO ] [REMOTE ] BRCC: Full fetch complete (58047 records). [2025-09-19T17:43:30.979804] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-19T17:43:31.048406] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-19T17:43:31.378264] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-19T17:43:31.378346] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-19T17:43:31.379008] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-19T17:43:31.379092] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-19T17:43:31.380523] [DEBUG] [LOCAL ] BRCC: Trimmed 58047 records to 41163 (keeping 200 days of data) [2025-09-19T17:43:31.617171] [DEBUG] [LOCAL ] BRCC: Primary data saved (41163 records). [2025-09-19T17:43:31.617332] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-19T17:43:31.617443] [INFO ] [MAIN ] Update Progress: 332/2372 symbols completed. BRCC took 32.1s. Estimated remaining: 4h 27m 1s. Rate: 7.6 symbols/min [2025-09-19T17:43:31.787616] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:31.787836] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-19T17:43:31.787877] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-19T17:43:31.788019] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-19T17:43:31.788061] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-19T17:43:31.788100] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-19T17:43:31.788132] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-19T17:43:31.855414] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-19T17:43:32.173916] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:32.186755] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:43:32.643267] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-19T17:43:32.808885] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T17:43:32.887326] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:32.887668] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-19T17:43:33.443260] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-19T17:43:33.671334] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:33.671678] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-19T17:43:33.854066] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T17:43:34.243289] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-19T17:43:35.043268] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-19T17:43:35.843281] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-19T17:43:36.003181] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T17:43:36.086733] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:36.087026] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-19T17:43:36.643226] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-19T17:43:37.287099] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-19T17:43:37.443294] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-19T17:43:38.243277] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-19T17:43:38.466844] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T17:43:38.485756] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:38.486128] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-19T17:43:39.043255] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-19T17:43:39.240981] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T17:43:39.843260] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-19T17:43:40.643270] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-19T17:43:40.880114] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:40.880452] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-19T17:43:41.102097] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:43:41.443231] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-19T17:43:41.530867] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T17:43:42.243277] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-19T17:43:42.470864] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:42.471192] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-19T17:43:43.043262] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-19T17:43:43.552157] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T17:43:43.843231] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-19T17:43:44.643310] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-19T17:43:45.420419] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:43:45.425938] [INFO ] [REMOTE ] BRFS: Full fetch complete (60830 records). [2025-09-19T17:43:45.426058] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-19T17:43:45.448460] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-19T17:43:45.637626] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-19T17:43:45.792923] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:43:45.804027] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-19T17:43:45.886616] [DEBUG] [VALIDATOR ] BRFS: All expected trading days are present. [2025-09-19T17:43:45.886722] [DEBUG] [VALIDATOR ] BRFS: Primary data validation passed. [2025-09-19T17:43:45.887428] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-19T17:43:45.887493] [DEBUG] [LOCAL ] BRFS: Saving primary data. [2025-09-19T17:43:45.888871] [DEBUG] [LOCAL ] BRFS: Trimmed 60830 records to 41644 (keeping 200 days of data) [2025-09-19T17:43:46.126012] [DEBUG] [LOCAL ] BRFS: Primary data saved (41644 records). [2025-09-19T17:43:46.126145] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-19T17:43:46.126243] [INFO ] [MAIN ] Update Progress: 333/2372 symbols completed. BRFS took 32.4s. Estimated remaining: 4h 27m 34s. Rate: 7.6 symbols/min [2025-09-19T17:43:46.247933] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-19T17:43:46.309036] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:46.309347] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-09-19T17:43:46.309432] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-09-19T17:43:46.309664] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-19T17:43:46.309736] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-19T17:43:46.309828] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-19T17:43:46.309943] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-19T17:43:46.493574] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T17:43:46.758688] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:47.043312] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-19T17:43:47.843296] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-19T17:43:48.632314] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T17:43:48.643450] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-19T17:43:49.310941] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:43:49.453951] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-19T17:43:49.460480] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-19T17:43:50.245190] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-19T17:43:50.249203] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T17:43:51.043300] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-19T17:43:51.557114] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T17:43:51.755932] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T17:43:51.843231] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-19T17:43:52.433270] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T17:43:52.643252] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-19T17:43:53.443283] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-19T17:43:53.499603] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:43:53.507399] [INFO ] [REMOTE ] BRO: Full fetch complete (74097 records). [2025-09-19T17:43:53.507529] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-19T17:43:53.906203] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-19T17:43:53.906290] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-19T17:43:53.907085] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-19T17:43:53.907151] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-19T17:43:53.908737] [DEBUG] [LOCAL ] BRO: Trimmed 74097 records to 52689 (keeping 200 days of data) [2025-09-19T17:43:54.243248] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-19T17:43:54.286013] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T17:43:54.302432] [DEBUG] [LOCAL ] BRO: Primary data saved (52689 records). [2025-09-19T17:43:54.302614] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-19T17:43:54.302749] [INFO ] [MAIN ] Update Progress: 334/2372 symbols completed. BRO took 32.5s. Estimated remaining: 4h 27m 28s. Rate: 7.6 symbols/min [2025-09-19T17:43:54.484370] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:54.491803] [DEBUG] [LOCAL ] BRT: Loaded 4864 existing records from primary storage. [2025-09-19T17:43:54.491919] [INFO ] [MAIN ] BRT: Loaded 4864 existing records. [2025-09-19T17:43:54.678700] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:43:54.679016] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-19T17:43:54.679064] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-19T17:43:54.679494] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-19T17:43:54.679554] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-19T17:43:55.035465] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:55.052894] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-19T17:43:55.057424] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T17:43:55.065151] [INFO ] [REMOTE ] BRSL: Full fetch complete (20502 records). [2025-09-19T17:43:55.065244] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-19T17:43:55.259472] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 56 unique days, need 200 days [2025-09-19T17:43:55.259880] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:43:55.259952] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:43:55.260020] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-19T17:43:55.260087] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-19T17:43:55.260122] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-19T17:43:55.260177] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-19T17:43:55.260259] [INFO ] [MAIN ] Update Progress: 335/2372 symbols completed. BRSL took 23.6s. Estimated remaining: 4h 26m 38s. Rate: 7.6 symbols/min [2025-09-19T17:43:55.433512] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:43:55.453522] [DEBUG] [LOCAL ] BRW: Loaded 19407 existing records from primary storage. [2025-09-19T17:43:55.453693] [INFO ] [MAIN ] BRW: Loaded 19407 existing records. [2025-09-19T17:43:55.633486] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:43:55.633826] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-19T17:43:55.633884] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-19T17:43:55.634640] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-19T17:43:55.634737] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-19T17:43:55.853997] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-19T17:43:55.994783] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:43:56.622143] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T17:43:56.637590] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-19T17:43:56.643202] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-19T17:43:56.679977] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T17:43:57.403589] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T17:43:57.443289] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-19T17:43:58.243282] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-19T17:43:59.043280] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-19T17:43:59.262319] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T17:43:59.377557] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-19T17:43:59.686691] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T17:43:59.843245] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-19T17:44:00.643284] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-19T17:44:01.381828] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T17:44:01.443262] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-19T17:44:02.243320] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-19T17:44:02.346209] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:44:02.560745] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-19T17:44:02.570171] [INFO ] [REMOTE ] BROS: Full fetch complete (76948 records). [2025-09-19T17:44:02.570394] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-19T17:44:02.977419] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-19T17:44:02.977513] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-19T17:44:02.978321] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-19T17:44:02.978385] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-19T17:44:02.979909] [DEBUG] [LOCAL ] BROS: Trimmed 76948 records to 54061 (keeping 200 days of data) [2025-09-19T17:44:03.064072] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-19T17:44:03.305742] [DEBUG] [LOCAL ] BROS: Primary data saved (54061 records). [2025-09-19T17:44:03.305919] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-19T17:44:03.306044] [INFO ] [MAIN ] Update Progress: 336/2372 symbols completed. BROS took 39.1s. Estimated remaining: 4h 26m 31s. Rate: 7.6 symbols/min [2025-09-19T17:44:03.477410] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:03.529210] [DEBUG] [LOCAL ] BRX: Loaded 52216 existing records from primary storage. [2025-09-19T17:44:03.529385] [INFO ] [MAIN ] BRX: Loaded 52216 existing records. [2025-09-19T17:44:03.726167] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:03.726409] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-19T17:44:03.726455] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-19T17:44:03.727886] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-19T17:44:03.727957] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-19T17:44:03.848431] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-19T17:44:04.123816] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:04.148545] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T17:44:04.390358] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T17:44:04.506053] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T17:44:04.643245] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-19T17:44:05.377380] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T17:44:05.443250] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-19T17:44:06.184989] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T17:44:06.243294] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-19T17:44:07.043294] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-19T17:44:07.475349] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T17:44:07.843278] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-19T17:44:07.953089] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T17:44:08.643269] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-19T17:44:08.818516] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T17:44:09.443313] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-19T17:44:10.243290] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-19T17:44:10.568266] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T17:44:10.730872] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T17:44:11.043276] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-19T17:44:11.645791] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T17:44:11.843280] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-19T17:44:12.650757] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-19T17:44:12.655409] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T17:44:12.915728] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T17:44:13.443273] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-19T17:44:13.944919] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:44:14.014880] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-19T17:44:14.016308] [INFO ] [REMOTE ] BRT: Full fetch complete (6768 records). [2025-09-19T17:44:14.016440] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-19T17:44:14.248458] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-19T17:44:14.399594] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-19T17:44:14.399705] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-19T17:44:14.400014] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-19T17:44:14.400075] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-19T17:44:14.400491] [DEBUG] [LOCAL ] BRT: Trimmed 6768 records to 4924 (keeping 200 days of data) [2025-09-19T17:44:14.431374] [DEBUG] [LOCAL ] BRT: Primary data saved (4924 records). [2025-09-19T17:44:14.431507] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-19T17:44:14.431613] [INFO ] [MAIN ] Update Progress: 337/2372 symbols completed. BRT took 20.1s. Estimated remaining: 4h 26m 43s. Rate: 7.6 symbols/min [2025-09-19T17:44:14.603304] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:14.603533] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-09-19T17:44:14.603589] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-09-19T17:44:14.603758] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-19T17:44:14.603805] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-19T17:44:14.603849] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-09-19T17:44:14.603882] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-19T17:44:14.968254] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:15.043293] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-19T17:44:15.704033] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:44:15.843270] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-19T17:44:16.643226] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-19T17:44:16.794209] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T17:44:16.982419] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:44:17.443287] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-19T17:44:18.117815] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:44:18.243315] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-19T17:44:18.518841] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T17:44:19.043316] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-19T17:44:19.122706] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T17:44:19.843331] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-19T17:44:20.259990] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T17:44:20.643226] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-19T17:44:21.133945] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:44:21.443231] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-19T17:44:21.757873] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T17:44:22.243267] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-19T17:44:23.043264] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-19T17:44:23.458775] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T17:44:23.843274] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-19T17:44:24.090888] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T17:44:24.095203] [INFO ] [REMOTE ] BRW: Full fetch complete (29503 records). [2025-09-19T17:44:24.095306] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-19T17:44:24.485633] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-19T17:44:24.485758] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-19T17:44:24.486362] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-19T17:44:24.486437] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-19T17:44:24.487418] [DEBUG] [LOCAL ] BRW: Trimmed 29503 records to 19506 (keeping 200 days of data) [2025-09-19T17:44:24.607542] [DEBUG] [LOCAL ] BRW: Primary data saved (19506 records). [2025-09-19T17:44:24.607792] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-19T17:44:24.607952] [INFO ] [MAIN ] Update Progress: 338/2372 symbols completed. BRW took 29.3s. Estimated remaining: 4h 26m 49s. Rate: 7.6 symbols/min [2025-09-19T17:44:24.652094] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-19T17:44:24.788173] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:24.805249] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:44:24.843835] [DEBUG] [LOCAL ] BSBR: Loaded 35306 existing records from primary storage. [2025-09-19T17:44:24.844006] [INFO ] [MAIN ] BSBR: Loaded 35306 existing records. [2025-09-19T17:44:25.026484] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:25.026762] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-19T17:44:25.026818] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-19T17:44:25.027966] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-19T17:44:25.028062] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-19T17:44:25.400229] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:25.443226] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-19T17:44:25.473105] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T17:44:25.478678] [INFO ] [REMOTE ] BRSP: Full fetch complete (53881 records). [2025-09-19T17:44:25.478791] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-19T17:44:25.864563] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-19T17:44:25.864675] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-19T17:44:25.865311] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-19T17:44:25.865367] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-19T17:44:25.866498] [DEBUG] [LOCAL ] BRSP: Trimmed 53881 records to 37505 (keeping 200 days of data) [2025-09-19T17:44:26.074229] [DEBUG] [LOCAL ] BRSP: Primary data saved (37505 records). [2025-09-19T17:44:26.074377] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-19T17:44:26.074471] [INFO ] [MAIN ] Update Progress: 339/2372 symbols completed. BRSP took 39.9s. Estimated remaining: 4h 26m 3s. Rate: 7.6 symbols/min [2025-09-19T17:44:26.246793] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:26.245683] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-19T17:44:26.259885] [DEBUG] [LOCAL ] BSL: Loaded 8070 existing records from primary storage. [2025-09-19T17:44:26.260135] [INFO ] [MAIN ] BSL: Loaded 8070 existing records. [2025-09-19T17:44:26.450965] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:26.451272] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-19T17:44:26.451330] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-19T17:44:26.451765] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-19T17:44:26.451847] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-19T17:44:26.835665] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:26.869397] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T17:44:27.005691] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T17:44:27.043229] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-19T17:44:27.355260] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T17:44:27.843284] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-19T17:44:28.115698] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T17:44:28.643250] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-19T17:44:29.443294] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-19T17:44:29.639350] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:44:30.210385] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T17:44:30.243214] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-19T17:44:31.043236] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-19T17:44:31.130902] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T17:44:31.826245] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T17:44:31.843207] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-19T17:44:32.643248] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-19T17:44:32.765684] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:44:33.443265] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-19T17:44:33.521713] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T17:44:34.153081] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T17:44:34.243242] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-19T17:44:34.547426] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T17:44:35.043274] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-19T17:44:35.206305] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T17:44:35.843282] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-19T17:44:36.643263] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-19T17:44:36.949000] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T17:44:37.115622] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T17:44:37.443268] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-19T17:44:38.248399] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-19T17:44:38.265410] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:44:39.014099] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T17:44:39.029700] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T17:44:39.043234] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-19T17:44:39.843270] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-19T17:44:40.643313] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-19T17:44:40.767909] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T17:44:40.834471] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T17:44:41.443304] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-19T17:44:42.243292] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-19T17:44:42.600403] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:44:42.988466] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:44:43.043217] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-19T17:44:43.401790] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T17:44:43.843325] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-19T17:44:44.625334] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:44:44.632692] [INFO ] [REMOTE ] BSAC: Full fetch complete (43496 records). [2025-09-19T17:44:44.632816] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-19T17:44:44.648507] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-19T17:44:45.017717] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-19T17:44:45.017856] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-19T17:44:45.018398] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-19T17:44:45.018476] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-19T17:44:45.019845] [DEBUG] [LOCAL ] BSAC: Trimmed 43496 records to 33535 (keeping 200 days of data) [2025-09-19T17:44:45.218231] [DEBUG] [LOCAL ] BSAC: Primary data saved (33535 records). [2025-09-19T17:44:45.218377] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-19T17:44:45.218500] [INFO ] [MAIN ] Update Progress: 340/2372 symbols completed. BSAC took 30.8s. Estimated remaining: 4h 27m 3s. Rate: 7.6 symbols/min [2025-09-19T17:44:45.431074] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:45.443320] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-19T17:44:45.474876] [DEBUG] [LOCAL ] BSM: Loaded 32852 existing records from primary storage. [2025-09-19T17:44:45.475013] [INFO ] [MAIN ] BSM: Loaded 32852 existing records. [2025-09-19T17:44:45.660027] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:45.660506] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-19T17:44:45.660575] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-19T17:44:45.670467] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-19T17:44:45.683540] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-19T17:44:45.737304] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T17:44:46.061719] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:46.243224] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-19T17:44:46.476880] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T17:44:46.798918] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T17:44:46.808016] [INFO ] [REMOTE ] BRX: Full fetch complete (74934 records). [2025-09-19T17:44:46.808143] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-19T17:44:47.054683] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-19T17:44:47.200415] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-19T17:44:47.200504] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-19T17:44:47.201300] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-19T17:44:47.201388] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-19T17:44:47.202981] [DEBUG] [LOCAL ] BRX: Trimmed 74934 records to 52569 (keeping 200 days of data) [2025-09-19T17:44:47.448762] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T17:44:47.560628] [DEBUG] [LOCAL ] BRX: Primary data saved (52569 records). [2025-09-19T17:44:47.560834] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-19T17:44:47.560927] [INFO ] [MAIN ] Update Progress: 341/2372 symbols completed. BRX took 44.3s. Estimated remaining: 4h 26m 22s. Rate: 7.6 symbols/min [2025-09-19T17:44:47.730594] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:47.730812] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-09-19T17:44:47.730855] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-09-19T17:44:47.731001] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-19T17:44:47.731042] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-19T17:44:47.731082] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-19T17:44:47.731113] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-19T17:44:47.848365] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-19T17:44:48.102717] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:48.423552] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:44:48.643304] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-19T17:44:49.449778] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-19T17:44:49.453688] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T17:44:49.727000] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T17:44:50.243269] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-19T17:44:50.366888] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T17:44:51.043267] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-19T17:44:51.843256] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-19T17:44:51.885914] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T17:44:51.891686] [INFO ] [REMOTE ] BSBR: Full fetch complete (50560 records). [2025-09-19T17:44:51.891791] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-19T17:44:52.277526] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-19T17:44:52.277603] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-19T17:44:52.278179] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-19T17:44:52.278243] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-19T17:44:52.280075] [DEBUG] [LOCAL ] BSBR: Trimmed 50560 records to 35603 (keeping 200 days of data) [2025-09-19T17:44:52.396697] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T17:44:52.511405] [DEBUG] [LOCAL ] BSBR: Primary data saved (35603 records). [2025-09-19T17:44:52.511553] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-19T17:44:52.511667] [INFO ] [MAIN ] Update Progress: 342/2372 symbols completed. BSBR took 27.9s. Estimated remaining: 4h 25m 57s. Rate: 7.6 symbols/min [2025-09-19T17:44:52.656297] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-19T17:44:52.690704] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:52.719597] [DEBUG] [LOCAL ] BSTZ: Loaded 25254 existing records from primary storage. [2025-09-19T17:44:52.719783] [INFO ] [MAIN ] BSTZ: Loaded 25254 existing records. [2025-09-19T17:44:52.901145] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:52.901415] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-19T17:44:52.901465] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-19T17:44:52.902539] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-19T17:44:52.902604] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-19T17:44:53.276222] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T17:44:53.299452] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:53.443217] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-19T17:44:53.987742] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:44:54.243312] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-19T17:44:54.423489] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T17:44:54.828900] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:44:55.043275] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-19T17:44:55.767849] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T17:44:55.843270] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-19T17:44:56.643258] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-19T17:44:56.917105] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T17:44:56.918904] [INFO ] [REMOTE ] BSL: Full fetch complete (12552 records). [2025-09-19T17:44:56.918975] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-19T17:44:57.300351] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-19T17:44:57.300463] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-19T17:44:57.300807] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-19T17:44:57.300869] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-19T17:44:57.301349] [DEBUG] [LOCAL ] BSL: Trimmed 12552 records to 8186 (keeping 200 days of data) [2025-09-19T17:44:57.354663] [DEBUG] [LOCAL ] BSL: Primary data saved (8186 records). [2025-09-19T17:44:57.354805] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-19T17:44:57.354906] [INFO ] [MAIN ] Update Progress: 343/2372 symbols completed. BSL took 31.3s. Estimated remaining: 4h 25m 31s. Rate: 7.6 symbols/min [2025-09-19T17:44:57.452775] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-19T17:44:57.529501] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:44:57.600304] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-09-19T17:44:57.600454] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-09-19T17:44:57.780764] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:44:57.781028] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-19T17:44:57.781093] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-19T17:44:57.782709] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-19T17:44:57.782773] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-19T17:44:58.165539] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T17:44:58.164387] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:44:58.243234] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-19T17:44:58.975901] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T17:44:59.043243] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-19T17:44:59.639007] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T17:44:59.843222] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-19T17:44:59.878575] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T17:45:00.643280] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-19T17:45:01.443291] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-19T17:45:02.243388] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-19T17:45:02.297034] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-19T17:45:02.524752] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T17:45:03.043290] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-19T17:45:03.843306] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-19T17:45:03.867509] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-19T17:45:04.643263] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-19T17:45:05.194060] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-09-19T17:45:05.443283] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-19T17:45:06.462851] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T17:45:06.470595] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-19T17:45:06.676739] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T17:45:06.953897] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T17:45:07.043306] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-19T17:45:07.142746] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (4.10 seconds). [2025-09-19T17:45:07.843294] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-19T17:45:08.017345] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T17:45:08.134162] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T17:45:08.643321] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-19T17:45:09.044804] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T17:45:09.443274] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-19T17:45:09.930208] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T17:45:09.938561] [INFO ] [REMOTE ] BSM: Full fetch complete (47701 records). [2025-09-19T17:45:09.938780] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-19T17:45:10.243832] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-19T17:45:10.337376] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-19T17:45:10.337462] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-19T17:45:10.338088] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-19T17:45:10.338162] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-19T17:45:10.339242] [DEBUG] [LOCAL ] BSM: Trimmed 47701 records to 33095 (keeping 200 days of data) [2025-09-19T17:45:10.548877] [DEBUG] [LOCAL ] BSM: Primary data saved (33095 records). [2025-09-19T17:45:10.549019] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-19T17:45:10.549111] [INFO ] [MAIN ] Update Progress: 344/2372 symbols completed. BSM took 25.3s. Estimated remaining: 4h 25m 55s. Rate: 7.6 symbols/min [2025-09-19T17:45:10.739259] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:10.746923] [DEBUG] [LOCAL ] BTA: Loaded 5346 existing records from primary storage. [2025-09-19T17:45:10.747051] [INFO ] [MAIN ] BTA: Loaded 5346 existing records. [2025-09-19T17:45:10.938020] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:10.938549] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-19T17:45:10.938634] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-19T17:45:10.939139] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-19T17:45:10.944369] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-19T17:45:10.998717] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T17:45:11.055525] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-19T17:45:11.328989] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:11.850605] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-19T17:45:11.867992] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T17:45:12.457755] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T17:45:12.643268] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-19T17:45:13.275353] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T17:45:13.443368] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-19T17:45:14.231712] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T17:45:14.243207] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-19T17:45:15.043283] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-19T17:45:15.336694] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T17:45:15.623443] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T17:45:15.843284] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-19T17:45:16.643282] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-19T17:45:17.041862] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T17:45:17.046244] [INFO ] [REMOTE ] BST: Full fetch complete (28602 records). [2025-09-19T17:45:17.046463] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-19T17:45:17.049720] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:45:17.049954] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:45:17.050006] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:45:17.050082] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-19T17:45:17.050357] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-19T17:45:17.050398] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-09-19T17:45:17.050456] [DEBUG] [LOCAL ] BST: No derivative data file found to delete. [2025-09-19T17:45:17.050579] [INFO ] [MAIN ] Update Progress: 345/2372 symbols completed. BST took 29.5s. Estimated remaining: 4h 25m 39s. Rate: 7.6 symbols/min [2025-09-19T17:45:17.245523] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:17.264030] [DEBUG] [LOCAL ] BTCM: Loaded 14279 existing records from primary storage. [2025-09-19T17:45:17.264259] [INFO ] [MAIN ] BTCM: Loaded 14279 existing records. [2025-09-19T17:45:17.452738] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-19T17:45:17.469396] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:17.471673] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-19T17:45:17.471849] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-19T17:45:17.472908] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-19T17:45:17.472985] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-19T17:45:17.922757] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:17.926416] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-09-19T17:45:17.976271] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T17:45:18.243268] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-19T17:45:18.891121] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T17:45:19.043291] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-19T17:45:19.111997] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T17:45:19.843279] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-19T17:45:19.974106] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T17:45:20.643269] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-19T17:45:20.832851] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T17:45:21.443286] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-19T17:45:21.507408] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-19T17:45:22.243274] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-19T17:45:22.909883] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:45:22.914031] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36706 records). [2025-09-19T17:45:22.914166] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-19T17:45:23.048448] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-19T17:45:23.239813] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T17:45:23.311496] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-19T17:45:23.311578] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-19T17:45:23.312109] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-19T17:45:23.312172] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-19T17:45:23.313121] [DEBUG] [LOCAL ] BSTZ: Trimmed 36706 records to 25410 (keeping 200 days of data) [2025-09-19T17:45:23.486094] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25410 records). [2025-09-19T17:45:23.486287] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-19T17:45:23.486391] [INFO ] [MAIN ] Update Progress: 346/2372 symbols completed. BSTZ took 31.0s. Estimated remaining: 4h 25m 22s. Rate: 7.6 symbols/min [2025-09-19T17:45:23.659062] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:23.715387] [DEBUG] [LOCAL ] BTE: Loaded 53147 existing records from primary storage. [2025-09-19T17:45:23.715569] [INFO ] [MAIN ] BTE: Loaded 53147 existing records. [2025-09-19T17:45:23.857190] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-19T17:45:23.899670] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:23.899925] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-19T17:45:23.899988] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-19T17:45:23.901564] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-19T17:45:23.901632] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-19T17:45:24.273424] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:24.287056] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T17:45:24.396208] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:45:24.643260] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-19T17:45:25.443278] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-19T17:45:25.587765] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T17:45:26.243285] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-19T17:45:26.812425] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T17:45:27.043287] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-19T17:45:27.554336] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T17:45:27.843233] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-19T17:45:28.100464] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T17:45:28.643316] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-19T17:45:29.443244] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-19T17:45:29.512985] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T17:45:30.243328] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-19T17:45:30.287180] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T17:45:30.289001] [INFO ] [REMOTE ] BTA: Full fetch complete (9478 records). [2025-09-19T17:45:30.289130] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-19T17:45:30.672741] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-19T17:45:30.673031] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-19T17:45:30.673351] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-19T17:45:30.673452] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-19T17:45:30.674210] [DEBUG] [LOCAL ] BTA: Trimmed 9478 records to 5358 (keeping 200 days of data) [2025-09-19T17:45:30.735095] [DEBUG] [LOCAL ] BTA: Primary data saved (5358 records). [2025-09-19T17:45:30.736848] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T17:45:30.735812] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-19T17:45:30.737007] [INFO ] [MAIN ] Update Progress: 347/2372 symbols completed. BTA took 20.2s. Estimated remaining: 4h 25m 11s. Rate: 7.6 symbols/min [2025-09-19T17:45:30.925131] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:30.981771] [DEBUG] [LOCAL ] BTI: Loaded 53942 existing records from primary storage. [2025-09-19T17:45:30.981919] [INFO ] [MAIN ] BTI: Loaded 53942 existing records. [2025-09-19T17:45:31.048521] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-19T17:45:31.171359] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:31.171637] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-19T17:45:31.171723] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-19T17:45:31.173171] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-19T17:45:31.173232] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-19T17:45:31.547393] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:31.843268] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-19T17:45:32.314666] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T17:45:32.381880] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T17:45:32.643281] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-19T17:45:32.830167] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T17:45:33.133507] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-19T17:45:33.443264] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-19T17:45:34.243262] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-19T17:45:34.398627] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T17:45:35.043261] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-19T17:45:35.843261] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-19T17:45:36.172541] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:45:36.254304] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T17:45:36.643259] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-19T17:45:37.443250] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-19T17:45:37.463401] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T17:45:38.018565] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:45:38.243260] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-19T17:45:39.043270] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-19T17:45:39.815037] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T17:45:39.843214] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-19T17:45:40.340685] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T17:45:40.643235] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-19T17:45:40.679425] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T17:45:41.443314] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-19T17:45:41.606120] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:45:42.243235] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-19T17:45:42.567727] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T17:45:42.982790] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T17:45:43.043222] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-19T17:45:43.843281] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-19T17:45:44.353044] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T17:45:44.643232] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-19T17:45:45.322736] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-19T17:45:45.330934] [INFO ] [REMOTE ] BSX: Full fetch complete (77675 records). [2025-09-19T17:45:45.331087] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-19T17:45:45.444790] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-19T17:45:45.776309] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-19T17:45:45.776450] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-19T17:45:45.777571] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-19T17:45:45.777719] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-19T17:45:45.796518] [DEBUG] [LOCAL ] BSX: Trimmed 77675 records to 54468 (keeping 200 days of data) [2025-09-19T17:45:45.815983] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T17:45:46.172117] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-09-19T17:45:46.172330] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-19T17:45:46.172592] [INFO ] [MAIN ] Update Progress: 348/2372 symbols completed. BSX took 48.8s. Estimated remaining: 4h 25m 47s. Rate: 7.6 symbols/min [2025-09-19T17:45:46.248432] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-19T17:45:46.348027] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:46.358783] [DEBUG] [LOCAL ] BTO: Loaded 9115 existing records from primary storage. [2025-09-19T17:45:46.359430] [INFO ] [MAIN ] BTO: Loaded 9115 existing records. [2025-09-19T17:45:46.534074] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:46.534370] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-19T17:45:46.534420] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-19T17:45:46.534844] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-19T17:45:46.534906] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-19T17:45:46.889491] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:45:46.912463] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:46.917261] [INFO ] [REMOTE ] BTCM: Full fetch complete (19491 records). [2025-09-19T17:45:46.917521] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-19T17:45:47.043547] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-19T17:45:47.372525] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-19T17:45:47.394820] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-19T17:45:47.395249] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-19T17:45:47.395840] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-19T17:45:47.395920] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-19T17:45:47.397007] [DEBUG] [LOCAL ] BTCM: Trimmed 19491 records to 14565 (keeping 200 days of data) [2025-09-19T17:45:47.479495] [DEBUG] [LOCAL ] BTCM: Primary data saved (14565 records). [2025-09-19T17:45:47.479681] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-19T17:45:47.479791] [INFO ] [MAIN ] Update Progress: 349/2372 symbols completed. BTCM took 30.4s. Estimated remaining: 4h 25m 1s. Rate: 7.6 symbols/min [2025-09-19T17:45:47.654680] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:45:47.671810] [DEBUG] [LOCAL ] BTT: Loaded 16236 existing records from primary storage. [2025-09-19T17:45:47.671947] [INFO ] [MAIN ] BTT: Loaded 16236 existing records. [2025-09-19T17:45:47.844633] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-19T17:45:47.848503] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:45:47.849806] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-19T17:45:47.849880] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-19T17:45:47.850439] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-19T17:45:47.850502] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-19T17:45:48.202715] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:45:48.211341] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T17:45:48.273486] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T17:45:48.643272] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-19T17:45:49.443294] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-19T17:45:49.622147] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T17:45:50.243271] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-19T17:45:50.440020] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T17:45:50.550884] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-19T17:45:51.043351] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-19T17:45:51.198633] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T17:45:51.843297] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-19T17:45:52.214174] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T17:45:52.643278] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-19T17:45:53.443291] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-19T17:45:53.998722] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T17:45:54.138313] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T17:45:54.243291] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-19T17:45:55.008321] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-19T17:45:55.027828] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T17:45:55.043224] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-19T17:45:55.843295] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-19T17:45:56.643282] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-19T17:45:56.725237] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T17:45:57.443272] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-19T17:45:57.694247] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T17:45:57.882537] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T17:45:58.204733] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:45:58.243267] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-19T17:45:59.043310] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-19T17:45:59.843292] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-19T17:46:00.034757] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T17:46:00.239992] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T17:46:00.643321] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-19T17:46:00.686906] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T17:46:01.443334] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-19T17:46:01.627724] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T17:46:02.243296] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-19T17:46:02.588451] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T17:46:03.043274] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-19T17:46:03.843269] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-19T17:46:04.026824] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T17:46:04.388560] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T17:46:04.643271] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-19T17:46:05.304348] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:46:05.443268] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-19T17:46:06.243340] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-19T17:46:06.818553] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T17:46:06.956017] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:46:07.043327] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-19T17:46:07.098925] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T17:46:07.111218] [INFO ] [REMOTE ] BTE: Full fetch complete (75982 records). [2025-09-19T17:46:07.111425] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-19T17:46:07.573736] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-19T17:46:07.573866] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-19T17:46:07.574785] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-19T17:46:07.574856] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-19T17:46:07.576516] [DEBUG] [LOCAL ] BTE: Trimmed 75982 records to 53527 (keeping 200 days of data) [2025-09-19T17:46:07.864595] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-19T17:46:07.919760] [DEBUG] [LOCAL ] BTE: Primary data saved (53527 records). [2025-09-19T17:46:07.919978] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-19T17:46:07.920098] [INFO ] [MAIN ] Update Progress: 350/2372 symbols completed. BTE took 44.4s. Estimated remaining: 4h 26m 6s. Rate: 7.6 symbols/min [2025-09-19T17:46:08.102387] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:08.159099] [DEBUG] [LOCAL ] BTU: Loaded 53692 existing records from primary storage. [2025-09-19T17:46:08.159329] [INFO ] [MAIN ] BTU: Loaded 53692 existing records. [2025-09-19T17:46:08.340149] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:08.340450] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-19T17:46:08.340498] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-19T17:46:08.341782] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-19T17:46:08.341843] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-19T17:46:08.648401] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-19T17:46:08.702168] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:09.146759] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T17:46:09.443279] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-19T17:46:09.494847] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T17:46:09.496826] [INFO ] [REMOTE ] BTO: Full fetch complete (13383 records). [2025-09-19T17:46:09.496912] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-19T17:46:09.893972] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-19T17:46:09.894360] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-19T17:46:09.894798] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-19T17:46:09.901972] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-19T17:46:09.916985] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-09-19T17:46:09.917115] [DEBUG] [LOCAL ] BTO: Trimmed 13383 records to 9175 (keeping 200 days of data) [2025-09-19T17:46:09.957875] [INFO ] [REMOTE ] BTI: Full fetch complete (77425 records). [2025-09-19T17:46:09.970615] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-19T17:46:10.253554] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-19T17:46:10.366021] [DEBUG] [LOCAL ] BTO: Primary data saved (9175 records). [2025-09-19T17:46:10.377155] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-19T17:46:10.396873] [INFO ] [MAIN ] Update Progress: 351/2372 symbols completed. BTO took 24.2s. Estimated remaining: 4h 25m 27s. Rate: 7.6 symbols/min [2025-09-19T17:46:10.448965] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-19T17:46:10.487008] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-19T17:46:10.509686] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-19T17:46:10.520453] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-19T17:46:10.575284] [DEBUG] [LOCAL ] BTI: Trimmed 77425 records to 54332 (keeping 200 days of data) [2025-09-19T17:46:10.594737] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:10.595166] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-19T17:46:10.595223] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-19T17:46:10.595678] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-19T17:46:10.595746] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-19T17:46:10.595795] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-19T17:46:10.595829] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-19T17:46:11.077138] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:11.078570] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-19T17:46:11.314533] [DEBUG] [LOCAL ] BTI: Primary data saved (54332 records). [2025-09-19T17:46:11.314712] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-19T17:46:11.314813] [INFO ] [MAIN ] Update Progress: 352/2372 symbols completed. BTI took 40.6s. Estimated remaining: 4h 24m 39s. Rate: 7.6 symbols/min [2025-09-19T17:46:11.463738] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:46:11.492397] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-19T17:46:11.492180] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:11.525401] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T17:46:11.554759] [DEBUG] [LOCAL ] BTZ: Loaded 23255 existing records from primary storage. [2025-09-19T17:46:11.554948] [INFO ] [MAIN ] BTZ: Loaded 23255 existing records. [2025-09-19T17:46:11.727786] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T17:46:11.749914] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:11.753509] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-19T17:46:11.753704] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-19T17:46:11.754583] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-19T17:46:11.754685] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-19T17:46:11.848327] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-19T17:46:12.128485] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:12.643265] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-19T17:46:12.889291] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:46:12.889610] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-19T17:46:13.080052] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T17:46:13.084520] [INFO ] [REMOTE ] BTT: Full fetch complete (24461 records). [2025-09-19T17:46:13.084633] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-19T17:46:13.447622] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-19T17:46:13.483887] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-19T17:46:13.483973] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-19T17:46:13.484387] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-19T17:46:13.484570] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-19T17:46:13.485524] [DEBUG] [LOCAL ] BTT: Trimmed 24461 records to 16323 (keeping 200 days of data) [2025-09-19T17:46:13.597536] [DEBUG] [LOCAL ] BTT: Primary data saved (16323 records). [2025-09-19T17:46:13.597723] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-19T17:46:13.597882] [INFO ] [MAIN ] Update Progress: 353/2372 symbols completed. BTT took 26.1s. Estimated remaining: 4h 23m 59s. Rate: 7.6 symbols/min [2025-09-19T17:46:13.781899] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:13.837393] [DEBUG] [LOCAL ] BUD: Loaded 53148 existing records from primary storage. [2025-09-19T17:46:13.837600] [INFO ] [MAIN ] BUD: Loaded 53148 existing records. [2025-09-19T17:46:14.020702] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:14.021019] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-19T17:46:14.021116] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-19T17:46:14.022373] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-19T17:46:14.022439] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-19T17:46:14.251183] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-19T17:46:14.399116] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:15.043297] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-19T17:46:15.570442] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T17:46:15.710290] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T17:46:15.776973] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T17:46:15.843298] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-19T17:46:16.643252] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-19T17:46:17.443263] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-19T17:46:18.122987] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T17:46:18.243248] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-19T17:46:18.461179] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T17:46:19.043275] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-19T17:46:19.123700] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T17:46:19.842582] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T17:46:19.847405] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-19T17:46:20.643254] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-19T17:46:20.708764] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T17:46:21.390780] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:46:21.443292] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-19T17:46:21.671513] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T17:46:22.243281] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-19T17:46:23.043270] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-19T17:46:23.370597] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T17:46:23.843239] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-19T17:46:23.966364] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-19T17:46:24.297396] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T17:46:24.643290] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-19T17:46:25.443313] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-19T17:46:26.062344] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-19T17:46:26.241839] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T17:46:26.245957] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-19T17:46:26.892454] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T17:46:27.043280] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-19T17:46:27.458516] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T17:46:27.843263] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-19T17:46:28.643271] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-19T17:46:29.076962] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T17:46:29.443273] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-19T17:46:29.639989] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T17:46:30.254977] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-19T17:46:30.260893] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-19T17:46:31.043244] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-19T17:46:31.113240] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T17:46:31.376630] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T17:46:31.843264] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-19T17:46:32.154638] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T17:46:32.643265] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-19T17:46:32.668684] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T17:46:33.443268] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-19T17:46:34.243279] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-19T17:46:34.295902] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T17:46:34.317954] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T17:46:35.043272] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-19T17:46:35.843274] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-19T17:46:36.101997] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T17:46:36.639862] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T17:46:36.644278] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-19T17:46:36.646288] [INFO ] [REMOTE ] BTX: Full fetch complete (35060 records). [2025-09-19T17:46:36.646451] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-19T17:46:36.851832] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 147 unique days, need 200 days [2025-09-19T17:46:36.859770] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:46:36.872517] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:46:36.874166] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T17:46:36.873147] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-19T17:46:36.881931] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-19T17:46:36.882005] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-19T17:46:36.882081] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-19T17:46:36.882197] [INFO ] [MAIN ] Update Progress: 354/2372 symbols completed. BTX took 26.5s. Estimated remaining: 4h 25m 20s. Rate: 7.6 symbols/min [2025-09-19T17:46:37.056432] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:37.070191] [DEBUG] [LOCAL ] BUI: Loaded 11572 existing records from primary storage. [2025-09-19T17:46:37.070313] [INFO ] [MAIN ] BUI: Loaded 11572 existing records. [2025-09-19T17:46:37.252957] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:37.253247] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-19T17:46:37.253309] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-19T17:46:37.253889] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-19T17:46:37.253986] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-19T17:46:37.448354] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-19T17:46:37.623925] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:38.243253] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-19T17:46:38.892577] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T17:46:39.083310] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-19T17:46:39.106421] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T17:46:39.350088] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T17:46:39.843267] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-19T17:46:40.518584] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T17:46:40.522716] [INFO ] [REMOTE ] BTZ: Full fetch complete (33952 records). [2025-09-19T17:46:40.522821] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-19T17:46:40.648451] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-19T17:46:40.921026] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-19T17:46:40.921126] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-19T17:46:40.921682] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-19T17:46:40.921783] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-19T17:46:40.930567] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:46:40.934209] [DEBUG] [LOCAL ] BTZ: Trimmed 33952 records to 23355 (keeping 200 days of data) [2025-09-19T17:46:41.078762] [DEBUG] [LOCAL ] BTZ: Primary data saved (23355 records). [2025-09-19T17:46:41.078904] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-19T17:46:41.079008] [INFO ] [MAIN ] Update Progress: 355/2372 symbols completed. BTZ took 29.8s. Estimated remaining: 4h 24m 51s. Rate: 7.6 symbols/min [2025-09-19T17:46:41.250738] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:41.300502] [DEBUG] [LOCAL ] BUR: Loaded 45435 existing records from primary storage. [2025-09-19T17:46:41.300699] [INFO ] [MAIN ] BUR: Loaded 45435 existing records. [2025-09-19T17:46:41.448420] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-19T17:46:41.496087] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:41.496432] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-19T17:46:41.496504] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-19T17:46:41.497482] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-19T17:46:41.497568] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-19T17:46:41.864714] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:42.243226] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-19T17:46:42.918526] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T17:46:42.931470] [INFO ] [REMOTE ] BTU: Full fetch complete (76827 records). [2025-09-19T17:46:42.931636] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-19T17:46:43.048314] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-19T17:46:43.359036] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-19T17:46:43.359129] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-19T17:46:43.359942] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-19T17:46:43.360009] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-19T17:46:43.362042] [DEBUG] [LOCAL ] BTU: Trimmed 76827 records to 54082 (keeping 200 days of data) [2025-09-19T17:46:43.750306] [DEBUG] [LOCAL ] BTU: Primary data saved (54082 records). [2025-09-19T17:46:43.751750] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-19T17:46:43.751871] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-19T17:46:43.761984] [INFO ] [MAIN ] Update Progress: 356/2372 symbols completed. BTU took 35.8s. Estimated remaining: 4h 24m 13s. Rate: 7.6 symbols/min [2025-09-19T17:46:43.856432] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-19T17:46:43.943009] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:46:43.994442] [DEBUG] [LOCAL ] BURL: Loaded 46881 existing records from primary storage. [2025-09-19T17:46:43.994755] [INFO ] [MAIN ] BURL: Loaded 46881 existing records. [2025-09-19T17:46:44.185967] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:46:44.194278] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T17:46:44.194418] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-19T17:46:44.197127] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-19T17:46:44.205638] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-19T17:46:44.219477] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-19T17:46:44.252828] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:46:44.587508] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:46:44.643235] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-19T17:46:45.443310] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-19T17:46:45.583232] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T17:46:45.934883] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T17:46:46.243305] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-19T17:46:46.784079] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-19T17:46:47.043266] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-19T17:46:47.197725] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T17:46:47.622799] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T17:46:47.843260] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-19T17:46:48.643254] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-19T17:46:49.443300] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-19T17:46:49.725249] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T17:46:50.243247] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-19T17:46:50.309396] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T17:46:51.043263] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-19T17:46:51.451082] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:46:51.761251] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:46:51.843238] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-19T17:46:52.643220] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-19T17:46:52.684428] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T17:46:53.117859] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T17:46:53.443267] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-19T17:46:54.243269] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-19T17:46:54.399563] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T17:46:54.402678] [INFO ] [REMOTE ] BUI: Full fetch complete (16158 records). [2025-09-19T17:46:54.402878] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-19T17:46:54.562134] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T17:46:54.818537] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-19T17:46:54.818620] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-19T17:46:54.819010] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-19T17:46:54.819086] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-19T17:46:54.819963] [DEBUG] [LOCAL ] BUI: Trimmed 16158 records to 11660 (keeping 200 days of data) [2025-09-19T17:46:54.898341] [DEBUG] [LOCAL ] BUI: Primary data saved (11660 records). [2025-09-19T17:46:54.898505] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-19T17:46:54.898675] [INFO ] [MAIN ] Update Progress: 357/2372 symbols completed. BUI took 18.0s. Estimated remaining: 4h 24m 24s. Rate: 7.6 symbols/min [2025-09-19T17:46:55.043263] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-19T17:46:55.843241] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-19T17:46:56.489851] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T17:46:56.497740] [INFO ] [REMOTE ] BUD: Full fetch complete (76490 records). [2025-09-19T17:46:56.497872] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-19T17:46:56.897907] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-19T17:46:56.898108] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-19T17:46:56.899129] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-19T17:46:56.899227] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-19T17:46:56.901192] [DEBUG] [LOCAL ] BUD: Trimmed 76490 records to 53535 (keeping 200 days of data) [2025-09-19T17:46:56.925602] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T17:46:56.934368] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-19T17:46:57.271439] [DEBUG] [LOCAL ] BUD: Primary data saved (53535 records). [2025-09-19T17:46:57.271867] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-19T17:46:57.272046] [INFO ] [MAIN ] Update Progress: 358/2372 symbols completed. BUD took 43.7s. Estimated remaining: 4h 23m 45s. Rate: 7.6 symbols/min [2025-09-19T17:46:57.792549] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T17:46:57.803153] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-19T17:46:59.003496] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T17:46:59.015187] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-19T17:46:59.696504] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T17:46:59.712495] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-19T17:47:01.024923] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:47:01.035403] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-19T17:47:03.035170] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (3.32 seconds). [2025-09-19T17:47:03.044555] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-19T17:47:03.179760] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T17:47:03.189961] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-19T17:47:04.380832] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T17:47:04.391300] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-19T17:47:04.940995] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T17:47:04.950945] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-19T17:47:06.150504] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:47:06.160738] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-19T17:47:06.381579] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T17:47:06.392637] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-19T17:47:07.637758] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T17:47:07.648288] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-19T17:47:08.443840] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T17:47:08.453736] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-19T17:47:09.652221] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T17:47:09.659505] [INFO ] [REMOTE ] BURL: Full fetch complete (65708 records). [2025-09-19T17:47:09.659802] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-19T17:47:10.047761] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-19T17:47:10.047856] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-19T17:47:10.048560] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-19T17:47:10.048605] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-19T17:47:10.049989] [DEBUG] [LOCAL ] BURL: Trimmed 65708 records to 47179 (keeping 200 days of data) [2025-09-19T17:47:10.342034] [DEBUG] [LOCAL ] BURL: Primary data saved (47179 records). [2025-09-19T17:47:10.342494] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-19T17:47:10.342613] [INFO ] [MAIN ] Update Progress: 359/2372 symbols completed. BURL took 26.6s. Estimated remaining: 4h 24m 7s. Rate: 7.6 symbols/min [2025-09-19T17:47:10.395730] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T17:47:10.402602] [INFO ] [REMOTE ] BUR: Full fetch complete (63192 records). [2025-09-19T17:47:10.402749] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-19T17:47:10.788833] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-19T17:47:10.788922] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-19T17:47:10.789597] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-19T17:47:10.789637] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-19T17:47:10.790928] [DEBUG] [LOCAL ] BUR: Trimmed 63192 records to 45780 (keeping 200 days of data) [2025-09-19T17:47:11.075252] [DEBUG] [LOCAL ] BUR: Primary data saved (45780 records). [2025-09-19T17:47:11.075408] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-19T17:47:11.076559] [INFO ] [MAIN ] Update Progress: 360/2372 symbols completed. BUR took 30.0s. Estimated remaining: 4h 23m 19s. Rate: 7.6 symbols/min [2025-09-19T17:47:11.744553] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:11.743638] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:11.822344] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:11.841750] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:11.860051] [DEBUG] [LOCAL ] BUXX: Loaded 15320 existing records from primary storage. [2025-09-19T17:47:11.860353] [INFO ] [MAIN ] BUXX: Loaded 15320 existing records. [2025-09-19T17:47:12.119849] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:12.131921] [DEBUG] [LOCAL ] BV: Loaded 38955 existing records from primary storage. [2025-09-19T17:47:12.132132] [INFO ] [MAIN ] BV: Loaded 38955 existing records. [2025-09-19T17:47:12.154007] [DEBUG] [LOCAL ] BW: Loaded 39797 existing records from primary storage. [2025-09-19T17:47:12.154163] [INFO ] [MAIN ] BW: Loaded 39797 existing records. [2025-09-19T17:47:12.132333] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-19T17:47:12.154825] [DEBUG] [LOCAL ] BVN: Loaded 43859 existing records from primary storage. [2025-09-19T17:47:12.169363] [INFO ] [MAIN ] BVN: Loaded 43859 existing records. [2025-09-19T17:47:12.169285] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-19T17:47:12.249282] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-19T17:47:12.282991] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-19T17:47:12.717846] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:12.800913] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:12.926414] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-19T17:47:12.926165] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:12.891913] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-19T17:47:12.931970] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-19T17:47:12.931879] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-19T17:47:12.958371] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-19T17:47:12.946500] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-19T17:47:12.963677] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-19T17:47:12.972199] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-19T17:47:12.997456] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-19T17:47:12.991434] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-19T17:47:13.002743] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-19T17:47:13.008992] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-19T17:47:13.457149] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:13.522461] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-19T17:47:14.067930] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:14.099404] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-19T17:47:14.201324] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:14.217186] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-19T17:47:14.223920] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:14.225074] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-19T17:47:14.453915] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T17:47:14.456955] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-19T17:47:15.381945] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T17:47:15.385026] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-19T17:47:15.783230] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:47:15.795229] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-19T17:47:15.852497] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T17:47:15.859258] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-19T17:47:15.967123] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T17:47:15.970576] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-19T17:47:16.000817] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T17:47:16.010268] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-19T17:47:16.837409] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T17:47:16.841101] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-19T17:47:16.858382] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T17:47:16.865158] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-19T17:47:16.976481] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:47:16.985816] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-19T17:47:17.282978] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T17:47:17.443270] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-19T17:47:17.519298] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T17:47:18.243270] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-19T17:47:18.624161] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T17:47:18.684351] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T17:47:18.801038] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:47:18.875946] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T17:47:19.043263] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-19T17:47:19.843285] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-19T17:47:20.257355] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T17:47:20.643263] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-19T17:47:21.408739] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:47:21.443247] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-19T17:47:21.846810] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T17:47:22.243269] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-19T17:47:22.617728] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T17:47:23.043254] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-19T17:47:23.644151] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T17:47:23.843292] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-19T17:47:24.643293] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-19T17:47:24.870577] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T17:47:24.982283] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-19T17:47:25.443309] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-19T17:47:26.243314] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-19T17:47:26.598975] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T17:47:26.601690] [INFO ] [REMOTE ] BUXX: Full fetch complete (20284 records). [2025-09-19T17:47:26.601810] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-19T17:47:27.022765] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-19T17:47:27.023479] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-19T17:47:27.025358] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-19T17:47:27.024673] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T17:47:27.025493] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-19T17:47:27.035624] [DEBUG] [LOCAL ] BUXX: Trimmed 20284 records to 15425 (keeping 200 days of data) [2025-09-19T17:47:27.085480] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-19T17:47:27.142955] [DEBUG] [LOCAL ] BUXX: Primary data saved (15425 records). [2025-09-19T17:47:27.143136] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-19T17:47:27.143234] [INFO ] [MAIN ] Update Progress: 361/2372 symbols completed. BUXX took 16.1s. Estimated remaining: 4h 23m 57s. Rate: 7.6 symbols/min [2025-09-19T17:47:27.325262] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:27.380513] [DEBUG] [LOCAL ] BWA: Loaded 52658 existing records from primary storage. [2025-09-19T17:47:27.380699] [INFO ] [MAIN ] BWA: Loaded 52658 existing records. [2025-09-19T17:47:27.573540] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:27.573841] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-19T17:47:27.573904] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-19T17:47:27.575579] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-19T17:47:27.575662] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-19T17:47:27.844484] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-19T17:47:27.937570] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:27.961896] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T17:47:28.277818] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:47:28.643284] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-19T17:47:29.443265] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-19T17:47:29.684543] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T17:47:30.243256] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-19T17:47:30.696055] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T17:47:31.043281] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-19T17:47:31.209619] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T17:47:31.843265] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-19T17:47:32.160171] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T17:47:32.429771] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T17:47:32.643252] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-19T17:47:33.041282] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T17:47:33.443257] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-19T17:47:34.192361] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:47:34.243234] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-19T17:47:35.043289] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-19T17:47:35.564564] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T17:47:35.843286] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-19T17:47:36.136796] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:47:36.648576] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-19T17:47:36.658528] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T17:47:37.364802] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:47:37.443257] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-19T17:47:38.214195] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T17:47:38.221529] [INFO ] [REMOTE ] BW: Full fetch complete (58678 records). [2025-09-19T17:47:38.221671] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-19T17:47:38.253387] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-19T17:47:38.618015] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-19T17:47:38.618115] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-19T17:47:38.618801] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-19T17:47:38.618869] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-19T17:47:38.620272] [DEBUG] [LOCAL ] BW: Trimmed 58678 records to 40158 (keeping 200 days of data) [2025-09-19T17:47:38.865409] [DEBUG] [LOCAL ] BW: Primary data saved (40158 records). [2025-09-19T17:47:38.901617] [INFO ] [MAIN ] BW: Full history saved. [2025-09-19T17:47:38.902221] [INFO ] [MAIN ] Update Progress: 362/2372 symbols completed. BW took 27.8s. Estimated remaining: 4h 24m 10s. Rate: 7.6 symbols/min [2025-09-19T17:47:38.904969] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T17:47:39.048363] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-19T17:47:39.108596] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:39.122878] [DEBUG] [LOCAL ] BWG: Loaded 12419 existing records from primary storage. [2025-09-19T17:47:39.123026] [INFO ] [MAIN ] BWG: Loaded 12419 existing records. [2025-09-19T17:47:39.322131] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:39.322419] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-19T17:47:39.322471] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-19T17:47:39.323065] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-19T17:47:39.323127] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-19T17:47:39.721434] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:39.843274] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-19T17:47:40.113580] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:47:40.643266] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-19T17:47:41.163801] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T17:47:41.443247] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-19T17:47:41.783929] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T17:47:41.878124] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T17:47:42.243281] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-19T17:47:42.790763] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T17:47:43.043262] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-19T17:47:43.843302] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-19T17:47:44.155213] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T17:47:44.188320] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T17:47:44.643258] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-19T17:47:45.345081] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T17:47:45.443315] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-19T17:47:46.243286] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-19T17:47:46.597090] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T17:47:46.607886] [INFO ] [REMOTE ] BVN: Full fetch complete (62593 records). [2025-09-19T17:47:46.608135] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-19T17:47:47.007537] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-19T17:47:47.007697] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-19T17:47:47.008416] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-19T17:47:47.008465] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-19T17:47:47.009932] [DEBUG] [LOCAL ] BVN: Trimmed 62593 records to 44243 (keeping 200 days of data) [2025-09-19T17:47:47.061209] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-19T17:47:47.280516] [DEBUG] [LOCAL ] BVN: Primary data saved (44243 records). [2025-09-19T17:47:47.280721] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-19T17:47:47.280850] [INFO ] [MAIN ] Update Progress: 363/2372 symbols completed. BVN took 36.2s. Estimated remaining: 4h 24m 5s. Rate: 7.6 symbols/min [2025-09-19T17:47:47.469682] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:47.506422] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T17:47:47.548995] [DEBUG] [LOCAL ] BWLP: Loaded 33217 existing records from primary storage. [2025-09-19T17:47:47.549153] [INFO ] [MAIN ] BWLP: Loaded 33217 existing records. [2025-09-19T17:47:47.740480] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:47.740790] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-19T17:47:47.740848] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-19T17:47:47.742071] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-19T17:47:47.742140] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-19T17:47:47.848977] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-19T17:47:48.134347] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:48.136798] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T17:47:48.166193] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T17:47:48.643258] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-19T17:47:49.443297] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-19T17:47:50.048790] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T17:47:50.056610] [INFO ] [REMOTE ] BWA: Full fetch complete (75755 records). [2025-09-19T17:47:50.056765] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-19T17:47:50.243931] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-19T17:47:50.477210] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-19T17:47:50.477321] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-19T17:47:50.478138] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-19T17:47:50.478216] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-19T17:47:50.502349] [DEBUG] [LOCAL ] BWA: Trimmed 75755 records to 53029 (keeping 200 days of data) [2025-09-19T17:47:50.503599] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T17:47:50.842457] [DEBUG] [LOCAL ] BWA: Primary data saved (53029 records). [2025-09-19T17:47:50.842612] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-19T17:47:50.842731] [INFO ] [MAIN ] Update Progress: 364/2372 symbols completed. BWA took 23.7s. Estimated remaining: 4h 23m 33s. Rate: 7.6 symbols/min [2025-09-19T17:47:51.011158] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:51.020816] [DEBUG] [LOCAL ] BWMX: Loaded 7627 existing records from primary storage. [2025-09-19T17:47:51.020936] [INFO ] [MAIN ] BWMX: Loaded 7627 existing records. [2025-09-19T17:47:51.058057] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-19T17:47:51.211824] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:51.212412] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-19T17:47:51.212558] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-19T17:47:51.213016] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-19T17:47:51.213159] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-19T17:47:51.357276] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T17:47:51.375445] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T17:47:51.405326] [INFO ] [REMOTE ] BV: Full fetch complete (53839 records). [2025-09-19T17:47:51.420408] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-19T17:47:51.844891] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-19T17:47:51.874586] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:52.047528] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-19T17:47:52.047629] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-19T17:47:52.048223] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-19T17:47:52.048276] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-19T17:47:52.049630] [DEBUG] [LOCAL ] BV: Trimmed 53839 records to 39305 (keeping 200 days of data) [2025-09-19T17:47:52.282833] [DEBUG] [LOCAL ] BV: Primary data saved (39305 records). [2025-09-19T17:47:52.283065] [INFO ] [MAIN ] BV: Full history saved. [2025-09-19T17:47:52.283427] [INFO ] [MAIN ] Update Progress: 365/2372 symbols completed. BV took 41.2s. Estimated remaining: 4h 22m 50s. Rate: 7.6 symbols/min [2025-09-19T17:47:52.459744] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:47:52.466804] [DEBUG] [LOCAL ] BWNB: Loaded 4527 existing records from primary storage. [2025-09-19T17:47:52.466929] [INFO ] [MAIN ] BWNB: Loaded 4527 existing records. [2025-09-19T17:47:52.648203] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:47:52.644031] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-19T17:47:52.650077] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-19T17:47:52.650230] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-19T17:47:52.650499] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-19T17:47:52.650570] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-19T17:47:52.922965] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T17:47:52.987281] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T17:47:53.072902] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:47:53.404956] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T17:47:53.443218] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-19T17:47:54.243324] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-19T17:47:54.416034] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T17:47:55.043279] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-19T17:47:55.641149] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T17:47:55.843295] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-19T17:47:55.948467] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:47:56.643280] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-19T17:47:56.669008] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T17:47:57.443274] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-19T17:47:57.625249] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T17:47:58.243297] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-19T17:47:59.028694] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T17:47:59.043220] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-19T17:47:59.190247] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:47:59.596671] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T17:47:59.843254] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-19T17:48:00.643231] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-19T17:48:01.011276] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:48:01.443304] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-19T17:48:02.243310] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-19T17:48:02.542360] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T17:48:02.752515] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T17:48:03.043277] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-19T17:48:03.843273] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-19T17:48:03.877277] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:48:04.643266] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-19T17:48:05.366472] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T17:48:05.374499] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T17:48:05.396871] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-19T17:48:05.443227] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-19T17:48:06.243282] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-19T17:48:06.416147] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T17:48:07.043269] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-19T17:48:07.843272] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-19T17:48:07.956487] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T17:48:08.643240] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-19T17:48:08.845461] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T17:48:09.140330] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-09-19T17:48:09.443309] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-19T17:48:10.203480] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:48:10.211507] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T17:48:10.243232] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-19T17:48:10.934494] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T17:48:11.043296] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-19T17:48:11.831151] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T17:48:11.838768] [INFO ] [REMOTE ] BWG: Full fetch complete (17627 records). [2025-09-19T17:48:11.838979] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-19T17:48:11.853377] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-19T17:48:12.315985] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-19T17:48:12.316098] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-19T17:48:12.316446] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-19T17:48:12.316485] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-19T17:48:12.317160] [DEBUG] [LOCAL ] BWG: Trimmed 17627 records to 12521 (keeping 200 days of data) [2025-09-19T17:48:12.398530] [DEBUG] [LOCAL ] BWG: Primary data saved (12521 records). [2025-09-19T17:48:12.398711] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-19T17:48:12.398835] [INFO ] [MAIN ] Update Progress: 366/2372 symbols completed. BWG took 33.5s. Estimated remaining: 4h 23m 50s. Rate: 7.6 symbols/min [2025-09-19T17:48:12.607599] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:12.615849] [DEBUG] [LOCAL ] BWSN: Loaded 5136 existing records from primary storage. [2025-09-19T17:48:12.615971] [INFO ] [MAIN ] BWSN: Loaded 5136 existing records. [2025-09-19T17:48:12.648383] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-19T17:48:12.798066] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:12.798359] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-19T17:48:12.798427] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-19T17:48:12.798832] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-19T17:48:12.798911] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-19T17:48:13.169332] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:13.443274] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-19T17:48:13.524294] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T17:48:13.718158] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:48:14.109971] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-19T17:48:14.243304] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-19T17:48:15.043285] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-19T17:48:15.227973] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T17:48:15.843272] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-19T17:48:16.187702] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T17:48:16.643286] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-19T17:48:17.443318] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-19T17:48:17.931950] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T17:48:17.934509] [INFO ] [REMOTE ] BWMX: Full fetch complete (10060 records). [2025-09-19T17:48:17.934701] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-19T17:48:18.234827] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T17:48:18.247117] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-19T17:48:18.336092] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-19T17:48:18.336188] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-19T17:48:18.336490] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-19T17:48:18.336530] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-19T17:48:18.337049] [DEBUG] [LOCAL ] BWMX: Trimmed 10060 records to 7670 (keeping 200 days of data) [2025-09-19T17:48:18.387220] [DEBUG] [LOCAL ] BWMX: Primary data saved (7670 records). [2025-09-19T17:48:18.387358] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-19T17:48:18.387460] [INFO ] [MAIN ] Update Progress: 367/2372 symbols completed. BWMX took 27.5s. Estimated remaining: 4h 23m 31s. Rate: 7.6 symbols/min [2025-09-19T17:48:18.568533] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:18.616671] [DEBUG] [LOCAL ] BWXT: Loaded 47026 existing records from primary storage. [2025-09-19T17:48:18.616823] [INFO ] [MAIN ] BWXT: Loaded 47026 existing records. [2025-09-19T17:48:18.800222] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T17:48:18.806811] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:18.809763] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-19T17:48:18.809857] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-19T17:48:18.811303] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-19T17:48:18.811366] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-19T17:48:19.049416] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-19T17:48:19.181312] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:19.284375] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T17:48:19.772728] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T17:48:19.773927] [INFO ] [REMOTE ] BWNB: Full fetch complete (5728 records). [2025-09-19T17:48:19.773997] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-19T17:48:19.774358] [FATAL] [VALIDATOR ] BWNB: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:48:19.774440] [FATAL] [MAIN ] BWNB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:48:19.774482] [WARN ] [MAIN ] BWNB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:48:19.774521] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-19T17:48:19.774576] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-09-19T17:48:19.774610] [INFO ] [LOCAL ] BWNB: Starting deletion of derivative data. [2025-09-19T17:48:19.775095] [DEBUG] [LOCAL ] BWNB: Deleted derivative data file. [2025-09-19T17:48:19.775189] [INFO ] [MAIN ] Update Progress: 368/2372 symbols completed. BWNB took 27.5s. Estimated remaining: 4h 22m 48s. Rate: 7.6 symbols/min [2025-09-19T17:48:19.848387] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-19T17:48:19.949862] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:20.013729] [DEBUG] [LOCAL ] BX: Loaded 53891 existing records from primary storage. [2025-09-19T17:48:20.013941] [INFO ] [MAIN ] BX: Loaded 53891 existing records. [2025-09-19T17:48:20.192510] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:20.192853] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-19T17:48:20.192909] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-19T17:48:20.195238] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-19T17:48:20.195300] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-19T17:48:20.497876] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T17:48:20.585227] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:20.643259] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-19T17:48:21.443308] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-19T17:48:22.243352] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-19T17:48:22.436859] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T17:48:22.441703] [INFO ] [REMOTE ] BWLP: Full fetch complete (48793 records). [2025-09-19T17:48:22.441801] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-19T17:48:22.819921] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-19T17:48:22.820018] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-19T17:48:22.820600] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-19T17:48:22.820667] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-19T17:48:22.821875] [DEBUG] [LOCAL ] BWLP: Trimmed 48793 records to 33422 (keeping 200 days of data) [2025-09-19T17:48:22.943182] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T17:48:23.029885] [DEBUG] [LOCAL ] BWLP: Primary data saved (33422 records). [2025-09-19T17:48:23.030053] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-19T17:48:23.030147] [INFO ] [MAIN ] Update Progress: 369/2372 symbols completed. BWLP took 35.7s. Estimated remaining: 4h 22m 15s. Rate: 7.6 symbols/min [2025-09-19T17:48:23.051126] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-19T17:48:23.201432] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:23.216740] [DEBUG] [LOCAL ] BXC: Loaded 13710 existing records from primary storage. [2025-09-19T17:48:23.216939] [INFO ] [MAIN ] BXC: Loaded 13710 existing records. [2025-09-19T17:48:23.394418] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:23.394943] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-19T17:48:23.395085] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-19T17:48:23.395742] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-19T17:48:23.395807] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-19T17:48:23.793799] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T17:48:23.819167] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:23.843228] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-19T17:48:24.643230] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-19T17:48:24.862679] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T17:48:25.344792] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T17:48:25.443326] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-19T17:48:26.243251] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-19T17:48:27.043300] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-19T17:48:27.405868] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T17:48:27.664244] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T17:48:27.843222] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-19T17:48:28.643333] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-19T17:48:28.646829] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (4.00 seconds). [2025-09-19T17:48:28.836848] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T17:48:29.443265] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-19T17:48:29.696904] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T17:48:29.802216] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:48:30.243275] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-19T17:48:30.412966] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T17:48:31.043281] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-19T17:48:31.843263] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-19T17:48:32.034128] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T17:48:32.280602] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T17:48:32.540436] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T17:48:32.643265] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-19T17:48:33.443271] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-19T17:48:34.243270] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-19T17:48:34.711708] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T17:48:34.763722] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T17:48:35.017310] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T17:48:35.043230] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-19T17:48:35.843261] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-19T17:48:36.503155] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T17:48:36.643258] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-19T17:48:37.374915] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T17:48:37.443262] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-19T17:48:38.148134] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T17:48:38.243265] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-19T17:48:39.043256] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-19T17:48:39.606936] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T17:48:39.626020] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T17:48:39.710230] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T17:48:39.843268] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-19T17:48:40.643260] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-19T17:48:41.443370] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-19T17:48:42.129017] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T17:48:42.186323] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T17:48:42.188507] [INFO ] [REMOTE ] BWSN: Full fetch complete (6181 records). [2025-09-19T17:48:42.188829] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-19T17:48:42.250138] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-19T17:48:42.616753] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-19T17:48:42.617014] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-19T17:48:42.617326] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-19T17:48:42.617437] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-19T17:48:42.618342] [DEBUG] [LOCAL ] BWSN: Trimmed 6181 records to 5145 (keeping 200 days of data) [2025-09-19T17:48:42.655213] [DEBUG] [LOCAL ] BWSN: Primary data saved (5145 records). [2025-09-19T17:48:42.655510] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-19T17:48:42.655714] [INFO ] [MAIN ] Update Progress: 370/2372 symbols completed. BWSN took 30.3s. Estimated remaining: 4h 23m 11s. Rate: 7.6 symbols/min [2025-09-19T17:48:42.823991] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T17:48:42.904437] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:42.958282] [DEBUG] [LOCAL ] BXMT: Loaded 47617 existing records from primary storage. [2025-09-19T17:48:42.958455] [INFO ] [MAIN ] BXMT: Loaded 47617 existing records. [2025-09-19T17:48:43.048525] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-19T17:48:43.159621] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:43.159906] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-19T17:48:43.159957] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-19T17:48:43.161478] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-19T17:48:43.161542] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-19T17:48:43.522938] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:43.843291] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-19T17:48:44.241364] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T17:48:44.508274] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T17:48:44.516011] [INFO ] [REMOTE ] BWXT: Full fetch complete (67075 records). [2025-09-19T17:48:44.516173] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-19T17:48:44.648419] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-19T17:48:44.934515] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-19T17:48:44.934634] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-19T17:48:44.935539] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-19T17:48:44.935610] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-19T17:48:44.937193] [DEBUG] [LOCAL ] BWXT: Trimmed 67075 records to 47373 (keeping 200 days of data) [2025-09-19T17:48:45.254435] [DEBUG] [LOCAL ] BWXT: Primary data saved (47373 records). [2025-09-19T17:48:45.254701] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-19T17:48:45.254848] [INFO ] [MAIN ] Update Progress: 371/2372 symbols completed. BWXT took 26.9s. Estimated remaining: 4h 22m 35s. Rate: 7.6 symbols/min [2025-09-19T17:48:45.429899] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:45.444705] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-19T17:48:45.456767] [DEBUG] [LOCAL ] BXMX: Loaded 19877 existing records from primary storage. [2025-09-19T17:48:45.456976] [INFO ] [MAIN ] BXMX: Loaded 19877 existing records. [2025-09-19T17:48:45.634556] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:45.634837] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-19T17:48:45.634887] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-19T17:48:45.635521] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-19T17:48:45.635591] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-19T17:48:45.993162] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:46.225962] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-19T17:48:46.243222] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-19T17:48:46.471753] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T17:48:47.043311] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-19T17:48:47.580661] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T17:48:47.843273] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-19T17:48:48.344846] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:48:48.643245] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-19T17:48:48.717684] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (4.07 seconds). [2025-09-19T17:48:49.358124] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T17:48:49.446226] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-19T17:48:49.449036] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T17:48:50.243282] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-19T17:48:50.430342] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T17:48:50.947043] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T17:48:50.950489] [INFO ] [REMOTE ] BXC: Full fetch complete (17559 records). [2025-09-19T17:48:50.950609] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-19T17:48:51.048351] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-19T17:48:51.333444] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-19T17:48:51.333544] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-19T17:48:51.333941] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-19T17:48:51.334022] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-19T17:48:51.334714] [DEBUG] [LOCAL ] BXC: Trimmed 17559 records to 13833 (keeping 200 days of data) [2025-09-19T17:48:51.433217] [DEBUG] [LOCAL ] BXC: Primary data saved (13833 records). [2025-09-19T17:48:51.433411] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-19T17:48:51.433723] [INFO ] [MAIN ] Update Progress: 372/2372 symbols completed. BXC took 28.4s. Estimated remaining: 4h 22m 18s. Rate: 7.6 symbols/min [2025-09-19T17:48:51.604164] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:48:51.660343] [DEBUG] [LOCAL ] BXP: Loaded 50269 existing records from primary storage. [2025-09-19T17:48:51.660482] [INFO ] [MAIN ] BXP: Loaded 50269 existing records. [2025-09-19T17:48:51.848393] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-19T17:48:51.856094] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:48:51.857541] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-19T17:48:51.857629] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-19T17:48:51.858971] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-19T17:48:51.859049] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-19T17:48:52.217457] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:48:52.643230] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-19T17:48:53.169406] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T17:48:53.443276] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-19T17:48:54.243328] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-19T17:48:54.333999] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T17:48:55.043272] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-19T17:48:55.313594] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (3.47 seconds). [2025-09-19T17:48:55.843241] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-19T17:48:56.420037] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T17:48:56.643244] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-19T17:48:57.064831] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:48:57.174500] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T17:48:57.443286] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-19T17:48:58.075187] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T17:48:58.243300] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-19T17:48:59.043304] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-19T17:48:59.061343] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T17:48:59.498474] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (6.06 seconds). [2025-09-19T17:48:59.843258] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-19T17:49:00.065449] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:49:00.643292] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-19T17:49:01.443378] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-19T17:49:01.738506] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-19T17:49:02.243325] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-19T17:49:02.267356] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T17:49:02.519579] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:49:03.043236] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-19T17:49:03.406107] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:49:03.843303] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-19T17:49:04.198445] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T17:49:04.562640] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T17:49:04.643276] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-19T17:49:05.443275] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-19T17:49:05.707870] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T17:49:05.715680] [INFO ] [REMOTE ] BX: Full fetch complete (77400 records). [2025-09-19T17:49:05.715828] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-19T17:49:06.124144] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-19T17:49:06.124294] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-19T17:49:06.125161] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-19T17:49:06.125228] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-19T17:49:06.126985] [DEBUG] [LOCAL ] BX: Trimmed 77400 records to 54281 (keeping 200 days of data) [2025-09-19T17:49:06.243387] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-19T17:49:06.517989] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T17:49:06.539767] [DEBUG] [LOCAL ] BX: Primary data saved (54281 records). [2025-09-19T17:49:06.539948] [INFO ] [MAIN ] BX: Full history saved. [2025-09-19T17:49:06.540101] [INFO ] [MAIN ] Update Progress: 373/2372 symbols completed. BX took 46.8s. Estimated remaining: 4h 22m 48s. Rate: 7.6 symbols/min [2025-09-19T17:49:06.715140] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:06.767927] [DEBUG] [LOCAL ] BXSL: Loaded 47757 existing records from primary storage. [2025-09-19T17:49:06.768079] [INFO ] [MAIN ] BXSL: Loaded 47757 existing records. [2025-09-19T17:49:06.951294] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:06.951540] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-19T17:49:06.951588] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-19T17:49:06.952872] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-19T17:49:06.952942] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-19T17:49:07.049263] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-19T17:49:07.308995] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:07.631872] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T17:49:07.723995] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T17:49:07.843265] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-19T17:49:08.547557] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:49:08.643241] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-19T17:49:09.443310] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-19T17:49:09.512264] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T17:49:10.243242] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-19T17:49:11.043238] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-19T17:49:11.366175] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T17:49:11.374371] [INFO ] [REMOTE ] BXMT: Full fetch complete (69369 records). [2025-09-19T17:49:11.380985] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-19T17:49:11.393853] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T17:49:11.827029] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-19T17:49:11.829372] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-19T17:49:11.828286] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-19T17:49:11.840298] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-19T17:49:11.840372] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-19T17:49:11.841638] [DEBUG] [LOCAL ] BXMT: Trimmed 69369 records to 47995 (keeping 200 days of data) [2025-09-19T17:49:11.843220] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-19T17:49:12.135485] [DEBUG] [LOCAL ] BXMT: Primary data saved (47995 records). [2025-09-19T17:49:12.135670] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-19T17:49:12.135772] [INFO ] [MAIN ] Update Progress: 374/2372 symbols completed. BXMT took 29.5s. Estimated remaining: 4h 22m 28s. Rate: 7.6 symbols/min [2025-09-19T17:49:12.306278] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:12.327877] [DEBUG] [LOCAL ] BY: Loaded 21642 existing records from primary storage. [2025-09-19T17:49:12.328003] [INFO ] [MAIN ] BY: Loaded 21642 existing records. [2025-09-19T17:49:12.514576] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:12.514914] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-19T17:49:12.514966] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-19T17:49:12.515711] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-19T17:49:12.515773] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-19T17:49:12.655803] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-19T17:49:12.877283] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:13.025852] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T17:49:13.401639] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T17:49:13.443226] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-19T17:49:13.776380] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T17:49:14.243290] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-19T17:49:14.636707] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T17:49:14.639575] [INFO ] [REMOTE ] BXMX: Full fetch complete (28604 records). [2025-09-19T17:49:14.639676] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-19T17:49:15.011473] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-19T17:49:15.011820] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-19T17:49:15.012301] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-19T17:49:15.012362] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-19T17:49:15.013449] [DEBUG] [LOCAL ] BXMX: Trimmed 28604 records to 19972 (keeping 200 days of data) [2025-09-19T17:49:15.079250] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-19T17:49:15.151839] [DEBUG] [LOCAL ] BXMX: Primary data saved (19972 records). [2025-09-19T17:49:15.152008] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-19T17:49:15.152151] [INFO ] [MAIN ] Update Progress: 375/2372 symbols completed. BXMX took 29.9s. Estimated remaining: 4h 21m 55s. Rate: 7.6 symbols/min [2025-09-19T17:49:15.326813] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:15.377530] [DEBUG] [LOCAL ] BYD: Loaded 45747 existing records from primary storage. [2025-09-19T17:49:15.377706] [INFO ] [MAIN ] BYD: Loaded 45747 existing records. [2025-09-19T17:49:15.555443] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:15.555790] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-19T17:49:15.555890] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-19T17:49:15.557221] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-19T17:49:15.557282] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-19T17:49:15.847153] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-19T17:49:15.870721] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:49:15.942939] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:16.643311] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-19T17:49:16.691859] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T17:49:17.443292] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-19T17:49:17.887593] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:49:18.002082] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T17:49:18.243294] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-19T17:49:19.043273] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-19T17:49:19.281554] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T17:49:19.519926] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T17:49:19.843278] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-19T17:49:20.643290] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-19T17:49:21.443320] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-19T17:49:21.706516] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T17:49:22.119082] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T17:49:22.161542] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-09-19T17:49:22.243231] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-19T17:49:22.679417] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T17:49:23.043266] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-19T17:49:23.843267] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-19T17:49:23.915518] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:49:24.643325] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-19T17:49:25.000841] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:49:25.443331] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-19T17:49:26.221177] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-19T17:49:26.228542] [INFO ] [REMOTE ] BXP: Full fetch complete (71120 records). [2025-09-19T17:49:26.228693] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-19T17:49:26.263766] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-19T17:49:26.628708] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T17:49:26.733633] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-19T17:49:26.733741] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-19T17:49:26.734481] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-19T17:49:26.734522] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-19T17:49:26.735976] [DEBUG] [LOCAL ] BXP: Trimmed 71120 records to 50587 (keeping 200 days of data) [2025-09-19T17:49:26.968988] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T17:49:27.053429] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-19T17:49:27.072824] [DEBUG] [LOCAL ] BXP: Primary data saved (50587 records). [2025-09-19T17:49:27.072935] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-19T17:49:27.073024] [INFO ] [MAIN ] Update Progress: 376/2372 symbols completed. BXP took 35.6s. Estimated remaining: 4h 22m 8s. Rate: 7.6 symbols/min [2025-09-19T17:49:27.243944] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:27.257365] [DEBUG] [LOCAL ] BYM: Loaded 12392 existing records from primary storage. [2025-09-19T17:49:27.257484] [INFO ] [MAIN ] BYM: Loaded 12392 existing records. [2025-09-19T17:49:27.435949] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:27.436267] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-19T17:49:27.436336] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-19T17:49:27.436856] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-19T17:49:27.436916] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-19T17:49:27.789216] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:27.843226] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-19T17:49:28.236431] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T17:49:28.323770] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T17:49:28.643231] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-19T17:49:29.132674] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T17:49:29.443268] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-19T17:49:29.974707] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T17:49:30.243267] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-19T17:49:30.974272] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T17:49:31.043273] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-19T17:49:31.843231] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-19T17:49:32.260586] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T17:49:32.443461] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T17:49:32.643278] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-19T17:49:33.443282] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-19T17:49:33.814198] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T17:49:33.846453] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T17:49:34.241807] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T17:49:34.247244] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-19T17:49:35.043267] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-19T17:49:35.739615] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T17:49:35.843226] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-19T17:49:36.643242] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-19T17:49:36.876771] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T17:49:37.346464] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T17:49:37.443303] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-19T17:49:38.251511] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-19T17:49:38.256811] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T17:49:38.264574] [INFO ] [REMOTE ] BXSL: Full fetch complete (69135 records). [2025-09-19T17:49:38.264738] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-19T17:49:38.686570] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-19T17:49:38.686719] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-19T17:49:38.687589] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-19T17:49:38.687734] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-19T17:49:38.689696] [DEBUG] [LOCAL ] BXSL: Trimmed 69135 records to 48143 (keeping 200 days of data) [2025-09-19T17:49:38.931637] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T17:49:38.938939] [INFO ] [REMOTE ] BY: Full fetch complete (28859 records). [2025-09-19T17:49:38.939612] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-19T17:49:39.043601] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-19T17:49:39.347576] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T17:49:39.416687] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-19T17:49:39.417112] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-19T17:49:39.417617] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-19T17:49:39.417728] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-19T17:49:39.421688] [DEBUG] [LOCAL ] BY: Trimmed 28859 records to 21803 (keeping 200 days of data) [2025-09-19T17:49:39.519713] [DEBUG] [LOCAL ] BXSL: Primary data saved (48143 records). [2025-09-19T17:49:39.520418] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-19T17:49:39.520807] [INFO ] [MAIN ] Update Progress: 377/2372 symbols completed. BXSL took 33.0s. Estimated remaining: 4h 22m 24s. Rate: 7.6 symbols/min [2025-09-19T17:49:39.702263] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:39.758943] [DEBUG] [LOCAL ] BY: Primary data saved (21803 records). [2025-09-19T17:49:39.760327] [INFO ] [MAIN ] BY: Full history saved. [2025-09-19T17:49:39.761799] [INFO ] [MAIN ] Update Progress: 378/2372 symbols completed. BY took 27.6s. Estimated remaining: 4h 21m 36s. Rate: 7.6 symbols/min [2025-09-19T17:49:39.761622] [DEBUG] [LOCAL ] BZH: Loaded 33190 existing records from primary storage. [2025-09-19T17:49:39.762272] [INFO ] [MAIN ] BZH: Loaded 33190 existing records. [2025-09-19T17:49:39.850209] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-19T17:49:40.164287] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:40.164478] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:40.165062] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-19T17:49:40.165144] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-19T17:49:40.166688] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-19T17:49:40.166762] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-19T17:49:40.543632] [DEBUG] [LOCAL ] C: Loaded 54131 existing records from primary storage. [2025-09-19T17:49:40.563380] [INFO ] [MAIN ] C: Loaded 54131 existing records. [2025-09-19T17:49:40.665263] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:40.681105] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-19T17:49:40.811750] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:40.812204] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-19T17:49:40.812309] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-19T17:49:40.813537] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-19T17:49:40.813602] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-19T17:49:40.999361] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T17:49:41.099472] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T17:49:41.282304] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:41.443265] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-19T17:49:41.731546] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T17:49:42.243285] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-19T17:49:43.043284] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-19T17:49:43.637785] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T17:49:43.728689] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T17:49:43.843244] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-19T17:49:44.471538] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T17:49:44.643282] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-19T17:49:45.443302] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-19T17:49:45.524913] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T17:49:46.243263] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-19T17:49:46.751348] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T17:49:47.043265] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-19T17:49:47.270931] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T17:49:47.405663] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-19T17:49:47.843248] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-19T17:49:48.076690] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T17:49:48.643284] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-19T17:49:49.443238] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-19T17:49:50.093211] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-19T17:49:50.243268] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-19T17:49:50.472510] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:49:50.479037] [INFO ] [REMOTE ] BYD: Full fetch complete (64997 records). [2025-09-19T17:49:50.479160] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-19T17:49:50.615976] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T17:49:50.885953] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-19T17:49:50.886097] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-19T17:49:50.887897] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-19T17:49:50.887979] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-19T17:49:50.889547] [DEBUG] [LOCAL ] BYD: Trimmed 64997 records to 46035 (keeping 200 days of data) [2025-09-19T17:49:51.070338] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-19T17:49:51.180804] [DEBUG] [LOCAL ] BYD: Primary data saved (46035 records). [2025-09-19T17:49:51.180957] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-19T17:49:51.181089] [INFO ] [MAIN ] Update Progress: 379/2372 symbols completed. BYD took 36.0s. Estimated remaining: 4h 21m 47s. Rate: 7.6 symbols/min [2025-09-19T17:49:51.361552] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:51.381880] [DEBUG] [LOCAL ] CAAP: Loaded 19312 existing records from primary storage. [2025-09-19T17:49:51.382016] [INFO ] [MAIN ] CAAP: Loaded 19312 existing records. [2025-09-19T17:49:51.583741] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:51.584448] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-19T17:49:51.584561] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-19T17:49:51.585239] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-19T17:49:51.604256] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-19T17:49:51.640194] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T17:49:51.742870] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T17:49:51.850679] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-19T17:49:52.011701] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:52.643280] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-19T17:49:53.356255] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T17:49:53.443241] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-19T17:49:53.632833] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T17:49:54.243279] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-19T17:49:55.043278] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-19T17:49:55.069557] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:49:55.843331] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-19T17:49:56.504292] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T17:49:56.643290] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-19T17:49:56.702790] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-19T17:49:57.136557] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:49:57.419215] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T17:49:57.423537] [INFO ] [REMOTE ] BYM: Full fetch complete (17953 records). [2025-09-19T17:49:57.423739] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-19T17:49:57.448499] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-19T17:49:57.996125] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-19T17:49:57.996229] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-19T17:49:57.996784] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-19T17:49:57.996854] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-19T17:49:57.998998] [DEBUG] [LOCAL ] BYM: Trimmed 17953 records to 12414 (keeping 200 days of data) [2025-09-19T17:49:58.095464] [DEBUG] [LOCAL ] BYM: Primary data saved (12414 records). [2025-09-19T17:49:58.095636] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-19T17:49:58.095812] [INFO ] [MAIN ] Update Progress: 380/2372 symbols completed. BYM took 31.0s. Estimated remaining: 4h 21m 34s. Rate: 7.6 symbols/min [2025-09-19T17:49:58.245602] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-19T17:49:58.357402] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:49:58.383398] [DEBUG] [LOCAL ] CABO: Loaded 17861 existing records from primary storage. [2025-09-19T17:49:58.383636] [INFO ] [MAIN ] CABO: Loaded 17861 existing records. [2025-09-19T17:49:58.602018] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:49:58.602460] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-19T17:49:58.602524] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-19T17:49:58.603223] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-19T17:49:58.603320] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-19T17:49:59.000861] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:49:59.024845] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T17:49:59.043218] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-19T17:49:59.177020] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T17:49:59.843277] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-19T17:50:00.079958] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T17:50:00.610919] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T17:50:00.643271] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-19T17:50:01.443310] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-19T17:50:02.243319] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-19T17:50:02.329310] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T17:50:02.335320] [INFO ] [REMOTE ] BZH: Full fetch complete (46870 records). [2025-09-19T17:50:02.335505] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-19T17:50:02.336249] [FATAL] [VALIDATOR ] BZH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:50:02.336350] [FATAL] [MAIN ] BZH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:50:02.336419] [WARN ] [MAIN ] BZH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:50:02.336499] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-19T17:50:02.336574] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-09-19T17:50:02.336611] [INFO ] [LOCAL ] BZH: Starting deletion of derivative data. [2025-09-19T17:50:02.337144] [DEBUG] [LOCAL ] BZH: Deleted derivative data file. [2025-09-19T17:50:02.337263] [INFO ] [MAIN ] Update Progress: 381/2372 symbols completed. BZH took 22.8s. Estimated remaining: 4h 21m 7s. Rate: 7.6 symbols/min [2025-09-19T17:50:02.523272] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:02.535694] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:50:02.563280] [DEBUG] [LOCAL ] CACI: Loaded 26140 existing records from primary storage. [2025-09-19T17:50:02.563428] [INFO ] [MAIN ] CACI: Loaded 26140 existing records. [2025-09-19T17:50:02.752828] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:02.753130] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-19T17:50:02.753183] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-19T17:50:02.754238] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-19T17:50:02.754356] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-19T17:50:03.048420] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-19T17:50:03.157857] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:03.579743] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T17:50:03.843270] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-19T17:50:04.643276] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-19T17:50:05.274246] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T17:50:05.443264] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-19T17:50:06.113520] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-19T17:50:06.190940] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T17:50:06.243255] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-19T17:50:06.757826] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T17:50:07.043326] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-19T17:50:07.342098] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T17:50:07.843286] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-19T17:50:08.643240] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-19T17:50:08.861439] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T17:50:09.443255] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-19T17:50:09.573784] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T17:50:10.171675] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-09-19T17:50:10.243225] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-19T17:50:10.547622] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T17:50:11.043325] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-19T17:50:11.843288] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-19T17:50:11.901086] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T17:50:12.168969] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T17:50:12.643270] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-19T17:50:13.387469] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T17:50:13.443271] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-19T17:50:13.957139] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T17:50:14.194708] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T17:50:14.243262] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-19T17:50:15.043270] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-19T17:50:15.843259] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-19T17:50:16.643257] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-19T17:50:17.188625] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:50:17.443236] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-19T17:50:17.919596] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T17:50:18.243270] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-19T17:50:19.095546] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (4.05 seconds). [2025-09-19T17:50:19.104015] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-19T17:50:19.172546] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (4.93 seconds). [2025-09-19T17:50:19.209070] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T17:50:19.843299] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-19T17:50:20.025551] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T17:50:20.029580] [INFO ] [REMOTE ] CAAP: Full fetch complete (27484 records). [2025-09-19T17:50:20.029725] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-19T17:50:20.410282] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-19T17:50:20.410369] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-19T17:50:20.410835] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-19T17:50:20.410898] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-19T17:50:20.411671] [DEBUG] [LOCAL ] CAAP: Trimmed 27484 records to 19495 (keeping 200 days of data) [2025-09-19T17:50:20.524637] [DEBUG] [LOCAL ] CAAP: Primary data saved (19495 records). [2025-09-19T17:50:20.524797] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-19T17:50:20.524896] [INFO ] [MAIN ] Update Progress: 382/2372 symbols completed. CAAP took 29.3s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-19T17:50:20.643319] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-19T17:50:20.688868] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T17:50:20.729032] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:20.774493] [DEBUG] [LOCAL ] CADE: Loaded 49099 existing records from primary storage. [2025-09-19T17:50:20.774633] [INFO ] [MAIN ] CADE: Loaded 49099 existing records. [2025-09-19T17:50:20.957045] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:20.957392] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-19T17:50:20.957461] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-19T17:50:20.963854] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-19T17:50:20.970189] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-19T17:50:21.003892] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T17:50:21.330541] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:21.443214] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-19T17:50:22.243305] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-19T17:50:22.746352] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T17:50:23.024772] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T17:50:23.043211] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-19T17:50:23.618058] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:50:23.843301] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-19T17:50:24.643279] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-19T17:50:24.918909] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T17:50:25.443319] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-19T17:50:25.715596] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T17:50:25.726247] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-09-19T17:50:25.726410] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-19T17:50:26.149849] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-19T17:50:26.150823] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-19T17:50:26.151819] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-19T17:50:26.153515] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-19T17:50:26.153390] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T17:50:26.162774] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54521 (keeping 200 days of data) [2025-09-19T17:50:26.265595] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-19T17:50:26.528954] [DEBUG] [LOCAL ] C: Primary data saved (54521 records). [2025-09-19T17:50:26.529115] [INFO ] [MAIN ] C: Full history saved. [2025-09-19T17:50:26.530130] [INFO ] [MAIN ] Update Progress: 383/2372 symbols completed. C took 46.8s. Estimated remaining: 4h 21m 35s. Rate: 7.6 symbols/min [2025-09-19T17:50:26.708455] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:26.748747] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T17:50:26.789558] [DEBUG] [LOCAL ] CAE: Loaded 39162 existing records from primary storage. [2025-09-19T17:50:26.789747] [INFO ] [MAIN ] CAE: Loaded 39162 existing records. [2025-09-19T17:50:26.965733] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:26.966021] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-19T17:50:26.966070] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-19T17:50:26.967350] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-19T17:50:26.967411] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-19T17:50:27.048419] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-19T17:50:27.324271] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:27.843284] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-19T17:50:27.859258] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T17:50:28.540465] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T17:50:28.643242] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-19T17:50:29.240792] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T17:50:29.443260] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-19T17:50:29.978173] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T17:50:29.982776] [INFO ] [REMOTE ] CACI: Full fetch complete (39227 records). [2025-09-19T17:50:29.982886] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-19T17:50:30.248465] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-19T17:50:30.379707] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-19T17:50:30.379803] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-19T17:50:30.380440] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-19T17:50:30.380482] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-19T17:50:30.381463] [DEBUG] [LOCAL ] CACI: Trimmed 39227 records to 26262 (keeping 200 days of data) [2025-09-19T17:50:30.540215] [DEBUG] [LOCAL ] CACI: Primary data saved (26262 records). [2025-09-19T17:50:30.540362] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-19T17:50:30.540470] [INFO ] [MAIN ] Update Progress: 384/2372 symbols completed. CACI took 28.2s. Estimated remaining: 4h 21m 7s. Rate: 7.6 symbols/min [2025-09-19T17:50:30.716448] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:30.722166] [DEBUG] [LOCAL ] CAF: Loaded 3464 existing records from primary storage. [2025-09-19T17:50:30.722291] [INFO ] [MAIN ] CAF: Loaded 3464 existing records. [2025-09-19T17:50:30.903941] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:30.904242] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-19T17:50:30.904292] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-19T17:50:30.904583] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-19T17:50:30.904682] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-19T17:50:31.048506] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-19T17:50:31.280243] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:31.301474] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T17:50:31.426684] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T17:50:31.429077] [INFO ] [REMOTE ] CABO: Full fetch complete (22946 records). [2025-09-19T17:50:31.429266] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-19T17:50:31.794585] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-19T17:50:31.794693] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-19T17:50:31.795142] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-19T17:50:31.795216] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-19T17:50:31.796000] [DEBUG] [LOCAL ] CABO: Trimmed 22946 records to 17935 (keeping 200 days of data) [2025-09-19T17:50:31.849745] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-19T17:50:31.910499] [DEBUG] [LOCAL ] CABO: Primary data saved (17935 records). [2025-09-19T17:50:31.910705] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-19T17:50:31.910815] [INFO ] [MAIN ] Update Progress: 385/2372 symbols completed. CABO took 33.8s. Estimated remaining: 4h 20m 26s. Rate: 7.6 symbols/min [2025-09-19T17:50:32.089543] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:32.149532] [DEBUG] [LOCAL ] CAG: Loaded 54048 existing records from primary storage. [2025-09-19T17:50:32.149713] [INFO ] [MAIN ] CAG: Loaded 54048 existing records. [2025-09-19T17:50:32.390378] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:32.390667] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-19T17:50:32.390728] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-19T17:50:32.393530] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-19T17:50:32.393597] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-19T17:50:32.649210] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-19T17:50:32.679729] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:50:32.791721] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T17:50:32.837250] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:33.443278] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-19T17:50:34.243260] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-19T17:50:34.469711] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:50:35.043242] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-19T17:50:35.573635] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T17:50:35.843277] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-19T17:50:36.449001] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T17:50:36.566927] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:50:36.643244] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-19T17:50:37.443297] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-19T17:50:38.176292] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-19T17:50:38.194181] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:50:38.243235] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-19T17:50:38.529751] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T17:50:39.043293] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-19T17:50:39.843294] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-19T17:50:40.177877] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T17:50:40.283494] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T17:50:40.297607] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-19T17:50:40.643264] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-19T17:50:41.443271] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-19T17:50:42.243280] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-19T17:50:42.479582] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T17:50:43.017851] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T17:50:43.043213] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-19T17:50:43.843330] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-19T17:50:44.307666] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T17:50:44.416681] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T17:50:44.643067] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T17:50:44.643229] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-19T17:50:45.443304] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-19T17:50:46.243308] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-19T17:50:46.651611] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:50:47.043281] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-19T17:50:47.289891] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T17:50:47.843287] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-19T17:50:47.901324] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:50:48.560623] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T17:50:48.643272] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-19T17:50:48.995532] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T17:50:49.388366] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T17:50:49.443257] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-19T17:50:50.028791] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-19T17:50:50.243285] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-19T17:50:51.043337] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-19T17:50:51.806099] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T17:50:51.843315] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-19T17:50:52.643310] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-19T17:50:52.764258] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T17:50:52.770219] [INFO ] [REMOTE ] CAE: Full fetch complete (55570 records). [2025-09-19T17:50:52.770344] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-19T17:50:53.155488] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-19T17:50:53.155603] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-19T17:50:53.156403] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-19T17:50:53.156483] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-19T17:50:53.157964] [DEBUG] [LOCAL ] CAE: Trimmed 55570 records to 39492 (keeping 200 days of data) [2025-09-19T17:50:53.246801] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T17:50:53.392291] [DEBUG] [LOCAL ] CAE: Primary data saved (39492 records). [2025-09-19T17:50:53.392457] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-19T17:50:53.394979] [INFO ] [MAIN ] Update Progress: 386/2372 symbols completed. CAE took 26.9s. Estimated remaining: 4h 21m 28s. Rate: 7.6 symbols/min [2025-09-19T17:50:53.452088] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-19T17:50:53.580435] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:53.646491] [DEBUG] [LOCAL ] CAH: Loaded 51889 existing records from primary storage. [2025-09-19T17:50:53.646684] [INFO ] [MAIN ] CAH: Loaded 51889 existing records. [2025-09-19T17:50:53.837882] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:53.838308] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-19T17:50:53.838383] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-19T17:50:53.852877] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-19T17:50:53.872831] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-19T17:50:53.923190] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T17:50:54.253494] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-19T17:50:54.298846] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:54.305505] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T17:50:55.043272] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-19T17:50:55.843367] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-19T17:50:55.926892] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T17:50:55.928819] [INFO ] [REMOTE ] CAF: Full fetch complete (5892 records). [2025-09-19T17:50:55.929025] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-19T17:50:56.315482] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-19T17:50:56.315587] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-19T17:50:56.315852] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-19T17:50:56.315934] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-19T17:50:56.316352] [DEBUG] [LOCAL ] CAF: Trimmed 5892 records to 3481 (keeping 200 days of data) [2025-09-19T17:50:56.337987] [DEBUG] [LOCAL ] CAF: Primary data saved (3481 records). [2025-09-19T17:50:56.338060] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-19T17:50:56.338167] [INFO ] [MAIN ] Update Progress: 387/2372 symbols completed. CAF took 25.8s. Estimated remaining: 4h 20m 55s. Rate: 7.6 symbols/min [2025-09-19T17:50:56.526419] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:56.567766] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:50:56.624900] [DEBUG] [LOCAL ] CAL: Loaded 43648 existing records from primary storage. [2025-09-19T17:50:56.625078] [INFO ] [MAIN ] CAL: Loaded 43648 existing records. [2025-09-19T17:50:56.648368] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-19T17:50:56.829903] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:56.830205] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-19T17:50:56.830254] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-19T17:50:56.831378] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-19T17:50:56.831449] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-19T17:50:57.217331] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:57.443287] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-19T17:50:58.243243] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-19T17:50:58.378863] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-19T17:50:58.782088] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T17:50:58.791130] [INFO ] [REMOTE ] CADE: Full fetch complete (69265 records). [2025-09-19T17:50:58.791318] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-19T17:50:58.792207] [FATAL] [VALIDATOR ] CADE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:50:58.792322] [FATAL] [MAIN ] CADE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:50:58.792400] [WARN ] [MAIN ] CADE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:50:58.792509] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-19T17:50:58.792607] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-19T17:50:58.792720] [INFO ] [LOCAL ] CADE: Starting deletion of derivative data. [2025-09-19T17:50:58.793154] [DEBUG] [LOCAL ] CADE: Deleted derivative data file. [2025-09-19T17:50:58.793313] [INFO ] [MAIN ] Update Progress: 388/2372 symbols completed. CADE took 38.3s. Estimated remaining: 4h 20m 19s. Rate: 7.6 symbols/min [2025-09-19T17:50:58.993721] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:50:59.043847] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-19T17:50:59.046176] [DEBUG] [LOCAL ] CALX: Loaded 39114 existing records from primary storage. [2025-09-19T17:50:59.046537] [INFO ] [MAIN ] CALX: Loaded 39114 existing records. [2025-09-19T17:50:59.214737] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T17:50:59.285066] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:50:59.285336] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-19T17:50:59.285390] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-19T17:50:59.286212] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-19T17:50:59.286273] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-19T17:50:59.656693] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:50:59.843293] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-19T17:51:00.133613] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T17:51:00.643318] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-19T17:51:01.443262] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-19T17:51:01.523940] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T17:51:01.686731] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-19T17:51:02.243306] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-19T17:51:02.623064] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T17:51:03.043301] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-19T17:51:03.843404] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-19T17:51:04.815549] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (3.37 seconds). [2025-09-19T17:51:04.826002] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-19T17:51:05.784306] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T17:51:05.792434] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-19T17:51:06.503124] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (4.26 seconds). [2025-09-19T17:51:06.510912] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-19T17:51:06.627139] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (3.58 seconds). [2025-09-19T17:51:06.635338] [INFO ] [REMOTE ] CAG: Full fetch complete (77641 records). [2025-09-19T17:51:06.635508] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-19T17:51:07.046216] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-19T17:51:07.046514] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-19T17:51:07.047394] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-19T17:51:07.047479] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-19T17:51:07.050780] [DEBUG] [LOCAL ] CAG: Trimmed 77641 records to 54438 (keeping 200 days of data) [2025-09-19T17:51:07.178167] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-19T17:51:07.191718] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-19T17:51:07.343084] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T17:51:07.480930] [DEBUG] [LOCAL ] CAG: Primary data saved (54438 records). [2025-09-19T17:51:07.481221] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-19T17:51:07.481346] [INFO ] [MAIN ] Update Progress: 389/2372 symbols completed. CAG took 35.6s. Estimated remaining: 4h 20m 15s. Rate: 7.6 symbols/min [2025-09-19T17:51:07.660918] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:07.683101] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T17:51:07.715866] [DEBUG] [LOCAL ] CANG: Loaded 26838 existing records from primary storage. [2025-09-19T17:51:07.716022] [INFO ] [MAIN ] CANG: Loaded 26838 existing records. [2025-09-19T17:51:07.848400] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-19T17:51:07.905880] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:07.906130] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-19T17:51:07.906181] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-19T17:51:07.907035] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-19T17:51:07.907101] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-19T17:51:08.291794] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:08.643308] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-19T17:51:08.823252] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:51:09.443337] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-19T17:51:09.782829] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T17:51:10.007197] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T17:51:10.243290] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-19T17:51:11.043278] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-19T17:51:11.742735] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T17:51:11.843273] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-19T17:51:12.164776] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T17:51:12.370616] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T17:51:12.643267] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-19T17:51:13.443284] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-19T17:51:13.783282] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T17:51:14.243278] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-19T17:51:15.043275] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-19T17:51:16.115722] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (3.47 seconds). [2025-09-19T17:51:16.127361] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-19T17:51:16.241426] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-19T17:51:16.300884] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T17:51:16.341980] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T17:51:16.643268] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-19T17:51:17.443307] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-19T17:51:17.649081] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T17:51:18.243248] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-19T17:51:18.318679] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:51:19.043266] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-19T17:51:19.239399] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T17:51:19.492289] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T17:51:19.843273] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-19T17:51:20.618532] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T17:51:20.643230] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-19T17:51:21.429216] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T17:51:21.443223] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-19T17:51:22.243280] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-19T17:51:22.398161] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T17:51:22.836413] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T17:51:23.043282] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-19T17:51:23.843285] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-19T17:51:24.436530] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-19T17:51:24.643284] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-19T17:51:25.029397] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T17:51:25.449870] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-19T17:51:25.454355] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T17:51:26.243270] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-19T17:51:26.398450] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T17:51:27.043263] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-19T17:51:27.680180] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T17:51:27.690680] [INFO ] [REMOTE ] CAL: Full fetch complete (61852 records). [2025-09-19T17:51:27.690859] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-19T17:51:27.848353] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-19T17:51:28.088408] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-19T17:51:28.088510] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-19T17:51:28.089221] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-19T17:51:28.089287] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-19T17:51:28.090707] [DEBUG] [LOCAL ] CAL: Trimmed 61852 records to 43947 (keeping 200 days of data) [2025-09-19T17:51:28.373557] [DEBUG] [LOCAL ] CAL: Primary data saved (43947 records). [2025-09-19T17:51:28.373723] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-19T17:51:28.373850] [INFO ] [MAIN ] Update Progress: 390/2372 symbols completed. CAL took 32.0s. Estimated remaining: 4h 21m 14s. Rate: 7.6 symbols/min [2025-09-19T17:51:28.567706] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:28.568992] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-19T17:51:28.577294] [INFO ] [REMOTE ] CAH: Full fetch complete (74592 records). [2025-09-19T17:51:28.577637] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-19T17:51:28.683795] [DEBUG] [LOCAL ] CAPL: Loaded 5996 existing records from primary storage. [2025-09-19T17:51:28.687331] [INFO ] [MAIN ] CAPL: Loaded 5996 existing records. [2025-09-19T17:51:29.094510] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:29.110817] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-19T17:51:29.193137] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-19T17:51:29.220235] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T17:51:29.221437] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T17:51:29.238835] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-19T17:51:29.237854] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-19T17:51:29.238441] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-19T17:51:29.239788] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-19T17:51:29.239728] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-19T17:51:29.252921] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-19T17:51:29.271688] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-19T17:51:29.262676] [INFO ] [REMOTE ] CALX: Full fetch complete (54202 records). [2025-09-19T17:51:29.314524] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-19T17:51:29.344839] [DEBUG] [LOCAL ] CAH: Trimmed 74592 records to 52263 (keeping 200 days of data) [2025-09-19T17:51:30.048749] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:30.055110] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-19T17:51:30.149998] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-19T17:51:30.150470] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-19T17:51:30.151939] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-19T17:51:30.152020] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-19T17:51:30.156972] [DEBUG] [LOCAL ] CALX: Trimmed 54202 records to 39339 (keeping 200 days of data) [2025-09-19T17:51:30.501678] [DEBUG] [LOCAL ] CALX: Primary data saved (39339 records). [2025-09-19T17:51:30.502287] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-19T17:51:30.502707] [INFO ] [MAIN ] Update Progress: 391/2372 symbols completed. CALX took 31.7s. Estimated remaining: 4h 20m 36s. Rate: 7.6 symbols/min [2025-09-19T17:51:30.682828] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:30.790780] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-19T17:51:30.794090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-19T17:51:30.812977] [DEBUG] [LOCAL ] CARR: Loaded 53988 existing records from primary storage. [2025-09-19T17:51:30.813402] [INFO ] [MAIN ] CARR: Loaded 53988 existing records. [2025-09-19T17:51:30.930013] [DEBUG] [LOCAL ] CAH: Primary data saved (52263 records). [2025-09-19T17:51:30.946036] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-19T17:51:30.952979] [INFO ] [MAIN ] Update Progress: 392/2372 symbols completed. CAH took 37.6s. Estimated remaining: 4h 19m 51s. Rate: 7.6 symbols/min [2025-09-19T17:51:31.114331] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:31.114783] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-19T17:51:31.114853] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-19T17:51:31.132825] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-19T17:51:31.132995] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-19T17:51:31.144851] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T17:51:31.282732] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:31.254886] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-19T17:51:31.452571] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T17:51:31.612032] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:31.613024] [DEBUG] [LOCAL ] CARS: Loaded 40751 existing records from primary storage. [2025-09-19T17:51:31.613098] [INFO ] [MAIN ] CARS: Loaded 40751 existing records. [2025-09-19T17:51:31.788701] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:31.788962] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-19T17:51:31.789013] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-19T17:51:31.789905] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-19T17:51:31.789965] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-19T17:51:31.852349] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-19T17:51:32.190019] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:32.312243] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T17:51:32.643257] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-19T17:51:33.443304] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-19T17:51:33.863720] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T17:51:34.140522] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T17:51:34.145885] [INFO ] [REMOTE ] CANG: Full fetch complete (40579 records). [2025-09-19T17:51:34.146025] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-19T17:51:34.251481] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-19T17:51:34.552589] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-19T17:51:34.552703] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-19T17:51:34.553296] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-19T17:51:34.553341] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-19T17:51:34.554513] [DEBUG] [LOCAL ] CANG: Trimmed 40579 records to 27140 (keeping 200 days of data) [2025-09-19T17:51:34.716079] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T17:51:34.732370] [DEBUG] [LOCAL ] CANG: Primary data saved (27140 records). [2025-09-19T17:51:34.732448] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-19T17:51:34.732521] [INFO ] [MAIN ] Update Progress: 393/2372 symbols completed. CANG took 27.3s. Estimated remaining: 4h 19m 22s. Rate: 7.6 symbols/min [2025-09-19T17:51:34.904401] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:34.963216] [DEBUG] [LOCAL ] CAT: Loaded 53322 existing records from primary storage. [2025-09-19T17:51:34.963361] [INFO ] [MAIN ] CAT: Loaded 53322 existing records. [2025-09-19T17:51:35.048610] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-19T17:51:35.125861] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T17:51:35.152336] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:35.154484] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-19T17:51:35.154534] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-19T17:51:35.155712] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-19T17:51:35.155772] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-19T17:51:35.509745] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:35.843264] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-19T17:51:36.394917] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T17:51:36.643275] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-19T17:51:37.335844] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T17:51:37.443263] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-19T17:51:37.655142] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T17:51:37.919930] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-19T17:51:38.243257] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-19T17:51:38.989722] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T17:51:39.043219] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-19T17:51:39.843278] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-19T17:51:40.643264] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-19T17:51:41.070517] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T17:51:41.443232] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-19T17:51:42.003817] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T17:51:42.093981] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-19T17:51:42.243218] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-19T17:51:43.043280] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-19T17:51:43.518265] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T17:51:43.843240] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-19T17:51:43.890730] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T17:51:44.643267] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-19T17:51:44.941551] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-19T17:51:45.439014] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T17:51:45.443204] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-19T17:51:45.844540] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T17:51:45.941829] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T17:51:46.243272] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-19T17:51:47.043276] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-19T17:51:47.843281] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-19T17:51:47.861448] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-19T17:51:47.866585] [INFO ] [REMOTE ] CAPL: Full fetch complete (8970 records). [2025-09-19T17:51:47.866733] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-19T17:51:47.867381] [FATAL] [VALIDATOR ] CAPL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:51:47.867472] [FATAL] [MAIN ] CAPL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:51:47.867515] [WARN ] [MAIN ] CAPL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:51:47.867590] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-19T17:51:47.867716] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-09-19T17:51:47.867772] [INFO ] [LOCAL ] CAPL: Starting deletion of derivative data. [2025-09-19T17:51:47.868152] [DEBUG] [LOCAL ] CAPL: Deleted derivative data file. [2025-09-19T17:51:47.868244] [INFO ] [MAIN ] Update Progress: 394/2372 symbols completed. CAPL took 19.5s. Estimated remaining: 4h 19m 41s. Rate: 7.6 symbols/min [2025-09-19T17:51:48.038810] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:51:48.047844] [DEBUG] [LOCAL ] CATO: Loaded 7490 existing records from primary storage. [2025-09-19T17:51:48.047965] [INFO ] [MAIN ] CATO: Loaded 7490 existing records. [2025-09-19T17:51:48.264282] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:51:48.264921] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-19T17:51:48.265153] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-19T17:51:48.265639] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-19T17:51:48.265855] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-19T17:51:48.645638] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-19T17:51:48.682213] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:51:48.684720] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T17:51:49.443265] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-19T17:51:49.974085] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T17:51:50.243301] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-19T17:51:50.441921] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T17:51:50.655523] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T17:51:51.043270] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-19T17:51:51.843299] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-19T17:51:51.913187] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T17:51:52.643337] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-19T17:51:53.057179] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:51:53.443285] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-19T17:51:53.604321] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T17:51:53.990689] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T17:51:54.243278] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-19T17:51:55.043286] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-19T17:51:55.238264] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T17:51:55.265386] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T17:51:55.843319] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-19T17:51:56.643268] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-19T17:51:56.854558] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:51:56.956158] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T17:51:57.443358] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-19T17:51:58.243299] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-19T17:51:59.043240] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-19T17:51:59.125926] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T17:51:59.348507] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-19T17:51:59.544536] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:51:59.843287] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-19T17:52:00.098746] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T17:52:00.643269] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-19T17:52:01.443315] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-19T17:52:01.655699] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T17:52:02.046341] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T17:52:02.243290] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-19T17:52:03.043340] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-19T17:52:03.192987] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T17:52:03.227609] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-19T17:52:03.843264] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-19T17:52:04.635734] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T17:52:04.643200] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-19T17:52:05.020223] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T17:52:05.028036] [INFO ] [REMOTE ] CARR: Full fetch complete (77594 records). [2025-09-19T17:52:05.028173] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-19T17:52:05.158914] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-19T17:52:05.437703] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-19T17:52:05.437828] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-19T17:52:05.438666] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-19T17:52:05.438730] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-19T17:52:05.440242] [DEBUG] [LOCAL ] CARR: Trimmed 77594 records to 54375 (keeping 200 days of data) [2025-09-19T17:52:05.443279] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-19T17:52:05.771967] [DEBUG] [LOCAL ] CARR: Primary data saved (54375 records). [2025-09-19T17:52:05.772137] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-19T17:52:05.772232] [INFO ] [MAIN ] Update Progress: 395/2372 symbols completed. CARR took 35.3s. Estimated remaining: 4h 20m 23s. Rate: 7.6 symbols/min [2025-09-19T17:52:05.941215] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:05.993806] [DEBUG] [LOCAL ] CAVA: Loaded 53942 existing records from primary storage. [2025-09-19T17:52:05.993957] [INFO ] [MAIN ] CAVA: Loaded 53942 existing records. [2025-09-19T17:52:06.186753] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:06.187080] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-19T17:52:06.187150] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-19T17:52:06.188228] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-19T17:52:06.188288] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-19T17:52:06.248551] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-19T17:52:06.586379] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:06.593870] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T17:52:07.043268] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-19T17:52:07.528238] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T17:52:07.534967] [INFO ] [REMOTE ] CARS: Full fetch complete (55356 records). [2025-09-19T17:52:07.535150] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-19T17:52:07.848328] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-19T17:52:07.976322] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-19T17:52:07.976414] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-19T17:52:07.977161] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-19T17:52:07.977245] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-19T17:52:07.978586] [DEBUG] [LOCAL ] CARS: Trimmed 55356 records to 41029 (keeping 200 days of data) [2025-09-19T17:52:08.226246] [DEBUG] [LOCAL ] CARS: Primary data saved (41029 records). [2025-09-19T17:52:08.226384] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-19T17:52:08.226472] [INFO ] [MAIN ] Update Progress: 396/2372 symbols completed. CARS took 37.3s. Estimated remaining: 4h 19m 48s. Rate: 7.6 symbols/min [2025-09-19T17:52:08.402356] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:08.455371] [DEBUG] [LOCAL ] CB: Loaded 50493 existing records from primary storage. [2025-09-19T17:52:08.455528] [INFO ] [MAIN ] CB: Loaded 50493 existing records. [2025-09-19T17:52:08.635758] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:08.636031] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-19T17:52:08.636080] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-19T17:52:08.637166] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-19T17:52:08.637226] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-19T17:52:08.668697] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-19T17:52:09.002301] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:09.009680] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T17:52:09.012910] [INFO ] [REMOTE ] CATO: Full fetch complete (12341 records). [2025-09-19T17:52:09.013494] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-19T17:52:09.399855] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-19T17:52:09.399934] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-19T17:52:09.400205] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-19T17:52:09.400242] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-19T17:52:09.400714] [DEBUG] [LOCAL ] CATO: Trimmed 12341 records to 7531 (keeping 200 days of data) [2025-09-19T17:52:09.443753] [DEBUG] [LOCAL ] CATO: Primary data saved (7531 records). [2025-09-19T17:52:09.444105] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-19T17:52:09.444261] [INFO ] [MAIN ] Update Progress: 397/2372 symbols completed. CATO took 21.6s. Estimated remaining: 4h 19m 7s. Rate: 7.6 symbols/min [2025-09-19T17:52:09.443908] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-19T17:52:09.474866] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-19T17:52:10.243276] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-19T17:52:11.066392] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-19T17:52:11.077600] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-19T17:52:11.742203] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T17:52:11.843317] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-19T17:52:12.419519] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T17:52:12.643288] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-19T17:52:12.999395] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T17:52:13.288627] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T17:52:13.443268] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-19T17:52:14.243358] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-19T17:52:14.931347] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T17:52:15.043231] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-19T17:52:15.755248] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T17:52:15.843268] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-19T17:52:15.878542] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T17:52:16.643266] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-19T17:52:17.563333] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-19T17:52:17.575560] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-19T17:52:18.231021] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T17:52:18.263604] [INFO ] [REMOTE ] CAT: Full fetch complete (76564 records). [2025-09-19T17:52:18.267532] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-19T17:52:18.269319] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:52:18.343251] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-19T17:52:18.734160] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-19T17:52:18.734246] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-19T17:52:18.735062] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-19T17:52:18.735126] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-19T17:52:18.736692] [DEBUG] [LOCAL ] CAT: Trimmed 76564 records to 53709 (keeping 200 days of data) [2025-09-19T17:52:19.090560] [DEBUG] [LOCAL ] CAT: Primary data saved (53709 records). [2025-09-19T17:52:19.090891] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-19T17:52:19.091202] [INFO ] [MAIN ] Update Progress: 398/2372 symbols completed. CAT took 44.4s. Estimated remaining: 4h 19m 8s. Rate: 7.6 symbols/min [2025-09-19T17:52:19.236628] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T17:52:19.248032] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-19T17:52:20.572303] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T17:52:20.583284] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-19T17:52:21.660763] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-19T17:52:21.671985] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-19T17:52:22.656145] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T17:52:22.666900] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-19T17:52:23.987185] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-19T17:52:23.998297] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-19T17:52:24.614143] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:52:24.624609] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-19T17:52:25.892076] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T17:52:25.903847] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-19T17:52:26.142749] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T17:52:26.153928] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-19T17:52:28.174237] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T17:52:28.187238] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-19T17:52:28.315989] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T17:52:28.328538] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-19T17:52:30.288910] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T17:52:30.301487] [INFO ] [REMOTE ] CB: Full fetch complete (72669 records). [2025-09-19T17:52:30.301713] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-19T17:52:30.703240] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-19T17:52:30.703355] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-19T17:52:30.704254] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-19T17:52:30.704419] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-19T17:52:30.706378] [DEBUG] [LOCAL ] CB: Trimmed 72669 records to 50868 (keeping 200 days of data) [2025-09-19T17:52:30.823989] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-19T17:52:30.842448] [INFO ] [REMOTE ] CAVA: Full fetch complete (77267 records). [2025-09-19T17:52:30.843357] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-19T17:52:31.254914] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-19T17:52:31.255223] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-19T17:52:31.256322] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-19T17:52:31.256712] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-19T17:52:31.261170] [DEBUG] [LOCAL ] CAVA: Trimmed 77267 records to 54332 (keeping 200 days of data) [2025-09-19T17:52:31.679301] [DEBUG] [LOCAL ] CB: Primary data saved (50868 records). [2025-09-19T17:52:31.680274] [INFO ] [MAIN ] CB: Full history saved. [2025-09-19T17:52:31.680401] [INFO ] [MAIN ] Update Progress: 399/2372 symbols completed. CB took 23.5s. Estimated remaining: 4h 19m 24s. Rate: 7.6 symbols/min [2025-09-19T17:52:31.791443] [DEBUG] [LOCAL ] CAVA: Primary data saved (54332 records). [2025-09-19T17:52:31.791610] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-19T17:52:31.791735] [INFO ] [MAIN ] Update Progress: 400/2372 symbols completed. CAVA took 26.0s. Estimated remaining: 4h 18m 37s. Rate: 7.6 symbols/min [2025-09-19T17:52:32.385934] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:32.451826] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:32.455398] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:32.478789] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-19T17:52:32.504301] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:32.504530] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-19T17:52:32.504837] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-19T17:52:32.504893] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-19T17:52:32.504940] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-19T17:52:32.504973] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-19T17:52:32.641381] [DEBUG] [LOCAL ] CBAN: Loaded 11306 existing records from primary storage. [2025-09-19T17:52:32.642216] [DEBUG] [LOCAL ] CBL: Loaded 16995 existing records from primary storage. [2025-09-19T17:52:32.641809] [INFO ] [MAIN ] CBAN: Loaded 11306 existing records. [2025-09-19T17:52:32.642778] [INFO ] [MAIN ] CBL: Loaded 16995 existing records. [2025-09-19T17:52:32.641599] [DEBUG] [LOCAL ] CBNA: Loaded 2970 existing records from primary storage. [2025-09-19T17:52:32.664234] [INFO ] [MAIN ] CBNA: Loaded 2970 existing records. [2025-09-19T17:52:33.348167] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:33.420720] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:33.420872] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-19T17:52:33.445251] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-19T17:52:33.460389] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-19T17:52:33.467154] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-19T17:52:33.471761] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-19T17:52:33.454598] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:33.471868] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-19T17:52:33.495005] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-19T17:52:33.503816] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:33.500729] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-19T17:52:33.522251] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-19T17:52:33.495068] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-19T17:52:33.528468] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-19T17:52:33.622849] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-19T17:52:33.668181] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-19T17:52:33.833538] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:33.915035] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-19T17:52:33.981564] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-19T17:52:34.420069] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:34.448751] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-19T17:52:34.536070] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:34.573158] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-19T17:52:34.576780] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:34.577179] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-19T17:52:34.577459] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-19T17:52:34.663574] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:34.663967] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-19T17:52:35.103002] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:35.103321] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-19T17:52:35.103813] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-19T17:52:35.345454] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T17:52:35.350358] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-19T17:52:35.506402] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T17:52:35.507298] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-19T17:52:35.548891] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T17:52:35.550630] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-19T17:52:35.676545] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T17:52:35.678712] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-19T17:52:35.755123] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-19T17:52:35.843252] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-19T17:52:36.096314] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:52:36.277210] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T17:52:36.315382] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-19T17:52:36.508272] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T17:52:36.643341] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-19T17:52:36.956590] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-19T17:52:37.443335] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-19T17:52:38.021734] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T17:52:38.243274] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-19T17:52:39.043302] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-19T17:52:39.274531] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T17:52:39.843229] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-19T17:52:40.354924] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T17:52:40.643279] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-19T17:52:40.876525] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-19T17:52:41.018482] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T17:52:41.443254] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-19T17:52:42.243268] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-19T17:52:42.490615] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:42.490968] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-19T17:52:42.507773] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T17:52:43.043290] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-19T17:52:43.843274] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-19T17:52:44.164137] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:52:44.164568] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-19T17:52:44.164700] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-19T17:52:44.164781] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-19T17:52:44.165520] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:52:44.165601] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:52:44.165686] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:52:44.165763] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-19T17:52:44.165831] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-19T17:52:44.165868] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-19T17:52:44.165974] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-19T17:52:44.166062] [INFO ] [MAIN ] Update Progress: 401/2372 symbols completed. CBO took 12.4s. Estimated remaining: 4h 18m 52s. Rate: 7.6 symbols/min [2025-09-19T17:52:44.364040] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:52:44.421433] [DEBUG] [LOCAL ] CBRE: Loaded 51090 existing records from primary storage. [2025-09-19T17:52:44.421588] [INFO ] [MAIN ] CBRE: Loaded 51090 existing records. [2025-09-19T17:52:44.627408] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:52:44.627774] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-19T17:52:44.627848] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-19T17:52:44.639133] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-19T17:52:44.639242] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-19T17:52:44.650735] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-19T17:52:44.700179] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:52:45.032711] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:52:45.443273] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-19T17:52:45.474602] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T17:52:46.243275] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-19T17:52:46.754671] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T17:52:47.043277] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-19T17:52:47.657892] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-19T17:52:47.843281] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-19T17:52:48.350179] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T17:52:48.555900] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T17:52:48.643302] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-19T17:52:49.443316] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-19T17:52:50.007251] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T17:52:50.183983] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T17:52:50.243245] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-19T17:52:51.043319] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-19T17:52:51.639100] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T17:52:51.843269] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-19T17:52:52.275941] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T17:52:52.643316] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-19T17:52:53.396073] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T17:52:53.443252] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-19T17:52:53.544671] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T17:52:54.243281] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-19T17:52:55.043334] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-19T17:52:55.349639] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T17:52:55.520083] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T17:52:55.573513] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T17:52:55.843344] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-19T17:52:56.643279] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-19T17:52:57.448437] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-19T17:52:57.467511] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:52:57.548924] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T17:52:58.083435] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T17:52:58.243294] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-19T17:52:58.998353] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T17:52:59.043279] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-19T17:52:59.843319] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-19T17:52:59.974295] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T17:53:00.643276] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-19T17:53:01.197764] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-19T17:53:01.443276] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-19T17:53:01.584745] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T17:53:01.918429] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T17:53:02.243279] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-19T17:53:03.043274] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-19T17:53:03.686218] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T17:53:03.701071] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T17:53:03.703529] [INFO ] [REMOTE ] CBNA: Full fetch complete (4808 records). [2025-09-19T17:53:03.704099] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-19T17:53:03.848439] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-19T17:53:04.121787] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-19T17:53:04.121874] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-19T17:53:04.122055] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-19T17:53:04.122133] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-19T17:53:04.122551] [DEBUG] [LOCAL ] CBNA: Trimmed 4808 records to 2982 (keeping 200 days of data) [2025-09-19T17:53:04.140045] [DEBUG] [LOCAL ] CBNA: Primary data saved (2982 records). [2025-09-19T17:53:04.140105] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-19T17:53:04.140214] [INFO ] [MAIN ] Update Progress: 402/2372 symbols completed. CBNA took 32.3s. Estimated remaining: 4h 19m 43s. Rate: 7.6 symbols/min [2025-09-19T17:53:04.307775] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:04.341221] [DEBUG] [LOCAL ] CBT: Loaded 31624 existing records from primary storage. [2025-09-19T17:53:04.341383] [INFO ] [MAIN ] CBT: Loaded 31624 existing records. [2025-09-19T17:53:04.517049] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:04.517275] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-19T17:53:04.517373] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-19T17:53:04.518336] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-19T17:53:04.518405] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-19T17:53:04.648512] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-19T17:53:04.899890] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:05.303958] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T17:53:05.443324] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-19T17:53:05.714050] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T17:53:05.716966] [INFO ] [REMOTE ] CBAN: Full fetch complete (15961 records). [2025-09-19T17:53:05.717045] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-19T17:53:06.080039] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-19T17:53:06.080120] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-19T17:53:06.080493] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-19T17:53:06.080533] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-19T17:53:06.081100] [DEBUG] [LOCAL ] CBAN: Trimmed 15961 records to 11389 (keeping 200 days of data) [2025-09-19T17:53:06.151414] [DEBUG] [LOCAL ] CBAN: Primary data saved (11389 records). [2025-09-19T17:53:06.151565] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-19T17:53:06.151673] [INFO ] [MAIN ] Update Progress: 403/2372 symbols completed. CBAN took 34.4s. Estimated remaining: 4h 19m 6s. Rate: 7.6 symbols/min [2025-09-19T17:53:06.249025] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-19T17:53:06.323475] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:06.349066] [DEBUG] [LOCAL ] CBU: Loaded 23167 existing records from primary storage. [2025-09-19T17:53:06.349244] [INFO ] [MAIN ] CBU: Loaded 23167 existing records. [2025-09-19T17:53:06.552540] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:06.552886] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-19T17:53:06.552950] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-19T17:53:06.553762] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-19T17:53:06.553833] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-19T17:53:06.964710] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:07.043269] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-19T17:53:07.137847] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T17:53:07.203813] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T17:53:07.206596] [INFO ] [REMOTE ] CBL: Full fetch complete (25824 records). [2025-09-19T17:53:07.206708] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-19T17:53:07.586339] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-19T17:53:07.586451] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-19T17:53:07.586947] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-19T17:53:07.587031] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-19T17:53:07.590339] [DEBUG] [LOCAL ] CBL: Trimmed 25824 records to 17100 (keeping 200 days of data) [2025-09-19T17:53:07.701131] [DEBUG] [LOCAL ] CBL: Primary data saved (17100 records). [2025-09-19T17:53:07.701271] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-19T17:53:07.701389] [INFO ] [MAIN ] Update Progress: 404/2372 symbols completed. CBL took 35.9s. Estimated remaining: 4h 18m 27s. Rate: 7.6 symbols/min [2025-09-19T17:53:07.850114] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-19T17:53:07.876016] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:07.877601] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-19T17:53:07.877690] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-19T17:53:07.877876] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-19T17:53:07.877934] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-19T17:53:07.877992] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-19T17:53:07.878062] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-19T17:53:08.248519] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:08.643303] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-19T17:53:08.855856] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T17:53:08.918730] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T17:53:08.927473] [INFO ] [REMOTE ] CBRE: Full fetch complete (73960 records). [2025-09-19T17:53:08.927633] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-19T17:53:09.333768] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-19T17:53:09.333871] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-19T17:53:09.334690] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-19T17:53:09.334770] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-19T17:53:09.336281] [DEBUG] [LOCAL ] CBRE: Trimmed 73960 records to 51439 (keeping 200 days of data) [2025-09-19T17:53:09.444681] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-19T17:53:09.654425] [DEBUG] [LOCAL ] CBRE: Primary data saved (51439 records). [2025-09-19T17:53:09.654605] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-19T17:53:09.654751] [INFO ] [MAIN ] Update Progress: 405/2372 symbols completed. CBRE took 25.5s. Estimated remaining: 4h 17m 51s. Rate: 7.6 symbols/min [2025-09-19T17:53:09.830918] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:09.869933] [DEBUG] [LOCAL ] CBZ: Loaded 33568 existing records from primary storage. [2025-09-19T17:53:09.870180] [INFO ] [MAIN ] CBZ: Loaded 33568 existing records. [2025-09-19T17:53:10.046183] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:10.046443] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-19T17:53:10.046491] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-19T17:53:10.047461] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-19T17:53:10.047532] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-19T17:53:10.250834] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-19T17:53:10.425714] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:10.437871] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:53:10.538554] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:10.538930] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-19T17:53:10.780435] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T17:53:11.043261] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-19T17:53:11.843273] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-19T17:53:12.036888] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T17:53:12.643267] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-19T17:53:13.198603] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T17:53:13.443242] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-19T17:53:13.577336] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T17:53:13.931419] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:13.931767] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-19T17:53:14.243285] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-19T17:53:15.043273] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-19T17:53:15.305919] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:15.306229] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-19T17:53:15.843281] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-19T17:53:15.957062] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:53:16.079165] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:16.079447] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-19T17:53:16.643270] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-19T17:53:17.443281] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-19T17:53:18.158681] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T17:53:18.243246] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-19T17:53:18.273966] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T17:53:19.043268] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-19T17:53:19.843282] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-19T17:53:19.880102] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T17:53:20.000409] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T17:53:20.069027] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:20.069395] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-19T17:53:20.643257] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-19T17:53:21.443317] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-19T17:53:22.213273] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:53:22.243264] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-19T17:53:22.492313] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T17:53:23.043264] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-19T17:53:23.332383] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-19T17:53:23.387371] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T17:53:23.843315] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-19T17:53:24.643303] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-19T17:53:24.964913] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T17:53:25.443263] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-19T17:53:26.126109] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T17:53:26.243287] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-19T17:53:26.991245] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T17:53:27.043268] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-19T17:53:27.058712] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T17:53:27.843261] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-19T17:53:28.550632] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T17:53:28.643260] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-19T17:53:28.723343] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T17:53:29.443265] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-19T17:53:29.524713] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-19T17:53:30.243275] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-19T17:53:30.972954] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T17:53:30.994603] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:53:31.043248] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-19T17:53:31.843294] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-19T17:53:32.084852] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:32.085288] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-19T17:53:32.145862] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T17:53:32.643299] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-19T17:53:33.002371] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:53:33.002838] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-19T17:53:33.002968] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-19T17:53:33.003058] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-19T17:53:33.003907] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:53:33.004005] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:53:33.004087] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:53:33.004176] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-19T17:53:33.004258] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-19T17:53:33.004325] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-19T17:53:33.004413] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-19T17:53:33.004512] [INFO ] [MAIN ] Update Progress: 406/2372 symbols completed. CBX took 25.3s. Estimated remaining: 4h 18m 58s. Rate: 7.6 symbols/min [2025-09-19T17:53:33.226133] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:33.304700] [DEBUG] [LOCAL ] CC: Loaded 53424 existing records from primary storage. [2025-09-19T17:53:33.304900] [INFO ] [MAIN ] CC: Loaded 53424 existing records. [2025-09-19T17:53:33.450632] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-19T17:53:33.493068] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:33.493361] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-19T17:53:33.493419] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-19T17:53:33.496294] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-19T17:53:33.496357] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-19T17:53:33.875024] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:34.243278] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-19T17:53:34.650711] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:53:35.043313] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-19T17:53:35.214894] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T17:53:35.843334] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-19T17:53:36.608196] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T17:53:36.643220] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-19T17:53:37.313454] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:53:37.443250] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-19T17:53:38.055071] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T17:53:38.058999] [INFO ] [REMOTE ] CBU: Full fetch complete (32050 records). [2025-09-19T17:53:38.059081] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-19T17:53:38.248587] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-19T17:53:38.430296] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-19T17:53:38.430380] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-19T17:53:38.430852] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-19T17:53:38.430912] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-19T17:53:38.431632] [DEBUG] [LOCAL ] CBU: Trimmed 32050 records to 23402 (keeping 200 days of data) [2025-09-19T17:53:38.591269] [DEBUG] [LOCAL ] CBU: Primary data saved (23402 records). [2025-09-19T17:53:38.591684] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-19T17:53:38.591798] [INFO ] [MAIN ] Update Progress: 407/2372 symbols completed. CBU took 32.4s. Estimated remaining: 4h 18m 39s. Rate: 7.6 symbols/min [2025-09-19T17:53:38.760553] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:38.829415] [DEBUG] [LOCAL ] CCI: Loaded 53549 existing records from primary storage. [2025-09-19T17:53:38.829557] [INFO ] [MAIN ] CCI: Loaded 53549 existing records. [2025-09-19T17:53:39.005874] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:39.006146] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-19T17:53:39.006194] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-19T17:53:39.008087] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-19T17:53:39.008149] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-19T17:53:39.050565] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-19T17:53:39.373658] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:39.402332] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T17:53:39.843251] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-19T17:53:39.925073] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T17:53:39.929544] [INFO ] [REMOTE ] CBT: Full fetch complete (45929 records). [2025-09-19T17:53:39.929627] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-19T17:53:40.307916] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-19T17:53:40.308022] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-19T17:53:40.308584] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-19T17:53:40.308623] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-19T17:53:40.309704] [DEBUG] [LOCAL ] CBT: Trimmed 45929 records to 31844 (keeping 200 days of data) [2025-09-19T17:53:40.506580] [DEBUG] [LOCAL ] CBT: Primary data saved (31844 records). [2025-09-19T17:53:40.506741] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-19T17:53:40.506834] [INFO ] [MAIN ] Update Progress: 408/2372 symbols completed. CBT took 36.4s. Estimated remaining: 4h 18m 2s. Rate: 7.6 symbols/min [2025-09-19T17:53:40.652160] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-19T17:53:40.677731] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:40.677862] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-19T17:53:40.677916] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-19T17:53:40.678052] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-19T17:53:40.678095] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-19T17:53:40.678136] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-19T17:53:40.678168] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-19T17:53:41.039879] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:41.060019] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T17:53:41.443284] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-19T17:53:41.685433] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T17:53:41.894281] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T17:53:42.243336] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-19T17:53:42.596091] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T17:53:43.043294] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-19T17:53:43.808367] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T17:53:43.843217] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-19T17:53:44.643271] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-19T17:53:45.065173] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T17:53:45.443267] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-19T17:53:45.815547] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T17:53:46.243280] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-19T17:53:46.352798] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T17:53:46.361509] [INFO ] [REMOTE ] CBZ: Full fetch complete (44497 records). [2025-09-19T17:53:46.361707] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-19T17:53:46.762542] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-19T17:53:46.762689] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-19T17:53:46.763278] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-19T17:53:46.763340] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-19T17:53:46.765519] [DEBUG] [LOCAL ] CBZ: Trimmed 44497 records to 33900 (keeping 200 days of data) [2025-09-19T17:53:46.975831] [DEBUG] [LOCAL ] CBZ: Primary data saved (33900 records). [2025-09-19T17:53:46.975997] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-19T17:53:46.976087] [INFO ] [MAIN ] Update Progress: 409/2372 symbols completed. CBZ took 37.3s. Estimated remaining: 4h 17m 47s. Rate: 7.6 symbols/min [2025-09-19T17:53:47.048756] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-19T17:53:47.159092] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:53:47.175839] [DEBUG] [LOCAL ] CCIF: Loaded 15358 existing records from primary storage. [2025-09-19T17:53:47.176028] [INFO ] [MAIN ] CCIF: Loaded 15358 existing records. [2025-09-19T17:53:47.378413] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:53:47.378955] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-19T17:53:47.379111] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-19T17:53:47.380079] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-19T17:53:47.380156] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-19T17:53:47.508415] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-19T17:53:47.834619] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:53:47.839751] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-19T17:53:47.851352] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-19T17:53:47.952595] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T17:53:48.643366] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-19T17:53:48.773494] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T17:53:49.053800] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T17:53:49.443300] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-19T17:53:50.243315] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-19T17:53:50.888764] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T17:53:51.043288] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-19T17:53:51.843302] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-19T17:53:52.416107] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T17:53:52.580960] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T17:53:52.643241] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-19T17:53:53.243149] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T17:53:53.304510] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T17:53:53.443298] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-19T17:53:53.932268] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-19T17:53:54.243290] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-19T17:53:55.043288] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-19T17:53:55.373929] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T17:53:55.843524] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-19T17:53:56.643294] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-19T17:53:57.037800] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T17:53:57.443303] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-19T17:53:57.490049] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T17:53:57.956673] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-19T17:53:58.243336] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-19T17:53:58.721883] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T17:53:59.043310] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-19T17:53:59.852805] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-19T17:53:59.877846] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T17:54:00.493475] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-19T17:54:00.643321] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-19T17:54:00.788836] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T17:54:00.797004] [INFO ] [REMOTE ] CC: Full fetch complete (75416 records). [2025-09-19T17:54:00.797192] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-19T17:54:01.125165] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-19T17:54:01.256230] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-19T17:54:01.256346] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-19T17:54:01.257242] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-19T17:54:01.257325] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-19T17:54:01.259001] [DEBUG] [LOCAL ] CC: Trimmed 75416 records to 53812 (keeping 200 days of data) [2025-09-19T17:54:01.444767] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-19T17:54:01.612070] [DEBUG] [LOCAL ] CC: Primary data saved (53812 records). [2025-09-19T17:54:01.612273] [INFO ] [MAIN ] CC: Full history saved. [2025-09-19T17:54:01.612378] [INFO ] [MAIN ] Update Progress: 410/2372 symbols completed. CC took 28.6s. Estimated remaining: 4h 18m 12s. Rate: 7.6 symbols/min [2025-09-19T17:54:01.791974] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:01.847559] [DEBUG] [LOCAL ] CCJ: Loaded 54065 existing records from primary storage. [2025-09-19T17:54:01.847798] [INFO ] [MAIN ] CCJ: Loaded 54065 existing records. [2025-09-19T17:54:02.033068] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:02.033365] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-19T17:54:02.033418] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-19T17:54:02.034784] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-19T17:54:02.034847] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-19T17:54:02.249783] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-19T17:54:02.425830] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:03.043304] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-19T17:54:03.843290] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-19T17:54:04.409568] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-09-19T17:54:04.433200] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T17:54:04.643281] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-19T17:54:05.160603] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T17:54:05.443287] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-19T17:54:05.771443] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-19T17:54:05.798171] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T17:54:05.995379] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T17:54:06.243269] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-19T17:54:06.661441] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-19T17:54:06.663026] [INFO ] [REMOTE ] CCIA: Full fetch complete (2022 records). [2025-09-19T17:54:06.663141] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-19T17:54:06.860739] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T17:54:06.860957] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:54:06.861032] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:54:06.861082] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-19T17:54:06.861144] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-19T17:54:06.861180] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-19T17:54:06.861244] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-19T17:54:06.861329] [INFO ] [MAIN ] Update Progress: 411/2372 symbols completed. CCIA took 26.4s. Estimated remaining: 4h 17m 51s. Rate: 7.6 symbols/min [2025-09-19T17:54:07.055618] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:07.048469] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-19T17:54:07.056021] [DEBUG] [LOCAL ] CCK: No existing data file found in primary storage. [2025-09-19T17:54:07.056986] [WARN ] [MAIN ] CCK: No existing data found, performing full refresh instead. [2025-09-19T17:54:07.057185] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-19T17:54:07.057239] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-19T17:54:07.057283] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-09-19T17:54:07.057316] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-19T17:54:07.426978] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:07.843268] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-19T17:54:08.643316] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-19T17:54:09.310740] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T17:54:09.443266] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-19T17:54:09.770420] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T17:54:10.243321] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-19T17:54:10.399183] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T17:54:10.812615] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:54:10.914849] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T17:54:11.043272] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-19T17:54:11.843273] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-19T17:54:12.643250] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-19T17:54:13.121601] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T17:54:13.148348] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:54:13.156802] [INFO ] [REMOTE ] CCI: Full fetch complete (76995 records). [2025-09-19T17:54:13.156943] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-19T17:54:13.452698] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-19T17:54:13.561693] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-19T17:54:13.561783] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-19T17:54:13.562733] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-19T17:54:13.562800] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-19T17:54:13.564331] [DEBUG] [LOCAL ] CCI: Trimmed 76995 records to 53934 (keeping 200 days of data) [2025-09-19T17:54:13.937361] [DEBUG] [LOCAL ] CCI: Primary data saved (53934 records). [2025-09-19T17:54:13.937528] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-19T17:54:13.937627] [INFO ] [MAIN ] Update Progress: 412/2372 symbols completed. CCI took 35.3s. Estimated remaining: 4h 17m 40s. Rate: 7.6 symbols/min [2025-09-19T17:54:14.108097] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:14.163859] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-09-19T17:54:14.164011] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-09-19T17:54:14.256715] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-19T17:54:14.357317] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:14.357582] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-19T17:54:14.357632] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-19T17:54:14.359019] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-19T17:54:14.359078] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-19T17:54:14.731083] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:15.043230] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-19T17:54:15.336630] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T17:54:15.339463] [INFO ] [REMOTE ] CCIF: Full fetch complete (21443 records). [2025-09-19T17:54:15.339541] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-19T17:54:15.710009] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-19T17:54:15.710114] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-19T17:54:15.710449] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-19T17:54:15.710523] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-19T17:54:15.711371] [DEBUG] [LOCAL ] CCIF: Trimmed 21443 records to 15474 (keeping 200 days of data) [2025-09-19T17:54:15.811934] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (3.17 seconds). [2025-09-19T17:54:15.840884] [DEBUG] [LOCAL ] CCIF: Primary data saved (15474 records). [2025-09-19T17:54:15.841031] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-19T17:54:15.841132] [INFO ] [MAIN ] Update Progress: 413/2372 symbols completed. CCIF took 28.9s. Estimated remaining: 4h 17m 3s. Rate: 7.6 symbols/min [2025-09-19T17:54:15.873374] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-19T17:54:16.021030] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:16.068202] [DEBUG] [LOCAL ] CCO: Loaded 47879 existing records from primary storage. [2025-09-19T17:54:16.068354] [INFO ] [MAIN ] CCO: Loaded 47879 existing records. [2025-09-19T17:54:16.246928] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:16.247148] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-19T17:54:16.247195] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-19T17:54:16.248567] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-19T17:54:16.248678] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-19T17:54:16.599472] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:16.643226] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-19T17:54:17.038364] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-19T17:54:17.443280] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-19T17:54:17.989249] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T17:54:18.074083] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T17:54:18.243270] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-19T17:54:18.570886] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (3.53 seconds). [2025-09-19T17:54:19.043280] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-19T17:54:19.423226] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:54:19.843262] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-19T17:54:20.037070] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T17:54:20.643269] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-19T17:54:21.443278] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-19T17:54:21.624442] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-19T17:54:21.735792] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T17:54:21.787357] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T17:54:22.243279] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-19T17:54:23.043309] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-19T17:54:23.141251] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T17:54:23.654229] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T17:54:23.843270] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-19T17:54:24.643263] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-19T17:54:25.211957] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T17:54:25.443263] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-19T17:54:26.243247] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-19T17:54:26.279128] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T17:54:26.392760] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T17:54:27.043326] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-19T17:54:27.843243] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-19T17:54:27.986437] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T17:54:28.119422] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-19T17:54:28.294111] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T17:54:28.643302] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-19T17:54:29.443324] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-19T17:54:30.243315] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-19T17:54:30.315866] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T17:54:30.581838] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T17:54:31.043268] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-19T17:54:31.227470] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T17:54:31.843289] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-19T17:54:32.643276] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-19T17:54:32.793542] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T17:54:32.985843] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-19T17:54:33.353821] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T17:54:33.443513] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-19T17:54:34.243312] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-19T17:54:35.043270] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-19T17:54:35.180079] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-19T17:54:35.309445] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T17:54:35.843277] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-19T17:54:36.020994] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-19T17:54:36.643265] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-19T17:54:37.443308] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-19T17:54:37.622883] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-19T17:54:37.675858] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T17:54:38.243290] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-19T17:54:38.547456] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T17:54:39.043268] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-19T17:54:39.449407] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T17:54:39.457061] [INFO ] [REMOTE ] CCK: Full fetch complete (67800 records). [2025-09-19T17:54:39.457202] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-19T17:54:39.852375] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-19T17:54:39.897854] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-19T17:54:39.897950] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-19T17:54:39.899019] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-19T17:54:39.899083] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-19T17:54:39.900811] [DEBUG] [LOCAL ] CCK: Trimmed 67800 records to 47277 (keeping 200 days of data) [2025-09-19T17:54:40.222265] [DEBUG] [LOCAL ] CCK: Primary data saved (47277 records). [2025-09-19T17:54:40.222424] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-19T17:54:40.222537] [INFO ] [MAIN ] Update Progress: 414/2372 symbols completed. CCK took 33.4s. Estimated remaining: 4h 18m 14s. Rate: 7.6 symbols/min [2025-09-19T17:54:40.411320] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:40.422509] [DEBUG] [LOCAL ] CCRD: Loaded 9003 existing records from primary storage. [2025-09-19T17:54:40.422688] [INFO ] [MAIN ] CCRD: Loaded 9003 existing records. [2025-09-19T17:54:40.606706] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:40.607150] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-19T17:54:40.607362] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-19T17:54:40.607853] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-19T17:54:40.608057] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-19T17:54:41.061634] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:41.062335] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-19T17:54:41.066125] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-19T17:54:41.219188] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T17:54:41.227944] [INFO ] [REMOTE ] CCJ: Full fetch complete (77680 records). [2025-09-19T17:54:41.228109] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-19T17:54:41.464473] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-19T17:54:41.666584] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-19T17:54:41.666722] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-19T17:54:41.667634] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-19T17:54:41.667731] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-19T17:54:41.669470] [DEBUG] [LOCAL ] CCJ: Trimmed 77680 records to 54455 (keeping 200 days of data) [2025-09-19T17:54:41.946950] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T17:54:41.958108] [INFO ] [REMOTE ] CCO: Full fetch complete (65980 records). [2025-09-19T17:54:41.959082] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-19T17:54:41.976580] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T17:54:42.259990] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-19T17:54:42.742158] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-19T17:54:42.743571] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-19T17:54:42.749681] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-19T17:54:42.756222] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-19T17:54:42.756112] [DEBUG] [LOCAL ] CCJ: Primary data saved (54455 records). [2025-09-19T17:54:42.756401] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-19T17:54:42.756881] [INFO ] [MAIN ] Update Progress: 415/2372 symbols completed. CCJ took 41.1s. Estimated remaining: 4h 17m 40s. Rate: 7.6 symbols/min [2025-09-19T17:54:42.884594] [DEBUG] [LOCAL ] CCO: Trimmed 65980 records to 48252 (keeping 200 days of data) [2025-09-19T17:54:43.095407] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:43.146568] [DEBUG] [LOCAL ] CCS: Loaded 30923 existing records from primary storage. [2025-09-19T17:54:43.147297] [INFO ] [MAIN ] CCS: Loaded 30923 existing records. [2025-09-19T17:54:43.351164] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:54:43.365625] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-19T17:54:43.430481] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:43.432339] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-19T17:54:43.432755] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-19T17:54:43.434260] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-19T17:54:43.435176] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-19T17:54:43.861685] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:43.862876] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-19T17:54:43.876788] [DEBUG] [LOCAL ] CCO: Primary data saved (48252 records). [2025-09-19T17:54:43.876899] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-19T17:54:43.877005] [INFO ] [MAIN ] Update Progress: 416/2372 symbols completed. CCO took 28.0s. Estimated remaining: 4h 17m 1s. Rate: 7.6 symbols/min [2025-09-19T17:54:44.047944] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:44.071830] [DEBUG] [LOCAL ] CCU: Loaded 24155 existing records from primary storage. [2025-09-19T17:54:44.072019] [INFO ] [MAIN ] CCU: Loaded 24155 existing records. [2025-09-19T17:54:44.256373] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T17:54:44.256486] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:54:44.258573] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-19T17:54:44.258634] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-19T17:54:44.259392] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-19T17:54:44.259452] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-19T17:54:44.629254] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:44.649204] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-19T17:54:44.665122] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (3.20 seconds). [2025-09-19T17:54:45.275908] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T17:54:45.443283] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-19T17:54:46.117756] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T17:54:46.243275] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-19T17:54:47.043269] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-19T17:54:47.123974] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T17:54:47.301723] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T17:54:47.843271] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-19T17:54:48.137129] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T17:54:48.643250] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-19T17:54:49.145336] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T17:54:49.443274] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-19T17:54:50.243313] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-19T17:54:50.768566] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T17:54:51.007976] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T17:54:51.043265] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-19T17:54:51.276253] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-19T17:54:51.284253] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-19T17:54:51.284385] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-19T17:54:51.682398] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-19T17:54:51.682508] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-19T17:54:51.683819] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-19T17:54:51.683942] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-19T17:54:51.686198] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54580 (keeping 200 days of data) [2025-09-19T17:54:51.871400] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-19T17:54:52.047189] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-09-19T17:54:52.047352] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-19T17:54:52.047507] [INFO ] [MAIN ] Update Progress: 417/2372 symbols completed. CCL took 38.1s. Estimated remaining: 4h 16m 54s. Rate: 7.6 symbols/min [2025-09-19T17:54:52.239755] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:54:52.239958] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-19T17:54:52.240011] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-19T17:54:52.240162] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-19T17:54:52.240205] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-19T17:54:52.240246] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-19T17:54:52.240290] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-19T17:54:52.645667] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:54:52.645791] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-19T17:54:52.681005] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T17:54:53.309551] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T17:54:53.443298] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-19T17:54:53.480878] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T17:54:53.874815] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-19T17:54:54.243322] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-19T17:54:54.513542] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-19T17:54:55.043283] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-19T17:54:55.843350] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-19T17:54:56.194970] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T17:54:56.643264] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-19T17:54:57.443276] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-19T17:54:57.562109] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T17:54:57.578886] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T17:54:58.243294] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-19T17:54:59.043268] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-19T17:54:59.137916] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T17:54:59.283692] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T17:54:59.843286] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-19T17:55:00.252444] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T17:55:00.643308] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-19T17:55:00.689036] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T17:55:01.443297] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-19T17:55:02.194753] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T17:55:02.243255] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-19T17:55:02.423507] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T17:55:03.043292] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-19T17:55:03.269670] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T17:55:03.271631] [INFO ] [REMOTE ] CCRD: Full fetch complete (12101 records). [2025-09-19T17:55:03.271807] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-19T17:55:03.337357] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-19T17:55:03.645339] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-19T17:55:03.645444] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-19T17:55:03.645770] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-19T17:55:03.645842] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-19T17:55:03.646490] [DEBUG] [LOCAL ] CCRD: Trimmed 12101 records to 9103 (keeping 200 days of data) [2025-09-19T17:55:03.706361] [DEBUG] [LOCAL ] CCRD: Primary data saved (9103 records). [2025-09-19T17:55:03.706521] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-19T17:55:03.706637] [INFO ] [MAIN ] Update Progress: 418/2372 symbols completed. CCRD took 23.5s. Estimated remaining: 4h 17m 4s. Rate: 7.6 symbols/min [2025-09-19T17:55:03.852683] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-19T17:55:03.881089] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:03.945323] [DEBUG] [LOCAL ] CDE: Loaded 54031 existing records from primary storage. [2025-09-19T17:55:03.945491] [INFO ] [MAIN ] CDE: Loaded 54031 existing records. [2025-09-19T17:55:04.132321] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:04.132755] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-19T17:55:04.132840] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-19T17:55:04.134597] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-19T17:55:04.134706] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-19T17:55:04.248074] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T17:55:04.501130] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:04.643306] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-19T17:55:05.443288] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-19T17:55:06.243276] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-19T17:55:06.945630] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T17:55:07.051879] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-19T17:55:07.059327] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T17:55:07.416337] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-19T17:55:07.502726] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T17:55:07.843372] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-19T17:55:08.643287] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-19T17:55:09.044003] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T17:55:09.047375] [INFO ] [REMOTE ] CCU: Full fetch complete (33333 records). [2025-09-19T17:55:09.047489] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-19T17:55:09.446676] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-19T17:55:09.456565] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-19T17:55:09.456666] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-19T17:55:09.457293] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-19T17:55:09.457426] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-19T17:55:09.458465] [DEBUG] [LOCAL ] CCU: Trimmed 33333 records to 24340 (keeping 200 days of data) [2025-09-19T17:55:09.605678] [DEBUG] [LOCAL ] CCU: Primary data saved (24340 records). [2025-09-19T17:55:09.605813] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-19T17:55:09.605921] [INFO ] [MAIN ] Update Progress: 419/2372 symbols completed. CCU took 25.7s. Estimated remaining: 4h 16m 47s. Rate: 7.6 symbols/min [2025-09-19T17:55:09.758110] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-19T17:55:09.786537] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:09.786767] [DEBUG] [LOCAL ] CDLR: No existing data file found in primary storage. [2025-09-19T17:55:09.786822] [WARN ] [MAIN ] CDLR: No existing data found, performing full refresh instead. [2025-09-19T17:55:09.786974] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-19T17:55:09.787206] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-19T17:55:09.787248] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-09-19T17:55:09.787280] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-19T17:55:10.195245] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:10.243287] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-19T17:55:10.774293] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T17:55:11.043282] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-19T17:55:11.300123] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:55:11.300443] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-19T17:55:11.843244] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-19T17:55:11.943685] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T17:55:12.643283] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-19T17:55:13.139920] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T17:55:13.443267] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-19T17:55:13.693702] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-19T17:55:14.243269] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-19T17:55:14.645347] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T17:55:15.043261] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-19T17:55:15.540628] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T17:55:15.805005] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T17:55:15.843374] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-19T17:55:16.643271] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-19T17:55:17.314839] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T17:55:17.406432] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T17:55:17.443414] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-19T17:55:18.159986] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T17:55:18.243219] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-19T17:55:19.043268] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-19T17:55:19.401138] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-19T17:55:19.401859] [INFO ] [REMOTE ] CCZ: Full fetch complete (142 records). [2025-09-19T17:55:19.401960] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-19T17:55:19.402390] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:55:19.402474] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:55:19.402529] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:55:19.402608] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-19T17:55:19.402725] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-19T17:55:19.402804] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-19T17:55:19.402886] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-19T17:55:19.402992] [INFO ] [MAIN ] Update Progress: 420/2372 symbols completed. CCZ took 27.4s. Estimated remaining: 4h 16m 48s. Rate: 7.6 symbols/min [2025-09-19T17:55:19.590682] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:19.591969] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T17:55:19.654983] [DEBUG] [LOCAL ] CDP: Loaded 43105 existing records from primary storage. [2025-09-19T17:55:19.655138] [INFO ] [MAIN ] CDP: Loaded 43105 existing records. [2025-09-19T17:55:19.834295] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:19.834557] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-19T17:55:19.834604] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-19T17:55:19.835612] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-19T17:55:19.835716] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-19T17:55:19.848324] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-19T17:55:20.235044] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:20.643284] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-19T17:55:21.222976] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T17:55:21.443278] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-19T17:55:22.243264] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-19T17:55:22.605911] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-19T17:55:23.043289] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-19T17:55:23.110002] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T17:55:23.117727] [INFO ] [REMOTE ] CCS: Full fetch complete (44598 records). [2025-09-19T17:55:23.117908] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-19T17:55:23.365105] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T17:55:23.539935] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-19T17:55:23.540048] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-19T17:55:23.540755] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-19T17:55:23.540819] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-19T17:55:23.544593] [DEBUG] [LOCAL ] CCS: Trimmed 44598 records to 31164 (keeping 200 days of data) [2025-09-19T17:55:23.770711] [DEBUG] [LOCAL ] CCS: Primary data saved (31164 records). [2025-09-19T17:55:23.770881] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-19T17:55:23.771007] [INFO ] [MAIN ] Update Progress: 421/2372 symbols completed. CCS took 41.0s. Estimated remaining: 4h 16m 23s. Rate: 7.6 symbols/min [2025-09-19T17:55:23.848591] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-19T17:55:24.040097] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:24.079259] [DEBUG] [LOCAL ] CDRE: Loaded 25336 existing records from primary storage. [2025-09-19T17:55:24.079435] [INFO ] [MAIN ] CDRE: Loaded 25336 existing records. [2025-09-19T17:55:24.275158] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:24.275891] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-19T17:55:24.275946] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-19T17:55:24.277083] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-19T17:55:24.277146] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-19T17:55:24.646907] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-19T17:55:24.711266] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:24.738133] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T17:55:24.858427] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T17:55:25.443309] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-19T17:55:26.243304] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-19T17:55:26.369285] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T17:55:27.043270] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-19T17:55:27.342543] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T17:55:27.751525] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T17:55:27.843270] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-19T17:55:27.924205] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T17:55:28.421450] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T17:55:28.643308] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-19T17:55:29.443265] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-19T17:55:29.666247] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T17:55:29.668046] [INFO ] [REMOTE ] CDLR: Full fetch complete (13151 records). [2025-09-19T17:55:29.668120] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-19T17:55:30.060674] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-19T17:55:30.060809] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-19T17:55:30.061193] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-19T17:55:30.061237] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-19T17:55:30.062446] [DEBUG] [LOCAL ] CDLR: Trimmed 13151 records to 10376 (keeping 200 days of data) [2025-09-19T17:55:30.127571] [DEBUG] [LOCAL ] CDLR: Primary data saved (10376 records). [2025-09-19T17:55:30.127731] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-19T17:55:30.127819] [INFO ] [MAIN ] Update Progress: 422/2372 symbols completed. CDLR took 20.5s. Estimated remaining: 4h 16m 8s. Rate: 7.6 symbols/min [2025-09-19T17:55:30.248367] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-19T17:55:30.312287] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:30.380365] [DEBUG] [LOCAL ] CE: Loaded 51968 existing records from primary storage. [2025-09-19T17:55:30.380522] [INFO ] [MAIN ] CE: Loaded 51968 existing records. [2025-09-19T17:55:30.558737] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:30.559017] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-19T17:55:30.559065] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-19T17:55:30.561366] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-19T17:55:30.561426] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-19T17:55:30.925968] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:30.942710] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T17:55:31.043224] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-19T17:55:31.843327] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-19T17:55:32.381733] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-19T17:55:32.643288] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-19T17:55:33.159731] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T17:55:33.443308] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-19T17:55:33.668217] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T17:55:34.248426] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-19T17:55:34.268348] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T17:55:34.835696] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T17:55:35.043232] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-19T17:55:35.349540] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T17:55:35.843289] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-19T17:55:36.643279] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-19T17:55:37.001210] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T17:55:37.443326] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-19T17:55:37.719872] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:55:38.243301] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-19T17:55:38.502672] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T17:55:39.043314] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-19T17:55:39.554348] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T17:55:39.843284] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-19T17:55:40.170713] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T17:55:40.643261] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-19T17:55:40.720994] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T17:55:41.443272] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-19T17:55:41.925104] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T17:55:42.186418] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T17:55:42.243287] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-19T17:55:42.929916] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T17:55:43.043249] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-19T17:55:43.843303] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-19T17:55:44.010001] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T17:55:44.643297] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-19T17:55:45.154228] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T17:55:45.164435] [INFO ] [REMOTE ] CDE: Full fetch complete (77574 records). [2025-09-19T17:55:45.164819] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-19T17:55:45.454685] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-19T17:55:45.618061] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T17:55:45.618203] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-19T17:55:45.623667] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-19T17:55:45.625067] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-19T17:55:45.625492] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-19T17:55:45.627010] [DEBUG] [LOCAL ] CDE: Trimmed 77574 records to 54421 (keeping 200 days of data) [2025-09-19T17:55:45.969601] [DEBUG] [LOCAL ] CDE: Primary data saved (54421 records). [2025-09-19T17:55:45.969878] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-19T17:55:45.971707] [INFO ] [MAIN ] Update Progress: 423/2372 symbols completed. CDE took 42.3s. Estimated remaining: 4h 16m 37s. Rate: 7.6 symbols/min [2025-09-19T17:55:46.159569] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:46.169706] [DEBUG] [LOCAL ] CEE: Loaded 7051 existing records from primary storage. [2025-09-19T17:55:46.169844] [INFO ] [MAIN ] CEE: Loaded 7051 existing records. [2025-09-19T17:55:46.249135] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-19T17:55:46.361190] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:46.361535] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-19T17:55:46.361586] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-19T17:55:46.361958] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-19T17:55:46.362020] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-19T17:55:46.747284] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:46.780606] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T17:55:46.815434] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T17:55:47.043265] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-19T17:55:47.217173] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T17:55:47.830121] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T17:55:47.843225] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-19T17:55:48.347186] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T17:55:48.643270] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-19T17:55:49.443268] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-19T17:55:50.243272] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-19T17:55:50.486137] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T17:55:50.861494] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T17:55:51.043265] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-19T17:55:51.279241] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T17:55:51.843298] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-19T17:55:52.643237] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-19T17:55:52.699983] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T17:55:53.003728] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T17:55:53.443455] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-19T17:55:54.091019] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T17:55:54.106288] [INFO ] [REMOTE ] CDP: Full fetch complete (61839 records). [2025-09-19T17:55:54.106590] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-19T17:55:54.251108] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-19T17:55:54.495260] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T17:55:54.726842] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-19T17:55:54.726992] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-19T17:55:54.728205] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-19T17:55:54.728297] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-19T17:55:54.730216] [DEBUG] [LOCAL ] CDP: Trimmed 61839 records to 43402 (keeping 200 days of data) [2025-09-19T17:55:55.043388] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-19T17:55:55.072277] [DEBUG] [LOCAL ] CDP: Primary data saved (43402 records). [2025-09-19T17:55:55.072433] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-19T17:55:55.072555] [INFO ] [MAIN ] Update Progress: 424/2372 symbols completed. CDP took 35.7s. Estimated remaining: 4h 16m 35s. Rate: 7.6 symbols/min [2025-09-19T17:55:55.272932] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:55:55.299473] [DEBUG] [LOCAL ] CEPU: Loaded 25891 existing records from primary storage. [2025-09-19T17:55:55.299673] [INFO ] [MAIN ] CEPU: Loaded 25891 existing records. [2025-09-19T17:55:55.508524] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:55:55.508820] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-19T17:55:55.508885] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-19T17:55:55.509609] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-19T17:55:55.509732] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-19T17:55:55.847521] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-19T17:55:55.881522] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:55:55.887161] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T17:55:56.323700] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T17:55:56.643308] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-19T17:55:56.823826] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T17:55:57.079829] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-19T17:55:57.443300] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-19T17:55:58.243276] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-19T17:55:58.957818] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T17:55:59.043265] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-19T17:55:59.258154] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T17:55:59.843264] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-19T17:56:00.226570] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:56:00.431885] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T17:56:00.643293] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-19T17:56:01.443298] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-19T17:56:01.567866] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T17:56:02.243285] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-19T17:56:02.834116] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T17:56:03.043323] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-19T17:56:03.683594] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T17:56:03.843341] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-19T17:56:04.630347] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T17:56:04.631764] [INFO ] [REMOTE ] CEE: Full fetch complete (10200 records). [2025-09-19T17:56:04.631868] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-19T17:56:04.648395] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-19T17:56:05.062541] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-19T17:56:05.062682] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-19T17:56:05.063087] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-19T17:56:05.063190] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-19T17:56:05.064894] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:56:05.071706] [DEBUG] [LOCAL ] CEE: Trimmed 10200 records to 7099 (keeping 200 days of data) [2025-09-19T17:56:05.072755] [INFO ] [REMOTE ] CE: Full fetch complete (74887 records). [2025-09-19T17:56:05.072844] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-19T17:56:05.218393] [DEBUG] [LOCAL ] CEE: Primary data saved (7099 records). [2025-09-19T17:56:05.229376] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-19T17:56:05.234615] [INFO ] [MAIN ] Update Progress: 425/2372 symbols completed. CEE took 19.3s. Estimated remaining: 4h 16m 37s. Rate: 7.6 symbols/min [2025-09-19T17:56:05.443678] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-19T17:56:05.634850] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:05.739131] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-19T17:56:05.739215] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-19T17:56:05.740746] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-19T17:56:05.740811] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-19T17:56:05.742664] [DEBUG] [LOCAL ] CE: Trimmed 74887 records to 52344 (keeping 200 days of data) [2025-09-19T17:56:05.875605] [DEBUG] [LOCAL ] CF: Loaded 52631 existing records from primary storage. [2025-09-19T17:56:05.877042] [INFO ] [MAIN ] CF: Loaded 52631 existing records. [2025-09-19T17:56:06.079692] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:06.082365] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-19T17:56:06.082973] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-19T17:56:06.085106] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-19T17:56:06.085219] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-19T17:56:06.525981] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T17:56:06.601986] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:06.602686] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-19T17:56:06.617623] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T17:56:06.623213] [INFO ] [REMOTE ] CDRE: Full fetch complete (35647 records). [2025-09-19T17:56:06.624209] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-19T17:56:07.040520] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-19T17:56:07.040939] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-19T17:56:07.041873] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-19T17:56:07.042254] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-19T17:56:07.043537] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-19T17:56:07.047125] [DEBUG] [LOCAL ] CDRE: Trimmed 35647 records to 25538 (keeping 200 days of data) [2025-09-19T17:56:07.259523] [DEBUG] [LOCAL ] CE: Primary data saved (52344 records). [2025-09-19T17:56:07.260218] [INFO ] [MAIN ] CE: Full history saved. [2025-09-19T17:56:07.260620] [INFO ] [MAIN ] Update Progress: 426/2372 symbols completed. CE took 37.1s. Estimated remaining: 4h 16m 2s. Rate: 7.6 symbols/min [2025-09-19T17:56:07.472185] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:07.473236] [DEBUG] [LOCAL ] CFG: No existing data file found in primary storage. [2025-09-19T17:56:07.473304] [WARN ] [MAIN ] CFG: No existing data found, performing full refresh instead. [2025-09-19T17:56:07.473544] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-19T17:56:07.479028] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-19T17:56:07.480334] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-09-19T17:56:07.480474] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-19T17:56:07.480410] [DEBUG] [LOCAL ] CDRE: Primary data saved (25538 records). [2025-09-19T17:56:07.485734] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-19T17:56:07.529355] [INFO ] [MAIN ] Update Progress: 427/2372 symbols completed. CDRE took 43.8s. Estimated remaining: 4h 15m 20s. Rate: 7.6 symbols/min [2025-09-19T17:56:07.916043] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:07.945996] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-19T17:56:07.957600] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-19T17:56:07.981384] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-19T17:56:07.981502] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-19T17:56:07.992283] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-19T17:56:08.002831] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-19T17:56:08.117481] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:08.167408] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-19T17:56:08.281577] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T17:56:08.502791] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:08.535769] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T17:56:08.643258] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-19T17:56:08.850793] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:08.851198] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-19T17:56:09.443282] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-19T17:56:09.680876] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:09.681217] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-19T17:56:09.892153] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T17:56:10.243267] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-19T17:56:11.043264] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-19T17:56:11.344946] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T17:56:11.843272] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-19T17:56:12.073949] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:12.074318] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-19T17:56:12.643261] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-19T17:56:12.986337] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T17:56:13.409609] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T17:56:13.443242] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-19T17:56:14.243266] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-19T17:56:15.043272] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-19T17:56:15.620434] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:15.620789] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-19T17:56:15.646315] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T17:56:15.700518] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T17:56:15.843246] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-19T17:56:16.069939] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:16.070363] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-19T17:56:16.643273] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-19T17:56:17.443260] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-19T17:56:18.243262] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-19T17:56:18.628480] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:18.628851] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-19T17:56:18.679175] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T17:56:19.043259] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-19T17:56:19.348745] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T17:56:19.843256] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-19T17:56:20.643307] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-19T17:56:20.896534] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:20.896905] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-19T17:56:20.986244] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T17:56:21.443254] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-19T17:56:21.682973] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:56:21.683290] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-19T17:56:22.248516] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-19T17:56:22.280064] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T17:56:23.043274] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-19T17:56:23.792869] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T17:56:23.843314] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-19T17:56:23.989937] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T17:56:24.643291] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-19T17:56:25.419933] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T17:56:25.425724] [INFO ] [REMOTE ] CEPU: Full fetch complete (39666 records). [2025-09-19T17:56:25.426077] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-19T17:56:25.449188] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-19T17:56:25.616609] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T17:56:25.664509] [INFO ] [REMOTE ] CFND: Full fetch complete (2457 records). [2025-09-19T17:56:25.675407] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-19T17:56:26.042050] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-19T17:56:26.042270] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-19T17:56:26.043275] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-19T17:56:26.041763] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 31 unique days, need 200 days [2025-09-19T17:56:26.043545] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-19T17:56:26.043453] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:56:26.043962] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:56:26.044086] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-19T17:56:26.044514] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-19T17:56:26.044591] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-19T17:56:26.044768] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-19T17:56:26.044887] [INFO ] [MAIN ] Update Progress: 428/2372 symbols completed. CFND took 18.5s. Estimated remaining: 4h 16m 0s. Rate: 7.6 symbols/min [2025-09-19T17:56:26.142785] [DEBUG] [LOCAL ] CEPU: Trimmed 39666 records to 26208 (keeping 200 days of data) [2025-09-19T17:56:26.257754] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-19T17:56:26.338019] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:26.400703] [DEBUG] [LOCAL ] CFR: Loaded 33951 existing records from primary storage. [2025-09-19T17:56:26.401397] [INFO ] [MAIN ] CFR: Loaded 33951 existing records. [2025-09-19T17:56:26.629311] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:26.631857] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-19T17:56:26.633230] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-19T17:56:26.634891] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-19T17:56:26.635601] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-19T17:56:26.702817] [DEBUG] [LOCAL ] CEPU: Primary data saved (26208 records). [2025-09-19T17:56:26.714314] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-19T17:56:26.730286] [INFO ] [MAIN ] Update Progress: 429/2372 symbols completed. CEPU took 31.7s. Estimated remaining: 4h 15m 20s. Rate: 7.6 symbols/min [2025-09-19T17:56:27.109232] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:27.199340] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:27.200106] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-19T17:56:27.240845] [DEBUG] [LOCAL ] CGAU: Loaded 42806 existing records from primary storage. [2025-09-19T17:56:27.240995] [INFO ] [MAIN ] CGAU: Loaded 42806 existing records. [2025-09-19T17:56:27.477231] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:27.477700] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-19T17:56:27.477863] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-19T17:56:27.479016] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-19T17:56:27.479082] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-19T17:56:27.892346] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T17:56:27.890242] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:27.903204] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-19T17:56:28.020875] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:56:28.349223] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T17:56:28.643284] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-19T17:56:29.196462] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T17:56:29.443263] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-19T17:56:30.190820] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T17:56:30.243263] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-19T17:56:31.043269] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-19T17:56:31.100718] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T17:56:31.843281] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-19T17:56:31.925821] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T17:56:32.643280] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-19T17:56:32.981181] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T17:56:33.443251] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-19T17:56:33.550092] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T17:56:34.243260] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-19T17:56:34.656735] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T17:56:35.043266] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-19T17:56:35.623630] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:56:35.837999] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T17:56:35.850072] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-19T17:56:36.643270] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-19T17:56:37.108564] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T17:56:37.443258] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-19T17:56:37.643132] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T17:56:37.895084] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T17:56:38.243264] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-19T17:56:38.543007] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T17:56:39.043275] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-19T17:56:39.400115] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T17:56:39.843261] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-19T17:56:40.643236] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-19T17:56:41.192191] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T17:56:41.200558] [INFO ] [REMOTE ] CF: Full fetch complete (75115 records). [2025-09-19T17:56:41.200723] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-19T17:56:41.449119] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-19T17:56:41.615386] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-19T17:56:41.615477] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-19T17:56:41.616361] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-19T17:56:41.616448] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-19T17:56:41.618078] [DEBUG] [LOCAL ] CF: Trimmed 75115 records to 53014 (keeping 200 days of data) [2025-09-19T17:56:41.886453] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T17:56:41.987358] [DEBUG] [LOCAL ] CF: Primary data saved (53014 records). [2025-09-19T17:56:41.987496] [INFO ] [MAIN ] CF: Full history saved. [2025-09-19T17:56:41.987581] [INFO ] [MAIN ] Update Progress: 430/2372 symbols completed. CF took 36.7s. Estimated remaining: 4h 15m 45s. Rate: 7.6 symbols/min [2025-09-19T17:56:42.161221] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:42.164792] [DEBUG] [LOCAL ] CGV: Loaded 1446 existing records from primary storage. [2025-09-19T17:56:42.164866] [INFO ] [MAIN ] CGV: Loaded 1446 existing records. [2025-09-19T17:56:42.254171] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-19T17:56:42.343918] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:42.344206] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-19T17:56:42.344256] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-19T17:56:42.344462] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-19T17:56:42.344523] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-19T17:56:42.715746] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:42.745381] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T17:56:43.043300] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-19T17:56:43.253693] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T17:56:43.843255] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-19T17:56:44.393180] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T17:56:44.423001] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T17:56:44.421713] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-19T17:56:44.431002] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-19T17:56:44.649955] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-19T17:56:44.862351] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-19T17:56:44.862473] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-19T17:56:44.863402] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-19T17:56:44.863473] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-19T17:56:44.865160] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54404 (keeping 200 days of data) [2025-09-19T17:56:45.210062] [DEBUG] [LOCAL ] CFG: Primary data saved (54404 records). [2025-09-19T17:56:45.210250] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-19T17:56:45.210382] [INFO ] [MAIN ] Update Progress: 431/2372 symbols completed. CFG took 37.9s. Estimated remaining: 4h 15m 16s. Rate: 7.6 symbols/min [2025-09-19T17:56:45.403381] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:45.427524] [DEBUG] [LOCAL ] CHCT: Loaded 24304 existing records from primary storage. [2025-09-19T17:56:45.427709] [INFO ] [MAIN ] CHCT: Loaded 24304 existing records. [2025-09-19T17:56:45.458540] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-19T17:56:45.619331] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:45.619585] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-19T17:56:45.619661] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-19T17:56:45.620326] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-19T17:56:45.620390] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-19T17:56:46.005437] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:46.025966] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T17:56:46.110380] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T17:56:46.243309] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-19T17:56:46.512197] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T17:56:47.043338] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-19T17:56:47.258476] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T17:56:47.843275] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-19T17:56:48.467579] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T17:56:48.643312] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-19T17:56:49.443365] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-19T17:56:49.651598] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T17:56:49.755279] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T17:56:50.243332] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-19T17:56:50.261774] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T17:56:51.043309] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-19T17:56:51.843285] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-19T17:56:52.129266] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:56:52.246560] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T17:56:52.643275] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-19T17:56:52.689846] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T17:56:53.155674] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-19T17:56:53.443265] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-19T17:56:54.243273] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-19T17:56:54.798668] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T17:56:55.009998] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T17:56:55.017775] [INFO ] [REMOTE ] CGAU: Full fetch complete (60353 records). [2025-09-19T17:56:55.017963] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-19T17:56:55.050782] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-19T17:56:55.444905] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-19T17:56:55.445050] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-19T17:56:55.445834] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-19T17:56:55.445899] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-19T17:56:55.447271] [DEBUG] [LOCAL ] CGAU: Trimmed 60353 records to 43183 (keeping 200 days of data) [2025-09-19T17:56:55.703236] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-19T17:56:55.709530] [DEBUG] [LOCAL ] CGAU: Primary data saved (43183 records). [2025-09-19T17:56:55.709621] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-19T17:56:55.709753] [INFO ] [MAIN ] Update Progress: 432/2372 symbols completed. CGAU took 29.0s. Estimated remaining: 4h 15m 20s. Rate: 7.6 symbols/min [2025-09-19T17:56:55.848348] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-19T17:56:55.897548] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:56:55.955907] [DEBUG] [LOCAL ] CHD: Loaded 52379 existing records from primary storage. [2025-09-19T17:56:55.956068] [INFO ] [MAIN ] CHD: Loaded 52379 existing records. [2025-09-19T17:56:56.146911] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:56:56.147338] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-19T17:56:56.147397] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-19T17:56:56.149638] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-19T17:56:56.149754] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-19T17:56:56.427365] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T17:56:56.534417] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:56:56.643229] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-19T17:56:57.443264] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-19T17:56:58.243272] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-19T17:56:58.414290] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T17:56:58.533149] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-19T17:56:58.680297] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T17:56:59.043283] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-19T17:56:59.843263] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-19T17:57:00.643272] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-19T17:57:00.984014] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-19T17:57:01.060557] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T17:57:01.215771] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T17:57:01.443278] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-19T17:57:02.243276] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-19T17:57:03.043272] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-19T17:57:03.611778] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T17:57:03.843267] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-19T17:57:04.643283] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-19T17:57:04.872401] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T17:57:05.443236] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-19T17:57:05.496989] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (3.25 seconds). [2025-09-19T17:57:06.026678] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T17:57:06.027464] [INFO ] [REMOTE ] CGV: Full fetch complete (2263 records). [2025-09-19T17:57:06.027544] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-19T17:57:06.027938] [FATAL] [VALIDATOR ] CGV: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T17:57:06.028024] [FATAL] [MAIN ] CGV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:57:06.028069] [WARN ] [MAIN ] CGV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:57:06.028136] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-19T17:57:06.028226] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-19T17:57:06.028285] [INFO ] [LOCAL ] CGV: Starting deletion of derivative data. [2025-09-19T17:57:06.028737] [DEBUG] [LOCAL ] CGV: Deleted derivative data file. [2025-09-19T17:57:06.028832] [INFO ] [MAIN ] Update Progress: 433/2372 symbols completed. CGV took 24.0s. Estimated remaining: 4h 15m 23s. Rate: 7.6 symbols/min [2025-09-19T17:57:06.212242] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:06.230258] [DEBUG] [LOCAL ] CHE: Loaded 14730 existing records from primary storage. [2025-09-19T17:57:06.230405] [INFO ] [MAIN ] CHE: Loaded 14730 existing records. [2025-09-19T17:57:06.263079] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-19T17:57:06.446053] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:06.446386] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-19T17:57:06.446693] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-19T17:57:06.448315] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-19T17:57:06.456936] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-19T17:57:06.457042] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-19T17:57:06.720462] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T17:57:06.851280] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:07.043266] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-19T17:57:07.843273] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-19T17:57:08.113827] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T17:57:08.643264] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-19T17:57:08.873238] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T17:57:08.879349] [INFO ] [REMOTE ] CFR: Full fetch complete (48463 records). [2025-09-19T17:57:08.879489] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-19T17:57:09.257695] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T17:57:09.306914] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-19T17:57:09.306998] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-19T17:57:09.307615] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-19T17:57:09.307687] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-19T17:57:09.308721] [DEBUG] [LOCAL ] CFR: Trimmed 48463 records to 34170 (keeping 200 days of data) [2025-09-19T17:57:09.445039] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-19T17:57:09.537755] [DEBUG] [LOCAL ] CFR: Primary data saved (34170 records). [2025-09-19T17:57:09.537889] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-19T17:57:09.538028] [INFO ] [MAIN ] Update Progress: 434/2372 symbols completed. CFR took 43.5s. Estimated remaining: 4h 14m 55s. Rate: 7.6 symbols/min [2025-09-19T17:57:09.710477] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:09.761019] [DEBUG] [LOCAL ] CHGG: Loaded 48206 existing records from primary storage. [2025-09-19T17:57:09.761180] [INFO ] [MAIN ] CHGG: Loaded 48206 existing records. [2025-09-19T17:57:09.940519] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:09.940810] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-19T17:57:09.940866] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-19T17:57:09.941912] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-19T17:57:09.941975] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-19T17:57:10.248407] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-19T17:57:10.308105] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:10.548088] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T17:57:10.817400] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T17:57:10.957507] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T17:57:11.043232] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-19T17:57:11.843261] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-19T17:57:12.643243] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-19T17:57:12.676187] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T17:57:13.313193] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T17:57:13.316908] [INFO ] [REMOTE ] CHCT: Full fetch complete (35150 records). [2025-09-19T17:57:13.317023] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-19T17:57:13.446168] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-19T17:57:13.580335] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T17:57:13.737828] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-19T17:57:13.737938] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-19T17:57:13.738492] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-19T17:57:13.738544] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-19T17:57:13.740353] [DEBUG] [LOCAL ] CHCT: Trimmed 35150 records to 24496 (keeping 200 days of data) [2025-09-19T17:57:13.891443] [DEBUG] [LOCAL ] CHCT: Primary data saved (24496 records). [2025-09-19T17:57:13.891615] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-19T17:57:13.891768] [INFO ] [MAIN ] Update Progress: 435/2372 symbols completed. CHCT took 28.7s. Estimated remaining: 4h 14m 32s. Rate: 7.6 symbols/min [2025-09-19T17:57:14.075097] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:14.075273] [DEBUG] [LOCAL ] CHH: No existing data file found in primary storage. [2025-09-19T17:57:14.075311] [WARN ] [MAIN ] CHH: No existing data found, performing full refresh instead. [2025-09-19T17:57:14.075461] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-19T17:57:14.075504] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-19T17:57:14.075546] [DEBUG] [LOCAL ] CHH: No primary data file found to delete. [2025-09-19T17:57:14.075581] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-19T17:57:14.245208] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-19T17:57:14.466786] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:15.043241] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-19T17:57:15.140864] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T17:57:15.571291] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-19T17:57:15.843248] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-19T17:57:16.643264] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-19T17:57:17.443276] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-19T17:57:17.688207] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-19T17:57:17.992058] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T17:57:18.229619] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T17:57:18.243208] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-19T17:57:18.935844] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T17:57:19.043290] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-19T17:57:19.392732] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T17:57:19.843271] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-19T17:57:20.440605] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T17:57:20.643287] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-19T17:57:20.957226] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T17:57:21.443287] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-19T17:57:22.191322] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T17:57:22.243226] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-19T17:57:23.048753] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-19T17:57:23.063139] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T17:57:23.673417] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T17:57:23.843262] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-19T17:57:24.643244] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-19T17:57:24.677861] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T17:57:25.443254] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-19T17:57:25.558024] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:57:26.243380] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-19T17:57:26.577694] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T17:57:26.662424] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T17:57:26.670479] [INFO ] [REMOTE ] CHD: Full fetch complete (74348 records). [2025-09-19T17:57:26.670740] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-19T17:57:27.059384] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-19T17:57:27.128786] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-19T17:57:27.128985] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-19T17:57:27.131053] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-19T17:57:27.131185] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-19T17:57:27.133618] [DEBUG] [LOCAL ] CHD: Trimmed 74348 records to 52750 (keeping 200 days of data) [2025-09-19T17:57:27.479031] [DEBUG] [LOCAL ] CHD: Primary data saved (52750 records). [2025-09-19T17:57:27.479314] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-19T17:57:27.479510] [INFO ] [MAIN ] Update Progress: 436/2372 symbols completed. CHD took 31.8s. Estimated remaining: 4h 14m 49s. Rate: 7.6 symbols/min [2025-09-19T17:57:27.620543] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T17:57:27.695201] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:27.720508] [DEBUG] [LOCAL ] CHMI: Loaded 22199 existing records from primary storage. [2025-09-19T17:57:27.720679] [INFO ] [MAIN ] CHMI: Loaded 22199 existing records. [2025-09-19T17:57:27.848391] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-19T17:57:27.919377] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:27.919708] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-19T17:57:27.919776] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-19T17:57:27.920374] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-19T17:57:27.920474] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-19T17:57:28.306593] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:28.643326] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-19T17:57:28.706603] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T17:57:29.070158] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T17:57:29.443287] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-19T17:57:29.523387] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T17:57:30.243293] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-19T17:57:31.043278] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-19T17:57:31.177325] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T17:57:31.533735] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T17:57:31.843255] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-19T17:57:32.237515] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T17:57:32.643285] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-19T17:57:32.806800] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T17:57:33.443300] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-19T17:57:34.243450] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-19T17:57:34.275199] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T17:57:35.001359] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T17:57:35.043229] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-19T17:57:35.593624] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T17:57:35.843255] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-19T17:57:36.643230] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-19T17:57:36.802914] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T17:57:37.231709] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T17:57:37.443314] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-19T17:57:37.538261] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T17:57:38.243301] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-19T17:57:38.622281] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T17:57:39.043276] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-19T17:57:39.588431] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T17:57:39.843281] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-19T17:57:40.428759] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T17:57:40.434320] [INFO ] [REMOTE ] CHE: Full fetch complete (19418 records). [2025-09-19T17:57:40.434545] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-19T17:57:40.648555] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-19T17:57:40.921956] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-19T17:57:40.922133] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-19T17:57:40.922660] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-19T17:57:40.922729] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-19T17:57:40.923427] [DEBUG] [LOCAL ] CHE: Trimmed 19418 records to 14825 (keeping 200 days of data) [2025-09-19T17:57:41.025354] [DEBUG] [LOCAL ] CHE: Primary data saved (14825 records). [2025-09-19T17:57:41.025513] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-19T17:57:41.025631] [INFO ] [MAIN ] Update Progress: 437/2372 symbols completed. CHE took 35.0s. Estimated remaining: 4h 15m 6s. Rate: 7.6 symbols/min [2025-09-19T17:57:41.432844] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T17:57:41.443207] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-19T17:57:42.081264] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T17:57:42.243265] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-19T17:57:42.920872] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T17:57:42.928073] [INFO ] [REMOTE ] CHH: Full fetch complete (46101 records). [2025-09-19T17:57:42.928258] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-19T17:57:43.048365] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-19T17:57:43.324601] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-19T17:57:43.324731] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-19T17:57:43.325408] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-19T17:57:43.325452] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-19T17:57:43.326717] [DEBUG] [LOCAL ] CHH: Trimmed 46101 records to 32806 (keeping 200 days of data) [2025-09-19T17:57:43.553829] [DEBUG] [LOCAL ] CHH: Primary data saved (32806 records). [2025-09-19T17:57:43.554372] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-19T17:57:43.554583] [INFO ] [MAIN ] Update Progress: 438/2372 symbols completed. CHH took 29.7s. Estimated remaining: 4h 14m 35s. Rate: 7.6 symbols/min [2025-09-19T17:57:44.416798] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T17:57:44.428277] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-19T17:57:44.491695] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T17:57:44.643337] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-19T17:57:45.938380] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T17:57:45.943112] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-19T17:57:46.583047] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:57:46.594674] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-19T17:57:47.428217] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T17:57:47.432140] [INFO ] [REMOTE ] CHMI: Full fetch complete (31604 records). [2025-09-19T17:57:47.432285] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-19T17:57:47.825714] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-19T17:57:47.825846] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-19T17:57:47.826331] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-19T17:57:47.826373] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-19T17:57:47.827383] [DEBUG] [LOCAL ] CHMI: Trimmed 31604 records to 22354 (keeping 200 days of data) [2025-09-19T17:57:47.961185] [DEBUG] [LOCAL ] CHMI: Primary data saved (22354 records). [2025-09-19T17:57:47.961321] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-19T17:57:47.961423] [INFO ] [MAIN ] Update Progress: 439/2372 symbols completed. CHMI took 20.5s. Estimated remaining: 4h 14m 11s. Rate: 7.6 symbols/min [2025-09-19T17:57:48.276021] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T17:57:48.283761] [INFO ] [REMOTE ] CHGG: Full fetch complete (70726 records). [2025-09-19T17:57:48.283924] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-19T17:57:48.715533] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-19T17:57:48.715883] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-19T17:57:48.716737] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-19T17:57:48.716804] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-19T17:57:48.719827] [DEBUG] [LOCAL ] CHGG: Trimmed 70726 records to 48526 (keeping 200 days of data) [2025-09-19T17:57:49.017293] [DEBUG] [LOCAL ] CHGG: Primary data saved (48526 records). [2025-09-19T17:57:49.017541] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-19T17:57:49.017635] [INFO ] [MAIN ] Update Progress: 440/2372 symbols completed. CHGG took 39.5s. Estimated remaining: 4h 13m 33s. Rate: 7.6 symbols/min [2025-09-19T17:57:49.730247] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:49.723444] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:49.830602] [DEBUG] [LOCAL ] CHWY: No existing data file found in primary storage. [2025-09-19T17:57:49.830294] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:49.828087] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:57:49.831553] [WARN ] [MAIN ] CHWY: No existing data found, performing full refresh instead. [2025-09-19T17:57:49.833634] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-19T17:57:49.833898] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-19T17:57:49.833975] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-09-19T17:57:49.834019] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-19T17:57:49.932847] [DEBUG] [LOCAL ] CHN: Loaded 4842 existing records from primary storage. [2025-09-19T17:57:49.949749] [INFO ] [MAIN ] CHN: Loaded 4842 existing records. [2025-09-19T17:57:49.988816] [DEBUG] [LOCAL ] CHT: Loaded 19893 existing records from primary storage. [2025-09-19T17:57:50.006789] [INFO ] [MAIN ] CHT: Loaded 19893 existing records. [2025-09-19T17:57:50.409211] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:50.514544] [DEBUG] [LOCAL ] CHPT: Loaded 50058 existing records from primary storage. [2025-09-19T17:57:50.499794] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-19T17:57:50.558489] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-19T17:57:50.558602] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:50.579532] [INFO ] [MAIN ] CHPT: Loaded 50058 existing records. [2025-09-19T17:57:50.579819] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-19T17:57:50.620668] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-19T17:57:50.591280] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-19T17:57:50.667378] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-19T17:57:50.733904] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-19T17:57:50.787709] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-19T17:57:50.777870] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:50.825291] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-19T17:57:51.197293] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:57:51.314568] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-19T17:57:51.364359] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-19T17:57:51.446922] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-19T17:57:51.515974] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-19T17:57:51.649981] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:51.665248] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-19T17:57:51.777488] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:51.783576] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-19T17:57:52.036980] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:57:52.037347] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-19T17:57:52.763069] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T17:57:52.767331] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-19T17:57:52.826046] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T17:57:52.827992] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-19T17:57:53.256036] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-19T17:57:53.267390] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-19T17:57:53.503974] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T17:57:53.507929] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-19T17:57:53.613321] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T17:57:53.616264] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-19T17:57:54.216114] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T17:57:54.243365] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-19T17:57:54.615337] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-19T17:57:54.928326] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T17:57:54.999424] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T17:57:55.043224] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-19T17:57:55.132589] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T17:57:55.843251] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-19T17:57:56.602485] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T17:57:56.614921] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T17:57:56.643272] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-19T17:57:57.102444] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-19T17:57:57.443289] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-19T17:57:58.243278] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-19T17:57:58.914537] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T17:57:59.043232] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-19T17:57:59.620005] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T17:57:59.843264] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-19T17:58:00.637305] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T17:58:00.648477] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-19T17:58:01.308966] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T17:58:01.443282] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-19T17:58:02.185072] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T17:58:02.243330] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-19T17:58:03.043291] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-19T17:58:03.518671] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-19T17:58:03.542221] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T17:58:03.666690] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T17:58:03.843262] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-19T17:58:04.614737] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T17:58:04.643253] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-19T17:58:05.443260] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-19T17:58:05.571303] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T17:58:06.243260] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-19T17:58:07.043231] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-19T17:58:07.479004] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T17:58:07.691740] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T17:58:07.843255] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-19T17:58:07.921621] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T17:58:07.923115] [INFO ] [REMOTE ] CHN: Full fetch complete (7588 records). [2025-09-19T17:58:07.923185] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-19T17:58:08.281262] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-19T17:58:08.281346] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-19T17:58:08.281539] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-19T17:58:08.281586] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-19T17:58:08.282048] [DEBUG] [LOCAL ] CHN: Trimmed 7588 records to 4871 (keeping 200 days of data) [2025-09-19T17:58:08.311748] [DEBUG] [LOCAL ] CHN: Primary data saved (4871 records). [2025-09-19T17:58:08.311819] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-19T17:58:08.311896] [INFO ] [MAIN ] Update Progress: 441/2372 symbols completed. CHN took 19.3s. Estimated remaining: 4h 14m 16s. Rate: 7.6 symbols/min [2025-09-19T17:58:08.479305] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:08.539268] [DEBUG] [LOCAL ] CI: Loaded 50340 existing records from primary storage. [2025-09-19T17:58:08.539405] [INFO ] [MAIN ] CI: Loaded 50340 existing records. [2025-09-19T17:58:08.648453] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-19T17:58:08.725811] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:08.726022] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-19T17:58:08.726084] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-19T17:58:08.727634] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-19T17:58:08.727718] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-19T17:58:09.087959] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T17:58:09.091888] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:09.095420] [INFO ] [REMOTE ] CHT: Full fetch complete (27412 records). [2025-09-19T17:58:09.095518] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-19T17:58:09.453064] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-19T17:58:09.482781] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-19T17:58:09.482862] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-19T17:58:09.483289] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-19T17:58:09.483435] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-19T17:58:09.484214] [DEBUG] [LOCAL ] CHT: Trimmed 27412 records to 19987 (keeping 200 days of data) [2025-09-19T17:58:09.607849] [DEBUG] [LOCAL ] CHT: Primary data saved (19987 records). [2025-09-19T17:58:09.608002] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-19T17:58:09.608093] [INFO ] [MAIN ] Update Progress: 442/2372 symbols completed. CHT took 20.6s. Estimated remaining: 4h 13m 39s. Rate: 7.6 symbols/min [2025-09-19T17:58:09.803159] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:09.803346] [DEBUG] [LOCAL ] CIA: No existing data file found in primary storage. [2025-09-19T17:58:09.803405] [WARN ] [MAIN ] CIA: No existing data found, performing full refresh instead. [2025-09-19T17:58:09.803549] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-19T17:58:09.803596] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-19T17:58:09.803639] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-09-19T17:58:09.803719] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-19T17:58:10.207632] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:10.243223] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-19T17:58:11.043260] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-19T17:58:11.371613] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T17:58:11.405482] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-19T17:58:11.848310] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-19T17:58:11.866819] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-19T17:58:12.643252] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-19T17:58:13.253364] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T17:58:13.443277] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-19T17:58:14.243323] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-19T17:58:14.344431] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T17:58:14.388367] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-19T17:58:14.888960] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T17:58:14.926004] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T17:58:15.043261] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-19T17:58:15.843271] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-19T17:58:16.160776] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T17:58:16.643262] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-19T17:58:17.443267] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-19T17:58:18.236539] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-19T17:58:18.252721] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-19T17:58:18.618866] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:58:19.043279] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-19T17:58:19.435553] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T17:58:19.843287] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-19T17:58:19.904383] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-19T17:58:20.657861] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-19T17:58:20.679286] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T17:58:21.443254] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-19T17:58:21.993059] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:58:22.243291] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-19T17:58:23.043246] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-19T17:58:23.126312] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T17:58:23.843334] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-19T17:58:24.171998] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T17:58:24.181002] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-19T17:58:24.181179] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-19T17:58:24.616752] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-19T17:58:24.616581] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T17:58:24.617143] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-19T17:58:24.622829] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-19T17:58:24.623473] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-19T17:58:24.653940] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-19T17:58:24.657491] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (4.00 seconds). [2025-09-19T17:58:24.662081] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 54405 (keeping 200 days of data) [2025-09-19T17:58:25.002585] [DEBUG] [LOCAL ] CHWY: Primary data saved (54405 records). [2025-09-19T17:58:25.002790] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-19T17:58:25.002879] [INFO ] [MAIN ] Update Progress: 443/2372 symbols completed. CHWY took 36.0s. Estimated remaining: 4h 14m 4s. Rate: 7.6 symbols/min [2025-09-19T17:58:25.174786] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:25.212556] [DEBUG] [LOCAL ] CIB: Loaded 31402 existing records from primary storage. [2025-09-19T17:58:25.212760] [INFO ] [MAIN ] CIB: Loaded 31402 existing records. [2025-09-19T17:58:25.395930] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:25.396189] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-19T17:58:25.396248] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-19T17:58:25.397239] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-19T17:58:25.397300] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-19T17:58:25.460766] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-19T17:58:25.774521] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:25.784830] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T17:58:25.821391] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T17:58:26.243282] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-19T17:58:27.043276] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-19T17:58:27.677864] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T17:58:27.843261] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-19T17:58:27.988708] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T17:58:28.355670] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-19T17:58:28.643311] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-19T17:58:29.352233] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T17:58:29.443258] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-19T17:58:30.243291] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-19T17:58:31.043387] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-19T17:58:31.101338] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-19T17:58:31.127180] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T17:58:31.147615] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T17:58:31.843281] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-19T17:58:32.643385] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-19T17:58:32.748724] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T17:58:33.443333] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-19T17:58:33.503300] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T17:58:33.862130] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T17:58:34.243265] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-19T17:58:35.043297] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-19T17:58:35.329366] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T17:58:35.417364] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T17:58:35.845583] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-19T17:58:35.848803] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T17:58:35.851947] [INFO ] [REMOTE ] CIA: Full fetch complete (23172 records). [2025-09-19T17:58:35.852099] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-19T17:58:36.230203] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-19T17:58:36.230303] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-19T17:58:36.230713] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-19T17:58:36.230776] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-19T17:58:36.231520] [DEBUG] [LOCAL ] CIA: Trimmed 23172 records to 17081 (keeping 200 days of data) [2025-09-19T17:58:36.330516] [DEBUG] [LOCAL ] CIA: Primary data saved (17081 records). [2025-09-19T17:58:36.330715] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-19T17:58:36.330818] [INFO ] [MAIN ] Update Progress: 444/2372 symbols completed. CIA took 26.7s. Estimated remaining: 4h 14m 11s. Rate: 7.6 symbols/min [2025-09-19T17:58:36.507311] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:36.507510] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-19T17:58:36.507550] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-19T17:58:36.507738] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-19T17:58:36.507801] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-19T17:58:36.507859] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-19T17:58:36.507962] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-19T17:58:36.657409] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-19T17:58:36.884751] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:37.443237] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-19T17:58:38.021740] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T17:58:38.108461] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T17:58:38.243223] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-19T17:58:38.950017] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T17:58:38.960349] [INFO ] [REMOTE ] CHPT: Full fetch complete (73658 records). [2025-09-19T17:58:38.960511] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-19T17:58:39.048391] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-19T17:58:39.380340] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-19T17:58:39.380451] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-19T17:58:39.381395] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-19T17:58:39.381538] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-19T17:58:39.404741] [DEBUG] [LOCAL ] CHPT: Trimmed 73658 records to 50321 (keeping 200 days of data) [2025-09-19T17:58:39.405971] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T17:58:39.535726] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T17:58:39.717969] [DEBUG] [LOCAL ] CHPT: Primary data saved (50321 records). [2025-09-19T17:58:39.718123] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-19T17:58:39.718225] [INFO ] [MAIN ] Update Progress: 445/2372 symbols completed. CHPT took 50.7s. Estimated remaining: 4h 13m 43s. Rate: 7.6 symbols/min [2025-09-19T17:58:39.848375] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-19T17:58:39.904203] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:39.958206] [DEBUG] [LOCAL ] CIEN: Loaded 52491 existing records from primary storage. [2025-09-19T17:58:39.958354] [INFO ] [MAIN ] CIEN: Loaded 52491 existing records. [2025-09-19T17:58:40.143630] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:40.144013] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-19T17:58:40.144071] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-19T17:58:40.145556] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-19T17:58:40.145617] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-19T17:58:40.537953] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:40.643270] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-19T17:58:40.804734] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T17:58:41.443308] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-19T17:58:41.983471] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T17:58:42.173084] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T17:58:42.243264] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-19T17:58:43.043275] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-19T17:58:43.843303] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-19T17:58:43.977851] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T17:58:44.643462] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-19T17:58:45.189337] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T17:58:45.204203] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T17:58:45.443252] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-19T17:58:46.112028] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-19T17:58:46.243303] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-19T17:58:46.900757] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T17:58:46.905974] [INFO ] [REMOTE ] CIB: Full fetch complete (44199 records). [2025-09-19T17:58:46.906113] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-19T17:58:47.052147] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-19T17:58:47.310291] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-19T17:58:47.310377] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-19T17:58:47.311019] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-19T17:58:47.311087] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-19T17:58:47.312258] [DEBUG] [LOCAL ] CIB: Trimmed 44199 records to 31593 (keeping 200 days of data) [2025-09-19T17:58:47.512198] [DEBUG] [LOCAL ] CIB: Primary data saved (31593 records). [2025-09-19T17:58:47.512368] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-19T17:58:47.512473] [INFO ] [MAIN ] Update Progress: 446/2372 symbols completed. CIB took 22.5s. Estimated remaining: 4h 13m 35s. Rate: 7.6 symbols/min [2025-09-19T17:58:47.695441] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:47.702521] [DEBUG] [LOCAL ] CIF: Loaded 4548 existing records from primary storage. [2025-09-19T17:58:47.702630] [INFO ] [MAIN ] CIF: Loaded 4548 existing records. [2025-09-19T17:58:47.856946] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-19T17:58:47.899511] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:47.900834] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-19T17:58:47.900949] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-19T17:58:47.901361] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-19T17:58:47.901451] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-19T17:58:48.226614] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T17:58:48.333823] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:48.463728] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-19T17:58:48.643233] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-19T17:58:49.097537] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T17:58:49.105090] [INFO ] [REMOTE ] CI: Full fetch complete (72516 records). [2025-09-19T17:58:49.105230] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-19T17:58:49.448330] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-19T17:58:49.529028] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-19T17:58:49.529119] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-19T17:58:49.529973] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-19T17:58:49.530042] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-19T17:58:49.531538] [DEBUG] [LOCAL ] CI: Trimmed 72516 records to 50689 (keeping 200 days of data) [2025-09-19T17:58:49.861708] [DEBUG] [LOCAL ] CI: Primary data saved (50689 records). [2025-09-19T17:58:49.861892] [INFO ] [MAIN ] CI: Full history saved. [2025-09-19T17:58:49.862945] [INFO ] [MAIN ] Update Progress: 447/2372 symbols completed. CI took 41.6s. Estimated remaining: 4h 13m 3s. Rate: 7.6 symbols/min [2025-09-19T17:58:50.056048] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:58:50.133271] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T17:58:50.131790] [DEBUG] [LOCAL ] CIG: Loaded 44042 existing records from primary storage. [2025-09-19T17:58:50.144032] [INFO ] [MAIN ] CIG: Loaded 44042 existing records. [2025-09-19T17:58:50.246358] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-19T17:58:50.336746] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:58:50.337001] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-19T17:58:50.337050] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-19T17:58:50.338298] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-19T17:58:50.338361] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-19T17:58:50.455206] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T17:58:50.717501] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:58:50.748364] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T17:58:51.043306] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-19T17:58:51.843266] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-19T17:58:52.596323] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T17:58:52.643235] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-19T17:58:53.101444] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T17:58:53.159450] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-19T17:58:53.443280] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-19T17:58:53.854476] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-19T17:58:54.243287] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-19T17:58:55.043267] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-19T17:58:55.843284] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-19T17:58:56.163727] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T17:58:56.338926] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-19T17:58:56.643313] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-19T17:58:56.794450] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T17:58:57.443278] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-19T17:58:57.456828] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T17:58:58.243278] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-19T17:58:59.043275] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-19T17:58:59.074162] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T17:58:59.086117] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T17:58:59.843266] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-19T17:59:00.427275] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T17:59:00.643305] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-19T17:59:01.443264] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-19T17:59:01.557890] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T17:59:02.155058] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T17:59:02.243319] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-19T17:59:02.786745] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T17:59:03.043344] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-19T17:59:03.731870] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T17:59:03.843272] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-19T17:59:04.075594] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T17:59:04.299025] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-19T17:59:04.643264] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-19T17:59:05.154521] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T17:59:05.443235] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-19T17:59:05.733531] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-19T17:59:06.243267] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-19T17:59:07.043280] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-19T17:59:07.842772] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T17:59:07.846563] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-19T17:59:08.308190] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-19T17:59:08.643261] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-19T17:59:08.851566] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T17:59:09.120305] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T17:59:09.121108] [INFO ] [REMOTE ] CICB: Full fetch complete (2157 records). [2025-09-19T17:59:09.121178] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-19T17:59:09.298859] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-19T17:59:09.299047] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:59:09.299114] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:59:09.299153] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-19T17:59:09.299209] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-19T17:59:09.299244] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-19T17:59:09.299297] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-19T17:59:09.299376] [INFO ] [MAIN ] Update Progress: 448/2372 symbols completed. CICB took 33.0s. Estimated remaining: 4h 13m 45s. Rate: 7.6 symbols/min [2025-09-19T17:59:09.467629] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:09.464430] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-19T17:59:09.486797] [DEBUG] [LOCAL ] CII: Loaded 15979 existing records from primary storage. [2025-09-19T17:59:09.486919] [INFO ] [MAIN ] CII: Loaded 15979 existing records. [2025-09-19T17:59:09.669108] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:09.669367] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-19T17:59:09.669417] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-19T17:59:09.670168] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-19T17:59:09.670229] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-19T17:59:10.025440] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:10.072690] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T17:59:10.073927] [INFO ] [REMOTE ] CIF: Full fetch complete (6587 records). [2025-09-19T17:59:10.073999] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-19T17:59:10.248724] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-19T17:59:10.435149] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-19T17:59:10.435232] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-19T17:59:10.435409] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-19T17:59:10.435448] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-19T17:59:10.435872] [DEBUG] [LOCAL ] CIF: Trimmed 6587 records to 4566 (keeping 200 days of data) [2025-09-19T17:59:10.462832] [DEBUG] [LOCAL ] CIF: Primary data saved (4566 records). [2025-09-19T17:59:10.462906] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-19T17:59:10.462991] [INFO ] [MAIN ] Update Progress: 449/2372 symbols completed. CIF took 23.0s. Estimated remaining: 4h 13m 8s. Rate: 7.6 symbols/min [2025-09-19T17:59:10.628637] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:10.667557] [DEBUG] [LOCAL ] CIM: Loaded 37425 existing records from primary storage. [2025-09-19T17:59:10.667727] [INFO ] [MAIN ] CIM: Loaded 37425 existing records. [2025-09-19T17:59:10.848470] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:10.848762] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-19T17:59:10.848826] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-19T17:59:10.850025] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-19T17:59:10.850106] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-19T17:59:11.049579] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-19T17:59:11.214080] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:11.642595] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T17:59:11.843255] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-19T17:59:12.441088] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T17:59:12.643257] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-19T17:59:13.261529] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:59:13.443266] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-19T17:59:13.850484] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T17:59:14.243262] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-19T17:59:14.622853] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T17:59:15.043265] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-19T17:59:15.843308] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-19T17:59:16.265062] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T17:59:16.459814] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T17:59:16.468291] [INFO ] [REMOTE ] CIEN: Full fetch complete (75512 records). [2025-09-19T17:59:16.468413] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-19T17:59:16.648453] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-19T17:59:16.866764] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-19T17:59:16.866843] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-19T17:59:16.867659] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-19T17:59:16.867735] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-19T17:59:16.869328] [DEBUG] [LOCAL ] CIEN: Trimmed 75512 records to 52866 (keeping 200 days of data) [2025-09-19T17:59:17.181146] [DEBUG] [LOCAL ] CIEN: Primary data saved (52866 records). [2025-09-19T17:59:17.181281] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-19T17:59:17.181362] [INFO ] [MAIN ] Update Progress: 450/2372 symbols completed. CIEN took 37.5s. Estimated remaining: 4h 12m 55s. Rate: 7.6 symbols/min [2025-09-19T17:59:17.365608] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:17.404139] [DEBUG] [LOCAL ] CIMN: Loaded 2676 existing records from primary storage. [2025-09-19T17:59:17.403947] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T17:59:17.404285] [INFO ] [MAIN ] CIMN: Loaded 2676 existing records. [2025-09-19T17:59:17.450900] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-19T17:59:17.598023] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:17.598259] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-19T17:59:17.598309] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-19T17:59:17.598596] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-19T17:59:17.598682] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-19T17:59:17.947211] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:18.243268] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-19T17:59:18.285861] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T17:59:18.467761] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T17:59:19.043266] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-19T17:59:19.843380] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-19T17:59:20.185499] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T17:59:20.339583] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-19T17:59:20.368290] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T17:59:20.643402] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-19T17:59:21.319939] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T17:59:21.443279] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-19T17:59:22.243330] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-19T17:59:23.043294] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-19T17:59:23.407361] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T17:59:23.843307] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-19T17:59:24.007941] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T17:59:24.643282] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-19T17:59:24.680836] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T17:59:24.796769] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T17:59:25.204705] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-19T17:59:25.443295] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-19T17:59:26.243298] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-19T17:59:26.514103] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T17:59:27.043265] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-19T17:59:27.843343] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-19T17:59:28.048136] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T17:59:28.058496] [INFO ] [REMOTE ] CIG: Full fetch complete (60811 records). [2025-09-19T17:59:28.058775] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-19T17:59:28.435232] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-19T17:59:28.458210] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-19T17:59:28.458283] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-19T17:59:28.459021] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-19T17:59:28.459107] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-19T17:59:28.462958] [DEBUG] [LOCAL ] CIG: Trimmed 60811 records to 44306 (keeping 200 days of data) [2025-09-19T17:59:28.648169] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-19T17:59:28.732826] [DEBUG] [LOCAL ] CIG: Primary data saved (44306 records). [2025-09-19T17:59:28.732959] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-19T17:59:28.733999] [INFO ] [MAIN ] Update Progress: 451/2372 symbols completed. CIG took 38.9s. Estimated remaining: 4h 13m 3s. Rate: 7.6 symbols/min [2025-09-19T17:59:28.913138] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:28.913349] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-19T17:59:28.913404] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-19T17:59:28.913555] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-19T17:59:28.913598] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-19T17:59:28.913639] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-19T17:59:28.913733] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-19T17:59:29.315835] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:29.338377] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T17:59:29.443247] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-19T17:59:29.785767] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T17:59:30.243243] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-19T17:59:30.553345] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T17:59:30.914020] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T17:59:31.043312] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-19T17:59:31.843286] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-19T17:59:32.173071] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T17:59:32.176069] [INFO ] [REMOTE ] CII: Full fetch complete (23126 records). [2025-09-19T17:59:32.176180] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-19T17:59:32.548861] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-19T17:59:32.548946] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-19T17:59:32.549464] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-19T17:59:32.549526] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-19T17:59:32.550259] [DEBUG] [LOCAL ] CII: Trimmed 23126 records to 16086 (keeping 200 days of data) [2025-09-19T17:59:32.648767] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-19T17:59:32.664492] [DEBUG] [LOCAL ] CII: Primary data saved (16086 records). [2025-09-19T17:59:32.664634] [INFO ] [MAIN ] CII: Full history saved. [2025-09-19T17:59:32.664849] [INFO ] [MAIN ] Update Progress: 452/2372 symbols completed. CII took 23.4s. Estimated remaining: 4h 12m 38s. Rate: 7.6 symbols/min [2025-09-19T17:59:32.842575] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:32.842800] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-19T17:59:32.842855] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-19T17:59:32.843081] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-19T17:59:32.843139] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-19T17:59:32.843187] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-19T17:59:32.843218] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-19T17:59:33.291028] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:33.295338] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T17:59:33.319363] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T17:59:33.443245] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-19T17:59:34.243285] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-19T17:59:34.476086] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:34.476451] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-19T17:59:34.789604] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T17:59:35.043280] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-19T17:59:35.843274] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-19T17:59:36.643249] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-19T17:59:36.738448] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T17:59:37.001924] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T17:59:37.187392] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T17:59:37.443259] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-19T17:59:38.010269] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T17:59:38.243271] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-19T17:59:39.043280] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-19T17:59:39.108535] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-19T17:59:39.821780] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T17:59:39.843236] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-19T17:59:40.385225] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T17:59:40.643295] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-19T17:59:40.964246] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-19T17:59:41.443314] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-19T17:59:41.681331] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:41.681636] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-19T17:59:42.243284] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-19T17:59:42.877552] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T17:59:43.043275] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-19T17:59:43.450692] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T17:59:43.843261] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-19T17:59:44.643264] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-19T17:59:44.875693] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:44.876011] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-19T17:59:45.443310] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-19T17:59:45.519260] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T17:59:45.525115] [INFO ] [REMOTE ] CIM: Full fetch complete (54421 records). [2025-09-19T17:59:45.525249] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-19T17:59:45.840882] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-19T17:59:45.939530] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-19T17:59:45.939671] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-19T17:59:45.940341] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-19T17:59:45.940388] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-19T17:59:45.942979] [DEBUG] [LOCAL ] CIM: Trimmed 54421 records to 37728 (keeping 200 days of data) [2025-09-19T17:59:46.212253] [DEBUG] [LOCAL ] CIM: Primary data saved (37728 records). [2025-09-19T17:59:46.212420] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-19T17:59:46.212526] [INFO ] [MAIN ] Update Progress: 453/2372 symbols completed. CIM took 35.7s. Estimated remaining: 4h 12m 54s. Rate: 7.6 symbols/min [2025-09-19T17:59:46.248597] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-19T17:59:46.483745] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:46.515819] [DEBUG] [LOCAL ] CINT: Loaded 18294 existing records from primary storage. [2025-09-19T17:59:46.516019] [INFO ] [MAIN ] CINT: Loaded 18294 existing records. [2025-09-19T17:59:46.819620] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:46.819995] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-19T17:59:46.820068] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-19T17:59:46.820775] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-19T17:59:46.820854] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-19T17:59:47.049373] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-19T17:59:47.154329] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T17:59:47.322246] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:47.843269] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-19T17:59:47.851774] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-19T17:59:48.643279] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-19T17:59:48.666359] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-19T17:59:48.667820] [INFO ] [REMOTE ] CIMO: Full fetch complete (5480 records). [2025-09-19T17:59:48.667891] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-19T17:59:48.855242] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T17:59:48.855501] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T17:59:48.855549] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T17:59:48.855739] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-19T17:59:48.855827] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-19T17:59:48.855884] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-19T17:59:48.855942] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-19T17:59:48.856026] [INFO ] [MAIN ] Update Progress: 454/2372 symbols completed. CIMO took 20.1s. Estimated remaining: 4h 12m 24s. Rate: 7.6 symbols/min [2025-09-19T17:59:49.028193] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:49.028407] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-09-19T17:59:49.028463] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-09-19T17:59:49.028612] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-19T17:59:49.028681] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-19T17:59:49.028743] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-09-19T17:59:49.028785] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-19T17:59:49.421631] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:49.443239] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-19T17:59:49.536618] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T17:59:49.537520] [INFO ] [REMOTE ] CIMN: Full fetch complete (3902 records). [2025-09-19T17:59:49.537592] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-19T17:59:49.889216] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-19T17:59:49.889292] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-19T17:59:49.889413] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-19T17:59:49.889449] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-19T17:59:49.889833] [DEBUG] [LOCAL ] CIMN: Trimmed 3902 records to 2690 (keeping 200 days of data) [2025-09-19T17:59:49.907542] [DEBUG] [LOCAL ] CIMN: Primary data saved (2690 records). [2025-09-19T17:59:49.907608] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-19T17:59:49.907712] [INFO ] [MAIN ] Update Progress: 455/2372 symbols completed. CIMN took 32.7s. Estimated remaining: 4h 11m 47s. Rate: 7.6 symbols/min [2025-09-19T17:59:50.079819] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T17:59:50.127585] [DEBUG] [LOCAL ] CION: Loaded 29561 existing records from primary storage. [2025-09-19T17:59:50.127748] [INFO ] [MAIN ] CION: Loaded 29561 existing records. [2025-09-19T17:59:50.248392] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-19T17:59:50.311626] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T17:59:50.311848] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-19T17:59:50.311942] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-19T17:59:50.313572] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-19T17:59:50.313633] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-19T17:59:50.583701] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:50.595055] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-19T17:59:50.619756] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T17:59:50.683940] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T17:59:51.043260] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-19T17:59:51.843274] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-19T17:59:51.934590] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T17:59:52.643264] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-19T17:59:53.414687] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-19T17:59:53.443229] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-19T17:59:53.635393] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T17:59:54.243263] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-19T17:59:54.281245] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T17:59:54.494573] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:54.495114] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-19T17:59:55.043267] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-19T17:59:55.843260] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-19T17:59:56.329062] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:56.329436] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-19T17:59:56.468036] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T17:59:56.643268] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-19T17:59:57.443277] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-19T17:59:57.688902] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:57.689228] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-19T17:59:57.884623] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T17:59:58.243274] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-19T17:59:58.469085] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T17:59:58.469414] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-19T17:59:59.043267] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-19T17:59:59.843235] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-19T18:00:00.068013] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:00:00.068301] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-19T18:00:00.449050] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:00:00.643269] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-19T18:00:01.443318] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-19T18:00:02.028939] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T18:00:02.243315] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-19T18:00:03.043299] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-19T18:00:03.843310] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-19T18:00:04.453234] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-19T18:00:04.643320] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-19T18:00:05.147229] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T18:00:05.148773] [INFO ] [REMOTE ] CIMP: Full fetch complete (347 records). [2025-09-19T18:00:05.148862] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-19T18:00:05.364553] [WARN ] [VALIDATOR ] CIMP: Validation failed - insufficient historical data. Have 2 unique days, need 200 days [2025-09-19T18:00:05.364943] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:00:05.365044] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:00:05.365348] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-19T18:00:05.365548] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-19T18:00:05.365727] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-19T18:00:05.365976] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-19T18:00:05.366138] [INFO ] [MAIN ] Update Progress: 456/2372 symbols completed. CIMP took 32.7s. Estimated remaining: 4h 12m 11s. Rate: 7.6 symbols/min [2025-09-19T18:00:05.496287] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T18:00:05.523187] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-19T18:00:05.576859] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:05.642979] [DEBUG] [LOCAL ] CIVI: Loaded 52973 existing records from primary storage. [2025-09-19T18:00:05.643141] [INFO ] [MAIN ] CIVI: Loaded 52973 existing records. [2025-09-19T18:00:05.826610] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:05.826890] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-19T18:00:05.826941] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-19T18:00:05.828475] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-19T18:00:05.828540] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-19T18:00:06.146958] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (3.90 seconds). [2025-09-19T18:00:06.237186] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:06.243226] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-19T18:00:06.501538] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T18:00:07.050798] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-19T18:00:07.055554] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:00:07.843276] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-19T18:00:08.231241] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T18:00:08.513476] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T18:00:08.620234] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T18:00:08.643237] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-19T18:00:09.443254] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-19T18:00:09.881724] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T18:00:10.243271] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-19T18:00:10.684275] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T18:00:11.043265] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-19T18:00:11.822595] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T18:00:11.848361] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-19T18:00:11.870076] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T18:00:12.649602] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-19T18:00:12.655027] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T18:00:13.443284] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-19T18:00:14.046366] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T18:00:14.243245] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-19T18:00:15.043266] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-19T18:00:15.843233] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-19T18:00:16.414589] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T18:00:16.643257] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-19T18:00:17.111889] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-19T18:00:17.443328] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-19T18:00:17.728392] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T18:00:18.016715] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T18:00:18.144287] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (4.70 seconds). [2025-09-19T18:00:18.243296] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-19T18:00:18.353817] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T18:00:18.358308] [INFO ] [REMOTE ] CION: Full fetch complete (41355 records). [2025-09-19T18:00:18.358422] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-19T18:00:18.742421] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-19T18:00:18.742521] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-19T18:00:18.743103] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-19T18:00:18.743176] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-19T18:00:18.744563] [DEBUG] [LOCAL ] CION: Trimmed 41355 records to 29804 (keeping 200 days of data) [2025-09-19T18:00:18.924947] [DEBUG] [LOCAL ] CION: Primary data saved (29804 records). [2025-09-19T18:00:18.925094] [INFO ] [MAIN ] CION: Full history saved. [2025-09-19T18:00:18.925192] [INFO ] [MAIN ] Update Progress: 457/2372 symbols completed. CION took 29.0s. Estimated remaining: 4h 12m 27s. Rate: 7.6 symbols/min [2025-09-19T18:00:19.048353] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-19T18:00:19.098402] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:19.150252] [DEBUG] [LOCAL ] CL: Loaded 54034 existing records from primary storage. [2025-09-19T18:00:19.150418] [INFO ] [MAIN ] CL: Loaded 54034 existing records. [2025-09-19T18:00:19.330496] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:19.330784] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-19T18:00:19.330849] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-19T18:00:19.332220] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-19T18:00:19.332283] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-19T18:00:19.695887] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:19.843267] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-19T18:00:20.022596] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T18:00:20.326811] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T18:00:20.643268] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-19T18:00:21.443303] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-19T18:00:22.234245] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T18:00:22.244934] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-19T18:00:22.703924] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T18:00:22.870763] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T18:00:22.874455] [INFO ] [REMOTE ] CIO: Full fetch complete (29032 records). [2025-09-19T18:00:22.874530] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-19T18:00:23.055461] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-19T18:00:23.246465] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-19T18:00:23.246563] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-19T18:00:23.247024] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-19T18:00:23.247085] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-19T18:00:23.247851] [DEBUG] [LOCAL ] CIO: Trimmed 29032 records to 20269 (keeping 200 days of data) [2025-09-19T18:00:23.367007] [DEBUG] [LOCAL ] CIO: Primary data saved (20269 records). [2025-09-19T18:00:23.367151] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-19T18:00:23.367232] [INFO ] [MAIN ] Update Progress: 458/2372 symbols completed. CIO took 34.5s. Estimated remaining: 4h 12m 4s. Rate: 7.6 symbols/min [2025-09-19T18:00:23.536912] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:23.577730] [DEBUG] [LOCAL ] CLB: Loaded 33545 existing records from primary storage. [2025-09-19T18:00:23.577872] [INFO ] [MAIN ] CLB: Loaded 33545 existing records. [2025-09-19T18:00:23.756220] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:23.756878] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-19T18:00:23.756956] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-19T18:00:23.763839] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-19T18:00:23.774752] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-19T18:00:23.782867] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T18:00:23.846454] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-19T18:00:24.166943] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:24.643303] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-19T18:00:25.148364] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T18:00:25.443280] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-19T18:00:25.928523] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T18:00:26.243306] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-19T18:00:26.288634] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T18:00:26.292588] [INFO ] [REMOTE ] CINT: Full fetch complete (25827 records). [2025-09-19T18:00:26.292702] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-19T18:00:26.671503] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-19T18:00:26.671689] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-19T18:00:26.672163] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-19T18:00:26.672225] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-19T18:00:26.672961] [DEBUG] [LOCAL ] CINT: Trimmed 25827 records to 18486 (keeping 200 days of data) [2025-09-19T18:00:26.773049] [DEBUG] [LOCAL ] CINT: Primary data saved (18486 records). [2025-09-19T18:00:26.773204] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-19T18:00:26.773293] [INFO ] [MAIN ] Update Progress: 459/2372 symbols completed. CINT took 40.6s. Estimated remaining: 4h 11m 38s. Rate: 7.6 symbols/min [2025-09-19T18:00:26.949177] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:26.949380] [DEBUG] [LOCAL ] CLCO: No existing data file found in primary storage. [2025-09-19T18:00:26.949418] [WARN ] [MAIN ] CLCO: No existing data found, performing full refresh instead. [2025-09-19T18:00:26.949562] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-19T18:00:26.949617] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-19T18:00:26.949719] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-09-19T18:00:26.949771] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-19T18:00:27.051676] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-19T18:00:27.332274] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:27.365272] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T18:00:27.843310] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-19T18:00:28.542801] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-19T18:00:28.643241] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-19T18:00:28.895276] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T18:00:29.443265] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-19T18:00:29.728187] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T18:00:30.243293] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-19T18:00:30.339440] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T18:00:30.484614] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T18:00:31.043277] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-19T18:00:31.843285] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-19T18:00:32.580417] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T18:00:32.643301] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-19T18:00:33.050852] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T18:00:33.363431] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T18:00:33.443305] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-19T18:00:34.126118] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:00:34.134064] [INFO ] [REMOTE ] CIVI: Full fetch complete (75012 records). [2025-09-19T18:00:34.134248] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-19T18:00:34.135162] [FATAL] [VALIDATOR ] CIVI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:00:34.135293] [FATAL] [MAIN ] CIVI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:00:34.135345] [WARN ] [MAIN ] CIVI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:00:34.135452] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-19T18:00:34.135534] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-19T18:00:34.135584] [INFO ] [LOCAL ] CIVI: Starting deletion of derivative data. [2025-09-19T18:00:34.136148] [DEBUG] [LOCAL ] CIVI: Deleted derivative data file. [2025-09-19T18:00:34.136278] [INFO ] [MAIN ] Update Progress: 460/2372 symbols completed. CIVI took 28.8s. Estimated remaining: 4h 11m 28s. Rate: 7.6 symbols/min [2025-09-19T18:00:34.248455] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-19T18:00:34.314845] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:34.342069] [DEBUG] [LOCAL ] CLDT: Loaded 26416 existing records from primary storage. [2025-09-19T18:00:34.342247] [INFO ] [MAIN ] CLDT: Loaded 26416 existing records. [2025-09-19T18:00:34.531931] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:34.532246] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-19T18:00:34.532296] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-19T18:00:34.533723] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-19T18:00:34.533786] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-19T18:00:34.900896] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:34.983592] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T18:00:35.043247] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-19T18:00:35.613017] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:00:35.843304] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-19T18:00:36.643277] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-19T18:00:37.156670] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T18:00:37.333014] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T18:00:37.443279] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-19T18:00:37.976480] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:00:38.243293] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-19T18:00:38.718410] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T18:00:39.043343] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-19T18:00:39.803333] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T18:00:39.843281] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-19T18:00:40.643242] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-19T18:00:41.334888] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T18:00:41.375235] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:00:41.443273] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-19T18:00:41.856792] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T18:00:42.243269] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-19T18:00:43.043286] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-19T18:00:43.728990] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T18:00:43.843266] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-19T18:00:43.997102] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-19T18:00:44.643253] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-19T18:00:44.693407] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T18:00:45.058152] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T18:00:45.443261] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-19T18:00:46.243274] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-19T18:00:46.434127] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T18:00:47.043271] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-19T18:00:47.101810] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T18:00:47.109963] [INFO ] [REMOTE ] CL: Full fetch complete (77615 records). [2025-09-19T18:00:47.110134] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-19T18:00:47.553954] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-19T18:00:47.554039] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-19T18:00:47.554861] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-19T18:00:47.554926] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-19T18:00:47.556393] [DEBUG] [LOCAL ] CL: Trimmed 77615 records to 54424 (keeping 200 days of data) [2025-09-19T18:00:47.849155] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-19T18:00:47.902056] [DEBUG] [LOCAL ] CL: Primary data saved (54424 records). [2025-09-19T18:00:47.902341] [INFO ] [MAIN ] CL: Full history saved. [2025-09-19T18:00:47.902571] [INFO ] [MAIN ] Update Progress: 461/2372 symbols completed. CL took 29.0s. Estimated remaining: 4h 11m 44s. Rate: 7.6 symbols/min [2025-09-19T18:00:48.112785] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:48.108629] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T18:00:48.127690] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T18:00:48.192120] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-09-19T18:00:48.192300] [INFO ] [MAIN ] CLF: Loaded 54131 existing records. [2025-09-19T18:00:48.380432] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:48.380799] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-19T18:00:48.380867] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-19T18:00:48.382273] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-19T18:00:48.382339] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-19T18:00:48.648344] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-19T18:00:48.761388] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:49.066293] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T18:00:49.443266] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-19T18:00:49.732957] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T18:00:50.243277] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-19T18:00:51.043349] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-19T18:00:51.176888] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T18:00:51.834107] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T18:00:51.844637] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-19T18:00:52.248376] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T18:00:52.643261] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-19T18:00:52.901889] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T18:00:53.443270] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-19T18:00:53.898437] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T18:00:54.243289] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-19T18:00:55.043274] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-19T18:00:55.092565] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:00:55.843266] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-19T18:00:56.247998] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T18:00:56.253981] [INFO ] [REMOTE ] CLB: Full fetch complete (46174 records). [2025-09-19T18:00:56.254195] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-19T18:00:56.653122] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-19T18:00:56.707330] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-19T18:00:56.707508] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-19T18:00:56.708283] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-19T18:00:56.708389] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-19T18:00:56.712433] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-19T18:00:56.724519] [DEBUG] [LOCAL ] CLB: Trimmed 46174 records to 33774 (keeping 200 days of data) [2025-09-19T18:00:56.833618] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T18:00:56.838888] [INFO ] [REMOTE ] CLCO: Full fetch complete (23487 records). [2025-09-19T18:00:56.839517] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-19T18:00:57.309342] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-19T18:00:57.309765] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-19T18:00:57.310808] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-19T18:00:57.311137] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-19T18:00:57.313838] [DEBUG] [LOCAL ] CLCO: Trimmed 23487 records to 13627 (keeping 200 days of data) [2025-09-19T18:00:57.368289] [DEBUG] [LOCAL ] CLB: Primary data saved (33774 records). [2025-09-19T18:00:57.386319] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-19T18:00:57.389316] [INFO ] [MAIN ] Update Progress: 462/2372 symbols completed. CLB took 34.0s. Estimated remaining: 4h 11m 43s. Rate: 7.6 symbols/min [2025-09-19T18:00:57.454612] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-19T18:00:57.577220] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:57.593701] [DEBUG] [LOCAL ] CLCO: Primary data saved (13627 records). [2025-09-19T18:00:57.593917] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-19T18:00:57.600906] [INFO ] [MAIN ] Update Progress: 463/2372 symbols completed. CLCO took 30.8s. Estimated remaining: 4h 11m 3s. Rate: 7.6 symbols/min [2025-09-19T18:00:57.717080] [DEBUG] [LOCAL ] CLH: Loaded 28807 existing records from primary storage. [2025-09-19T18:00:57.727485] [INFO ] [MAIN ] CLH: Loaded 28807 existing records. [2025-09-19T18:00:57.862558] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:00:57.885678] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-09-19T18:00:57.885805] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-09-19T18:00:57.886087] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-19T18:00:57.886143] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-19T18:00:57.886530] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-09-19T18:00:57.886590] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-19T18:00:58.089417] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:00:58.150589] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-19T18:00:58.207731] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-19T18:00:58.233138] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-19T18:00:58.233288] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-19T18:00:58.446661] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:58.447018] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-19T18:00:58.546928] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T18:00:58.738991] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:00:59.043239] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-19T18:00:59.748388] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T18:00:59.836933] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T18:00:59.843203] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-19T18:01:00.260159] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T18:01:00.518925] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T18:01:00.643274] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-19T18:01:01.443293] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-19T18:01:01.606479] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T18:01:02.243285] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-19T18:01:02.443577] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T18:01:03.043283] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-19T18:01:03.843266] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-19T18:01:04.332539] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T18:01:04.643260] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-19T18:01:04.904723] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-19T18:01:04.951021] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T18:01:05.443265] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-19T18:01:05.707045] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T18:01:05.711065] [INFO ] [REMOTE ] CLDT: Full fetch complete (37117 records). [2025-09-19T18:01:05.711176] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-19T18:01:06.103894] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-19T18:01:06.103983] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-19T18:01:06.104492] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-19T18:01:06.104533] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-19T18:01:06.105471] [DEBUG] [LOCAL ] CLDT: Trimmed 37117 records to 26615 (keeping 200 days of data) [2025-09-19T18:01:06.246716] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-19T18:01:06.270964] [DEBUG] [LOCAL ] CLDT: Primary data saved (26615 records). [2025-09-19T18:01:06.271075] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-19T18:01:06.271171] [INFO ] [MAIN ] Update Progress: 464/2372 symbols completed. CLDT took 32.1s. Estimated remaining: 4h 10m 58s. Rate: 7.6 symbols/min [2025-09-19T18:01:06.442193] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:06.442364] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-09-19T18:01:06.442400] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-09-19T18:01:06.442558] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-19T18:01:06.442611] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-19T18:01:06.442682] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-09-19T18:01:06.442735] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-19T18:01:06.773985] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:01:06.817588] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:07.043287] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-19T18:01:07.843258] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-19T18:01:08.439243] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T18:01:08.643263] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-19T18:01:08.853897] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T18:01:09.241604] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T18:01:09.443280] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-19T18:01:10.243270] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-19T18:01:10.618707] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:01:10.920758] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:01:11.043278] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-19T18:01:11.731766] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T18:01:11.843283] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-19T18:01:12.514227] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T18:01:12.643265] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-19T18:01:13.443252] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-19T18:01:13.608761] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:01:14.018343] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T18:01:14.243288] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-19T18:01:15.010713] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T18:01:15.043235] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-19T18:01:15.843258] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-19T18:01:16.643254] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-19T18:01:16.671375] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T18:01:17.046329] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-19T18:01:17.443267] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-19T18:01:17.720796] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T18:01:18.243273] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-19T18:01:18.578283] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-19T18:01:18.838068] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:01:19.043256] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-19T18:01:19.243785] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T18:01:19.245431] [INFO ] [REMOTE ] CLPR: Full fetch complete (17859 records). [2025-09-19T18:01:19.245506] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-19T18:01:19.624980] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-19T18:01:19.625070] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-19T18:01:19.625465] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-19T18:01:19.625506] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-19T18:01:19.626103] [DEBUG] [LOCAL ] CLPR: Trimmed 17859 records to 11738 (keeping 200 days of data) [2025-09-19T18:01:19.696195] [DEBUG] [LOCAL ] CLPR: Primary data saved (11738 records). [2025-09-19T18:01:19.696346] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-19T18:01:19.696445] [INFO ] [MAIN ] Update Progress: 465/2372 symbols completed. CLPR took 22.1s. Estimated remaining: 4h 11m 13s. Rate: 7.6 symbols/min [2025-09-19T18:01:19.847372] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-19T18:01:19.882976] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:19.938822] [DEBUG] [LOCAL ] CLVT: Loaded 52395 existing records from primary storage. [2025-09-19T18:01:19.939000] [INFO ] [MAIN ] CLVT: Loaded 52395 existing records. [2025-09-19T18:01:20.130581] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:20.130853] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-19T18:01:20.130904] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-19T18:01:20.132289] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-19T18:01:20.132371] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-19T18:01:20.510521] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:20.533994] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:01:20.643243] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-19T18:01:21.443232] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-19T18:01:22.053995] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T18:01:22.243314] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-19T18:01:22.622165] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-19T18:01:23.043254] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-19T18:01:23.714342] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T18:01:23.843271] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-19T18:01:24.116398] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T18:01:24.492525] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T18:01:24.643293] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-19T18:01:25.443271] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-19T18:01:25.737710] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T18:01:26.243292] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-19T18:01:26.402757] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T18:01:26.589934] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T18:01:27.043297] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-19T18:01:27.843269] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-19T18:01:28.649682] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-19T18:01:28.650907] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T18:01:28.873078] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-19T18:01:29.443266] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-19T18:01:29.975337] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T18:01:30.243274] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-19T18:01:30.420289] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-19T18:01:30.428043] [INFO ] [REMOTE ] CLF: Full fetch complete (77419 records). [2025-09-19T18:01:30.428216] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-19T18:01:30.429194] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:01:30.429301] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:01:30.429373] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:01:30.429461] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-19T18:01:30.429558] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-09-19T18:01:30.429616] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-09-19T18:01:30.430114] [DEBUG] [LOCAL ] CLF: Deleted derivative data file. [2025-09-19T18:01:30.430216] [INFO ] [MAIN ] Update Progress: 466/2372 symbols completed. CLF took 42.5s. Estimated remaining: 4h 11m 17s. Rate: 7.6 symbols/min [2025-09-19T18:01:30.604700] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:30.627728] [DEBUG] [LOCAL ] CLW: Loaded 22217 existing records from primary storage. [2025-09-19T18:01:30.627878] [INFO ] [MAIN ] CLW: Loaded 22217 existing records. [2025-09-19T18:01:30.813545] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:30.813816] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-19T18:01:30.813869] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-19T18:01:30.814517] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-19T18:01:30.814579] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-19T18:01:31.048407] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-19T18:01:31.197745] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:31.601131] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T18:01:31.843289] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-19T18:01:32.066801] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T18:01:32.105603] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T18:01:32.111721] [INFO ] [REMOTE ] CLH: Full fetch complete (41599 records). [2025-09-19T18:01:32.111903] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-19T18:01:32.112846] [FATAL] [VALIDATOR ] CLH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:01:32.112966] [FATAL] [MAIN ] CLH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:01:32.113048] [WARN ] [MAIN ] CLH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:01:32.113161] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-19T18:01:32.113256] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-19T18:01:32.113319] [INFO ] [LOCAL ] CLH: Starting deletion of derivative data. [2025-09-19T18:01:32.113986] [DEBUG] [LOCAL ] CLH: Deleted derivative data file. [2025-09-19T18:01:32.114123] [INFO ] [MAIN ] Update Progress: 467/2372 symbols completed. CLH took 34.7s. Estimated remaining: 4h 10m 44s. Rate: 7.6 symbols/min [2025-09-19T18:01:32.393747] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:32.478999] [DEBUG] [LOCAL ] CLX: Loaded 51779 existing records from primary storage. [2025-09-19T18:01:32.479266] [INFO ] [MAIN ] CLX: Loaded 51779 existing records. [2025-09-19T18:01:32.649163] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-19T18:01:32.796601] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:32.797004] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-19T18:01:32.797081] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-19T18:01:32.799126] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-19T18:01:32.799219] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-19T18:01:33.284895] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:33.443298] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-19T18:01:33.522856] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:01:34.243299] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-19T18:01:35.043304] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-19T18:01:35.407823] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-19T18:01:35.459587] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T18:01:35.787165] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T18:01:35.843251] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-19T18:01:36.162798] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:01:36.643297] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-19T18:01:37.443289] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-19T18:01:37.476549] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T18:01:37.927830] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:01:38.243285] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-19T18:01:39.043264] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-19T18:01:39.586775] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T18:01:39.624392] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T18:01:39.843265] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-19T18:01:40.342576] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T18:01:40.643293] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-19T18:01:41.271545] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T18:01:41.443262] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-19T18:01:42.243282] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-19T18:01:42.752687] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:01:43.043333] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-19T18:01:43.419852] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:01:43.843287] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-19T18:01:44.603313] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-19T18:01:44.643287] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-19T18:01:45.027771] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:01:45.085772] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T18:01:45.443289] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-19T18:01:46.243287] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-19T18:01:46.815948] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T18:01:47.048457] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-19T18:01:47.059897] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-19T18:01:47.068874] [INFO ] [REMOTE ] CLS: Full fetch complete (77449 records). [2025-09-19T18:01:47.069030] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-19T18:01:47.466841] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-19T18:01:47.466921] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-19T18:01:47.467738] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-19T18:01:47.467801] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-19T18:01:47.469389] [DEBUG] [LOCAL ] CLS: Trimmed 77449 records to 54422 (keeping 200 days of data) [2025-09-19T18:01:47.830407] [DEBUG] [LOCAL ] CLS: Primary data saved (54422 records). [2025-09-19T18:01:47.830636] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-19T18:01:47.830818] [INFO ] [MAIN ] Update Progress: 468/2372 symbols completed. CLS took 41.6s. Estimated remaining: 4h 11m 8s. Rate: 7.6 symbols/min [2025-09-19T18:01:47.857423] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-19T18:01:48.030721] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:48.087057] [DEBUG] [LOCAL ] CM: Loaded 49009 existing records from primary storage. [2025-09-19T18:01:48.087239] [INFO ] [MAIN ] CM: Loaded 49009 existing records. [2025-09-19T18:01:48.275892] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:48.276196] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-19T18:01:48.276252] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-19T18:01:48.277355] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-19T18:01:48.277433] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-19T18:01:48.703701] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:48.706399] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T18:01:48.704848] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-19T18:01:48.717634] [INFO ] [REMOTE ] CLVT: Full fetch complete (75240 records). [2025-09-19T18:01:48.717859] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-19T18:01:49.170524] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-19T18:01:49.170849] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-19T18:01:49.171824] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-19T18:01:49.172097] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-19T18:01:49.175265] [DEBUG] [LOCAL ] CLVT: Trimmed 75240 records to 52761 (keeping 200 days of data) [2025-09-19T18:01:49.188967] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T18:01:49.314100] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T18:01:49.444713] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-19T18:01:49.553305] [DEBUG] [LOCAL ] CLVT: Primary data saved (52761 records). [2025-09-19T18:01:49.553554] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-19T18:01:49.553830] [INFO ] [MAIN ] Update Progress: 469/2372 symbols completed. CLVT took 29.9s. Estimated remaining: 4h 10m 35s. Rate: 7.6 symbols/min [2025-09-19T18:01:49.737468] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:01:49.794027] [DEBUG] [LOCAL ] CMA: Loaded 50675 existing records from primary storage. [2025-09-19T18:01:49.794184] [INFO ] [MAIN ] CMA: Loaded 50675 existing records. [2025-09-19T18:01:49.973580] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:01:49.973875] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-19T18:01:49.973926] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-19T18:01:49.975033] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-19T18:01:49.975108] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-19T18:01:50.249202] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-19T18:01:50.341411] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:01:50.799378] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T18:01:51.043303] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-19T18:01:51.527462] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:01:51.624519] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:01:51.843310] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-19T18:01:52.450866] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T18:01:52.643276] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-19T18:01:53.443319] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-19T18:01:53.489154] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:01:54.243290] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-19T18:01:54.844089] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T18:01:55.043257] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-19T18:01:55.243780] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T18:01:55.843272] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-19T18:01:56.566132] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:01:56.643220] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-19T18:01:57.281571] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T18:01:57.333028] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T18:01:57.443219] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-19T18:01:58.243277] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-19T18:01:58.757021] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:01:58.807559] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:01:59.043230] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-19T18:01:59.593145] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T18:01:59.843261] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-19T18:02:00.643268] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-19T18:02:01.443280] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-19T18:02:01.733439] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-19T18:02:01.741574] [INFO ] [REMOTE ] CLX: Full fetch complete (72784 records). [2025-09-19T18:02:01.741782] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-19T18:02:02.174746] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-19T18:02:02.175256] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-19T18:02:02.187249] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T18:02:02.186678] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-19T18:02:02.188685] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-19T18:02:02.192526] [INFO ] [REMOTE ] CLW: Full fetch complete (35057 records). [2025-09-19T18:02:02.192911] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-19T18:02:02.194150] [FATAL] [VALIDATOR ] CLW: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:02:02.194395] [FATAL] [MAIN ] CLW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:02:02.194816] [WARN ] [MAIN ] CLW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:02:02.194915] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-19T18:02:02.195015] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-09-19T18:02:02.204744] [INFO ] [LOCAL ] CLW: Starting deletion of derivative data. [2025-09-19T18:02:02.210080] [DEBUG] [LOCAL ] CLX: Trimmed 72784 records to 52158 (keeping 200 days of data) [2025-09-19T18:02:02.223055] [DEBUG] [LOCAL ] CLW: Deleted derivative data file. [2025-09-19T18:02:02.223262] [INFO ] [MAIN ] Update Progress: 470/2372 symbols completed. CLW took 31.8s. Estimated remaining: 4h 10m 46s. Rate: 7.6 symbols/min [2025-09-19T18:02:02.246881] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T18:02:02.429405] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-19T18:02:02.539291] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:02.544793] [DEBUG] [LOCAL ] CMBT: No existing data file found in primary storage. [2025-09-19T18:02:02.548780] [WARN ] [MAIN ] CMBT: No existing data found, performing full refresh instead. [2025-09-19T18:02:02.551381] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-19T18:02:02.551746] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-19T18:02:02.553271] [DEBUG] [LOCAL ] CMBT: No primary data file found to delete. [2025-09-19T18:02:02.554830] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-19T18:02:03.067791] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:03.071849] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-19T18:02:03.180568] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T18:02:03.204542] [DEBUG] [LOCAL ] CLX: Primary data saved (52158 records). [2025-09-19T18:02:03.205062] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-19T18:02:03.205946] [INFO ] [MAIN ] Update Progress: 471/2372 symbols completed. CLX took 31.1s. Estimated remaining: 4h 10m 10s. Rate: 7.6 symbols/min [2025-09-19T18:02:03.390910] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:03.443056] [DEBUG] [LOCAL ] CMC: Loaded 46140 existing records from primary storage. [2025-09-19T18:02:03.443255] [INFO ] [MAIN ] CMC: Loaded 46140 existing records. [2025-09-19T18:02:03.640023] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:03.640297] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-19T18:02:03.640351] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-19T18:02:03.641839] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-19T18:02:03.641902] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-19T18:02:03.866754] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-19T18:02:04.026798] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:04.402091] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:02:04.445087] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T18:02:04.643261] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-19T18:02:05.443261] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-19T18:02:06.090813] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:02:06.208267] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T18:02:06.243304] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-19T18:02:07.043310] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-19T18:02:07.369107] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T18:02:07.843284] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-19T18:02:08.155470] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T18:02:08.324775] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T18:02:08.643271] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-19T18:02:09.355523] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T18:02:09.443272] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-19T18:02:10.243277] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-19T18:02:10.709897] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T18:02:10.847350] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T18:02:11.043312] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-19T18:02:11.128452] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T18:02:11.843289] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-19T18:02:12.643293] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-19T18:02:12.967147] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T18:02:13.274061] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T18:02:13.443259] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-19T18:02:13.919774] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T18:02:14.243310] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-19T18:02:15.043314] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-19T18:02:15.458736] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T18:02:15.843270] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-19T18:02:16.286530] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T18:02:16.643262] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-19T18:02:16.675201] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:02:16.682725] [INFO ] [REMOTE ] CM: Full fetch complete (68998 records). [2025-09-19T18:02:16.682900] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-19T18:02:16.683821] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:02:16.683943] [FATAL] [MAIN ] CM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:02:16.683987] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:02:16.684049] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-19T18:02:16.684127] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-19T18:02:16.684182] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-09-19T18:02:16.684865] [DEBUG] [LOCAL ] CM: Deleted derivative data file. [2025-09-19T18:02:16.684983] [INFO ] [MAIN ] Update Progress: 472/2372 symbols completed. CM took 28.9s. Estimated remaining: 4h 10m 25s. Rate: 7.6 symbols/min [2025-09-19T18:02:16.875770] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:16.882880] [DEBUG] [LOCAL ] CMCM: Loaded 4678 existing records from primary storage. [2025-09-19T18:02:16.882999] [INFO ] [MAIN ] CMCM: Loaded 4678 existing records. [2025-09-19T18:02:17.069201] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:17.069489] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-19T18:02:17.069540] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-19T18:02:17.069870] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-19T18:02:17.069934] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-19T18:02:17.451103] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-19T18:02:17.458881] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:17.475447] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T18:02:17.516933] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T18:02:18.243280] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-19T18:02:19.043274] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-19T18:02:19.128168] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T18:02:19.629327] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T18:02:19.843273] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-19T18:02:20.377639] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T18:02:20.461473] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T18:02:20.643287] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-19T18:02:21.443288] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-19T18:02:22.243317] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-19T18:02:22.589829] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T18:02:23.043319] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-19T18:02:23.400506] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:02:23.488361] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T18:02:23.843264] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-19T18:02:23.918300] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T18:02:24.643269] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-19T18:02:25.443343] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-19T18:02:25.903031] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:02:25.914053] [INFO ] [REMOTE ] CMA: Full fetch complete (73392 records). [2025-09-19T18:02:25.914299] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-19T18:02:26.257990] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-19T18:02:26.526526] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-19T18:02:26.527004] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-19T18:02:26.529448] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-19T18:02:26.530100] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T18:02:26.530445] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-19T18:02:26.535597] [DEBUG] [LOCAL ] CMA: Trimmed 73392 records to 51012 (keeping 200 days of data) [2025-09-19T18:02:26.721687] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T18:02:26.996702] [DEBUG] [LOCAL ] CMA: Primary data saved (51012 records). [2025-09-19T18:02:26.996885] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-19T18:02:26.996991] [INFO ] [MAIN ] Update Progress: 473/2372 symbols completed. CMA took 37.4s. Estimated remaining: 4h 10m 26s. Rate: 7.6 symbols/min [2025-09-19T18:02:27.053888] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-19T18:02:27.177742] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:27.177952] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-19T18:02:27.177991] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-19T18:02:27.178137] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-19T18:02:27.178180] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-19T18:02:27.178222] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-19T18:02:27.178253] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-19T18:02:27.588514] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:27.599904] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T18:02:27.776510] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T18:02:27.843264] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-19T18:02:28.643286] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-19T18:02:28.870621] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:28.871011] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-19T18:02:29.443309] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-19T18:02:29.971342] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T18:02:30.062064] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-19T18:02:30.243329] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-19T18:02:31.043219] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-19T18:02:31.410706] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-19T18:02:31.843311] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-19T18:02:32.324957] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T18:02:32.331825] [INFO ] [REMOTE ] CMC: Full fetch complete (66843 records). [2025-09-19T18:02:32.331955] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-19T18:02:32.645853] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-19T18:02:32.738978] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T18:02:32.739165] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-19T18:02:32.741425] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-19T18:02:32.742233] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-19T18:02:32.742297] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-19T18:02:32.743626] [DEBUG] [LOCAL ] CMC: Trimmed 66843 records to 46515 (keeping 200 days of data) [2025-09-19T18:02:33.030659] [DEBUG] [LOCAL ] CMC: Primary data saved (46515 records). [2025-09-19T18:02:33.030812] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-19T18:02:33.031481] [INFO ] [MAIN ] Update Progress: 474/2372 symbols completed. CMC took 29.8s. Estimated remaining: 4h 10m 11s. Rate: 7.6 symbols/min [2025-09-19T18:02:33.199543] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:33.255805] [DEBUG] [LOCAL ] CMG: Loaded 54110 existing records from primary storage. [2025-09-19T18:02:33.255961] [INFO ] [MAIN ] CMG: Loaded 54110 existing records. [2025-09-19T18:02:33.434953] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:33.435229] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-19T18:02:33.435290] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-19T18:02:33.436470] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-19T18:02:33.436531] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-19T18:02:33.451910] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-19T18:02:33.802749] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:34.243277] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-19T18:02:34.343233] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T18:02:34.635622] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T18:02:35.043321] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-19T18:02:35.283471] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:35.284052] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-19T18:02:35.843262] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-19T18:02:36.643286] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-19T18:02:36.854353] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:36.854720] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-19T18:02:36.986527] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-19T18:02:37.443311] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-19T18:02:37.592437] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T18:02:37.600514] [INFO ] [REMOTE ] CMBT: Full fetch complete (28630 records). [2025-09-19T18:02:37.600692] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-19T18:02:37.678732] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:37.714257] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-19T18:02:38.016209] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-19T18:02:38.016294] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-19T18:02:38.016864] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-19T18:02:38.016943] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-19T18:02:38.017788] [DEBUG] [LOCAL ] CMBT: Trimmed 28630 records to 21759 (keeping 200 days of data) [2025-09-19T18:02:38.160288] [DEBUG] [LOCAL ] CMBT: Primary data saved (21759 records). [2025-09-19T18:02:38.160454] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-19T18:02:38.160554] [INFO ] [MAIN ] Update Progress: 475/2372 symbols completed. CMBT took 35.9s. Estimated remaining: 4h 9m 52s. Rate: 7.6 symbols/min [2025-09-19T18:02:38.248370] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-19T18:02:38.351430] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:38.408910] [DEBUG] [LOCAL ] CMI: Loaded 42298 existing records from primary storage. [2025-09-19T18:02:38.409092] [INFO ] [MAIN ] CMI: Loaded 42298 existing records. [2025-09-19T18:02:38.507831] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:02:38.527960] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-19T18:02:38.616270] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:38.616585] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-19T18:02:38.616664] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-19T18:02:38.617728] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-19T18:02:38.617791] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-19T18:02:39.026572] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:39.043314] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-19T18:02:39.843265] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-19T18:02:40.436842] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T18:02:40.643275] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-19T18:02:41.443268] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-19T18:02:41.677896] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T18:02:41.835598] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T18:02:42.243264] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-19T18:02:43.043280] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-19T18:02:43.535884] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T18:02:43.616011] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T18:02:43.781947] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T18:02:43.784001] [INFO ] [REMOTE ] CMCM: Full fetch complete (7014 records). [2025-09-19T18:02:43.784074] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-19T18:02:43.848337] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-19T18:02:44.156245] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-19T18:02:44.156398] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-19T18:02:44.156607] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-19T18:02:44.156668] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-19T18:02:44.157092] [DEBUG] [LOCAL ] CMCM: Trimmed 7014 records to 4718 (keeping 200 days of data) [2025-09-19T18:02:44.182884] [DEBUG] [LOCAL ] CMCM: Primary data saved (4718 records). [2025-09-19T18:02:44.182981] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-19T18:02:44.183060] [INFO ] [MAIN ] Update Progress: 476/2372 symbols completed. CMCM took 27.5s. Estimated remaining: 4h 9m 37s. Rate: 7.6 symbols/min [2025-09-19T18:02:44.354484] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:02:44.395757] [DEBUG] [LOCAL ] CMP: Loaded 36915 existing records from primary storage. [2025-09-19T18:02:44.395911] [INFO ] [MAIN ] CMP: Loaded 36915 existing records. [2025-09-19T18:02:44.577575] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:02:44.577910] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-19T18:02:44.577997] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-19T18:02:44.578940] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-19T18:02:44.579004] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-19T18:02:44.648375] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-19T18:02:44.950916] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:02:45.362045] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T18:02:45.443259] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-19T18:02:46.211958] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T18:02:46.243240] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-19T18:02:47.043273] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-19T18:02:47.282594] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T18:02:47.843275] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-19T18:02:48.644998] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-19T18:02:48.643463] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-19T18:02:48.891099] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T18:02:48.929692] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T18:02:49.443265] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-19T18:02:50.243255] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-19T18:02:50.627232] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:02:50.667865] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T18:02:50.670469] [INFO ] [REMOTE ] CMDB: Full fetch complete (10556 records). [2025-09-19T18:02:50.670546] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-19T18:02:50.886389] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 94 unique days, need 200 days [2025-09-19T18:02:50.886725] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:02:50.886832] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:02:50.886920] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-19T18:02:50.887045] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-19T18:02:50.887153] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-19T18:02:50.887263] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-19T18:02:50.887391] [INFO ] [MAIN ] Update Progress: 477/2372 symbols completed. CMDB took 23.9s. Estimated remaining: 4h 9m 24s. Rate: 7.6 symbols/min [2025-09-19T18:02:51.043323] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-19T18:02:51.515281] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T18:02:51.843290] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-19T18:02:52.643280] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-19T18:02:53.042561] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:02:53.443259] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-19T18:02:53.592535] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T18:02:54.243273] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-19T18:02:54.331476] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T18:02:55.043274] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-19T18:02:55.834137] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T18:02:55.852242] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-19T18:02:55.933847] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T18:02:56.067295] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T18:02:56.643270] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-19T18:02:57.443241] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-19T18:02:57.808198] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:02:58.243267] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-19T18:02:58.431391] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:02:58.463909] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T18:02:59.043256] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-19T18:02:59.843256] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-19T18:03:00.825201] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:03:00.837538] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-19T18:03:00.974162] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T18:03:01.443266] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-19T18:03:02.306296] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-19T18:03:02.315918] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-19T18:03:03.879978] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (3.04 seconds). [2025-09-19T18:03:03.892065] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-19T18:03:04.766406] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (3.32 seconds). [2025-09-19T18:03:04.775253] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-19T18:03:04.851945] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-19T18:03:04.860360] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-19T18:03:06.495189] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T18:03:06.501832] [INFO ] [REMOTE ] CMI: Full fetch complete (59821 records). [2025-09-19T18:03:06.501998] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-19T18:03:06.820453] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:03:06.860602] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-19T18:03:06.959045] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-19T18:03:06.959136] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-19T18:03:06.959833] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-19T18:03:06.959898] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-19T18:03:06.961304] [DEBUG] [LOCAL ] CMI: Trimmed 59821 records to 42606 (keeping 200 days of data) [2025-09-19T18:03:07.207711] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.32 seconds). [2025-09-19T18:03:07.221720] [INFO ] [REMOTE ] CMG: Full fetch complete (77403 records). [2025-09-19T18:03:07.222489] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-19T18:03:07.227559] [FATAL] [VALIDATOR ] CMG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:03:07.232429] [FATAL] [MAIN ] CMG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:03:07.235120] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:03:07.235697] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-19T18:03:07.237000] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-19T18:03:07.237300] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-09-19T18:03:07.239511] [DEBUG] [LOCAL ] CMG: Deleted derivative data file. [2025-09-19T18:03:07.240940] [INFO ] [MAIN ] Update Progress: 478/2372 symbols completed. CMG took 34.2s. Estimated remaining: 4h 9m 49s. Rate: 7.6 symbols/min [2025-09-19T18:03:07.270735] [DEBUG] [LOCAL ] CMI: Primary data saved (42606 records). [2025-09-19T18:03:07.270847] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-19T18:03:07.270925] [INFO ] [MAIN ] Update Progress: 479/2372 symbols completed. CMI took 29.1s. Estimated remaining: 4h 9m 10s. Rate: 7.6 symbols/min [2025-09-19T18:03:08.610752] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:03:08.618404] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-19T18:03:09.660524] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T18:03:09.665029] [INFO ] [REMOTE ] CMP: Full fetch complete (53313 records). [2025-09-19T18:03:09.665130] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-19T18:03:10.061584] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-19T18:03:10.061700] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-19T18:03:10.062397] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-19T18:03:10.062460] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-19T18:03:10.063820] [DEBUG] [LOCAL ] CMP: Trimmed 53313 records to 37120 (keeping 200 days of data) [2025-09-19T18:03:10.293997] [DEBUG] [LOCAL ] CMP: Primary data saved (37120 records). [2025-09-19T18:03:10.294154] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-19T18:03:10.294242] [INFO ] [MAIN ] Update Progress: 480/2372 symbols completed. CMP took 26.1s. Estimated remaining: 4h 8m 43s. Rate: 7.6 symbols/min [2025-09-19T18:03:10.896871] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:10.936611] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:10.976007] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:11.029598] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:11.035503] [DEBUG] [LOCAL ] CMSA: Loaded 3384 existing records from primary storage. [2025-09-19T18:03:11.035832] [INFO ] [MAIN ] CMSA: Loaded 3384 existing records. [2025-09-19T18:03:11.141802] [DEBUG] [LOCAL ] CMSC: Loaded 5156 existing records from primary storage. [2025-09-19T18:03:11.153832] [INFO ] [MAIN ] CMSC: Loaded 5156 existing records. [2025-09-19T18:03:11.376994] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:11.493720] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:11.494595] [DEBUG] [LOCAL ] CMS: Loaded 53032 existing records from primary storage. [2025-09-19T18:03:11.464415] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-19T18:03:11.495608] [DEBUG] [LOCAL ] CMRE: Loaded 35979 existing records from primary storage. [2025-09-19T18:03:11.495805] [INFO ] [MAIN ] CMS: Loaded 53032 existing records. [2025-09-19T18:03:11.495996] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-19T18:03:11.501395] [INFO ] [MAIN ] CMRE: Loaded 35979 existing records. [2025-09-19T18:03:11.496158] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-19T18:03:11.496200] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-19T18:03:11.527427] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-19T18:03:11.536847] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-19T18:03:11.566852] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-19T18:03:11.582395] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-19T18:03:12.053778] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:12.104580] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:12.154699] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-19T18:03:12.173427] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-19T18:03:12.197231] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-19T18:03:12.218403] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-19T18:03:12.218568] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-19T18:03:12.268503] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-19T18:03:12.344319] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-19T18:03:12.388567] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-19T18:03:13.098923] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:13.163344] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:13.221297] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-19T18:03:13.199579] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-19T18:03:13.379999] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:13.397524] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-19T18:03:13.446450] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:13.447002] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-19T18:03:15.150091] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T18:03:15.151874] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-19T18:03:15.299767] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:03:15.301587] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-19T18:03:15.640230] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T18:03:15.645865] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-19T18:03:15.690287] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-19T18:03:15.692153] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-19T18:03:16.130671] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T18:03:16.132295] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-19T18:03:16.294876] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T18:03:16.296399] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-19T18:03:16.501981] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-19T18:03:16.503617] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-19T18:03:16.523592] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:03:16.530607] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-19T18:03:16.712959] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T18:03:16.715073] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-19T18:03:16.868820] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-19T18:03:17.057950] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (3.66 seconds). [2025-09-19T18:03:17.443281] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-19T18:03:17.568457] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T18:03:18.047527] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T18:03:18.243273] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-19T18:03:19.043248] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-19T18:03:19.117257] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:03:19.434374] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T18:03:19.843242] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-19T18:03:19.890758] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T18:03:20.643297] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-19T18:03:20.821734] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T18:03:21.341162] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T18:03:21.443258] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-19T18:03:22.243276] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-19T18:03:22.716601] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T18:03:23.043263] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-19T18:03:23.469394] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T18:03:23.678178] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-19T18:03:23.843290] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-19T18:03:24.522950] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T18:03:24.643310] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-19T18:03:25.150443] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T18:03:25.443321] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-19T18:03:26.243261] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-19T18:03:26.251826] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T18:03:26.885507] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-19T18:03:26.886761] [INFO ] [REMOTE ] CMSC: Full fetch complete (7158 records). [2025-09-19T18:03:26.886831] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-19T18:03:27.050761] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-19T18:03:27.296581] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-19T18:03:27.296715] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-19T18:03:27.296932] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-19T18:03:27.296974] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-19T18:03:27.297381] [DEBUG] [LOCAL ] CMSC: Trimmed 7158 records to 5184 (keeping 200 days of data) [2025-09-19T18:03:27.329558] [DEBUG] [LOCAL ] CMSC: Primary data saved (5184 records). [2025-09-19T18:03:27.329695] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-19T18:03:27.329807] [INFO ] [MAIN ] Update Progress: 481/2372 symbols completed. CMSC took 17.0s. Estimated remaining: 4h 9m 11s. Rate: 7.6 symbols/min [2025-09-19T18:03:27.510972] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:27.526212] [DEBUG] [LOCAL ] CMSD: Loaded 8213 existing records from primary storage. [2025-09-19T18:03:27.526391] [INFO ] [MAIN ] CMSD: Loaded 8213 existing records. [2025-09-19T18:03:27.726560] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:27.726862] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-19T18:03:27.726913] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-19T18:03:27.727269] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-19T18:03:27.727331] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-19T18:03:27.848346] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-19T18:03:28.094198] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:28.381413] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:03:28.643273] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-19T18:03:28.662275] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T18:03:29.443276] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-19T18:03:29.640850] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T18:03:30.243298] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-19T18:03:30.636922] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T18:03:30.944481] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T18:03:30.945593] [INFO ] [REMOTE ] CMSA: Full fetch complete (5024 records). [2025-09-19T18:03:30.945692] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-19T18:03:31.048463] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-19T18:03:31.336525] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-19T18:03:31.336608] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-19T18:03:31.336822] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-19T18:03:31.336897] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-19T18:03:31.337288] [DEBUG] [LOCAL ] CMSA: Trimmed 5024 records to 3404 (keeping 200 days of data) [2025-09-19T18:03:31.359925] [DEBUG] [LOCAL ] CMSA: Primary data saved (3404 records). [2025-09-19T18:03:31.360064] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-19T18:03:31.360183] [INFO ] [MAIN ] Update Progress: 482/2372 symbols completed. CMSA took 21.1s. Estimated remaining: 4h 8m 48s. Rate: 7.6 symbols/min [2025-09-19T18:03:31.532987] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:31.572159] [DEBUG] [LOCAL ] CMTG: Loaded 38077 existing records from primary storage. [2025-09-19T18:03:31.572312] [INFO ] [MAIN ] CMTG: Loaded 38077 existing records. [2025-09-19T18:03:31.751895] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:31.752253] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-19T18:03:31.752312] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-19T18:03:31.753336] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-19T18:03:31.753400] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-19T18:03:31.852373] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-19T18:03:32.110322] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:32.643268] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-19T18:03:32.778009] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T18:03:33.170672] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-19T18:03:33.440586] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T18:03:33.450529] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-19T18:03:34.243299] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-19T18:03:35.048854] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-19T18:03:35.058906] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T18:03:35.803713] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T18:03:35.843728] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-19T18:03:35.845878] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:03:36.643279] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-19T18:03:37.266608] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T18:03:37.443309] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-19T18:03:37.875813] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T18:03:38.243295] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-19T18:03:39.043345] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-19T18:03:39.239841] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T18:03:39.282864] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T18:03:39.843266] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-19T18:03:40.523799] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T18:03:40.643265] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-19T18:03:40.886131] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T18:03:41.443276] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-19T18:03:42.243309] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-19T18:03:42.488008] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T18:03:42.584019] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T18:03:43.043267] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-19T18:03:43.162427] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T18:03:43.843271] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-19T18:03:44.643273] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-19T18:03:44.687162] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T18:03:45.443280] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-19T18:03:45.507489] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T18:03:45.512454] [INFO ] [REMOTE ] CMRE: Full fetch complete (49457 records). [2025-09-19T18:03:45.512544] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-19T18:03:45.890483] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-19T18:03:45.890569] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-19T18:03:45.891188] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-19T18:03:45.891252] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-19T18:03:45.892364] [DEBUG] [LOCAL ] CMRE: Trimmed 49457 records to 36224 (keeping 200 days of data) [2025-09-19T18:03:46.119570] [DEBUG] [LOCAL ] CMRE: Primary data saved (36224 records). [2025-09-19T18:03:46.119744] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-19T18:03:46.119874] [INFO ] [MAIN ] Update Progress: 483/2372 symbols completed. CMRE took 35.8s. Estimated remaining: 4h 9m 7s. Rate: 7.6 symbols/min [2025-09-19T18:03:46.248967] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-19T18:03:46.255547] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T18:03:46.317005] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:46.326795] [DEBUG] [LOCAL ] CMU: Loaded 7421 existing records from primary storage. [2025-09-19T18:03:46.326920] [INFO ] [MAIN ] CMU: Loaded 7421 existing records. [2025-09-19T18:03:46.504265] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:46.504497] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-19T18:03:46.504547] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-19T18:03:46.504896] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-19T18:03:46.504967] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-19T18:03:46.872296] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:46.907676] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T18:03:47.043297] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-19T18:03:47.843269] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-19T18:03:48.120731] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T18:03:48.153383] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:03:48.643291] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-19T18:03:48.702517] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T18:03:49.443267] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-19T18:03:49.498147] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T18:03:50.162866] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T18:03:50.164432] [INFO ] [REMOTE ] CMSD: Full fetch complete (12600 records). [2025-09-19T18:03:50.164548] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-19T18:03:50.248435] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-19T18:03:50.532143] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-19T18:03:50.532229] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-19T18:03:50.532538] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-19T18:03:50.532577] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-19T18:03:50.533093] [DEBUG] [LOCAL ] CMSD: Trimmed 12600 records to 8242 (keeping 200 days of data) [2025-09-19T18:03:50.586232] [DEBUG] [LOCAL ] CMSD: Primary data saved (8242 records). [2025-09-19T18:03:50.586383] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-19T18:03:50.586513] [INFO ] [MAIN ] Update Progress: 484/2372 symbols completed. CMSD took 23.3s. Estimated remaining: 4h 8m 46s. Rate: 7.6 symbols/min [2025-09-19T18:03:50.759930] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:50.796806] [DEBUG] [LOCAL ] CNA: Loaded 33018 existing records from primary storage. [2025-09-19T18:03:50.796984] [INFO ] [MAIN ] CNA: Loaded 33018 existing records. [2025-09-19T18:03:50.977909] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:50.978195] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-19T18:03:50.978253] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-19T18:03:50.979294] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-19T18:03:50.979355] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-19T18:03:51.052994] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-19T18:03:51.378260] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:51.711421] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:03:51.843224] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-19T18:03:51.899935] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T18:03:52.643276] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-19T18:03:53.360623] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T18:03:53.368786] [INFO ] [REMOTE ] CMS: Full fetch complete (76036 records). [2025-09-19T18:03:53.368937] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-19T18:03:53.448370] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-19T18:03:53.696634] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T18:03:53.791637] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-19T18:03:53.791756] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-19T18:03:53.792586] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-19T18:03:53.792688] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-19T18:03:53.797216] [DEBUG] [LOCAL ] CMS: Trimmed 76036 records to 53419 (keeping 200 days of data) [2025-09-19T18:03:54.127297] [DEBUG] [LOCAL ] CMS: Primary data saved (53419 records). [2025-09-19T18:03:54.127436] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-19T18:03:54.127555] [INFO ] [MAIN ] Update Progress: 485/2372 symbols completed. CMS took 43.8s. Estimated remaining: 4h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T18:03:54.248380] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-19T18:03:54.313292] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:03:54.373267] [DEBUG] [LOCAL ] CNC: Loaded 54119 existing records from primary storage. [2025-09-19T18:03:54.373442] [INFO ] [MAIN ] CNC: Loaded 54119 existing records. [2025-09-19T18:03:54.569766] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:03:54.570139] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-19T18:03:54.570203] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-19T18:03:54.571719] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-19T18:03:54.571792] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-19T18:03:54.952069] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:03:55.043286] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-19T18:03:55.254392] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:03:55.283463] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T18:03:55.843273] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-19T18:03:56.549445] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T18:03:56.643231] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-19T18:03:56.861022] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T18:03:57.035270] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-19T18:03:57.443286] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-19T18:03:58.243286] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-19T18:03:58.340484] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T18:03:59.043267] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-19T18:03:59.843267] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-19T18:04:00.376733] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T18:04:00.643277] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-19T18:04:00.726267] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:04:01.443269] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-19T18:04:01.743742] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:04:01.760251] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T18:04:02.243264] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-19T18:04:02.439862] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:04:03.043297] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-19T18:04:03.615210] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-19T18:04:03.616720] [INFO ] [REMOTE ] CMU: Full fetch complete (9661 records). [2025-09-19T18:04:03.616831] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-19T18:04:03.848972] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-19T18:04:03.980441] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-19T18:04:03.980524] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-19T18:04:03.980825] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-19T18:04:03.980910] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-19T18:04:03.982285] [DEBUG] [LOCAL ] CMU: Trimmed 9661 records to 7451 (keeping 200 days of data) [2025-09-19T18:04:04.032764] [DEBUG] [LOCAL ] CMU: Primary data saved (7451 records). [2025-09-19T18:04:04.032873] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-19T18:04:04.033036] [INFO ] [MAIN ] Update Progress: 486/2372 symbols completed. CMU took 17.9s. Estimated remaining: 4h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T18:04:04.199701] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:04.218575] [DEBUG] [LOCAL ] CNF: Loaded 10837 existing records from primary storage. [2025-09-19T18:04:04.218723] [INFO ] [MAIN ] CNF: Loaded 10837 existing records. [2025-09-19T18:04:04.393209] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:04.393485] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-19T18:04:04.393571] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-19T18:04:04.394035] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-19T18:04:04.394106] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-19T18:04:04.648341] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-19T18:04:04.752202] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:05.197528] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T18:04:05.443263] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-19T18:04:05.781607] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:04:06.243268] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-19T18:04:07.043286] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-19T18:04:07.117066] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T18:04:07.629714] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-19T18:04:07.843238] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-19T18:04:07.910995] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T18:04:08.643278] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-19T18:04:08.880972] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T18:04:09.005514] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-19T18:04:09.443306] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-19T18:04:10.243288] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-19T18:04:10.791121] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T18:04:11.043267] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-19T18:04:11.843317] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-19T18:04:12.055741] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T18:04:12.643391] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-19T18:04:12.716632] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (3.27 seconds). [2025-09-19T18:04:13.030005] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (10.79 seconds). [2025-09-19T18:04:13.426051] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T18:04:13.443275] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-19T18:04:13.471770] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:04:13.476893] [INFO ] [REMOTE ] CMTG: Full fetch complete (53064 records). [2025-09-19T18:04:13.477029] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-19T18:04:13.879490] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-19T18:04:13.879691] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-19T18:04:13.880334] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-19T18:04:13.880378] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-19T18:04:13.881597] [DEBUG] [LOCAL ] CMTG: Trimmed 53064 records to 38290 (keeping 200 days of data) [2025-09-19T18:04:14.115707] [DEBUG] [LOCAL ] CMTG: Primary data saved (38290 records). [2025-09-19T18:04:14.115853] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-19T18:04:14.116003] [INFO ] [MAIN ] Update Progress: 487/2372 symbols completed. CMTG took 42.8s. Estimated remaining: 4h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T18:04:14.258438] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-19T18:04:14.294601] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:14.296595] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-09-19T18:04:14.296712] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-09-19T18:04:14.296977] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-19T18:04:14.297057] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-19T18:04:14.297134] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-09-19T18:04:14.297175] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-19T18:04:14.702953] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:14.681127] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T18:04:15.043298] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-19T18:04:15.132462] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T18:04:15.843297] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-19T18:04:16.643267] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-19T18:04:17.007457] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T18:04:17.190720] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T18:04:17.443267] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-19T18:04:17.828224] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:04:18.243268] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-19T18:04:19.043237] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-19T18:04:19.165371] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T18:04:19.225808] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T18:04:19.843257] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-19T18:04:20.643283] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-19T18:04:20.901673] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T18:04:21.443276] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-19T18:04:22.148202] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T18:04:22.186678] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T18:04:22.243223] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-19T18:04:22.674283] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:04:23.043265] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-19T18:04:23.391172] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T18:04:23.395978] [INFO ] [REMOTE ] CNA: Full fetch complete (45400 records). [2025-09-19T18:04:23.396070] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-19T18:04:23.782150] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-19T18:04:23.782500] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-19T18:04:23.783377] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-19T18:04:23.783442] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-19T18:04:23.786048] [DEBUG] [LOCAL ] CNA: Trimmed 45400 records to 33238 (keeping 200 days of data) [2025-09-19T18:04:23.855573] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-19T18:04:24.012525] [DEBUG] [LOCAL ] CNA: Primary data saved (33238 records). [2025-09-19T18:04:24.012728] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-19T18:04:24.012848] [INFO ] [MAIN ] Update Progress: 488/2372 symbols completed. CNA took 33.4s. Estimated remaining: 4h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T18:04:24.191559] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:24.250079] [DEBUG] [LOCAL ] CNI: Loaded 52046 existing records from primary storage. [2025-09-19T18:04:24.250227] [INFO ] [MAIN ] CNI: Loaded 52046 existing records. [2025-09-19T18:04:24.446166] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:24.446476] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-19T18:04:24.446529] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-19T18:04:24.448280] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-19T18:04:24.448345] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-19T18:04:24.645420] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-19T18:04:24.846801] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:25.228127] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T18:04:25.443280] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-19T18:04:25.840193] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T18:04:25.842738] [INFO ] [REMOTE ] CNF: Full fetch complete (12610 records). [2025-09-19T18:04:25.842817] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-19T18:04:26.244908] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-19T18:04:26.254602] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-19T18:04:26.255994] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-19T18:04:26.256350] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-19T18:04:26.256512] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-19T18:04:26.257343] [DEBUG] [LOCAL ] CNF: Trimmed 12610 records to 10887 (keeping 200 days of data) [2025-09-19T18:04:26.337666] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T18:04:26.365552] [DEBUG] [LOCAL ] CNF: Primary data saved (10887 records). [2025-09-19T18:04:26.365714] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-19T18:04:26.365832] [INFO ] [MAIN ] Update Progress: 489/2372 symbols completed. CNF took 22.3s. Estimated remaining: 4h 7m 52s. Rate: 7.6 symbols/min [2025-09-19T18:04:26.540329] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:26.601541] [DEBUG] [LOCAL ] CNK: Loaded 53299 existing records from primary storage. [2025-09-19T18:04:26.601740] [INFO ] [MAIN ] CNK: Loaded 53299 existing records. [2025-09-19T18:04:26.785747] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:26.786006] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-19T18:04:26.786054] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-19T18:04:26.787488] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-19T18:04:26.787549] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-19T18:04:27.045773] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-19T18:04:27.166636] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:27.196495] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T18:04:27.843232] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-19T18:04:28.006138] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T18:04:28.643298] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-19T18:04:29.342015] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T18:04:29.443232] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-19T18:04:29.754382] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T18:04:30.243300] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-19T18:04:30.810294] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T18:04:31.043283] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-19T18:04:31.143743] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T18:04:31.770463] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T18:04:31.843321] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-19T18:04:32.643285] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-19T18:04:33.146680] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:04:33.443260] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-19T18:04:33.799436] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:04:34.243278] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-19T18:04:35.043305] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-19T18:04:35.354139] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:04:35.514553] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-19T18:04:35.717622] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T18:04:35.843264] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-19T18:04:36.565749] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T18:04:36.643278] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-19T18:04:37.216078] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T18:04:37.443276] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-19T18:04:38.020255] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:04:38.243260] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-19T18:04:39.043301] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-19T18:04:39.795775] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-19T18:04:39.843235] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-19T18:04:40.179204] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T18:04:40.643262] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-19T18:04:41.163606] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T18:04:41.302690] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:04:41.443277] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-19T18:04:42.243327] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-19T18:04:43.043288] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-19T18:04:43.159351] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-19T18:04:43.461540] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T18:04:43.575847] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:04:43.583372] [INFO ] [REMOTE ] CNH: Full fetch complete (77146 records). [2025-09-19T18:04:43.583504] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-19T18:04:43.584772] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:04:43.584866] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:04:43.584910] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:04:43.584997] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-19T18:04:43.585092] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-09-19T18:04:43.585160] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-09-19T18:04:43.585243] [DEBUG] [LOCAL ] CNH: No derivative data file found to delete. [2025-09-19T18:04:43.585326] [INFO ] [MAIN ] Update Progress: 490/2372 symbols completed. CNH took 29.5s. Estimated remaining: 4h 8m 20s. Rate: 7.6 symbols/min [2025-09-19T18:04:43.762796] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:43.816424] [DEBUG] [LOCAL ] CNM: Loaded 51337 existing records from primary storage. [2025-09-19T18:04:43.816598] [INFO ] [MAIN ] CNM: Loaded 51337 existing records. [2025-09-19T18:04:43.848980] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-19T18:04:44.010539] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:44.010836] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-19T18:04:44.010890] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-19T18:04:44.012192] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-19T18:04:44.012269] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-19T18:04:44.394862] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:44.643248] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-19T18:04:45.101514] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T18:04:45.443267] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-19T18:04:45.938832] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T18:04:45.948271] [INFO ] [REMOTE ] CNC: Full fetch complete (77279 records). [2025-09-19T18:04:45.948457] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-19T18:04:45.953552] [FATAL] [VALIDATOR ] CNC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:04:45.953716] [FATAL] [MAIN ] CNC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:04:45.953769] [WARN ] [MAIN ] CNC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:04:45.953835] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-19T18:04:45.953903] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-09-19T18:04:45.953938] [INFO ] [LOCAL ] CNC: Starting deletion of derivative data. [2025-09-19T18:04:45.954387] [DEBUG] [LOCAL ] CNC: Deleted derivative data file. [2025-09-19T18:04:45.956893] [INFO ] [MAIN ] Update Progress: 491/2372 symbols completed. CNC took 51.8s. Estimated remaining: 4h 7m 51s. Rate: 7.6 symbols/min [2025-09-19T18:04:46.136143] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:46.198193] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T18:04:46.220436] [DEBUG] [LOCAL ] CNMD: Loaded 32887 existing records from primary storage. [2025-09-19T18:04:46.220675] [INFO ] [MAIN ] CNMD: Loaded 32887 existing records. [2025-09-19T18:04:46.253480] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-19T18:04:46.406338] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:46.406606] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-19T18:04:46.406684] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-19T18:04:46.407758] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-19T18:04:46.407821] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-19T18:04:46.767918] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:47.043274] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-19T18:04:47.477956] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:04:47.843252] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-19T18:04:48.647302] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-19T18:04:48.651357] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-19T18:04:49.039838] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T18:04:49.443273] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-19T18:04:49.887283] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T18:04:50.087638] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:04:50.243265] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-19T18:04:51.043260] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-19T18:04:51.621630] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T18:04:51.843225] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-19T18:04:51.844737] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T18:04:51.853693] [INFO ] [REMOTE ] CNK: Full fetch complete (75623 records). [2025-09-19T18:04:51.853812] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-19T18:04:52.273701] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-19T18:04:52.273800] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-19T18:04:52.274691] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-19T18:04:52.274770] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-19T18:04:52.276930] [DEBUG] [LOCAL ] CNK: Trimmed 75623 records to 53688 (keeping 200 days of data) [2025-09-19T18:04:52.629888] [DEBUG] [LOCAL ] CNK: Primary data saved (53688 records). [2025-09-19T18:04:52.630036] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-19T18:04:52.630125] [INFO ] [MAIN ] Update Progress: 492/2372 symbols completed. CNK took 26.3s. Estimated remaining: 4h 7m 38s. Rate: 7.6 symbols/min [2025-09-19T18:04:52.655263] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-19T18:04:52.814942] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:52.853373] [DEBUG] [LOCAL ] CNNE: Loaded 37218 existing records from primary storage. [2025-09-19T18:04:52.853518] [INFO ] [MAIN ] CNNE: Loaded 37218 existing records. [2025-09-19T18:04:53.037549] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:53.037990] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-19T18:04:53.038209] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-19T18:04:53.039407] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-19T18:04:53.039475] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-19T18:04:53.258284] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T18:04:53.449780] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:53.446012] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-19T18:04:53.596188] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:04:54.243273] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-19T18:04:54.315944] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T18:04:55.043277] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-19T18:04:55.189767] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T18:04:55.843241] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-19T18:04:56.408599] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T18:04:56.433227] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T18:04:56.441691] [INFO ] [REMOTE ] CNI: Full fetch complete (74683 records). [2025-09-19T18:04:56.441866] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-19T18:04:56.651363] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-19T18:04:56.886421] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-19T18:04:56.886503] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-19T18:04:56.887310] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-19T18:04:56.887374] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-19T18:04:56.888810] [DEBUG] [LOCAL ] CNI: Trimmed 74683 records to 52411 (keeping 200 days of data) [2025-09-19T18:04:57.226414] [DEBUG] [LOCAL ] CNI: Primary data saved (52411 records). [2025-09-19T18:04:57.226603] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-19T18:04:57.226817] [INFO ] [MAIN ] Update Progress: 493/2372 symbols completed. CNI took 33.2s. Estimated remaining: 4h 7m 18s. Rate: 7.6 symbols/min [2025-09-19T18:04:57.415453] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T18:04:57.433218] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:04:57.447728] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-19T18:04:57.494417] [DEBUG] [LOCAL ] CNO: Loaded 41931 existing records from primary storage. [2025-09-19T18:04:57.494571] [INFO ] [MAIN ] CNO: Loaded 41931 existing records. [2025-09-19T18:04:57.686711] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:04:57.686992] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-19T18:04:57.687062] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-19T18:04:57.688970] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-19T18:04:57.689034] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-19T18:04:58.077535] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:04:58.099716] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:04:58.243275] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-19T18:04:59.043277] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-19T18:04:59.115343] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T18:04:59.843238] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-19T18:04:59.913452] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T18:05:00.526859] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T18:05:00.643282] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-19T18:05:01.443250] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-19T18:05:01.568618] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:05:01.666847] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T18:05:02.243334] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-19T18:05:03.043280] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-19T18:05:03.660155] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T18:05:03.843268] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-19T18:05:04.028098] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:05:04.347849] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:05:04.643304] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-19T18:05:05.058947] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T18:05:05.443305] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-19T18:05:06.243266] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-19T18:05:06.421296] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T18:05:07.043291] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-19T18:05:07.200527] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T18:05:07.843273] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-19T18:05:07.904293] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:05:08.648343] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-19T18:05:08.667335] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:05:09.443267] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-19T18:05:09.986354] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T18:05:10.116484] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T18:05:10.243282] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-19T18:05:10.840524] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:05:11.043222] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-19T18:05:11.501037] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T18:05:11.843253] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-19T18:05:12.643268] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-19T18:05:12.884531] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T18:05:13.085784] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T18:05:13.443325] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-19T18:05:14.027516] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T18:05:14.243319] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-19T18:05:14.645496] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:05:15.043287] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-19T18:05:15.843252] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-19T18:05:16.086713] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T18:05:16.231848] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:05:16.643272] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-19T18:05:17.444900] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-19T18:05:17.448434] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T18:05:17.457255] [INFO ] [REMOTE ] CNM: Full fetch complete (73628 records). [2025-09-19T18:05:17.457442] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-19T18:05:17.884460] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-19T18:05:17.884586] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-19T18:05:17.885542] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-19T18:05:17.885610] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-19T18:05:17.887357] [DEBUG] [LOCAL ] CNM: Trimmed 73628 records to 51723 (keeping 200 days of data) [2025-09-19T18:05:18.191932] [DEBUG] [LOCAL ] CNM: Primary data saved (51723 records). [2025-09-19T18:05:18.192120] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-19T18:05:18.192236] [INFO ] [MAIN ] Update Progress: 494/2372 symbols completed. CNM took 34.6s. Estimated remaining: 4h 7m 59s. Rate: 7.6 symbols/min [2025-09-19T18:05:18.256442] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-19T18:05:18.372151] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:18.400478] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T18:05:18.456590] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-09-19T18:05:18.456812] [INFO ] [MAIN ] CNP: Loaded 53859 existing records. [2025-09-19T18:05:18.639302] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:05:18.639602] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-19T18:05:18.639683] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-19T18:05:18.641213] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-19T18:05:18.641277] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-19T18:05:18.995661] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:19.043258] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-19T18:05:19.124716] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T18:05:19.835137] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T18:05:19.840196] [INFO ] [REMOTE ] CNMD: Full fetch complete (46876 records). [2025-09-19T18:05:19.840303] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-19T18:05:19.852248] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-19T18:05:20.245519] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-19T18:05:20.245611] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-19T18:05:20.246441] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-19T18:05:20.246526] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-19T18:05:20.248341] [DEBUG] [LOCAL ] CNMD: Trimmed 46876 records to 33083 (keeping 200 days of data) [2025-09-19T18:05:20.465617] [DEBUG] [LOCAL ] CNMD: Primary data saved (33083 records). [2025-09-19T18:05:20.465908] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-19T18:05:20.466175] [INFO ] [MAIN ] Update Progress: 495/2372 symbols completed. CNMD took 34.5s. Estimated remaining: 4h 7m 30s. Rate: 7.6 symbols/min [2025-09-19T18:05:20.641243] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:20.641445] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-09-19T18:05:20.641483] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-09-19T18:05:20.641682] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-19T18:05:20.641737] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-19T18:05:20.641780] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-09-19T18:05:20.641814] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-19T18:05:20.673775] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-19T18:05:21.009703] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:21.275418] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T18:05:21.443271] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-19T18:05:21.838246] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T18:05:22.243291] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-19T18:05:22.484738] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T18:05:23.043256] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-19T18:05:23.513212] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T18:05:23.843269] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-19T18:05:24.061579] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T18:05:24.643312] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-19T18:05:24.866005] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T18:05:25.282331] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T18:05:25.291540] [INFO ] [REMOTE ] CNNE: Full fetch complete (49013 records). [2025-09-19T18:05:25.291818] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-19T18:05:25.451143] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-19T18:05:25.863062] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-19T18:05:25.863188] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-19T18:05:25.863893] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-19T18:05:25.863962] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-19T18:05:25.865277] [DEBUG] [LOCAL ] CNNE: Trimmed 49013 records to 37488 (keeping 200 days of data) [2025-09-19T18:05:26.099783] [DEBUG] [LOCAL ] CNNE: Primary data saved (37488 records). [2025-09-19T18:05:26.099924] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-19T18:05:26.100020] [INFO ] [MAIN ] Update Progress: 496/2372 symbols completed. CNNE took 33.5s. Estimated remaining: 4h 7m 13s. Rate: 7.6 symbols/min [2025-09-19T18:05:26.272243] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-19T18:05:26.276734] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:26.277093] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-19T18:05:26.277203] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-19T18:05:26.277525] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-19T18:05:26.277667] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-19T18:05:26.277812] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-19T18:05:26.277923] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-19T18:05:26.413152] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T18:05:26.442267] [INFO ] [REMOTE ] CNO: Full fetch complete (60553 records). [2025-09-19T18:05:26.464260] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-19T18:05:26.867862] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:27.048377] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-19T18:05:27.124336] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-19T18:05:27.124445] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-19T18:05:27.125420] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-19T18:05:27.125743] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-19T18:05:27.127330] [DEBUG] [LOCAL ] CNO: Trimmed 60553 records to 42229 (keeping 200 days of data) [2025-09-19T18:05:27.390099] [DEBUG] [LOCAL ] CNO: Primary data saved (42229 records). [2025-09-19T18:05:27.390368] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-19T18:05:27.390513] [INFO ] [MAIN ] Update Progress: 497/2372 symbols completed. CNO took 30.2s. Estimated remaining: 4h 6m 41s. Rate: 7.6 symbols/min [2025-09-19T18:05:27.465235] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:05:27.501805] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-19T18:05:27.579224] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:27.638735] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:05:27.657621] [DEBUG] [LOCAL ] CNS: Loaded 21340 existing records from primary storage. [2025-09-19T18:05:27.657781] [INFO ] [MAIN ] CNS: Loaded 21340 existing records. [2025-09-19T18:05:27.836330] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:05:27.836623] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-19T18:05:27.836708] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-19T18:05:27.837517] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-19T18:05:27.837580] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-19T18:05:27.849303] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-19T18:05:28.223011] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:28.592049] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-19T18:05:28.643213] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-19T18:05:29.443295] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-19T18:05:29.813575] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:05:30.243264] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-19T18:05:30.859859] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:05:30.901879] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:05:31.043292] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-19T18:05:31.843287] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-19T18:05:32.572510] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-19T18:05:32.602323] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:05:32.643224] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-19T18:05:33.443272] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-19T18:05:34.145695] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T18:05:34.243235] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-19T18:05:34.540865] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T18:05:35.043256] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-19T18:05:35.781429] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T18:05:35.843263] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-19T18:05:36.218509] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:05:36.333440] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T18:05:36.643266] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-19T18:05:37.351297] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T18:05:37.443233] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-19T18:05:38.243263] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-19T18:05:38.466398] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T18:05:39.056631] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-19T18:05:39.082483] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T18:05:39.843274] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-19T18:05:39.983022] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T18:05:40.346709] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:05:40.643266] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-19T18:05:41.443259] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-19T18:05:41.918245] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T18:05:42.043558] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T18:05:42.243268] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-19T18:05:43.043279] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-19T18:05:43.471951] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T18:05:43.843219] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-19T18:05:44.488603] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T18:05:44.643264] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-19T18:05:45.360377] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T18:05:45.443277] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-19T18:05:45.626778] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T18:05:46.034733] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:05:46.243312] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-19T18:05:47.043300] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-19T18:05:47.533209] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T18:05:47.540631] [INFO ] [REMOTE ] CNP: Full fetch complete (76968 records). [2025-09-19T18:05:47.540828] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-19T18:05:47.541604] [FATAL] [VALIDATOR ] CNP: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:05:47.541760] [FATAL] [MAIN ] CNP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:05:47.541812] [WARN ] [MAIN ] CNP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:05:47.541876] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-19T18:05:47.541942] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-09-19T18:05:47.541978] [INFO ] [LOCAL ] CNP: Starting deletion of derivative data. [2025-09-19T18:05:47.542422] [DEBUG] [LOCAL ] CNP: Deleted derivative data file. [2025-09-19T18:05:47.542526] [INFO ] [MAIN ] Update Progress: 498/2372 symbols completed. CNP took 29.4s. Estimated remaining: 4h 7m 19s. Rate: 7.6 symbols/min [2025-09-19T18:05:47.732382] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:47.818083] [DEBUG] [LOCAL ] CNX: Loaded 51751 existing records from primary storage. [2025-09-19T18:05:47.816892] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:05:47.829684] [INFO ] [MAIN ] CNX: Loaded 51751 existing records. [2025-09-19T18:05:47.852077] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-19T18:05:48.026826] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:05:48.027140] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-19T18:05:48.027219] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-19T18:05:48.028629] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-19T18:05:48.028719] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-19T18:05:48.395886] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:48.593107] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T18:05:48.643264] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-19T18:05:49.266531] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T18:05:49.443289] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-19T18:05:50.243295] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-19T18:05:50.721162] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:05:51.043288] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-19T18:05:51.148280] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T18:05:51.721501] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:05:51.729806] [INFO ] [REMOTE ] CNQ: Full fetch complete (77541 records). [2025-09-19T18:05:51.729938] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-19T18:05:51.848387] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-19T18:05:52.125254] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-19T18:05:52.125342] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-19T18:05:52.126177] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-19T18:05:52.126241] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-19T18:05:52.127757] [DEBUG] [LOCAL ] CNQ: Trimmed 77541 records to 54362 (keeping 200 days of data) [2025-09-19T18:05:52.460608] [DEBUG] [LOCAL ] CNQ: Primary data saved (54362 records). [2025-09-19T18:05:52.460783] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-19T18:05:52.460867] [INFO ] [MAIN ] Update Progress: 499/2372 symbols completed. CNQ took 32.0s. Estimated remaining: 4h 6m 60s. Rate: 7.6 symbols/min [2025-09-19T18:05:52.636672] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:52.653280] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-19T18:05:52.684983] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T18:05:52.735725] [DEBUG] [LOCAL ] CODI: Loaded 39862 existing records from primary storage. [2025-09-19T18:05:52.735877] [INFO ] [MAIN ] CODI: Loaded 39862 existing records. [2025-09-19T18:05:52.925356] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:05:52.925692] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-19T18:05:52.925752] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-19T18:05:52.926723] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-19T18:05:52.926788] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-19T18:05:53.299112] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:53.443245] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-19T18:05:53.914190] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T18:05:53.921187] [INFO ] [REMOTE ] CNR: Full fetch complete (55273 records). [2025-09-19T18:05:53.921470] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-19T18:05:54.100707] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T18:05:54.150791] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 171 unique days, need 200 days [2025-09-19T18:05:54.151446] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:05:54.151522] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:05:54.151600] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-19T18:05:54.151701] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-19T18:05:54.151759] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-19T18:05:54.151803] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-19T18:05:54.151897] [INFO ] [MAIN ] Update Progress: 500/2372 symbols completed. CNR took 28.1s. Estimated remaining: 4h 6m 28s. Rate: 7.6 symbols/min [2025-09-19T18:05:54.244682] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-19T18:05:54.328014] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:05:54.328200] [DEBUG] [LOCAL ] COF: No existing data file found in primary storage. [2025-09-19T18:05:54.328236] [WARN ] [MAIN ] COF: No existing data found, performing full refresh instead. [2025-09-19T18:05:54.328380] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-19T18:05:54.328424] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-19T18:05:54.328465] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-09-19T18:05:54.328496] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-19T18:05:54.689509] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:05:54.703964] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T18:05:55.043273] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-19T18:05:55.843235] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-19T18:05:56.201181] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:05:56.222748] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:05:56.643264] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-19T18:05:57.436477] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T18:05:57.443836] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-19T18:05:57.529842] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T18:05:58.243307] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-19T18:05:58.997492] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T18:05:59.043257] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-19T18:05:59.627885] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:05:59.843260] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-19T18:06:00.643272] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-19T18:06:01.160762] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T18:06:01.224028] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T18:06:01.443271] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-19T18:06:01.620679] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:06:02.243259] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-19T18:06:03.043315] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-19T18:06:03.843294] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-19T18:06:04.336492] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-19T18:06:04.643306] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-19T18:06:05.381971] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (3.14 seconds). [2025-09-19T18:06:05.385759] [INFO ] [REMOTE ] CNS: Full fetch complete (29743 records). [2025-09-19T18:06:05.385899] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-19T18:06:05.759322] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-19T18:06:05.759416] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-19T18:06:05.759883] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-19T18:06:05.759944] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-19T18:06:05.760712] [DEBUG] [LOCAL ] CNS: Trimmed 29743 records to 21458 (keeping 200 days of data) [2025-09-19T18:06:05.896316] [DEBUG] [LOCAL ] CNS: Primary data saved (21458 records). [2025-09-19T18:06:05.896481] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-19T18:06:05.896907] [INFO ] [MAIN ] Update Progress: 501/2372 symbols completed. CNS took 38.5s. Estimated remaining: 4h 6m 35s. Rate: 7.6 symbols/min [2025-09-19T18:06:06.072379] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:06.124826] [DEBUG] [LOCAL ] COHR: Loaded 53762 existing records from primary storage. [2025-09-19T18:06:06.124975] [INFO ] [MAIN ] COHR: Loaded 53762 existing records. [2025-09-19T18:06:06.302328] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:06.302587] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-19T18:06:06.302635] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-19T18:06:06.303939] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-19T18:06:06.304007] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-19T18:06:06.677168] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:06.677704] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-19T18:06:06.793399] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (3.75 seconds). [2025-09-19T18:06:06.804527] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-19T18:06:07.503229] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (3.66 seconds). [2025-09-19T18:06:07.510485] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-19T18:06:07.674841] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (3.03 seconds). [2025-09-19T18:06:07.843324] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-19T18:06:08.595379] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:06:08.643220] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-19T18:06:09.003503] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T18:06:09.052811] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T18:06:09.220111] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:06:09.443260] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-19T18:06:10.115334] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:06:10.243345] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-19T18:06:11.043283] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-19T18:06:11.636707] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:06:11.843252] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-19T18:06:12.428219] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T18:06:12.643293] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-19T18:06:13.269958] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T18:06:13.443234] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-19T18:06:14.131780] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T18:06:14.243249] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-19T18:06:14.706703] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:06:14.714370] [INFO ] [REMOTE ] CNX: Full fetch complete (74754 records). [2025-09-19T18:06:14.714546] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-19T18:06:15.054569] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-19T18:06:15.161280] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-19T18:06:15.161378] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-19T18:06:15.162405] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-19T18:06:15.162476] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-19T18:06:15.165249] [DEBUG] [LOCAL ] CNX: Trimmed 74754 records to 52136 (keeping 200 days of data) [2025-09-19T18:06:15.462478] [DEBUG] [LOCAL ] CNX: Primary data saved (52136 records). [2025-09-19T18:06:15.462712] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-19T18:06:15.462864] [INFO ] [MAIN ] Update Progress: 502/2372 symbols completed. CNX took 27.9s. Estimated remaining: 4h 6m 33s. Rate: 7.6 symbols/min [2025-09-19T18:06:15.643439] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:15.701542] [DEBUG] [LOCAL ] COLD: Loaded 52280 existing records from primary storage. [2025-09-19T18:06:15.701724] [INFO ] [MAIN ] COLD: Loaded 52280 existing records. [2025-09-19T18:06:15.888094] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:15.888622] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-19T18:06:15.888789] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-19T18:06:15.890007] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-19T18:06:15.890282] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-19T18:06:16.132280] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-09-19T18:06:16.200671] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-19T18:06:16.321544] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:16.559469] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T18:06:16.626074] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T18:06:16.643220] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-19T18:06:17.443307] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-19T18:06:18.243269] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-19T18:06:18.577471] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T18:06:19.033364] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-19T18:06:19.050896] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-19T18:06:19.723853] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T18:06:19.843289] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-19T18:06:19.847442] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:06:20.643370] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-19T18:06:21.443229] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-19T18:06:22.086858] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:06:22.248463] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-19T18:06:22.267683] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (3.22 seconds). [2025-09-19T18:06:22.934790] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T18:06:23.043305] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-19T18:06:23.649783] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T18:06:23.659239] [INFO ] [REMOTE ] CODI: Full fetch complete (49948 records). [2025-09-19T18:06:23.659466] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-19T18:06:23.850392] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-19T18:06:24.094132] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-19T18:06:24.124296] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-19T18:06:24.124664] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-19T18:06:24.125548] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-19T18:06:24.126012] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-19T18:06:24.127354] [DEBUG] [LOCAL ] CODI: Trimmed 49948 records to 40123 (keeping 200 days of data) [2025-09-19T18:06:24.373461] [DEBUG] [LOCAL ] CODI: Primary data saved (40123 records). [2025-09-19T18:06:24.373591] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-19T18:06:24.375258] [INFO ] [MAIN ] Update Progress: 503/2372 symbols completed. CODI took 31.9s. Estimated remaining: 4h 6m 29s. Rate: 7.6 symbols/min [2025-09-19T18:06:24.551108] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:24.614739] [DEBUG] [LOCAL ] COMP: Loaded 53771 existing records from primary storage. [2025-09-19T18:06:24.614911] [INFO ] [MAIN ] COMP: Loaded 53771 existing records. [2025-09-19T18:06:24.648538] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-19T18:06:24.804905] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:24.805150] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-19T18:06:24.805198] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-19T18:06:24.806365] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-19T18:06:24.806443] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-19T18:06:25.180524] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:25.365011] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-19T18:06:25.407546] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T18:06:25.443222] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-19T18:06:26.243275] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-19T18:06:26.315875] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T18:06:27.043278] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-19T18:06:27.402158] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T18:06:27.843269] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-19T18:06:28.104214] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T18:06:28.643272] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-19T18:06:29.012680] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T18:06:29.443230] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-19T18:06:29.476816] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:06:29.485455] [INFO ] [REMOTE ] COF: Full fetch complete (77380 records). [2025-09-19T18:06:29.485687] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-19T18:06:29.899479] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-19T18:06:29.899624] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-19T18:06:29.900497] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-19T18:06:29.900570] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-19T18:06:29.902774] [DEBUG] [LOCAL ] COF: Trimmed 77380 records to 54390 (keeping 200 days of data) [2025-09-19T18:06:30.243313] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-19T18:06:30.262976] [DEBUG] [LOCAL ] COF: Primary data saved (54390 records). [2025-09-19T18:06:30.263106] [INFO ] [MAIN ] COF: Full history saved. [2025-09-19T18:06:30.263201] [INFO ] [MAIN ] Update Progress: 504/2372 symbols completed. COF took 36.1s. Estimated remaining: 4h 6m 14s. Rate: 7.6 symbols/min [2025-09-19T18:06:30.460623] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:30.501318] [DEBUG] [LOCAL ] CON: Loaded 39213 existing records from primary storage. [2025-09-19T18:06:30.501463] [INFO ] [MAIN ] CON: Loaded 39213 existing records. [2025-09-19T18:06:30.701319] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:30.701729] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-19T18:06:30.701810] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-19T18:06:30.703294] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-19T18:06:30.703363] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-19T18:06:31.067476] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:31.068071] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-19T18:06:31.109719] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-19T18:06:31.156681] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T18:06:31.696229] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T18:06:31.843282] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-19T18:06:32.288113] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T18:06:32.643291] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-19T18:06:33.443310] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-19T18:06:33.927822] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:06:34.243292] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-19T18:06:34.441948] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T18:06:35.043291] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-19T18:06:35.741717] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-19T18:06:35.843277] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-19T18:06:36.049988] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:06:36.199127] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T18:06:36.643322] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-19T18:06:37.188113] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T18:06:37.443259] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-19T18:06:38.243271] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-19T18:06:38.281548] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T18:06:39.043325] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-19T18:06:39.565454] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T18:06:39.843271] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-19T18:06:40.099138] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T18:06:40.107291] [INFO ] [REMOTE ] COHR: Full fetch complete (77080 records). [2025-09-19T18:06:40.107468] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-19T18:06:40.522974] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-19T18:06:40.523089] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-19T18:06:40.523963] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-19T18:06:40.524046] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-19T18:06:40.546363] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T18:06:40.554238] [DEBUG] [LOCAL ] COHR: Trimmed 77080 records to 54145 (keeping 200 days of data) [2025-09-19T18:06:40.657489] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-19T18:06:40.892201] [DEBUG] [LOCAL ] COHR: Primary data saved (54145 records). [2025-09-19T18:06:40.892341] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-19T18:06:40.892490] [INFO ] [MAIN ] Update Progress: 505/2372 symbols completed. COHR took 35.0s. Estimated remaining: 4h 6m 16s. Rate: 7.6 symbols/min [2025-09-19T18:06:41.069854] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:41.099352] [DEBUG] [LOCAL ] COOK: Loaded 24332 existing records from primary storage. [2025-09-19T18:06:41.099515] [INFO ] [MAIN ] COOK: Loaded 24332 existing records. [2025-09-19T18:06:41.277484] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:41.277776] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-19T18:06:41.277830] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-19T18:06:41.278488] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-19T18:06:41.278548] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-19T18:06:41.443557] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-19T18:06:41.667243] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:42.087211] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T18:06:42.243274] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-19T18:06:42.310774] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T18:06:43.048413] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-19T18:06:43.063828] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:06:43.494432] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T18:06:43.843282] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-19T18:06:44.643282] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-19T18:06:45.189947] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T18:06:45.443271] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-19T18:06:45.630178] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:06:46.154361] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T18:06:46.248419] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-19T18:06:46.262145] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T18:06:46.270779] [INFO ] [REMOTE ] COLD: Full fetch complete (74035 records). [2025-09-19T18:06:46.271002] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-19T18:06:46.681593] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-19T18:06:46.681743] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-19T18:06:46.682603] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-19T18:06:46.682694] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-19T18:06:46.684392] [DEBUG] [LOCAL ] COLD: Trimmed 74035 records to 52669 (keeping 200 days of data) [2025-09-19T18:06:47.014129] [DEBUG] [LOCAL ] COLD: Primary data saved (52669 records). [2025-09-19T18:06:47.014279] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-19T18:06:47.014364] [INFO ] [MAIN ] Update Progress: 506/2372 symbols completed. COLD took 31.6s. Estimated remaining: 4h 6m 1s. Rate: 7.6 symbols/min [2025-09-19T18:06:47.048436] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-19T18:06:47.185293] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:47.245380] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-09-19T18:06:47.245555] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-09-19T18:06:47.433327] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:47.433994] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-19T18:06:47.434130] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-19T18:06:47.435566] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-19T18:06:47.435669] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-19T18:06:47.737469] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T18:06:47.849207] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:47.845971] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-19T18:06:47.873817] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T18:06:48.643264] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-19T18:06:49.298679] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T18:06:49.443263] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-19T18:06:50.243294] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-19T18:06:51.043277] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-19T18:06:51.089709] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-19T18:06:51.211514] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T18:06:51.577291] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T18:06:51.843301] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-19T18:06:52.260066] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T18:06:52.643232] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-19T18:06:53.117491] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T18:06:53.443262] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-19T18:06:54.243243] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-19T18:06:54.279955] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T18:06:54.895737] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T18:06:55.043267] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-19T18:06:55.843276] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-19T18:06:56.274547] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T18:06:56.282899] [INFO ] [REMOTE ] CON: Full fetch complete (57371 records). [2025-09-19T18:06:56.283105] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-19T18:06:56.655053] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-19T18:06:56.692357] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-19T18:06:56.692512] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-19T18:06:56.693351] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-19T18:06:56.693429] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-19T18:06:56.694782] [DEBUG] [LOCAL ] CON: Trimmed 57371 records to 39527 (keeping 200 days of data) [2025-09-19T18:06:56.940590] [DEBUG] [LOCAL ] CON: Primary data saved (39527 records). [2025-09-19T18:06:56.940801] [INFO ] [MAIN ] CON: Full history saved. [2025-09-19T18:06:56.940924] [INFO ] [MAIN ] Update Progress: 507/2372 symbols completed. CON took 26.7s. Estimated remaining: 4h 6m 1s. Rate: 7.6 symbols/min [2025-09-19T18:06:57.131772] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:06:57.173619] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T18:06:57.216784] [DEBUG] [LOCAL ] COR: Loaded 47685 existing records from primary storage. [2025-09-19T18:06:57.216945] [INFO ] [MAIN ] COR: Loaded 47685 existing records. [2025-09-19T18:06:57.423870] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:06:57.424181] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-19T18:06:57.424237] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-19T18:06:57.425426] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-19T18:06:57.425491] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-19T18:06:57.448387] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-19T18:06:57.806213] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:06:57.864197] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T18:06:58.223700] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T18:06:58.243213] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-19T18:06:59.043229] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-19T18:06:59.769321] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T18:06:59.832126] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T18:06:59.843235] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-19T18:07:00.643227] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-19T18:07:00.701461] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:07:01.443305] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-19T18:07:02.014954] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T18:07:02.024983] [INFO ] [REMOTE ] COMP: Full fetch complete (76673 records). [2025-09-19T18:07:02.025299] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-19T18:07:02.028516] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:07:02.028702] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:07:02.028762] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:07:02.028854] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-19T18:07:02.028968] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-09-19T18:07:02.029040] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-09-19T18:07:02.029541] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-09-19T18:07:02.030259] [INFO ] [MAIN ] Update Progress: 508/2372 symbols completed. COMP took 37.7s. Estimated remaining: 4h 5m 42s. Rate: 7.6 symbols/min [2025-09-19T18:07:02.233429] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:02.233728] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-09-19T18:07:02.233786] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-09-19T18:07:02.233979] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-19T18:07:02.234029] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-19T18:07:02.234111] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-09-19T18:07:02.234203] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-19T18:07:02.249045] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-19T18:07:02.647393] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:02.687723] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:07:02.865397] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T18:07:03.043308] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-19T18:07:03.843334] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-19T18:07:04.458197] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T18:07:04.643325] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-19T18:07:04.843595] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T18:07:05.443866] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-19T18:07:05.847079] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T18:07:06.243305] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-19T18:07:06.926714] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T18:07:07.050217] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-19T18:07:07.071691] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T18:07:07.843273] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-19T18:07:08.529591] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-19T18:07:08.643255] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-19T18:07:08.889425] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T18:07:08.893610] [INFO ] [REMOTE ] COOK: Full fetch complete (32873 records). [2025-09-19T18:07:08.893726] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-19T18:07:09.269708] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-19T18:07:09.269792] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-19T18:07:09.270271] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-19T18:07:09.270310] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-19T18:07:09.271097] [DEBUG] [LOCAL ] COOK: Trimmed 32873 records to 24488 (keeping 200 days of data) [2025-09-19T18:07:09.405076] [DEBUG] [LOCAL ] COOK: Primary data saved (24488 records). [2025-09-19T18:07:09.405212] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-19T18:07:09.405299] [INFO ] [MAIN ] Update Progress: 509/2372 symbols completed. COOK took 28.5s. Estimated remaining: 4h 5m 33s. Rate: 7.6 symbols/min [2025-09-19T18:07:09.472494] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-19T18:07:09.583897] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:09.628405] [DEBUG] [LOCAL ] COUR: Loaded 49223 existing records from primary storage. [2025-09-19T18:07:09.628562] [INFO ] [MAIN ] COUR: Loaded 49223 existing records. [2025-09-19T18:07:09.814075] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:09.814537] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-19T18:07:09.814621] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-19T18:07:09.816014] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-19T18:07:09.816083] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-19T18:07:10.011462] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T18:07:10.224283] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:10.243267] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-19T18:07:10.940005] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T18:07:11.043229] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-19T18:07:11.631020] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T18:07:11.759098] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T18:07:11.843233] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-19T18:07:12.643239] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-19T18:07:13.421805] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T18:07:13.448335] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-19T18:07:13.465331] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T18:07:14.243277] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-19T18:07:14.701275] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T18:07:15.043287] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-19T18:07:15.547590] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T18:07:15.843271] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-19T18:07:16.162377] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T18:07:16.589491] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T18:07:16.643323] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-19T18:07:17.443536] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-19T18:07:17.825236] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:07:18.068690] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T18:07:18.243351] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-19T18:07:19.043278] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-19T18:07:19.567118] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T18:07:19.843233] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-19T18:07:20.066837] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T18:07:20.643275] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-19T18:07:20.736884] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T18:07:20.746451] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-19T18:07:20.746606] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-19T18:07:21.153665] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-19T18:07:21.153760] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-19T18:07:21.154572] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-19T18:07:21.154615] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-19T18:07:21.156167] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54507 (keeping 200 days of data) [2025-09-19T18:07:21.447437] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-19T18:07:21.492428] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-09-19T18:07:21.492582] [INFO ] [MAIN ] COP: Full history saved. [2025-09-19T18:07:21.492695] [INFO ] [MAIN ] Update Progress: 510/2372 symbols completed. COP took 34.5s. Estimated remaining: 4h 5m 40s. Rate: 7.6 symbols/min [2025-09-19T18:07:21.662588] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:21.714062] [DEBUG] [LOCAL ] CP: Loaded 53681 existing records from primary storage. [2025-09-19T18:07:21.714232] [INFO ] [MAIN ] CP: Loaded 53681 existing records. [2025-09-19T18:07:21.895511] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:21.896028] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-19T18:07:21.896117] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-19T18:07:21.905785] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-19T18:07:21.921041] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-19T18:07:21.987070] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T18:07:22.246261] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-19T18:07:22.315421] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:22.351382] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T18:07:22.966089] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T18:07:23.043231] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-19T18:07:23.843269] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-19T18:07:24.326780] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:07:24.643240] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-19T18:07:24.931512] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T18:07:25.376350] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:07:25.443234] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-19T18:07:26.017636] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T18:07:26.243279] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-19T18:07:26.949790] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T18:07:27.043281] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-19T18:07:27.848362] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-19T18:07:27.860083] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:07:28.643289] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-19T18:07:29.062729] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T18:07:29.443293] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-19T18:07:29.783470] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T18:07:29.790518] [INFO ] [REMOTE ] COR: Full fetch complete (68847 records). [2025-09-19T18:07:29.790674] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-19T18:07:30.201139] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-19T18:07:30.201243] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-19T18:07:30.202246] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-19T18:07:30.202323] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-19T18:07:30.204156] [DEBUG] [LOCAL ] COR: Trimmed 68847 records to 48035 (keeping 200 days of data) [2025-09-19T18:07:30.268828] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-19T18:07:30.619538] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T18:07:30.643192] [INFO ] [REMOTE ] COTY: Full fetch complete (77100 records). [2025-09-19T18:07:30.644634] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-19T18:07:31.213939] [DEBUG] [LOCAL ] COR: Primary data saved (48035 records). [2025-09-19T18:07:31.250242] [INFO ] [MAIN ] COR: Full history saved. [2025-09-19T18:07:31.276858] [INFO ] [MAIN ] Update Progress: 511/2372 symbols completed. COR took 34.3s. Estimated remaining: 4h 5m 39s. Rate: 7.6 symbols/min [2025-09-19T18:07:31.297109] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-19T18:07:31.332329] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-19T18:07:31.380905] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-19T18:07:31.410168] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-19T18:07:31.488099] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:31.488354] [DEBUG] [LOCAL ] COTY: Trimmed 77100 records to 54037 (keeping 200 days of data) [2025-09-19T18:07:31.627398] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T18:07:31.655515] [DEBUG] [LOCAL ] CPA: Loaded 29299 existing records from primary storage. [2025-09-19T18:07:31.655098] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-19T18:07:31.657340] [INFO ] [MAIN ] CPA: Loaded 29299 existing records. [2025-09-19T18:07:31.938279] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:31.940835] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-19T18:07:31.942030] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-19T18:07:31.944531] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-19T18:07:31.944878] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-19T18:07:32.363045] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:32.370397] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-19T18:07:32.416901] [DEBUG] [LOCAL ] COTY: Primary data saved (54037 records). [2025-09-19T18:07:32.417065] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-19T18:07:32.417148] [INFO ] [MAIN ] Update Progress: 512/2372 symbols completed. COTY took 30.4s. Estimated remaining: 4h 5m 6s. Rate: 7.6 symbols/min [2025-09-19T18:07:32.605838] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:32.624125] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-19T18:07:32.626371] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-19T18:07:32.624478] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-19T18:07:32.637374] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-19T18:07:32.637871] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-19T18:07:32.637954] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-19T18:07:32.637992] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-19T18:07:32.669797] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-19T18:07:32.994880] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:33.324323] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T18:07:33.443271] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-19T18:07:34.085698] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T18:07:34.243248] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-19T18:07:34.830583] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:07:34.911604] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:07:35.043255] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-19T18:07:35.241116] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:07:35.843311] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-19T18:07:36.643267] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-19T18:07:36.678706] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T18:07:37.250639] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:07:37.443271] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-19T18:07:38.243272] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-19T18:07:38.706112] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:07:38.717707] [INFO ] [REMOTE ] COUR: Full fetch complete (70545 records). [2025-09-19T18:07:38.717889] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-19T18:07:38.719057] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:07:38.719159] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:07:38.719203] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:07:38.719282] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-19T18:07:38.719363] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-09-19T18:07:38.719400] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-09-19T18:07:38.719782] [DEBUG] [LOCAL ] COUR: Deleted derivative data file. [2025-09-19T18:07:38.719890] [INFO ] [MAIN ] Update Progress: 513/2372 symbols completed. COUR took 29.3s. Estimated remaining: 4h 4m 53s. Rate: 7.6 symbols/min [2025-09-19T18:07:38.901223] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:38.934477] [DEBUG] [LOCAL ] CPAY: Loaded 31613 existing records from primary storage. [2025-09-19T18:07:38.934620] [INFO ] [MAIN ] CPAY: Loaded 31613 existing records. [2025-09-19T18:07:39.043700] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-19T18:07:39.130016] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:39.134975] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-19T18:07:39.135063] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-19T18:07:39.134574] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T18:07:39.162687] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-19T18:07:39.167259] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-19T18:07:39.253153] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T18:07:39.544063] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:39.843276] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-19T18:07:40.515011] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T18:07:40.643254] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-19T18:07:41.038097] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T18:07:41.443265] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-19T18:07:42.169181] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:07:42.243239] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-19T18:07:42.609512] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-19T18:07:42.863256] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T18:07:43.043272] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-19T18:07:43.392671] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-19T18:07:43.843274] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-19T18:07:44.261487] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T18:07:44.643291] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-19T18:07:45.443318] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-19T18:07:46.243333] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-19T18:07:46.410783] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T18:07:47.043336] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-19T18:07:47.066415] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T18:07:47.843321] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-19T18:07:47.909378] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T18:07:48.013729] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:07:48.266609] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T18:07:48.643279] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-19T18:07:49.161082] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T18:07:49.443270] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-19T18:07:50.243280] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-19T18:07:51.043285] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-19T18:07:51.546993] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T18:07:51.839442] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T18:07:51.844983] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-19T18:07:52.160915] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T18:07:52.643266] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-19T18:07:53.068134] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-19T18:07:53.443274] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-19T18:07:53.962850] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T18:07:53.970902] [INFO ] [REMOTE ] CP: Full fetch complete (77137 records). [2025-09-19T18:07:53.971035] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-19T18:07:54.248408] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-19T18:07:54.388937] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-19T18:07:54.389067] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-19T18:07:54.390525] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-19T18:07:54.390665] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-19T18:07:54.392591] [DEBUG] [LOCAL ] CP: Trimmed 77137 records to 54068 (keeping 200 days of data) [2025-09-19T18:07:54.733227] [DEBUG] [LOCAL ] CP: Primary data saved (54068 records). [2025-09-19T18:07:54.733452] [INFO ] [MAIN ] CP: Full history saved. [2025-09-19T18:07:54.733736] [INFO ] [MAIN ] Update Progress: 514/2372 symbols completed. CP took 33.2s. Estimated remaining: 4h 5m 14s. Rate: 7.6 symbols/min [2025-09-19T18:07:54.913479] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:54.913679] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-09-19T18:07:54.913734] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-09-19T18:07:54.913894] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-19T18:07:54.913946] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-19T18:07:54.913988] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-09-19T18:07:54.914019] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-19T18:07:55.045023] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-19T18:07:55.077806] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-19T18:07:55.311389] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:55.334696] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T18:07:55.843267] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-19T18:07:56.643250] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-19T18:07:56.739714] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:07:57.011397] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-19T18:07:57.278454] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T18:07:57.443256] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-19T18:07:58.243276] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-19T18:07:58.528597] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:07:58.698074] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-19T18:07:58.698979] [INFO ] [REMOTE ] CPAC: Full fetch complete (1909 records). [2025-09-19T18:07:58.699052] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-19T18:07:58.882961] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T18:07:58.883167] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:07:58.883212] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:07:58.883257] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-19T18:07:58.883380] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-19T18:07:58.883435] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-19T18:07:58.883477] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-19T18:07:58.883552] [INFO ] [MAIN ] Update Progress: 515/2372 symbols completed. CPAC took 26.5s. Estimated remaining: 4h 4m 52s. Rate: 7.6 symbols/min [2025-09-19T18:07:59.052025] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-19T18:07:59.056764] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:07:59.073028] [DEBUG] [LOCAL ] CPK: Loaded 13277 existing records from primary storage. [2025-09-19T18:07:59.073150] [INFO ] [MAIN ] CPK: Loaded 13277 existing records. [2025-09-19T18:07:59.254305] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:07:59.254554] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-19T18:07:59.254610] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-19T18:07:59.255127] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-19T18:07:59.255188] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-19T18:07:59.611624] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:07:59.843235] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-19T18:08:00.288223] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:08:00.643265] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-19T18:08:01.256054] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T18:08:01.443305] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-19T18:08:02.243314] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-19T18:08:02.497124] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T18:08:02.503529] [INFO ] [REMOTE ] CPA: Full fetch complete (42292 records). [2025-09-19T18:08:02.503734] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-19T18:08:02.905917] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-19T18:08:02.906003] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-19T18:08:02.906564] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-19T18:08:02.906607] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-19T18:08:02.907680] [DEBUG] [LOCAL ] CPA: Trimmed 42292 records to 29453 (keeping 200 days of data) [2025-09-19T18:08:03.059231] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-19T18:08:03.096334] [DEBUG] [LOCAL ] CPA: Primary data saved (29453 records). [2025-09-19T18:08:03.096507] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-19T18:08:03.096600] [INFO ] [MAIN ] Update Progress: 516/2372 symbols completed. CPA took 31.8s. Estimated remaining: 4h 4m 31s. Rate: 7.6 symbols/min [2025-09-19T18:08:03.267416] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:03.267587] [DEBUG] [LOCAL ] CPNG: No existing data file found in primary storage. [2025-09-19T18:08:03.267627] [WARN ] [MAIN ] CPNG: No existing data found, performing full refresh instead. [2025-09-19T18:08:03.267799] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-19T18:08:03.267844] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-19T18:08:03.267887] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-09-19T18:08:03.267921] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-19T18:08:03.660716] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:03.662517] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T18:08:03.686938] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T18:08:03.843267] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-19T18:08:04.424639] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:08:04.643310] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-19T18:08:05.443247] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-19T18:08:05.465417] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T18:08:05.989028] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T18:08:06.243275] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-19T18:08:07.043486] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-19T18:08:07.398688] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T18:08:07.751607] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T18:08:07.843269] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-19T18:08:08.049238] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T18:08:08.553186] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T18:08:08.643284] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-19T18:08:09.443293] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-19T18:08:10.243295] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-19T18:08:10.437803] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T18:08:10.890316] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T18:08:11.043329] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-19T18:08:11.843268] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-19T18:08:12.611573] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:08:12.653946] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-19T18:08:12.682257] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-19T18:08:12.746573] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-19T18:08:13.443263] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-19T18:08:13.792627] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T18:08:13.796949] [INFO ] [REMOTE ] CPAY: Full fetch complete (45188 records). [2025-09-19T18:08:13.797071] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-19T18:08:13.797668] [FATAL] [VALIDATOR ] CPAY: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:08:13.797756] [FATAL] [MAIN ] CPAY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:08:13.797798] [WARN ] [MAIN ] CPAY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:08:13.797835] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-19T18:08:13.797893] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-09-19T18:08:13.797927] [INFO ] [LOCAL ] CPAY: Starting deletion of derivative data. [2025-09-19T18:08:13.798310] [DEBUG] [LOCAL ] CPAY: Deleted derivative data file. [2025-09-19T18:08:13.798410] [INFO ] [MAIN ] Update Progress: 517/2372 symbols completed. CPAY took 35.1s. Estimated remaining: 4h 4m 33s. Rate: 7.6 symbols/min [2025-09-19T18:08:14.243330] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-19T18:08:15.043335] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-19T18:08:15.404168] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T18:08:15.406976] [INFO ] [REMOTE ] CPF: Full fetch complete (24325 records). [2025-09-19T18:08:15.407071] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-19T18:08:15.788049] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-19T18:08:15.788187] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-19T18:08:15.788756] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-19T18:08:15.788893] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-19T18:08:15.790338] [DEBUG] [LOCAL ] CPF: Trimmed 24325 records to 15847 (keeping 200 days of data) [2025-09-19T18:08:15.889730] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-19T18:08:15.902208] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-19T18:08:15.931512] [DEBUG] [LOCAL ] CPF: Primary data saved (15847 records). [2025-09-19T18:08:15.931622] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-19T18:08:15.931731] [INFO ] [MAIN ] Update Progress: 518/2372 symbols completed. CPF took 21.2s. Estimated remaining: 4h 4m 5s. Rate: 7.6 symbols/min [2025-09-19T18:08:16.173452] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:08:16.643277] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-19T18:08:17.503432] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:08:17.507960] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-19T18:08:18.420367] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-19T18:08:18.431664] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-19T18:08:18.855996] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T18:08:19.043320] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-19T18:08:20.086574] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T18:08:20.089825] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-19T18:08:20.911663] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T18:08:20.923091] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-19T18:08:20.995944] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T18:08:21.443275] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-19T18:08:22.653239] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T18:08:22.658935] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-19T18:08:23.659097] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-19T18:08:23.688224] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T18:08:23.693525] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-19T18:08:23.843338] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-19T18:08:24.740967] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T18:08:24.743221] [INFO ] [REMOTE ] CPK: Full fetch complete (17555 records). [2025-09-19T18:08:24.743297] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-19T18:08:25.117879] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-19T18:08:25.117964] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-19T18:08:25.118364] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-19T18:08:25.118404] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-19T18:08:25.118990] [DEBUG] [LOCAL ] CPK: Trimmed 17555 records to 13398 (keeping 200 days of data) [2025-09-19T18:08:25.204149] [DEBUG] [LOCAL ] CPK: Primary data saved (13398 records). [2025-09-19T18:08:25.204297] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-19T18:08:25.204398] [INFO ] [MAIN ] Update Progress: 519/2372 symbols completed. CPK took 26.3s. Estimated remaining: 4h 4m 2s. Rate: 7.6 symbols/min [2025-09-19T18:08:26.269508] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-19T18:08:26.281707] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-19T18:08:29.026262] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-19T18:08:29.038174] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-19T18:08:31.480574] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-19T18:08:31.492313] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-19T18:08:34.108623] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-19T18:08:34.116551] [INFO ] [REMOTE ] CPNG: Full fetch complete (77668 records). [2025-09-19T18:08:34.116731] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-19T18:08:34.509494] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-19T18:08:34.509575] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-19T18:08:34.510431] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-19T18:08:34.510507] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-19T18:08:34.512068] [DEBUG] [LOCAL ] CPNG: Trimmed 77668 records to 54451 (keeping 200 days of data) [2025-09-19T18:08:34.845285] [DEBUG] [LOCAL ] CPNG: Primary data saved (54451 records). [2025-09-19T18:08:34.845428] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-19T18:08:34.845537] [INFO ] [MAIN ] Update Progress: 520/2372 symbols completed. CPNG took 31.7s. Estimated remaining: 4h 4m 0s. Rate: 7.6 symbols/min [2025-09-19T18:08:35.405491] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:35.497305] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:35.494509] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-09-19T18:08:35.534264] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-09-19T18:08:35.570178] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-19T18:08:35.570115] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:35.535289] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:35.570409] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-19T18:08:35.570945] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-09-19T18:08:35.571111] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-19T18:08:35.744817] [DEBUG] [LOCAL ] CQP: Loaded 20205 existing records from primary storage. [2025-09-19T18:08:35.788248] [INFO ] [MAIN ] CQP: Loaded 20205 existing records. [2025-09-19T18:08:36.031163] [DEBUG] [LOCAL ] CPRI: Loaded 52972 existing records from primary storage. [2025-09-19T18:08:36.040794] [INFO ] [MAIN ] CPRI: Loaded 52972 existing records. [2025-09-19T18:08:36.041449] [DEBUG] [LOCAL ] CPT: Loaded 44714 existing records from primary storage. [2025-09-19T18:08:36.206460] [INFO ] [MAIN ] CPT: Loaded 44714 existing records. [2025-09-19T18:08:36.429205] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:36.456545] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-19T18:08:36.447703] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:08:36.484329] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-19T18:08:36.490767] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-19T18:08:36.507724] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-19T18:08:36.549292] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-19T18:08:36.683219] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:08:36.721813] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:08:36.761381] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-19T18:08:36.769634] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-19T18:08:36.773561] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-19T18:08:36.773701] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-19T18:08:36.780456] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-19T18:08:36.780576] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-19T18:08:36.785828] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-19T18:08:36.796214] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-19T18:08:37.361623] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:37.422135] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-19T18:08:37.795367] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:37.801568] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-19T18:08:37.801249] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:37.802190] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-19T18:08:38.065583] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T18:08:38.070026] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-19T18:08:38.853867] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T18:08:38.858488] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-19T18:08:39.293120] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:08:39.298119] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-19T18:08:39.759335] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T18:08:39.767401] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-19T18:08:39.817211] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T18:08:39.823354] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-19T18:08:39.921024] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T18:08:39.933418] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-19T18:08:40.289528] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T18:08:40.295030] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-19T18:08:41.023774] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T18:08:41.032717] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-19T18:08:41.241958] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T18:08:41.249974] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-19T18:08:41.360125] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T18:08:41.366510] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-19T18:08:42.047627] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T18:08:42.058315] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-19T18:08:42.097373] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-19T18:08:42.102885] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-19T18:08:42.412211] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:08:42.421351] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-19T18:08:42.778355] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T18:08:42.782827] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-19T18:08:42.959314] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T18:08:42.966814] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-19T18:08:44.032426] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T18:08:44.056824] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-19T18:08:44.058828] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T18:08:44.065359] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-19T18:08:44.500610] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:08:44.507838] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-19T18:08:44.613139] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:08:44.643221] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-19T18:08:45.065254] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:08:45.443236] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-19T18:08:45.872946] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T18:08:45.908586] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:08:46.085352] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:08:46.243222] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-19T18:08:46.263805] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T18:08:47.043264] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-19T18:08:47.843261] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-19T18:08:48.261256] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T18:08:48.370143] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-19T18:08:48.643247] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-19T18:08:49.227768] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:08:49.443261] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-19T18:08:50.243271] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-19T18:08:50.837333] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T18:08:51.043264] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-19T18:08:51.108997] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T18:08:51.255859] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:08:51.843262] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-19T18:08:52.643272] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-19T18:08:53.124618] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:08:53.283173] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T18:08:53.287842] [INFO ] [REMOTE ] CPS: Full fetch complete (36177 records). [2025-09-19T18:08:53.288133] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-19T18:08:53.448366] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-19T18:08:53.731432] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-19T18:08:53.731596] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-19T18:08:53.732953] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-19T18:08:53.733239] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-19T18:08:53.736544] [DEBUG] [LOCAL ] CPS: Trimmed 36177 records to 26671 (keeping 200 days of data) [2025-09-19T18:08:53.901506] [DEBUG] [LOCAL ] CPS: Primary data saved (26671 records). [2025-09-19T18:08:53.901681] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-19T18:08:53.901854] [INFO ] [MAIN ] Update Progress: 521/2372 symbols completed. CPS took 19.1s. Estimated remaining: 4h 4m 32s. Rate: 7.6 symbols/min [2025-09-19T18:08:54.073405] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:54.073660] [DEBUG] [LOCAL ] CR: No existing data file found in primary storage. [2025-09-19T18:08:54.073718] [WARN ] [MAIN ] CR: No existing data found, performing full refresh instead. [2025-09-19T18:08:54.073873] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-19T18:08:54.073934] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-19T18:08:54.073991] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-09-19T18:08:54.074051] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-19T18:08:54.254838] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-19T18:08:54.480014] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:54.514519] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T18:08:54.816912] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T18:08:55.045725] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-19T18:08:55.049380] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T18:08:55.053823] [INFO ] [REMOTE ] CQP: Full fetch complete (30906 records). [2025-09-19T18:08:55.053977] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-19T18:08:55.442718] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-19T18:08:55.442803] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-19T18:08:55.443268] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-19T18:08:55.443307] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-19T18:08:55.445632] [DEBUG] [LOCAL ] CQP: Trimmed 30906 records to 20282 (keeping 200 days of data) [2025-09-19T18:08:55.584057] [DEBUG] [LOCAL ] CQP: Primary data saved (20282 records). [2025-09-19T18:08:55.584181] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-19T18:08:55.584290] [INFO ] [MAIN ] Update Progress: 522/2372 symbols completed. CQP took 20.7s. Estimated remaining: 4h 4m 2s. Rate: 7.6 symbols/min [2025-09-19T18:08:55.753518] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:08:55.753736] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-19T18:08:55.753791] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-19T18:08:55.753930] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-19T18:08:55.753975] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-19T18:08:55.754016] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-19T18:08:55.754047] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-19T18:08:55.848405] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-19T18:08:56.116937] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:08:56.470534] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T18:08:56.643263] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-19T18:08:57.317794] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T18:08:57.443329] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-19T18:08:58.033477] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T18:08:58.243272] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-19T18:08:58.767171] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T18:08:59.043296] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-19T18:08:59.634674] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-19T18:08:59.843294] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-19T18:09:00.137433] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T18:09:00.144533] [INFO ] [REMOTE ] CPT: Full fetch complete (63460 records). [2025-09-19T18:09:00.144725] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-19T18:09:00.531872] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-19T18:09:00.531957] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-19T18:09:00.532783] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-19T18:09:00.532907] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-19T18:09:00.536404] [DEBUG] [LOCAL ] CPT: Trimmed 63460 records to 45047 (keeping 200 days of data) [2025-09-19T18:09:00.648380] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-19T18:09:00.839975] [DEBUG] [LOCAL ] CPT: Primary data saved (45047 records). [2025-09-19T18:09:00.840147] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-19T18:09:00.840896] [INFO ] [MAIN ] Update Progress: 523/2372 symbols completed. CPT took 26.0s. Estimated remaining: 4h 3m 44s. Rate: 7.6 symbols/min [2025-09-19T18:09:01.015624] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:01.080463] [DEBUG] [LOCAL ] CRBG: Loaded 52724 existing records from primary storage. [2025-09-19T18:09:01.080611] [INFO ] [MAIN ] CRBG: Loaded 52724 existing records. [2025-09-19T18:09:01.277130] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:01.283969] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-19T18:09:01.284842] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-19T18:09:01.287509] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-19T18:09:01.294236] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-19T18:09:01.300595] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-19T18:09:01.327042] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T18:09:01.448401] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-19T18:09:01.702590] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:02.243310] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-19T18:09:03.043267] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-19T18:09:03.843269] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-19T18:09:04.657186] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-09-19T18:09:04.663518] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-19T18:09:04.786372] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-19T18:09:05.443329] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-19T18:09:05.764940] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T18:09:06.243281] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-19T18:09:06.364934] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T18:09:06.456663] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (3.41 seconds). [2025-09-19T18:09:06.884920] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (3.04 seconds). [2025-09-19T18:09:07.043340] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-19T18:09:07.149096] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T18:09:07.843341] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-19T18:09:08.643325] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-19T18:09:08.895572] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T18:09:09.244430] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-19T18:09:09.443280] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-19T18:09:09.667390] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:09:10.243250] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-19T18:09:10.824499] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:09:11.043296] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-19T18:09:11.843282] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-19T18:09:12.188721] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T18:09:12.278011] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:09:12.643282] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-19T18:09:13.443264] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-19T18:09:13.602123] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T18:09:13.731778] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T18:09:14.243274] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-19T18:09:15.043305] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-19T18:09:15.647859] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T18:09:15.652668] [INFO ] [REMOTE ] CR: Full fetch complete (34916 records). [2025-09-19T18:09:15.652830] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-19T18:09:15.848412] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-19T18:09:16.035927] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-19T18:09:16.036021] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-19T18:09:16.036533] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-19T18:09:16.036575] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-19T18:09:16.037402] [DEBUG] [LOCAL ] CR: Trimmed 34916 records to 25083 (keeping 200 days of data) [2025-09-19T18:09:16.203502] [DEBUG] [LOCAL ] CR: Primary data saved (25083 records). [2025-09-19T18:09:16.203674] [INFO ] [MAIN ] CR: Full history saved. [2025-09-19T18:09:16.203773] [INFO ] [MAIN ] Update Progress: 524/2372 symbols completed. CR took 22.3s. Estimated remaining: 4h 4m 3s. Rate: 7.6 symbols/min [2025-09-19T18:09:16.376457] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:16.409933] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T18:09:16.467152] [DEBUG] [LOCAL ] CRC: Loaded 44876 existing records from primary storage. [2025-09-19T18:09:16.467312] [INFO ] [MAIN ] CRC: Loaded 44876 existing records. [2025-09-19T18:09:16.644862] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-19T18:09:16.644683] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T18:09:16.696672] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:16.703040] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-19T18:09:16.703137] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-19T18:09:16.704952] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-19T18:09:16.705032] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-19T18:09:17.207162] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:17.443335] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-19T18:09:18.243319] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-19T18:09:18.333963] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-19T18:09:18.341815] [INFO ] [REMOTE ] CPRI: Full fetch complete (75789 records). [2025-09-19T18:09:18.342031] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-19T18:09:18.343091] [FATAL] [VALIDATOR ] CPRI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:09:18.343324] [FATAL] [MAIN ] CPRI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:09:18.343392] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:09:18.343463] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-19T18:09:18.343546] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-09-19T18:09:18.343614] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-09-19T18:09:18.344451] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-09-19T18:09:18.344569] [INFO ] [MAIN ] Update Progress: 525/2372 symbols completed. CPRI took 43.5s. Estimated remaining: 4h 3m 34s. Rate: 7.6 symbols/min [2025-09-19T18:09:18.529835] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:18.530018] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-19T18:09:18.530058] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-19T18:09:18.530198] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-19T18:09:18.530279] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-19T18:09:18.530329] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-19T18:09:18.530362] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-19T18:09:18.834835] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-19T18:09:18.925168] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:18.959622] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T18:09:19.043274] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-19T18:09:19.225875] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T18:09:19.843278] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-19T18:09:20.643281] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-19T18:09:21.061937] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T18:09:21.177426] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:09:21.443240] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-19T18:09:21.626536] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T18:09:21.628258] [INFO ] [REMOTE ] CRBD: Full fetch complete (15319 records). [2025-09-19T18:09:21.628341] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-19T18:09:21.628971] [FATAL] [VALIDATOR ] CRBD: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:09:21.629078] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:09:21.629128] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:09:21.629169] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-19T18:09:21.629226] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-19T18:09:21.629266] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-19T18:09:21.629307] [DEBUG] [LOCAL ] CRBD: No derivative data file found to delete. [2025-09-19T18:09:21.629366] [INFO ] [MAIN ] Update Progress: 526/2372 symbols completed. CRBD took 26.0s. Estimated remaining: 4h 3m 10s. Rate: 7.6 symbols/min [2025-09-19T18:09:21.675341] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:21.710329] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-19T18:09:21.813255] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:21.873980] [DEBUG] [LOCAL ] CRGY: Loaded 52911 existing records from primary storage. [2025-09-19T18:09:21.874331] [INFO ] [MAIN ] CRGY: Loaded 52911 existing records. [2025-09-19T18:09:22.063202] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:22.063453] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-19T18:09:22.063502] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-19T18:09:22.064843] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-19T18:09:22.064906] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-19T18:09:22.251072] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-19T18:09:22.480706] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:23.043304] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-19T18:09:23.264373] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:23.264726] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-19T18:09:23.714275] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T18:09:23.843283] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-19T18:09:24.074056] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:24.074381] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-19T18:09:24.643276] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-19T18:09:25.443273] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-19T18:09:26.243231] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-19T18:09:26.474928] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T18:09:27.043234] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-19T18:09:27.297507] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:27.297843] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-19T18:09:27.724916] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T18:09:27.841367] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:09:27.848598] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-19T18:09:28.088912] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:28.089243] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-19T18:09:28.643267] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-19T18:09:28.895820] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:09:28.896244] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-19T18:09:29.443356] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-19T18:09:30.243263] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-19T18:09:31.043298] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-19T18:09:31.843281] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-19T18:09:32.141987] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-19T18:09:32.481853] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:09:32.588308] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T18:09:32.643237] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-19T18:09:33.357855] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T18:09:33.443286] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-19T18:09:34.243283] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-19T18:09:35.047133] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-19T18:09:35.048972] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T18:09:35.763733] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-09-19T18:09:35.843268] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-19T18:09:36.205104] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:09:36.643302] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-19T18:09:37.106835] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:09:37.114866] [INFO ] [REMOTE ] CRBG: Full fetch complete (75703 records). [2025-09-19T18:09:37.115040] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-19T18:09:37.458004] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-19T18:09:37.524009] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-19T18:09:37.524098] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-19T18:09:37.524970] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-19T18:09:37.525046] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-19T18:09:37.526585] [DEBUG] [LOCAL ] CRBG: Trimmed 75703 records to 53112 (keeping 200 days of data) [2025-09-19T18:09:37.863027] [DEBUG] [LOCAL ] CRBG: Primary data saved (53112 records). [2025-09-19T18:09:37.863195] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-19T18:09:37.863986] [INFO ] [MAIN ] Update Progress: 527/2372 symbols completed. CRBG took 37.0s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-19T18:09:38.045503] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:38.045827] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-09-19T18:09:38.045888] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-09-19T18:09:38.046196] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-19T18:09:38.046284] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-19T18:09:38.046428] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-09-19T18:09:38.046544] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-19T18:09:38.360131] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T18:09:38.393383] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-19T18:09:38.456086] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:39.027756] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (3.18 seconds). [2025-09-19T18:09:39.043560] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-19T18:09:39.648545] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:09:39.843262] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-19T18:09:40.235900] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T18:09:40.643270] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-19T18:09:41.407723] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-19T18:09:41.443231] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-19T18:09:41.556073] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:09:42.243327] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-19T18:09:42.749614] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:09:43.043334] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-19T18:09:43.467924] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T18:09:43.843353] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-19T18:09:44.643311] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-19T18:09:45.065763] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T18:09:45.209637] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-19T18:09:45.217442] [INFO ] [REMOTE ] CRCL: Full fetch complete (28659 records). [2025-09-19T18:09:45.217569] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-19T18:09:45.417291] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-19T18:09:45.417744] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:09:45.417818] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:09:45.417892] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-19T18:09:45.417969] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-19T18:09:45.418009] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-19T18:09:45.418068] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-19T18:09:45.418159] [INFO ] [MAIN ] Update Progress: 528/2372 symbols completed. CRCL took 27.1s. Estimated remaining: 4h 3m 22s. Rate: 7.6 symbols/min [2025-09-19T18:09:45.451345] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-19T18:09:45.601527] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:45.662935] [DEBUG] [LOCAL ] CRI: Loaded 50352 existing records from primary storage. [2025-09-19T18:09:45.663150] [INFO ] [MAIN ] CRI: Loaded 50352 existing records. [2025-09-19T18:09:45.860784] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:45.861328] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-19T18:09:45.861436] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-19T18:09:45.863075] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-19T18:09:45.863222] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-19T18:09:46.107325] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-19T18:09:46.249481] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-19T18:09:46.281740] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:46.340040] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T18:09:46.879310] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T18:09:46.886167] [INFO ] [REMOTE ] CRC: Full fetch complete (61742 records). [2025-09-19T18:09:46.886331] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-19T18:09:46.887138] [FATAL] [VALIDATOR ] CRC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:09:46.887239] [FATAL] [MAIN ] CRC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:09:46.887283] [WARN ] [MAIN ] CRC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:09:46.887325] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-19T18:09:46.887386] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-09-19T18:09:46.887421] [INFO ] [LOCAL ] CRC: Starting deletion of derivative data. [2025-09-19T18:09:46.887845] [DEBUG] [LOCAL ] CRC: Deleted derivative data file. [2025-09-19T18:09:46.887948] [INFO ] [MAIN ] Update Progress: 529/2372 symbols completed. CRC took 30.7s. Estimated remaining: 4h 2m 52s. Rate: 7.6 symbols/min [2025-09-19T18:09:47.046137] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-19T18:09:47.067124] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:47.119220] [DEBUG] [LOCAL ] CRK: Loaded 52520 existing records from primary storage. [2025-09-19T18:09:47.119384] [INFO ] [MAIN ] CRK: Loaded 52520 existing records. [2025-09-19T18:09:47.297810] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:47.298062] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-19T18:09:47.298109] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-19T18:09:47.299343] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-19T18:09:47.299403] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-19T18:09:47.651601] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:47.843214] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-19T18:09:48.570118] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-19T18:09:48.643244] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-19T18:09:48.965448] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T18:09:49.443255] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-19T18:09:49.535435] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:09:50.195305] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T18:09:50.243269] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-19T18:09:51.043270] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-19T18:09:51.507567] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:09:51.843299] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-19T18:09:52.374227] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T18:09:52.639789] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T18:09:52.649713] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-19T18:09:53.313480] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T18:09:53.443269] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-19T18:09:54.243278] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-19T18:09:55.043324] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-19T18:09:55.149597] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T18:09:55.383027] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T18:09:55.713528] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T18:09:55.843283] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-19T18:09:56.643268] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-19T18:09:56.797532] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T18:09:56.805464] [INFO ] [REMOTE ] CRGY: Full fetch complete (75918 records). [2025-09-19T18:09:56.805603] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-19T18:09:57.188696] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-19T18:09:57.188785] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-19T18:09:57.189602] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-19T18:09:57.189664] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-19T18:09:57.191145] [DEBUG] [LOCAL ] CRGY: Trimmed 75918 records to 53297 (keeping 200 days of data) [2025-09-19T18:09:57.468554] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-19T18:09:57.516328] [DEBUG] [LOCAL ] CRGY: Primary data saved (53297 records). [2025-09-19T18:09:57.516456] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-19T18:09:57.516592] [INFO ] [MAIN ] Update Progress: 530/2372 symbols completed. CRGY took 35.9s. Estimated remaining: 4h 2m 54s. Rate: 7.6 symbols/min [2025-09-19T18:09:57.704338] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:09:57.751052] [DEBUG] [LOCAL ] CRL: Loaded 43985 existing records from primary storage. [2025-09-19T18:09:57.751200] [INFO ] [MAIN ] CRL: Loaded 43985 existing records. [2025-09-19T18:09:57.951184] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:09:57.951512] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-19T18:09:57.951597] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-19T18:09:57.952937] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-19T18:09:57.953073] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-19T18:09:58.091611] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-19T18:09:58.269688] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-19T18:09:58.378385] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:09:58.412868] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T18:09:59.043322] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-19T18:09:59.441111] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T18:09:59.843242] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-19T18:09:59.957191] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T18:10:00.131622] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T18:10:00.643273] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-19T18:10:01.371300] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:10:01.443272] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-19T18:10:02.243267] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-19T18:10:02.876834] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T18:10:03.043297] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-19T18:10:03.512963] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T18:10:03.652568] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T18:10:03.843225] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-19T18:10:04.643305] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-19T18:10:05.115790] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T18:10:05.239595] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T18:10:05.443270] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-19T18:10:06.021160] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:10:06.243294] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-19T18:10:07.046363] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-19T18:10:07.053907] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T18:10:07.507610] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T18:10:07.843273] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-19T18:10:08.643246] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-19T18:10:08.776792] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:10:09.443309] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-19T18:10:09.860909] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T18:10:10.243310] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-19T18:10:10.970395] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:10:11.043237] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-19T18:10:11.087195] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-19T18:10:11.843281] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-19T18:10:12.518131] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T18:10:12.551770] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-19T18:10:12.559946] [INFO ] [REMOTE ] CRK: Full fetch complete (75492 records). [2025-09-19T18:10:12.560129] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-19T18:10:12.653530] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-19T18:10:12.970483] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-19T18:10:12.970592] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-19T18:10:12.971444] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-19T18:10:12.971508] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-19T18:10:12.973412] [DEBUG] [LOCAL ] CRK: Trimmed 75492 records to 52887 (keeping 200 days of data) [2025-09-19T18:10:13.279967] [DEBUG] [LOCAL ] CRK: Primary data saved (52887 records). [2025-09-19T18:10:13.280106] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-19T18:10:13.280249] [INFO ] [MAIN ] Update Progress: 531/2372 symbols completed. CRK took 26.4s. Estimated remaining: 4h 3m 13s. Rate: 7.6 symbols/min [2025-09-19T18:10:13.445588] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-19T18:10:13.447107] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:13.506177] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-09-19T18:10:13.506352] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-09-19T18:10:13.682113] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:13.682360] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-19T18:10:13.682436] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-19T18:10:13.683808] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-19T18:10:13.683868] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-19T18:10:14.040534] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:14.075032] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T18:10:14.243249] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-19T18:10:14.758284] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T18:10:14.858047] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:10:14.865853] [INFO ] [REMOTE ] CRI: Full fetch complete (70792 records). [2025-09-19T18:10:14.866035] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-19T18:10:15.048479] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-19T18:10:15.270462] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-19T18:10:15.270566] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-19T18:10:15.271359] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-19T18:10:15.271423] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-19T18:10:15.272921] [DEBUG] [LOCAL ] CRI: Trimmed 70792 records to 50689 (keeping 200 days of data) [2025-09-19T18:10:15.586917] [DEBUG] [LOCAL ] CRI: Primary data saved (50689 records). [2025-09-19T18:10:15.587061] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-19T18:10:15.587170] [INFO ] [MAIN ] Update Progress: 532/2372 symbols completed. CRI took 30.2s. Estimated remaining: 4h 2m 46s. Rate: 7.6 symbols/min [2025-09-19T18:10:15.758278] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:15.805164] [DEBUG] [LOCAL ] CRS: Loaded 43895 existing records from primary storage. [2025-09-19T18:10:15.805329] [INFO ] [MAIN ] CRS: Loaded 43895 existing records. [2025-09-19T18:10:15.848862] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-19T18:10:15.992815] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:15.993060] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-19T18:10:15.993113] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-19T18:10:15.994168] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-19T18:10:15.994229] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-19T18:10:16.367326] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:16.643268] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-19T18:10:16.818811] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-19T18:10:17.443303] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-19T18:10:17.852346] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T18:10:18.243275] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-19T18:10:18.612569] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T18:10:18.737176] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (3.69 seconds). [2025-09-19T18:10:18.746257] [INFO ] [REMOTE ] CRH: Full fetch complete (77292 records). [2025-09-19T18:10:18.746407] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-19T18:10:19.080590] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-19T18:10:19.188181] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-19T18:10:19.188346] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-19T18:10:19.189221] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-19T18:10:19.189286] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-19T18:10:19.191170] [DEBUG] [LOCAL ] CRH: Trimmed 77292 records to 54250 (keeping 200 days of data) [2025-09-19T18:10:19.534022] [DEBUG] [LOCAL ] CRH: Primary data saved (54250 records). [2025-09-19T18:10:19.534182] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-19T18:10:19.534356] [INFO ] [MAIN ] Update Progress: 533/2372 symbols completed. CRH took 41.7s. Estimated remaining: 4h 2m 24s. Rate: 7.6 symbols/min [2025-09-19T18:10:19.738743] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T18:10:19.770945] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:19.779559] [DEBUG] [LOCAL ] CRT: Loaded 4920 existing records from primary storage. [2025-09-19T18:10:19.779702] [INFO ] [MAIN ] CRT: Loaded 4920 existing records. [2025-09-19T18:10:19.843420] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-19T18:10:19.972771] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:19.973297] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-19T18:10:19.973373] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-19T18:10:19.973766] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-19T18:10:19.973846] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-19T18:10:20.176501] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-19T18:10:20.380621] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:20.643270] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-19T18:10:20.897715] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T18:10:21.443249] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-19T18:10:21.506379] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T18:10:21.840035] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T18:10:22.243281] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-19T18:10:23.043332] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-19T18:10:23.290698] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:10:23.843264] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-19T18:10:24.037219] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:10:24.643330] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-19T18:10:25.138200] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T18:10:25.443307] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-19T18:10:25.867971] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T18:10:26.183778] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T18:10:26.189475] [INFO ] [REMOTE ] CRL: Full fetch complete (62473 records). [2025-09-19T18:10:26.189588] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-19T18:10:26.190382] [FATAL] [VALIDATOR ] CRL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:10:26.190473] [FATAL] [MAIN ] CRL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:10:26.190516] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:10:26.190632] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-19T18:10:26.190779] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-19T18:10:26.190855] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-09-19T18:10:26.191452] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-09-19T18:10:26.191587] [INFO ] [MAIN ] Update Progress: 534/2372 symbols completed. CRL took 28.7s. Estimated remaining: 4h 2m 12s. Rate: 7.6 symbols/min [2025-09-19T18:10:26.248687] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-19T18:10:26.371690] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:26.413729] [DEBUG] [LOCAL ] CSAN: Loaded 42325 existing records from primary storage. [2025-09-19T18:10:26.413952] [INFO ] [MAIN ] CSAN: Loaded 42325 existing records. [2025-09-19T18:10:26.609714] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:26.609975] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-19T18:10:26.610026] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-19T18:10:26.613059] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-19T18:10:26.613125] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-19T18:10:26.978755] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:27.043226] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-19T18:10:27.115185] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T18:10:27.843397] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-19T18:10:28.035301] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-19T18:10:28.643291] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-19T18:10:28.825458] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T18:10:28.841344] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:10:29.443269] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-19T18:10:30.184538] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T18:10:30.243314] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-19T18:10:31.043289] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-19T18:10:31.249815] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-19T18:10:31.429580] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:10:31.843286] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-19T18:10:32.643289] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-19T18:10:33.243538] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-19T18:10:33.443271] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-19T18:10:33.548301] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T18:10:34.243275] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-19T18:10:34.443216] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-19T18:10:34.706721] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-19T18:10:35.043270] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-19T18:10:35.345053] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:10:35.843270] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-19T18:10:36.643270] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-19T18:10:37.078780] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T18:10:37.443268] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-19T18:10:37.805704] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:10:37.871532] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T18:10:38.243313] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-19T18:10:39.043265] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-19T18:10:39.799459] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T18:10:39.843251] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-19T18:10:39.893429] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T18:10:40.222061] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T18:10:40.643273] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-19T18:10:41.443308] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-19T18:10:41.942174] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T18:10:42.243274] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-19T18:10:42.987961] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T18:10:43.043252] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-19T18:10:43.426537] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:10:43.508417] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-19T18:10:43.831726] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T18:10:43.833557] [INFO ] [REMOTE ] CRT: Full fetch complete (7565 records). [2025-09-19T18:10:43.833684] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-19T18:10:43.848383] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-19T18:10:44.215203] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-19T18:10:44.215290] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-19T18:10:44.215514] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-19T18:10:44.215588] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-19T18:10:44.216073] [DEBUG] [LOCAL ] CRT: Trimmed 7565 records to 4969 (keeping 200 days of data) [2025-09-19T18:10:44.246601] [DEBUG] [LOCAL ] CRT: Primary data saved (4969 records). [2025-09-19T18:10:44.246750] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-19T18:10:44.246882] [INFO ] [MAIN ] Update Progress: 535/2372 symbols completed. CRT took 24.7s. Estimated remaining: 4h 2m 39s. Rate: 7.6 symbols/min [2025-09-19T18:10:44.418787] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:44.460747] [DEBUG] [LOCAL ] CSL: Loaded 31709 existing records from primary storage. [2025-09-19T18:10:44.460902] [INFO ] [MAIN ] CSL: Loaded 31709 existing records. [2025-09-19T18:10:44.648866] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-19T18:10:44.654252] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:44.655485] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-19T18:10:44.655542] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-19T18:10:44.656467] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-19T18:10:44.656542] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-19T18:10:45.039243] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:45.443280] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-19T18:10:45.840227] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T18:10:45.848133] [INFO ] [REMOTE ] CRS: Full fetch complete (62467 records). [2025-09-19T18:10:45.848284] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-19T18:10:46.245852] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-19T18:10:46.268502] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-19T18:10:46.268611] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-19T18:10:46.269536] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-19T18:10:46.269605] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-19T18:10:46.271246] [DEBUG] [LOCAL ] CRS: Trimmed 62467 records to 44213 (keeping 200 days of data) [2025-09-19T18:10:46.562792] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T18:10:46.624485] [DEBUG] [LOCAL ] CRS: Primary data saved (44213 records). [2025-09-19T18:10:46.624679] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-19T18:10:46.624843] [INFO ] [MAIN ] Update Progress: 536/2372 symbols completed. CRS took 31.0s. Estimated remaining: 4h 2m 12s. Rate: 7.6 symbols/min [2025-09-19T18:10:46.814740] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:46.831976] [DEBUG] [LOCAL ] CSR: Loaded 12508 existing records from primary storage. [2025-09-19T18:10:46.832124] [INFO ] [MAIN ] CSR: Loaded 12508 existing records. [2025-09-19T18:10:47.029596] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:47.029948] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-19T18:10:47.030020] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-19T18:10:47.030490] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-19T18:10:47.030572] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-19T18:10:47.064565] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-19T18:10:47.431244] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:47.681176] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T18:10:47.843275] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-19T18:10:48.011599] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T18:10:48.022987] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-19T18:10:48.023200] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-19T18:10:48.428698] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-19T18:10:48.428823] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-19T18:10:48.429712] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-19T18:10:48.429795] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-19T18:10:48.432212] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54550 (keeping 200 days of data) [2025-09-19T18:10:48.661427] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-19T18:10:48.792353] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-09-19T18:10:48.792510] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-19T18:10:48.792671] [INFO ] [MAIN ] Update Progress: 537/2372 symbols completed. CRM took 35.5s. Estimated remaining: 4h 1m 44s. Rate: 7.6 symbols/min [2025-09-19T18:10:48.987788] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:10:49.008748] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T18:10:49.046853] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:10:49.096802] [DEBUG] [LOCAL ] CSTM: Loaded 48163 existing records from primary storage. [2025-09-19T18:10:49.096977] [INFO ] [MAIN ] CSTM: Loaded 48163 existing records. [2025-09-19T18:10:49.274297] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:10:49.274536] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-19T18:10:49.274584] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-19T18:10:49.275679] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-19T18:10:49.275751] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-19T18:10:49.449035] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-19T18:10:49.594192] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T18:10:49.655735] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:10:50.243264] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-19T18:10:51.043252] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-19T18:10:51.249479] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T18:10:51.317477] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T18:10:51.843297] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-19T18:10:52.643275] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-19T18:10:52.883826] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T18:10:53.443275] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-19T18:10:53.675329] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:10:54.243318] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-19T18:10:54.362144] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T18:10:55.043262] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-19T18:10:55.369017] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T18:10:55.843266] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-19T18:10:55.930949] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T18:10:56.643306] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-19T18:10:56.800785] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T18:10:56.929100] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:10:57.443298] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-19T18:10:58.243262] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-19T18:10:58.515577] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T18:10:58.964148] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T18:10:59.043288] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-19T18:10:59.189352] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T18:10:59.843376] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-19T18:11:00.643286] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-19T18:11:01.162281] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T18:11:01.443313] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-19T18:11:01.878046] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:11:01.887070] [INFO ] [REMOTE ] CSAN: Full fetch complete (60741 records). [2025-09-19T18:11:01.887386] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-19T18:11:02.029800] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:11:02.248365] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-19T18:11:02.345408] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-19T18:11:02.345527] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-19T18:11:02.346357] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-19T18:11:02.346433] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-19T18:11:02.348049] [DEBUG] [LOCAL ] CSAN: Trimmed 60741 records to 42602 (keeping 200 days of data) [2025-09-19T18:11:02.619118] [DEBUG] [LOCAL ] CSAN: Primary data saved (42602 records). [2025-09-19T18:11:02.619330] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-19T18:11:02.619503] [INFO ] [MAIN ] Update Progress: 538/2372 symbols completed. CSAN took 36.4s. Estimated remaining: 4h 1m 56s. Rate: 7.6 symbols/min [2025-09-19T18:11:02.792345] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:02.811019] [DEBUG] [LOCAL ] CSV: Loaded 13238 existing records from primary storage. [2025-09-19T18:11:02.811184] [INFO ] [MAIN ] CSV: Loaded 13238 existing records. [2025-09-19T18:11:03.008710] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:11:03.009140] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-19T18:11:03.009213] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-19T18:11:03.015692] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-19T18:11:03.025260] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-19T18:11:03.065252] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-19T18:11:03.060037] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T18:11:03.416808] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:03.736478] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:11:03.843276] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-19T18:11:04.603937] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T18:11:04.643222] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-19T18:11:05.370394] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T18:11:05.390980] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T18:11:05.443226] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-19T18:11:06.243258] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-19T18:11:06.541211] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T18:11:07.043227] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-19T18:11:07.155543] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T18:11:07.843287] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-19T18:11:08.100286] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T18:11:08.643300] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-19T18:11:09.443275] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-19T18:11:09.659129] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:11:09.855445] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T18:11:10.243323] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-19T18:11:10.620917] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T18:11:11.043319] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-19T18:11:11.843305] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-19T18:11:12.051045] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:11:12.140864] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T18:11:12.643327] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-19T18:11:13.255028] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:11:13.443290] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-19T18:11:13.896467] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T18:11:13.899034] [INFO ] [REMOTE ] CSR: Full fetch complete (17373 records). [2025-09-19T18:11:13.899115] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-19T18:11:14.252674] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-19T18:11:14.279550] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-19T18:11:14.279630] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-19T18:11:14.280135] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-19T18:11:14.280199] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-19T18:11:14.281331] [DEBUG] [LOCAL ] CSR: Trimmed 17373 records to 12588 (keeping 200 days of data) [2025-09-19T18:11:14.366487] [DEBUG] [LOCAL ] CSR: Primary data saved (12588 records). [2025-09-19T18:11:14.366635] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-19T18:11:14.366765] [INFO ] [MAIN ] Update Progress: 539/2372 symbols completed. CSR took 27.7s. Estimated remaining: 4h 2m 2s. Rate: 7.6 symbols/min [2025-09-19T18:11:14.544232] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:14.544420] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-19T18:11:14.544486] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-19T18:11:14.544701] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-19T18:11:14.544753] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-19T18:11:14.544798] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-19T18:11:14.544832] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-19T18:11:14.911718] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:15.043274] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-19T18:11:15.235550] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:11:15.560421] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:11:15.843306] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-19T18:11:16.643272] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-19T18:11:17.099389] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:11:17.121493] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T18:11:17.443282] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-19T18:11:17.672905] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:17.673627] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-19T18:11:17.760524] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T18:11:17.768355] [INFO ] [REMOTE ] CSL: Full fetch complete (44508 records). [2025-09-19T18:11:17.768480] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-19T18:11:17.769229] [FATAL] [VALIDATOR ] CSL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:11:17.769320] [FATAL] [MAIN ] CSL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:11:17.769377] [WARN ] [MAIN ] CSL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:11:17.769442] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-19T18:11:17.769507] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-09-19T18:11:17.769556] [INFO ] [LOCAL ] CSL: Starting deletion of derivative data. [2025-09-19T18:11:17.770044] [DEBUG] [LOCAL ] CSL: Deleted derivative data file. [2025-09-19T18:11:17.770144] [INFO ] [MAIN ] Update Progress: 540/2372 symbols completed. CSL took 33.5s. Estimated remaining: 4h 1m 38s. Rate: 7.6 symbols/min [2025-09-19T18:11:17.962070] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:17.981834] [DEBUG] [LOCAL ] CTBB: Loaded 7314 existing records from primary storage. [2025-09-19T18:11:17.981991] [INFO ] [MAIN ] CTBB: Loaded 7314 existing records. [2025-09-19T18:11:18.182009] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:11:18.182257] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-19T18:11:18.182305] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-19T18:11:18.182635] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-19T18:11:18.182732] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-19T18:11:18.248452] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-19T18:11:18.530016] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:18.563433] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-19T18:11:18.569861] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:19.043276] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-19T18:11:19.843274] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-19T18:11:20.643323] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-19T18:11:20.672772] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T18:11:21.042355] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T18:11:21.443732] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-19T18:11:21.470435] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T18:11:21.663452] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:21.663908] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-19T18:11:22.243280] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-19T18:11:23.043302] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-19T18:11:23.112836] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T18:11:23.843330] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-19T18:11:24.060350] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T18:11:24.091526] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:24.092043] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-19T18:11:24.643363] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-19T18:11:25.443283] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-19T18:11:26.185889] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:11:26.243331] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-19T18:11:26.474987] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:26.475458] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-19T18:11:26.585842] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T18:11:26.593082] [INFO ] [REMOTE ] CSTM: Full fetch complete (68925 records). [2025-09-19T18:11:26.593265] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-19T18:11:27.000099] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-19T18:11:27.000228] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-19T18:11:27.001215] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-19T18:11:27.001294] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-19T18:11:27.004166] [DEBUG] [LOCAL ] CSTM: Trimmed 68925 records to 48510 (keeping 200 days of data) [2025-09-19T18:11:27.057113] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-19T18:11:27.302947] [DEBUG] [LOCAL ] CSTM: Primary data saved (48510 records). [2025-09-19T18:11:27.303101] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-19T18:11:27.303239] [INFO ] [MAIN ] Update Progress: 541/2372 symbols completed. CSTM took 38.5s. Estimated remaining: 4h 1m 36s. Rate: 7.6 symbols/min [2025-09-19T18:11:27.492060] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:27.492255] [DEBUG] [LOCAL ] CTDD: No existing data file found in primary storage. [2025-09-19T18:11:27.492313] [WARN ] [MAIN ] CTDD: No existing data found, performing full refresh instead. [2025-09-19T18:11:27.492470] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-19T18:11:27.492532] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-19T18:11:27.492582] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-09-19T18:11:27.492616] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-19T18:11:27.838819] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T18:11:27.852845] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-19T18:11:27.896975] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:28.532918] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T18:11:28.643336] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-19T18:11:29.443328] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-19T18:11:29.649687] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:11:29.666012] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:29.666361] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-19T18:11:30.243301] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-19T18:11:30.968306] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-19T18:11:31.043319] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-19T18:11:31.797623] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T18:11:31.843287] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-19T18:11:32.643277] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-19T18:11:32.781165] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T18:11:33.443271] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-19T18:11:33.508819] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T18:11:34.243331] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-19T18:11:34.598843] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T18:11:34.601391] [INFO ] [REMOTE ] CSV: Full fetch complete (19377 records). [2025-09-19T18:11:34.601471] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-19T18:11:34.979129] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-19T18:11:34.979243] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-19T18:11:34.983106] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-19T18:11:34.983187] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-19T18:11:34.983877] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:11:34.986231] [DEBUG] [LOCAL ] CSV: Trimmed 19377 records to 13335 (keeping 200 days of data) [2025-09-19T18:11:35.044418] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-19T18:11:35.069984] [DEBUG] [LOCAL ] CSV: Primary data saved (13335 records). [2025-09-19T18:11:35.070085] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-19T18:11:35.070166] [INFO ] [MAIN ] Update Progress: 542/2372 symbols completed. CSV took 32.5s. Estimated remaining: 4h 1m 27s. Rate: 7.6 symbols/min [2025-09-19T18:11:35.238774] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:35.238948] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-19T18:11:35.239003] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-19T18:11:35.239143] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-19T18:11:35.239198] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-19T18:11:35.239266] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-19T18:11:35.239301] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-19T18:11:35.588983] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:35.843239] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-19T18:11:35.950608] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T18:11:36.497181] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-19T18:11:36.643272] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-19T18:11:37.443284] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-19T18:11:37.810115] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T18:11:38.214727] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T18:11:38.243235] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-19T18:11:39.043327] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-19T18:11:39.116575] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T18:11:39.843270] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-19T18:11:39.994781] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T18:11:40.643352] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-19T18:11:40.994133] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:11:41.443278] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-19T18:11:41.503743] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T18:11:41.505291] [INFO ] [REMOTE ] CTBB: Full fetch complete (11127 records). [2025-09-19T18:11:41.505361] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-19T18:11:41.872576] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-19T18:11:41.872688] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-19T18:11:41.872962] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-19T18:11:41.873002] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-19T18:11:41.873451] [DEBUG] [LOCAL ] CTBB: Trimmed 11127 records to 7337 (keeping 200 days of data) [2025-09-19T18:11:41.921480] [DEBUG] [LOCAL ] CTBB: Primary data saved (7337 records). [2025-09-19T18:11:41.921669] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-19T18:11:41.921777] [INFO ] [MAIN ] Update Progress: 543/2372 symbols completed. CTBB took 24.2s. Estimated remaining: 4h 1m 16s. Rate: 7.6 symbols/min [2025-09-19T18:11:42.099757] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:42.099937] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-19T18:11:42.100024] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-19T18:11:42.100139] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-19T18:11:42.100179] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-19T18:11:42.100219] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-19T18:11:42.100249] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-19T18:11:42.188585] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T18:11:42.253214] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-19T18:11:42.480398] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:43.035841] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T18:11:43.043261] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-19T18:11:43.260463] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:43.260812] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-19T18:11:43.843275] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-19T18:11:44.643276] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-19T18:11:44.860087] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:44.860412] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-19T18:11:45.021800] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T18:11:45.443298] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-19T18:11:45.789515] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:45.789890] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-19T18:11:46.243262] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-19T18:11:46.726903] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T18:11:47.043275] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-19T18:11:47.843270] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-19T18:11:48.294404] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T18:11:48.297398] [INFO ] [REMOTE ] CSW: Full fetch complete (7776 records). [2025-09-19T18:11:48.297471] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-19T18:11:48.483218] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-19T18:11:48.483460] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:11:48.483535] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:11:48.483589] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-19T18:11:48.483677] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-19T18:11:48.483736] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-19T18:11:48.483786] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-19T18:11:48.483849] [INFO ] [MAIN ] Update Progress: 544/2372 symbols completed. CSW took 34.1s. Estimated remaining: 4h 1m 3s. Rate: 7.6 symbols/min [2025-09-19T18:11:48.660133] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-19T18:11:48.663932] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:48.703313] [DEBUG] [LOCAL ] CTO: Loaded 28716 existing records from primary storage. [2025-09-19T18:11:48.703460] [INFO ] [MAIN ] CTO: Loaded 28716 existing records. [2025-09-19T18:11:48.938324] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:48.944132] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:11:48.944831] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-19T18:11:48.945875] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-19T18:11:48.946067] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-19T18:11:48.954356] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-19T18:11:48.954508] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-19T18:11:48.987885] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T18:11:49.323727] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:49.443267] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-19T18:11:49.698627] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:49.699009] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-19T18:11:50.243323] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-19T18:11:50.907519] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T18:11:51.043303] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-19T18:11:51.843312] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-19T18:11:52.073775] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:52.074100] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-19T18:11:52.147083] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T18:11:52.643261] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-19T18:11:53.443247] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-19T18:11:53.789959] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T18:11:54.243294] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-19T18:11:54.746269] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:11:54.746611] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-19T18:11:55.048420] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-19T18:11:55.053518] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T18:11:55.662894] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-19T18:11:55.843277] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-19T18:11:56.269090] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-19T18:11:56.643324] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-19T18:11:57.427835] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T18:11:57.443234] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-19T18:11:58.216324] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T18:11:58.243267] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-19T18:11:58.822202] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T18:11:58.823706] [INFO ] [REMOTE ] CTDD: Full fetch complete (8610 records). [2025-09-19T18:11:58.823782] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-19T18:11:59.048516] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-19T18:11:59.208876] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-19T18:11:59.209089] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-19T18:11:59.209498] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-19T18:11:59.209586] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-19T18:11:59.210576] [DEBUG] [LOCAL ] CTDD: Trimmed 8610 records to 5937 (keeping 200 days of data) [2025-09-19T18:11:59.255256] [DEBUG] [LOCAL ] CTDD: Primary data saved (5937 records). [2025-09-19T18:11:59.255438] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-19T18:11:59.255530] [INFO ] [MAIN ] Update Progress: 545/2372 symbols completed. CTDD took 32.0s. Estimated remaining: 4h 1m 5s. Rate: 7.6 symbols/min [2025-09-19T18:11:59.367401] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-19T18:11:59.438504] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:11:59.438738] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-09-19T18:11:59.438787] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-09-19T18:11:59.438928] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-19T18:11:59.438970] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-19T18:11:59.439067] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-09-19T18:11:59.439115] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-19T18:11:59.798419] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:11:59.843230] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-19T18:12:00.643284] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-19T18:12:00.901282] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:12:00.901594] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-19T18:12:01.443316] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-19T18:12:01.612618] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T18:12:02.243299] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-19T18:12:03.027874] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T18:12:03.043246] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-19T18:12:03.843272] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-19T18:12:04.643268] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-19T18:12:05.004157] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T18:12:05.245844] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (3.00 seconds). [2025-09-19T18:12:05.443291] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-19T18:12:05.548709] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:12:05.549068] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-19T18:12:05.549185] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-19T18:12:05.549255] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-19T18:12:05.549920] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:12:05.549999] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:12:05.550069] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:12:05.550152] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-19T18:12:05.550233] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-19T18:12:05.550270] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-19T18:12:05.550326] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-19T18:12:05.550404] [INFO ] [MAIN ] Update Progress: 546/2372 symbols completed. CTEST took 30.5s. Estimated remaining: 4h 0m 52s. Rate: 7.6 symbols/min [2025-09-19T18:12:05.727126] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:05.743712] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T18:12:05.801769] [DEBUG] [LOCAL ] CTRA: Loaded 54039 existing records from primary storage. [2025-09-19T18:12:05.801916] [INFO ] [MAIN ] CTRA: Loaded 54039 existing records. [2025-09-19T18:12:05.974918] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:12:05.975153] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-19T18:12:05.975200] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-19T18:12:05.976829] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-19T18:12:05.976889] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-19T18:12:06.247785] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-19T18:12:06.327706] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:06.628040] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T18:12:06.630422] [INFO ] [REMOTE ] CTEV: Full fetch complete (13285 records). [2025-09-19T18:12:06.630495] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-19T18:12:06.810565] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 141 unique days, need 200 days [2025-09-19T18:12:06.810853] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:12:06.810921] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:12:06.810970] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-19T18:12:06.811026] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-19T18:12:06.811070] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-19T18:12:06.811107] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-19T18:12:06.811163] [INFO ] [MAIN ] Update Progress: 547/2372 symbols completed. CTEV took 24.9s. Estimated remaining: 4h 0m 22s. Rate: 7.6 symbols/min [2025-09-19T18:12:06.976912] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:07.036270] [DEBUG] [LOCAL ] CTRE: Loaded 49577 existing records from primary storage. [2025-09-19T18:12:07.036415] [INFO ] [MAIN ] CTRE: Loaded 49577 existing records. [2025-09-19T18:12:07.049180] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-19T18:12:07.217563] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:12:07.217806] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-19T18:12:07.217863] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-19T18:12:07.219158] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-19T18:12:07.219217] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-19T18:12:07.581472] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:07.845477] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-19T18:12:07.847690] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:12:08.643265] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-19T18:12:08.778980] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T18:12:09.443291] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-19T18:12:10.091481] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-19T18:12:10.249042] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-19T18:12:10.259826] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T18:12:11.043247] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-19T18:12:11.257277] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:12:11.843254] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-19T18:12:11.947949] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T18:12:12.039082] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T18:12:12.643293] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-19T18:12:13.443273] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-19T18:12:14.243355] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-19T18:12:14.573748] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-19T18:12:15.043494] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-19T18:12:15.392959] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-19T18:12:15.843243] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-19T18:12:16.435761] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T18:12:16.652383] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-19T18:12:16.657516] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (3.21 seconds). [2025-09-19T18:12:16.981584] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:12:17.443263] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-19T18:12:18.059854] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:12:18.087212] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:12:18.243261] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-19T18:12:18.882506] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T18:12:19.043258] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-19T18:12:19.843296] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-19T18:12:20.083145] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T18:12:20.113411] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T18:12:20.643281] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-19T18:12:21.176768] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T18:12:21.443277] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-19T18:12:22.243316] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-19T18:12:22.746151] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:12:23.043246] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-19T18:12:23.068070] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T18:12:23.810301] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T18:12:23.843256] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-19T18:12:24.643299] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-19T18:12:25.443268] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-19T18:12:25.576078] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-19T18:12:25.780884] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T18:12:25.992786] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T18:12:26.243292] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-19T18:12:27.043276] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-19T18:12:27.099419] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T18:12:27.843268] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-19T18:12:27.944636] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T18:12:28.643269] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-19T18:12:29.024010] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:12:29.229355] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T18:12:29.443262] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-19T18:12:30.243280] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-19T18:12:30.563376] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T18:12:30.568318] [INFO ] [REMOTE ] CTOS: Full fetch complete (53188 records). [2025-09-19T18:12:30.568426] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-19T18:12:30.569343] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:12:30.569450] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:12:30.569492] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:12:30.569531] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-19T18:12:30.569589] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-09-19T18:12:30.569623] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-09-19T18:12:30.569708] [DEBUG] [LOCAL ] CTOS: No derivative data file found to delete. [2025-09-19T18:12:30.569784] [INFO ] [MAIN ] Update Progress: 548/2372 symbols completed. CTOS took 31.3s. Estimated remaining: 4h 1m 7s. Rate: 7.6 symbols/min [2025-09-19T18:12:30.741399] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:30.777793] [DEBUG] [LOCAL ] CTRI: Loaded 37668 existing records from primary storage. [2025-09-19T18:12:30.777945] [INFO ] [MAIN ] CTRI: Loaded 37668 existing records. [2025-09-19T18:12:30.970176] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:12:30.970429] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-19T18:12:30.970479] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-19T18:12:30.971548] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-19T18:12:30.971611] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-19T18:12:31.056312] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-19T18:12:31.213076] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T18:12:31.286018] [INFO ] [REMOTE ] CTO: Full fetch complete (41920 records). [2025-09-19T18:12:31.305509] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-19T18:12:31.545237] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:31.817900] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-19T18:12:31.817995] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-19T18:12:31.818675] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-19T18:12:31.818740] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-19T18:12:31.819868] [DEBUG] [LOCAL ] CTO: Trimmed 41920 records to 28928 (keeping 200 days of data) [2025-09-19T18:12:31.875424] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-19T18:12:32.007122] [DEBUG] [LOCAL ] CTO: Primary data saved (28928 records). [2025-09-19T18:12:32.007290] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-19T18:12:32.007428] [INFO ] [MAIN ] Update Progress: 549/2372 symbols completed. CTO took 43.5s. Estimated remaining: 4h 0m 37s. Rate: 7.6 symbols/min [2025-09-19T18:12:32.192784] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:32.212931] [DEBUG] [LOCAL ] CTS: Loaded 19514 existing records from primary storage. [2025-09-19T18:12:32.213103] [INFO ] [MAIN ] CTS: Loaded 19514 existing records. [2025-09-19T18:12:32.413865] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:12:32.414150] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-19T18:12:32.414210] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-19T18:12:32.414967] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-19T18:12:32.415044] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-19T18:12:32.831625] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:32.832193] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-19T18:12:32.865345] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-19T18:12:33.359688] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-19T18:12:33.443257] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-19T18:12:33.554274] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:12:33.684007] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T18:12:34.243313] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-19T18:12:35.043260] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-19T18:12:35.492548] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T18:12:35.651520] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T18:12:35.843234] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-19T18:12:35.864769] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T18:12:35.876122] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-19T18:12:35.876280] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-19T18:12:36.265909] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-19T18:12:36.265998] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-19T18:12:36.266850] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-19T18:12:36.266916] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-19T18:12:36.268468] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 54429 (keeping 200 days of data) [2025-09-19T18:12:36.603266] [DEBUG] [LOCAL ] CTRA: Primary data saved (54429 records). [2025-09-19T18:12:36.603404] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-19T18:12:36.603499] [INFO ] [MAIN ] Update Progress: 550/2372 symbols completed. CTRA took 31.1s. Estimated remaining: 4h 0m 18s. Rate: 7.6 symbols/min [2025-09-19T18:12:36.648369] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-19T18:12:36.782667] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:36.782858] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-09-19T18:12:36.782912] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-09-19T18:12:36.783053] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-19T18:12:36.783120] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-19T18:12:36.783189] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-19T18:12:36.783235] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-19T18:12:37.140903] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:12:37.160805] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:37.443253] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-19T18:12:37.922510] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T18:12:38.243241] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-19T18:12:38.852162] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:12:39.043276] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-19T18:12:39.744632] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T18:12:39.843269] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-19T18:12:40.363591] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T18:12:40.643271] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-19T18:12:41.443275] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-19T18:12:41.919442] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:12:42.243250] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-19T18:12:42.356122] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T18:12:42.867884] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T18:12:42.875875] [INFO ] [REMOTE ] CTRE: Full fetch complete (71078 records). [2025-09-19T18:12:42.876039] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-19T18:12:43.049112] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-19T18:12:43.301843] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-19T18:12:43.302003] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-19T18:12:43.302900] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-19T18:12:43.302965] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-19T18:12:43.304948] [DEBUG] [LOCAL ] CTRE: Trimmed 71078 records to 49948 (keeping 200 days of data) [2025-09-19T18:12:43.622357] [DEBUG] [LOCAL ] CTRE: Primary data saved (49948 records). [2025-09-19T18:12:43.622499] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-19T18:12:43.623327] [INFO ] [MAIN ] Update Progress: 551/2372 symbols completed. CTRE took 36.8s. Estimated remaining: 4h 0m 7s. Rate: 7.6 symbols/min [2025-09-19T18:12:43.804005] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:12:43.804182] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-19T18:12:43.804238] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-19T18:12:43.804381] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-19T18:12:43.804425] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-19T18:12:43.804467] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-19T18:12:43.804499] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-19T18:12:43.868132] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-19T18:12:44.168704] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:12:44.198159] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:12:44.457623] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T18:12:44.643280] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-19T18:12:45.384857] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T18:12:45.443297] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-19T18:12:45.866747] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-19T18:12:45.912173] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T18:12:46.243249] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-19T18:12:47.043269] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-19T18:12:47.769580] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T18:12:47.844427] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-19T18:12:47.849220] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T18:12:48.643333] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-19T18:12:49.027080] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T18:12:49.443274] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-19T18:12:49.670168] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:12:49.885619] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-19T18:12:50.243261] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-19T18:12:50.665695] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-19T18:12:51.043253] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-19T18:12:51.843310] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-19T18:12:52.279619] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T18:12:52.643253] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-19T18:12:53.249452] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T18:12:53.320358] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T18:12:53.443237] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-19T18:12:53.701872] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-19T18:12:54.243262] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-19T18:12:55.043269] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-19T18:12:55.371760] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:12:55.843266] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-19T18:12:56.643246] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-19T18:12:56.708891] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T18:12:57.443235] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-19T18:12:57.925131] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:12:57.947723] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T18:12:58.243270] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-19T18:12:59.043302] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-19T18:12:59.213030] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T18:12:59.488138] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T18:12:59.491320] [INFO ] [REMOTE ] CTS: Full fetch complete (26524 records). [2025-09-19T18:12:59.491409] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-19T18:12:59.848362] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-19T18:12:59.860321] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-19T18:12:59.860401] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-19T18:12:59.860917] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-19T18:12:59.860983] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-19T18:12:59.862071] [DEBUG] [LOCAL ] CTS: Trimmed 26524 records to 19657 (keeping 200 days of data) [2025-09-19T18:12:59.985518] [DEBUG] [LOCAL ] CTS: Primary data saved (19657 records). [2025-09-19T18:12:59.985730] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-19T18:12:59.985879] [INFO ] [MAIN ] Update Progress: 552/2372 symbols completed. CTS took 28.0s. Estimated remaining: 4h 0m 27s. Rate: 7.6 symbols/min [2025-09-19T18:13:00.159622] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:00.212796] [DEBUG] [LOCAL ] CUBE: Loaded 51124 existing records from primary storage. [2025-09-19T18:13:00.212963] [INFO ] [MAIN ] CUBE: Loaded 51124 existing records. [2025-09-19T18:13:00.389541] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:00.389849] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-19T18:13:00.389925] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-19T18:13:00.391895] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-19T18:13:00.391985] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-19T18:13:00.547585] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T18:13:00.650153] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-19T18:13:00.761888] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:01.431562] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T18:13:01.443217] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-19T18:13:01.989814] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T18:13:02.243327] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-19T18:13:03.043289] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-19T18:13:03.464867] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T18:13:03.565999] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T18:13:03.843257] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-19T18:13:04.490476] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T18:13:04.498312] [INFO ] [REMOTE ] CTRI: Full fetch complete (50610 records). [2025-09-19T18:13:04.498482] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-19T18:13:04.651085] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-19T18:13:04.897143] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-19T18:13:04.897234] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-19T18:13:04.897985] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-19T18:13:04.898051] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-19T18:13:04.899284] [DEBUG] [LOCAL ] CTRI: Trimmed 50610 records to 38053 (keeping 200 days of data) [2025-09-19T18:13:05.127602] [DEBUG] [LOCAL ] CTRI: Primary data saved (38053 records). [2025-09-19T18:13:05.127827] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-19T18:13:05.128008] [INFO ] [MAIN ] Update Progress: 553/2372 symbols completed. CTRI took 34.6s. Estimated remaining: 4h 0m 10s. Rate: 7.6 symbols/min [2025-09-19T18:13:05.261048] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T18:13:05.290213] [INFO ] [REMOTE ] CUBB: Full fetch complete (929 records). [2025-09-19T18:13:05.305723] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-19T18:13:05.309148] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:05.452159] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-19T18:13:05.552082] [DEBUG] [LOCAL ] CUBI: Loaded 27519 existing records from primary storage. [2025-09-19T18:13:05.550824] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-19T18:13:05.552480] [INFO ] [MAIN ] CUBI: Loaded 27519 existing records. [2025-09-19T18:13:05.552373] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:13:05.598446] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:13:05.621046] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-19T18:13:05.650777] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-19T18:13:05.659346] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-19T18:13:05.662165] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-19T18:13:05.662612] [INFO ] [MAIN ] Update Progress: 554/2372 symbols completed. CUBB took 22.0s. Estimated remaining: 3h 59m 38s. Rate: 7.6 symbols/min [2025-09-19T18:13:05.816513] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:05.852440] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-19T18:13:05.852963] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-19T18:13:05.863702] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-19T18:13:05.892959] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-19T18:13:05.954313] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:06.329037] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-19T18:13:06.374102] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:06.387137] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-19T18:13:06.390757] [DEBUG] [LOCAL ] CUK: Loaded 51410 existing records from primary storage. [2025-09-19T18:13:06.391007] [INFO ] [MAIN ] CUK: Loaded 51410 existing records. [2025-09-19T18:13:06.649372] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:06.649701] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-19T18:13:06.649760] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-19T18:13:06.650862] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-19T18:13:06.650925] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-19T18:13:07.048716] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-19T18:13:07.169801] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:07.611496] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:13:07.697827] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T18:13:07.843320] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-19T18:13:08.643270] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-19T18:13:09.191970] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T18:13:09.443279] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-19T18:13:09.853877] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T18:13:10.243274] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-19T18:13:10.569792] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T18:13:11.017561] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T18:13:11.043214] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-19T18:13:11.843274] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-19T18:13:11.991677] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T18:13:12.124965] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T18:13:12.643271] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-19T18:13:13.443258] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-19T18:13:14.038385] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T18:13:14.048898] [INFO ] [REMOTE ] CTVA: Full fetch complete (76543 records). [2025-09-19T18:13:14.049073] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-19T18:13:14.049993] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:13:14.050095] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:13:14.050139] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:13:14.050205] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-19T18:13:14.050310] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-09-19T18:13:14.050400] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-09-19T18:13:14.050469] [DEBUG] [LOCAL ] CTVA: No derivative data file found to delete. [2025-09-19T18:13:14.050565] [INFO ] [MAIN ] Update Progress: 555/2372 symbols completed. CTVA took 37.4s. Estimated remaining: 3h 59m 32s. Rate: 7.6 symbols/min [2025-09-19T18:13:14.237415] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:14.246149] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-19T18:13:14.259899] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T18:13:14.262683] [DEBUG] [LOCAL ] CULP: Loaded 3147 existing records from primary storage. [2025-09-19T18:13:14.268723] [INFO ] [MAIN ] CULP: Loaded 3147 existing records. [2025-09-19T18:13:14.463200] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:14.463455] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-19T18:13:14.463506] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-19T18:13:14.463818] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-19T18:13:14.463878] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-19T18:13:14.841179] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:15.043271] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-19T18:13:15.354515] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:13:15.524102] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-19T18:13:15.842776] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:13:15.851773] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-19T18:13:16.643315] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-19T18:13:17.443294] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-19T18:13:17.814551] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T18:13:17.960732] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T18:13:17.985754] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T18:13:18.243275] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-19T18:13:19.043277] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-19T18:13:19.554019] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T18:13:19.620175] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T18:13:19.843260] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-19T18:13:20.643239] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-19T18:13:21.205217] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T18:13:21.443259] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-19T18:13:22.243234] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-19T18:13:22.368498] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T18:13:22.469403] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T18:13:23.043268] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-19T18:13:23.643297] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T18:13:23.843268] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-19T18:13:24.508288] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:13:24.643287] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-19T18:13:25.443268] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-19T18:13:26.122510] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T18:13:26.175811] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T18:13:26.178084] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T18:13:26.243224] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-19T18:13:27.043337] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-19T18:13:27.843273] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-19T18:13:28.341678] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:13:28.429490] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:13:28.435792] [INFO ] [REMOTE ] CUBI: Full fetch complete (39225 records). [2025-09-19T18:13:28.436145] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-19T18:13:28.533888] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-19T18:13:28.645044] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-19T18:13:28.855547] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-19T18:13:28.855738] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-19T18:13:28.856410] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-19T18:13:28.856485] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-19T18:13:28.857502] [DEBUG] [LOCAL ] CUBI: Trimmed 39225 records to 27721 (keeping 200 days of data) [2025-09-19T18:13:29.033744] [DEBUG] [LOCAL ] CUBI: Primary data saved (27721 records). [2025-09-19T18:13:29.033937] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-19T18:13:29.034075] [INFO ] [MAIN ] Update Progress: 556/2372 symbols completed. CUBI took 23.9s. Estimated remaining: 3h 59m 47s. Rate: 7.6 symbols/min [2025-09-19T18:13:29.220452] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:29.256492] [DEBUG] [LOCAL ] CURB: Loaded 33297 existing records from primary storage. [2025-09-19T18:13:29.256700] [INFO ] [MAIN ] CURB: Loaded 33297 existing records. [2025-09-19T18:13:29.437999] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:29.438296] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-19T18:13:29.438344] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-19T18:13:29.439352] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-19T18:13:29.439414] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-19T18:13:29.450732] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-19T18:13:29.848808] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:30.218729] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T18:13:30.243258] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-19T18:13:30.610518] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-19T18:13:30.837672] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T18:13:31.043266] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-19T18:13:31.843264] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-19T18:13:32.643330] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-19T18:13:32.818245] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T18:13:33.139248] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T18:13:33.443268] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-19T18:13:33.571211] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T18:13:34.243288] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-19T18:13:35.043263] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-19T18:13:35.098896] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T18:13:35.603575] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-19T18:13:35.604994] [INFO ] [REMOTE ] CULP: Full fetch complete (4773 records). [2025-09-19T18:13:35.605089] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-19T18:13:35.860256] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-19T18:13:35.984844] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-19T18:13:35.984951] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-19T18:13:35.985107] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-19T18:13:35.985179] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-19T18:13:35.985982] [DEBUG] [LOCAL ] CULP: Trimmed 4773 records to 3165 (keeping 200 days of data) [2025-09-19T18:13:36.033246] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:13:36.048928] [DEBUG] [LOCAL ] CULP: Primary data saved (3165 records). [2025-09-19T18:13:36.049207] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-19T18:13:36.049389] [INFO ] [MAIN ] Update Progress: 557/2372 symbols completed. CULP took 22.0s. Estimated remaining: 3h 59m 36s. Rate: 7.6 symbols/min [2025-09-19T18:13:36.643274] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-19T18:13:37.443250] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-19T18:13:37.968070] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:13:37.998974] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:13:38.243270] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-19T18:13:39.043294] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-19T18:13:39.365283] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T18:13:39.843327] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-19T18:13:40.051579] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:13:40.643286] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-19T18:13:41.159010] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T18:13:41.443269] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-19T18:13:41.834478] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T18:13:42.243329] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-19T18:13:42.381276] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T18:13:43.043362] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-19T18:13:43.157762] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T18:13:43.166558] [INFO ] [REMOTE ] CUK: Full fetch complete (73671 records). [2025-09-19T18:13:43.166724] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-19T18:13:43.567560] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-19T18:13:43.567700] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-19T18:13:43.568631] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-19T18:13:43.568739] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-19T18:13:43.570483] [DEBUG] [LOCAL ] CUK: Trimmed 73671 records to 51795 (keeping 200 days of data) [2025-09-19T18:13:43.887318] [DEBUG] [LOCAL ] CUK: Primary data saved (51795 records). [2025-09-19T18:13:43.887468] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-19T18:13:43.888339] [INFO ] [MAIN ] Update Progress: 558/2372 symbols completed. CUK took 38.2s. Estimated remaining: 3h 59m 28s. Rate: 7.6 symbols/min [2025-09-19T18:13:44.347960] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T18:13:44.355731] [INFO ] [REMOTE ] CUBE: Full fetch complete (72945 records). [2025-09-19T18:13:44.355870] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-19T18:13:44.767825] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-19T18:13:44.767955] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-19T18:13:44.768793] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-19T18:13:44.768859] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-19T18:13:44.770500] [DEBUG] [LOCAL ] CUBE: Trimmed 72945 records to 51502 (keeping 200 days of data) [2025-09-19T18:13:45.029338] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T18:13:45.042272] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-19T18:13:45.146778] [DEBUG] [LOCAL ] CUBE: Primary data saved (51502 records). [2025-09-19T18:13:45.146936] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-19T18:13:45.147074] [INFO ] [MAIN ] Update Progress: 559/2372 symbols completed. CUBE took 45.2s. Estimated remaining: 3h 58m 58s. Rate: 7.6 symbols/min [2025-09-19T18:13:46.601097] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T18:13:46.607948] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-19T18:13:48.169472] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T18:13:48.177184] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-19T18:13:49.814567] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T18:13:49.824825] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-19T18:13:51.745950] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T18:13:51.751257] [INFO ] [REMOTE ] CURB: Full fetch complete (47209 records). [2025-09-19T18:13:51.751395] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-19T18:13:52.135756] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-19T18:13:52.135867] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-19T18:13:52.136482] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-19T18:13:52.136536] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-19T18:13:52.137722] [DEBUG] [LOCAL ] CURB: Trimmed 47209 records to 33552 (keeping 200 days of data) [2025-09-19T18:13:52.331966] [DEBUG] [LOCAL ] CURB: Primary data saved (33552 records). [2025-09-19T18:13:52.332108] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-19T18:13:52.332193] [INFO ] [MAIN ] Update Progress: 560/2372 symbols completed. CURB took 23.3s. Estimated remaining: 3h 58m 48s. Rate: 7.6 symbols/min [2025-09-19T18:13:52.908471] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:53.015205] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:53.051616] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:53.080380] [DEBUG] [LOCAL ] CUZ: No existing data file found in primary storage. [2025-09-19T18:13:53.080486] [WARN ] [MAIN ] CUZ: No existing data found, performing full refresh instead. [2025-09-19T18:13:53.084255] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:13:53.085005] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-19T18:13:53.085499] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-19T18:13:53.085608] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-09-19T18:13:53.085734] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-19T18:13:53.247025] [DEBUG] [LOCAL ] CVEO: Loaded 15698 existing records from primary storage. [2025-09-19T18:13:53.266404] [DEBUG] [LOCAL ] CURV: Loaded 26800 existing records from primary storage. [2025-09-19T18:13:53.293468] [INFO ] [MAIN ] CURV: Loaded 26800 existing records. [2025-09-19T18:13:53.271633] [INFO ] [MAIN ] CVEO: Loaded 15698 existing records. [2025-09-19T18:13:53.709041] [DEBUG] [LOCAL ] CVE: Loaded 53947 existing records from primary storage. [2025-09-19T18:13:53.765940] [INFO ] [MAIN ] CVE: Loaded 53947 existing records. [2025-09-19T18:13:53.766164] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:53.863068] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-19T18:13:53.909362] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-19T18:13:53.935631] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:54.002943] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:54.003058] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-19T18:13:53.999764] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-19T18:13:54.016588] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-19T18:13:54.016689] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-19T18:13:54.016891] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-19T18:13:54.034072] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-19T18:13:54.059172] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-19T18:13:54.215403] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:13:54.294955] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-19T18:13:54.311794] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-19T18:13:54.395290] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-19T18:13:54.460971] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-19T18:13:54.866305] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:54.882154] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-19T18:13:54.999010] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:55.015056] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-19T18:13:55.196121] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:13:55.196419] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-19T18:13:55.588379] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T18:13:55.591148] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-19T18:13:55.814145] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T18:13:55.823894] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-19T18:13:56.538348] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T18:13:56.546452] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-19T18:13:56.552606] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T18:13:56.555156] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-19T18:13:56.938163] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T18:13:56.949384] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-19T18:13:57.329028] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T18:13:57.338309] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-19T18:13:57.576393] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T18:13:57.579530] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-19T18:13:58.055817] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T18:13:58.061606] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-19T18:13:58.358242] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T18:13:58.362143] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-19T18:13:58.477826] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T18:13:58.488540] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-19T18:13:58.733301] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T18:13:58.742373] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-19T18:13:58.773764] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T18:13:59.043340] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-19T18:13:59.438863] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-19T18:13:59.843238] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-19T18:14:00.155374] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T18:14:00.169016] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T18:14:00.197096] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T18:14:00.643338] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-19T18:14:00.676396] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T18:14:01.443322] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-19T18:14:02.179779] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T18:14:02.243279] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-19T18:14:03.043276] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-19T18:14:03.614059] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T18:14:03.766606] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T18:14:03.843271] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-19T18:14:04.103866] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T18:14:04.643267] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-19T18:14:04.979717] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T18:14:05.443285] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-19T18:14:05.966326] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T18:14:06.243275] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-19T18:14:07.043294] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-19T18:14:07.496333] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:14:07.843283] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-19T18:14:08.393440] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T18:14:08.648363] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-19T18:14:08.665311] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T18:14:09.443271] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-19T18:14:09.780568] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T18:14:09.802364] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T18:14:10.243234] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-19T18:14:10.581295] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T18:14:10.584061] [INFO ] [REMOTE ] CVEO: Full fetch complete (20176 records). [2025-09-19T18:14:10.584201] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-19T18:14:10.954263] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-19T18:14:10.954353] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-19T18:14:10.954796] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-19T18:14:10.954857] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-19T18:14:10.955511] [DEBUG] [LOCAL ] CVEO: Trimmed 20176 records to 15767 (keeping 200 days of data) [2025-09-19T18:14:11.045401] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-19T18:14:11.053429] [DEBUG] [LOCAL ] CVEO: Primary data saved (15767 records). [2025-09-19T18:14:11.053566] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-19T18:14:11.053696] [INFO ] [MAIN ] Update Progress: 561/2372 symbols completed. CVEO took 18.7s. Estimated remaining: 3h 59m 15s. Rate: 7.6 symbols/min [2025-09-19T18:14:11.237954] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:11.252702] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T18:14:11.298413] [DEBUG] [LOCAL ] CVI: Loaded 46782 existing records from primary storage. [2025-09-19T18:14:11.298556] [INFO ] [MAIN ] CVI: Loaded 46782 existing records. [2025-09-19T18:14:11.475307] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:14:11.475602] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-19T18:14:11.475682] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-19T18:14:11.476992] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-19T18:14:11.477054] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-19T18:14:11.852198] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-19T18:14:11.887253] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:12.643307] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-19T18:14:13.078188] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T18:14:13.367712] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T18:14:13.443230] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-19T18:14:14.243248] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-19T18:14:14.720998] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:14:15.043262] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-19T18:14:15.389165] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:14:15.539537] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:14:15.843266] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-19T18:14:16.325892] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T18:14:16.643305] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-19T18:14:17.443313] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-19T18:14:18.195110] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:14:18.203029] [INFO ] [REMOTE ] CUZ: Full fetch complete (70675 records). [2025-09-19T18:14:18.231597] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-19T18:14:18.237401] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-19T18:14:18.243229] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-19T18:14:18.660631] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-19T18:14:18.660744] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-19T18:14:18.661592] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-19T18:14:18.661683] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-19T18:14:18.663209] [DEBUG] [LOCAL ] CUZ: Trimmed 70675 records to 50074 (keeping 200 days of data) [2025-09-19T18:14:18.972476] [DEBUG] [LOCAL ] CUZ: Primary data saved (50074 records). [2025-09-19T18:14:18.972691] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-19T18:14:18.972799] [INFO ] [MAIN ] Update Progress: 562/2372 symbols completed. CUZ took 26.6s. Estimated remaining: 3h 59m 7s. Rate: 7.6 symbols/min [2025-09-19T18:14:19.049250] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-19T18:14:19.151213] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:19.170625] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:14:19.189831] [DEBUG] [LOCAL ] CVLG: Loaded 15548 existing records from primary storage. [2025-09-19T18:14:19.189966] [INFO ] [MAIN ] CVLG: Loaded 15548 existing records. [2025-09-19T18:14:19.366877] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:14:19.367211] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-19T18:14:19.367278] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-19T18:14:19.367783] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-19T18:14:19.367858] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-19T18:14:19.728306] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:19.843255] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-19T18:14:20.104554] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T18:14:20.625592] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-19T18:14:20.643287] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-19T18:14:21.315678] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-19T18:14:21.443305] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-19T18:14:22.243300] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-19T18:14:22.386101] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T18:14:22.927566] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:14:22.935636] [INFO ] [REMOTE ] CVE: Full fetch complete (77536 records). [2025-09-19T18:14:22.935862] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-19T18:14:23.043376] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-19T18:14:23.284937] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T18:14:23.388280] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-19T18:14:23.388391] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-19T18:14:23.389341] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-19T18:14:23.389429] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-19T18:14:23.391203] [DEBUG] [LOCAL ] CVE: Trimmed 77536 records to 54337 (keeping 200 days of data) [2025-09-19T18:14:23.729508] [DEBUG] [LOCAL ] CVE: Primary data saved (54337 records). [2025-09-19T18:14:23.729705] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-19T18:14:23.729863] [INFO ] [MAIN ] Update Progress: 563/2372 symbols completed. CVE took 31.4s. Estimated remaining: 3h 58m 49s. Rate: 7.6 symbols/min [2025-09-19T18:14:23.848503] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-19T18:14:23.905587] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:23.959051] [DEBUG] [LOCAL ] CVNA: Loaded 53454 existing records from primary storage. [2025-09-19T18:14:23.959236] [INFO ] [MAIN ] CVNA: Loaded 53454 existing records. [2025-09-19T18:14:24.140790] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:14:24.141041] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-19T18:14:24.141090] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-19T18:14:24.142495] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-19T18:14:24.142559] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-19T18:14:24.509857] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:24.643344] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-19T18:14:25.443336] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-19T18:14:25.724835] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-19T18:14:25.752257] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T18:14:25.758129] [INFO ] [REMOTE ] CURV: Full fetch complete (39954 records). [2025-09-19T18:14:25.758227] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-19T18:14:26.154374] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-19T18:14:26.154464] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-19T18:14:26.155032] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-19T18:14:26.155095] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-19T18:14:26.156081] [DEBUG] [LOCAL ] CURV: Trimmed 39954 records to 27076 (keeping 200 days of data) [2025-09-19T18:14:26.248628] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-19T18:14:26.321356] [DEBUG] [LOCAL ] CURV: Primary data saved (27076 records). [2025-09-19T18:14:26.321503] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-19T18:14:26.321607] [INFO ] [MAIN ] Update Progress: 564/2372 symbols completed. CURV took 34.0s. Estimated remaining: 3h 58m 24s. Rate: 7.6 symbols/min [2025-09-19T18:14:26.517822] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:26.518266] [DEBUG] [LOCAL ] CVS: No existing data file found in primary storage. [2025-09-19T18:14:26.518330] [WARN ] [MAIN ] CVS: No existing data found, performing full refresh instead. [2025-09-19T18:14:26.518547] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-19T18:14:26.518685] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-19T18:14:26.519348] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-09-19T18:14:26.519538] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-19T18:14:26.649684] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T18:14:26.934715] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:26.977986] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T18:14:27.043239] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-19T18:14:27.843272] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-19T18:14:28.039709] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T18:14:28.501700] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T18:14:28.643277] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-19T18:14:29.443409] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-19T18:14:29.729634] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T18:14:30.243293] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-19T18:14:30.339565] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T18:14:30.386571] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:14:31.043255] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-19T18:14:31.843267] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-19T18:14:32.098261] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:14:32.643275] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-19T18:14:32.948601] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T18:14:33.040997] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T18:14:33.443273] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-19T18:14:34.243277] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-19T18:14:35.018973] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T18:14:35.043220] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-19T18:14:35.276006] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-19T18:14:35.843272] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-19T18:14:36.387314] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T18:14:36.473888] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T18:14:36.481685] [INFO ] [REMOTE ] CVI: Full fetch complete (67241 records). [2025-09-19T18:14:36.481865] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-19T18:14:36.652451] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-19T18:14:36.892151] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-19T18:14:36.892313] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-19T18:14:36.893307] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-19T18:14:36.893393] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-19T18:14:36.894942] [DEBUG] [LOCAL ] CVI: Trimmed 67241 records to 47141 (keeping 200 days of data) [2025-09-19T18:14:37.129898] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T18:14:37.208229] [DEBUG] [LOCAL ] CVI: Primary data saved (47141 records). [2025-09-19T18:14:37.208374] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-19T18:14:37.208481] [INFO ] [MAIN ] Update Progress: 565/2372 symbols completed. CVI took 26.2s. Estimated remaining: 3h 58m 26s. Rate: 7.6 symbols/min [2025-09-19T18:14:37.398794] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:37.455997] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-19T18:14:37.459448] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-09-19T18:14:37.459733] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-09-19T18:14:37.658486] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:14:37.658800] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-19T18:14:37.658860] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-19T18:14:37.660457] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-19T18:14:37.660519] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-19T18:14:38.045676] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:38.243217] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-19T18:14:38.715468] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T18:14:38.844507] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:14:39.043257] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-19T18:14:39.661347] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-19T18:14:39.843262] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-19T18:14:40.643264] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-19T18:14:40.730544] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T18:14:41.443288] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-19T18:14:41.469126] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T18:14:41.471839] [INFO ] [REMOTE ] CVLG: Full fetch complete (20488 records). [2025-09-19T18:14:41.471924] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-19T18:14:41.859557] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-19T18:14:41.859732] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-19T18:14:41.860240] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-19T18:14:41.860341] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-19T18:14:41.861414] [DEBUG] [LOCAL ] CVLG: Trimmed 20488 records to 15662 (keeping 200 days of data) [2025-09-19T18:14:41.958148] [DEBUG] [LOCAL ] CVLG: Primary data saved (15662 records). [2025-09-19T18:14:41.958332] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-19T18:14:41.958453] [INFO ] [MAIN ] Update Progress: 566/2372 symbols completed. CVLG took 23.0s. Estimated remaining: 3h 58m 8s. Rate: 7.6 symbols/min [2025-09-19T18:14:42.165349] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T18:14:42.168483] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:42.168802] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-09-19T18:14:42.179828] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-09-19T18:14:42.180091] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-19T18:14:42.180318] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-19T18:14:42.180882] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-19T18:14:42.180945] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-19T18:14:42.248371] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-19T18:14:42.546431] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:43.043266] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-19T18:14:43.343480] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T18:14:43.843274] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-19T18:14:44.643292] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-19T18:14:44.893835] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-19T18:14:45.027192] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T18:14:45.443317] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-19T18:14:45.617160] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:14:46.243503] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-19T18:14:46.243431] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:14:47.043262] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-19T18:14:47.772111] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T18:14:47.843224] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-19T18:14:48.251256] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T18:14:48.563809] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T18:14:48.643257] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-19T18:14:49.443321] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-19T18:14:50.151571] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T18:14:50.221274] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T18:14:50.243253] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-19T18:14:51.043226] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-19T18:14:51.843244] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-19T18:14:51.878171] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-19T18:14:52.264598] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T18:14:52.643240] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-19T18:14:53.251795] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T18:14:53.443302] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-19T18:14:53.528695] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-19T18:14:54.243296] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-19T18:14:54.488875] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T18:14:55.043255] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-19T18:14:55.802684] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-19T18:14:55.810345] [INFO ] [REMOTE ] CVNA: Full fetch complete (76690 records). [2025-09-19T18:14:55.810475] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-19T18:14:55.853797] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-19T18:14:56.209334] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-19T18:14:56.209416] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-19T18:14:56.210246] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-19T18:14:56.210310] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-19T18:14:56.212056] [DEBUG] [LOCAL ] CVNA: Trimmed 76690 records to 53831 (keeping 200 days of data) [2025-09-19T18:14:56.539884] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T18:14:56.555392] [DEBUG] [LOCAL ] CVNA: Primary data saved (53831 records). [2025-09-19T18:14:56.555527] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-19T18:14:56.555622] [INFO ] [MAIN ] Update Progress: 567/2372 symbols completed. CVNA took 32.8s. Estimated remaining: 3h 58m 21s. Rate: 7.6 symbols/min [2025-09-19T18:14:56.652927] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-19T18:14:56.727058] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:14:56.727209] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-09-19T18:14:56.727247] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-09-19T18:14:56.727385] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-19T18:14:56.727428] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-19T18:14:56.727469] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-19T18:14:56.727501] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-19T18:14:57.131478] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:14:57.161632] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-09-19T18:14:57.443225] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-19T18:14:57.657634] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T18:14:58.190077] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T18:14:58.243222] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-19T18:14:59.043271] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-19T18:14:59.458430] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T18:14:59.843277] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-19T18:15:00.161884] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-09-19T18:15:00.454359] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T18:15:00.643284] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-19T18:15:01.244344] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:15:01.443277] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-19T18:15:02.243299] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-19T18:15:03.043307] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-19T18:15:03.257227] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-19T18:15:03.843336] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-19T18:15:04.331351] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-19T18:15:04.643251] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-19T18:15:06.316274] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-19T18:15:06.325738] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-19T18:15:06.665186] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (3.62 seconds). [2025-09-19T18:15:06.684625] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-19T18:15:06.686223] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T18:15:06.689788] [INFO ] [REMOTE ] CW: Full fetch complete (33489 records). [2025-09-19T18:15:06.689867] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-19T18:15:06.690390] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:15:06.690477] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:15:06.690534] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:15:06.690618] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-19T18:15:06.690741] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-19T18:15:06.690815] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-09-19T18:15:06.690915] [DEBUG] [LOCAL ] CW: No derivative data file found to delete. [2025-09-19T18:15:06.691013] [INFO ] [MAIN ] Update Progress: 568/2372 symbols completed. CW took 24.7s. Estimated remaining: 3h 58m 20s. Rate: 7.6 symbols/min [2025-09-19T18:15:06.862495] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:06.912580] [DEBUG] [LOCAL ] CWEN: Loaded 45379 existing records from primary storage. [2025-09-19T18:15:06.912760] [INFO ] [MAIN ] CWEN: Loaded 45379 existing records. [2025-09-19T18:15:07.091094] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:07.091347] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-19T18:15:07.091394] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-19T18:15:07.092829] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-19T18:15:07.092889] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-19T18:15:07.449681] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:07.450085] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-19T18:15:07.586706] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (5.34 seconds). [2025-09-19T18:15:07.843294] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-19T18:15:07.926156] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T18:15:08.643323] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-19T18:15:09.051843] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:15:09.443290] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-19T18:15:09.713402] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T18:15:10.243283] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-19T18:15:10.426570] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:15:10.849326] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-19T18:15:11.043287] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-19T18:15:11.847267] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-19T18:15:11.936071] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T18:15:12.299110] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-19T18:15:12.312598] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-19T18:15:12.312954] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-19T18:15:12.651843] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-19T18:15:12.818600] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-19T18:15:12.818738] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-19T18:15:12.819821] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-19T18:15:12.819915] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-19T18:15:12.821721] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54540 (keeping 200 days of data) [2025-09-19T18:15:13.181718] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-09-19T18:15:13.181911] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-19T18:15:13.182054] [INFO ] [MAIN ] Update Progress: 569/2372 symbols completed. CVX took 36.0s. Estimated remaining: 3h 58m 8s. Rate: 7.6 symbols/min [2025-09-19T18:15:13.374990] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T18:15:13.402608] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:13.454199] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-19T18:15:13.457409] [DEBUG] [LOCAL ] CWH: Loaded 51794 existing records from primary storage. [2025-09-19T18:15:13.457570] [INFO ] [MAIN ] CWH: Loaded 51794 existing records. [2025-09-19T18:15:13.638784] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:13.639049] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-19T18:15:13.639102] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-19T18:15:13.640761] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-19T18:15:13.640834] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-19T18:15:13.998411] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:14.243287] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-19T18:15:15.062344] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (3.22 seconds). [2025-09-19T18:15:15.073718] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-19T18:15:16.127752] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (3.48 seconds). [2025-09-19T18:15:16.137136] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-19T18:15:16.167862] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-19T18:15:16.643315] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-19T18:15:16.798764] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-19T18:15:16.894352] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T18:15:16.901699] [INFO ] [REMOTE ] CVS: Full fetch complete (77425 records). [2025-09-19T18:15:16.901837] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-19T18:15:16.902693] [FATAL] [VALIDATOR ] CVS: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:15:16.902786] [FATAL] [MAIN ] CVS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:15:16.902852] [WARN ] [MAIN ] CVS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:15:16.902915] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-19T18:15:16.902975] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-09-19T18:15:16.903011] [INFO ] [LOCAL ] CVS: Starting deletion of derivative data. [2025-09-19T18:15:16.903049] [DEBUG] [LOCAL ] CVS: No derivative data file found to delete. [2025-09-19T18:15:16.903110] [INFO ] [MAIN ] Update Progress: 570/2372 symbols completed. CVS took 50.6s. Estimated remaining: 3h 57m 46s. Rate: 7.6 symbols/min [2025-09-19T18:15:17.077210] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:17.130351] [DEBUG] [LOCAL ] CWK: Loaded 49789 existing records from primary storage. [2025-09-19T18:15:17.130501] [INFO ] [MAIN ] CWK: Loaded 49789 existing records. [2025-09-19T18:15:17.306194] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:17.306432] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-19T18:15:17.306480] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-19T18:15:17.307632] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-19T18:15:17.307732] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-19T18:15:17.451516] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-19T18:15:17.677838] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:18.028823] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T18:15:18.243278] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-19T18:15:18.390018] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T18:15:18.930259] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T18:15:19.043286] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-19T18:15:19.705862] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:15:19.843291] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-19T18:15:20.597943] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T18:15:20.643240] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-19T18:15:21.124410] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T18:15:21.443275] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-19T18:15:22.243271] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-19T18:15:22.819800] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T18:15:22.829081] [INFO ] [REMOTE ] CWAN: Full fetch complete (75087 records). [2025-09-19T18:15:22.829233] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-19T18:15:23.048345] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-19T18:15:23.264757] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-19T18:15:23.264904] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-19T18:15:23.267366] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-19T18:15:23.267608] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-19T18:15:23.300368] [DEBUG] [LOCAL ] CWAN: Trimmed 75087 records to 53159 (keeping 200 days of data) [2025-09-19T18:15:23.303408] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T18:15:23.453274] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T18:15:23.663349] [DEBUG] [LOCAL ] CWAN: Primary data saved (53159 records). [2025-09-19T18:15:23.663494] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-19T18:15:23.663584] [INFO ] [MAIN ] Update Progress: 571/2372 symbols completed. CWAN took 27.1s. Estimated remaining: 3h 57m 35s. Rate: 7.6 symbols/min [2025-09-19T18:15:23.837480] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:23.843254] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-19T18:15:23.869287] [DEBUG] [LOCAL ] CWT: Loaded 28182 existing records from primary storage. [2025-09-19T18:15:23.869452] [INFO ] [MAIN ] CWT: Loaded 28182 existing records. [2025-09-19T18:15:24.075967] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:24.076284] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-19T18:15:24.076392] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-19T18:15:24.077259] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-19T18:15:24.077335] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-19T18:15:24.437099] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:24.643261] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-19T18:15:25.107051] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T18:15:25.443277] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-19T18:15:25.822815] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:15:25.918381] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:15:26.243277] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-19T18:15:26.716904] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T18:15:27.043277] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-19T18:15:27.843297] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-19T18:15:27.948564] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:15:28.561138] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T18:15:28.643265] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-19T18:15:29.400492] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:15:29.443234] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-19T18:15:30.243226] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-19T18:15:30.699554] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:15:30.893571] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T18:15:31.043252] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-19T18:15:31.745022] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T18:15:31.843270] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-19T18:15:32.606794] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T18:15:32.643218] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-19T18:15:33.443240] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-19T18:15:33.765234] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T18:15:33.897257] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:15:34.243294] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-19T18:15:35.043258] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-19T18:15:35.423298] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:15:35.843277] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-19T18:15:36.525155] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T18:15:36.643282] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-19T18:15:37.013426] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T18:15:37.027541] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T18:15:37.443273] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-19T18:15:38.243270] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-19T18:15:38.760537] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T18:15:39.043260] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-19T18:15:39.490876] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T18:15:39.500218] [INFO ] [REMOTE ] CWEN: Full fetch complete (64344 records). [2025-09-19T18:15:39.500407] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-19T18:15:39.861755] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-19T18:15:39.914445] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-19T18:15:39.914825] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-19T18:15:39.915802] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-19T18:15:39.943194] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-19T18:15:39.949255] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:15:39.960197] [DEBUG] [LOCAL ] CWEN: Trimmed 64344 records to 45721 (keeping 200 days of data) [2025-09-19T18:15:40.253060] [DEBUG] [LOCAL ] CWEN: Primary data saved (45721 records). [2025-09-19T18:15:40.253197] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-19T18:15:40.254469] [INFO ] [MAIN ] Update Progress: 572/2372 symbols completed. CWEN took 33.6s. Estimated remaining: 3h 57m 54s. Rate: 7.6 symbols/min [2025-09-19T18:15:40.426046] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:40.426224] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-09-19T18:15:40.426261] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-09-19T18:15:40.426419] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-19T18:15:40.426462] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-19T18:15:40.426502] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-09-19T18:15:40.426562] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-19T18:15:40.649158] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-19T18:15:40.811873] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:40.821453] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T18:15:40.834516] [INFO ] [REMOTE ] CWH: Full fetch complete (72698 records). [2025-09-19T18:15:40.834703] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-19T18:15:41.229634] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-19T18:15:41.229780] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-19T18:15:41.230601] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-19T18:15:41.230666] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-19T18:15:41.232225] [DEBUG] [LOCAL ] CWH: Trimmed 72698 records to 52176 (keeping 200 days of data) [2025-09-19T18:15:41.452008] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-19T18:15:41.454472] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T18:15:41.619748] [DEBUG] [LOCAL ] CWH: Primary data saved (52176 records). [2025-09-19T18:15:41.620021] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-19T18:15:41.620142] [INFO ] [MAIN ] Update Progress: 573/2372 symbols completed. CWH took 28.4s. Estimated remaining: 3h 57m 26s. Rate: 7.6 symbols/min [2025-09-19T18:15:41.796993] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:41.807466] [DEBUG] [LOCAL ] CXE: Loaded 7287 existing records from primary storage. [2025-09-19T18:15:41.807597] [INFO ] [MAIN ] CXE: Loaded 7287 existing records. [2025-09-19T18:15:41.996063] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:15:41.996460] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-19T18:15:41.996548] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-19T18:15:41.997252] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-19T18:15:41.997329] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-19T18:15:42.251674] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-19T18:15:42.398795] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:42.430670] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T18:15:43.048040] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-19T18:15:43.052972] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:15:43.849628] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-19T18:15:43.854229] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T18:15:43.949564] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T18:15:44.643265] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-19T18:15:45.393377] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:15:45.443228] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-19T18:15:45.573798] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T18:15:46.170118] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T18:15:46.243291] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-19T18:15:47.043275] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-19T18:15:47.800374] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:15:47.805190] [INFO ] [REMOTE ] CWT: Full fetch complete (40309 records). [2025-09-19T18:15:47.805302] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-19T18:15:47.852778] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-19T18:15:48.219429] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-19T18:15:48.219545] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-19T18:15:48.220121] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-19T18:15:48.220184] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-19T18:15:48.221223] [DEBUG] [LOCAL ] CWT: Trimmed 40309 records to 28363 (keeping 200 days of data) [2025-09-19T18:15:48.424631] [DEBUG] [LOCAL ] CWT: Primary data saved (28363 records). [2025-09-19T18:15:48.439903] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-19T18:15:48.443756] [INFO ] [MAIN ] Update Progress: 574/2372 symbols completed. CWT took 24.8s. Estimated remaining: 3h 57m 14s. Rate: 7.6 symbols/min [2025-09-19T18:15:48.515987] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T18:15:48.636882] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:48.637107] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-09-19T18:15:48.637163] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-09-19T18:15:48.637308] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-19T18:15:48.637361] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-19T18:15:48.637410] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-09-19T18:15:48.637451] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-19T18:15:48.648584] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-19T18:15:49.000108] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:49.385345] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:15:49.443232] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-19T18:15:49.700717] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T18:15:50.243264] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-19T18:15:50.910712] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T18:15:51.043252] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-19T18:15:51.347229] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T18:15:51.843270] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-19T18:15:51.868591] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T18:15:52.643315] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-19T18:15:53.214891] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T18:15:53.222280] [INFO ] [REMOTE ] CWK: Full fetch complete (70823 records). [2025-09-19T18:15:53.222446] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-19T18:15:53.453844] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-19T18:15:53.534144] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T18:15:53.631777] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-19T18:15:53.631885] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-19T18:15:53.632954] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-19T18:15:53.633028] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-19T18:15:53.635713] [DEBUG] [LOCAL ] CWK: Trimmed 70823 records to 50153 (keeping 200 days of data) [2025-09-19T18:15:53.978569] [DEBUG] [LOCAL ] CWK: Primary data saved (50153 records). [2025-09-19T18:15:53.978775] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-19T18:15:53.978876] [INFO ] [MAIN ] Update Progress: 575/2372 symbols completed. CWK took 37.1s. Estimated remaining: 3h 56m 59s. Rate: 7.6 symbols/min [2025-09-19T18:15:54.233402] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:15:54.233628] [DEBUG] [LOCAL ] CXM: No existing data file found in primary storage. [2025-09-19T18:15:54.233709] [WARN ] [MAIN ] CXM: No existing data found, performing full refresh instead. [2025-09-19T18:15:54.233914] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-19T18:15:54.233958] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-19T18:15:54.234001] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-09-19T18:15:54.234033] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-19T18:15:54.248428] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-19T18:15:54.608555] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:15:54.897908] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-19T18:15:55.043290] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-19T18:15:55.623690] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T18:15:55.843273] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-19T18:15:56.609694] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T18:15:56.643303] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-19T18:15:56.970639] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T18:15:57.145155] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-19T18:15:57.443276] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-19T18:15:58.063395] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T18:15:58.243282] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-19T18:15:59.043254] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-19T18:15:59.843268] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-19T18:16:00.337373] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T18:16:00.620589] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-19T18:16:00.643225] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-19T18:16:00.930749] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T18:16:01.443316] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-19T18:16:01.611227] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T18:16:01.614264] [INFO ] [REMOTE ] CXE: Full fetch complete (11865 records). [2025-09-19T18:16:01.614456] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-19T18:16:02.091275] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-19T18:16:02.091400] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-19T18:16:02.091743] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-19T18:16:02.091818] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-19T18:16:02.092567] [DEBUG] [LOCAL ] CXE: Trimmed 11865 records to 7323 (keeping 200 days of data) [2025-09-19T18:16:02.139670] [DEBUG] [LOCAL ] CXE: Primary data saved (7323 records). [2025-09-19T18:16:02.139851] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-19T18:16:02.139957] [INFO ] [MAIN ] Update Progress: 576/2372 symbols completed. CXE took 20.5s. Estimated remaining: 3h 56m 52s. Rate: 7.6 symbols/min [2025-09-19T18:16:02.251473] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-19T18:16:02.333988] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:02.366472] [DEBUG] [LOCAL ] CXT: Loaded 31312 existing records from primary storage. [2025-09-19T18:16:02.366612] [INFO ] [MAIN ] CXT: Loaded 31312 existing records. [2025-09-19T18:16:02.555294] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:02.555572] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-19T18:16:02.555684] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-19T18:16:02.556679] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-19T18:16:02.556740] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-19T18:16:02.919726] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:03.007196] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T18:16:03.032719] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T18:16:03.043225] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-19T18:16:03.843279] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-19T18:16:04.391562] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T18:16:04.425963] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T18:16:04.643326] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-19T18:16:05.062635] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T18:16:05.443337] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-19T18:16:06.243316] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-19T18:16:07.007774] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T18:16:07.043250] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-19T18:16:07.834057] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T18:16:07.843208] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-19T18:16:08.003994] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T18:16:08.552064] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T18:16:08.643219] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-19T18:16:09.443273] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-19T18:16:09.617735] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:16:10.243282] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-19T18:16:10.750580] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T18:16:11.043287] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-19T18:16:11.734475] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:16:11.843258] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-19T18:16:12.566471] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T18:16:12.643279] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-19T18:16:13.443389] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-19T18:16:13.477552] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T18:16:13.798232] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T18:16:14.115360] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T18:16:14.243284] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-19T18:16:15.043271] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-19T18:16:15.223428] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T18:16:15.225020] [INFO ] [REMOTE ] CXH: Full fetch complete (5529 records). [2025-09-19T18:16:15.225118] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-19T18:16:15.609252] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-19T18:16:15.609398] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-19T18:16:15.609639] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-19T18:16:15.609722] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-19T18:16:15.610130] [DEBUG] [LOCAL ] CXH: Trimmed 5529 records to 4458 (keeping 200 days of data) [2025-09-19T18:16:15.636588] [DEBUG] [LOCAL ] CXH: Primary data saved (4458 records). [2025-09-19T18:16:15.636754] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-19T18:16:15.636843] [INFO ] [MAIN ] Update Progress: 577/2372 symbols completed. CXH took 27.2s. Estimated remaining: 3h 57m 1s. Rate: 7.6 symbols/min [2025-09-19T18:16:15.813480] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:15.844111] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-19T18:16:15.864429] [DEBUG] [LOCAL ] CXW: Loaded 44915 existing records from primary storage. [2025-09-19T18:16:15.864596] [INFO ] [MAIN ] CXW: Loaded 44915 existing records. [2025-09-19T18:16:16.053555] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:16.053845] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-19T18:16:16.053952] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-19T18:16:16.055347] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-19T18:16:16.055420] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-19T18:16:16.447819] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:16.643281] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-19T18:16:16.902785] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T18:16:17.443320] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-19T18:16:17.737924] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T18:16:18.041264] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T18:16:18.243267] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-19T18:16:18.482924] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T18:16:19.043255] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-19T18:16:19.843291] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-19T18:16:20.445950] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T18:16:20.596436] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T18:16:20.643252] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-19T18:16:21.197960] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T18:16:21.443267] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-19T18:16:22.243299] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-19T18:16:22.731117] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T18:16:23.000511] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T18:16:23.043257] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-19T18:16:23.843288] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-19T18:16:24.055526] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:16:24.643305] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-19T18:16:24.812560] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:16:24.850197] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T18:16:25.443263] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-19T18:16:26.243288] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-19T18:16:26.281303] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T18:16:26.293726] [INFO ] [REMOTE ] CX: Full fetch complete (76356 records). [2025-09-19T18:16:26.293920] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-19T18:16:26.717873] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-19T18:16:26.717996] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-19T18:16:26.718876] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-19T18:16:26.718944] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-19T18:16:26.720588] [DEBUG] [LOCAL ] CX: Trimmed 76356 records to 53611 (keeping 200 days of data) [2025-09-19T18:16:27.043382] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-19T18:16:27.058851] [DEBUG] [LOCAL ] CX: Primary data saved (53611 records). [2025-09-19T18:16:27.058992] [INFO ] [MAIN ] CX: Full history saved. [2025-09-19T18:16:27.059128] [INFO ] [MAIN ] Update Progress: 578/2372 symbols completed. CX took 46.8s. Estimated remaining: 3h 57m 4s. Rate: 7.6 symbols/min [2025-09-19T18:16:27.240449] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:27.291520] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:16:27.302250] [DEBUG] [LOCAL ] CYD: Loaded 27150 existing records from primary storage. [2025-09-19T18:16:27.302708] [INFO ] [MAIN ] CYD: Loaded 27150 existing records. [2025-09-19T18:16:27.487203] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:27.487529] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-19T18:16:27.487589] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-19T18:16:27.488480] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-19T18:16:27.488543] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-19T18:16:27.841838] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:27.843216] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-19T18:16:28.131515] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:16:28.648373] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-19T18:16:28.667147] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:16:28.681688] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T18:16:29.443259] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-19T18:16:30.187699] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T18:16:30.243334] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-19T18:16:30.710324] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T18:16:31.043281] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-19T18:16:31.568710] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:16:31.573730] [INFO ] [REMOTE ] CXT: Full fetch complete (44788 records). [2025-09-19T18:16:31.573863] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-19T18:16:31.848443] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-19T18:16:32.058101] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-19T18:16:32.058186] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-19T18:16:32.058860] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-19T18:16:32.058975] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-19T18:16:32.060035] [DEBUG] [LOCAL ] CXT: Trimmed 44788 records to 31548 (keeping 200 days of data) [2025-09-19T18:16:32.252318] [DEBUG] [LOCAL ] CXT: Primary data saved (31548 records). [2025-09-19T18:16:32.252470] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-19T18:16:32.252569] [INFO ] [MAIN ] Update Progress: 579/2372 symbols completed. CXT took 30.1s. Estimated remaining: 3h 56m 48s. Rate: 7.6 symbols/min [2025-09-19T18:16:32.442228] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:32.486950] [DEBUG] [LOCAL ] CYH: Loaded 48382 existing records from primary storage. [2025-09-19T18:16:32.487112] [INFO ] [MAIN ] CYH: Loaded 48382 existing records. [2025-09-19T18:16:32.648410] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-19T18:16:32.689720] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:32.689984] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-19T18:16:32.690047] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-19T18:16:32.691531] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-19T18:16:32.691604] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-19T18:16:33.071722] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:33.103142] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T18:16:33.271998] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T18:16:33.443271] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-19T18:16:34.243294] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-19T18:16:34.575719] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T18:16:35.043256] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-19T18:16:35.491925] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:16:35.843268] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-19T18:16:36.264331] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T18:16:36.643256] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-19T18:16:36.819124] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T18:16:36.826499] [INFO ] [REMOTE ] CXM: Full fetch complete (69152 records). [2025-09-19T18:16:36.826688] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-19T18:16:37.237382] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-19T18:16:37.237473] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-19T18:16:37.238342] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-19T18:16:37.238408] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-19T18:16:37.239921] [DEBUG] [LOCAL ] CXM: Trimmed 69152 records to 48705 (keeping 200 days of data) [2025-09-19T18:16:37.452093] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-19T18:16:37.541247] [DEBUG] [LOCAL ] CXM: Primary data saved (48705 records). [2025-09-19T18:16:37.541400] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-19T18:16:37.541494] [INFO ] [MAIN ] Update Progress: 580/2372 symbols completed. CXM took 43.6s. Estimated remaining: 3h 56m 32s. Rate: 7.6 symbols/min [2025-09-19T18:16:37.728454] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:37.784724] [DEBUG] [LOCAL ] D: Loaded 54037 existing records from primary storage. [2025-09-19T18:16:37.784998] [INFO ] [MAIN ] D: Loaded 54037 existing records. [2025-09-19T18:16:37.940399] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T18:16:38.015434] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:38.015714] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-19T18:16:38.015770] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-19T18:16:38.017263] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-19T18:16:38.017326] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-19T18:16:38.258554] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-19T18:16:38.384555] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:38.589051] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:16:38.690723] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T18:16:39.043282] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-19T18:16:39.547338] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T18:16:39.843275] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-19T18:16:40.643272] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-19T18:16:40.691127] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:16:41.443260] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-19T18:16:41.972033] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T18:16:42.168470] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:16:42.174954] [INFO ] [REMOTE ] CXW: Full fetch complete (65052 records). [2025-09-19T18:16:42.175074] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-19T18:16:42.248418] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-19T18:16:42.583967] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-19T18:16:42.584100] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-19T18:16:42.585078] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-19T18:16:42.585429] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-19T18:16:42.601519] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T18:16:42.608149] [DEBUG] [LOCAL ] CXW: Trimmed 65052 records to 45182 (keeping 200 days of data) [2025-09-19T18:16:42.872582] [DEBUG] [LOCAL ] CXW: Primary data saved (45182 records). [2025-09-19T18:16:42.872751] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-19T18:16:42.872847] [INFO ] [MAIN ] Update Progress: 581/2372 symbols completed. CXW took 27.2s. Estimated remaining: 3h 56m 16s. Rate: 7.6 symbols/min [2025-09-19T18:16:43.057277] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-19T18:16:43.061610] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:43.061808] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-09-19T18:16:43.063277] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-09-19T18:16:43.063467] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-19T18:16:43.063534] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-19T18:16:43.063589] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-19T18:16:43.063623] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-19T18:16:43.427608] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:43.843241] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-19T18:16:44.506223] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T18:16:44.606450] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-19T18:16:44.643223] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-19T18:16:45.317598] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T18:16:45.443253] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-19T18:16:46.189315] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T18:16:46.243258] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-19T18:16:47.043276] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-19T18:16:47.436633] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T18:16:47.696329] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T18:16:47.843281] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-19T18:16:48.401885] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T18:16:48.643248] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-19T18:16:49.084825] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:16:49.443270] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-19T18:16:50.243272] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-19T18:16:50.309054] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T18:16:50.551487] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T18:16:51.043312] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-19T18:16:51.843266] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-19T18:16:52.460756] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:16:52.544698] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:16:52.643308] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-19T18:16:53.443286] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-19T18:16:53.845875] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:16:54.207717] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T18:16:54.243260] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-19T18:16:55.043298] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-19T18:16:55.301328] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T18:16:55.796184] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:16:55.800877] [INFO ] [REMOTE ] CYD: Full fetch complete (31664 records). [2025-09-19T18:16:55.800958] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-19T18:16:55.848418] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-19T18:16:56.201307] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-19T18:16:56.201391] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-19T18:16:56.201957] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-19T18:16:56.202020] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-19T18:16:56.202887] [DEBUG] [LOCAL ] CYD: Trimmed 31664 records to 27385 (keeping 200 days of data) [2025-09-19T18:16:56.367325] [DEBUG] [LOCAL ] CYD: Primary data saved (27385 records). [2025-09-19T18:16:56.367490] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-19T18:16:56.367662] [INFO ] [MAIN ] Update Progress: 582/2372 symbols completed. CYD took 29.3s. Estimated remaining: 3h 56m 25s. Rate: 7.6 symbols/min [2025-09-19T18:16:56.553610] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:16:56.612232] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-09-19T18:16:56.612383] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-09-19T18:16:56.656514] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-19T18:16:56.811825] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:16:56.812098] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-19T18:16:56.812151] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-19T18:16:56.813382] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-19T18:16:56.813447] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-19T18:16:57.231542] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:16:57.268108] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T18:16:57.291352] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:16:57.443348] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-19T18:16:58.243332] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-19T18:16:58.725491] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T18:16:59.043310] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-19T18:16:59.242923] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T18:16:59.843287] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-19T18:17:00.568526] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T18:17:00.643265] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-19T18:17:01.279742] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T18:17:01.443272] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-19T18:17:01.945280] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T18:17:02.243285] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-19T18:17:03.014480] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T18:17:03.043210] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-19T18:17:03.084009] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T18:17:03.317683] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-19T18:17:03.843289] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-19T18:17:04.238479] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T18:17:04.643273] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-19T18:17:05.443286] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-19T18:17:05.954871] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:17:06.061906] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-19T18:17:06.243286] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-19T18:17:06.616789] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T18:17:06.624857] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-09-19T18:17:06.624992] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-19T18:17:07.037264] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-19T18:17:07.037428] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-19T18:17:07.038480] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-19T18:17:07.038552] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-19T18:17:07.040292] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 54427 (keeping 200 days of data) [2025-09-19T18:17:07.043302] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-19T18:17:07.386776] [DEBUG] [LOCAL ] D: Primary data saved (54427 records). [2025-09-19T18:17:07.386926] [INFO ] [MAIN ] D: Full history saved. [2025-09-19T18:17:07.387024] [INFO ] [MAIN ] Update Progress: 583/2372 symbols completed. D took 29.8s. Estimated remaining: 3h 56m 27s. Rate: 7.6 symbols/min [2025-09-19T18:17:07.480382] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T18:17:07.576020] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:07.625451] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-09-19T18:17:07.625605] [INFO ] [MAIN ] DAN: Loaded 49394 existing records. [2025-09-19T18:17:07.801813] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:07.802078] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-19T18:17:07.802130] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-19T18:17:07.803658] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-19T18:17:07.803723] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-19T18:17:07.848473] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-19T18:17:08.202170] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:08.646227] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-19T18:17:08.648258] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T18:17:08.650474] [INFO ] [REMOTE ] DAC: Full fetch complete (20088 records). [2025-09-19T18:17:08.650549] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-19T18:17:09.054239] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-19T18:17:09.054332] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-19T18:17:09.054818] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-19T18:17:09.054882] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-19T18:17:09.055622] [DEBUG] [LOCAL ] DAC: Trimmed 20088 records to 12959 (keeping 200 days of data) [2025-09-19T18:17:09.142998] [DEBUG] [LOCAL ] DAC: Primary data saved (12959 records). [2025-09-19T18:17:09.143156] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-19T18:17:09.143242] [INFO ] [MAIN ] Update Progress: 584/2372 symbols completed. DAC took 26.3s. Estimated remaining: 3h 55m 60s. Rate: 7.6 symbols/min [2025-09-19T18:17:09.339069] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:09.377335] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T18:17:09.397057] [DEBUG] [LOCAL ] DAO: Loaded 21693 existing records from primary storage. [2025-09-19T18:17:09.397214] [INFO ] [MAIN ] DAO: Loaded 21693 existing records. [2025-09-19T18:17:09.453783] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-19T18:17:09.602810] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:09.603182] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-19T18:17:09.603261] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-19T18:17:09.603930] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-19T18:17:09.603999] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-19T18:17:09.990315] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:10.243280] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-19T18:17:10.645634] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:17:10.653103] [INFO ] [REMOTE ] CYH: Full fetch complete (70537 records). [2025-09-19T18:17:10.653267] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-19T18:17:11.049914] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-19T18:17:11.054750] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-19T18:17:11.054925] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-19T18:17:11.055910] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-19T18:17:11.056188] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-19T18:17:11.087353] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T18:17:11.097477] [DEBUG] [LOCAL ] CYH: Trimmed 70537 records to 48687 (keeping 200 days of data) [2025-09-19T18:17:11.210159] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T18:17:11.419842] [DEBUG] [LOCAL ] CYH: Primary data saved (48687 records). [2025-09-19T18:17:11.419992] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-19T18:17:11.420080] [INFO ] [MAIN ] Update Progress: 585/2372 symbols completed. CYH took 39.2s. Estimated remaining: 3h 55m 35s. Rate: 7.6 symbols/min [2025-09-19T18:17:11.588771] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:11.639889] [DEBUG] [LOCAL ] DAR: Loaded 52223 existing records from primary storage. [2025-09-19T18:17:11.640077] [INFO ] [MAIN ] DAR: Loaded 52223 existing records. [2025-09-19T18:17:11.817705] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:11.818066] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-19T18:17:11.818149] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-19T18:17:11.819496] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-19T18:17:11.819570] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-19T18:17:11.850325] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-19T18:17:12.175076] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:12.643252] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-19T18:17:12.664559] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-19T18:17:13.443266] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-19T18:17:13.811957] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-19T18:17:13.928957] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T18:17:14.243314] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-19T18:17:14.874066] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T18:17:15.043267] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-19T18:17:15.843252] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-19T18:17:16.189215] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T18:17:16.354475] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T18:17:16.643287] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-19T18:17:17.443274] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-19T18:17:18.243286] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-19T18:17:18.486833] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-19T18:17:18.530575] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T18:17:18.561900] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T18:17:19.043261] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-19T18:17:19.843281] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-19T18:17:20.219326] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:17:20.643276] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-19T18:17:20.848605] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:17:20.996462] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T18:17:21.443308] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-19T18:17:22.243259] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-19T18:17:22.686390] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:17:22.711901] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T18:17:23.043264] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-19T18:17:23.843255] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-19T18:17:24.149631] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:17:24.274331] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T18:17:24.643256] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-19T18:17:25.443264] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-19T18:17:25.757224] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T18:17:25.937676] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T18:17:26.243271] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-19T18:17:27.048340] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-19T18:17:27.067503] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T18:17:27.555721] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T18:17:27.843267] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-19T18:17:28.643264] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-19T18:17:29.113029] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:17:29.116631] [INFO ] [REMOTE ] DAO: Full fetch complete (32488 records). [2025-09-19T18:17:29.116762] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-19T18:17:29.447731] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-19T18:17:29.497380] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-19T18:17:29.497729] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-19T18:17:29.498341] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-19T18:17:29.498542] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-19T18:17:29.500418] [DEBUG] [LOCAL ] DAO: Trimmed 32488 records to 21932 (keeping 200 days of data) [2025-09-19T18:17:29.630315] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:17:29.675125] [DEBUG] [LOCAL ] DAO: Primary data saved (21932 records). [2025-09-19T18:17:29.675274] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-19T18:17:29.675366] [INFO ] [MAIN ] Update Progress: 586/2372 symbols completed. DAO took 20.5s. Estimated remaining: 3h 55m 58s. Rate: 7.6 symbols/min [2025-09-19T18:17:29.841504] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:29.880133] [DEBUG] [LOCAL ] DAVA: Loaded 40658 existing records from primary storage. [2025-09-19T18:17:29.880278] [INFO ] [MAIN ] DAVA: Loaded 40658 existing records. [2025-09-19T18:17:30.058978] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:30.059262] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-19T18:17:30.059338] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-19T18:17:30.060400] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-19T18:17:30.060465] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-19T18:17:30.271004] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-19T18:17:30.430456] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:30.714927] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T18:17:31.043248] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-19T18:17:31.557773] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T18:17:31.843266] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-19T18:17:32.590611] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T18:17:32.643227] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-19T18:17:32.802591] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T18:17:33.443274] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-19T18:17:33.690253] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T18:17:34.243280] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-19T18:17:34.901386] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T18:17:34.909260] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-19T18:17:34.909392] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-19T18:17:35.054360] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-19T18:17:35.317115] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-19T18:17:35.317320] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-19T18:17:35.318562] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-19T18:17:35.318684] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-19T18:17:35.352196] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T18:17:35.363130] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54533 (keeping 200 days of data) [2025-09-19T18:17:35.693261] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-09-19T18:17:35.693400] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-19T18:17:35.694871] [INFO ] [MAIN ] Update Progress: 587/2372 symbols completed. DAL took 39.3s. Estimated remaining: 3h 55m 45s. Rate: 7.6 symbols/min [2025-09-19T18:17:35.815404] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T18:17:35.848330] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-19T18:17:35.894820] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:35.943681] [DEBUG] [LOCAL ] DAY: Loaded 50388 existing records from primary storage. [2025-09-19T18:17:35.943860] [INFO ] [MAIN ] DAY: Loaded 50388 existing records. [2025-09-19T18:17:36.117744] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:17:36.117947] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-19T18:17:36.118081] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-19T18:17:36.119147] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-19T18:17:36.119208] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-19T18:17:36.473733] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:36.643233] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-19T18:17:37.178278] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T18:17:37.443293] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-19T18:17:37.776696] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T18:17:38.138966] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T18:17:38.243220] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-19T18:17:39.043254] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-19T18:17:39.496984] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T18:17:39.744162] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T18:17:39.843218] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-19T18:17:40.643348] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-19T18:17:41.065910] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T18:17:41.443281] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-19T18:17:41.879057] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T18:17:41.886969] [INFO ] [REMOTE ] DAN: Full fetch complete (70917 records). [2025-09-19T18:17:41.887208] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-19T18:17:42.248114] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-19T18:17:42.343678] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:17:42.358018] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-19T18:17:42.358377] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-19T18:17:42.359457] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-19T18:17:42.359564] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-19T18:17:42.361222] [DEBUG] [LOCAL ] DAN: Trimmed 70917 records to 49741 (keeping 200 days of data) [2025-09-19T18:17:42.670254] [DEBUG] [LOCAL ] DAN: Primary data saved (49741 records). [2025-09-19T18:17:42.670472] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-19T18:17:42.670628] [INFO ] [MAIN ] Update Progress: 588/2372 symbols completed. DAN took 35.3s. Estimated remaining: 3h 55m 34s. Rate: 7.6 symbols/min [2025-09-19T18:17:42.841101] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:42.841337] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-09-19T18:17:42.841392] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-09-19T18:17:42.841561] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-19T18:17:42.841604] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-19T18:17:42.841668] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-19T18:17:42.841740] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-19T18:17:43.055211] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-19T18:17:43.221108] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:43.240432] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T18:17:43.843279] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-19T18:17:44.307099] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T18:17:44.643288] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-19T18:17:45.339154] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T18:17:45.443225] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-19T18:17:45.569939] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:17:46.173988] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:17:46.183623] [INFO ] [REMOTE ] DAR: Full fetch complete (74547 records). [2025-09-19T18:17:46.183854] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-19T18:17:46.254007] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-19T18:17:46.618697] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-19T18:17:46.618818] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-19T18:17:46.619892] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-19T18:17:46.619975] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-19T18:17:46.622496] [DEBUG] [LOCAL ] DAR: Trimmed 74547 records to 52611 (keeping 200 days of data) [2025-09-19T18:17:46.947697] [DEBUG] [LOCAL ] DAR: Primary data saved (52611 records). [2025-09-19T18:17:46.947851] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-19T18:17:46.947994] [INFO ] [MAIN ] Update Progress: 589/2372 symbols completed. DAR took 35.5s. Estimated remaining: 3h 55m 15s. Rate: 7.6 symbols/min [2025-09-19T18:17:47.048340] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-19T18:17:47.136190] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:17:47.136408] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-19T18:17:47.136474] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-19T18:17:47.136708] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-19T18:17:47.136761] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-19T18:17:47.136807] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-19T18:17:47.136851] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-19T18:17:47.536404] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:17:47.569892] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T18:17:47.843272] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-19T18:17:48.253421] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:17:48.643301] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-19T18:17:49.291510] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T18:17:49.443290] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-19T18:17:50.137095] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-19T18:17:50.243341] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-19T18:17:50.459782] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:17:50.533565] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T18:17:51.043318] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-19T18:17:51.843301] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-19T18:17:52.070891] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T18:17:52.540898] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T18:17:52.643250] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-19T18:17:53.443303] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-19T18:17:53.746729] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T18:17:54.243279] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-19T18:17:54.601735] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:17:54.968714] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:17:54.992868] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T18:17:55.043292] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-19T18:17:55.843276] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-19T18:17:56.225746] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T18:17:56.643292] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-19T18:17:57.443271] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-19T18:17:57.601836] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T18:17:57.705247] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T18:17:58.243309] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-19T18:17:59.043293] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-19T18:17:59.544966] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T18:17:59.803280] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-19T18:17:59.836365] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T18:17:59.843381] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-19T18:18:00.643270] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-19T18:18:01.443289] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-19T18:18:02.243279] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-19T18:18:02.611309] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-19T18:18:03.043267] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-19T18:18:03.225311] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-19T18:18:03.683713] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T18:18:03.843296] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-19T18:18:04.643288] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-19T18:18:06.262357] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-19T18:18:06.268434] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-19T18:18:06.373328] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T18:18:06.380339] [INFO ] [REMOTE ] DAY: Full fetch complete (71789 records). [2025-09-19T18:18:06.380453] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-19T18:18:06.781844] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-19T18:18:06.782077] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-19T18:18:06.783041] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-19T18:18:06.783125] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-19T18:18:06.784790] [DEBUG] [LOCAL ] DAY: Trimmed 71789 records to 50756 (keeping 200 days of data) [2025-09-19T18:18:06.914109] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (4.67 seconds). [2025-09-19T18:18:06.924530] [INFO ] [REMOTE ] DAVA: Full fetch complete (55152 records). [2025-09-19T18:18:06.925222] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-19T18:18:07.339477] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (4.30 seconds). [2025-09-19T18:18:07.486020] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-19T18:18:07.471394] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-19T18:18:07.486146] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-19T18:18:07.488828] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-19T18:18:07.488937] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-19T18:18:07.558377] [DEBUG] [LOCAL ] DAVA: Trimmed 55152 records to 41022 (keeping 200 days of data) [2025-09-19T18:18:07.603635] [DEBUG] [LOCAL ] DAY: Primary data saved (50756 records). [2025-09-19T18:18:07.603845] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-19T18:18:07.603963] [INFO ] [MAIN ] Update Progress: 590/2372 symbols completed. DAY took 31.9s. Estimated remaining: 3h 55m 45s. Rate: 7.6 symbols/min [2025-09-19T18:18:07.940193] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:07.941004] [DEBUG] [LOCAL ] DBI: No existing data file found in primary storage. [2025-09-19T18:18:07.941753] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-09-19T18:18:07.943415] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-19T18:18:07.944682] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-19T18:18:07.946212] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-09-19T18:18:07.946588] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-19T18:18:08.045166] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T18:18:08.133209] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-19T18:18:08.482766] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:08.485966] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-19T18:18:08.498016] [DEBUG] [LOCAL ] DAVA: Primary data saved (41022 records). [2025-09-19T18:18:08.498146] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-19T18:18:08.498245] [INFO ] [MAIN ] Update Progress: 591/2372 symbols completed. DAVA took 38.8s. Estimated remaining: 3h 55m 16s. Rate: 7.6 symbols/min [2025-09-19T18:18:08.671236] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:08.684855] [DEBUG] [LOCAL ] DBL: Loaded 9122 existing records from primary storage. [2025-09-19T18:18:08.684990] [INFO ] [MAIN ] DBL: Loaded 9122 existing records. [2025-09-19T18:18:08.866548] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:08.866822] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-19T18:18:08.866874] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-19T18:18:08.867520] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-19T18:18:08.867580] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-19T18:18:09.235282] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:09.235637] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-19T18:18:09.584327] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T18:18:09.594912] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-19T18:18:09.723668] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T18:18:09.878023] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-19T18:18:10.015303] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T18:18:10.243331] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-19T18:18:10.388587] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T18:18:10.393089] [INFO ] [REMOTE ] DBD: Full fetch complete (30285 records). [2025-09-19T18:18:10.393311] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-19T18:18:10.394041] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:18:10.394149] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:18:10.394215] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:18:10.394286] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-19T18:18:10.394360] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-19T18:18:10.394413] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-19T18:18:10.394511] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-19T18:18:10.394616] [INFO ] [MAIN ] Update Progress: 592/2372 symbols completed. DBD took 23.4s. Estimated remaining: 3h 54m 50s. Rate: 7.6 symbols/min [2025-09-19T18:18:10.589295] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:10.646028] [DEBUG] [LOCAL ] DBRG: Loaded 50211 existing records from primary storage. [2025-09-19T18:18:10.646186] [INFO ] [MAIN ] DBRG: Loaded 50211 existing records. [2025-09-19T18:18:10.829610] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:10.829882] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-19T18:18:10.829931] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-19T18:18:10.831137] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-19T18:18:10.831200] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-19T18:18:11.048505] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-19T18:18:11.194261] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:18:11.227934] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:11.843273] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-19T18:18:12.431557] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T18:18:12.643263] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-19T18:18:13.443263] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-19T18:18:13.957909] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T18:18:14.243284] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-19T18:18:15.043246] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-19T18:18:15.808176] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (3.16 seconds). [2025-09-19T18:18:15.843227] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-19T18:18:16.241532] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-19T18:18:16.418964] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T18:18:16.440267] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T18:18:16.643262] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-19T18:18:17.421814] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T18:18:17.443285] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-19T18:18:18.065916] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T18:18:18.243262] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-19T18:18:19.043238] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-19T18:18:19.170929] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:18:19.675772] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-19T18:18:19.843264] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-19T18:18:20.106799] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T18:18:20.114735] [INFO ] [REMOTE ] DB: Full fetch complete (74046 records). [2025-09-19T18:18:20.114851] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-19T18:18:20.513226] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T18:18:20.513347] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-19T18:18:20.515367] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-19T18:18:20.516881] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-19T18:18:20.517260] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-19T18:18:20.518780] [DEBUG] [LOCAL ] DB: Trimmed 74046 records to 53423 (keeping 200 days of data) [2025-09-19T18:18:20.643636] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-19T18:18:20.847002] [DEBUG] [LOCAL ] DB: Primary data saved (53423 records). [2025-09-19T18:18:20.847146] [INFO ] [MAIN ] DB: Full history saved. [2025-09-19T18:18:20.847233] [INFO ] [MAIN ] Update Progress: 593/2372 symbols completed. DB took 38.2s. Estimated remaining: 3h 54m 50s. Rate: 7.6 symbols/min [2025-09-19T18:18:21.019320] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:21.056107] [DEBUG] [LOCAL ] DCI: Loaded 38012 existing records from primary storage. [2025-09-19T18:18:21.056262] [INFO ] [MAIN ] DCI: Loaded 38012 existing records. [2025-09-19T18:18:21.235448] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:21.235754] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-19T18:18:21.235811] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-19T18:18:21.236800] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-19T18:18:21.236860] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-19T18:18:21.448430] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-19T18:18:21.594305] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:22.229304] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T18:18:22.243211] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-19T18:18:22.605761] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T18:18:23.043272] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-19T18:18:23.467475] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T18:18:23.843310] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-19T18:18:24.643325] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-19T18:18:25.443316] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-19T18:18:25.675126] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-19T18:18:25.753079] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T18:18:26.000956] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:18:26.243271] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-19T18:18:27.043293] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-19T18:18:27.233085] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T18:18:27.234221] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T18:18:27.247433] [INFO ] [REMOTE ] DBL: Full fetch complete (12432 records). [2025-09-19T18:18:27.247556] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-19T18:18:27.701015] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-19T18:18:27.701100] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-19T18:18:27.701416] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-19T18:18:27.701456] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-19T18:18:27.702404] [DEBUG] [LOCAL ] DBL: Trimmed 12432 records to 9154 (keeping 200 days of data) [2025-09-19T18:18:27.764616] [DEBUG] [LOCAL ] DBL: Primary data saved (9154 records). [2025-09-19T18:18:27.764795] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-19T18:18:27.764888] [INFO ] [MAIN ] Update Progress: 594/2372 symbols completed. DBL took 19.3s. Estimated remaining: 3h 54m 39s. Rate: 7.6 symbols/min [2025-09-19T18:18:27.848446] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-19T18:18:27.974460] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:27.990356] [DEBUG] [LOCAL ] DCO: Loaded 13679 existing records from primary storage. [2025-09-19T18:18:27.990493] [INFO ] [MAIN ] DCO: Loaded 13679 existing records. [2025-09-19T18:18:28.198080] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:28.198524] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-19T18:18:28.198622] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-19T18:18:28.199358] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-19T18:18:28.199539] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-19T18:18:28.538900] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T18:18:28.652849] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-19T18:18:28.659690] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:29.443292] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-19T18:18:29.874818] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T18:18:30.243305] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-19T18:18:30.301968] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T18:18:30.729810] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T18:18:31.043269] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-19T18:18:31.843252] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-19T18:18:32.283028] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T18:18:32.428382] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T18:18:32.643281] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-19T18:18:33.127810] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T18:18:33.443267] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-19T18:18:34.182109] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:18:34.243259] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-19T18:18:35.043248] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-19T18:18:35.269692] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T18:18:35.595607] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T18:18:35.660692] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T18:18:35.843273] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-19T18:18:36.643329] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-19T18:18:36.886219] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T18:18:37.443261] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-19T18:18:38.243271] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-19T18:18:38.626298] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:18:39.043300] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-19T18:18:39.687136] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T18:18:39.725052] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T18:18:39.843254] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-19T18:18:40.643300] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-19T18:18:40.668870] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T18:18:41.375026] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:18:41.382470] [INFO ] [REMOTE ] DBRG: Full fetch complete (72203 records). [2025-09-19T18:18:41.382703] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-19T18:18:41.451272] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-19T18:18:41.789031] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-19T18:18:41.789145] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-19T18:18:41.789990] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-19T18:18:41.790054] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-19T18:18:41.791703] [DEBUG] [LOCAL ] DBRG: Trimmed 72203 records to 50570 (keeping 200 days of data) [2025-09-19T18:18:42.092890] [DEBUG] [LOCAL ] DBRG: Primary data saved (50570 records). [2025-09-19T18:18:42.093039] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-19T18:18:42.093141] [INFO ] [MAIN ] Update Progress: 595/2372 symbols completed. DBRG took 31.7s. Estimated remaining: 3h 54m 50s. Rate: 7.6 symbols/min [2025-09-19T18:18:42.257810] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-19T18:18:42.260316] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:42.335021] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:18:42.335997] [DEBUG] [LOCAL ] DD: Loaded 53183 existing records from primary storage. [2025-09-19T18:18:42.344694] [INFO ] [MAIN ] DD: Loaded 53183 existing records. [2025-09-19T18:18:42.523683] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:42.523944] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-19T18:18:42.524014] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-19T18:18:42.525151] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-19T18:18:42.525210] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-19T18:18:42.891694] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:42.916774] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T18:18:43.043270] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-19T18:18:43.408508] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T18:18:43.843264] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-19T18:18:44.484841] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T18:18:44.643238] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-19T18:18:44.945364] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T18:18:45.443264] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-19T18:18:46.085278] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T18:18:46.243267] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-19T18:18:46.583530] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:18:47.043302] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-19T18:18:47.843266] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-19T18:18:47.994674] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:18:48.643267] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-19T18:18:48.930676] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T18:18:48.937473] [INFO ] [REMOTE ] DBI: Full fetch complete (66612 records). [2025-09-19T18:18:48.937621] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-19T18:18:49.330605] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-19T18:18:49.330731] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-19T18:18:49.331493] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-19T18:18:49.331536] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-19T18:18:49.333122] [DEBUG] [LOCAL ] DBI: Trimmed 66612 records to 45867 (keeping 200 days of data) [2025-09-19T18:18:49.444502] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-19T18:18:49.599467] [DEBUG] [LOCAL ] DBI: Primary data saved (45867 records). [2025-09-19T18:18:49.599606] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-19T18:18:49.599714] [INFO ] [MAIN ] Update Progress: 596/2372 symbols completed. DBI took 42.0s. Estimated remaining: 3h 54m 41s. Rate: 7.6 symbols/min [2025-09-19T18:18:49.770255] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:18:49.824140] [DEBUG] [LOCAL ] DDD: Loaded 51205 existing records from primary storage. [2025-09-19T18:18:49.824288] [INFO ] [MAIN ] DDD: Loaded 51205 existing records. [2025-09-19T18:18:50.010337] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:18:50.010784] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-19T18:18:50.010853] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-19T18:18:50.015146] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-19T18:18:50.040551] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-19T18:18:50.118088] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T18:18:50.236029] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T18:18:50.245821] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-19T18:18:50.424957] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:18:50.469118] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T18:18:50.475383] [INFO ] [REMOTE ] DCI: Full fetch complete (54444 records). [2025-09-19T18:18:50.475500] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-19T18:18:50.882389] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-19T18:18:50.882517] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-19T18:18:50.883289] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-19T18:18:50.883359] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-19T18:18:50.884539] [DEBUG] [LOCAL ] DCI: Trimmed 54444 records to 38302 (keeping 200 days of data) [2025-09-19T18:18:51.056958] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-19T18:18:51.123906] [DEBUG] [LOCAL ] DCI: Primary data saved (38302 records). [2025-09-19T18:18:51.124056] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-19T18:18:51.124144] [INFO ] [MAIN ] Update Progress: 597/2372 symbols completed. DCI took 30.3s. Estimated remaining: 3h 54m 14s. Rate: 7.6 symbols/min [2025-09-19T18:18:51.843265] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-19T18:18:52.328091] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T18:18:52.520815] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:18:52.643237] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-19T18:18:53.344491] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T18:18:53.443231] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-19T18:18:53.544545] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T18:18:54.243269] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-19T18:18:55.053264] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-19T18:18:55.074138] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T18:18:55.843243] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-19T18:18:56.353208] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T18:18:56.640297] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T18:18:56.650977] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-19T18:18:57.443309] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-19T18:18:57.840598] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T18:18:57.922291] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:18:57.925321] [INFO ] [REMOTE ] DCO: Full fetch complete (19677 records). [2025-09-19T18:18:57.925418] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-19T18:18:58.248072] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-19T18:18:58.292505] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-19T18:18:58.292603] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-19T18:18:58.293065] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-19T18:18:58.293118] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-19T18:18:58.293706] [DEBUG] [LOCAL ] DCO: Trimmed 19677 records to 13827 (keeping 200 days of data) [2025-09-19T18:18:58.379032] [DEBUG] [LOCAL ] DCO: Primary data saved (13827 records). [2025-09-19T18:18:58.379157] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-19T18:18:58.379241] [INFO ] [MAIN ] Update Progress: 598/2372 symbols completed. DCO took 30.6s. Estimated remaining: 3h 54m 4s. Rate: 7.6 symbols/min [2025-09-19T18:18:59.490637] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T18:18:59.502268] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-19T18:18:59.849158] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T18:18:59.859972] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-19T18:19:01.659622] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T18:19:01.675862] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-19T18:19:01.727997] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T18:19:01.739717] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-19T18:19:03.853227] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T18:19:03.871434] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-19T18:19:03.994513] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-19T18:19:04.009302] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-19T18:19:05.981993] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:19:05.994136] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-19T18:19:06.137792] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T18:19:06.148260] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-19T18:19:07.659461] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T18:19:07.667318] [INFO ] [REMOTE ] DD: Full fetch complete (76239 records). [2025-09-19T18:19:07.667458] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-19T18:19:08.075168] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-19T18:19:08.075444] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-19T18:19:08.076455] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-19T18:19:08.076575] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-19T18:19:08.078923] [DEBUG] [LOCAL ] DD: Trimmed 76239 records to 53571 (keeping 200 days of data) [2025-09-19T18:19:08.111172] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:19:08.211475] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-19T18:19:08.463380] [DEBUG] [LOCAL ] DD: Primary data saved (53571 records). [2025-09-19T18:19:08.463539] [INFO ] [MAIN ] DD: Full history saved. [2025-09-19T18:19:08.463679] [INFO ] [MAIN ] Update Progress: 599/2372 symbols completed. DD took 26.4s. Estimated remaining: 3h 54m 3s. Rate: 7.6 symbols/min [2025-09-19T18:19:10.267051] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T18:19:10.278169] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-19T18:19:12.382320] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T18:19:12.389997] [INFO ] [REMOTE ] DDD: Full fetch complete (73680 records). [2025-09-19T18:19:12.390131] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-19T18:19:12.780798] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-19T18:19:12.780884] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-19T18:19:12.781789] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-19T18:19:12.781857] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-19T18:19:12.783496] [DEBUG] [LOCAL ] DDD: Trimmed 73680 records to 51576 (keeping 200 days of data) [2025-09-19T18:19:13.081954] [DEBUG] [LOCAL ] DDD: Primary data saved (51576 records). [2025-09-19T18:19:13.082189] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-19T18:19:13.083516] [INFO ] [MAIN ] Update Progress: 600/2372 symbols completed. DDD took 23.5s. Estimated remaining: 3h 53m 45s. Rate: 7.6 symbols/min [2025-09-19T18:19:13.735387] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:13.721232] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:13.799432] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:13.780253] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:13.807952] [DEBUG] [LOCAL ] DDT: Loaded 2096 existing records from primary storage. [2025-09-19T18:19:13.808099] [INFO ] [MAIN ] DDT: Loaded 2096 existing records. [2025-09-19T18:19:13.988706] [DEBUG] [LOCAL ] DDS: Loaded 13611 existing records from primary storage. [2025-09-19T18:19:14.001189] [INFO ] [MAIN ] DDS: Loaded 13611 existing records. [2025-09-19T18:19:14.044253] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:14.056026] [DEBUG] [LOCAL ] DDL: Loaded 36628 existing records from primary storage. [2025-09-19T18:19:14.085079] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-19T18:19:14.079734] [INFO ] [MAIN ] DDL: Loaded 36628 existing records. [2025-09-19T18:19:14.090520] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-19T18:19:14.173578] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-19T18:19:14.196697] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-19T18:19:14.287599] [DEBUG] [LOCAL ] DE: Loaded 48145 existing records from primary storage. [2025-09-19T18:19:14.342686] [INFO ] [MAIN ] DE: Loaded 48145 existing records. [2025-09-19T18:19:14.555151] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:14.631298] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-19T18:19:14.712429] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-19T18:19:14.728906] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-19T18:19:14.725742] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:14.749058] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-19T18:19:14.782923] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-19T18:19:14.826345] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-19T18:19:14.890413] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-19T18:19:14.948327] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-19T18:19:15.078922] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:15.134445] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-19T18:19:15.155500] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-19T18:19:15.254232] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-19T18:19:15.274976] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-19T18:19:15.389740] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:15.441623] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-19T18:19:15.978900] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:15.992487] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-19T18:19:15.991969] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:16.026350] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-19T18:19:16.175347] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:16.175735] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-19T18:19:16.928729] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T18:19:16.930025] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-19T18:19:17.286113] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-19T18:19:17.287321] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-19T18:19:17.333505] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T18:19:17.337129] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-19T18:19:17.845056] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T18:19:17.853933] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-19T18:19:17.880203] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-19T18:19:17.881442] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-19T18:19:18.073421] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T18:19:18.083602] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-19T18:19:18.092097] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T18:19:18.095406] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-19T18:19:18.442315] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T18:19:18.443509] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-19T18:19:18.822859] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T18:19:18.826000] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-19T18:19:18.875608] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T18:19:18.882734] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-19T18:19:19.086839] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T18:19:19.088424] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-19T18:19:19.690938] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T18:19:19.692165] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-19T18:19:19.740510] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T18:19:19.760944] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T18:19:19.843234] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-19T18:19:20.263716] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T18:19:20.504961] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T18:19:20.643266] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-19T18:19:21.427133] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T18:19:21.443232] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-19T18:19:21.746823] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T18:19:22.243294] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-19T18:19:22.699820] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-19T18:19:23.043287] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-19T18:19:23.587450] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T18:19:23.843263] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-19T18:19:24.481774] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:19:24.643262] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-19T18:19:25.443266] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-19T18:19:25.882123] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-19T18:19:26.186353] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T18:19:26.243255] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-19T18:19:26.279484] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T18:19:27.043257] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-19T18:19:27.843274] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-19T18:19:28.363845] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T18:19:28.524238] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T18:19:28.643241] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-19T18:19:29.245120] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T18:19:29.443275] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-19T18:19:29.815755] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T18:19:30.243254] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-19T18:19:30.727914] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T18:19:31.043252] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-19T18:19:31.470548] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:19:31.843277] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-19T18:19:32.089846] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T18:19:32.643345] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-19T18:19:33.174845] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:19:33.183499] [INFO ] [REMOTE ] DDL: Full fetch complete (53379 records). [2025-09-19T18:19:33.183682] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-19T18:19:33.450892] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-19T18:19:33.570196] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-19T18:19:33.570285] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-19T18:19:33.570982] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-19T18:19:33.571051] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-19T18:19:33.572325] [DEBUG] [LOCAL ] DDL: Trimmed 53379 records to 36967 (keeping 200 days of data) [2025-09-19T18:19:33.782725] [DEBUG] [LOCAL ] DDL: Primary data saved (36967 records). [2025-09-19T18:19:33.783000] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-19T18:19:33.783120] [INFO ] [MAIN ] Update Progress: 601/2372 symbols completed. DDL took 20.7s. Estimated remaining: 3h 54m 15s. Rate: 7.6 symbols/min [2025-09-19T18:19:33.966951] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:34.007386] [DEBUG] [LOCAL ] DEA: Loaded 42080 existing records from primary storage. [2025-09-19T18:19:34.007535] [INFO ] [MAIN ] DEA: Loaded 42080 existing records. [2025-09-19T18:19:34.181358] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:19:34.192626] [INFO ] [REMOTE ] DDT: Full fetch complete (2900 records). [2025-09-19T18:19:34.196724] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-19T18:19:34.196613] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:34.230402] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-19T18:19:34.230497] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-19T18:19:34.254223] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-19T18:19:34.263260] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-19T18:19:34.269776] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-19T18:19:34.952270] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-19T18:19:34.985553] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:34.982216] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-19T18:19:34.986149] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-19T18:19:34.986613] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-19T18:19:34.987455] [DEBUG] [LOCAL ] DDT: Trimmed 2900 records to 2112 (keeping 200 days of data) [2025-09-19T18:19:35.002499] [DEBUG] [LOCAL ] DDT: Primary data saved (2112 records). [2025-09-19T18:19:35.002774] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-19T18:19:35.002947] [INFO ] [MAIN ] Update Progress: 602/2372 symbols completed. DDT took 21.9s. Estimated remaining: 3h 53m 47s. Rate: 7.6 symbols/min [2025-09-19T18:19:35.050416] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-19T18:19:35.218584] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:35.219664] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-09-19T18:19:35.221437] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-09-19T18:19:35.221341] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-19T18:19:35.221768] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-19T18:19:35.231710] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-19T18:19:35.232001] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-09-19T18:19:35.232055] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-19T18:19:35.552621] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T18:19:35.631182] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:35.843264] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-19T18:19:36.643310] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-19T18:19:36.971960] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T18:19:37.291346] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T18:19:37.359941] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T18:19:37.443292] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-19T18:19:38.243270] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-19T18:19:39.043250] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-19T18:19:39.617463] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T18:19:39.634738] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:19:39.637141] [INFO ] [REMOTE ] DDS: Full fetch complete (19299 records). [2025-09-19T18:19:39.637227] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-19T18:19:39.855743] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-19T18:19:40.015905] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-19T18:19:40.015984] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-19T18:19:40.016403] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-19T18:19:40.016442] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-19T18:19:40.017055] [DEBUG] [LOCAL ] DDS: Trimmed 19299 records to 13658 (keeping 200 days of data) [2025-09-19T18:19:40.108178] [DEBUG] [LOCAL ] DDS: Primary data saved (13658 records). [2025-09-19T18:19:40.108339] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-19T18:19:40.108505] [INFO ] [MAIN ] Update Progress: 603/2372 symbols completed. DDS took 27.0s. Estimated remaining: 3h 53m 31s. Rate: 7.6 symbols/min [2025-09-19T18:19:40.277829] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:40.336346] [DEBUG] [LOCAL ] DECK: Loaded 53698 existing records from primary storage. [2025-09-19T18:19:40.336554] [INFO ] [MAIN ] DECK: Loaded 53698 existing records. [2025-09-19T18:19:40.530962] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:40.531381] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-19T18:19:40.531494] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-19T18:19:40.542402] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-19T18:19:40.544215] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-19T18:19:40.594069] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T18:19:40.652749] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-19T18:19:40.939940] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:41.443304] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-19T18:19:41.505315] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T18:19:42.243312] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-19T18:19:42.535428] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T18:19:43.043256] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-19T18:19:43.651227] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T18:19:43.799996] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:19:43.807323] [INFO ] [REMOTE ] DE: Full fetch complete (69620 records). [2025-09-19T18:19:43.807460] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-19T18:19:43.855562] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-19T18:19:44.249153] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-19T18:19:44.249266] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-19T18:19:44.250104] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-19T18:19:44.250273] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-19T18:19:44.268580] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T18:19:44.275164] [DEBUG] [LOCAL ] DE: Trimmed 69620 records to 48509 (keeping 200 days of data) [2025-09-19T18:19:44.607527] [DEBUG] [LOCAL ] DE: Primary data saved (48509 records). [2025-09-19T18:19:44.607735] [INFO ] [MAIN ] DE: Full history saved. [2025-09-19T18:19:44.607870] [INFO ] [MAIN ] Update Progress: 604/2372 symbols completed. DE took 31.5s. Estimated remaining: 3h 53m 13s. Rate: 7.6 symbols/min [2025-09-19T18:19:44.651238] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-19T18:19:44.786670] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:19:44.835316] [DEBUG] [LOCAL ] DEI: Loaded 48891 existing records from primary storage. [2025-09-19T18:19:44.835478] [INFO ] [MAIN ] DEI: Loaded 48891 existing records. [2025-09-19T18:19:45.013537] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:19:45.013876] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-19T18:19:45.013931] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-19T18:19:45.015260] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-19T18:19:45.015322] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-19T18:19:45.380554] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:19:45.409223] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T18:19:45.443210] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-19T18:19:46.243279] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-19T18:19:46.707730] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T18:19:47.043324] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-19T18:19:47.360009] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T18:19:47.843269] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-19T18:19:48.143909] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:19:48.427177] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:19:48.643265] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-19T18:19:49.269853] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T18:19:49.443294] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-19T18:19:50.243271] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-19T18:19:50.398115] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T18:19:50.576777] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:19:51.043254] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-19T18:19:51.843281] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-19T18:19:52.066045] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:19:52.213218] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T18:19:52.643269] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-19T18:19:53.443272] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-19T18:19:53.594876] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T18:19:53.686199] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T18:19:54.243279] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-19T18:19:54.892046] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T18:19:55.043254] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-19T18:19:55.762425] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T18:19:55.843265] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-19T18:19:56.472835] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T18:19:56.643396] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-19T18:19:57.443401] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-19T18:19:57.748947] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:19:58.243352] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-19T18:19:58.633852] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:19:58.775556] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T18:19:59.043291] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-19T18:19:59.460182] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T18:19:59.843314] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-19T18:20:00.643389] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-19T18:20:01.305358] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T18:20:01.312141] [INFO ] [REMOTE ] DEC: Full fetch complete (42907 records). [2025-09-19T18:20:01.312357] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-19T18:20:01.448523] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-19T18:20:01.750865] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-19T18:20:01.751018] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-19T18:20:01.751883] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-19T18:20:01.752013] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-19T18:20:01.754066] [DEBUG] [LOCAL ] DEC: Trimmed 42907 records to 31645 (keeping 200 days of data) [2025-09-19T18:20:01.993549] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-09-19T18:20:02.029854] [DEBUG] [LOCAL ] DEC: Primary data saved (31645 records). [2025-09-19T18:20:02.030037] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-19T18:20:02.030159] [INFO ] [MAIN ] Update Progress: 605/2372 symbols completed. DEC took 27.0s. Estimated remaining: 3h 53m 33s. Rate: 7.6 symbols/min [2025-09-19T18:20:02.214466] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:02.247592] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-19T18:20:02.272632] [DEBUG] [LOCAL ] DELL: Loaded 54126 existing records from primary storage. [2025-09-19T18:20:02.272829] [INFO ] [MAIN ] DELL: Loaded 54126 existing records. [2025-09-19T18:20:02.461591] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:02.462428] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-19T18:20:02.462538] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-19T18:20:02.464379] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-19T18:20:02.464478] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-19T18:20:02.646071] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:20:02.990048] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:03.026975] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T18:20:03.043302] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-19T18:20:03.843332] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-19T18:20:04.643391] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-19T18:20:04.848236] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-19T18:20:05.102741] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T18:20:05.109672] [INFO ] [REMOTE ] DEA: Full fetch complete (63191 records). [2025-09-19T18:20:05.109790] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-19T18:20:05.448420] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-19T18:20:05.521256] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-19T18:20:05.521340] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-19T18:20:05.522247] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-19T18:20:05.522315] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-19T18:20:05.526683] [DEBUG] [LOCAL ] DEA: Trimmed 63191 records to 42365 (keeping 200 days of data) [2025-09-19T18:20:05.791012] [DEBUG] [LOCAL ] DEA: Primary data saved (42365 records). [2025-09-19T18:20:05.791144] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-19T18:20:05.791279] [INFO ] [MAIN ] Update Progress: 606/2372 symbols completed. DEA took 32.0s. Estimated remaining: 3h 53m 13s. Rate: 7.6 symbols/min [2025-09-19T18:20:05.971457] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:06.023004] [DEBUG] [LOCAL ] DEO: Loaded 49348 existing records from primary storage. [2025-09-19T18:20:06.023166] [INFO ] [MAIN ] DEO: Loaded 49348 existing records. [2025-09-19T18:20:06.204816] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:06.205145] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-19T18:20:06.205202] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-19T18:20:06.206545] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-19T18:20:06.206607] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-19T18:20:06.523464] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T18:20:06.550092] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-19T18:20:06.619558] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:06.824663] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.98 seconds). [2025-09-19T18:20:07.043247] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-19T18:20:07.843270] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-19T18:20:08.362954] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.91 seconds). [2025-09-19T18:20:08.643245] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-19T18:20:09.062325] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-19T18:20:09.234124] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:20:09.443295] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-19T18:20:10.251691] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-19T18:20:10.259670] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T18:20:11.043363] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-19T18:20:11.082128] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-19T18:20:11.536844] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T18:20:11.843258] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-19T18:20:12.099188] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T18:20:12.558842] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T18:20:12.643228] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-19T18:20:13.443281] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-19T18:20:14.243272] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-19T18:20:14.378593] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-19T18:20:14.620806] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T18:20:14.666581] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T18:20:15.043255] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-19T18:20:15.843310] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-19T18:20:16.131205] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T18:20:16.643274] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-19T18:20:17.282133] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T18:20:17.443284] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-19T18:20:18.243318] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-19T18:20:18.907675] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-09-19T18:20:18.915192] [INFO ] [REMOTE ] DEI: Full fetch complete (69509 records). [2025-09-19T18:20:18.915368] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-19T18:20:19.359736] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-19T18:20:19.360224] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-19T18:20:19.361155] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-19T18:20:19.361247] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-19T18:20:19.363637] [DEBUG] [LOCAL ] DEI: Trimmed 69509 records to 49247 (keeping 200 days of data) [2025-09-19T18:20:19.677994] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (3.03 seconds). [2025-09-19T18:20:19.680407] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T18:20:19.706995] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-19T18:20:19.777307] [DEBUG] [LOCAL ] DEI: Primary data saved (49247 records). [2025-09-19T18:20:19.777523] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-19T18:20:19.779110] [INFO ] [MAIN ] Update Progress: 607/2372 symbols completed. DEI took 35.2s. Estimated remaining: 3h 53m 22s. Rate: 7.6 symbols/min [2025-09-19T18:20:19.849269] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-19T18:20:19.959972] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:19.982565] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T18:20:19.990617] [INFO ] [REMOTE ] DECK: Full fetch complete (76577 records). [2025-09-19T18:20:19.990821] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-19T18:20:20.200846] [DEBUG] [LOCAL ] DFH: Loaded 33349 existing records from primary storage. [2025-09-19T18:20:20.251268] [INFO ] [MAIN ] DFH: Loaded 33349 existing records. [2025-09-19T18:20:20.599964] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-19T18:20:20.604366] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-19T18:20:20.605270] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-19T18:20:20.605477] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-19T18:20:20.605417] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:20.605795] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-19T18:20:20.605844] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-19T18:20:20.606812] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-19T18:20:20.606876] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-19T18:20:20.638344] [DEBUG] [LOCAL ] DECK: Trimmed 76577 records to 54084 (keeping 200 days of data) [2025-09-19T18:20:21.097000] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:21.097811] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-19T18:20:21.302479] [DEBUG] [LOCAL ] DECK: Primary data saved (54084 records). [2025-09-19T18:20:21.302638] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-19T18:20:21.302794] [INFO ] [MAIN ] Update Progress: 608/2372 symbols completed. DECK took 41.2s. Estimated remaining: 3h 52m 56s. Rate: 7.6 symbols/min [2025-09-19T18:20:21.480359] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:21.506258] [DEBUG] [LOCAL ] DFIN: Loaded 23738 existing records from primary storage. [2025-09-19T18:20:21.506438] [INFO ] [MAIN ] DFIN: Loaded 23738 existing records. [2025-09-19T18:20:21.718660] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T18:20:21.723107] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:21.732980] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-19T18:20:21.733216] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-19T18:20:21.733780] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-19T18:20:21.734825] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-19T18:20:21.734897] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-19T18:20:22.124156] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:22.206513] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T18:20:22.243229] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-19T18:20:23.043285] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-19T18:20:23.251610] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T18:20:23.785272] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:20:23.843265] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-19T18:20:23.984039] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:20:24.643282] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-19T18:20:24.817333] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-19T18:20:25.443300] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-19T18:20:25.645774] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T18:20:25.746226] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T18:20:26.243272] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-19T18:20:27.043250] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-19T18:20:27.848331] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-19T18:20:27.860685] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T18:20:28.069437] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-19T18:20:28.094053] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T18:20:28.643261] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-19T18:20:29.443253] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-19T18:20:29.718687] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T18:20:30.243261] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-19T18:20:30.318977] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T18:20:31.043286] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-19T18:20:31.796987] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:20:31.804447] [INFO ] [REMOTE ] DEO: Full fetch complete (71116 records). [2025-09-19T18:20:31.804610] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-19T18:20:31.805472] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:20:31.805609] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:20:31.805735] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:20:31.805829] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-19T18:20:31.805912] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-09-19T18:20:31.805950] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-09-19T18:20:31.806415] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-09-19T18:20:31.806518] [INFO ] [MAIN ] Update Progress: 609/2372 symbols completed. DEO took 26.0s. Estimated remaining: 3h 52m 55s. Rate: 7.6 symbols/min [2025-09-19T18:20:31.850726] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-19T18:20:31.996279] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:32.036042] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-19T18:20:32.053621] [DEBUG] [LOCAL ] DFP: Loaded 11867 existing records from primary storage. [2025-09-19T18:20:32.053775] [INFO ] [MAIN ] DFP: Loaded 11867 existing records. [2025-09-19T18:20:32.230937] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:32.231192] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-19T18:20:32.231249] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-19T18:20:32.231669] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-19T18:20:32.231743] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-19T18:20:32.584745] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:32.643221] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-19T18:20:32.717967] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T18:20:32.899526] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T18:20:33.443296] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-19T18:20:33.706886] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T18:20:34.243316] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-19T18:20:35.043276] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-19T18:20:35.330181] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T18:20:35.843275] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-19T18:20:36.504482] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T18:20:36.515154] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-09-19T18:20:36.515318] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-19T18:20:36.648375] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-19T18:20:36.945755] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-19T18:20:36.945864] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-19T18:20:36.946759] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-19T18:20:36.946841] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-19T18:20:36.948814] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T18:20:36.959492] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54515 (keeping 200 days of data) [2025-09-19T18:20:37.316992] [DEBUG] [LOCAL ] DELL: Primary data saved (54515 records). [2025-09-19T18:20:37.317167] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-19T18:20:37.317268] [INFO ] [MAIN ] Update Progress: 610/2372 symbols completed. DELL took 35.3s. Estimated remaining: 3h 52m 40s. Rate: 7.6 symbols/min [2025-09-19T18:20:37.448333] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-19T18:20:37.506505] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:37.518426] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T18:20:37.578559] [DEBUG] [LOCAL ] DG: Loaded 53697 existing records from primary storage. [2025-09-19T18:20:37.578729] [INFO ] [MAIN ] DG: Loaded 53697 existing records. [2025-09-19T18:20:37.743584] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T18:20:37.776254] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:37.776459] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-19T18:20:37.776506] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-19T18:20:37.777824] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-19T18:20:37.777885] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-19T18:20:38.132516] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:38.243240] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-19T18:20:39.043317] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-19T18:20:39.202730] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T18:20:39.843290] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-19T18:20:40.030408] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T18:20:40.380430] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T18:20:40.643225] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-19T18:20:41.168346] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T18:20:41.443250] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-19T18:20:41.483442] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T18:20:42.243269] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-19T18:20:43.043281] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-19T18:20:43.609139] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T18:20:43.848347] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-19T18:20:43.860264] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T18:20:44.382570] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T18:20:44.643251] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-19T18:20:45.012577] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T18:20:45.443375] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-19T18:20:45.610919] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:20:46.243318] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-19T18:20:46.600023] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T18:20:47.043283] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-19T18:20:47.327735] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T18:20:47.843269] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-19T18:20:47.972979] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T18:20:47.977927] [INFO ] [REMOTE ] DFH: Full fetch complete (49224 records). [2025-09-19T18:20:47.978091] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-19T18:20:48.360317] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-19T18:20:48.360429] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-19T18:20:48.361166] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-19T18:20:48.361233] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-19T18:20:48.362381] [DEBUG] [LOCAL ] DFH: Trimmed 49224 records to 33560 (keeping 200 days of data) [2025-09-19T18:20:48.572892] [DEBUG] [LOCAL ] DFH: Primary data saved (33560 records). [2025-09-19T18:20:48.573075] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-19T18:20:48.573177] [INFO ] [MAIN ] Update Progress: 611/2372 symbols completed. DFH took 28.8s. Estimated remaining: 3h 52m 42s. Rate: 7.6 symbols/min [2025-09-19T18:20:48.648438] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-19T18:20:48.768609] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:48.824083] [DEBUG] [LOCAL ] DGX: Loaded 45793 existing records from primary storage. [2025-09-19T18:20:48.824259] [INFO ] [MAIN ] DGX: Loaded 45793 existing records. [2025-09-19T18:20:48.999949] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:20:49.000217] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-19T18:20:49.000280] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-19T18:20:49.001763] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-19T18:20:49.001850] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-19T18:20:49.378330] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:49.443229] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-19T18:20:49.843296] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T18:20:50.243323] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-19T18:20:50.342721] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:20:50.608198] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T18:20:51.043346] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-19T18:20:51.843260] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-19T18:20:52.113406] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T18:20:52.383632] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T18:20:52.387349] [INFO ] [REMOTE ] DFIN: Full fetch complete (33281 records). [2025-09-19T18:20:52.387449] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-19T18:20:52.655245] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-19T18:20:52.804014] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-19T18:20:52.804101] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-19T18:20:52.804717] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-19T18:20:52.804780] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-19T18:20:52.805789] [DEBUG] [LOCAL ] DFIN: Trimmed 33281 records to 23906 (keeping 200 days of data) [2025-09-19T18:20:52.944488] [DEBUG] [LOCAL ] DFIN: Primary data saved (23906 records). [2025-09-19T18:20:52.944627] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-19T18:20:52.944749] [INFO ] [MAIN ] Update Progress: 612/2372 symbols completed. DFIN took 31.6s. Estimated remaining: 3h 52m 24s. Rate: 7.6 symbols/min [2025-09-19T18:20:53.123153] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:20:53.123393] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-09-19T18:20:53.123449] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-09-19T18:20:53.123605] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-19T18:20:53.123675] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-19T18:20:53.123741] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-19T18:20:53.123776] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-19T18:20:53.453730] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-19T18:20:53.497902] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:20:53.527424] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T18:20:53.627439] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:20:54.243312] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-19T18:20:55.043237] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-19T18:20:55.415152] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T18:20:55.843229] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-19T18:20:55.968425] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-19T18:20:56.643299] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-19T18:20:56.930393] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T18:20:56.947684] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T18:20:57.443297] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-19T18:20:58.243287] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-19T18:20:58.532789] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T18:20:58.828244] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:20:59.043262] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-19T18:20:59.635000] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:20:59.843253] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-19T18:21:00.308819] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T18:21:00.643274] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-19T18:21:01.443298] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-19T18:21:02.243285] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-19T18:21:02.626939] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-19T18:21:03.043258] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-19T18:21:04.145587] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (3.50 seconds). [2025-09-19T18:21:04.157247] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-19T18:21:04.413220] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-19T18:21:04.415849] [INFO ] [REMOTE ] DFP: Full fetch complete (16220 records). [2025-09-19T18:21:04.415958] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-19T18:21:04.803697] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-19T18:21:04.803823] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-19T18:21:04.804189] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-19T18:21:04.804231] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-19T18:21:04.804789] [DEBUG] [LOCAL ] DFP: Trimmed 16220 records to 11926 (keeping 200 days of data) [2025-09-19T18:21:04.874843] [DEBUG] [LOCAL ] DFP: Primary data saved (11926 records). [2025-09-19T18:21:04.874985] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-19T18:21:04.875072] [INFO ] [MAIN ] Update Progress: 613/2372 symbols completed. DFP took 33.1s. Estimated remaining: 3h 52m 28s. Rate: 7.6 symbols/min [2025-09-19T18:21:05.050223] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:05.110914] [DEBUG] [LOCAL ] DHI: Loaded 53765 existing records from primary storage. [2025-09-19T18:21:05.111067] [INFO ] [MAIN ] DHI: Loaded 53765 existing records. [2025-09-19T18:21:05.299158] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:05.299455] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-19T18:21:05.299509] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-19T18:21:05.300838] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-19T18:21:05.300898] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-19T18:21:05.668879] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:05.669233] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-19T18:21:05.846469] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (3.60 seconds). [2025-09-19T18:21:05.853699] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-19T18:21:06.006008] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-09-19T18:21:06.243299] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-19T18:21:06.843888] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-19T18:21:06.883687] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T18:21:07.043275] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-19T18:21:07.522280] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T18:21:07.582287] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T18:21:07.843265] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-19T18:21:08.643294] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-19T18:21:09.443260] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-19T18:21:09.577183] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-19T18:21:09.618700] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T18:21:10.107169] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T18:21:10.243307] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-19T18:21:11.043282] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-19T18:21:11.317542] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T18:21:11.843278] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-19T18:21:11.926883] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T18:21:12.643288] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-19T18:21:12.967717] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T18:21:12.975449] [INFO ] [REMOTE ] DG: Full fetch complete (77238 records). [2025-09-19T18:21:12.975579] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-19T18:21:13.362317] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-19T18:21:13.362403] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-19T18:21:13.363275] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-19T18:21:13.363360] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-19T18:21:13.364888] [DEBUG] [LOCAL ] DG: Trimmed 77238 records to 54085 (keeping 200 days of data) [2025-09-19T18:21:13.455347] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-19T18:21:13.704573] [DEBUG] [LOCAL ] DG: Primary data saved (54085 records). [2025-09-19T18:21:13.704805] [INFO ] [MAIN ] DG: Full history saved. [2025-09-19T18:21:13.704916] [INFO ] [MAIN ] Update Progress: 614/2372 symbols completed. DG took 36.4s. Estimated remaining: 3h 52m 22s. Rate: 7.6 symbols/min [2025-09-19T18:21:13.876617] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:13.888977] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T18:21:13.959699] [DEBUG] [LOCAL ] DHR: Loaded 53757 existing records from primary storage. [2025-09-19T18:21:13.960093] [INFO ] [MAIN ] DHR: Loaded 53757 existing records. [2025-09-19T18:21:14.162853] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:14.163358] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-19T18:21:14.163421] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-19T18:21:14.172098] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-19T18:21:14.187277] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-19T18:21:14.221258] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T18:21:14.254298] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-19T18:21:14.591548] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:15.043252] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-19T18:21:15.843273] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-19T18:21:16.711535] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (3.26 seconds). [2025-09-19T18:21:16.724245] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-19T18:21:16.832304] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T18:21:16.839149] [INFO ] [REMOTE ] DGX: Full fetch complete (65125 records). [2025-09-19T18:21:16.839330] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-19T18:21:17.056563] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-19T18:21:17.270199] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-19T18:21:17.270280] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-19T18:21:17.271048] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-19T18:21:17.271111] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-19T18:21:17.272500] [DEBUG] [LOCAL ] DGX: Trimmed 65125 records to 46056 (keeping 200 days of data) [2025-09-19T18:21:17.461196] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-19T18:21:17.574152] [DEBUG] [LOCAL ] DGX: Primary data saved (46056 records). [2025-09-19T18:21:17.574328] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-19T18:21:17.575196] [INFO ] [MAIN ] Update Progress: 615/2372 symbols completed. DGX took 29.0s. Estimated remaining: 3h 52m 3s. Rate: 7.6 symbols/min [2025-09-19T18:21:17.747310] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:17.798337] [DEBUG] [LOCAL ] DHT: Loaded 48423 existing records from primary storage. [2025-09-19T18:21:17.798486] [INFO ] [MAIN ] DHT: Loaded 48423 existing records. [2025-09-19T18:21:17.975341] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:17.975708] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-19T18:21:17.975765] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-19T18:21:17.977260] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-19T18:21:17.977322] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-19T18:21:18.352817] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:18.353284] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-19T18:21:18.390042] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-19T18:21:18.860201] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:21:19.043248] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-19T18:21:19.395559] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T18:21:19.823554] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T18:21:19.843224] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-19T18:21:20.643261] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-19T18:21:20.987101] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:21:21.412461] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T18:21:21.443234] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-19T18:21:22.104135] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:21:22.243253] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-19T18:21:23.043254] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-19T18:21:23.541395] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T18:21:23.843263] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-19T18:21:24.432236] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T18:21:24.643265] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-19T18:21:24.765671] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T18:21:24.768618] [INFO ] [REMOTE ] DHF: Full fetch complete (29472 records). [2025-09-19T18:21:24.768724] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-19T18:21:24.769274] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:21:24.769356] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:21:24.769398] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:21:24.769436] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-19T18:21:24.769517] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-19T18:21:24.769574] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-09-19T18:21:24.769632] [DEBUG] [LOCAL ] DHF: No derivative data file found to delete. [2025-09-19T18:21:24.769740] [INFO ] [MAIN ] Update Progress: 616/2372 symbols completed. DHF took 31.8s. Estimated remaining: 3h 51m 53s. Rate: 7.6 symbols/min [2025-09-19T18:21:24.952857] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:24.967291] [DEBUG] [LOCAL ] DHX: Loaded 13327 existing records from primary storage. [2025-09-19T18:21:24.967413] [INFO ] [MAIN ] DHX: Loaded 13327 existing records. [2025-09-19T18:21:25.141325] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:25.141596] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-19T18:21:25.141676] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-19T18:21:25.142123] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-19T18:21:25.142182] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-19T18:21:25.456877] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-19T18:21:25.500377] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:25.941474] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T18:21:26.249189] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-19T18:21:26.255880] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T18:21:27.043230] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-19T18:21:27.404320] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T18:21:27.451321] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T18:21:27.843291] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-19T18:21:28.643296] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-19T18:21:29.167003] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T18:21:29.443288] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-19T18:21:29.621185] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:21:30.243287] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-19T18:21:30.731506] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T18:21:31.043243] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-19T18:21:31.496090] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T18:21:31.843265] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-19T18:21:31.951669] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T18:21:32.643242] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-19T18:21:33.423091] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T18:21:33.444258] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-19T18:21:33.446519] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T18:21:34.126418] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-19T18:21:34.243298] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-19T18:21:35.046592] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-19T18:21:35.052424] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T18:21:35.843277] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-19T18:21:35.884749] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T18:21:36.643288] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-19T18:21:37.419829] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:21:37.443266] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-19T18:21:37.811127] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:21:38.213821] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-19T18:21:38.243282] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-19T18:21:39.043250] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-19T18:21:39.315045] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T18:21:39.843271] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-19T18:21:40.439987] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T18:21:40.460429] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T18:21:40.643270] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-19T18:21:41.443268] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-19T18:21:41.845355] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:21:41.852933] [INFO ] [REMOTE ] DHI: Full fetch complete (76819 records). [2025-09-19T18:21:41.853101] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-19T18:21:41.854069] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:21:41.854165] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:21:41.854214] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:21:41.854263] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-19T18:21:41.854355] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-19T18:21:41.854413] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-09-19T18:21:41.854780] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-09-19T18:21:41.854922] [INFO ] [MAIN ] Update Progress: 617/2372 symbols completed. DHI took 37.0s. Estimated remaining: 3h 52m 11s. Rate: 7.6 symbols/min [2025-09-19T18:21:42.036937] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:42.052616] [DEBUG] [LOCAL ] DIAX: Loaded 12421 existing records from primary storage. [2025-09-19T18:21:42.052782] [INFO ] [MAIN ] DIAX: Loaded 12421 existing records. [2025-09-19T18:21:42.230391] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:42.230922] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-19T18:21:42.230978] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-19T18:21:42.231437] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-19T18:21:42.231496] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-19T18:21:42.263489] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-19T18:21:42.604463] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:42.936802] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-19T18:21:42.947029] [INFO ] [REMOTE ] DHR: Full fetch complete (77274 records). [2025-09-19T18:21:42.947207] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-19T18:21:43.054212] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-19T18:21:43.366974] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-19T18:21:43.367078] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-19T18:21:43.368110] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-19T18:21:43.368278] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-19T18:21:43.389455] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T18:21:43.395918] [DEBUG] [LOCAL ] DHR: Trimmed 77274 records to 54147 (keeping 200 days of data) [2025-09-19T18:21:43.397466] [INFO ] [REMOTE ] DHT: Full fetch complete (69817 records). [2025-09-19T18:21:43.397639] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-19T18:21:43.398492] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:21:43.462074] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:21:43.462174] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:21:43.462612] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-19T18:21:43.489349] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-19T18:21:43.492686] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-19T18:21:43.497605] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-09-19T18:21:43.499173] [INFO ] [MAIN ] Update Progress: 618/2372 symbols completed. DHT took 25.9s. Estimated remaining: 3h 51m 45s. Rate: 7.6 symbols/min [2025-09-19T18:21:43.653986] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:21:43.715387] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:43.716904] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-09-19T18:21:43.716976] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-09-19T18:21:43.718743] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-19T18:21:43.719038] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-19T18:21:43.719890] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-09-19T18:21:43.720693] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-19T18:21:43.848187] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-19T18:21:44.157946] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T18:21:44.284474] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:44.470513] [DEBUG] [LOCAL ] DHR: Primary data saved (54147 records). [2025-09-19T18:21:44.470778] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-19T18:21:44.470917] [INFO ] [MAIN ] Update Progress: 619/2372 symbols completed. DHR took 30.8s. Estimated remaining: 3h 51m 17s. Rate: 7.6 symbols/min [2025-09-19T18:21:44.648504] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-19T18:21:44.765446] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:44.846885] [DEBUG] [LOCAL ] DINO: Loaded 53364 existing records from primary storage. [2025-09-19T18:21:44.847116] [INFO ] [MAIN ] DINO: Loaded 53364 existing records. [2025-09-19T18:21:45.137913] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:45.138463] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-19T18:21:45.138561] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-19T18:21:45.145980] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-19T18:21:45.155167] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T18:21:45.154432] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-19T18:21:45.448450] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-19T18:21:45.623067] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:46.243322] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-19T18:21:46.637102] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T18:21:46.792184] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T18:21:47.043263] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-19T18:21:47.715898] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T18:21:47.843257] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-19T18:21:48.422695] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T18:21:48.643268] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-19T18:21:48.883508] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T18:21:49.443310] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-19T18:21:50.243329] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-19T18:21:50.687343] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T18:21:50.712963] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T18:21:51.043253] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-19T18:21:51.462103] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:21:51.843298] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-19T18:21:52.568931] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T18:21:52.643300] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-19T18:21:53.086122] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T18:21:53.443282] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-19T18:21:53.658788] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T18:21:54.243319] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-19T18:21:54.453203] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T18:21:55.043258] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-19T18:21:55.843267] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-19T18:21:56.138670] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:21:56.538150] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T18:21:56.643258] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-19T18:21:56.721427] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T18:21:57.443326] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-19T18:21:58.243289] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-19T18:21:58.471376] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T18:21:58.912154] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T18:21:58.975553] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:21:58.979111] [INFO ] [REMOTE ] DHX: Full fetch complete (20833 records). [2025-09-19T18:21:58.979247] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-19T18:21:58.980019] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:21:58.980135] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:21:58.980358] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:21:58.980449] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-19T18:21:58.980539] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-19T18:21:58.980587] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-09-19T18:21:58.981021] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-09-19T18:21:58.981146] [INFO ] [MAIN ] Update Progress: 620/2372 symbols completed. DHX took 34.2s. Estimated remaining: 3h 51m 28s. Rate: 7.6 symbols/min [2025-09-19T18:21:59.048511] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-19T18:21:59.186116] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:21:59.247724] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-09-19T18:21:59.247874] [INFO ] [MAIN ] DIS: Loaded 54178 existing records. [2025-09-19T18:21:59.438119] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:21:59.438371] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-19T18:21:59.438427] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-19T18:21:59.440111] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-19T18:21:59.440180] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-19T18:21:59.804215] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:21:59.843228] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-19T18:22:00.643244] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-19T18:22:01.323443] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T18:22:01.396802] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T18:22:01.443229] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-19T18:22:02.243315] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-19T18:22:02.321285] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-19T18:22:02.835982] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T18:22:03.043255] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-19T18:22:03.843285] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-19T18:22:04.037750] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:22:04.135812] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:22:04.643314] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-19T18:22:05.443273] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-19T18:22:05.660475] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T18:22:05.731771] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:22:05.734128] [INFO ] [REMOTE ] DIAX: Full fetch complete (16987 records). [2025-09-19T18:22:05.734218] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-19T18:22:05.734667] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:22:05.734777] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:22:05.734851] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:22:05.734948] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-19T18:22:05.735033] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-19T18:22:05.735071] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-19T18:22:05.735467] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-09-19T18:22:05.735576] [INFO ] [MAIN ] Update Progress: 621/2372 symbols completed. DIAX took 23.9s. Estimated remaining: 3h 51m 17s. Rate: 7.6 symbols/min [2025-09-19T18:22:05.909746] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:05.909932] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-19T18:22:05.910028] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-19T18:22:05.910219] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-19T18:22:05.910273] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-19T18:22:05.910358] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-19T18:22:05.910399] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-19T18:22:06.248699] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-19T18:22:06.270934] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:07.043284] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-19T18:22:07.843315] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-19T18:22:07.965771] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T18:22:08.315270] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-19T18:22:08.503792] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-09-19T18:22:08.643263] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-19T18:22:09.069729] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:22:09.174393] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-19T18:22:09.443268] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-19T18:22:10.243266] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-19T18:22:11.002030] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T18:22:11.043241] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-19T18:22:11.048436] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T18:22:11.843268] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-19T18:22:12.643277] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-19T18:22:13.232186] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T18:22:13.387327] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-19T18:22:13.443270] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-19T18:22:14.040028] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T18:22:14.243247] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-19T18:22:14.771500] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T18:22:14.866800] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-19T18:22:15.043268] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-19T18:22:15.843266] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-19T18:22:16.643239] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-19T18:22:17.156632] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-19T18:22:17.181220] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T18:22:17.191101] [INFO ] [REMOTE ] DINO: Full fetch complete (76641 records). [2025-09-19T18:22:17.191327] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-19T18:22:17.409053] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:22:17.443247] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-19T18:22:17.662243] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-19T18:22:17.662350] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-19T18:22:17.663714] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-19T18:22:17.663801] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-19T18:22:17.665679] [DEBUG] [LOCAL ] DINO: Trimmed 76641 records to 53743 (keeping 200 days of data) [2025-09-19T18:22:17.902580] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-19T18:22:18.014937] [DEBUG] [LOCAL ] DINO: Primary data saved (53743 records). [2025-09-19T18:22:18.015112] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-19T18:22:18.015275] [INFO ] [MAIN ] Update Progress: 622/2372 symbols completed. DINO took 33.5s. Estimated remaining: 3h 51m 21s. Rate: 7.6 symbols/min [2025-09-19T18:22:18.195150] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:18.248507] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-19T18:22:18.253258] [DEBUG] [LOCAL ] DK: Loaded 49841 existing records from primary storage. [2025-09-19T18:22:18.253617] [INFO ] [MAIN ] DK: Loaded 49841 existing records. [2025-09-19T18:22:18.452625] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:18.453010] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-19T18:22:18.453074] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-19T18:22:18.454177] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-19T18:22:18.454256] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-19T18:22:18.814798] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:19.043265] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-19T18:22:19.843273] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-19T18:22:20.027691] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T18:22:20.036384] [INFO ] [REMOTE ] DIN: Full fetch complete (55071 records). [2025-09-19T18:22:20.036606] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-19T18:22:20.449980] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-19T18:22:20.450076] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-19T18:22:20.450830] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-19T18:22:20.450929] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-19T18:22:20.452886] [DEBUG] [LOCAL ] DIN: Trimmed 55071 records to 38019 (keeping 200 days of data) [2025-09-19T18:22:20.662726] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-19T18:22:20.696248] [DEBUG] [LOCAL ] DIN: Primary data saved (38019 records). [2025-09-19T18:22:20.696405] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-19T18:22:20.696548] [INFO ] [MAIN ] Update Progress: 623/2372 symbols completed. DIN took 37.2s. Estimated remaining: 3h 50m 58s. Rate: 7.6 symbols/min [2025-09-19T18:22:20.871351] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:20.892420] [DEBUG] [LOCAL ] DKL: Loaded 19651 existing records from primary storage. [2025-09-19T18:22:20.892570] [INFO ] [MAIN ] DKL: Loaded 19651 existing records. [2025-09-19T18:22:21.076323] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:21.080591] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-19T18:22:21.082284] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-19T18:22:21.082368] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-19T18:22:21.083811] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-19T18:22:21.083889] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-19T18:22:21.378771] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T18:22:21.454189] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-19T18:22:21.496881] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:22.243279] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-19T18:22:22.462722] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-19T18:22:23.043276] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-19T18:22:23.251160] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T18:22:23.342117] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T18:22:23.843288] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-19T18:22:24.643297] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-19T18:22:25.091795] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-19T18:22:25.439873] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T18:22:25.450725] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-19T18:22:25.867441] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T18:22:26.186211] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T18:22:26.243263] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-19T18:22:27.043275] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-19T18:22:27.843272] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-19T18:22:28.143472] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:22:28.346005] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-19T18:22:28.347203] [INFO ] [REMOTE ] DIVY: Full fetch complete (1718 records). [2025-09-19T18:22:28.347278] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-19T18:22:28.523616] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T18:22:28.523851] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:22:28.523940] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:22:28.524034] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-19T18:22:28.524115] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-19T18:22:28.524164] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-19T18:22:28.524231] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-19T18:22:28.524315] [INFO ] [MAIN ] Update Progress: 624/2372 symbols completed. DIVY took 22.8s. Estimated remaining: 3h 50m 50s. Rate: 7.6 symbols/min [2025-09-19T18:22:28.648336] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-19T18:22:28.695513] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:28.774527] [DEBUG] [LOCAL ] DKS: Loaded 50351 existing records from primary storage. [2025-09-19T18:22:28.774698] [INFO ] [MAIN ] DKS: Loaded 50351 existing records. [2025-09-19T18:22:28.949962] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:28.950230] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-19T18:22:28.950286] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-19T18:22:28.951524] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-19T18:22:28.951598] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-19T18:22:29.327251] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:29.443282] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-19T18:22:29.841190] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-19T18:22:30.189299] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T18:22:30.243240] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-19T18:22:31.043281] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-19T18:22:31.096538] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:22:31.125056] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T18:22:31.843278] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-19T18:22:32.643268] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-19T18:22:32.945939] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T18:22:33.443311] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-19T18:22:33.495722] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-19T18:22:34.243298] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-19T18:22:34.433394] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T18:22:34.457813] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T18:22:35.043268] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-19T18:22:35.843332] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-19T18:22:36.643311] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-19T18:22:36.927621] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-19T18:22:37.122613] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:22:37.443325] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-19T18:22:37.796978] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:22:37.869949] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T18:22:38.243301] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-19T18:22:39.043306] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-19T18:22:39.444809] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:22:39.843256] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-19T18:22:40.035547] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-19T18:22:40.643279] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-19T18:22:40.864193] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T18:22:41.443303] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-19T18:22:41.714777] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:22:41.774672] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T18:22:42.243309] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-19T18:22:43.043290] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-19T18:22:43.500722] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T18:22:43.843280] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-19T18:22:44.257134] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T18:22:44.643298] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-19T18:22:45.067101] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T18:22:45.071714] [INFO ] [REMOTE ] DKL: Full fetch complete (29596 records). [2025-09-19T18:22:45.071860] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-19T18:22:45.448453] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-19T18:22:45.539374] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-19T18:22:45.539525] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-19T18:22:45.540358] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-19T18:22:45.540433] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-19T18:22:45.541887] [DEBUG] [LOCAL ] DKL: Trimmed 29596 records to 19705 (keeping 200 days of data) [2025-09-19T18:22:45.673336] [DEBUG] [LOCAL ] DKL: Primary data saved (19705 records). [2025-09-19T18:22:45.673804] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-19T18:22:45.673932] [INFO ] [MAIN ] Update Progress: 625/2372 symbols completed. DKL took 25.0s. Estimated remaining: 3h 51m 8s. Rate: 7.6 symbols/min [2025-09-19T18:22:45.869578] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-19T18:22:45.872714] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:45.882052] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-19T18:22:45.882252] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-19T18:22:46.152209] [DEBUG] [LOCAL ] DLB: Loaded 32524 existing records from primary storage. [2025-09-19T18:22:46.191853] [INFO ] [MAIN ] DLB: Loaded 32524 existing records. [2025-09-19T18:22:46.575695] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-19T18:22:46.575969] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-19T18:22:46.575584] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:46.577041] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-19T18:22:46.577286] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-19T18:22:46.579044] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-19T18:22:46.579202] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-19T18:22:46.579451] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 54568 (keeping 200 days of data) [2025-09-19T18:22:46.580838] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-19T18:22:46.580914] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-19T18:22:46.900216] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T18:22:46.957531] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-19T18:22:47.135853] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:47.136820] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-19T18:22:47.381538] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-09-19T18:22:47.381726] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-19T18:22:47.381846] [INFO ] [MAIN ] Update Progress: 626/2372 symbols completed. DIS took 48.4s. Estimated remaining: 3h 50m 43s. Rate: 7.6 symbols/min [2025-09-19T18:22:47.553114] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:47.561822] [DEBUG] [LOCAL ] DLNG: Loaded 6345 existing records from primary storage. [2025-09-19T18:22:47.561956] [INFO ] [MAIN ] DLNG: Loaded 6345 existing records. [2025-09-19T18:22:47.742793] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:22:47.743153] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-19T18:22:47.743217] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-19T18:22:47.743601] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-19T18:22:47.743690] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-19T18:22:48.053700] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-19T18:22:48.082382] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-19T18:22:48.151135] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:48.643304] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-19T18:22:48.827622] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:22:48.953388] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:22:48.963326] [INFO ] [REMOTE ] DK: Full fetch complete (70577 records). [2025-09-19T18:22:48.963495] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-19T18:22:49.360403] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-19T18:22:49.360547] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-19T18:22:49.361449] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-19T18:22:49.361534] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-19T18:22:49.363210] [DEBUG] [LOCAL ] DK: Trimmed 70577 records to 50194 (keeping 200 days of data) [2025-09-19T18:22:49.462754] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-19T18:22:49.634230] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T18:22:49.699520] [DEBUG] [LOCAL ] DK: Primary data saved (50194 records). [2025-09-19T18:22:49.699739] [INFO ] [MAIN ] DK: Full history saved. [2025-09-19T18:22:49.699868] [INFO ] [MAIN ] Update Progress: 627/2372 symbols completed. DK took 31.7s. Estimated remaining: 3h 50m 19s. Rate: 7.6 symbols/min [2025-09-19T18:22:49.884032] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:22:49.884295] [DEBUG] [LOCAL ] DLR: No existing data file found in primary storage. [2025-09-19T18:22:49.884351] [WARN ] [MAIN ] DLR: No existing data found, performing full refresh instead. [2025-09-19T18:22:49.884771] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-19T18:22:49.884942] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-19T18:22:49.885014] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-19T18:22:49.885051] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-19T18:22:50.008176] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T18:22:50.252933] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-19T18:22:50.295735] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:22:50.707954] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T18:22:51.043331] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-19T18:22:51.843300] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-19T18:22:52.316447] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T18:22:52.643330] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-19T18:22:52.645300] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:22:53.443275] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-19T18:22:53.563351] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T18:22:54.243325] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-19T18:22:54.721471] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T18:22:55.043408] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-19T18:22:55.439976] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T18:22:55.546747] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T18:22:55.843306] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-19T18:22:56.643310] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-19T18:22:57.168637] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T18:22:57.443275] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-19T18:22:57.467744] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:22:57.848265] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:22:58.243403] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-19T18:22:59.043309] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-19T18:22:59.352744] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T18:22:59.360724] [INFO ] [REMOTE ] DKS: Full fetch complete (71622 records). [2025-09-19T18:22:59.360904] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-19T18:22:59.774932] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T18:22:59.801871] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-19T18:22:59.802000] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-19T18:22:59.802957] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-19T18:22:59.803069] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-19T18:22:59.804960] [DEBUG] [LOCAL ] DKS: Trimmed 71622 records to 50730 (keeping 200 days of data) [2025-09-19T18:22:59.877717] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-19T18:23:00.161811] [DEBUG] [LOCAL ] DKS: Primary data saved (50730 records). [2025-09-19T18:23:00.162159] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-19T18:23:00.162328] [INFO ] [MAIN ] Update Progress: 628/2372 symbols completed. DKS took 31.6s. Estimated remaining: 3h 50m 18s. Rate: 7.6 symbols/min [2025-09-19T18:23:00.336964] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:00.370097] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T18:23:00.411128] [DEBUG] [LOCAL ] DLX: Loaded 29538 existing records from primary storage. [2025-09-19T18:23:00.411285] [INFO ] [MAIN ] DLX: Loaded 29538 existing records. [2025-09-19T18:23:00.529181] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-19T18:23:00.616463] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:23:00.616840] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-19T18:23:00.616915] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-19T18:23:00.617717] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-19T18:23:00.617777] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-19T18:23:00.648451] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-19T18:23:00.999630] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:01.443330] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-19T18:23:01.672070] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T18:23:02.243335] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-19T18:23:03.043329] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-19T18:23:03.843275] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-19T18:23:04.083292] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T18:23:04.139761] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:23:04.643297] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-19T18:23:04.874341] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T18:23:05.443290] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-19T18:23:05.686400] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T18:23:05.960808] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (4.52 seconds). [2025-09-19T18:23:06.243267] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-19T18:23:06.573753] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T18:23:07.043270] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-19T18:23:07.799575] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T18:23:07.843330] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-19T18:23:08.284072] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:23:08.599205] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T18:23:08.643301] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-19T18:23:09.443301] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-19T18:23:10.041367] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T18:23:10.222869] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T18:23:10.243258] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-19T18:23:11.043304] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-19T18:23:11.777427] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T18:23:11.843281] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-19T18:23:11.886422] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T18:23:11.887860] [INFO ] [REMOTE ] DLNG: Full fetch complete (12104 records). [2025-09-19T18:23:11.887937] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-19T18:23:12.271068] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-19T18:23:12.271172] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-19T18:23:12.271440] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-19T18:23:12.271481] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-19T18:23:12.272056] [DEBUG] [LOCAL ] DLNG: Trimmed 12104 records to 6395 (keeping 200 days of data) [2025-09-19T18:23:12.308594] [DEBUG] [LOCAL ] DLNG: Primary data saved (6395 records). [2025-09-19T18:23:12.308726] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-19T18:23:12.308819] [INFO ] [MAIN ] Update Progress: 629/2372 symbols completed. DLNG took 24.9s. Estimated remaining: 3h 50m 22s. Rate: 7.6 symbols/min [2025-09-19T18:23:12.476758] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:12.476950] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-09-19T18:23:12.476989] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-09-19T18:23:12.477152] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-19T18:23:12.477195] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-19T18:23:12.477279] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-09-19T18:23:12.477331] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-19T18:23:12.648790] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-19T18:23:12.835639] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:13.443263] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-19T18:23:13.945393] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:23:13.972962] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T18:23:13.978724] [INFO ] [REMOTE ] DLB: Full fetch complete (47043 records). [2025-09-19T18:23:13.978880] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-19T18:23:14.255007] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-19T18:23:14.430717] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-19T18:23:14.430816] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-19T18:23:14.431553] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-19T18:23:14.431597] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-19T18:23:14.432717] [DEBUG] [LOCAL ] DLB: Trimmed 47043 records to 32772 (keeping 200 days of data) [2025-09-19T18:23:14.648843] [DEBUG] [LOCAL ] DLB: Primary data saved (32772 records). [2025-09-19T18:23:14.649027] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-19T18:23:14.649796] [INFO ] [MAIN ] Update Progress: 630/2372 symbols completed. DLB took 29.0s. Estimated remaining: 3h 49m 59s. Rate: 7.6 symbols/min [2025-09-19T18:23:14.818243] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:14.818456] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-09-19T18:23:14.818510] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-09-19T18:23:14.818683] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-19T18:23:14.818737] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-19T18:23:14.818780] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-09-19T18:23:14.818812] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-19T18:23:15.049419] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-19T18:23:15.210455] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:15.231210] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T18:23:15.823120] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T18:23:15.843258] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-19T18:23:16.184568] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T18:23:16.643307] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-19T18:23:17.437177] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T18:23:17.436921] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:23:17.443508] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-19T18:23:18.198699] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T18:23:18.243311] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-19T18:23:19.043283] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-19T18:23:19.770877] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T18:23:19.843261] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-19T18:23:20.624580] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T18:23:20.643222] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-19T18:23:21.443269] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-19T18:23:21.861713] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:23:21.989622] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T18:23:21.997690] [INFO ] [REMOTE ] DLR: Full fetch complete (74267 records). [2025-09-19T18:23:21.997870] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-19T18:23:22.239868] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T18:23:22.253638] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-19T18:23:22.417780] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-19T18:23:22.417863] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-19T18:23:22.419749] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-19T18:23:22.419815] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-19T18:23:22.421266] [DEBUG] [LOCAL ] DLR: Trimmed 74267 records to 51987 (keeping 200 days of data) [2025-09-19T18:23:22.749139] [DEBUG] [LOCAL ] DLR: Primary data saved (51987 records). [2025-09-19T18:23:22.749274] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-19T18:23:22.749360] [INFO ] [MAIN ] Update Progress: 631/2372 symbols completed. DLR took 33.0s. Estimated remaining: 3h 49m 51s. Rate: 7.6 symbols/min [2025-09-19T18:23:22.919468] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:22.930742] [DEBUG] [LOCAL ] DMB: Loaded 10199 existing records from primary storage. [2025-09-19T18:23:22.930878] [INFO ] [MAIN ] DMB: Loaded 10199 existing records. [2025-09-19T18:23:23.048440] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-19T18:23:23.120007] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:23:23.120272] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-19T18:23:23.120328] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-19T18:23:23.120811] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-19T18:23:23.120872] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-19T18:23:23.474585] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:23.763766] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T18:23:23.848152] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-19T18:23:23.849162] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T18:23:24.643258] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-19T18:23:24.921982] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T18:23:25.443299] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-19T18:23:25.894352] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T18:23:26.158920] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-19T18:23:26.243294] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-19T18:23:27.043281] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-19T18:23:27.193669] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T18:23:27.843250] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-19T18:23:28.291684] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T18:23:28.643266] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-19T18:23:28.836868] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T18:23:29.443275] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-19T18:23:30.082689] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T18:23:30.244997] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T18:23:30.243709] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-19T18:23:30.939780] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T18:23:31.043296] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-19T18:23:31.843268] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-19T18:23:32.171191] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:23:32.643244] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-19T18:23:32.747832] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T18:23:33.367067] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T18:23:33.443270] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-19T18:23:34.243253] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-19T18:23:34.564719] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T18:23:34.808901] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T18:23:35.043266] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-19T18:23:35.843268] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-19T18:23:35.897996] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T18:23:35.899501] [INFO ] [REMOTE ] DMA: Full fetch complete (6497 records). [2025-09-19T18:23:35.899589] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-19T18:23:36.279101] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-19T18:23:36.279183] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-19T18:23:36.279392] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-19T18:23:36.279457] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-19T18:23:36.280679] [DEBUG] [LOCAL ] DMA: Trimmed 6497 records to 4603 (keeping 200 days of data) [2025-09-19T18:23:36.308688] [DEBUG] [LOCAL ] DMA: Primary data saved (4603 records). [2025-09-19T18:23:36.308855] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-19T18:23:36.308947] [INFO ] [MAIN ] Update Progress: 632/2372 symbols completed. DMA took 21.7s. Estimated remaining: 3h 49m 59s. Rate: 7.6 symbols/min [2025-09-19T18:23:36.482472] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:36.482665] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-09-19T18:23:36.482725] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-09-19T18:23:36.482904] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-19T18:23:36.482950] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-19T18:23:36.482994] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-19T18:23:36.483028] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-19T18:23:36.644425] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-19T18:23:36.702824] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:23:36.865552] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:37.443274] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-19T18:23:38.243350] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-19T18:23:38.418497] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T18:23:38.513446] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T18:23:38.878628] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T18:23:39.043263] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-19T18:23:39.843272] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-19T18:23:40.063901] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:23:40.643312] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-19T18:23:41.163979] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T18:23:41.443322] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-19T18:23:41.638124] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T18:23:42.130809] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T18:23:42.243298] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-19T18:23:43.043306] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-19T18:23:43.843277] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-19T18:23:43.988538] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:23:44.002616] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T18:23:44.643284] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-19T18:23:44.736484] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T18:23:45.443278] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-19T18:23:46.028145] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T18:23:46.032752] [INFO ] [REMOTE ] DLX: Full fetch complete (41219 records). [2025-09-19T18:23:46.032853] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-19T18:23:46.250395] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-19T18:23:46.442116] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-19T18:23:46.442205] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-19T18:23:46.442818] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-19T18:23:46.442895] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-19T18:23:46.451817] [DEBUG] [LOCAL ] DLX: Trimmed 41219 records to 29746 (keeping 200 days of data) [2025-09-19T18:23:46.452979] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T18:23:46.642304] [DEBUG] [LOCAL ] DLX: Primary data saved (29746 records). [2025-09-19T18:23:46.642466] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-19T18:23:46.642600] [INFO ] [MAIN ] Update Progress: 633/2372 symbols completed. DLX took 46.5s. Estimated remaining: 3h 49m 58s. Rate: 7.6 symbols/min [2025-09-19T18:23:46.813494] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:46.813747] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-09-19T18:23:46.813803] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-09-19T18:23:46.813951] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-19T18:23:46.813993] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-19T18:23:46.814038] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-09-19T18:23:46.814068] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-19T18:23:47.051390] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-19T18:23:47.179419] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:47.580033] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T18:23:47.843264] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-19T18:23:48.442950] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:23:48.445430] [INFO ] [REMOTE ] DMB: Full fetch complete (15060 records). [2025-09-19T18:23:48.445504] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-19T18:23:48.648362] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-19T18:23:48.816782] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-19T18:23:48.816862] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-19T18:23:48.817273] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-19T18:23:48.817320] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-19T18:23:48.817876] [DEBUG] [LOCAL ] DMB: Trimmed 15060 records to 10260 (keeping 200 days of data) [2025-09-19T18:23:48.881213] [DEBUG] [LOCAL ] DMB: Primary data saved (10260 records). [2025-09-19T18:23:48.881377] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-19T18:23:48.881471] [INFO ] [MAIN ] Update Progress: 634/2372 symbols completed. DMB took 26.1s. Estimated remaining: 3h 49m 34s. Rate: 7.6 symbols/min [2025-09-19T18:23:49.057845] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:49.093213] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T18:23:49.117553] [DEBUG] [LOCAL ] DNOW: Loaded 43837 existing records from primary storage. [2025-09-19T18:23:49.117742] [INFO ] [MAIN ] DNOW: Loaded 43837 existing records. [2025-09-19T18:23:49.323891] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:23:49.324238] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-19T18:23:49.324307] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-19T18:23:49.325433] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-19T18:23:49.325498] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-19T18:23:49.448548] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-19T18:23:49.745061] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T18:23:49.777861] [INFO ] [REMOTE ] DLY: Full fetch complete (28182 records). [2025-09-19T18:23:49.800386] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-19T18:23:50.086005] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:50.250095] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-19T18:23:50.413216] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-19T18:23:50.413296] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-19T18:23:50.413998] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-19T18:23:50.414059] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-19T18:23:50.414990] [DEBUG] [LOCAL ] DLY: Trimmed 28182 records to 19696 (keeping 200 days of data) [2025-09-19T18:23:50.538850] [DEBUG] [LOCAL ] DLY: Primary data saved (19696 records). [2025-09-19T18:23:50.538990] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-19T18:23:50.539065] [INFO ] [MAIN ] Update Progress: 635/2372 symbols completed. DLY took 38.2s. Estimated remaining: 3h 49m 9s. Rate: 7.6 symbols/min [2025-09-19T18:23:50.708208] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:23:50.743623] [DEBUG] [LOCAL ] DNP: Loaded 33722 existing records from primary storage. [2025-09-19T18:23:50.743841] [INFO ] [MAIN ] DNP: Loaded 33722 existing records. [2025-09-19T18:23:50.922486] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:23:50.922743] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-19T18:23:50.922804] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-19T18:23:50.923892] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-19T18:23:50.923952] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-19T18:23:51.048413] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-19T18:23:51.292791] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:23:51.606767] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:23:51.843273] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-19T18:23:51.929555] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:23:52.361238] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:23:52.643234] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-19T18:23:53.443307] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-19T18:23:53.634392] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T18:23:53.794753] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T18:23:54.243310] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-19T18:23:54.452871] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:23:55.043283] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-19T18:23:55.843277] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-19T18:23:55.902849] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T18:23:56.643263] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-19T18:23:56.758704] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T18:23:57.448377] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-19T18:23:57.465922] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T18:23:57.621869] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T18:23:58.243266] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-19T18:23:59.044054] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-19T18:23:59.048993] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T18:23:59.156909] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T18:23:59.843268] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-19T18:24:00.018172] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:24:00.643282] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-19T18:24:01.443293] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-19T18:24:02.243327] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-19T18:24:02.970704] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (3.13 seconds). [2025-09-19T18:24:03.043327] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-19T18:24:03.601794] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T18:24:03.689847] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (3.05 seconds). [2025-09-19T18:24:03.843325] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-19T18:24:04.643318] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-19T18:24:04.876965] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-19T18:24:05.229168] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T18:24:05.443264] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-19T18:24:05.731759] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T18:24:06.243263] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-19T18:24:06.635122] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T18:24:06.764763] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T18:24:07.043305] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-19T18:24:07.761887] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T18:24:07.769770] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:24:07.777731] [INFO ] [REMOTE ] DMO: Full fetch complete (14409 records). [2025-09-19T18:24:07.778098] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-19T18:24:07.778911] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:24:07.778998] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:24:07.779041] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:24:07.779080] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-19T18:24:07.779137] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-19T18:24:07.779179] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-09-19T18:24:07.779239] [DEBUG] [LOCAL ] DMO: No derivative data file found to delete. [2025-09-19T18:24:07.779317] [INFO ] [MAIN ] Update Progress: 636/2372 symbols completed. DMO took 31.5s. Estimated remaining: 3h 49m 27s. Rate: 7.6 symbols/min [2025-09-19T18:24:07.848389] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-19T18:24:07.957784] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:08.019745] [DEBUG] [LOCAL ] DOC: Loaded 53925 existing records from primary storage. [2025-09-19T18:24:08.019936] [INFO ] [MAIN ] DOC: Loaded 53925 existing records. [2025-09-19T18:24:08.206636] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:08.206957] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-19T18:24:08.207027] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-19T18:24:08.208414] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-19T18:24:08.208486] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-19T18:24:08.565516] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:08.643238] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-19T18:24:09.443353] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-19T18:24:09.523428] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T18:24:10.101625] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:24:10.243264] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-19T18:24:11.043281] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-19T18:24:11.089623] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T18:24:11.843291] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-19T18:24:12.567597] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:24:12.643236] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-19T18:24:13.443271] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-19T18:24:14.257177] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-19T18:24:14.264273] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-19T18:24:14.874381] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (3.83 seconds). [2025-09-19T18:24:15.043256] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-19T18:24:15.180627] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T18:24:15.307820] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T18:24:15.843266] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-19T18:24:16.289682] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:24:16.643267] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-19T18:24:16.923045] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T18:24:17.443270] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-19T18:24:17.837906] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:24:18.083361] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T18:24:18.243274] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-19T18:24:18.852544] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:24:18.861427] [INFO ] [REMOTE ] DNOW: Full fetch complete (62265 records). [2025-09-19T18:24:18.861592] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-19T18:24:19.051280] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-19T18:24:19.307578] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-19T18:24:19.307690] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-19T18:24:19.308856] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-19T18:24:19.308919] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-19T18:24:19.310614] [DEBUG] [LOCAL ] DNOW: Trimmed 62265 records to 44148 (keeping 200 days of data) [2025-09-19T18:24:19.576206] [DEBUG] [LOCAL ] DNOW: Primary data saved (44148 records). [2025-09-19T18:24:19.576338] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-19T18:24:19.576433] [INFO ] [MAIN ] Update Progress: 637/2372 symbols completed. DNOW took 30.7s. Estimated remaining: 3h 49m 29s. Rate: 7.6 symbols/min [2025-09-19T18:24:19.843251] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-19T18:24:20.221130] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T18:24:20.643274] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-19T18:24:20.897204] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:24:21.443291] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-19T18:24:21.464769] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T18:24:21.470718] [INFO ] [REMOTE ] DNP: Full fetch complete (49451 records). [2025-09-19T18:24:21.470861] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-19T18:24:21.895660] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-19T18:24:21.895760] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-19T18:24:21.896495] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-19T18:24:21.896571] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-19T18:24:21.899773] [DEBUG] [LOCAL ] DNP: Trimmed 49451 records to 33926 (keeping 200 days of data) [2025-09-19T18:24:22.110999] [DEBUG] [LOCAL ] DNP: Primary data saved (33926 records). [2025-09-19T18:24:22.111159] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-19T18:24:22.111280] [INFO ] [MAIN ] Update Progress: 638/2372 symbols completed. DNP took 31.6s. Estimated remaining: 3h 49m 7s. Rate: 7.6 symbols/min [2025-09-19T18:24:22.376201] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:24:22.389625] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-19T18:24:24.082561] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-19T18:24:24.100453] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-19T18:24:24.576527] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T18:24:24.584612] [INFO ] [REMOTE ] DNA: Full fetch complete (70983 records). [2025-09-19T18:24:24.584818] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-19T18:24:24.999427] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-19T18:24:24.999540] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-19T18:24:25.000455] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-19T18:24:25.000534] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-19T18:24:25.002510] [DEBUG] [LOCAL ] DNA: Trimmed 70983 records to 49205 (keeping 200 days of data) [2025-09-19T18:24:25.310004] [DEBUG] [LOCAL ] DNA: Primary data saved (49205 records). [2025-09-19T18:24:25.310275] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-19T18:24:25.310502] [INFO ] [MAIN ] Update Progress: 639/2372 symbols completed. DNA took 38.7s. Estimated remaining: 3h 48m 46s. Rate: 7.6 symbols/min [2025-09-19T18:24:25.636256] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T18:24:25.648968] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-19T18:24:27.187175] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:24:27.198552] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-19T18:24:29.401329] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T18:24:29.413194] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-19T18:24:31.640062] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T18:24:31.651791] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-19T18:24:33.733907] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T18:24:33.742135] [INFO ] [REMOTE ] DOC: Full fetch complete (77366 records). [2025-09-19T18:24:33.742327] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-19T18:24:34.148269] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-19T18:24:34.148360] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-19T18:24:34.149285] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-19T18:24:34.149366] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-19T18:24:34.151041] [DEBUG] [LOCAL ] DOC: Trimmed 77366 records to 54313 (keeping 200 days of data) [2025-09-19T18:24:34.517466] [DEBUG] [LOCAL ] DOC: Primary data saved (54313 records). [2025-09-19T18:24:34.517630] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-19T18:24:34.518226] [INFO ] [MAIN ] Update Progress: 640/2372 symbols completed. DOC took 26.7s. Estimated remaining: 3h 48m 41s. Rate: 7.6 symbols/min [2025-09-19T18:24:35.196879] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:35.275773] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:35.280297] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:35.308086] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:35.390184] [DEBUG] [LOCAL ] DOUG: Loaded 35182 existing records from primary storage. [2025-09-19T18:24:35.390395] [INFO ] [MAIN ] DOUG: Loaded 35182 existing records. [2025-09-19T18:24:35.577585] [DEBUG] [LOCAL ] DOCN: Loaded 50790 existing records from primary storage. [2025-09-19T18:24:35.579180] [INFO ] [MAIN ] DOCN: Loaded 50790 existing records. [2025-09-19T18:24:35.579079] [DEBUG] [LOCAL ] DOCS: Loaded 51729 existing records from primary storage. [2025-09-19T18:24:35.579832] [DEBUG] [LOCAL ] DOLE: Loaded 38101 existing records from primary storage. [2025-09-19T18:24:35.606600] [INFO ] [MAIN ] DOLE: Loaded 38101 existing records. [2025-09-19T18:24:35.585237] [INFO ] [MAIN ] DOCS: Loaded 51729 existing records. [2025-09-19T18:24:35.876795] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:35.948546] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-19T18:24:36.025294] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-19T18:24:36.112480] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-19T18:24:36.236300] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:36.245074] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:36.200395] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-19T18:24:36.268866] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-19T18:24:36.248279] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:36.278129] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-19T18:24:36.278039] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-19T18:24:36.293820] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-19T18:24:36.317410] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-19T18:24:36.323017] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-19T18:24:36.328367] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-19T18:24:36.333792] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-19T18:24:36.339270] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-19T18:24:36.354902] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-19T18:24:36.460697] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-19T18:24:36.485344] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-19T18:24:37.383889] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:37.412280] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-19T18:24:37.677093] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:37.711321] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-19T18:24:37.757873] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:37.770267] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-19T18:24:37.811776] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:37.812900] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-19T18:24:39.007999] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T18:24:39.017098] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-19T18:24:39.083336] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T18:24:39.092669] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-19T18:24:39.587256] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T18:24:39.594415] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-19T18:24:39.954770] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T18:24:39.965252] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-19T18:24:40.448489] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T18:24:40.458678] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-19T18:24:40.631921] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T18:24:40.640722] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-19T18:24:40.757868] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T18:24:40.765287] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-19T18:24:41.729406] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T18:24:41.737295] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-19T18:24:42.154000] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:24:42.170301] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-19T18:24:42.336497] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T18:24:42.352111] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-19T18:24:42.418898] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T18:24:42.429032] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-19T18:24:42.860544] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T18:24:42.869672] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-19T18:24:43.410100] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:24:43.417584] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-19T18:24:44.228077] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T18:24:44.238156] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-19T18:24:44.322817] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T18:24:44.333203] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-19T18:24:44.356361] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:24:44.364540] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-19T18:24:44.572755] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T18:24:44.580892] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-19T18:24:45.815998] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T18:24:45.826300] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-19T18:24:46.021516] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:24:46.030203] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-19T18:24:46.255601] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T18:24:46.264344] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-19T18:24:46.452103] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T18:24:46.463507] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-19T18:24:47.632372] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T18:24:47.640354] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-19T18:24:47.829093] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T18:24:47.843217] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-19T18:24:47.904596] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T18:24:48.150335] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T18:24:48.643311] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-19T18:24:48.693964] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T18:24:49.443282] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-19T18:24:49.695429] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T18:24:49.824937] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T18:24:50.243257] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-19T18:24:51.043306] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-19T18:24:51.268060] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T18:24:51.843273] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-19T18:24:52.042752] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T18:24:52.643286] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-19T18:24:53.183814] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-19T18:24:53.402348] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:24:53.407499] [INFO ] [REMOTE ] DOUG: Full fetch complete (51816 records). [2025-09-19T18:24:53.407597] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-19T18:24:53.451467] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-19T18:24:53.896920] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-19T18:24:53.897252] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-19T18:24:53.898044] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-19T18:24:53.898112] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-19T18:24:53.899407] [DEBUG] [LOCAL ] DOUG: Trimmed 51816 records to 35374 (keeping 200 days of data) [2025-09-19T18:24:54.099843] [DEBUG] [LOCAL ] DOUG: Primary data saved (35374 records). [2025-09-19T18:24:54.099997] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-19T18:24:54.100088] [INFO ] [MAIN ] Update Progress: 641/2372 symbols completed. DOUG took 19.6s. Estimated remaining: 3h 49m 5s. Rate: 7.6 symbols/min [2025-09-19T18:24:54.253148] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-19T18:24:54.283170] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:54.334487] [DEBUG] [LOCAL ] DOV: Loaded 46188 existing records from primary storage. [2025-09-19T18:24:54.334634] [INFO ] [MAIN ] DOV: Loaded 46188 existing records. [2025-09-19T18:24:54.522009] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:54.522311] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-19T18:24:54.522360] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-19T18:24:54.524062] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-19T18:24:54.524128] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-19T18:24:54.901475] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:55.048421] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-19T18:24:55.066620] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-19T18:24:55.639864] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:24:55.646224] [INFO ] [REMOTE ] DOLE: Full fetch complete (52817 records). [2025-09-19T18:24:55.646421] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-19T18:24:55.648445] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:24:55.648541] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:24:55.648584] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:24:55.648622] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-19T18:24:55.648721] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-09-19T18:24:55.648773] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-09-19T18:24:55.649216] [DEBUG] [LOCAL ] DOLE: Deleted derivative data file. [2025-09-19T18:24:55.649324] [INFO ] [MAIN ] Update Progress: 642/2372 symbols completed. DOLE took 21.1s. Estimated remaining: 3h 48m 40s. Rate: 7.6 symbols/min [2025-09-19T18:24:55.827358] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:24:55.856526] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-19T18:24:55.865342] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T18:24:55.933306] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-09-19T18:24:55.933480] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-09-19T18:24:56.117894] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:24:56.118141] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-19T18:24:56.118189] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-19T18:24:56.119895] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-19T18:24:56.119955] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-19T18:24:56.508205] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:24:56.531157] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T18:24:56.643266] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-19T18:24:57.388438] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T18:24:57.443286] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-19T18:24:58.243293] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-19T18:24:58.843560] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T18:24:58.987726] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T18:24:59.043276] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-19T18:24:59.843275] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-19T18:25:00.087457] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T18:25:00.643276] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-19T18:25:01.151350] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:25:01.443289] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-19T18:25:02.099933] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T18:25:02.243333] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-19T18:25:02.448224] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T18:25:02.456045] [INFO ] [REMOTE ] DOCN: Full fetch complete (71064 records). [2025-09-19T18:25:02.456203] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-19T18:25:02.861119] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-19T18:25:02.861246] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-19T18:25:02.862184] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-19T18:25:02.862263] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-19T18:25:02.864377] [DEBUG] [LOCAL ] DOCN: Trimmed 71064 records to 51180 (keeping 200 days of data) [2025-09-19T18:25:02.975019] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:25:02.987552] [INFO ] [REMOTE ] DOCS: Full fetch complete (74260 records). [2025-09-19T18:25:02.989993] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-19T18:25:03.043243] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-19T18:25:03.537551] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-19T18:25:03.538213] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-19T18:25:03.539638] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-19T18:25:03.540249] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-19T18:25:03.549060] [DEBUG] [LOCAL ] DOCS: Trimmed 74260 records to 52104 (keeping 200 days of data) [2025-09-19T18:25:03.717333] [DEBUG] [LOCAL ] DOCN: Primary data saved (51180 records). [2025-09-19T18:25:03.718943] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-19T18:25:03.719351] [INFO ] [MAIN ] Update Progress: 643/2372 symbols completed. DOCN took 29.2s. Estimated remaining: 3h 48m 32s. Rate: 7.6 symbols/min [2025-09-19T18:25:03.998257] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:04.000392] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-09-19T18:25:04.000838] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-09-19T18:25:04.001442] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-19T18:25:04.006083] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-19T18:25:04.008151] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-19T18:25:04.010793] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-19T18:25:04.520004] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T18:25:04.525586] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:04.537056] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-19T18:25:04.543486] [DEBUG] [LOCAL ] DOCS: Primary data saved (52104 records). [2025-09-19T18:25:04.543581] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-19T18:25:04.543686] [INFO ] [MAIN ] Update Progress: 644/2372 symbols completed. DOCS took 30.0s. Estimated remaining: 3h 48m 5s. Rate: 7.6 symbols/min [2025-09-19T18:25:04.643579] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-19T18:25:04.722226] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:04.761012] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T18:25:04.808313] [DEBUG] [LOCAL ] DQ: Loaded 43417 existing records from primary storage. [2025-09-19T18:25:04.808516] [INFO ] [MAIN ] DQ: Loaded 43417 existing records. [2025-09-19T18:25:04.982736] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:25:04.982979] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-19T18:25:04.983048] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-19T18:25:04.984291] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-19T18:25:04.984377] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-19T18:25:05.297052] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T18:25:05.357496] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:05.443233] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-19T18:25:06.248096] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-19T18:25:06.253953] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T18:25:07.043452] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-19T18:25:07.314379] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T18:25:07.843269] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-19T18:25:08.092960] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T18:25:08.643280] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-19T18:25:09.047230] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:25:09.443315] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-19T18:25:09.755830] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-19T18:25:10.243260] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-19T18:25:10.718749] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:25:11.043320] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-19T18:25:11.223118] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T18:25:11.585079] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T18:25:11.843262] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-19T18:25:12.033400] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T18:25:12.643265] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-19T18:25:13.443266] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-19T18:25:13.585851] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:25:14.243279] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-19T18:25:14.625179] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:25:15.043277] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-19T18:25:15.246166] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T18:25:15.693306] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T18:25:15.843269] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-19T18:25:16.184453] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T18:25:16.643271] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-19T18:25:17.041876] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T18:25:17.443256] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-19T18:25:18.243287] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-19T18:25:18.559127] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T18:25:18.785180] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-19T18:25:19.043267] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-19T18:25:19.767528] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T18:25:19.843299] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-19T18:25:20.099546] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T18:25:20.643354] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-19T18:25:20.884542] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T18:25:21.443283] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-19T18:25:22.041425] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T18:25:22.243318] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-19T18:25:22.789552] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T18:25:23.043321] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-19T18:25:23.843287] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-19T18:25:23.892716] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:25:24.643270] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-19T18:25:24.982287] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-19T18:25:25.252100] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T18:25:25.443267] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-19T18:25:26.243319] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-19T18:25:26.516719] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:25:26.518987] [INFO ] [REMOTE ] DPG: Full fetch complete (18793 records). [2025-09-19T18:25:26.519076] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-19T18:25:26.519543] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:25:26.519627] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:25:26.519718] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:25:26.519790] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-19T18:25:26.519854] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-19T18:25:26.519889] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-09-19T18:25:26.519945] [DEBUG] [LOCAL ] DPG: No derivative data file found to delete. [2025-09-19T18:25:26.520024] [INFO ] [MAIN ] Update Progress: 645/2372 symbols completed. DPG took 22.8s. Estimated remaining: 3h 48m 35s. Rate: 7.6 symbols/min [2025-09-19T18:25:26.697613] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:26.697957] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-09-19T18:25:26.698037] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-09-19T18:25:26.698323] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-19T18:25:26.698470] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-19T18:25:26.698625] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-19T18:25:26.698718] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-19T18:25:26.826066] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T18:25:27.051990] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-19T18:25:27.092871] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:27.843277] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-19T18:25:28.179762] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T18:25:28.643292] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-19T18:25:29.057275] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T18:25:29.063992] [INFO ] [REMOTE ] DOV: Full fetch complete (64714 records). [2025-09-19T18:25:29.064131] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-19T18:25:29.459183] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-19T18:25:29.474455] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-19T18:25:29.475169] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-19T18:25:29.477205] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T18:25:29.476009] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-19T18:25:29.485463] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-19T18:25:29.486979] [DEBUG] [LOCAL ] DOV: Trimmed 64714 records to 46479 (keeping 200 days of data) [2025-09-19T18:25:29.779712] [DEBUG] [LOCAL ] DOV: Primary data saved (46479 records). [2025-09-19T18:25:29.779872] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-19T18:25:29.780691] [INFO ] [MAIN ] Update Progress: 646/2372 symbols completed. DOV took 35.7s. Estimated remaining: 3h 48m 15s. Rate: 7.6 symbols/min [2025-09-19T18:25:29.951676] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:30.003747] [DEBUG] [LOCAL ] DRH: Loaded 50816 existing records from primary storage. [2025-09-19T18:25:30.003904] [INFO ] [MAIN ] DRH: Loaded 50816 existing records. [2025-09-19T18:25:30.186456] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:25:30.186833] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-19T18:25:30.186891] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-19T18:25:30.188157] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-19T18:25:30.188219] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-19T18:25:30.251335] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-19T18:25:30.567022] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:30.614876] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T18:25:30.623128] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-19T18:25:30.623310] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-19T18:25:31.019352] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-19T18:25:31.019453] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-19T18:25:31.020476] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-19T18:25:31.020545] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-19T18:25:31.022232] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54513 (keeping 200 days of data) [2025-09-19T18:25:31.078536] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-19T18:25:31.361310] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-09-19T18:25:31.361462] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-19T18:25:31.361547] [INFO ] [MAIN ] Update Progress: 647/2372 symbols completed. DOW took 35.7s. Estimated remaining: 3h 47m 50s. Rate: 7.6 symbols/min [2025-09-19T18:25:31.530811] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:31.531274] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-09-19T18:25:31.531336] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-09-19T18:25:31.531553] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-19T18:25:31.531783] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-19T18:25:31.531914] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-09-19T18:25:31.532065] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-19T18:25:31.922581] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:31.944260] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-19T18:25:31.942834] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-19T18:25:31.971858] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T18:25:32.643281] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-19T18:25:33.060186] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T18:25:33.443242] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-19T18:25:33.682125] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T18:25:34.137225] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T18:25:34.243315] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-19T18:25:34.812671] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T18:25:35.043323] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-19T18:25:35.411772] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T18:25:35.843288] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-19T18:25:36.363287] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T18:25:36.643232] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-19T18:25:36.938054] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T18:25:37.443319] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-19T18:25:38.243261] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-19T18:25:38.757522] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T18:25:38.766483] [INFO ] [REMOTE ] DQ: Full fetch complete (62903 records). [2025-09-19T18:25:38.766617] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-19T18:25:39.050067] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-19T18:25:39.174539] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-19T18:25:39.174731] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-19T18:25:39.175625] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-19T18:25:39.175730] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-19T18:25:39.177230] [DEBUG] [LOCAL ] DQ: Trimmed 62903 records to 43775 (keeping 200 days of data) [2025-09-19T18:25:39.325429] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T18:25:39.489524] [DEBUG] [LOCAL ] DQ: Primary data saved (43775 records). [2025-09-19T18:25:39.489702] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-19T18:25:39.489809] [INFO ] [MAIN ] Update Progress: 648/2372 symbols completed. DQ took 34.9s. Estimated remaining: 3h 47m 42s. Rate: 7.6 symbols/min [2025-09-19T18:25:39.681727] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:39.699067] [DEBUG] [LOCAL ] DRLL: Loaded 10099 existing records from primary storage. [2025-09-19T18:25:39.699209] [INFO ] [MAIN ] DRLL: Loaded 10099 existing records. [2025-09-19T18:25:39.847781] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-19T18:25:39.890092] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:25:39.890349] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-19T18:25:39.890412] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-19T18:25:39.890941] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-19T18:25:39.891002] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-19T18:25:40.318614] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T18:25:40.324678] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:40.643261] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-19T18:25:40.916702] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T18:25:41.208696] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:25:41.443233] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-19T18:25:41.587724] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:25:42.243263] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-19T18:25:43.043273] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-19T18:25:43.802514] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-19T18:25:43.845941] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T18:25:43.846062] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-19T18:25:44.649244] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-19T18:25:44.670728] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:25:44.847136] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:25:45.443289] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-19T18:25:46.243266] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-19T18:25:46.460582] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:25:47.003736] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T18:25:47.043249] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-19T18:25:47.257158] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T18:25:47.843309] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-19T18:25:48.643281] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-19T18:25:48.917035] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T18:25:49.261459] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T18:25:49.443259] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-19T18:25:49.814564] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:25:50.243270] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-19T18:25:50.811822] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T18:25:51.043291] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-19T18:25:51.393189] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T18:25:51.843258] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-19T18:25:52.243488] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T18:25:52.643264] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-19T18:25:53.443317] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-19T18:25:53.751907] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:25:53.857605] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T18:25:54.061476] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T18:25:54.243269] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-19T18:25:55.043295] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-19T18:25:55.843294] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-19T18:25:55.879796] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T18:25:55.887001] [INFO ] [REMOTE ] DRD: Full fetch complete (48355 records). [2025-09-19T18:25:55.887144] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-19T18:25:56.321439] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-19T18:25:56.321553] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-19T18:25:56.322461] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-19T18:25:56.322544] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-19T18:25:56.324054] [DEBUG] [LOCAL ] DRD: Trimmed 48355 records to 37026 (keeping 200 days of data) [2025-09-19T18:25:56.564431] [DEBUG] [LOCAL ] DRD: Primary data saved (37026 records). [2025-09-19T18:25:56.564714] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-19T18:25:56.564943] [INFO ] [MAIN ] Update Progress: 649/2372 symbols completed. DRD took 30.0s. Estimated remaining: 3h 47m 59s. Rate: 7.6 symbols/min [2025-09-19T18:25:56.648479] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-19T18:25:56.762180] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:25:56.762395] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-09-19T18:25:56.762450] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-09-19T18:25:56.762620] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-19T18:25:56.762694] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-19T18:25:56.762752] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-09-19T18:25:56.762785] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-19T18:25:57.139198] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:25:57.170536] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T18:25:57.443269] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-19T18:25:57.669209] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-19T18:25:57.898725] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:25:58.243286] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-19T18:25:59.043331] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-19T18:25:59.183404] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T18:25:59.318370] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T18:25:59.843277] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-19T18:26:00.202635] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T18:26:00.643270] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-19T18:26:01.176568] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T18:26:01.443245] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-19T18:26:01.973453] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:26:02.243291] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-19T18:26:03.043252] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-19T18:26:03.068867] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T18:26:03.070690] [INFO ] [REMOTE ] DRLL: Full fetch complete (16346 records). [2025-09-19T18:26:03.070766] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-19T18:26:03.477941] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-19T18:26:03.478216] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-19T18:26:03.478703] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-19T18:26:03.478849] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-19T18:26:03.479851] [DEBUG] [LOCAL ] DRLL: Trimmed 16346 records to 10151 (keeping 200 days of data) [2025-09-19T18:26:03.558175] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T18:26:03.585561] [DEBUG] [LOCAL ] DRLL: Primary data saved (10151 records). [2025-09-19T18:26:03.585754] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-19T18:26:03.585869] [INFO ] [MAIN ] Update Progress: 650/2372 symbols completed. DRLL took 24.1s. Estimated remaining: 3h 47m 48s. Rate: 7.6 symbols/min [2025-09-19T18:26:03.759271] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:03.759466] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-09-19T18:26:03.759521] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-09-19T18:26:03.759704] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-19T18:26:03.759756] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-19T18:26:03.759799] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-19T18:26:03.759831] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-19T18:26:03.848830] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-19T18:26:04.128373] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:04.535884] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T18:26:04.543182] [INFO ] [REMOTE ] DRI: Full fetch complete (69517 records). [2025-09-19T18:26:04.543358] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-19T18:26:04.648436] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-19T18:26:04.944466] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-19T18:26:04.944551] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-19T18:26:04.945371] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-19T18:26:04.945436] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-19T18:26:04.946878] [DEBUG] [LOCAL ] DRI: Trimmed 69517 records to 48576 (keeping 200 days of data) [2025-09-19T18:26:05.266923] [DEBUG] [LOCAL ] DRI: Primary data saved (48576 records). [2025-09-19T18:26:05.267077] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-19T18:26:05.267158] [INFO ] [MAIN ] Update Progress: 651/2372 symbols completed. DRI took 33.9s. Estimated remaining: 3h 47m 24s. Rate: 7.6 symbols/min [2025-09-19T18:26:05.443135] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:05.443265] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-19T18:26:05.448210] [DEBUG] [LOCAL ] DSMC: Loaded 2010 existing records from primary storage. [2025-09-19T18:26:05.448395] [INFO ] [MAIN ] DSMC: Loaded 2010 existing records. [2025-09-19T18:26:05.641063] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:05.641440] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-19T18:26:05.641500] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-19T18:26:05.641809] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-19T18:26:05.641870] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-19T18:26:06.012932] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:06.045383] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T18:26:06.046921] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T18:26:06.060096] [INFO ] [REMOTE ] DRH: Full fetch complete (71878 records). [2025-09-19T18:26:06.060292] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-19T18:26:06.246430] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-19T18:26:06.474477] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-19T18:26:06.474624] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-19T18:26:06.475634] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-19T18:26:06.475778] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-19T18:26:06.492923] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T18:26:06.499304] [DEBUG] [LOCAL ] DRH: Trimmed 71878 records to 51192 (keeping 200 days of data) [2025-09-19T18:26:06.799243] [DEBUG] [LOCAL ] DRH: Primary data saved (51192 records). [2025-09-19T18:26:06.799421] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-19T18:26:06.799537] [INFO ] [MAIN ] Update Progress: 652/2372 symbols completed. DRH took 37.0s. Estimated remaining: 3h 46m 59s. Rate: 7.6 symbols/min [2025-09-19T18:26:06.967954] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:06.992809] [DEBUG] [LOCAL ] DSU: Loaded 21836 existing records from primary storage. [2025-09-19T18:26:06.993013] [INFO ] [MAIN ] DSU: Loaded 21836 existing records. [2025-09-19T18:26:07.055180] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-19T18:26:07.177948] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:07.178241] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-19T18:26:07.178300] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-19T18:26:07.179287] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-19T18:26:07.179350] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-19T18:26:07.531962] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:07.542435] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:26:07.843268] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-19T18:26:08.646494] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-19T18:26:08.655965] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T18:26:09.109862] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-19T18:26:09.198965] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T18:26:09.443260] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-19T18:26:10.243248] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-19T18:26:10.569915] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T18:26:10.798314] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-19T18:26:11.043278] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-19T18:26:11.843247] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-19T18:26:12.365011] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T18:26:12.643267] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-19T18:26:13.168404] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T18:26:13.443284] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-19T18:26:13.593028] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T18:26:14.243266] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-19T18:26:14.812067] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:26:15.043262] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-19T18:26:15.410238] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-19T18:26:15.527802] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T18:26:15.843261] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-19T18:26:16.643228] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-19T18:26:17.188672] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:26:17.374148] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T18:26:17.443274] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-19T18:26:18.243224] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-19T18:26:18.368733] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T18:26:19.043283] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-19T18:26:19.843315] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-19T18:26:19.902360] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T18:26:20.614877] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T18:26:20.643215] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-19T18:26:20.688695] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:26:21.209423] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T18:26:21.443272] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-19T18:26:22.243312] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-19T18:26:22.409130] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T18:26:22.655518] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T18:26:23.043295] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-19T18:26:23.843278] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-19T18:26:24.116292] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T18:26:24.643287] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-19T18:26:25.143621] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T18:26:25.350563] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T18:26:25.443294] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-19T18:26:25.974762] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T18:26:26.243280] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-19T18:26:26.769781] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-19T18:26:27.043273] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-19T18:26:27.843302] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-19T18:26:27.998482] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T18:26:28.643267] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-19T18:26:29.087458] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T18:26:29.088453] [INFO ] [REMOTE ] DSMC: Full fetch complete (2873 records). [2025-09-19T18:26:29.088525] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-19T18:26:29.446038] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-19T18:26:29.493882] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-19T18:26:29.493978] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-19T18:26:29.494186] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-19T18:26:29.494302] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-19T18:26:29.494862] [DEBUG] [LOCAL ] DSMC: Trimmed 2873 records to 2049 (keeping 200 days of data) [2025-09-19T18:26:29.520553] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T18:26:29.530249] [DEBUG] [LOCAL ] DSMC: Primary data saved (2049 records). [2025-09-19T18:26:29.530341] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-19T18:26:29.530419] [INFO ] [MAIN ] Update Progress: 653/2372 symbols completed. DSMC took 24.3s. Estimated remaining: 3h 47m 30s. Rate: 7.6 symbols/min [2025-09-19T18:26:29.720736] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:29.745781] [DEBUG] [LOCAL ] DSX: Loaded 24874 existing records from primary storage. [2025-09-19T18:26:29.745916] [INFO ] [MAIN ] DSX: Loaded 24874 existing records. [2025-09-19T18:26:29.941351] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:29.941639] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-19T18:26:29.941721] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-19T18:26:29.942634] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-19T18:26:29.942736] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-19T18:26:30.256857] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-19T18:26:30.305045] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:30.403385] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T18:26:31.043284] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-19T18:26:31.712383] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T18:26:31.718369] [INFO ] [REMOTE ] DSL: Full fetch complete (41307 records). [2025-09-19T18:26:31.718495] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-19T18:26:31.848502] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-19T18:26:32.147115] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-19T18:26:32.147196] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-19T18:26:32.147830] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-19T18:26:32.147892] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-19T18:26:32.149215] [DEBUG] [LOCAL ] DSL: Trimmed 41307 records to 28666 (keeping 200 days of data) [2025-09-19T18:26:32.328123] [DEBUG] [LOCAL ] DSL: Primary data saved (28666 records). [2025-09-19T18:26:32.328262] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-19T18:26:32.328408] [INFO ] [MAIN ] Update Progress: 654/2372 symbols completed. DSL took 35.8s. Estimated remaining: 3h 47m 9s. Rate: 7.6 symbols/min [2025-09-19T18:26:32.455523] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T18:26:32.534139] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:32.585324] [DEBUG] [LOCAL ] DT: Loaded 53342 existing records from primary storage. [2025-09-19T18:26:32.585501] [INFO ] [MAIN ] DT: Loaded 53342 existing records. [2025-09-19T18:26:32.655592] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-19T18:26:32.793152] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T18:26:32.799427] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:32.804309] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-19T18:26:32.804382] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-19T18:26:32.806060] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-19T18:26:32.806123] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-19T18:26:33.163328] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:33.443286] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-19T18:26:34.126486] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T18:26:34.131075] [INFO ] [REMOTE ] DSU: Full fetch complete (32122 records). [2025-09-19T18:26:34.131202] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-19T18:26:34.248446] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-19T18:26:34.514018] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-19T18:26:34.556715] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-19T18:26:34.556811] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-19T18:26:34.557467] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-19T18:26:34.557544] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-19T18:26:34.558367] [DEBUG] [LOCAL ] DSU: Trimmed 32122 records to 22088 (keeping 200 days of data) [2025-09-19T18:26:34.707207] [DEBUG] [LOCAL ] DSU: Primary data saved (22088 records). [2025-09-19T18:26:34.707342] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-19T18:26:34.707451] [INFO ] [MAIN ] Update Progress: 655/2372 symbols completed. DSU took 27.9s. Estimated remaining: 3h 46m 46s. Rate: 7.6 symbols/min [2025-09-19T18:26:34.875712] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:34.875887] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-09-19T18:26:34.875940] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-09-19T18:26:34.876090] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-19T18:26:34.876142] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-19T18:26:34.876207] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-09-19T18:26:34.876261] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-19T18:26:35.050414] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-19T18:26:35.255030] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:35.843301] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-19T18:26:36.407696] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:26:36.498961] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:26:36.643296] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-19T18:26:36.765837] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T18:26:37.443266] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-19T18:26:37.594763] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T18:26:38.123296] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T18:26:38.243289] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-19T18:26:38.921432] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T18:26:39.043249] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-19T18:26:39.843284] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-19T18:26:40.643240] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-19T18:26:41.200703] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-19T18:26:41.324628] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:26:41.327223] [INFO ] [REMOTE ] DSM: Full fetch complete (24720 records). [2025-09-19T18:26:41.327330] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-19T18:26:41.448356] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-19T18:26:41.715823] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-19T18:26:41.715909] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-19T18:26:41.716389] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-19T18:26:41.716466] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-19T18:26:41.717247] [DEBUG] [LOCAL ] DSM: Trimmed 24720 records to 16018 (keeping 200 days of data) [2025-09-19T18:26:41.820319] [DEBUG] [LOCAL ] DSM: Primary data saved (16018 records). [2025-09-19T18:26:41.820458] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-19T18:26:41.820555] [INFO ] [MAIN ] Update Progress: 656/2372 symbols completed. DSM took 38.2s. Estimated remaining: 3h 46m 36s. Rate: 7.6 symbols/min [2025-09-19T18:26:42.002787] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:42.066922] [DEBUG] [LOCAL ] DTE: Loaded 48330 existing records from primary storage. [2025-09-19T18:26:42.067077] [INFO ] [MAIN ] DTE: Loaded 48330 existing records. [2025-09-19T18:26:42.256809] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:26:42.250037] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-19T18:26:42.257695] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-19T18:26:42.258979] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-19T18:26:42.277478] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:26:42.277554] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-19T18:26:42.284029] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-19T18:26:42.650781] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:43.003226] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T18:26:43.043228] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-19T18:26:43.488622] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-19T18:26:43.567160] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T18:26:43.843303] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-19T18:26:44.643270] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-19T18:26:45.346518] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T18:26:45.398502] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T18:26:45.443324] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-19T18:26:46.191693] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T18:26:46.243329] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-19T18:26:47.043269] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-19T18:26:47.094631] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T18:26:47.843281] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-19T18:26:48.405272] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T18:26:48.501464] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-19T18:26:48.643287] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-19T18:26:49.443270] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-19T18:26:50.243283] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-19T18:26:50.731574] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T18:26:51.043241] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-19T18:26:51.809430] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T18:26:51.843219] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-19T18:26:52.042882] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T18:26:52.042265] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-19T18:26:52.643274] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-19T18:26:53.150326] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T18:26:53.443305] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-19T18:26:54.243274] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-19T18:26:54.591095] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T18:26:54.915591] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:26:55.043288] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-19T18:26:55.843266] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-19T18:26:56.081059] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T18:26:56.509415] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T18:26:56.643230] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-19T18:26:57.443263] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-19T18:26:57.955272] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T18:26:57.976886] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:26:57.982927] [INFO ] [REMOTE ] DSX: Full fetch complete (37596 records). [2025-09-19T18:26:57.983019] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-19T18:26:58.248410] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-19T18:26:58.359174] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-19T18:26:58.359676] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-19T18:26:58.360289] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-19T18:26:58.360441] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-19T18:26:58.361369] [DEBUG] [LOCAL ] DSX: Trimmed 37596 records to 25050 (keeping 200 days of data) [2025-09-19T18:26:58.519960] [DEBUG] [LOCAL ] DSX: Primary data saved (25050 records). [2025-09-19T18:26:58.520132] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-19T18:26:58.520265] [INFO ] [MAIN ] Update Progress: 657/2372 symbols completed. DSX took 29.0s. Estimated remaining: 3h 46m 51s. Rate: 7.6 symbols/min [2025-09-19T18:26:58.737431] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:26:58.737737] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-19T18:26:58.737792] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-19T18:26:58.737962] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-19T18:26:58.738006] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-19T18:26:58.738050] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-19T18:26:58.738131] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-19T18:26:59.048387] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-19T18:26:59.106474] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:26:59.333709] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T18:26:59.777504] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T18:26:59.843283] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-19T18:26:59.994602] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T18:26:59.996905] [INFO ] [REMOTE ] DTB: Full fetch complete (6792 records). [2025-09-19T18:26:59.997016] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-19T18:27:00.414580] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-19T18:27:00.414831] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-19T18:27:00.415063] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-19T18:27:00.415109] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-19T18:27:00.415858] [DEBUG] [LOCAL ] DTB: Trimmed 6792 records to 4777 (keeping 200 days of data) [2025-09-19T18:27:00.459970] [DEBUG] [LOCAL ] DTB: Primary data saved (4777 records). [2025-09-19T18:27:00.460150] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-19T18:27:00.460318] [INFO ] [MAIN ] Update Progress: 658/2372 symbols completed. DTB took 25.8s. Estimated remaining: 3h 46m 28s. Rate: 7.6 symbols/min [2025-09-19T18:27:00.645811] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-19T18:27:00.647551] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:00.663027] [DEBUG] [LOCAL ] DTG: Loaded 5943 existing records from primary storage. [2025-09-19T18:27:00.663214] [INFO ] [MAIN ] DTG: Loaded 5943 existing records. [2025-09-19T18:27:00.855328] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:00.855581] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-19T18:27:00.855629] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-19T18:27:00.856063] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-19T18:27:00.856124] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-19T18:27:01.215600] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:01.418205] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T18:27:01.443263] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-19T18:27:01.829068] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T18:27:02.243267] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-19T18:27:03.043293] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-19T18:27:03.843358] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-19T18:27:04.651948] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-19T18:27:04.653294] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-19T18:27:04.660775] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (3.22 seconds). [2025-09-19T18:27:05.354130] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T18:27:05.443259] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-19T18:27:05.960533] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-19T18:27:06.186863] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T18:27:06.243259] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-19T18:27:06.274414] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-19T18:27:06.648244] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-19T18:27:07.043284] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-19T18:27:07.843274] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-19T18:27:08.643265] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-19T18:27:08.897856] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T18:27:09.185431] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T18:27:09.443269] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-19T18:27:09.917049] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-19T18:27:09.968179] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T18:27:09.976715] [INFO ] [REMOTE ] DT: Full fetch complete (76641 records). [2025-09-19T18:27:09.976849] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-19T18:27:10.250986] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-19T18:27:10.402137] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-19T18:27:10.402221] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-19T18:27:10.403104] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-19T18:27:10.403168] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-19T18:27:10.404675] [DEBUG] [LOCAL ] DT: Trimmed 76641 records to 53726 (keeping 200 days of data) [2025-09-19T18:27:10.624577] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-19T18:27:10.737461] [DEBUG] [LOCAL ] DT: Primary data saved (53726 records). [2025-09-19T18:27:10.737599] [INFO ] [MAIN ] DT: Full history saved. [2025-09-19T18:27:10.737714] [INFO ] [MAIN ] Update Progress: 659/2372 symbols completed. DT took 38.4s. Estimated remaining: 3h 46m 26s. Rate: 7.6 symbols/min [2025-09-19T18:27:10.905059] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:10.949876] [DEBUG] [LOCAL ] DTM: Loaded 44984 existing records from primary storage. [2025-09-19T18:27:10.950040] [INFO ] [MAIN ] DTM: Loaded 44984 existing records. [2025-09-19T18:27:11.049291] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-19T18:27:11.134551] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:11.134860] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-19T18:27:11.134914] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-19T18:27:11.136409] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-19T18:27:11.136487] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-19T18:27:11.511841] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:11.843241] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-19T18:27:12.287894] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T18:27:12.643258] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-19T18:27:13.195773] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-19T18:27:13.240304] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T18:27:13.443282] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-19T18:27:14.243313] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-19T18:27:15.043334] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-19T18:27:15.788660] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T18:27:15.843287] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-19T18:27:16.019221] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:27:16.521552] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T18:27:16.631448] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T18:27:16.643212] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-19T18:27:17.443270] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-19T18:27:17.932434] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T18:27:17.933348] [INFO ] [REMOTE ] DTF: Full fetch complete (2193 records). [2025-09-19T18:27:17.933419] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-19T18:27:17.933846] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:27:17.933932] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:27:17.933977] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:27:17.934017] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-19T18:27:17.934075] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-19T18:27:17.934114] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-19T18:27:17.934185] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-19T18:27:17.934284] [INFO ] [MAIN ] Update Progress: 660/2372 symbols completed. DTF took 19.4s. Estimated remaining: 3h 46m 16s. Rate: 7.6 symbols/min [2025-09-19T18:27:18.106827] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:18.113965] [DEBUG] [LOCAL ] DTW: Loaded 4957 existing records from primary storage. [2025-09-19T18:27:18.114074] [INFO ] [MAIN ] DTW: Loaded 4957 existing records. [2025-09-19T18:27:18.251279] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-19T18:27:18.292429] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:18.292712] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-19T18:27:18.292768] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-19T18:27:18.293077] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-19T18:27:18.293138] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-19T18:27:18.662845] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:18.690385] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T18:27:19.043291] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-19T18:27:19.843247] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-19T18:27:20.202779] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T18:27:20.618220] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:27:20.643225] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-19T18:27:20.775007] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T18:27:21.443331] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-19T18:27:22.202924] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T18:27:22.243276] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-19T18:27:22.636448] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T18:27:22.636588] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:27:22.646050] [INFO ] [REMOTE ] DTE: Full fetch complete (69304 records). [2025-09-19T18:27:22.646181] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-19T18:27:23.044742] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-19T18:27:23.045319] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-19T18:27:23.046770] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-19T18:27:23.047867] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-19T18:27:23.048043] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-19T18:27:23.050184] [DEBUG] [LOCAL ] DTE: Trimmed 69304 records to 48671 (keeping 200 days of data) [2025-09-19T18:27:23.397351] [DEBUG] [LOCAL ] DTE: Primary data saved (48671 records). [2025-09-19T18:27:23.397518] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-19T18:27:23.397612] [INFO ] [MAIN ] Update Progress: 661/2372 symbols completed. DTE took 41.6s. Estimated remaining: 3h 46m 2s. Rate: 7.6 symbols/min [2025-09-19T18:27:23.573432] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:23.639177] [DEBUG] [LOCAL ] DUK: Loaded 53863 existing records from primary storage. [2025-09-19T18:27:23.639375] [INFO ] [MAIN ] DUK: Loaded 53863 existing records. [2025-09-19T18:27:23.843287] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-19T18:27:23.877982] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:23.878279] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-19T18:27:23.878352] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-19T18:27:23.880561] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-19T18:27:23.880635] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-19T18:27:24.241791] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:24.322997] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T18:27:24.643311] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-19T18:27:24.872800] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:27:25.092363] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-19T18:27:25.443313] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-19T18:27:26.243286] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-19T18:27:27.043252] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-19T18:27:27.541504] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T18:27:27.843292] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-19T18:27:28.016121] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T18:27:28.330095] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T18:27:28.643269] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-19T18:27:29.377838] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T18:27:29.443299] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-19T18:27:29.855869] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T18:27:29.908910] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T18:27:30.243272] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-19T18:27:31.043302] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-19T18:27:31.843244] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-19T18:27:31.931974] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T18:27:32.020343] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T18:27:32.643299] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-19T18:27:32.688438] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T18:27:33.443308] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-19T18:27:34.187288] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T18:27:34.243236] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-19T18:27:34.685726] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T18:27:34.805511] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T18:27:35.043308] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-19T18:27:35.843277] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-19T18:27:36.643244] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-19T18:27:36.816910] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T18:27:36.875367] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T18:27:37.443311] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-19T18:27:38.243288] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-19T18:27:38.297510] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T18:27:38.299067] [INFO ] [REMOTE ] DTW: Full fetch complete (7870 records). [2025-09-19T18:27:38.299157] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-19T18:27:38.822464] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-19T18:27:38.822601] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-19T18:27:38.823083] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-19T18:27:38.823165] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-19T18:27:38.824185] [DEBUG] [LOCAL ] DTW: Trimmed 7870 records to 4977 (keeping 200 days of data) [2025-09-19T18:27:38.869204] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T18:27:38.885731] [DEBUG] [LOCAL ] DTW: Primary data saved (4977 records). [2025-09-19T18:27:38.887194] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-19T18:27:38.887383] [INFO ] [MAIN ] Update Progress: 662/2372 symbols completed. DTW took 21.0s. Estimated remaining: 3h 46m 13s. Rate: 7.6 symbols/min [2025-09-19T18:27:38.876631] [INFO ] [REMOTE ] DTG: Full fetch complete (9027 records). [2025-09-19T18:27:38.905480] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-19T18:27:39.053167] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-19T18:27:39.325875] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:39.515796] [DEBUG] [LOCAL ] DUKB: Loaded 6483 existing records from primary storage. [2025-09-19T18:27:39.526375] [INFO ] [MAIN ] DUKB: Loaded 6483 existing records. [2025-09-19T18:27:39.747374] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-19T18:27:39.751493] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-19T18:27:39.751819] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-19T18:27:39.757628] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-19T18:27:39.841160] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:39.842318] [DEBUG] [LOCAL ] DTG: Trimmed 9027 records to 5979 (keeping 200 days of data) [2025-09-19T18:27:39.842736] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-19T18:27:39.843107] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-19T18:27:39.843506] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-19T18:27:39.843570] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-19T18:27:39.998593] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (3.36 seconds). [2025-09-19T18:27:40.044943] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-19T18:27:40.079933] [DEBUG] [LOCAL ] DTG: Primary data saved (5979 records). [2025-09-19T18:27:40.100961] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-19T18:27:40.102034] [INFO ] [MAIN ] Update Progress: 663/2372 symbols completed. DTG took 39.6s. Estimated remaining: 3h 45m 48s. Rate: 7.6 symbols/min [2025-09-19T18:27:40.496431] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:40.490823] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:40.565419] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T18:27:40.590711] [DEBUG] [LOCAL ] DV: Loaded 51678 existing records from primary storage. [2025-09-19T18:27:40.590879] [INFO ] [MAIN ] DV: Loaded 51678 existing records. [2025-09-19T18:27:40.654249] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-19T18:27:40.782155] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:40.782411] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-19T18:27:40.782469] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-19T18:27:40.783982] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-19T18:27:40.784048] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-19T18:27:41.168720] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:41.338229] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-19T18:27:41.443283] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-19T18:27:42.243257] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-19T18:27:42.327145] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:27:42.455587] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-19T18:27:43.043267] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-19T18:27:43.778490] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:27:43.843268] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-19T18:27:44.321823] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T18:27:44.557817] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T18:27:44.643275] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-19T18:27:45.443301] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-19T18:27:46.243272] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-19T18:27:46.455808] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T18:27:46.828916] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-19T18:27:46.989387] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T18:27:47.043226] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-19T18:27:47.843283] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-19T18:27:48.643302] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-19T18:27:48.821237] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T18:27:48.855040] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T18:27:49.443288] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-19T18:27:50.243292] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-19T18:27:50.611406] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:27:51.043302] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-19T18:27:51.400762] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T18:27:51.408882] [INFO ] [REMOTE ] DTM: Full fetch complete (64947 records). [2025-09-19T18:27:51.409066] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-19T18:27:51.804750] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-19T18:27:51.804881] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-19T18:27:51.805683] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-19T18:27:51.805745] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-19T18:27:51.807107] [DEBUG] [LOCAL ] DTM: Trimmed 64947 records to 45355 (keeping 200 days of data) [2025-09-19T18:27:51.864511] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-19T18:27:52.096354] [DEBUG] [LOCAL ] DTM: Primary data saved (45355 records). [2025-09-19T18:27:52.096505] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-19T18:27:52.096733] [INFO ] [MAIN ] Update Progress: 664/2372 symbols completed. DTM took 41.4s. Estimated remaining: 3h 45m 50s. Rate: 7.6 symbols/min [2025-09-19T18:27:52.233066] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T18:27:52.313314] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:27:52.356707] [DEBUG] [LOCAL ] DVA: Loaded 42021 existing records from primary storage. [2025-09-19T18:27:52.356849] [INFO ] [MAIN ] DVA: Loaded 42021 existing records. [2025-09-19T18:27:52.532762] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:27:52.533027] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-19T18:27:52.533086] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-19T18:27:52.534077] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-19T18:27:52.534136] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-19T18:27:52.648406] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-19T18:27:52.897702] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:27:52.929589] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T18:27:52.962117] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T18:27:53.443273] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-19T18:27:54.187697] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T18:27:54.243217] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-19T18:27:55.043234] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-19T18:27:55.778874] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T18:27:55.843226] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-19T18:27:55.890777] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-19T18:27:56.242391] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:27:56.643278] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-19T18:27:57.443291] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-19T18:27:58.150002] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T18:27:58.243275] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-19T18:27:58.570698] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T18:27:58.628187] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-19T18:27:59.043279] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-19T18:27:59.107258] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:27:59.843276] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-19T18:27:59.946175] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T18:27:59.947849] [INFO ] [REMOTE ] DUKB: Full fetch complete (9596 records). [2025-09-19T18:27:59.947926] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-19T18:28:00.329824] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-19T18:28:00.329924] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-19T18:28:00.330392] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-19T18:28:00.330453] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-19T18:28:00.331820] [DEBUG] [LOCAL ] DUKB: Trimmed 9596 records to 6504 (keeping 200 days of data) [2025-09-19T18:28:00.372382] [DEBUG] [LOCAL ] DUKB: Primary data saved (6504 records). [2025-09-19T18:28:00.372484] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-19T18:28:00.372587] [INFO ] [MAIN ] Update Progress: 665/2372 symbols completed. DUKB took 21.5s. Estimated remaining: 3h 45m 43s. Rate: 7.6 symbols/min [2025-09-19T18:28:00.569239] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:00.629179] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-09-19T18:28:00.629337] [INFO ] [MAIN ] DVN: Loaded 54089 existing records. [2025-09-19T18:28:00.651119] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-19T18:28:00.820512] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:00.820840] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-19T18:28:00.820892] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-19T18:28:00.822308] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-19T18:28:00.822372] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-19T18:28:01.206946] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:01.443296] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-19T18:28:01.950783] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T18:28:02.243269] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-19T18:28:02.725403] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T18:28:03.043261] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-19T18:28:03.178584] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-19T18:28:03.186727] [INFO ] [REMOTE ] DUK: Full fetch complete (77405 records). [2025-09-19T18:28:03.186882] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-19T18:28:03.583301] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-19T18:28:03.583393] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-19T18:28:03.584394] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-19T18:28:03.584465] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-19T18:28:03.586227] [DEBUG] [LOCAL ] DUK: Trimmed 77405 records to 54250 (keeping 200 days of data) [2025-09-19T18:28:03.856877] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T18:28:03.853723] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-19T18:28:03.998430] [DEBUG] [LOCAL ] DUK: Primary data saved (54250 records). [2025-09-19T18:28:03.998614] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-19T18:28:03.998772] [INFO ] [MAIN ] Update Progress: 666/2372 symbols completed. DUK took 40.6s. Estimated remaining: 3h 45m 24s. Rate: 7.6 symbols/min [2025-09-19T18:28:04.181398] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:04.239404] [DEBUG] [LOCAL ] DX: Loaded 52855 existing records from primary storage. [2025-09-19T18:28:04.239568] [INFO ] [MAIN ] DX: Loaded 52855 existing records. [2025-09-19T18:28:04.430182] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:04.430428] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-19T18:28:04.430476] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-19T18:28:04.431580] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-19T18:28:04.431680] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-19T18:28:04.661504] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-19T18:28:04.823076] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:05.352966] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T18:28:05.443222] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-19T18:28:05.683794] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-19T18:28:06.176033] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T18:28:06.243238] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-19T18:28:06.861625] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T18:28:07.043306] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-19T18:28:07.843243] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-19T18:28:07.876723] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:28:07.884698] [INFO ] [REMOTE ] DV: Full fetch complete (73182 records). [2025-09-19T18:28:07.884830] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-19T18:28:08.322149] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-19T18:28:08.322287] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-19T18:28:08.323189] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-19T18:28:08.323255] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-19T18:28:08.324872] [DEBUG] [LOCAL ] DV: Trimmed 73182 records to 52057 (keeping 200 days of data) [2025-09-19T18:28:08.644180] [DEBUG] [LOCAL ] DV: Primary data saved (52057 records). [2025-09-19T18:28:08.644354] [INFO ] [MAIN ] DV: Full history saved. [2025-09-19T18:28:08.644554] [INFO ] [MAIN ] Update Progress: 667/2372 symbols completed. DV took 28.5s. Estimated remaining: 3h 45m 8s. Rate: 7.6 symbols/min [2025-09-19T18:28:08.644045] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-19T18:28:08.825931] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:08.918336] [DEBUG] [LOCAL ] DXC: Loaded 49827 existing records from primary storage. [2025-09-19T18:28:08.917262] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:28:08.930992] [INFO ] [MAIN ] DXC: Loaded 49827 existing records. [2025-09-19T18:28:09.118537] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:09.118866] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-19T18:28:09.118923] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-19T18:28:09.120042] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-19T18:28:09.120106] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-19T18:28:09.448351] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-19T18:28:09.486957] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:09.838964] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:28:10.243236] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-19T18:28:10.295525] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T18:28:11.043263] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-19T18:28:11.219728] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:28:11.843276] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-19T18:28:11.879580] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T18:28:12.380169] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T18:28:12.643267] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-19T18:28:13.443326] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-19T18:28:13.586857] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T18:28:13.731162] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:28:14.243307] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-19T18:28:15.043303] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-19T18:28:15.450852] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T18:28:15.843269] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-19T18:28:16.115242] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:28:16.643287] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-19T18:28:17.443254] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-19T18:28:17.593269] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-19T18:28:17.709994] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T18:28:17.819466] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T18:28:18.243263] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-19T18:28:19.043325] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-19T18:28:19.190330] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T18:28:19.843317] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-19T18:28:20.376563] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T18:28:20.643330] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-19T18:28:20.998849] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-19T18:28:21.443324] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-19T18:28:21.781822] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T18:28:21.885122] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T18:28:22.243336] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-19T18:28:23.043291] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-19T18:28:23.153581] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T18:28:23.843321] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-19T18:28:24.251085] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T18:28:24.315426] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:28:24.321952] [INFO ] [REMOTE ] DVA: Full fetch complete (59737 records). [2025-09-19T18:28:24.322136] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-19T18:28:24.655448] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-19T18:28:24.715414] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-19T18:28:24.715522] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-19T18:28:24.716421] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-19T18:28:24.716493] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-19T18:28:24.717982] [DEBUG] [LOCAL ] DVA: Trimmed 59737 records to 42344 (keeping 200 days of data) [2025-09-19T18:28:24.973845] [DEBUG] [LOCAL ] DVA: Primary data saved (42344 records). [2025-09-19T18:28:24.973984] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-19T18:28:24.974072] [INFO ] [MAIN ] Update Progress: 668/2372 symbols completed. DVA took 32.9s. Estimated remaining: 3h 45m 22s. Rate: 7.6 symbols/min [2025-09-19T18:28:25.144707] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:25.180861] [DEBUG] [LOCAL ] DXYZ: Loaded 37029 existing records from primary storage. [2025-09-19T18:28:25.181016] [INFO ] [MAIN ] DXYZ: Loaded 37029 existing records. [2025-09-19T18:28:25.361218] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:25.361511] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-19T18:28:25.361561] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-19T18:28:25.362475] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-19T18:28:25.362537] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-19T18:28:25.451369] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-19T18:28:25.717249] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:26.248919] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-19T18:28:26.268811] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-19T18:28:26.609600] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T18:28:26.813638] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T18:28:27.043259] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-19T18:28:27.843298] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-19T18:28:28.654451] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-19T18:28:28.660308] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T18:28:29.147954] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-19T18:28:29.443311] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-19T18:28:30.250598] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-19T18:28:30.257438] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T18:28:30.658495] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T18:28:30.886217] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T18:28:31.043271] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-19T18:28:31.843341] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-19T18:28:32.169716] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T18:28:32.434401] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T18:28:32.643351] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-19T18:28:33.434005] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:28:33.449360] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-19T18:28:34.243318] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-19T18:28:34.875228] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T18:28:34.883840] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-19T18:28:34.884051] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-19T18:28:35.052390] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-19T18:28:35.295890] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-19T18:28:35.295974] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-19T18:28:35.296880] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-19T18:28:35.296958] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-19T18:28:35.298483] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54479 (keeping 200 days of data) [2025-09-19T18:28:35.548792] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T18:28:35.678248] [DEBUG] [LOCAL ] DVN: Primary data saved (54479 records). [2025-09-19T18:28:35.678396] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-19T18:28:35.678484] [INFO ] [MAIN ] Update Progress: 669/2372 symbols completed. DVN took 35.3s. Estimated remaining: 3h 45m 21s. Rate: 7.6 symbols/min [2025-09-19T18:28:35.848387] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-19T18:28:35.850496] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:35.851679] [DEBUG] [LOCAL ] DY: No existing data file found in primary storage. [2025-09-19T18:28:35.851741] [WARN ] [MAIN ] DY: No existing data found, performing full refresh instead. [2025-09-19T18:28:35.851932] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-19T18:28:35.851985] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-19T18:28:35.852028] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-09-19T18:28:35.852076] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-19T18:28:36.214560] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:36.384482] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T18:28:36.576325] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T18:28:36.643217] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-19T18:28:37.443262] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-19T18:28:37.537616] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T18:28:38.243259] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-19T18:28:38.662886] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T18:28:38.670446] [INFO ] [REMOTE ] DXC: Full fetch complete (68372 records). [2025-09-19T18:28:38.670596] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-19T18:28:39.047499] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-19T18:28:39.070063] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-19T18:28:39.070201] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-19T18:28:39.071169] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-19T18:28:39.071244] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-19T18:28:39.076843] [DEBUG] [LOCAL ] DXC: Trimmed 68372 records to 50193 (keeping 200 days of data) [2025-09-19T18:28:39.371082] [DEBUG] [LOCAL ] DXC: Primary data saved (50193 records). [2025-09-19T18:28:39.371217] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-19T18:28:39.373676] [INFO ] [MAIN ] Update Progress: 670/2372 symbols completed. DXC took 30.7s. Estimated remaining: 3h 45m 2s. Rate: 7.6 symbols/min [2025-09-19T18:28:39.546447] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:39.584124] [DEBUG] [LOCAL ] E: Loaded 33908 existing records from primary storage. [2025-09-19T18:28:39.584270] [INFO ] [MAIN ] E: Loaded 33908 existing records. [2025-09-19T18:28:39.769326] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:39.770062] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-19T18:28:39.770200] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-19T18:28:39.771090] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-19T18:28:39.771151] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-19T18:28:39.951255] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-19T18:28:40.065137] [INFO ] [REMOTE ] DX: Full fetch complete (75234 records). [2025-09-19T18:28:40.096222] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-19T18:28:40.275749] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:40.286957] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-19T18:28:40.554149] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T18:28:40.622256] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-19T18:28:40.622341] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-19T18:28:40.626462] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-19T18:28:40.626781] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-19T18:28:40.643264] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-19T18:28:40.654997] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T18:28:40.662889] [DEBUG] [LOCAL ] DX: Trimmed 75234 records to 53245 (keeping 200 days of data) [2025-09-19T18:28:41.007412] [DEBUG] [LOCAL ] DX: Primary data saved (53245 records). [2025-09-19T18:28:41.007572] [INFO ] [MAIN ] DX: Full history saved. [2025-09-19T18:28:41.007726] [INFO ] [MAIN ] Update Progress: 671/2372 symbols completed. DX took 37.0s. Estimated remaining: 3h 44m 38s. Rate: 7.6 symbols/min [2025-09-19T18:28:41.204959] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:41.250504] [DEBUG] [LOCAL ] EAF: Loaded 44503 existing records from primary storage. [2025-09-19T18:28:41.250672] [INFO ] [MAIN ] EAF: Loaded 44503 existing records. [2025-09-19T18:28:41.448434] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-19T18:28:41.457872] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:41.459693] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-19T18:28:41.459784] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-19T18:28:41.460999] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-19T18:28:41.461108] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-19T18:28:41.840971] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:42.164633] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T18:28:42.243268] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-19T18:28:42.872904] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T18:28:43.043269] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-19T18:28:43.114909] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:28:43.241468] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:28:43.843271] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-19T18:28:44.643245] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-19T18:28:45.110416] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T18:28:45.188994] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-19T18:28:45.443283] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-19T18:28:45.629248] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T18:28:46.243309] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-19T18:28:47.043275] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-19T18:28:47.471152] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T18:28:47.843262] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-19T18:28:48.024329] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:28:48.643283] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-19T18:28:48.843067] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T18:28:49.443275] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-19T18:28:49.799524] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T18:28:50.243302] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-19T18:28:50.373193] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:28:50.681008] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T18:28:51.043281] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-19T18:28:51.843266] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-19T18:28:52.108402] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:28:52.643271] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-19T18:28:52.875276] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T18:28:53.091296] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T18:28:53.096792] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58333 records). [2025-09-19T18:28:53.096925] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-19T18:28:53.451550] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-19T18:28:53.509373] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-19T18:28:53.509479] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-19T18:28:53.510350] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-19T18:28:53.510415] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-19T18:28:53.514794] [DEBUG] [LOCAL ] DXYZ: Trimmed 58333 records to 37323 (keeping 200 days of data) [2025-09-19T18:28:53.747544] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37323 records). [2025-09-19T18:28:53.747746] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-19T18:28:53.747897] [INFO ] [MAIN ] Update Progress: 672/2372 symbols completed. DXYZ took 28.8s. Estimated remaining: 3h 44m 42s. Rate: 7.6 symbols/min [2025-09-19T18:28:53.926418] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:28:53.935739] [DEBUG] [LOCAL ] EAI: Loaded 4051 existing records from primary storage. [2025-09-19T18:28:53.935853] [INFO ] [MAIN ] EAI: Loaded 4051 existing records. [2025-09-19T18:28:54.123050] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:28:54.123786] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-19T18:28:54.123900] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-19T18:28:54.124605] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-19T18:28:54.124835] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-19T18:28:54.248226] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-19T18:28:54.415388] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:28:54.573154] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:28:55.043293] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-19T18:28:55.433636] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:28:55.843279] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-19T18:28:55.900413] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:28:56.290660] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T18:28:56.643286] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-19T18:28:57.443291] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-19T18:28:57.470033] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T18:28:57.959478] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T18:28:58.243270] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-19T18:28:59.043285] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-19T18:28:59.449936] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T18:28:59.843271] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-19T18:29:00.153921] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T18:29:00.643327] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-19T18:29:00.755953] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T18:29:01.443286] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-19T18:29:01.864932] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T18:29:02.243278] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-19T18:29:02.402780] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T18:29:02.407288] [INFO ] [REMOTE ] DY: Full fetch complete (44944 records). [2025-09-19T18:29:02.407391] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-19T18:29:02.787946] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-19T18:29:02.788165] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-19T18:29:02.788986] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-19T18:29:02.789077] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-19T18:29:02.790518] [DEBUG] [LOCAL ] DY: Trimmed 44944 records to 30563 (keeping 200 days of data) [2025-09-19T18:29:02.815618] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T18:29:03.014251] [DEBUG] [LOCAL ] DY: Primary data saved (30563 records). [2025-09-19T18:29:03.014393] [INFO ] [MAIN ] DY: Full history saved. [2025-09-19T18:29:03.014507] [INFO ] [MAIN ] Update Progress: 673/2372 symbols completed. DY took 27.3s. Estimated remaining: 3h 44m 38s. Rate: 7.6 symbols/min [2025-09-19T18:29:03.047236] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-19T18:29:03.200251] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:03.196924] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T18:29:03.235417] [DEBUG] [LOCAL ] EARN: Loaded 30975 existing records from primary storage. [2025-09-19T18:29:03.235556] [INFO ] [MAIN ] EARN: Loaded 30975 existing records. [2025-09-19T18:29:03.421448] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:03.421763] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-19T18:29:03.421819] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-19T18:29:03.422630] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-19T18:29:03.422722] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-19T18:29:03.783252] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:03.843212] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-19T18:29:04.643271] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-19T18:29:04.669263] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:29:05.244289] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T18:29:05.355768] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T18:29:05.443261] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-19T18:29:06.243259] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-19T18:29:06.685589] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T18:29:06.694005] [INFO ] [REMOTE ] E: Full fetch complete (48602 records). [2025-09-19T18:29:06.694205] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-19T18:29:07.048362] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-19T18:29:07.118428] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-19T18:29:07.118683] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-19T18:29:07.119373] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-19T18:29:07.119496] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-19T18:29:07.120550] [DEBUG] [LOCAL ] E: Trimmed 48602 records to 34114 (keeping 200 days of data) [2025-09-19T18:29:07.352744] [DEBUG] [LOCAL ] E: Primary data saved (34114 records). [2025-09-19T18:29:07.352927] [INFO ] [MAIN ] E: Full history saved. [2025-09-19T18:29:07.353759] [INFO ] [MAIN ] Update Progress: 674/2372 symbols completed. E took 28.0s. Estimated remaining: 3h 44m 21s. Rate: 7.6 symbols/min [2025-09-19T18:29:07.537695] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:07.600058] [DEBUG] [LOCAL ] EAT: Loaded 50215 existing records from primary storage. [2025-09-19T18:29:07.600214] [INFO ] [MAIN ] EAT: Loaded 50215 existing records. [2025-09-19T18:29:07.799887] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:07.805685] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-19T18:29:07.806673] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T18:29:07.806807] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-19T18:29:07.810292] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-19T18:29:07.810381] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-19T18:29:07.849242] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-19T18:29:08.173371] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T18:29:08.223740] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:08.643268] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-19T18:29:08.707390] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:29:09.443280] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-19T18:29:10.243269] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-19T18:29:10.645011] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T18:29:10.697319] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-19T18:29:11.043310] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-19T18:29:11.371191] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T18:29:11.843296] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-19T18:29:12.643268] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-19T18:29:12.800569] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T18:29:13.289133] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:29:13.443272] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-19T18:29:14.165420] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T18:29:14.243320] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-19T18:29:15.043278] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-19T18:29:15.355106] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:29:15.843264] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-19T18:29:16.213107] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T18:29:16.505074] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:29:16.505329] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-19T18:29:16.643302] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-19T18:29:17.443269] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-19T18:29:17.979685] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T18:29:18.243269] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-19T18:29:19.043265] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-19T18:29:19.399151] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T18:29:19.491893] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T18:29:19.783679] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T18:29:19.843270] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-19T18:29:20.643296] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-19T18:29:20.975760] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T18:29:21.443260] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-19T18:29:21.957271] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T18:29:21.961946] [INFO ] [REMOTE ] EAF: Full fetch complete (64953 records). [2025-09-19T18:29:21.962096] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-19T18:29:21.963054] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:29:21.963168] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:29:21.963212] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:29:21.963278] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-19T18:29:21.963348] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-19T18:29:21.963385] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-09-19T18:29:21.963819] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-09-19T18:29:21.963939] [INFO ] [MAIN ] Update Progress: 675/2372 symbols completed. EAF took 41.0s. Estimated remaining: 3h 44m 30s. Rate: 7.6 symbols/min [2025-09-19T18:29:22.137021] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:22.178897] [DEBUG] [LOCAL ] EB: Loaded 38499 existing records from primary storage. [2025-09-19T18:29:22.179038] [INFO ] [MAIN ] EB: Loaded 38499 existing records. [2025-09-19T18:29:22.243972] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-19T18:29:22.303429] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T18:29:22.403544] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:22.403934] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-19T18:29:22.404029] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-19T18:29:22.405188] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-19T18:29:22.405252] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-19T18:29:22.796790] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:23.043276] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-19T18:29:23.691158] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T18:29:23.719866] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T18:29:23.843266] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-19T18:29:24.643568] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-19T18:29:24.814403] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T18:29:24.816207] [INFO ] [REMOTE ] EAI: Full fetch complete (6185 records). [2025-09-19T18:29:24.816303] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-19T18:29:25.331542] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-19T18:29:25.331674] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-19T18:29:25.331930] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-19T18:29:25.332005] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-19T18:29:25.332735] [DEBUG] [LOCAL ] EAI: Trimmed 6185 records to 4060 (keeping 200 days of data) [2025-09-19T18:29:25.363535] [DEBUG] [LOCAL ] EAI: Primary data saved (4060 records). [2025-09-19T18:29:25.363749] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-19T18:29:25.363866] [INFO ] [MAIN ] Update Progress: 676/2372 symbols completed. EAI took 31.6s. Estimated remaining: 3h 44m 10s. Rate: 7.6 symbols/min [2025-09-19T18:29:25.448477] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-19T18:29:25.543486] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:25.563812] [DEBUG] [LOCAL ] EBF: Loaded 19811 existing records from primary storage. [2025-09-19T18:29:25.563984] [INFO ] [MAIN ] EBF: Loaded 19811 existing records. [2025-09-19T18:29:25.744608] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:25.744887] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-19T18:29:25.744955] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-19T18:29:25.745525] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-19T18:29:25.745585] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-19T18:29:26.071562] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T18:29:26.130260] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:26.243221] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-19T18:29:27.043264] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-19T18:29:27.471006] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T18:29:27.843276] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-19T18:29:28.129357] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-19T18:29:28.621401] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T18:29:28.643214] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-19T18:29:28.962088] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:29:29.443268] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-19T18:29:29.820415] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T18:29:30.243304] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-19T18:29:30.612917] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:29:31.043300] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-19T18:29:31.536513] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T18:29:31.540215] [INFO ] [REMOTE ] EARN: Full fetch complete (46689 records). [2025-09-19T18:29:31.540313] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-19T18:29:31.541005] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:29:31.541098] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:29:31.541161] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:29:31.541200] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-19T18:29:31.541259] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-19T18:29:31.541296] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-09-19T18:29:31.541729] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-09-19T18:29:31.541828] [INFO ] [MAIN ] Update Progress: 677/2372 symbols completed. EARN took 28.5s. Estimated remaining: 3h 43m 58s. Rate: 7.6 symbols/min [2025-09-19T18:29:31.843267] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-19T18:29:32.216304] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:29:32.643275] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-19T18:29:33.443269] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-19T18:29:33.840347] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T18:29:34.243241] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-19T18:29:34.422210] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T18:29:34.778007] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T18:29:35.043282] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-19T18:29:35.843247] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-19T18:29:35.940728] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T18:29:36.111493] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:29:36.643270] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-19T18:29:37.362965] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T18:29:37.443228] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-19T18:29:38.243277] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-19T18:29:38.354116] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T18:29:39.043264] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-19T18:29:39.284277] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T18:29:39.843283] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-19T18:29:40.299205] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:29:40.563116] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T18:29:40.643220] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-19T18:29:40.909789] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T18:29:41.443261] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-19T18:29:42.251173] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-19T18:29:42.253922] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T18:29:42.329376] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T18:29:43.043269] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-19T18:29:43.843291] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-19T18:29:44.060691] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T18:29:44.513432] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T18:29:44.643296] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-19T18:29:45.261849] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T18:29:45.269277] [INFO ] [REMOTE ] EAT: Full fetch complete (71714 records). [2025-09-19T18:29:45.269459] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-19T18:29:45.443314] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-19T18:29:45.589603] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T18:29:45.609740] [INFO ] [REMOTE ] EBF: Full fetch complete (27283 records). [2025-09-19T18:29:45.620088] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-19T18:29:45.807448] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-19T18:29:45.807833] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-19T18:29:45.808814] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-19T18:29:45.814264] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-19T18:29:45.869385] [DEBUG] [LOCAL ] EAT: Trimmed 71714 records to 50594 (keeping 200 days of data) [2025-09-19T18:29:46.194063] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-19T18:29:46.200177] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-19T18:29:46.204672] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-19T18:29:46.207224] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-19T18:29:46.215792] [DEBUG] [LOCAL ] EBF: Trimmed 27283 records to 19927 (keeping 200 days of data) [2025-09-19T18:29:46.529846] [DEBUG] [LOCAL ] EAT: Primary data saved (50594 records). [2025-09-19T18:29:46.530521] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-19T18:29:46.533187] [INFO ] [MAIN ] Update Progress: 678/2372 symbols completed. EAT took 39.2s. Estimated remaining: 3h 44m 8s. Rate: 7.6 symbols/min [2025-09-19T18:29:46.533315] [DEBUG] [LOCAL ] EBF: Primary data saved (19927 records). [2025-09-19T18:29:46.533540] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-19T18:29:46.533617] [INFO ] [MAIN ] Update Progress: 679/2372 symbols completed. EBF took 21.2s. Estimated remaining: 3h 43m 40s. Rate: 7.6 symbols/min [2025-09-19T18:29:47.176634] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:29:47.185142] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-19T18:29:48.717732] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:29:48.722899] [INFO ] [REMOTE ] EB: Full fetch complete (57239 records). [2025-09-19T18:29:48.723013] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-19T18:29:49.113950] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-19T18:29:49.114035] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-19T18:29:49.114938] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-19T18:29:49.115005] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-19T18:29:49.116277] [DEBUG] [LOCAL ] EB: Trimmed 57239 records to 38768 (keeping 200 days of data) [2025-09-19T18:29:49.334032] [DEBUG] [LOCAL ] EB: Primary data saved (38768 records). [2025-09-19T18:29:49.334214] [INFO ] [MAIN ] EB: Full history saved. [2025-09-19T18:29:49.334312] [INFO ] [MAIN ] Update Progress: 680/2372 symbols completed. EB took 27.4s. Estimated remaining: 3h 43m 19s. Rate: 7.6 symbols/min [2025-09-19T18:29:50.002288] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:49.994103] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:50.019593] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:50.031173] [DEBUG] [LOCAL ] EBR: No existing data file found in primary storage. [2025-09-19T18:29:50.053450] [WARN ] [MAIN ] EBR: No existing data found, performing full refresh instead. [2025-09-19T18:29:50.084293] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:29:50.085252] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-19T18:29:50.085378] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-19T18:29:50.085447] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-19T18:29:50.085484] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-19T18:29:50.406278] [DEBUG] [LOCAL ] ECAT: Loaded 30165 existing records from primary storage. [2025-09-19T18:29:50.424512] [INFO ] [MAIN ] ECAT: Loaded 30165 existing records. [2025-09-19T18:29:50.503775] [DEBUG] [LOCAL ] EBS: Loaded 47331 existing records from primary storage. [2025-09-19T18:29:50.544314] [DEBUG] [LOCAL ] EC: Loaded 49826 existing records from primary storage. [2025-09-19T18:29:50.543536] [INFO ] [MAIN ] EBS: Loaded 47331 existing records. [2025-09-19T18:29:50.592670] [INFO ] [MAIN ] EC: Loaded 49826 existing records. [2025-09-19T18:29:50.681500] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:50.764403] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-19T18:29:51.012881] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:51.047682] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:51.081398] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-19T18:29:51.081339] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-19T18:29:51.081500] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-19T18:29:51.103218] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-19T18:29:51.119705] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-19T18:29:51.125440] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-19T18:29:51.136939] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-19T18:29:51.125580] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:29:51.152042] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-19T18:29:51.183281] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-19T18:29:51.212543] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-19T18:29:51.249638] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-19T18:29:51.275478] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-19T18:29:52.143878] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:52.176565] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-19T18:29:52.274986] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:52.282843] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-19T18:29:52.361530] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:29:52.362132] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-19T18:29:52.949817] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T18:29:52.960601] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-19T18:29:53.875435] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T18:29:53.881388] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-19T18:29:53.970293] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:29:53.983727] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-19T18:29:54.020393] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T18:29:54.030465] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-19T18:29:54.762138] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T18:29:54.772979] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-19T18:29:54.792207] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T18:29:54.802324] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-19T18:29:55.415859] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T18:29:55.426664] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-19T18:29:55.876014] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T18:29:55.885489] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-19T18:29:55.990546] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T18:29:56.316558] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T18:29:56.643263] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-19T18:29:57.242773] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:29:57.443270] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-19T18:29:57.615075] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T18:29:58.243273] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-19T18:29:58.411794] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:29:59.043285] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-19T18:29:59.338578] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:29:59.843275] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-19T18:29:59.877504] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:30:00.411637] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T18:30:00.643282] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-19T18:30:01.443307] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-19T18:30:01.518030] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T18:30:02.243254] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-19T18:30:02.736579] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T18:30:03.043296] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-19T18:30:03.843303] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-19T18:30:04.658446] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (3.22 seconds). [2025-09-19T18:30:04.668534] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-19T18:30:05.762225] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (3.52 seconds). [2025-09-19T18:30:05.772992] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-19T18:30:06.573716] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-19T18:30:06.584013] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-19T18:30:06.693072] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (3.65 seconds). [2025-09-19T18:30:06.736961] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T18:30:07.043269] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-19T18:30:07.843295] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-19T18:30:07.885049] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T18:30:07.939899] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T18:30:08.643273] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-19T18:30:08.910273] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:30:08.978244] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T18:30:09.443299] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-19T18:30:10.243277] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-19T18:30:10.739027] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:30:11.043316] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-19T18:30:11.237762] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T18:30:11.843269] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-19T18:30:12.000432] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T18:30:12.529868] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T18:30:12.643272] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-19T18:30:13.443302] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-19T18:30:13.756803] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T18:30:14.243273] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-19T18:30:14.274754] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T18:30:15.043285] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-19T18:30:15.843291] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-19T18:30:16.307429] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-19T18:30:16.643314] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-19T18:30:16.974187] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-19T18:30:17.125174] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T18:30:17.443313] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-19T18:30:17.969727] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T18:30:17.974932] [INFO ] [REMOTE ] ECAT: Full fetch complete (42241 records). [2025-09-19T18:30:17.975074] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-19T18:30:17.975923] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:30:17.976028] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:17.976072] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:17.976137] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-19T18:30:17.976216] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-19T18:30:17.976272] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-09-19T18:30:17.976733] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-09-19T18:30:17.976834] [INFO ] [MAIN ] Update Progress: 681/2372 symbols completed. ECAT took 28.6s. Estimated remaining: 3h 44m 3s. Rate: 7.5 symbols/min [2025-09-19T18:30:18.158860] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:18.208457] [DEBUG] [LOCAL ] ECC: Loaded 43720 existing records from primary storage. [2025-09-19T18:30:18.208613] [INFO ] [MAIN ] ECC: Loaded 43720 existing records. [2025-09-19T18:30:18.243553] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-19T18:30:18.406107] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:30:18.423838] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-19T18:30:18.423994] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-19T18:30:18.425455] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-19T18:30:18.425383] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T18:30:18.425697] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-19T18:30:18.511728] [INFO ] [REMOTE ] EBR: Full fetch complete (62487 records). [2025-09-19T18:30:18.523222] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-19T18:30:18.547485] [FATAL] [VALIDATOR ] EBR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:30:18.563369] [FATAL] [MAIN ] EBR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:18.573741] [WARN ] [MAIN ] EBR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:18.588503] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-19T18:30:18.609589] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-09-19T18:30:18.611347] [INFO ] [LOCAL ] EBR: Starting deletion of derivative data. [2025-09-19T18:30:18.625746] [DEBUG] [LOCAL ] EBR: No derivative data file found to delete. [2025-09-19T18:30:18.669320] [INFO ] [MAIN ] Update Progress: 682/2372 symbols completed. EBR took 29.3s. Estimated remaining: 3h 43m 37s. Rate: 7.6 symbols/min [2025-09-19T18:30:18.934803] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:19.023628] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:19.023908] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-19T18:30:19.024012] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-19T18:30:19.024351] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-19T18:30:19.024515] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-19T18:30:19.024604] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-19T18:30:19.024824] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-19T18:30:19.052328] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-19T18:30:19.135416] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T18:30:19.173550] [INFO ] [REMOTE ] EC: Full fetch complete (71992 records). [2025-09-19T18:30:19.189170] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-19T18:30:19.615848] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:19.850189] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-19T18:30:19.875407] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-19T18:30:19.875530] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-19T18:30:19.876530] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-19T18:30:19.876601] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-19T18:30:19.878457] [DEBUG] [LOCAL ] EC: Trimmed 71992 records to 50191 (keeping 200 days of data) [2025-09-19T18:30:20.181091] [DEBUG] [LOCAL ] EC: Primary data saved (50191 records). [2025-09-19T18:30:20.181311] [INFO ] [MAIN ] EC: Full history saved. [2025-09-19T18:30:20.181689] [INFO ] [MAIN ] Update Progress: 683/2372 symbols completed. EC took 30.8s. Estimated remaining: 3h 43m 13s. Rate: 7.6 symbols/min [2025-09-19T18:30:20.356630] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:20.356981] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-19T18:30:20.357173] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-19T18:30:20.357425] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-19T18:30:20.357533] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-19T18:30:20.357616] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-19T18:30:20.357809] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-19T18:30:20.459522] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-19T18:30:20.510724] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T18:30:20.615054] [INFO ] [REMOTE ] EBS: Full fetch complete (67385 records). [2025-09-19T18:30:20.647485] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-19T18:30:20.641824] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-19T18:30:20.858794] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:21.138045] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T18:30:21.155929] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-19T18:30:21.156018] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-19T18:30:21.157110] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-19T18:30:21.157194] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-19T18:30:21.158864] [DEBUG] [LOCAL ] EBS: Trimmed 67385 records to 47661 (keeping 200 days of data) [2025-09-19T18:30:21.262402] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T18:30:21.452366] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-19T18:30:21.468568] [DEBUG] [LOCAL ] EBS: Primary data saved (47661 records). [2025-09-19T18:30:21.468818] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-19T18:30:21.468950] [INFO ] [MAIN ] Update Progress: 684/2372 symbols completed. EBS took 32.1s. Estimated remaining: 3h 42m 49s. Rate: 7.6 symbols/min [2025-09-19T18:30:21.699251] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:21.699458] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-19T18:30:21.699517] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-19T18:30:21.699705] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-19T18:30:21.699759] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-19T18:30:21.699803] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-19T18:30:21.699836] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-19T18:30:21.808551] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-19T18:30:22.082597] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:22.243314] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-19T18:30:23.043271] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-19T18:30:23.475128] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-19T18:30:23.539158] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:30:23.843304] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-19T18:30:24.298585] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-19T18:30:24.643281] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-19T18:30:24.944186] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-19T18:30:25.443268] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-19T18:30:26.243265] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-19T18:30:26.894417] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T18:30:27.043275] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-19T18:30:27.140370] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:30:27.398559] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-19T18:30:27.843284] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-19T18:30:28.221786] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T18:30:28.643306] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-19T18:30:29.343394] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T18:30:29.443266] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-19T18:30:30.243319] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-19T18:30:31.043288] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-19T18:30:31.130907] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T18:30:31.457576] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T18:30:31.537785] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T18:30:31.843295] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-19T18:30:32.643294] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-19T18:30:33.118444] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-19T18:30:33.443295] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-19T18:30:33.880536] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:30:34.217136] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T18:30:34.243288] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-19T18:30:34.713076] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T18:30:35.043317] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-19T18:30:35.522871] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-19T18:30:35.843313] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-19T18:30:36.643303] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-19T18:30:37.126857] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-19T18:30:37.443260] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-19T18:30:37.712967] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T18:30:37.906091] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-19T18:30:38.243271] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-19T18:30:39.043289] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-19T18:30:39.555497] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-19T18:30:39.853484] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-19T18:30:39.858911] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:30:40.245029] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T18:30:40.643261] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-19T18:30:41.443273] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-19T18:30:42.148252] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T18:30:42.243288] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-19T18:30:42.700799] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T18:30:42.771819] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-19T18:30:43.043269] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-19T18:30:43.578226] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T18:30:43.843260] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-19T18:30:44.159859] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-19T18:30:44.643293] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-19T18:30:45.443271] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-19T18:30:45.552514] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T18:30:45.553416] [INFO ] [REMOTE ] ECCU: Full fetch complete (4396 records). [2025-09-19T18:30:45.553488] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-19T18:30:45.553985] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:30:45.554081] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:45.554124] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:45.554167] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-19T18:30:45.554263] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-19T18:30:45.554318] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-19T18:30:45.554376] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-19T18:30:45.554452] [INFO ] [MAIN ] Update Progress: 685/2372 symbols completed. ECCU took 25.4s. Estimated remaining: 3h 43m 21s. Rate: 7.6 symbols/min [2025-09-19T18:30:45.723356] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:45.723546] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-19T18:30:45.723590] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-19T18:30:45.723754] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-19T18:30:45.723800] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-19T18:30:45.723841] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-19T18:30:45.723873] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-19T18:30:46.078807] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:46.110793] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T18:30:46.111659] [INFO ] [REMOTE ] ECCC: Full fetch complete (1286 records). [2025-09-19T18:30:46.111735] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-19T18:30:46.251221] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-19T18:30:46.293311] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-19T18:30:46.293500] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:46.293568] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:46.293661] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-19T18:30:46.293789] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-19T18:30:46.293847] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-19T18:30:46.293892] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-19T18:30:46.293949] [INFO ] [MAIN ] Update Progress: 686/2372 symbols completed. ECCC took 27.6s. Estimated remaining: 3h 42m 55s. Rate: 7.6 symbols/min [2025-09-19T18:30:46.478587] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:46.515064] [DEBUG] [LOCAL ] ECG: Loaded 34945 existing records from primary storage. [2025-09-19T18:30:46.515211] [INFO ] [MAIN ] ECG: Loaded 34945 existing records. [2025-09-19T18:30:46.698698] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:30:46.699047] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-19T18:30:46.699105] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-19T18:30:46.700364] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-19T18:30:46.700426] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-19T18:30:46.806095] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-19T18:30:47.049168] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-19T18:30:47.073295] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:47.843288] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-19T18:30:48.357534] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T18:30:48.643260] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-19T18:30:48.867772] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T18:30:48.985757] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-19T18:30:49.443297] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-19T18:30:50.243269] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-19T18:30:50.707772] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-19T18:30:51.043241] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-19T18:30:51.133984] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:30:51.341944] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-19T18:30:51.843274] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-19T18:30:52.266863] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-19T18:30:52.643263] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-19T18:30:53.443308] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-19T18:30:54.009104] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T18:30:54.243318] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-19T18:30:54.748001] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T18:30:54.750334] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T18:30:54.756758] [INFO ] [REMOTE ] ECC: Full fetch complete (61070 records). [2025-09-19T18:30:54.756924] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-19T18:30:55.048322] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-19T18:30:55.168913] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-19T18:30:55.169009] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-19T18:30:55.169857] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-19T18:30:55.169923] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-19T18:30:55.171297] [DEBUG] [LOCAL ] ECC: Trimmed 61070 records to 44039 (keeping 200 days of data) [2025-09-19T18:30:55.444515] [DEBUG] [LOCAL ] ECC: Primary data saved (44039 records). [2025-09-19T18:30:55.444668] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-19T18:30:55.444771] [INFO ] [MAIN ] Update Progress: 687/2372 symbols completed. ECC took 37.5s. Estimated remaining: 3h 42m 50s. Rate: 7.6 symbols/min [2025-09-19T18:30:55.618971] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:55.619153] [DEBUG] [LOCAL ] ECL: No existing data file found in primary storage. [2025-09-19T18:30:55.619209] [WARN ] [MAIN ] ECL: No existing data found, performing full refresh instead. [2025-09-19T18:30:55.619356] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-19T18:30:55.619400] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-19T18:30:55.619443] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-19T18:30:55.619475] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-19T18:30:55.850408] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-19T18:30:55.995878] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:56.353993] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T18:30:56.643255] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-19T18:30:57.056591] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T18:30:57.119947] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-19T18:30:57.443265] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-19T18:30:57.929058] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T18:30:57.929868] [INFO ] [REMOTE ] ECCW: Full fetch complete (1414 records). [2025-09-19T18:30:57.929938] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-19T18:30:58.107755] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-19T18:30:58.107943] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:30:58.108009] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:30:58.108081] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-19T18:30:58.108145] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-19T18:30:58.108180] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-19T18:30:58.108217] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-19T18:30:58.108274] [INFO ] [MAIN ] Update Progress: 688/2372 symbols completed. ECCW took 36.6s. Estimated remaining: 3h 42m 29s. Rate: 7.6 symbols/min [2025-09-19T18:30:58.251457] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-19T18:30:58.278008] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:30:58.296518] [DEBUG] [LOCAL ] ECO: Loaded 18799 existing records from primary storage. [2025-09-19T18:30:58.296827] [INFO ] [MAIN ] ECO: Loaded 18799 existing records. [2025-09-19T18:30:58.474158] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:30:58.474435] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-19T18:30:58.474482] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-19T18:30:58.475247] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-19T18:30:58.475336] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-19T18:30:58.830828] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:30:59.043293] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-19T18:30:59.843264] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-19T18:31:00.643280] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-19T18:31:01.940080] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T18:31:01.948693] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-19T18:31:03.540715] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (4.50 seconds). [2025-09-19T18:31:03.544030] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (5.29 seconds). [2025-09-19T18:31:03.549923] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-19T18:31:03.551378] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-19T18:31:03.787429] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T18:31:03.843234] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-19T18:31:03.976759] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-19T18:31:04.643264] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-19T18:31:05.173286] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T18:31:05.218638] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T18:31:05.219468] [INFO ] [REMOTE ] ECCX: Full fetch complete (1478 records). [2025-09-19T18:31:05.219537] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-19T18:31:05.462485] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-19T18:31:05.470244] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-19T18:31:05.472134] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:31:05.472354] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:31:05.472488] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-19T18:31:05.472702] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-19T18:31:05.472807] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-19T18:31:05.473058] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-19T18:31:05.473222] [INFO ] [MAIN ] Update Progress: 689/2372 symbols completed. ECCX took 19.9s. Estimated remaining: 3h 42m 20s. Rate: 7.6 symbols/min [2025-09-19T18:31:05.689160] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:05.691896] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T18:31:05.728824] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (5.09 seconds). [2025-09-19T18:31:05.774770] [DEBUG] [LOCAL ] ECVT: Loaded 43492 existing records from primary storage. [2025-09-19T18:31:05.774914] [INFO ] [MAIN ] ECVT: Loaded 43492 existing records. [2025-09-19T18:31:05.956725] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:05.957056] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-19T18:31:05.957141] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-19T18:31:05.958413] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-19T18:31:05.958478] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-19T18:31:06.243876] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-19T18:31:06.327950] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:06.715104] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T18:31:07.043259] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-19T18:31:07.843280] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-19T18:31:07.999143] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T18:31:08.352824] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:31:08.643297] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-19T18:31:09.406264] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:31:09.443249] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-19T18:31:10.243295] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-19T18:31:10.721006] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T18:31:11.043321] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-19T18:31:11.371719] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T18:31:11.601022] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:31:11.843296] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-19T18:31:12.643271] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-19T18:31:12.864019] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T18:31:13.443321] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-19T18:31:14.038735] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T18:31:14.197587] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T18:31:14.243231] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-19T18:31:14.850020] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T18:31:15.043283] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-19T18:31:15.843284] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-19T18:31:15.987273] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T18:31:16.077954] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T18:31:16.643300] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-19T18:31:17.409979] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T18:31:17.443276] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-19T18:31:17.843090] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:31:18.243306] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-19T18:31:18.440796] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:31:19.043325] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-19T18:31:19.257855] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T18:31:19.843241] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-19T18:31:20.286441] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T18:31:20.643317] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-19T18:31:21.443308] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-19T18:31:21.813615] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T18:31:21.822160] [INFO ] [REMOTE ] ECG: Full fetch complete (51746 records). [2025-09-19T18:31:21.822391] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-19T18:31:22.227621] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-19T18:31:22.227788] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-19T18:31:22.228987] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-19T18:31:22.229115] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-19T18:31:22.230733] [DEBUG] [LOCAL ] ECG: Trimmed 51746 records to 35132 (keeping 200 days of data) [2025-09-19T18:31:22.289128] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-19T18:31:22.372437] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T18:31:22.504761] [DEBUG] [LOCAL ] ECG: Primary data saved (35132 records). [2025-09-19T18:31:22.504917] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-19T18:31:22.505039] [INFO ] [MAIN ] Update Progress: 690/2372 symbols completed. ECG took 36.2s. Estimated remaining: 3h 42m 34s. Rate: 7.6 symbols/min [2025-09-19T18:31:22.676154] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:22.734293] [DEBUG] [LOCAL ] ED: Loaded 53213 existing records from primary storage. [2025-09-19T18:31:22.734468] [INFO ] [MAIN ] ED: Loaded 53213 existing records. [2025-09-19T18:31:22.916559] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:22.916828] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-19T18:31:22.916879] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-19T18:31:22.918887] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-19T18:31:22.918950] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-19T18:31:23.048474] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-19T18:31:23.299701] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:23.301145] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T18:31:23.305789] [INFO ] [REMOTE ] ECO: Full fetch complete (29567 records). [2025-09-19T18:31:23.305910] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-19T18:31:23.692958] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-19T18:31:23.693102] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-19T18:31:23.693751] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-19T18:31:23.693863] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-19T18:31:23.694931] [DEBUG] [LOCAL ] ECO: Trimmed 29567 records to 18901 (keeping 200 days of data) [2025-09-19T18:31:23.774373] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-19T18:31:23.847678] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-19T18:31:23.852848] [DEBUG] [LOCAL ] ECO: Primary data saved (18901 records). [2025-09-19T18:31:23.854001] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-19T18:31:23.854121] [INFO ] [MAIN ] Update Progress: 691/2372 symbols completed. ECO took 25.7s. Estimated remaining: 3h 42m 10s. Rate: 7.6 symbols/min [2025-09-19T18:31:24.041815] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:24.069484] [DEBUG] [LOCAL ] EDD: Loaded 27486 existing records from primary storage. [2025-09-19T18:31:24.069666] [INFO ] [MAIN ] EDD: Loaded 27486 existing records. [2025-09-19T18:31:24.253608] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:24.253962] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-19T18:31:24.254062] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-19T18:31:24.254768] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-19T18:31:24.254847] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-19T18:31:24.638752] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:24.643227] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-19T18:31:24.698681] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:31:25.443280] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-19T18:31:26.068419] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:31:26.243320] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-19T18:31:26.317711] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T18:31:27.043311] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-19T18:31:27.403073] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:31:27.843256] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-19T18:31:27.926556] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:31:28.174053] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T18:31:28.643362] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-19T18:31:29.198588] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T18:31:29.443247] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-19T18:31:29.867464] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:31:30.243286] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-19T18:31:31.043293] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-19T18:31:31.394206] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T18:31:31.458180] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T18:31:31.466226] [INFO ] [REMOTE ] ECL: Full fetch complete (67521 records). [2025-09-19T18:31:31.466396] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-19T18:31:31.851162] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-19T18:31:31.874333] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-19T18:31:31.874436] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-19T18:31:31.875315] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-19T18:31:31.875408] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-19T18:31:31.877483] [DEBUG] [LOCAL ] ECL: Trimmed 67521 records to 47444 (keeping 200 days of data) [2025-09-19T18:31:32.207717] [DEBUG] [LOCAL ] ECL: Primary data saved (47444 records). [2025-09-19T18:31:32.207958] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-19T18:31:32.208097] [INFO ] [MAIN ] Update Progress: 692/2372 symbols completed. ECL took 36.8s. Estimated remaining: 3h 42m 3s. Rate: 7.6 symbols/min [2025-09-19T18:31:32.390956] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:32.391175] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-09-19T18:31:32.391233] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-09-19T18:31:32.391433] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-19T18:31:32.391477] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-19T18:31:32.391530] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-09-19T18:31:32.391577] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-19T18:31:32.660752] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-19T18:31:32.831951] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:32.998685] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T18:31:33.443278] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-19T18:31:33.990181] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T18:31:34.243253] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-19T18:31:34.381797] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-19T18:31:34.959771] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T18:31:35.043216] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-19T18:31:35.171535] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T18:31:35.843258] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-19T18:31:35.920797] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:31:36.643274] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-19T18:31:37.429321] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T18:31:37.443224] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-19T18:31:37.508856] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T18:31:38.243289] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-19T18:31:38.797057] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T18:31:39.043306] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-19T18:31:39.843269] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-19T18:31:40.197474] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T18:31:40.507610] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T18:31:40.643297] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-19T18:31:41.075747] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:31:41.443283] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-19T18:31:41.892101] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T18:31:42.243286] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-19T18:31:42.314528] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T18:31:43.043265] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-19T18:31:43.843332] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-19T18:31:44.036567] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T18:31:44.043336] [INFO ] [REMOTE ] ECVT: Full fetch complete (59864 records). [2025-09-19T18:31:44.043456] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-19T18:31:44.438539] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-19T18:31:44.438687] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-19T18:31:44.439725] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-19T18:31:44.439821] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-19T18:31:44.454900] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:31:44.459583] [DEBUG] [LOCAL ] ECVT: Trimmed 59864 records to 43818 (keeping 200 days of data) [2025-09-19T18:31:44.460760] [INFO ] [REMOTE ] EDD: Full fetch complete (39270 records). [2025-09-19T18:31:44.460864] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-19T18:31:44.648085] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-19T18:31:44.723230] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T18:31:45.104576] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-19T18:31:45.104957] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-19T18:31:45.106051] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-19T18:31:45.106455] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-19T18:31:45.114445] [DEBUG] [LOCAL ] EDD: Trimmed 39270 records to 27679 (keeping 200 days of data) [2025-09-19T18:31:45.229537] [DEBUG] [LOCAL ] ECVT: Primary data saved (43818 records). [2025-09-19T18:31:45.230101] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-19T18:31:45.235675] [INFO ] [MAIN ] Update Progress: 693/2372 symbols completed. ECVT took 39.8s. Estimated remaining: 3h 42m 8s. Rate: 7.6 symbols/min [2025-09-19T18:31:45.418336] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:45.453186] [DEBUG] [LOCAL ] EDN: Loaded 17946 existing records from primary storage. [2025-09-19T18:31:45.449261] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-19T18:31:45.453950] [INFO ] [MAIN ] EDN: Loaded 17946 existing records. [2025-09-19T18:31:45.688306] [DEBUG] [LOCAL ] EDD: Primary data saved (27679 records). [2025-09-19T18:31:45.688573] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-19T18:31:45.688770] [INFO ] [MAIN ] Update Progress: 694/2372 symbols completed. EDD took 21.8s. Estimated remaining: 3h 41m 42s. Rate: 7.6 symbols/min [2025-09-19T18:31:45.688432] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:45.754083] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-19T18:31:45.765356] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-19T18:31:45.791639] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-19T18:31:45.791798] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-19T18:31:46.015631] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:46.265534] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:46.266185] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-19T18:31:46.297701] [DEBUG] [LOCAL ] EDU: Loaded 45632 existing records from primary storage. [2025-09-19T18:31:46.297864] [INFO ] [MAIN ] EDU: Loaded 45632 existing records. [2025-09-19T18:31:46.502510] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:46.512029] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-19T18:31:46.512102] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-19T18:31:46.519131] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-19T18:31:46.519273] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-19T18:31:46.587805] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T18:31:46.723606] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T18:31:46.906122] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:47.043249] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-19T18:31:47.438882] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T18:31:47.843275] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-19T18:31:48.643265] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-19T18:31:48.993059] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T18:31:49.443240] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-19T18:31:49.616440] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:31:49.869607] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T18:31:50.243268] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-19T18:31:51.043266] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-19T18:31:51.272063] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T18:31:51.843296] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-19T18:31:52.325712] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:31:52.347119] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T18:31:52.643269] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-19T18:31:53.443283] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-19T18:31:53.494721] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T18:31:53.616667] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:31:54.243275] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-19T18:31:54.639266] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:31:55.043288] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-19T18:31:55.843263] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-19T18:31:56.093422] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:31:56.428049] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:31:56.643267] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-19T18:31:56.729493] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T18:31:56.733342] [INFO ] [REMOTE ] EDF: Full fetch complete (21180 records). [2025-09-19T18:31:56.733480] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-19T18:31:57.104833] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-19T18:31:57.104912] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-19T18:31:57.105363] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-19T18:31:57.105425] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-19T18:31:57.106043] [DEBUG] [LOCAL ] EDF: Trimmed 21180 records to 13744 (keeping 200 days of data) [2025-09-19T18:31:57.184000] [DEBUG] [LOCAL ] EDF: Primary data saved (13744 records). [2025-09-19T18:31:57.184136] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-19T18:31:57.184226] [INFO ] [MAIN ] Update Progress: 695/2372 symbols completed. EDF took 25.0s. Estimated remaining: 3h 41m 42s. Rate: 7.6 symbols/min [2025-09-19T18:31:57.351817] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:31:57.392332] [DEBUG] [LOCAL ] EE: Loaded 32818 existing records from primary storage. [2025-09-19T18:31:57.392507] [INFO ] [MAIN ] EE: Loaded 32818 existing records. [2025-09-19T18:31:57.454320] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-19T18:31:57.573007] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:31:57.573456] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-19T18:31:57.573587] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-19T18:31:57.583600] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-19T18:31:57.584245] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-19T18:31:57.584599] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T18:31:57.936607] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:31:58.243234] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-19T18:31:59.043230] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-19T18:31:59.203723] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T18:31:59.790989] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T18:31:59.843247] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-19T18:31:59.966379] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T18:32:00.643263] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-19T18:32:01.421501] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T18:32:01.443223] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-19T18:32:01.794808] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T18:32:02.243268] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-19T18:32:02.640420] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T18:32:03.043270] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-19T18:32:03.843269] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-19T18:32:04.153340] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T18:32:04.177723] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:32:04.643256] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-19T18:32:05.438953] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-19T18:32:05.447245] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-19T18:32:05.812295] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T18:32:06.243251] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-19T18:32:07.043258] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-19T18:32:07.360807] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T18:32:07.604054] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:32:07.608060] [INFO ] [REMOTE ] EDN: Full fetch complete (30568 records). [2025-09-19T18:32:07.608141] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-19T18:32:07.855481] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-19T18:32:08.003254] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-19T18:32:08.003345] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-19T18:32:08.003951] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-19T18:32:08.004039] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-19T18:32:08.004826] [DEBUG] [LOCAL ] EDN: Trimmed 30568 records to 18158 (keeping 200 days of data) [2025-09-19T18:32:08.112453] [DEBUG] [LOCAL ] EDN: Primary data saved (18158 records). [2025-09-19T18:32:08.112603] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-19T18:32:08.112725] [INFO ] [MAIN ] Update Progress: 696/2372 symbols completed. EDN took 22.9s. Estimated remaining: 3h 41m 42s. Rate: 7.6 symbols/min [2025-09-19T18:32:08.285320] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:08.290159] [DEBUG] [LOCAL ] EEA: Loaded 2842 existing records from primary storage. [2025-09-19T18:32:08.290297] [INFO ] [MAIN ] EEA: Loaded 2842 existing records. [2025-09-19T18:32:08.491699] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:08.492070] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-19T18:32:08.492159] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-19T18:32:08.492456] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-19T18:32:08.492517] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-19T18:32:08.649724] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-19T18:32:08.871717] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:08.936171] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T18:32:09.443275] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-19T18:32:09.681395] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T18:32:09.770250] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:32:09.897604] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T18:32:10.243304] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-19T18:32:11.043291] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-19T18:32:11.426467] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T18:32:11.467391] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T18:32:11.843281] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-19T18:32:12.643306] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-19T18:32:13.173036] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T18:32:13.371359] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T18:32:13.443274] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-19T18:32:14.243327] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-19T18:32:14.638423] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T18:32:15.043327] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-19T18:32:15.448336] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-19T18:32:15.843306] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-19T18:32:16.021083] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T18:32:16.643305] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-19T18:32:17.443282] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-19T18:32:17.933837] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T18:32:17.941342] [INFO ] [REMOTE ] ED: Full fetch complete (75985 records). [2025-09-19T18:32:17.941481] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-19T18:32:17.942540] [FATAL] [VALIDATOR ] ED: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:32:17.942683] [FATAL] [MAIN ] ED: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:32:17.942757] [WARN ] [MAIN ] ED: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:32:17.942812] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-19T18:32:17.942876] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-09-19T18:32:17.942930] [INFO ] [LOCAL ] ED: Starting deletion of derivative data. [2025-09-19T18:32:17.943320] [DEBUG] [LOCAL ] ED: Deleted derivative data file. [2025-09-19T18:32:17.943467] [INFO ] [MAIN ] Update Progress: 697/2372 symbols completed. ED took 55.4s. Estimated remaining: 3h 41m 38s. Rate: 7.6 symbols/min [2025-09-19T18:32:18.120551] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:18.140724] [DEBUG] [LOCAL ] EEX: Loaded 12439 existing records from primary storage. [2025-09-19T18:32:18.140872] [INFO ] [MAIN ] EEX: Loaded 12439 existing records. [2025-09-19T18:32:18.251513] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T18:32:18.251164] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-19T18:32:18.369272] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:18.371935] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T18:32:18.372200] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-19T18:32:18.379284] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-19T18:32:18.380334] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-19T18:32:18.380402] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-19T18:32:18.733958] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:19.043273] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-19T18:32:19.819700] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:32:19.843243] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-19T18:32:20.468637] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T18:32:20.643323] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-19T18:32:21.443330] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-19T18:32:21.698924] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T18:32:21.709718] [INFO ] [REMOTE ] EDU: Full fetch complete (66304 records). [2025-09-19T18:32:21.709944] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-19T18:32:21.711104] [FATAL] [VALIDATOR ] EDU: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:32:21.711269] [FATAL] [MAIN ] EDU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:32:21.711333] [WARN ] [MAIN ] EDU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:32:21.711418] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-19T18:32:21.711511] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-09-19T18:32:21.711571] [INFO ] [LOCAL ] EDU: Starting deletion of derivative data. [2025-09-19T18:32:21.711977] [DEBUG] [LOCAL ] EDU: Deleted derivative data file. [2025-09-19T18:32:21.712111] [INFO ] [MAIN ] Update Progress: 698/2372 symbols completed. EDU took 36.0s. Estimated remaining: 3h 41m 20s. Rate: 7.6 symbols/min [2025-09-19T18:32:21.949279] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:22.008520] [DEBUG] [LOCAL ] EFC: Loaded 46603 existing records from primary storage. [2025-09-19T18:32:22.008709] [INFO ] [MAIN ] EFC: Loaded 46603 existing records. [2025-09-19T18:32:22.207357] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:22.207813] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-19T18:32:22.207992] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-19T18:32:22.209505] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-19T18:32:22.209585] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-19T18:32:22.253563] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-19T18:32:22.380596] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:32:22.624519] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:22.635848] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:32:23.000022] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T18:32:23.043311] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-19T18:32:23.534757] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-19T18:32:23.843271] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-19T18:32:24.643273] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-19T18:32:25.047690] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T18:32:25.443267] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-19T18:32:26.243263] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-19T18:32:26.545878] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T18:32:26.661362] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T18:32:26.841038] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T18:32:27.043266] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-19T18:32:27.843283] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-19T18:32:28.213044] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T18:32:28.643304] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-19T18:32:29.335971] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-19T18:32:29.337145] [INFO ] [REMOTE ] EEA: Full fetch complete (3985 records). [2025-09-19T18:32:29.337226] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-19T18:32:29.448439] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-19T18:32:29.467054] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:32:29.750894] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-19T18:32:29.750981] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-19T18:32:29.751112] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-19T18:32:29.751150] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-19T18:32:29.751524] [DEBUG] [LOCAL ] EEA: Trimmed 3985 records to 2853 (keeping 200 days of data) [2025-09-19T18:32:29.768758] [DEBUG] [LOCAL ] EEA: Primary data saved (2853 records). [2025-09-19T18:32:29.768876] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-19T18:32:29.768960] [INFO ] [MAIN ] Update Progress: 699/2372 symbols completed. EEA took 21.7s. Estimated remaining: 3h 41m 13s. Rate: 7.6 symbols/min [2025-09-19T18:32:29.953152] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:29.969022] [DEBUG] [LOCAL ] EFR: Loaded 14242 existing records from primary storage. [2025-09-19T18:32:29.969138] [INFO ] [MAIN ] EFR: Loaded 14242 existing records. [2025-09-19T18:32:30.146049] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:30.146340] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-19T18:32:30.146404] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-19T18:32:30.146938] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-19T18:32:30.147042] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-19T18:32:30.249549] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-19T18:32:30.522135] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:30.740189] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T18:32:31.043291] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-19T18:32:31.570412] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T18:32:31.575205] [INFO ] [REMOTE ] EE: Full fetch complete (43502 records). [2025-09-19T18:32:31.575293] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-19T18:32:31.851970] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-19T18:32:31.953844] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-19T18:32:31.953965] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-19T18:32:31.954726] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-19T18:32:31.954810] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-19T18:32:31.956180] [DEBUG] [LOCAL ] EE: Trimmed 43502 records to 33025 (keeping 200 days of data) [2025-09-19T18:32:32.149899] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T18:32:32.171435] [DEBUG] [LOCAL ] EE: Primary data saved (33025 records). [2025-09-19T18:32:32.171546] [INFO ] [MAIN ] EE: Full history saved. [2025-09-19T18:32:32.171628] [INFO ] [MAIN ] Update Progress: 700/2372 symbols completed. EE took 35.0s. Estimated remaining: 3h 40m 52s. Rate: 7.6 symbols/min [2025-09-19T18:32:32.350135] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:32.363980] [DEBUG] [LOCAL ] EFT: Loaded 12563 existing records from primary storage. [2025-09-19T18:32:32.364105] [INFO ] [MAIN ] EFT: Loaded 12563 existing records. [2025-09-19T18:32:32.539793] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:32.540065] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-19T18:32:32.540829] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-19T18:32:32.541233] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-19T18:32:32.541293] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-19T18:32:32.645292] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-19T18:32:32.911582] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:33.443242] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-19T18:32:33.861083] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T18:32:34.081529] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T18:32:34.243278] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-19T18:32:34.498629] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T18:32:35.043260] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-19T18:32:35.564670] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T18:32:35.843277] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-19T18:32:35.865586] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T18:32:36.643279] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-19T18:32:36.822150] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T18:32:37.443285] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-19T18:32:37.531631] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T18:32:38.243263] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-19T18:32:38.427737] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T18:32:39.043261] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-19T18:32:39.843314] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-19T18:32:39.914147] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:32:40.035487] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T18:32:40.643267] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-19T18:32:40.771772] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T18:32:41.443259] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-19T18:32:41.491162] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T18:32:42.243261] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-19T18:32:42.302709] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:32:43.043258] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-19T18:32:43.283048] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T18:32:43.843267] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-19T18:32:44.115030] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T18:32:44.643276] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-19T18:32:44.770398] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T18:32:45.443270] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-19T18:32:45.992387] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T18:32:46.243288] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-19T18:32:46.696411] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T18:32:47.043261] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-19T18:32:47.195293] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T18:32:47.197223] [INFO ] [REMOTE ] EEX: Full fetch complete (20139 records). [2025-09-19T18:32:47.197301] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-19T18:32:47.197933] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:32:47.198017] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:32:47.198075] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:32:47.198164] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-19T18:32:47.198265] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-19T18:32:47.198340] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-09-19T18:32:47.198870] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-09-19T18:32:47.199024] [INFO ] [MAIN ] Update Progress: 701/2372 symbols completed. EEX took 29.3s. Estimated remaining: 3h 41m 1s. Rate: 7.6 symbols/min [2025-09-19T18:32:47.368055] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:47.424103] [DEBUG] [LOCAL ] EFX: Loaded 45372 existing records from primary storage. [2025-09-19T18:32:47.424273] [INFO ] [MAIN ] EFX: Loaded 45372 existing records. [2025-09-19T18:32:47.600026] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:47.600316] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-19T18:32:47.600395] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-19T18:32:47.602240] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-19T18:32:47.602304] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-19T18:32:47.844726] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-19T18:32:47.995145] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:48.068788] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T18:32:48.643269] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-19T18:32:49.443240] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-19T18:32:49.819449] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:32:49.960779] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T18:32:50.243243] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-19T18:32:50.583087] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T18:32:51.043240] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-19T18:32:51.385960] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T18:32:51.843266] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-19T18:32:52.643273] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-19T18:32:53.097596] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T18:32:53.366050] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T18:32:53.443277] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-19T18:32:53.597517] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T18:32:54.243270] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-19T18:32:54.795377] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:32:55.043273] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-19T18:32:55.564549] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T18:32:55.843265] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-19T18:32:56.643310] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-19T18:32:56.951267] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T18:32:56.954185] [INFO ] [REMOTE ] EFR: Full fetch complete (18474 records). [2025-09-19T18:32:56.954302] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-19T18:32:57.344514] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-19T18:32:57.344727] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-19T18:32:57.345154] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-19T18:32:57.345227] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-19T18:32:57.368455] [DEBUG] [LOCAL ] EFR: Trimmed 18474 records to 14298 (keeping 200 days of data) [2025-09-19T18:32:57.370364] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T18:32:57.443871] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-19T18:32:57.466332] [DEBUG] [LOCAL ] EFR: Primary data saved (14298 records). [2025-09-19T18:32:57.466431] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-19T18:32:57.466511] [INFO ] [MAIN ] Update Progress: 702/2372 symbols completed. EFR took 27.7s. Estimated remaining: 3h 40m 58s. Rate: 7.6 symbols/min [2025-09-19T18:32:57.649307] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:57.678809] [DEBUG] [LOCAL ] EFXT: Loaded 29917 existing records from primary storage. [2025-09-19T18:32:57.678945] [INFO ] [MAIN ] EFXT: Loaded 29917 existing records. [2025-09-19T18:32:57.870249] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:57.870140] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:32:57.872884] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-19T18:32:57.872758] [INFO ] [REMOTE ] EFT: Full fetch complete (17399 records). [2025-09-19T18:32:57.872991] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-19T18:32:57.873071] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-19T18:32:57.904624] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-19T18:32:57.937095] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-19T18:32:58.270921] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-19T18:32:58.626955] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-19T18:32:58.626860] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:58.627107] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-19T18:32:58.627587] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-19T18:32:58.627703] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-19T18:32:58.628571] [DEBUG] [LOCAL ] EFT: Trimmed 17399 records to 12640 (keeping 200 days of data) [2025-09-19T18:32:58.715322] [DEBUG] [LOCAL ] EFT: Primary data saved (12640 records). [2025-09-19T18:32:58.715500] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-19T18:32:58.715764] [INFO ] [MAIN ] Update Progress: 703/2372 symbols completed. EFT took 26.5s. Estimated remaining: 3h 40m 34s. Rate: 7.6 symbols/min [2025-09-19T18:32:58.902466] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:32:58.931502] [DEBUG] [LOCAL ] EG: Loaded 29272 existing records from primary storage. [2025-09-19T18:32:58.931638] [INFO ] [MAIN ] EG: Loaded 29272 existing records. [2025-09-19T18:32:59.048385] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-19T18:32:59.132546] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:32:59.132904] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-19T18:32:59.132983] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-19T18:32:59.133858] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-19T18:32:59.133921] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-19T18:32:59.501285] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:32:59.529002] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T18:32:59.843268] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-19T18:33:00.230737] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T18:33:00.509282] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T18:33:00.643268] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-19T18:33:01.436179] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T18:33:01.445962] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-19T18:33:02.243311] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-19T18:33:03.048334] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-19T18:33:03.061589] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-19T18:33:03.843350] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-19T18:33:04.235549] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-09-19T18:33:04.643302] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-19T18:33:05.433715] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T18:33:05.440715] [INFO ] [REMOTE ] EFC: Full fetch complete (66026 records). [2025-09-19T18:33:05.440830] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-19T18:33:05.706030] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (3.46 seconds). [2025-09-19T18:33:05.771384] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-19T18:33:05.885681] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-19T18:33:05.885889] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-19T18:33:05.886767] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-19T18:33:05.886854] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-19T18:33:05.888781] [DEBUG] [LOCAL ] EFC: Trimmed 66026 records to 46929 (keeping 200 days of data) [2025-09-19T18:33:05.916778] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T18:33:06.211901] [DEBUG] [LOCAL ] EFC: Primary data saved (46929 records). [2025-09-19T18:33:06.212069] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-19T18:33:06.212193] [INFO ] [MAIN ] Update Progress: 704/2372 symbols completed. EFC took 44.5s. Estimated remaining: 3h 40m 25s. Rate: 7.6 symbols/min [2025-09-19T18:33:06.255571] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-19T18:33:06.386981] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:06.404012] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T18:33:06.457541] [DEBUG] [LOCAL ] EGO: Loaded 51775 existing records from primary storage. [2025-09-19T18:33:06.457706] [INFO ] [MAIN ] EGO: Loaded 51775 existing records. [2025-09-19T18:33:06.636059] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:06.636296] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-19T18:33:06.636343] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-19T18:33:06.637425] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-19T18:33:06.637485] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-19T18:33:06.995831] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:07.043226] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-19T18:33:07.615245] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T18:33:07.843268] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-19T18:33:08.637224] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T18:33:08.646686] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-19T18:33:09.116268] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-19T18:33:09.443262] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-19T18:33:09.535236] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T18:33:10.243292] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-19T18:33:10.349768] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:33:11.043304] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-19T18:33:11.197902] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T18:33:11.843272] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-19T18:33:12.184355] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:33:12.283096] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T18:33:12.643305] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-19T18:33:13.036673] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T18:33:13.443285] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-19T18:33:14.243292] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-19T18:33:15.043343] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-19T18:33:15.271956] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-19T18:33:15.474734] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T18:33:15.830569] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T18:33:15.843217] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-19T18:33:16.434224] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T18:33:16.643287] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-19T18:33:17.443243] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-19T18:33:17.548241] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T18:33:18.243258] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-19T18:33:18.686676] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T18:33:18.777139] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T18:33:19.043267] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-19T18:33:19.843272] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-19T18:33:20.129497] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:33:20.494434] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T18:33:20.643291] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-19T18:33:20.877330] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T18:33:21.443266] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-19T18:33:22.243297] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-19T18:33:22.619113] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:33:23.043296] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-19T18:33:23.355120] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T18:33:23.869351] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-19T18:33:23.883179] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T18:33:24.643319] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-19T18:33:24.840080] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T18:33:25.032729] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T18:33:25.443284] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-19T18:33:26.243291] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-19T18:33:26.634454] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T18:33:26.641415] [INFO ] [REMOTE ] EFX: Full fetch complete (64395 records). [2025-09-19T18:33:26.641597] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-19T18:33:26.848886] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T18:33:27.052575] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-19T18:33:27.075706] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-19T18:33:27.075787] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-19T18:33:27.076615] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-19T18:33:27.076862] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-19T18:33:27.078294] [DEBUG] [LOCAL ] EFX: Trimmed 64395 records to 45687 (keeping 200 days of data) [2025-09-19T18:33:27.349754] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T18:33:27.358437] [INFO ] [REMOTE ] EFXT: Full fetch complete (44195 records). [2025-09-19T18:33:27.359136] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-19T18:33:27.800695] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-19T18:33:27.801157] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-19T18:33:27.803534] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-19T18:33:27.803627] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-19T18:33:27.802485] [DEBUG] [LOCAL ] EFX: Primary data saved (45687 records). [2025-09-19T18:33:27.803960] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-19T18:33:27.804070] [INFO ] [MAIN ] Update Progress: 705/2372 symbols completed. EFX took 40.6s. Estimated remaining: 3h 40m 50s. Rate: 7.5 symbols/min [2025-09-19T18:33:27.845476] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-19T18:33:27.867752] [DEBUG] [LOCAL ] EFXT: Trimmed 44195 records to 30115 (keeping 200 days of data) [2025-09-19T18:33:28.080869] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:28.128244] [DEBUG] [LOCAL ] EGP: Loaded 31675 existing records from primary storage. [2025-09-19T18:33:28.128901] [INFO ] [MAIN ] EGP: Loaded 31675 existing records. [2025-09-19T18:33:28.372692] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:28.374029] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-19T18:33:28.374627] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-19T18:33:28.376134] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-19T18:33:28.376222] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-19T18:33:28.629379] [DEBUG] [LOCAL ] EFXT: Primary data saved (30115 records). [2025-09-19T18:33:28.637112] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-19T18:33:28.642456] [INFO ] [MAIN ] Update Progress: 706/2372 symbols completed. EFXT took 31.2s. Estimated remaining: 3h 40m 25s. Rate: 7.6 symbols/min [2025-09-19T18:33:28.905826] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:28.911451] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-19T18:33:28.973901] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T18:33:28.996736] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:28.998104] [INFO ] [REMOTE ] EG: Full fetch complete (44041 records). [2025-09-19T18:33:28.998240] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-19T18:33:29.320897] [DEBUG] [LOCAL ] EGY: Loaded 42731 existing records from primary storage. [2025-09-19T18:33:29.326736] [INFO ] [MAIN ] EGY: Loaded 42731 existing records. [2025-09-19T18:33:29.532940] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-19T18:33:29.538110] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-19T18:33:29.549385] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-19T18:33:29.549596] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-19T18:33:29.606303] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:29.607199] [DEBUG] [LOCAL ] EG: Trimmed 44041 records to 29471 (keeping 200 days of data) [2025-09-19T18:33:29.608098] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-19T18:33:29.608511] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-19T18:33:29.609633] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-19T18:33:29.609722] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-19T18:33:29.925831] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T18:33:30.082394] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-19T18:33:30.141032] [DEBUG] [LOCAL ] EG: Primary data saved (29471 records). [2025-09-19T18:33:30.142248] [INFO ] [MAIN ] EG: Full history saved. [2025-09-19T18:33:30.142830] [INFO ] [MAIN ] Update Progress: 707/2372 symbols completed. EG took 31.4s. Estimated remaining: 3h 40m 2s. Rate: 7.6 symbols/min [2025-09-19T18:33:30.312850] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:30.335191] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-19T18:33:30.409612] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:30.442990] [DEBUG] [LOCAL ] EHAB: Loaded 30421 existing records from primary storage. [2025-09-19T18:33:30.443140] [INFO ] [MAIN ] EHAB: Loaded 30421 existing records. [2025-09-19T18:33:30.631813] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:30.637471] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-19T18:33:30.637706] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-19T18:33:30.644344] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-19T18:33:30.654179] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-19T18:33:30.725140] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T18:33:31.025181] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:31.043225] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-19T18:33:31.675267] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:33:31.843270] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-19T18:33:32.162549] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T18:33:32.498219] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T18:33:32.643294] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-19T18:33:33.443266] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-19T18:33:33.501384] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T18:33:33.829234] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:33:34.243272] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-19T18:33:34.979039] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T18:33:35.043232] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-19T18:33:35.181604] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T18:33:35.843274] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-19T18:33:36.643277] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-19T18:33:36.745438] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:33:36.834475] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T18:33:37.443285] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-19T18:33:37.888022] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T18:33:38.243271] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-19T18:33:38.859346] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T18:33:38.867401] [INFO ] [REMOTE ] EGO: Full fetch complete (73259 records). [2025-09-19T18:33:38.867581] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-19T18:33:39.052469] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-19T18:33:39.274286] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-19T18:33:39.274386] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-19T18:33:39.275306] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-19T18:33:39.275385] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-19T18:33:39.276914] [DEBUG] [LOCAL ] EGO: Trimmed 73259 records to 52165 (keeping 200 days of data) [2025-09-19T18:33:39.419121] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T18:33:39.652915] [DEBUG] [LOCAL ] EGO: Primary data saved (52165 records). [2025-09-19T18:33:39.653211] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-19T18:33:39.654732] [INFO ] [MAIN ] Update Progress: 708/2372 symbols completed. EGO took 33.4s. Estimated remaining: 3h 39m 58s. Rate: 7.6 symbols/min [2025-09-19T18:33:39.831302] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:39.843298] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-19T18:33:39.899098] [DEBUG] [LOCAL ] EHC: Loaded 41881 existing records from primary storage. [2025-09-19T18:33:39.899265] [INFO ] [MAIN ] EHC: Loaded 41881 existing records. [2025-09-19T18:33:40.087175] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:40.087749] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-19T18:33:40.087892] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-19T18:33:40.097015] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-19T18:33:40.097132] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-19T18:33:40.144964] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T18:33:40.496837] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:40.643284] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-19T18:33:41.308399] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T18:33:41.443285] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-19T18:33:42.237032] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T18:33:42.244510] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-19T18:33:42.730694] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T18:33:43.043290] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-19T18:33:43.621271] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T18:33:43.843292] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-19T18:33:44.643263] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-19T18:33:44.748639] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T18:33:45.373150] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:33:45.443289] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-19T18:33:46.243275] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-19T18:33:46.800934] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T18:33:47.043270] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-19T18:33:47.338329] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T18:33:47.635419] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T18:33:47.843266] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-19T18:33:47.993589] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T18:33:48.643267] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-19T18:33:49.109937] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T18:33:49.443281] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-19T18:33:50.243279] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-19T18:33:50.825070] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T18:33:51.042260] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T18:33:51.044492] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-19T18:33:51.288843] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T18:33:51.843280] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-19T18:33:52.232046] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T18:33:52.643283] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-19T18:33:52.982803] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T18:33:53.443227] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-19T18:33:53.672302] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T18:33:53.676424] [INFO ] [REMOTE ] EHAB: Full fetch complete (41729 records). [2025-09-19T18:33:53.676559] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-19T18:33:54.055741] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-19T18:33:54.055845] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-19T18:33:54.056485] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-19T18:33:54.056531] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-19T18:33:54.058205] [DEBUG] [LOCAL ] EHAB: Trimmed 41729 records to 30600 (keeping 200 days of data) [2025-09-19T18:33:54.241894] [DEBUG] [LOCAL ] EHAB: Primary data saved (30600 records). [2025-09-19T18:33:54.242047] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-19T18:33:54.242181] [INFO ] [MAIN ] Update Progress: 709/2372 symbols completed. EHAB took 24.1s. Estimated remaining: 3h 40m 5s. Rate: 7.6 symbols/min [2025-09-19T18:33:54.248518] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-19T18:33:54.435206] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:54.435598] [DEBUG] [LOCAL ] EHI: No existing data file found in primary storage. [2025-09-19T18:33:54.435686] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-09-19T18:33:54.435895] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-19T18:33:54.435948] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-19T18:33:54.435993] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-09-19T18:33:54.436100] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-19T18:33:54.792440] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:55.043250] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-19T18:33:55.231555] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:33:55.819857] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T18:33:55.843222] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-19T18:33:56.355725] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T18:33:56.643267] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-19T18:33:57.443265] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-19T18:33:57.648792] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T18:33:57.653853] [INFO ] [REMOTE ] EGP: Full fetch complete (45198 records). [2025-09-19T18:33:57.653947] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-19T18:33:58.070372] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-19T18:33:58.070524] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-19T18:33:58.071215] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-19T18:33:58.071279] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-19T18:33:58.072372] [DEBUG] [LOCAL ] EGP: Trimmed 45198 records to 31908 (keeping 200 days of data) [2025-09-19T18:33:58.244757] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-19T18:33:58.288368] [DEBUG] [LOCAL ] EGP: Primary data saved (31908 records). [2025-09-19T18:33:58.288521] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-19T18:33:58.288703] [INFO ] [MAIN ] Update Progress: 710/2372 symbols completed. EGP took 30.5s. Estimated remaining: 3h 39m 48s. Rate: 7.6 symbols/min [2025-09-19T18:33:58.476203] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:33:58.509898] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T18:33:58.539723] [DEBUG] [LOCAL ] EIC: Loaded 24772 existing records from primary storage. [2025-09-19T18:33:58.539886] [INFO ] [MAIN ] EIC: Loaded 24772 existing records. [2025-09-19T18:33:58.724775] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:33:58.725050] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-19T18:33:58.725101] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-19T18:33:58.726024] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-19T18:33:58.726099] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-19T18:33:59.062053] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-19T18:33:59.115947] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:33:59.127139] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T18:33:59.136458] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T18:33:59.843307] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-19T18:34:00.643276] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-19T18:34:00.856968] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T18:34:01.095396] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T18:34:01.443284] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-19T18:34:02.243255] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-19T18:34:02.477672] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T18:34:02.747313] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T18:34:03.043264] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-19T18:34:03.308323] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T18:34:03.843266] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-19T18:34:04.643271] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-19T18:34:04.910279] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T18:34:04.943988] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T18:34:05.443274] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-19T18:34:06.243240] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-19T18:34:06.473239] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T18:34:06.479224] [INFO ] [REMOTE ] EGY: Full fetch complete (61902 records). [2025-09-19T18:34:06.479334] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-19T18:34:06.880224] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-19T18:34:06.880405] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-19T18:34:06.881260] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-19T18:34:06.881406] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-19T18:34:06.896202] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:34:06.901412] [DEBUG] [LOCAL ] EGY: Trimmed 61902 records to 43031 (keeping 200 days of data) [2025-09-19T18:34:07.083515] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-19T18:34:07.181482] [DEBUG] [LOCAL ] EGY: Primary data saved (43031 records). [2025-09-19T18:34:07.181661] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-19T18:34:07.181795] [INFO ] [MAIN ] Update Progress: 711/2372 symbols completed. EGY took 38.5s. Estimated remaining: 3h 39m 43s. Rate: 7.6 symbols/min [2025-09-19T18:34:07.362925] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:07.363098] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-19T18:34:07.363134] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-19T18:34:07.363276] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-19T18:34:07.363318] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-19T18:34:07.363358] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-19T18:34:07.363389] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-19T18:34:07.741310] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:07.843240] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-19T18:34:07.978331] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T18:34:08.006498] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T18:34:08.463674] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-19T18:34:08.643260] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-19T18:34:09.182196] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T18:34:09.443265] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-19T18:34:10.243272] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-19T18:34:10.380403] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T18:34:10.547909] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-19T18:34:11.043269] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-19T18:34:11.843281] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-19T18:34:12.161441] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-19T18:34:12.643284] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-19T18:34:12.799759] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T18:34:12.806215] [INFO ] [REMOTE ] EHC: Full fetch complete (58896 records). [2025-09-19T18:34:12.806347] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-19T18:34:13.200886] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-19T18:34:13.201012] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-19T18:34:13.201898] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-19T18:34:13.201975] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-19T18:34:13.203453] [DEBUG] [LOCAL ] EHC: Trimmed 58896 records to 42121 (keeping 200 days of data) [2025-09-19T18:34:13.443635] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-19T18:34:13.469117] [DEBUG] [LOCAL ] EHC: Primary data saved (42121 records). [2025-09-19T18:34:13.469251] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-19T18:34:13.470029] [INFO ] [MAIN ] Update Progress: 712/2372 symbols completed. EHC took 33.8s. Estimated remaining: 3h 39m 31s. Rate: 7.6 symbols/min [2025-09-19T18:34:13.643151] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:13.643320] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-19T18:34:13.643358] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-19T18:34:13.643503] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-19T18:34:13.643545] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-19T18:34:13.643588] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-19T18:34:13.643621] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-19T18:34:14.010788] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:14.243240] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-19T18:34:14.322814] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T18:34:14.479115] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T18:34:14.777180] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T18:34:15.043293] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-19T18:34:15.843286] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-19T18:34:16.022782] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T18:34:16.168288] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-19T18:34:16.643292] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-19T18:34:17.443291] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-19T18:34:17.740045] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T18:34:17.766564] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-19T18:34:18.243265] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-19T18:34:18.760338] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T18:34:19.043307] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-19T18:34:19.410670] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-19T18:34:19.843279] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-19T18:34:20.372041] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T18:34:20.643277] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-19T18:34:21.289884] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T18:34:21.443279] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-19T18:34:22.243250] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-19T18:34:22.826716] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T18:34:22.843133] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-19T18:34:23.043329] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-19T18:34:23.843316] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-19T18:34:23.950414] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T18:34:24.643270] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-19T18:34:24.750771] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T18:34:25.329726] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T18:34:25.443309] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-19T18:34:25.852407] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-19T18:34:26.243304] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-19T18:34:27.043306] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-19T18:34:27.296732] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T18:34:27.299364] [INFO ] [REMOTE ] EHI: Full fetch complete (16438 records). [2025-09-19T18:34:27.299472] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-19T18:34:27.711260] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-19T18:34:27.711369] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-19T18:34:27.711828] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-19T18:34:27.711928] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-19T18:34:27.712877] [DEBUG] [LOCAL ] EHI: Trimmed 16438 records to 10346 (keeping 200 days of data) [2025-09-19T18:34:27.778986] [DEBUG] [LOCAL ] EHI: Primary data saved (10346 records). [2025-09-19T18:34:27.779147] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-19T18:34:27.779234] [INFO ] [MAIN ] Update Progress: 713/2372 symbols completed. EHI took 33.5s. Estimated remaining: 3h 39m 38s. Rate: 7.6 symbols/min [2025-09-19T18:34:27.848552] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-19T18:34:27.974108] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:27.974352] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-19T18:34:27.974412] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-19T18:34:27.974601] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-19T18:34:27.974730] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-19T18:34:27.974813] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-19T18:34:27.974863] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-19T18:34:28.287406] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-19T18:34:28.375481] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:28.393230] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T18:34:28.643296] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-19T18:34:29.157513] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-19T18:34:29.443264] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-19T18:34:29.841477] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-19T18:34:29.842303] [INFO ] [REMOTE ] EICA: Full fetch complete (1262 records). [2025-09-19T18:34:29.842375] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-19T18:34:30.045582] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-19T18:34:30.045787] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:34:30.045872] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:34:30.045946] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-19T18:34:30.046009] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-19T18:34:30.046057] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-19T18:34:30.046146] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-19T18:34:30.046226] [INFO ] [MAIN ] Update Progress: 714/2372 symbols completed. EICA took 22.9s. Estimated remaining: 3h 39m 17s. Rate: 7.6 symbols/min [2025-09-19T18:34:30.215299] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:30.238346] [DEBUG] [LOCAL ] EIG: Loaded 20425 existing records from primary storage. [2025-09-19T18:34:30.238478] [INFO ] [MAIN ] EIG: Loaded 20425 existing records. [2025-09-19T18:34:30.249275] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-19T18:34:30.418691] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:34:30.418928] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-19T18:34:30.418976] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-19T18:34:30.419763] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-19T18:34:30.419824] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-19T18:34:30.776086] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:31.043297] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-19T18:34:31.141583] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T18:34:31.843254] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-19T18:34:32.326860] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:34:32.643278] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-19T18:34:33.101479] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-19T18:34:33.126720] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T18:34:33.443285] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-19T18:34:34.243265] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-19T18:34:34.687859] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-19T18:34:34.771478] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:34:34.774703] [INFO ] [REMOTE ] EIC: Full fetch complete (35716 records). [2025-09-19T18:34:34.774795] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-19T18:34:35.048342] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-19T18:34:35.148989] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-19T18:34:35.149073] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-19T18:34:35.149759] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-19T18:34:35.149825] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-19T18:34:35.150756] [DEBUG] [LOCAL ] EIC: Trimmed 35716 records to 24897 (keeping 200 days of data) [2025-09-19T18:34:35.304039] [DEBUG] [LOCAL ] EIC: Primary data saved (24897 records). [2025-09-19T18:34:35.304323] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-19T18:34:35.304476] [INFO ] [MAIN ] Update Progress: 715/2372 symbols completed. EIC took 37.0s. Estimated remaining: 3h 39m 3s. Rate: 7.6 symbols/min [2025-09-19T18:34:35.475828] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:35.530684] [DEBUG] [LOCAL ] EIX: Loaded 53743 existing records from primary storage. [2025-09-19T18:34:35.530836] [INFO ] [MAIN ] EIX: Loaded 53743 existing records. [2025-09-19T18:34:35.707577] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:34:35.707828] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-19T18:34:35.707876] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-19T18:34:35.709102] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-19T18:34:35.709162] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-19T18:34:35.849780] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-19T18:34:36.123033] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:36.241761] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:34:36.643272] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-19T18:34:36.750111] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T18:34:37.443288] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-19T18:34:38.091669] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T18:34:38.243264] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-19T18:34:38.579835] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T18:34:38.646493] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-19T18:34:39.043278] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-19T18:34:39.824337] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T18:34:39.843224] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-19T18:34:40.643273] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-19T18:34:41.426352] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T18:34:41.443325] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-19T18:34:41.560635] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T18:34:41.972225] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T18:34:42.243323] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-19T18:34:43.043268] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-19T18:34:43.843283] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-19T18:34:44.206419] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T18:34:44.207373] [INFO ] [REMOTE ] EICB: Full fetch complete (2673 records). [2025-09-19T18:34:44.207442] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-19T18:34:44.393834] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T18:34:44.394104] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:34:44.394289] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:34:44.394432] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-19T18:34:44.394573] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-19T18:34:44.394668] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-19T18:34:44.394841] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-19T18:34:44.394930] [INFO ] [MAIN ] Update Progress: 716/2372 symbols completed. EICB took 30.9s. Estimated remaining: 3h 38m 57s. Rate: 7.6 symbols/min [2025-09-19T18:34:44.513745] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T18:34:44.622599] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:34:44.627370] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T18:34:44.643254] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-19T18:34:44.689505] [DEBUG] [LOCAL ] EL: Loaded 53826 existing records from primary storage. [2025-09-19T18:34:44.689672] [INFO ] [MAIN ] EL: Loaded 53826 existing records. [2025-09-19T18:34:44.864733] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:34:44.864932] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-19T18:34:44.864979] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-19T18:34:44.866179] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-19T18:34:44.866240] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-19T18:34:45.228829] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:34:45.387870] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T18:34:45.443214] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-19T18:34:46.243269] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-19T18:34:47.043456] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-19T18:34:47.585008] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T18:34:47.832428] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T18:34:47.843210] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-19T18:34:48.101844] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-19T18:34:48.620955] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-19T18:34:48.643216] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-19T18:34:49.386181] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T18:34:49.388098] [INFO ] [REMOTE ] EICC: Full fetch complete (7763 records). [2025-09-19T18:34:49.388174] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-19T18:34:49.388808] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:34:49.388901] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:34:49.388942] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:34:49.388980] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-19T18:34:49.389037] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-19T18:34:49.389119] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-19T18:34:49.389202] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-19T18:34:49.389281] [INFO ] [MAIN ] Update Progress: 717/2372 symbols completed. EICC took 21.6s. Estimated remaining: 3h 38m 43s. Rate: 7.6 symbols/min [2025-09-19T18:34:49.443263] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-19T18:34:50.243274] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-19T18:34:51.022516] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T18:34:51.043209] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-19T18:34:51.843263] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-19T18:34:52.017350] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:34:52.643272] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-19T18:34:52.737323] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T18:34:53.303590] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-19T18:34:53.443253] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-19T18:34:54.243258] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-19T18:34:54.296602] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T18:34:54.827148] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T18:34:55.043260] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-19T18:34:55.843258] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-19T18:34:55.856309] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T18:34:56.545614] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T18:34:56.643275] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-19T18:34:57.443280] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-19T18:34:57.826219] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:34:58.243289] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-19T18:34:58.386548] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T18:34:58.429757] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:34:59.043313] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-19T18:34:59.843304] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-19T18:35:00.433104] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T18:35:00.643271] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-19T18:35:01.024057] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:35:01.282732] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T18:35:01.443323] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-19T18:35:02.243341] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-19T18:35:02.967280] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:35:02.989992] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:35:02.993717] [INFO ] [REMOTE ] EIG: Full fetch complete (26861 records). [2025-09-19T18:35:02.993804] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-19T18:35:03.055475] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-19T18:35:03.415690] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-19T18:35:03.415786] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-19T18:35:03.416370] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-19T18:35:03.416413] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-19T18:35:03.417437] [DEBUG] [LOCAL ] EIG: Trimmed 26861 records to 20564 (keeping 200 days of data) [2025-09-19T18:35:03.548600] [DEBUG] [LOCAL ] EIG: Primary data saved (20564 records). [2025-09-19T18:35:03.548759] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-19T18:35:03.548864] [INFO ] [MAIN ] Update Progress: 718/2372 symbols completed. EIG took 33.5s. Estimated remaining: 3h 38m 49s. Rate: 7.6 symbols/min [2025-09-19T18:35:04.414050] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T18:35:04.426026] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-19T18:35:05.348217] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T18:35:05.361204] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-19T18:35:06.899245] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-19T18:35:06.911354] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-19T18:35:07.483796] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T18:35:07.491103] [INFO ] [REMOTE ] EIX: Full fetch complete (76552 records). [2025-09-19T18:35:07.491250] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-19T18:35:07.492263] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:35:07.492369] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:35:07.492413] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:35:07.492478] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-19T18:35:07.492545] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-19T18:35:07.492581] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-19T18:35:07.493056] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-09-19T18:35:07.493211] [INFO ] [MAIN ] Update Progress: 719/2372 symbols completed. EIX took 32.2s. Estimated remaining: 3h 38m 32s. Rate: 7.6 symbols/min [2025-09-19T18:35:09.379588] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T18:35:09.391992] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-19T18:35:11.628354] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-19T18:35:11.636083] [INFO ] [REMOTE ] EL: Full fetch complete (77360 records). [2025-09-19T18:35:11.636212] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-19T18:35:12.033535] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-19T18:35:12.033636] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-19T18:35:12.034539] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-19T18:35:12.034586] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-19T18:35:12.036147] [DEBUG] [LOCAL ] EL: Trimmed 77360 records to 54205 (keeping 200 days of data) [2025-09-19T18:35:12.368010] [DEBUG] [LOCAL ] EL: Primary data saved (54205 records). [2025-09-19T18:35:12.368161] [INFO ] [MAIN ] EL: Full history saved. [2025-09-19T18:35:12.368906] [INFO ] [MAIN ] Update Progress: 720/2372 symbols completed. EL took 28.0s. Estimated remaining: 3h 38m 17s. Rate: 7.6 symbols/min [2025-09-19T18:35:13.042839] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:13.021413] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:13.063237] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-09-19T18:35:13.099768] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:13.120322] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:13.121786] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-09-19T18:35:13.122315] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-19T18:35:13.122391] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-19T18:35:13.122689] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-09-19T18:35:13.123000] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-19T18:35:13.140869] [DEBUG] [LOCAL ] ELC: Loaded 3546 existing records from primary storage. [2025-09-19T18:35:13.173577] [INFO ] [MAIN ] ELC: Loaded 3546 existing records. [2025-09-19T18:35:13.589351] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:13.605323] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-19T18:35:13.613595] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-19T18:35:13.665384] [DEBUG] [LOCAL ] ELF: Loaded 52723 existing records from primary storage. [2025-09-19T18:35:13.707042] [INFO ] [MAIN ] ELF: Loaded 52723 existing records. [2025-09-19T18:35:13.712603] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-19T18:35:13.719420] [DEBUG] [LOCAL ] ELAN: Loaded 53570 existing records from primary storage. [2025-09-19T18:35:13.725330] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-19T18:35:13.730718] [INFO ] [MAIN ] ELAN: Loaded 53570 existing records. [2025-09-19T18:35:13.906608] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:13.979140] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-19T18:35:14.245140] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:14.322046] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-19T18:35:14.348150] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-19T18:35:14.391333] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-19T18:35:14.391560] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:14.443473] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-19T18:35:14.443343] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-19T18:35:14.523927] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-19T18:35:14.586567] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-19T18:35:14.618133] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-19T18:35:14.820433] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:14.855622] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-19T18:35:15.279664] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:15.283797] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-19T18:35:15.365729] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:15.366050] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-19T18:35:16.031606] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T18:35:16.033278] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-19T18:35:16.362713] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-19T18:35:16.370589] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-19T18:35:16.786930] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T18:35:16.788404] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-19T18:35:17.027933] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:35:17.038791] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-19T18:35:17.162769] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-19T18:35:17.164108] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-19T18:35:17.890296] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T18:35:17.897954] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-19T18:35:17.915279] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T18:35:17.916736] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-19T18:35:18.024463] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-19T18:35:18.034862] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-19T18:35:18.665787] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T18:35:18.667487] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-19T18:35:18.864154] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T18:35:18.883700] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-19T18:35:19.242993] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T18:35:19.259457] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-19T18:35:19.271530] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T18:35:19.280344] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-19T18:35:20.021429] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T18:35:20.023300] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-19T18:35:20.597837] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-19T18:35:20.651751] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-19T18:35:20.676535] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T18:35:20.677593] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T18:35:21.049860] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:35:21.443274] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-19T18:35:21.889424] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-19T18:35:22.243280] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-19T18:35:22.537523] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T18:35:22.765782] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-19T18:35:22.767004] [INFO ] [REMOTE ] ELC: Full fetch complete (5177 records). [2025-09-19T18:35:22.767076] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-19T18:35:23.048492] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-19T18:35:23.160116] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-19T18:35:23.160203] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-19T18:35:23.160372] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-19T18:35:23.160435] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-19T18:35:23.160891] [DEBUG] [LOCAL ] ELC: Trimmed 5177 records to 3562 (keeping 200 days of data) [2025-09-19T18:35:23.184152] [DEBUG] [LOCAL ] ELC: Primary data saved (3562 records). [2025-09-19T18:35:23.184221] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-19T18:35:23.184294] [INFO ] [MAIN ] Update Progress: 721/2372 symbols completed. ELC took 10.8s. Estimated remaining: 3h 38m 16s. Rate: 7.6 symbols/min [2025-09-19T18:35:23.360972] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:23.387319] [DEBUG] [LOCAL ] ELP: Loaded 26172 existing records from primary storage. [2025-09-19T18:35:23.387461] [INFO ] [MAIN ] ELP: Loaded 26172 existing records. [2025-09-19T18:35:23.571472] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:23.571984] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-19T18:35:23.572088] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-19T18:35:23.572921] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-19T18:35:23.572982] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-19T18:35:23.848736] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-19T18:35:23.940129] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:24.643311] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-19T18:35:25.443309] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-19T18:35:25.514195] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T18:35:25.654167] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T18:35:26.243304] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-19T18:35:26.449458] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T18:35:27.043282] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-19T18:35:27.429597] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T18:35:27.843281] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-19T18:35:28.388927] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:35:28.643230] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-19T18:35:28.719569] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T18:35:28.799362] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T18:35:29.443348] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-19T18:35:30.201344] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T18:35:30.243242] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-19T18:35:31.043280] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-19T18:35:31.636545] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T18:35:31.741239] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:35:31.843288] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-19T18:35:31.877637] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T18:35:32.643320] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-19T18:35:33.443305] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-19T18:35:34.003539] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T18:35:34.243331] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-19T18:35:34.409949] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-19T18:35:34.700417] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T18:35:35.043268] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-19T18:35:35.709884] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T18:35:35.843271] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-19T18:35:36.643258] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-19T18:35:37.022008] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:35:37.411549] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T18:35:37.443209] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-19T18:35:37.888961] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T18:35:37.895319] [INFO ] [REMOTE ] ELME: Full fetch complete (55743 records). [2025-09-19T18:35:37.895421] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-19T18:35:38.253560] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-19T18:35:38.274272] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-19T18:35:38.274364] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-19T18:35:38.275241] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-19T18:35:38.275442] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-19T18:35:38.276748] [DEBUG] [LOCAL ] ELME: Trimmed 55743 records to 39870 (keeping 200 days of data) [2025-09-19T18:35:38.517756] [DEBUG] [LOCAL ] ELME: Primary data saved (39870 records). [2025-09-19T18:35:38.517890] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-19T18:35:38.517979] [INFO ] [MAIN ] Update Progress: 722/2372 symbols completed. ELME took 26.1s. Estimated remaining: 3h 38m 25s. Rate: 7.6 symbols/min [2025-09-19T18:35:38.688260] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:38.688483] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-19T18:35:38.688556] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-19T18:35:38.689147] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-19T18:35:38.689253] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-19T18:35:38.689370] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-19T18:35:38.689563] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-19T18:35:38.868375] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:35:39.051739] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-19T18:35:39.084528] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:39.843316] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-19T18:35:40.031669] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T18:35:40.328140] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-19T18:35:40.643292] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-19T18:35:40.839563] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:35:41.443324] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-19T18:35:41.842971] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-19T18:35:42.018711] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:35:42.243268] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-19T18:35:42.895357] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T18:35:43.043275] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-19T18:35:43.476243] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-19T18:35:43.843277] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-19T18:35:44.643270] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-19T18:35:45.208113] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T18:35:45.443256] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-19T18:35:45.860710] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-19T18:35:46.159228] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:35:46.243272] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-19T18:35:47.043274] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-19T18:35:47.203403] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T18:35:47.446408] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T18:35:47.843262] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-19T18:35:48.643258] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-19T18:35:49.443256] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-19T18:35:50.011061] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T18:35:50.014750] [INFO ] [REMOTE ] ELP: Full fetch complete (37678 records). [2025-09-19T18:35:50.014858] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-19T18:35:50.251307] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-19T18:35:50.421025] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:35:50.469381] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-19T18:35:50.469498] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-19T18:35:50.470474] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-19T18:35:50.470575] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-19T18:35:50.472186] [DEBUG] [LOCAL ] ELP: Trimmed 37678 records to 26324 (keeping 200 days of data) [2025-09-19T18:35:50.628433] [DEBUG] [LOCAL ] ELP: Primary data saved (26324 records). [2025-09-19T18:35:50.628590] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-19T18:35:50.628706] [INFO ] [MAIN ] Update Progress: 723/2372 symbols completed. ELP took 27.4s. Estimated remaining: 3h 38m 26s. Rate: 7.5 symbols/min [2025-09-19T18:35:50.818328] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:50.864094] [DEBUG] [LOCAL ] ELS: Loaded 49743 existing records from primary storage. [2025-09-19T18:35:50.864262] [INFO ] [MAIN ] ELS: Loaded 49743 existing records. [2025-09-19T18:35:50.938018] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T18:35:51.062452] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-19T18:35:51.068861] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:51.070299] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-19T18:35:51.070383] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-19T18:35:51.071861] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-19T18:35:51.071941] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-19T18:35:51.269376] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T18:35:51.405377] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-19T18:35:51.484207] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:51.843257] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-19T18:35:52.196402] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-19T18:35:52.197142] [INFO ] [REMOTE ] ELPC: Full fetch complete (1500 records). [2025-09-19T18:35:52.197213] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-19T18:35:52.377456] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-19T18:35:52.377619] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:35:52.377726] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:35:52.377802] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-19T18:35:52.377880] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-19T18:35:52.377937] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-19T18:35:52.378007] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-19T18:35:52.378087] [INFO ] [MAIN ] Update Progress: 724/2372 symbols completed. ELPC took 13.9s. Estimated remaining: 3h 38m 4s. Rate: 7.6 symbols/min [2025-09-19T18:35:52.589779] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:52.647841] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-19T18:35:52.649984] [DEBUG] [LOCAL ] ELV: Loaded 50849 existing records from primary storage. [2025-09-19T18:35:52.650224] [INFO ] [MAIN ] ELV: Loaded 50849 existing records. [2025-09-19T18:35:52.835080] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:52.835341] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-19T18:35:52.835389] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-19T18:35:52.837042] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-19T18:35:52.837104] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-19T18:35:53.206096] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:53.443279] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-19T18:35:54.243273] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-19T18:35:55.043251] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-19T18:35:55.110493] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-19T18:35:55.164057] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T18:35:55.843284] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-19T18:35:56.341354] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T18:35:56.349927] [INFO ] [REMOTE ] ELAN: Full fetch complete (76859 records). [2025-09-19T18:35:56.350106] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-19T18:35:56.648436] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-19T18:35:56.774578] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-19T18:35:56.774719] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-19T18:35:56.775739] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-19T18:35:56.775807] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-19T18:35:56.777777] [DEBUG] [LOCAL ] ELAN: Trimmed 76859 records to 53959 (keeping 200 days of data) [2025-09-19T18:35:57.024186] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T18:35:57.141693] [DEBUG] [LOCAL ] ELAN: Primary data saved (53959 records). [2025-09-19T18:35:57.141831] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-19T18:35:57.141962] [INFO ] [MAIN ] Update Progress: 725/2372 symbols completed. ELAN took 44.8s. Estimated remaining: 3h 37m 49s. Rate: 7.6 symbols/min [2025-09-19T18:35:57.310259] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:57.310400] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-19T18:35:57.310436] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-19T18:35:57.310574] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-19T18:35:57.310687] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-19T18:35:57.310746] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-19T18:35:57.310780] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-19T18:35:57.448444] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-19T18:35:57.671247] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:35:57.918894] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T18:35:58.243343] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-19T18:35:58.434849] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T18:35:58.444117] [INFO ] [REMOTE ] ELF: Full fetch complete (75407 records). [2025-09-19T18:35:58.444293] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-19T18:35:58.872518] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-19T18:35:58.872614] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-19T18:35:58.873542] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-19T18:35:58.873610] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-19T18:35:58.876332] [DEBUG] [LOCAL ] ELF: Trimmed 75407 records to 53101 (keeping 200 days of data) [2025-09-19T18:35:59.059422] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-19T18:35:59.219912] [DEBUG] [LOCAL ] ELF: Primary data saved (53101 records). [2025-09-19T18:35:59.220265] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-19T18:35:59.220428] [INFO ] [MAIN ] Update Progress: 726/2372 symbols completed. ELF took 46.9s. Estimated remaining: 3h 37m 28s. Rate: 7.6 symbols/min [2025-09-19T18:35:59.329195] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:35:59.330066] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-19T18:35:59.407311] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T18:35:59.443156] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:35:59.464497] [DEBUG] [LOCAL ] EMD: Loaded 21570 existing records from primary storage. [2025-09-19T18:35:59.464637] [INFO ] [MAIN ] EMD: Loaded 21570 existing records. [2025-09-19T18:35:59.645833] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:35:59.646168] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-19T18:35:59.646242] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-19T18:35:59.646996] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-19T18:35:59.647058] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-19T18:35:59.851953] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-19T18:36:00.014808] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:36:00.068606] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:00.643276] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-19T18:36:00.875635] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:36:00.876104] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-19T18:36:01.443300] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-19T18:36:01.766491] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:36:02.243357] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-19T18:36:03.043328] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-19T18:36:03.843389] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-19T18:36:05.991717] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:36:05.992114] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-19T18:36:05.993135] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-19T18:36:10.578926] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:36:10.579265] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-19T18:36:10.579783] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-19T18:36:10.769049] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (6.93 seconds). [2025-09-19T18:36:10.779730] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-19T18:36:10.807709] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:36:10.808046] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-19T18:36:10.808615] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-19T18:36:10.893956] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (7.85 seconds). [2025-09-19T18:36:10.899274] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-19T18:36:11.188676] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (8.95 seconds). [2025-09-19T18:36:11.199394] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-19T18:36:11.231706] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-19T18:36:11.232860] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-19T18:36:12.494864] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T18:36:12.499521] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-19T18:36:12.772372] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T18:36:12.783280] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-19T18:36:13.027370] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T18:36:13.030436] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-19T18:36:14.653281] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (3.75 seconds). [2025-09-19T18:36:14.658247] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-19T18:36:15.127974] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T18:36:15.132299] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-19T18:36:15.422007] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (4.64 seconds). [2025-09-19T18:36:15.432662] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-19T18:36:16.201420] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (3.42 seconds). [2025-09-19T18:36:16.212000] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-19T18:36:17.014741] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T18:36:17.017531] [INFO ] [REMOTE ] EMA: Full fetch complete (7699 records). [2025-09-19T18:36:17.017638] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-19T18:36:17.213065] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 80 unique days, need 200 days [2025-09-19T18:36:17.213309] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:36:17.213566] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:36:17.213693] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-19T18:36:17.239965] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-19T18:36:17.240389] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-19T18:36:17.240717] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-19T18:36:17.241243] [INFO ] [MAIN ] Update Progress: 727/2372 symbols completed. EMA took 20.1s. Estimated remaining: 3h 37m 43s. Rate: 7.6 symbols/min [2025-09-19T18:36:17.243118] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T18:36:17.353788] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-19T18:36:17.442183] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:17.458889] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-19T18:36:17.465307] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-19T18:36:17.509434] [DEBUG] [LOCAL ] EME: Loaded 32125 existing records from primary storage. [2025-09-19T18:36:17.509579] [INFO ] [MAIN ] EME: Loaded 32125 existing records. [2025-09-19T18:36:17.706534] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:17.707030] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-19T18:36:17.707118] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-19T18:36:17.708184] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-19T18:36:17.708263] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-19T18:36:18.089567] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:18.090085] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-19T18:36:18.125238] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T18:36:18.243222] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-19T18:36:18.274394] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T18:36:19.043278] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-19T18:36:19.498596] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T18:36:19.562429] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-19T18:36:19.787131] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T18:36:19.843233] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-19T18:36:20.078680] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T18:36:20.643280] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-19T18:36:21.377587] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:36:21.443232] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-19T18:36:21.839231] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:36:22.169236] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T18:36:22.243241] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-19T18:36:23.043276] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-19T18:36:23.843290] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-19T18:36:23.844849] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T18:36:24.643278] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-19T18:36:25.316986] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-19T18:36:25.443288] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-19T18:36:25.495548] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T18:36:25.794474] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T18:36:26.243282] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-19T18:36:27.043368] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-19T18:36:27.429196] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T18:36:27.514968] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:36:27.518362] [INFO ] [REMOTE ] EMD: Full fetch complete (32150 records). [2025-09-19T18:36:27.518472] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-19T18:36:27.519159] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:36:27.519248] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:36:27.519293] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:36:27.519361] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-19T18:36:27.519429] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-09-19T18:36:27.519498] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-09-19T18:36:27.519985] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-09-19T18:36:27.520115] [INFO ] [MAIN ] Update Progress: 728/2372 symbols completed. EMD took 28.3s. Estimated remaining: 3h 37m 40s. Rate: 7.6 symbols/min [2025-09-19T18:36:27.697979] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:27.707264] [DEBUG] [LOCAL ] EMF: Loaded 3712 existing records from primary storage. [2025-09-19T18:36:27.707383] [INFO ] [MAIN ] EMF: Loaded 3712 existing records. [2025-09-19T18:36:27.848428] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-19T18:36:27.890677] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:27.890948] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-19T18:36:27.891002] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-19T18:36:27.891305] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-19T18:36:27.891366] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-19T18:36:28.250678] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:28.643268] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-19T18:36:29.443238] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-19T18:36:29.474117] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-19T18:36:30.110609] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T18:36:30.243230] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-19T18:36:30.766638] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (2.92 seconds). [2025-09-19T18:36:30.776608] [INFO ] [REMOTE ] ELS: Full fetch complete (70058 records). [2025-09-19T18:36:30.776779] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-19T18:36:30.780458] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:36:30.780566] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:36:30.780617] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:36:30.780703] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-19T18:36:30.780790] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-19T18:36:30.780842] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-09-19T18:36:30.781425] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-09-19T18:36:30.781541] [INFO ] [MAIN ] Update Progress: 729/2372 symbols completed. ELS took 40.2s. Estimated remaining: 3h 37m 22s. Rate: 7.6 symbols/min [2025-09-19T18:36:30.956117] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:31.017476] [DEBUG] [LOCAL ] EMN: Loaded 50622 existing records from primary storage. [2025-09-19T18:36:31.017678] [INFO ] [MAIN ] EMN: Loaded 50622 existing records. [2025-09-19T18:36:31.048592] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-19T18:36:31.201276] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:31.201772] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-19T18:36:31.201991] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-19T18:36:31.203179] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-19T18:36:31.203240] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-19T18:36:31.326352] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T18:36:31.409733] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T18:36:31.599000] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:31.843217] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-19T18:36:32.643226] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-19T18:36:32.807214] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T18:36:32.815543] [INFO ] [REMOTE ] ELV: Full fetch complete (72845 records). [2025-09-19T18:36:32.815687] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-19T18:36:32.816494] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:36:32.816596] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:36:32.816701] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:36:32.816795] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-19T18:36:32.816877] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-19T18:36:32.816958] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-19T18:36:32.817298] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-09-19T18:36:32.818275] [INFO ] [MAIN ] Update Progress: 730/2372 symbols completed. ELV took 40.4s. Estimated remaining: 3h 37m 0s. Rate: 7.6 symbols/min [2025-09-19T18:36:32.987846] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:33.013767] [DEBUG] [LOCAL ] EMO: Loaded 12366 existing records from primary storage. [2025-09-19T18:36:33.013893] [INFO ] [MAIN ] EMO: Loaded 12366 existing records. [2025-09-19T18:36:33.190969] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:33.191186] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-19T18:36:33.191232] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-19T18:36:33.191635] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-19T18:36:33.191724] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-19T18:36:33.445047] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-19T18:36:33.566946] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:33.594472] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T18:36:34.002324] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:36:34.243240] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-19T18:36:34.304258] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-19T18:36:35.043280] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-19T18:36:35.726749] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T18:36:35.843291] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-19T18:36:36.172130] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T18:36:36.643276] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-19T18:36:36.742319] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T18:36:37.443267] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-19T18:36:37.830671] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T18:36:38.243270] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-19T18:36:38.407573] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T18:36:39.043291] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-19T18:36:39.843287] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-19T18:36:40.262822] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T18:36:40.319572] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T18:36:40.643279] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-19T18:36:40.813238] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T18:36:41.443286] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-19T18:36:42.243257] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-19T18:36:42.584516] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T18:36:42.856484] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T18:36:42.869735] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-19T18:36:43.043257] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-19T18:36:43.843269] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-19T18:36:44.372584] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T18:36:44.643281] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-19T18:36:45.084827] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T18:36:45.216884] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T18:36:45.443268] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-19T18:36:46.243263] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-19T18:36:46.476499] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T18:36:47.043296] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-19T18:36:47.600509] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T18:36:47.843266] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-19T18:36:48.643267] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-19T18:36:48.915879] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:36:49.011773] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T18:36:49.016816] [INFO ] [REMOTE ] EME: Full fetch complete (46779 records). [2025-09-19T18:36:49.016903] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-19T18:36:49.288226] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-19T18:36:49.397685] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-19T18:36:49.397805] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-19T18:36:49.398562] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-19T18:36:49.398702] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-19T18:36:49.403129] [DEBUG] [LOCAL ] EME: Trimmed 46779 records to 32382 (keeping 200 days of data) [2025-09-19T18:36:49.466544] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-19T18:36:49.620357] [DEBUG] [LOCAL ] EME: Primary data saved (32382 records). [2025-09-19T18:36:49.620535] [INFO ] [MAIN ] EME: Full history saved. [2025-09-19T18:36:49.620687] [INFO ] [MAIN ] Update Progress: 731/2372 symbols completed. EME took 32.4s. Estimated remaining: 3h 37m 12s. Rate: 7.6 symbols/min [2025-09-19T18:36:49.789815] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:36:49.795203] [DEBUG] [LOCAL ] EMP: Loaded 3023 existing records from primary storage. [2025-09-19T18:36:49.795288] [INFO ] [MAIN ] EMP: Loaded 3023 existing records. [2025-09-19T18:36:49.972827] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:36:49.973088] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-19T18:36:49.973135] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-19T18:36:49.973393] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-19T18:36:49.973452] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-19T18:36:50.249764] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-19T18:36:50.345110] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:36:51.043306] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-19T18:36:51.071176] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T18:36:51.636460] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T18:36:51.843294] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-19T18:36:52.116493] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T18:36:52.297486] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-19T18:36:52.643324] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-19T18:36:53.443260] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-19T18:36:53.492575] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T18:36:54.012428] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T18:36:54.243270] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-19T18:36:54.974055] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T18:36:55.043271] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-19T18:36:55.433563] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:36:55.843264] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-19T18:36:56.643305] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-19T18:36:56.822978] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T18:36:57.205104] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T18:36:57.443308] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-19T18:36:58.243296] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-19T18:36:59.032862] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T18:36:59.043223] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-19T18:36:59.333141] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T18:36:59.843341] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-19T18:36:59.958462] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T18:37:00.643316] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-19T18:37:01.443381] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-19T18:37:01.453247] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T18:37:01.454949] [INFO ] [REMOTE ] EMF: Full fetch complete (7400 records). [2025-09-19T18:37:01.455057] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-19T18:37:01.947004] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-19T18:37:01.947120] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-19T18:37:01.947477] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-19T18:37:01.947520] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-19T18:37:01.948051] [DEBUG] [LOCAL ] EMF: Trimmed 7400 records to 3735 (keeping 200 days of data) [2025-09-19T18:37:01.975849] [DEBUG] [LOCAL ] EMF: Primary data saved (3735 records). [2025-09-19T18:37:01.976146] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-19T18:37:01.976416] [INFO ] [MAIN ] Update Progress: 732/2372 symbols completed. EMF took 34.5s. Estimated remaining: 3h 37m 14s. Rate: 7.5 symbols/min [2025-09-19T18:37:02.169799] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:02.195860] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-19T18:37:02.204399] [INFO ] [REMOTE ] EMN: Full fetch complete (71875 records). [2025-09-19T18:37:02.204693] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-19T18:37:02.248585] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-19T18:37:02.500595] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T18:37:02.633915] [DEBUG] [LOCAL ] EMR: Loaded 53650 existing records from primary storage. [2025-09-19T18:37:02.644536] [INFO ] [MAIN ] EMR: Loaded 53650 existing records. [2025-09-19T18:37:02.828162] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-19T18:37:02.842694] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-19T18:37:02.846727] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-19T18:37:02.846821] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-19T18:37:02.907371] [DEBUG] [LOCAL ] EMN: Trimmed 71875 records to 50995 (keeping 200 days of data) [2025-09-19T18:37:02.932057] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:02.932817] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-19T18:37:02.932914] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-19T18:37:02.934306] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-19T18:37:02.934372] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-19T18:37:03.063893] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-19T18:37:03.147905] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T18:37:03.595220] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:03.680092] [DEBUG] [LOCAL ] EMN: Primary data saved (50995 records). [2025-09-19T18:37:03.680260] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-19T18:37:03.680347] [INFO ] [MAIN ] Update Progress: 733/2372 symbols completed. EMN took 32.9s. Estimated remaining: 3h 36m 52s. Rate: 7.6 symbols/min [2025-09-19T18:37:03.853500] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-19T18:37:03.858472] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:03.917199] [DEBUG] [LOCAL ] ENB: Loaded 53914 existing records from primary storage. [2025-09-19T18:37:03.917370] [INFO ] [MAIN ] ENB: Loaded 53914 existing records. [2025-09-19T18:37:04.137365] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:04.138103] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-19T18:37:04.138307] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-19T18:37:04.149482] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-19T18:37:04.151351] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:37:04.150459] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-19T18:37:04.650580] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-19T18:37:04.657880] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:05.443308] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-19T18:37:05.756600] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T18:37:05.822806] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T18:37:05.825918] [INFO ] [REMOTE ] EMO: Full fetch complete (17189 records). [2025-09-19T18:37:05.825989] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-19T18:37:06.192507] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-19T18:37:06.192631] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-19T18:37:06.193016] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-19T18:37:06.193080] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-19T18:37:06.193624] [DEBUG] [LOCAL ] EMO: Trimmed 17189 records to 12458 (keeping 200 days of data) [2025-09-19T18:37:06.248723] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-19T18:37:06.271219] [DEBUG] [LOCAL ] EMO: Primary data saved (12458 records). [2025-09-19T18:37:06.271352] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-19T18:37:06.271462] [INFO ] [MAIN ] Update Progress: 734/2372 symbols completed. EMO took 33.5s. Estimated remaining: 3h 36m 32s. Rate: 7.6 symbols/min [2025-09-19T18:37:06.368065] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T18:37:06.448483] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:06.453337] [DEBUG] [LOCAL ] ENFY: Loaded 3075 existing records from primary storage. [2025-09-19T18:37:06.453420] [INFO ] [MAIN ] ENFY: Loaded 3075 existing records. [2025-09-19T18:37:06.627867] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:06.628135] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-19T18:37:06.628183] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-19T18:37:06.628403] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-19T18:37:06.628461] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-19T18:37:06.978625] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:07.043390] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-19T18:37:07.621637] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T18:37:07.843283] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-19T18:37:08.282731] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T18:37:08.643261] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-19T18:37:09.246302] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T18:37:09.443309] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-19T18:37:10.078239] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T18:37:10.243301] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-19T18:37:10.413853] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T18:37:10.967140] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T18:37:10.968246] [INFO ] [REMOTE ] EMP: Full fetch complete (4282 records). [2025-09-19T18:37:10.968316] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-19T18:37:11.048431] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-19T18:37:11.360451] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-19T18:37:11.360568] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-19T18:37:11.360757] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-19T18:37:11.360819] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-19T18:37:11.361233] [DEBUG] [LOCAL ] EMP: Trimmed 4282 records to 3035 (keeping 200 days of data) [2025-09-19T18:37:11.379992] [DEBUG] [LOCAL ] EMP: Primary data saved (3035 records). [2025-09-19T18:37:11.380072] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-19T18:37:11.380156] [INFO ] [MAIN ] Update Progress: 735/2372 symbols completed. EMP took 21.8s. Estimated remaining: 3h 36m 18s. Rate: 7.6 symbols/min [2025-09-19T18:37:11.547800] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:11.591530] [DEBUG] [LOCAL ] ENIC: Loaded 37105 existing records from primary storage. [2025-09-19T18:37:11.591752] [INFO ] [MAIN ] ENIC: Loaded 37105 existing records. [2025-09-19T18:37:11.782020] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:11.782378] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-19T18:37:11.782476] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-19T18:37:11.783724] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-19T18:37:11.783797] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-19T18:37:11.848497] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-19T18:37:12.205573] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:12.643269] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-19T18:37:13.133417] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T18:37:13.186382] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T18:37:13.443247] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-19T18:37:14.175873] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T18:37:14.243298] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-19T18:37:14.980815] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T18:37:15.043298] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-19T18:37:15.843318] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-19T18:37:16.643290] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-19T18:37:16.673149] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T18:37:16.737928] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-19T18:37:17.055106] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-19T18:37:17.443316] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-19T18:37:18.243258] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-19T18:37:18.591457] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-19T18:37:18.785360] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-19T18:37:19.043248] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-19T18:37:19.722680] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T18:37:19.843230] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-19T18:37:20.501956] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-19T18:37:20.572254] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T18:37:20.643246] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-19T18:37:21.443281] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-19T18:37:21.865199] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T18:37:22.243295] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-19T18:37:22.920237] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:37:23.043303] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-19T18:37:23.680898] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T18:37:23.843265] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-19T18:37:24.011679] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T18:37:24.643277] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-19T18:37:25.201262] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T18:37:25.443265] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-19T18:37:26.005814] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T18:37:26.101182] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T18:37:26.102319] [INFO ] [REMOTE ] ENFY: Full fetch complete (5655 records). [2025-09-19T18:37:26.102404] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-19T18:37:26.252344] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-19T18:37:26.499044] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-19T18:37:26.499145] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-19T18:37:26.499392] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-19T18:37:26.499454] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-19T18:37:26.499889] [DEBUG] [LOCAL ] ENFY: Trimmed 5655 records to 3085 (keeping 200 days of data) [2025-09-19T18:37:26.518141] [DEBUG] [LOCAL ] ENFY: Primary data saved (3085 records). [2025-09-19T18:37:26.518256] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-19T18:37:26.518356] [INFO ] [MAIN ] Update Progress: 736/2372 symbols completed. ENFY took 20.2s. Estimated remaining: 3h 36m 26s. Rate: 7.6 symbols/min [2025-09-19T18:37:26.700906] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:26.704770] [DEBUG] [LOCAL ] ENO: Loaded 2006 existing records from primary storage. [2025-09-19T18:37:26.704857] [INFO ] [MAIN ] ENO: Loaded 2006 existing records. [2025-09-19T18:37:26.893245] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:26.893531] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-19T18:37:26.893580] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-19T18:37:26.893824] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-19T18:37:26.893886] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-19T18:37:27.046700] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-19T18:37:27.255111] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:27.843263] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-19T18:37:28.474106] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-19T18:37:28.637434] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T18:37:28.648537] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-19T18:37:28.755555] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T18:37:29.443272] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-19T18:37:29.907527] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T18:37:30.243267] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-19T18:37:30.445301] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:37:31.043282] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-19T18:37:31.829624] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:37:31.843218] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-19T18:37:32.643284] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-19T18:37:33.443277] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-19T18:37:33.557634] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-19T18:37:33.829771] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:37:33.831547] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T18:37:34.243261] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-19T18:37:34.844544] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T18:37:35.043249] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-19T18:37:35.205557] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (3.36 seconds). [2025-09-19T18:37:35.843367] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-19T18:37:36.643267] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-19T18:37:37.140238] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:37:37.443270] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-19T18:37:37.582720] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:37:38.195433] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:37:38.203611] [INFO ] [REMOTE ] EMR: Full fetch complete (77110 records). [2025-09-19T18:37:38.203829] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-19T18:37:38.252185] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-19T18:37:38.626807] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-19T18:37:38.626909] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-19T18:37:38.628003] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-19T18:37:38.628082] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-19T18:37:38.629832] [DEBUG] [LOCAL ] EMR: Trimmed 77110 records to 54035 (keeping 200 days of data) [2025-09-19T18:37:38.864549] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T18:37:38.992963] [DEBUG] [LOCAL ] EMR: Primary data saved (54035 records). [2025-09-19T18:37:38.993168] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-19T18:37:38.994918] [INFO ] [MAIN ] Update Progress: 737/2372 symbols completed. EMR took 37.0s. Estimated remaining: 3h 36m 28s. Rate: 7.6 symbols/min [2025-09-19T18:37:39.051034] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-19T18:37:39.173600] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:39.218803] [DEBUG] [LOCAL ] ENOV: Loaded 45663 existing records from primary storage. [2025-09-19T18:37:39.218979] [INFO ] [MAIN ] ENOV: Loaded 45663 existing records. [2025-09-19T18:37:39.398929] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:39.399194] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-19T18:37:39.399254] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-19T18:37:39.400452] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-19T18:37:39.400512] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-19T18:37:39.551361] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T18:37:39.778103] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:39.811018] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-19T18:37:39.843223] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-19T18:37:40.643271] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-19T18:37:41.413898] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T18:37:41.443225] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-19T18:37:41.765258] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T18:37:42.243256] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-19T18:37:43.043234] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-19T18:37:43.394019] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T18:37:43.578960] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T18:37:43.586827] [INFO ] [REMOTE ] ENB: Full fetch complete (77492 records). [2025-09-19T18:37:43.586991] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-19T18:37:43.848339] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-19T18:37:43.975479] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-19T18:37:43.975562] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-19T18:37:43.976465] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-19T18:37:43.976530] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-19T18:37:43.978053] [DEBUG] [LOCAL ] ENB: Trimmed 77492 records to 54299 (keeping 200 days of data) [2025-09-19T18:37:44.226505] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-19T18:37:44.325568] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:37:44.353501] [DEBUG] [LOCAL ] ENB: Primary data saved (54299 records). [2025-09-19T18:37:44.353670] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-19T18:37:44.353797] [INFO ] [MAIN ] Update Progress: 738/2372 symbols completed. ENB took 40.7s. Estimated remaining: 3h 36m 15s. Rate: 7.6 symbols/min [2025-09-19T18:37:44.526631] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:44.566387] [DEBUG] [LOCAL ] ENR: Loaded 42861 existing records from primary storage. [2025-09-19T18:37:44.566530] [INFO ] [MAIN ] ENR: Loaded 42861 existing records. [2025-09-19T18:37:44.648454] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-19T18:37:44.744964] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:44.745327] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-19T18:37:44.745375] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-19T18:37:44.746374] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-19T18:37:44.746436] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-19T18:37:45.102516] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:45.443258] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-19T18:37:45.865833] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T18:37:45.870945] [INFO ] [REMOTE ] ENIC: Full fetch complete (51162 records). [2025-09-19T18:37:45.871048] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-19T18:37:46.241592] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-19T18:37:46.241698] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-19T18:37:46.242395] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-19T18:37:46.242456] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-19T18:37:46.243223] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-19T18:37:46.244400] [DEBUG] [LOCAL ] ENIC: Trimmed 51162 records to 37334 (keeping 200 days of data) [2025-09-19T18:37:46.460187] [DEBUG] [LOCAL ] ENIC: Primary data saved (37334 records). [2025-09-19T18:37:46.460438] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-19T18:37:46.460799] [INFO ] [MAIN ] Update Progress: 739/2372 symbols completed. ENIC took 35.1s. Estimated remaining: 3h 35m 54s. Rate: 7.6 symbols/min [2025-09-19T18:37:46.639435] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:46.669385] [DEBUG] [LOCAL ] ENS: Loaded 29560 existing records from primary storage. [2025-09-19T18:37:46.669527] [INFO ] [MAIN ] ENS: Loaded 29560 existing records. [2025-09-19T18:37:46.844078] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:46.844342] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-19T18:37:46.844399] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-19T18:37:46.845243] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-19T18:37:46.845312] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-19T18:37:47.050591] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-19T18:37:47.220608] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:47.245696] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T18:37:47.765666] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T18:37:47.843219] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-19T18:37:48.021394] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T18:37:48.370067] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-19T18:37:48.643348] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-19T18:37:49.443359] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-19T18:37:50.243238] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-19T18:37:50.246153] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T18:37:50.247864] [INFO ] [REMOTE ] ENO: Full fetch complete (3221 records). [2025-09-19T18:37:50.248024] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-19T18:37:50.449959] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T18:37:50.657388] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-19T18:37:50.657466] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-19T18:37:50.657586] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-19T18:37:50.657625] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-19T18:37:50.658014] [DEBUG] [LOCAL ] ENO: Trimmed 3221 records to 2016 (keeping 200 days of data) [2025-09-19T18:37:50.670661] [DEBUG] [LOCAL ] ENO: Primary data saved (2016 records). [2025-09-19T18:37:50.670730] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-19T18:37:50.670801] [INFO ] [MAIN ] Update Progress: 740/2372 symbols completed. ENO took 24.2s. Estimated remaining: 3h 35m 38s. Rate: 7.6 symbols/min [2025-09-19T18:37:50.886225] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:37:50.913943] [DEBUG] [LOCAL ] ENVA: Loaded 25959 existing records from primary storage. [2025-09-19T18:37:50.914078] [INFO ] [MAIN ] ENVA: Loaded 25959 existing records. [2025-09-19T18:37:51.055122] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-19T18:37:51.096389] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:37:51.097429] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-19T18:37:51.097482] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-19T18:37:51.098272] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-19T18:37:51.098339] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-19T18:37:51.469418] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:37:51.490045] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T18:37:51.843281] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-19T18:37:52.643276] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-19T18:37:52.973214] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T18:37:53.363428] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T18:37:53.443319] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-19T18:37:53.736346] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:37:54.243233] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-19T18:37:54.786670] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T18:37:55.043264] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-19T18:37:55.826129] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T18:37:55.843214] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-19T18:37:56.643291] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-19T18:37:56.852089] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T18:37:57.443283] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-19T18:37:58.162522] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T18:37:58.243252] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-19T18:37:58.732822] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-09-19T18:37:58.763320] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T18:37:59.043308] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-19T18:37:59.843268] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-19T18:38:00.190992] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T18:38:00.643246] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-19T18:38:00.733063] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T18:38:01.276195] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T18:38:01.443251] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-19T18:38:02.243257] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-19T18:38:02.639248] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T18:38:02.914265] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T18:38:03.043261] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-19T18:38:03.803238] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:38:03.843249] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-19T18:38:04.643312] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-19T18:38:05.096595] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:38:05.440325] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:38:05.446239] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-19T18:38:06.243252] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-19T18:38:06.386855] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T18:38:06.842555] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:38:07.043254] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-19T18:38:07.390680] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T18:38:07.843284] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-19T18:38:08.643308] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-19T18:38:08.900060] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T18:38:09.443245] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-19T18:38:09.482875] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T18:38:09.964848] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T18:38:10.243268] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-19T18:38:10.838142] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:38:11.043293] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-19T18:38:11.843301] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-19T18:38:11.866998] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T18:38:11.873472] [INFO ] [REMOTE ] ENR: Full fetch complete (57679 records). [2025-09-19T18:38:11.873676] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-19T18:38:11.875518] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:38:11.875613] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:38:11.875709] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:38:11.875800] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-19T18:38:11.875916] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-19T18:38:11.875985] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-19T18:38:11.876562] [DEBUG] [LOCAL ] ENR: Deleted derivative data file. [2025-09-19T18:38:11.876721] [INFO ] [MAIN ] Update Progress: 741/2372 symbols completed. ENR took 27.5s. Estimated remaining: 3h 35m 59s. Rate: 7.6 symbols/min [2025-09-19T18:38:12.056351] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:12.076712] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T18:38:12.092921] [DEBUG] [LOCAL ] EOD: Loaded 14253 existing records from primary storage. [2025-09-19T18:38:12.093102] [INFO ] [MAIN ] EOD: Loaded 14253 existing records. [2025-09-19T18:38:12.273834] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:12.274156] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-19T18:38:12.274239] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-19T18:38:12.275006] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-19T18:38:12.275070] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-19T18:38:12.642916] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:12.643235] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-19T18:38:13.443268] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-19T18:38:13.643000] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T18:38:13.725093] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T18:38:14.243282] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-19T18:38:14.870142] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T18:38:15.043276] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-19T18:38:15.325171] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T18:38:15.843277] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-19T18:38:16.643286] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-19T18:38:16.972990] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:38:17.204311] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T18:38:17.216758] [INFO ] [REMOTE ] ENOV: Full fetch complete (63002 records). [2025-09-19T18:38:17.216997] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-19T18:38:17.463070] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-19T18:38:17.761078] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-19T18:38:17.761193] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-19T18:38:17.762390] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-19T18:38:17.762469] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-19T18:38:17.764277] [DEBUG] [LOCAL ] ENOV: Trimmed 63002 records to 45945 (keeping 200 days of data) [2025-09-19T18:38:18.050356] [DEBUG] [LOCAL ] ENOV: Primary data saved (45945 records). [2025-09-19T18:38:18.050534] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-19T18:38:18.050684] [INFO ] [MAIN ] Update Progress: 742/2372 symbols completed. ENOV took 39.1s. Estimated remaining: 3h 35m 47s. Rate: 7.6 symbols/min [2025-09-19T18:38:18.229235] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:18.243271] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-19T18:38:18.284911] [DEBUG] [LOCAL ] EOG: Loaded 53731 existing records from primary storage. [2025-09-19T18:38:18.285061] [INFO ] [MAIN ] EOG: Loaded 53731 existing records. [2025-09-19T18:38:18.472390] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:18.472798] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-19T18:38:18.472879] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-19T18:38:18.483978] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-19T18:38:18.486456] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-19T18:38:18.493514] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T18:38:18.609447] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T18:38:18.903729] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:19.043279] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-19T18:38:19.337920] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:38:19.843283] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-19T18:38:20.635046] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T18:38:20.645359] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-19T18:38:21.182565] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T18:38:21.443286] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-19T18:38:21.673908] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T18:38:22.243283] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-19T18:38:23.043312] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-19T18:38:23.357379] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T18:38:23.404173] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T18:38:23.843277] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-19T18:38:24.450525] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:38:24.454871] [INFO ] [REMOTE ] ENVA: Full fetch complete (36527 records). [2025-09-19T18:38:24.454958] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-19T18:38:24.652747] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-19T18:38:24.835022] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-19T18:38:24.835119] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-19T18:38:24.835996] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-19T18:38:24.836058] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-19T18:38:24.836982] [DEBUG] [LOCAL ] ENVA: Trimmed 36527 records to 26160 (keeping 200 days of data) [2025-09-19T18:38:24.942625] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T18:38:25.010604] [DEBUG] [LOCAL ] ENVA: Primary data saved (26160 records). [2025-09-19T18:38:25.010765] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-19T18:38:25.010871] [INFO ] [MAIN ] Update Progress: 743/2372 symbols completed. ENVA took 34.3s. Estimated remaining: 3h 35m 37s. Rate: 7.6 symbols/min [2025-09-19T18:38:25.180084] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:25.191274] [DEBUG] [LOCAL ] EOI: Loaded 10796 existing records from primary storage. [2025-09-19T18:38:25.191407] [INFO ] [MAIN ] EOI: Loaded 10796 existing records. [2025-09-19T18:38:25.371580] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:25.371943] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-19T18:38:25.372029] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-19T18:38:25.372466] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-19T18:38:25.372529] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-19T18:38:25.448390] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-19T18:38:25.741631] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:26.243302] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-19T18:38:26.298671] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T18:38:26.675775] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T18:38:27.043279] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-19T18:38:27.843322] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-19T18:38:27.892410] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T18:38:27.898976] [INFO ] [REMOTE ] ENS: Full fetch complete (41765 records). [2025-09-19T18:38:27.899076] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-19T18:38:28.096698] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T18:38:28.287268] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-19T18:38:28.287358] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-19T18:38:28.288056] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-19T18:38:28.288122] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-19T18:38:28.290599] [DEBUG] [LOCAL ] ENS: Trimmed 41765 records to 29761 (keeping 200 days of data) [2025-09-19T18:38:28.487122] [DEBUG] [LOCAL ] ENS: Primary data saved (29761 records). [2025-09-19T18:38:28.487353] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-19T18:38:28.487483] [INFO ] [MAIN ] Update Progress: 744/2372 symbols completed. ENS took 42.0s. Estimated remaining: 3h 35m 19s. Rate: 7.6 symbols/min [2025-09-19T18:38:28.660242] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:28.656756] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-19T18:38:28.681554] [DEBUG] [LOCAL ] EOS: Loaded 15700 existing records from primary storage. [2025-09-19T18:38:28.681715] [INFO ] [MAIN ] EOS: Loaded 15700 existing records. [2025-09-19T18:38:28.865454] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:28.865737] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-19T18:38:28.865795] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-19T18:38:28.866265] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-19T18:38:28.866337] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-19T18:38:29.235026] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:29.443266] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-19T18:38:30.000379] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T18:38:30.066845] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:38:30.243246] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-19T18:38:30.437777] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T18:38:31.043261] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-19T18:38:31.448037] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T18:38:31.843286] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-19T18:38:32.643301] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-19T18:38:32.898769] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T18:38:32.901104] [INFO ] [REMOTE ] EOD: Full fetch complete (19727 records). [2025-09-19T18:38:32.901233] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-19T18:38:33.309431] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-19T18:38:33.309688] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-19T18:38:33.310380] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-19T18:38:33.310523] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-19T18:38:33.311830] [DEBUG] [LOCAL ] EOD: Trimmed 19727 records to 14342 (keeping 200 days of data) [2025-09-19T18:38:33.367072] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T18:38:33.416738] [DEBUG] [LOCAL ] EOD: Primary data saved (14342 records). [2025-09-19T18:38:33.417085] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-19T18:38:33.417258] [INFO ] [MAIN ] Update Progress: 745/2372 symbols completed. EOD took 21.5s. Estimated remaining: 3h 35m 5s. Rate: 7.6 symbols/min [2025-09-19T18:38:33.454077] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-19T18:38:33.638549] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:33.641049] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T18:38:33.663427] [DEBUG] [LOCAL ] EOT: Loaded 6898 existing records from primary storage. [2025-09-19T18:38:33.663565] [INFO ] [MAIN ] EOT: Loaded 6898 existing records. [2025-09-19T18:38:33.851621] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:33.851938] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-19T18:38:33.852025] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-19T18:38:33.852410] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-19T18:38:33.852480] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-19T18:38:34.214777] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:34.243234] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-19T18:38:34.463240] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T18:38:34.930154] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-19T18:38:35.043265] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-19T18:38:35.843262] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-19T18:38:35.923446] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:38:36.643294] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-19T18:38:37.176480] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T18:38:37.188944] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T18:38:37.443299] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-19T18:38:38.243262] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-19T18:38:38.485547] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T18:38:39.043271] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-19T18:38:39.184607] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T18:38:39.843266] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-19T18:38:40.151756] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T18:38:40.643234] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-19T18:38:41.161010] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T18:38:41.257274] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T18:38:41.443291] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-19T18:38:42.243284] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-19T18:38:43.043283] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-19T18:38:43.087019] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T18:38:43.666084] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T18:38:43.674386] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-19T18:38:43.843276] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-19T18:38:44.643269] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-19T18:38:44.799054] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T18:38:45.437348] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T18:38:45.443217] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-19T18:38:46.243258] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-19T18:38:46.534993] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T18:38:47.043273] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-19T18:38:47.281558] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T18:38:47.843272] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-19T18:38:48.587763] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:38:48.643227] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-19T18:38:48.836977] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T18:38:49.443231] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-19T18:38:49.774910] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:38:50.243260] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-19T18:38:51.043271] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-19T18:38:51.290248] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T18:38:51.697960] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T18:38:51.843238] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-19T18:38:52.107510] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T18:38:52.643285] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-19T18:38:53.334603] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T18:38:53.443220] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-19T18:38:53.696515] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T18:38:54.243269] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-19T18:38:54.681140] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T18:38:54.684965] [INFO ] [REMOTE ] EOS: Full fetch complete (23094 records). [2025-09-19T18:38:54.685270] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-19T18:38:55.051188] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-19T18:38:55.063191] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-19T18:38:55.063300] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-19T18:38:55.063961] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-19T18:38:55.064025] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-19T18:38:55.064727] [DEBUG] [LOCAL ] EOS: Trimmed 23094 records to 15784 (keeping 200 days of data) [2025-09-19T18:38:55.175311] [DEBUG] [LOCAL ] EOS: Primary data saved (15784 records). [2025-09-19T18:38:55.178517] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-19T18:38:55.178777] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T18:38:55.179062] [INFO ] [MAIN ] Update Progress: 746/2372 symbols completed. EOS took 26.7s. Estimated remaining: 3h 35m 27s. Rate: 7.5 symbols/min [2025-09-19T18:38:55.353725] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:55.382523] [DEBUG] [LOCAL ] EPAC: Loaded 27231 existing records from primary storage. [2025-09-19T18:38:55.382693] [INFO ] [MAIN ] EPAC: Loaded 27231 existing records. [2025-09-19T18:38:55.574612] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:55.574960] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-19T18:38:55.575019] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-19T18:38:55.575952] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-19T18:38:55.576020] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-19T18:38:55.848734] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-19T18:38:55.957956] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:56.643246] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-19T18:38:56.882036] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T18:38:57.303986] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T18:38:57.313660] [INFO ] [REMOTE ] EOG: Full fetch complete (77267 records). [2025-09-19T18:38:57.313852] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-19T18:38:57.455218] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-19T18:38:57.629106] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T18:38:57.736429] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-19T18:38:57.736526] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-19T18:38:57.737672] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-19T18:38:57.737766] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-19T18:38:57.739426] [DEBUG] [LOCAL ] EOG: Trimmed 77267 records to 54121 (keeping 200 days of data) [2025-09-19T18:38:58.090445] [DEBUG] [LOCAL ] EOG: Primary data saved (54121 records). [2025-09-19T18:38:58.090591] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-19T18:38:58.092296] [INFO ] [MAIN ] Update Progress: 747/2372 symbols completed. EOG took 40.0s. Estimated remaining: 3h 35m 8s. Rate: 7.6 symbols/min [2025-09-19T18:38:58.247367] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-19T18:38:58.264893] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:58.315905] [DEBUG] [LOCAL ] EPAM: Loaded 40056 existing records from primary storage. [2025-09-19T18:38:58.316062] [INFO ] [MAIN ] EPAM: Loaded 40056 existing records. [2025-09-19T18:38:58.499033] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:58.500487] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-19T18:38:58.500556] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-19T18:38:58.502319] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-19T18:38:58.502380] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-19T18:38:58.777557] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T18:38:58.804227] [INFO ] [REMOTE ] EOI: Full fetch complete (15988 records). [2025-09-19T18:38:58.820163] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-19T18:38:58.970792] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:38:59.052426] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-19T18:38:59.270137] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-19T18:38:59.270221] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-19T18:38:59.270568] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-19T18:38:59.270606] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-19T18:38:59.271163] [DEBUG] [LOCAL ] EOI: Trimmed 15988 records to 10854 (keeping 200 days of data) [2025-09-19T18:38:59.346701] [DEBUG] [LOCAL ] EOI: Primary data saved (10854 records). [2025-09-19T18:38:59.346857] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-19T18:38:59.346945] [INFO ] [MAIN ] Update Progress: 748/2372 symbols completed. EOI took 34.3s. Estimated remaining: 3h 34m 46s. Rate: 7.6 symbols/min [2025-09-19T18:38:59.519848] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:38:59.574354] [DEBUG] [LOCAL ] EPC: Loaded 40244 existing records from primary storage. [2025-09-19T18:38:59.574494] [INFO ] [MAIN ] EPC: Loaded 40244 existing records. [2025-09-19T18:38:59.750260] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:38:59.750483] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-19T18:38:59.750551] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-19T18:38:59.751761] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-19T18:38:59.751821] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-19T18:38:59.849910] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-19T18:39:00.119619] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T18:39:00.154815] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:00.155923] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T18:39:00.158067] [INFO ] [REMOTE ] EOT: Full fetch complete (10887 records). [2025-09-19T18:39:00.158140] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-19T18:39:00.518193] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-19T18:39:00.518304] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-19T18:39:00.518611] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-19T18:39:00.518672] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-19T18:39:00.519122] [DEBUG] [LOCAL ] EOT: Trimmed 10887 records to 6926 (keeping 200 days of data) [2025-09-19T18:39:00.562492] [DEBUG] [LOCAL ] EOT: Primary data saved (6926 records). [2025-09-19T18:39:00.562596] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-19T18:39:00.562706] [INFO ] [MAIN ] Update Progress: 749/2372 symbols completed. EOT took 27.1s. Estimated remaining: 3h 34m 23s. Rate: 7.6 symbols/min [2025-09-19T18:39:00.652423] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-19T18:39:00.735776] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:00.799729] [DEBUG] [LOCAL ] EPD: Loaded 54006 existing records from primary storage. [2025-09-19T18:39:00.799876] [INFO ] [MAIN ] EPD: Loaded 54006 existing records. [2025-09-19T18:39:00.975397] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:00.975706] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-19T18:39:00.975763] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-19T18:39:00.977603] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-19T18:39:00.977688] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-19T18:39:01.357613] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:01.443246] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-19T18:39:01.541937] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T18:39:01.986264] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:39:02.243290] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-19T18:39:03.043287] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-19T18:39:03.843278] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-19T18:39:04.636356] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T18:39:04.643308] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-19T18:39:04.906669] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (3.46 seconds). [2025-09-19T18:39:05.069431] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-09-19T18:39:05.443270] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-19T18:39:05.744266] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T18:39:06.243304] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-19T18:39:06.522999] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T18:39:07.043313] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-19T18:39:07.553105] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T18:39:07.843241] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-19T18:39:07.909305] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:39:08.077746] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T18:39:08.643293] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-19T18:39:09.443349] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-19T18:39:09.857417] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T18:39:10.243301] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-19T18:39:10.576391] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T18:39:10.940796] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T18:39:11.043244] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-19T18:39:11.605582] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:39:11.843295] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-19T18:39:12.643306] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-19T18:39:13.022139] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T18:39:13.140887] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T18:39:13.443269] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-19T18:39:14.243276] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-19T18:39:14.316034] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T18:39:15.043274] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-19T18:39:15.827091] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T18:39:15.843227] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-19T18:39:16.643312] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-19T18:39:16.704241] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T18:39:17.419908] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-09-19T18:39:17.453052] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-19T18:39:17.460435] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:39:18.243298] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-19T18:39:18.866342] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:39:19.043333] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-19T18:39:19.178322] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T18:39:19.391914] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:39:19.843272] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-19T18:39:20.643279] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-19T18:39:21.443250] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-19T18:39:21.779828] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-19T18:39:21.883835] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T18:39:22.243295] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-19T18:39:22.622747] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:39:23.043247] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-19T18:39:23.276864] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T18:39:23.843285] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-19T18:39:23.980287] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T18:39:24.643354] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-19T18:39:25.268711] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T18:39:25.275005] [INFO ] [REMOTE ] EPAM: Full fetch complete (56001 records). [2025-09-19T18:39:25.275126] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-19T18:39:25.445695] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-19T18:39:25.680790] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-19T18:39:25.681025] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-19T18:39:25.681862] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-19T18:39:25.681969] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-19T18:39:25.683512] [DEBUG] [LOCAL ] EPAM: Trimmed 56001 records to 40338 (keeping 200 days of data) [2025-09-19T18:39:25.798851] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:39:25.961032] [DEBUG] [LOCAL ] EPAM: Primary data saved (40338 records). [2025-09-19T18:39:25.961177] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-19T18:39:25.961263] [INFO ] [MAIN ] Update Progress: 750/2372 symbols completed. EPAM took 27.9s. Estimated remaining: 3h 34m 53s. Rate: 7.5 symbols/min [2025-09-19T18:39:26.134271] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:26.175254] [DEBUG] [LOCAL ] EPR: Loaded 44723 existing records from primary storage. [2025-09-19T18:39:26.175400] [INFO ] [MAIN ] EPR: Loaded 44723 existing records. [2025-09-19T18:39:26.244453] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-19T18:39:26.368416] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:26.368868] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-19T18:39:26.368996] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-19T18:39:26.371138] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-19T18:39:26.371223] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-19T18:39:26.587623] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T18:39:26.781729] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:27.043337] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-19T18:39:27.263460] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T18:39:27.267595] [INFO ] [REMOTE ] EPAC: Full fetch complete (38760 records). [2025-09-19T18:39:27.267727] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-19T18:39:27.268241] [FATAL] [VALIDATOR ] EPAC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:39:27.268326] [FATAL] [MAIN ] EPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:39:27.268368] [WARN ] [MAIN ] EPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:39:27.268438] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-19T18:39:27.268501] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-09-19T18:39:27.268536] [INFO ] [LOCAL ] EPAC: Starting deletion of derivative data. [2025-09-19T18:39:27.269021] [DEBUG] [LOCAL ] EPAC: Deleted derivative data file. [2025-09-19T18:39:27.269115] [INFO ] [MAIN ] Update Progress: 751/2372 symbols completed. EPAC took 32.1s. Estimated remaining: 3h 34m 31s. Rate: 7.6 symbols/min [2025-09-19T18:39:27.442450] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:27.494711] [DEBUG] [LOCAL ] EPRT: Loaded 49084 existing records from primary storage. [2025-09-19T18:39:27.494862] [INFO ] [MAIN ] EPRT: Loaded 49084 existing records. [2025-09-19T18:39:27.695523] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:27.695817] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-19T18:39:27.695872] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-19T18:39:27.697030] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-19T18:39:27.697098] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-19T18:39:27.849956] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-19T18:39:28.073768] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:28.101572] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T18:39:28.433681] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T18:39:28.643263] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-19T18:39:29.443304] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-19T18:39:30.248891] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-19T18:39:30.263426] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-19T18:39:30.622601] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T18:39:31.043236] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-19T18:39:31.135297] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:39:31.811301] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:39:31.843249] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-19T18:39:32.165992] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:39:32.643302] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-19T18:39:33.443302] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-19T18:39:33.686174] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T18:39:34.243254] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-19T18:39:34.412258] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:39:35.043253] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-19T18:39:35.659723] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T18:39:35.722499] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T18:39:35.843221] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-19T18:39:36.643261] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-19T18:39:37.043082] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T18:39:37.172037] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:39:37.443277] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-19T18:39:38.243268] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-19T18:39:38.314917] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T18:39:38.322808] [INFO ] [REMOTE ] EPD: Full fetch complete (77643 records). [2025-09-19T18:39:38.322947] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-19T18:39:38.734753] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-19T18:39:38.734951] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-19T18:39:38.735966] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-19T18:39:38.736056] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-19T18:39:38.755191] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T18:39:38.761322] [DEBUG] [LOCAL ] EPD: Trimmed 77643 records to 54396 (keeping 200 days of data) [2025-09-19T18:39:38.762462] [INFO ] [REMOTE ] EPC: Full fetch complete (56704 records). [2025-09-19T18:39:38.762588] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-19T18:39:39.052903] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-19T18:39:39.307062] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-19T18:39:39.307723] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-19T18:39:39.309754] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-19T18:39:39.310102] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-19T18:39:39.317207] [DEBUG] [LOCAL ] EPC: Trimmed 56704 records to 40556 (keeping 200 days of data) [2025-09-19T18:39:39.803178] [DEBUG] [LOCAL ] EPC: Primary data saved (40556 records). [2025-09-19T18:39:39.803751] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-19T18:39:39.805452] [INFO ] [MAIN ] Update Progress: 752/2372 symbols completed. EPC took 40.5s. Estimated remaining: 3h 34m 33s. Rate: 7.6 symbols/min [2025-09-19T18:39:39.808475] [DEBUG] [LOCAL ] EPD: Primary data saved (54396 records). [2025-09-19T18:39:39.820420] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-19T18:39:39.820580] [INFO ] [MAIN ] Update Progress: 753/2372 symbols completed. EPD took 39.3s. Estimated remaining: 3h 34m 8s. Rate: 7.6 symbols/min [2025-09-19T18:39:40.143584] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:40.172244] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:40.211342] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:39:40.224044] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-19T18:39:40.229190] [DEBUG] [LOCAL ] EQBK: Loaded 10975 existing records from primary storage. [2025-09-19T18:39:40.232355] [INFO ] [MAIN ] EQBK: Loaded 10975 existing records. [2025-09-19T18:39:40.431576] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:40.432509] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-19T18:39:40.432748] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-19T18:39:40.450888] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-19T18:39:40.453269] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-19T18:39:40.498339] [DEBUG] [LOCAL ] EQH: Loaded 53057 existing records from primary storage. [2025-09-19T18:39:40.546387] [INFO ] [MAIN ] EQH: Loaded 53057 existing records. [2025-09-19T18:39:40.864691] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:40.942774] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-19T18:39:40.946188] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-19T18:39:40.962762] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-19T18:39:40.962881] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-19T18:39:41.064882] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:41.098031] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-19T18:39:41.175428] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T18:39:41.460014] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:41.454158] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-19T18:39:42.122119] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T18:39:42.149012] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T18:39:42.243230] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-19T18:39:43.043265] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-19T18:39:43.562489] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T18:39:43.768436] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:39:43.843281] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-19T18:39:44.471520] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T18:39:44.643299] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-19T18:39:45.443273] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-19T18:39:45.885715] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T18:39:46.010510] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T18:39:46.243264] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-19T18:39:46.988474] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T18:39:47.043217] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-19T18:39:47.843279] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-19T18:39:48.206311] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:39:48.643276] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-19T18:39:48.952630] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T18:39:49.191404] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T18:39:49.198295] [INFO ] [REMOTE ] EPR: Full fetch complete (62874 records). [2025-09-19T18:39:49.198424] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-19T18:39:49.448430] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-19T18:39:49.610614] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-19T18:39:49.610741] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-19T18:39:49.611535] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-19T18:39:49.611581] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-19T18:39:49.613063] [DEBUG] [LOCAL ] EPR: Trimmed 62874 records to 45037 (keeping 200 days of data) [2025-09-19T18:39:49.918218] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T18:39:49.966550] [DEBUG] [LOCAL ] EPR: Primary data saved (45037 records). [2025-09-19T18:39:49.966713] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-19T18:39:49.966812] [INFO ] [MAIN ] Update Progress: 754/2372 symbols completed. EPR took 24.0s. Estimated remaining: 3h 34m 5s. Rate: 7.6 symbols/min [2025-09-19T18:39:50.146261] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:50.155164] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T18:39:50.204194] [DEBUG] [LOCAL ] EQNR: Loaded 53434 existing records from primary storage. [2025-09-19T18:39:50.204342] [INFO ] [MAIN ] EQNR: Loaded 53434 existing records. [2025-09-19T18:39:50.248357] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-19T18:39:50.388790] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:50.389039] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-19T18:39:50.389087] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-19T18:39:50.390677] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-19T18:39:50.390738] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-19T18:39:50.740707] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:51.043319] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-19T18:39:51.305485] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T18:39:51.843320] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-19T18:39:52.643273] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-19T18:39:53.023958] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T18:39:53.443328] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-19T18:39:53.777244] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T18:39:53.784601] [INFO ] [REMOTE ] EPRT: Full fetch complete (68629 records). [2025-09-19T18:39:53.784770] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-19T18:39:54.185074] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-19T18:39:54.185161] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-19T18:39:54.186053] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-19T18:39:54.186116] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-19T18:39:54.187504] [DEBUG] [LOCAL ] EPRT: Trimmed 68629 records to 49420 (keeping 200 days of data) [2025-09-19T18:39:54.248325] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-19T18:39:54.494620] [DEBUG] [LOCAL ] EPRT: Primary data saved (49420 records). [2025-09-19T18:39:54.494800] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-19T18:39:54.494909] [INFO ] [MAIN ] Update Progress: 755/2372 symbols completed. EPRT took 27.2s. Estimated remaining: 3h 33m 49s. Rate: 7.6 symbols/min [2025-09-19T18:39:54.666017] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:39:54.715031] [DEBUG] [LOCAL ] EQR: Loaded 51751 existing records from primary storage. [2025-09-19T18:39:54.715178] [INFO ] [MAIN ] EQR: Loaded 51751 existing records. [2025-09-19T18:39:54.904269] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:39:54.905274] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-19T18:39:54.905404] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-19T18:39:54.913122] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-19T18:39:54.925083] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-19T18:39:54.930745] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T18:39:55.047284] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-19T18:39:55.049303] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-19T18:39:55.317288] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:39:55.615560] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T18:39:55.843276] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-19T18:39:56.201437] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T18:39:56.643300] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-19T18:39:57.443328] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-19T18:39:57.797316] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T18:39:58.243278] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-19T18:39:58.371333] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T18:39:58.753187] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T18:39:59.043278] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-19T18:39:59.743780] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T18:39:59.843268] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-19T18:40:00.643277] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-19T18:40:00.946512] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:40:01.009870] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T18:40:01.443308] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-19T18:40:02.243335] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-19T18:40:02.264558] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T18:40:02.759827] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-19T18:40:03.043339] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-19T18:40:03.808707] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T18:40:03.828573] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-19T18:40:03.843214] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-19T18:40:04.643276] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-19T18:40:04.966823] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T18:40:04.969229] [INFO ] [REMOTE ] EQBK: Full fetch complete (15505 records). [2025-09-19T18:40:04.969314] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-19T18:40:05.355028] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-19T18:40:05.355141] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-19T18:40:05.355505] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-19T18:40:05.355566] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-19T18:40:05.356169] [DEBUG] [LOCAL ] EQBK: Trimmed 15505 records to 11059 (keeping 200 days of data) [2025-09-19T18:40:05.422503] [DEBUG] [LOCAL ] EQBK: Primary data saved (11059 records). [2025-09-19T18:40:05.422662] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-19T18:40:05.422832] [INFO ] [MAIN ] Update Progress: 756/2372 symbols completed. EQBK took 25.6s. Estimated remaining: 3h 33m 48s. Rate: 7.6 symbols/min [2025-09-19T18:40:05.452573] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-19T18:40:05.599777] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:05.599960] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-19T18:40:05.599999] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-19T18:40:05.600221] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-19T18:40:05.600275] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-19T18:40:05.600383] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-19T18:40:05.600449] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-19T18:40:05.951712] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:06.243335] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-19T18:40:06.591616] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T18:40:06.716349] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-19T18:40:07.043354] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-19T18:40:07.313600] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T18:40:07.492335] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-19T18:40:07.843258] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-19T18:40:08.643283] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-19T18:40:09.443310] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-19T18:40:10.065832] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T18:40:10.179865] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T18:40:10.243275] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-19T18:40:10.880229] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T18:40:11.043263] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-19T18:40:11.843271] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-19T18:40:12.276704] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-19T18:40:12.279597] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:40:12.643270] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-19T18:40:13.072807] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T18:40:13.443269] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-19T18:40:14.243297] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-19T18:40:14.572594] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-19T18:40:14.622954] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:40:14.800972] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:40:14.808848] [INFO ] [REMOTE ] EQH: Full fetch complete (75912 records). [2025-09-19T18:40:14.808992] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-19T18:40:14.809946] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:40:14.810037] [FATAL] [MAIN ] EQH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:40:14.810081] [WARN ] [MAIN ] EQH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:40:14.810125] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-19T18:40:14.810243] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-19T18:40:14.810309] [INFO ] [LOCAL ] EQH: Starting deletion of derivative data. [2025-09-19T18:40:14.810711] [DEBUG] [LOCAL ] EQH: Deleted derivative data file. [2025-09-19T18:40:14.810869] [INFO ] [MAIN ] Update Progress: 757/2372 symbols completed. EQH took 35.0s. Estimated remaining: 3h 33m 43s. Rate: 7.6 symbols/min [2025-09-19T18:40:15.043271] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-19T18:40:15.465983] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T18:40:15.843261] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-19T18:40:16.266847] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-19T18:40:16.643267] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-19T18:40:17.443268] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-19T18:40:17.596506] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T18:40:18.243272] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-19T18:40:18.824432] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-19T18:40:19.043328] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-19T18:40:19.843281] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-19T18:40:20.264769] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-19T18:40:20.600082] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T18:40:20.643338] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-19T18:40:21.145087] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T18:40:21.443261] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-19T18:40:22.250299] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-19T18:40:22.269632] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T18:40:22.857048] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T18:40:22.856904] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T18:40:22.858822] [INFO ] [REMOTE ] EQS: Full fetch complete (2528 records). [2025-09-19T18:40:22.872718] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-19T18:40:23.048826] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-19T18:40:23.054326] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-19T18:40:23.055201] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:40:23.055276] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:40:23.055350] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-19T18:40:23.055409] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-19T18:40:23.055445] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-19T18:40:23.055502] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-19T18:40:23.055584] [INFO ] [MAIN ] Update Progress: 758/2372 symbols completed. EQS took 17.6s. Estimated remaining: 3h 33m 36s. Rate: 7.6 symbols/min [2025-09-19T18:40:23.843269] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-19T18:40:24.605057] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T18:40:24.643226] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-19T18:40:25.917180] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T18:40:25.928732] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-19T18:40:26.926498] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-19T18:40:26.938089] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-19T18:40:27.503261] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T18:40:27.510911] [INFO ] [REMOTE ] EQR: Full fetch complete (73682 records). [2025-09-19T18:40:27.511039] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-19T18:40:27.915548] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-19T18:40:27.915637] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-19T18:40:27.916627] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-19T18:40:27.916719] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-19T18:40:27.918301] [DEBUG] [LOCAL ] EQR: Trimmed 73682 records to 52136 (keeping 200 days of data) [2025-09-19T18:40:28.237996] [DEBUG] [LOCAL ] EQR: Primary data saved (52136 records). [2025-09-19T18:40:28.238169] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-19T18:40:28.238269] [INFO ] [MAIN ] Update Progress: 759/2372 symbols completed. EQR took 33.7s. Estimated remaining: 3h 33m 22s. Rate: 7.6 symbols/min [2025-09-19T18:40:28.588375] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T18:40:28.596215] [INFO ] [REMOTE ] EQNR: Full fetch complete (76744 records). [2025-09-19T18:40:28.596347] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-19T18:40:29.004685] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-19T18:40:29.004846] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-19T18:40:29.005775] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-19T18:40:29.005839] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-19T18:40:29.007390] [DEBUG] [LOCAL ] EQNR: Trimmed 76744 records to 53821 (keeping 200 days of data) [2025-09-19T18:40:29.337215] [DEBUG] [LOCAL ] EQNR: Primary data saved (53821 records). [2025-09-19T18:40:29.337359] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-19T18:40:29.337461] [INFO ] [MAIN ] Update Progress: 760/2372 symbols completed. EQNR took 39.4s. Estimated remaining: 3h 32m 60s. Rate: 7.6 symbols/min [2025-09-19T18:40:29.891107] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:30.046876] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:30.075363] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:30.097084] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:30.103084] [DEBUG] [LOCAL ] EQV: Loaded 2930 existing records from primary storage. [2025-09-19T18:40:30.103274] [INFO ] [MAIN ] EQV: Loaded 2930 existing records. [2025-09-19T18:40:30.263090] [DEBUG] [LOCAL ] ERO: Loaded 41425 existing records from primary storage. [2025-09-19T18:40:30.294434] [INFO ] [MAIN ] ERO: Loaded 41425 existing records. [2025-09-19T18:40:30.353596] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:30.400463] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-19T18:40:30.423173] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-19T18:40:30.447896] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-19T18:40:30.482530] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-09-19T18:40:30.497460] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-19T18:40:30.497767] [INFO ] [MAIN ] EQT: Loaded 54072 existing records. [2025-09-19T18:40:30.514107] [DEBUG] [LOCAL ] ERJ: Loaded 51280 existing records from primary storage. [2025-09-19T18:40:30.575631] [INFO ] [MAIN ] ERJ: Loaded 51280 existing records. [2025-09-19T18:40:30.838447] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:30.961373] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-19T18:40:31.006578] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-19T18:40:31.069815] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-19T18:40:31.080292] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-19T18:40:31.117789] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:31.210142] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-19T18:40:31.267159] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-19T18:40:31.415934] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-19T18:40:31.462449] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-19T18:40:31.354403] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:31.533536] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-19T18:40:31.623182] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-19T18:40:31.728269] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-19T18:40:31.769052] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-19T18:40:31.936970] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:31.973340] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-19T18:40:32.215497] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:32.246356] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-19T18:40:32.417760] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:32.433941] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-19T18:40:32.620603] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:32.620918] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-19T18:40:32.748847] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-19T18:40:32.750949] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-19T18:40:33.911884] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T18:40:33.914418] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-19T18:40:34.128492] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T18:40:34.136541] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-19T18:40:34.261400] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T18:40:34.271365] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-19T18:40:34.303891] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T18:40:34.314566] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-19T18:40:34.655322] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:40:34.657030] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-19T18:40:35.091574] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-19T18:40:35.093572] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-19T18:40:35.243448] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T18:40:35.607137] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-19T18:40:35.843271] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-19T18:40:36.186360] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T18:40:36.241069] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T18:40:36.378983] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T18:40:36.643276] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-19T18:40:37.443272] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-19T18:40:38.243264] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-19T18:40:38.596756] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T18:40:38.988203] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T18:40:39.043240] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-19T18:40:39.632479] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T18:40:39.843261] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-19T18:40:40.208027] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T18:40:40.643268] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-19T18:40:41.443261] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-19T18:40:41.568255] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T18:40:42.248414] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-19T18:40:42.274340] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-19T18:40:43.043258] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-19T18:40:43.206327] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T18:40:43.255949] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:40:43.843258] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-19T18:40:44.643283] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-19T18:40:45.003007] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T18:40:45.443266] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-19T18:40:45.543940] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T18:40:46.243243] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-19T18:40:46.897488] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T18:40:47.043276] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-19T18:40:47.320459] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T18:40:47.843241] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-19T18:40:47.972383] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T18:40:48.518164] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T18:40:48.519367] [INFO ] [REMOTE ] EQV: Full fetch complete (5709 records). [2025-09-19T18:40:48.519441] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-19T18:40:48.519898] [FATAL] [VALIDATOR ] EQV: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:40:48.519995] [FATAL] [MAIN ] EQV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:40:48.520064] [WARN ] [MAIN ] EQV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:40:48.520149] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-19T18:40:48.520233] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-09-19T18:40:48.520273] [INFO ] [LOCAL ] EQV: Starting deletion of derivative data. [2025-09-19T18:40:48.520721] [DEBUG] [LOCAL ] EQV: Deleted derivative data file. [2025-09-19T18:40:48.520844] [INFO ] [MAIN ] Update Progress: 761/2372 symbols completed. EQV took 19.2s. Estimated remaining: 3h 33m 15s. Rate: 7.6 symbols/min [2025-09-19T18:40:48.648384] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-19T18:40:48.728995] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:40:48.792223] [DEBUG] [LOCAL ] ES: Loaded 52905 existing records from primary storage. [2025-09-19T18:40:48.792386] [INFO ] [MAIN ] ES: Loaded 52905 existing records. [2025-09-19T18:40:48.981511] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:40:48.982118] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-19T18:40:48.982218] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-19T18:40:48.983794] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-19T18:40:48.983863] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-19T18:40:49.184095] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T18:40:49.424778] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:40:49.443220] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-19T18:40:49.997181] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:40:50.243276] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-19T18:40:51.043265] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-19T18:40:51.470816] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T18:40:51.843272] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-19T18:40:52.127123] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T18:40:52.643283] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-19T18:40:52.767618] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T18:40:53.316496] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T18:40:53.443324] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-19T18:40:54.243279] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-19T18:40:54.641297] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T18:40:54.916942] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T18:40:55.043399] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-19T18:40:55.549330] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T18:40:55.843316] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-19T18:40:56.643281] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-19T18:40:57.152705] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:40:57.443243] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-19T18:40:57.631139] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:40:58.243300] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-19T18:40:58.350268] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T18:40:59.043309] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-19T18:40:59.653264] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T18:40:59.843260] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-19T18:41:00.578357] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-19T18:41:00.643290] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-19T18:41:01.101934] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T18:41:01.443300] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-19T18:41:02.190590] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-19T18:41:02.199311] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-19T18:41:02.199531] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-19T18:41:02.266108] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-19T18:41:02.645022] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-19T18:41:02.645628] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-19T18:41:02.647572] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T18:41:02.658985] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-19T18:41:02.659601] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-19T18:41:02.661325] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 54462 (keeping 200 days of data) [2025-09-19T18:41:03.004147] [DEBUG] [LOCAL ] EQT: Primary data saved (54462 records). [2025-09-19T18:41:03.004343] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-19T18:41:03.004512] [INFO ] [MAIN ] Update Progress: 762/2372 symbols completed. EQT took 33.7s. Estimated remaining: 3h 33m 21s. Rate: 7.5 symbols/min [2025-09-19T18:41:03.048621] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-19T18:41:03.182515] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:03.210844] [DEBUG] [LOCAL ] ESAB: Loaded 25833 existing records from primary storage. [2025-09-19T18:41:03.210986] [INFO ] [MAIN ] ESAB: Loaded 25833 existing records. [2025-09-19T18:41:03.390342] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:03.390678] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-19T18:41:03.390753] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-19T18:41:03.391726] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-19T18:41:03.391811] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-19T18:41:03.784178] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T18:41:03.812541] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:03.842972] [INFO ] [REMOTE ] ERJ: Full fetch complete (72115 records). [2025-09-19T18:41:03.843581] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-19T18:41:03.843272] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-19T18:41:03.847235] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T18:41:03.926973] [INFO ] [REMOTE ] ERO: Full fetch complete (58908 records). [2025-09-19T18:41:03.938179] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-19T18:41:04.683189] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-19T18:41:04.708138] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-19T18:41:04.726598] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-19T18:41:04.730861] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-19T18:41:04.767091] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-19T18:41:04.767246] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-19T18:41:04.767930] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-19T18:41:04.768142] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-19T18:41:04.768452] [DEBUG] [LOCAL ] ERJ: Trimmed 72115 records to 51594 (keeping 200 days of data) [2025-09-19T18:41:04.770146] [DEBUG] [LOCAL ] ERO: Trimmed 58908 records to 41705 (keeping 200 days of data) [2025-09-19T18:41:05.311485] [DEBUG] [LOCAL ] ERO: Primary data saved (41705 records). [2025-09-19T18:41:05.327991] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-19T18:41:05.329383] [INFO ] [MAIN ] Update Progress: 763/2372 symbols completed. ERO took 36.0s. Estimated remaining: 3h 33m 1s. Rate: 7.6 symbols/min [2025-09-19T18:41:05.451709] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-19T18:41:05.479266] [DEBUG] [LOCAL ] ERJ: Primary data saved (51594 records). [2025-09-19T18:41:05.500533] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-19T18:41:05.514993] [INFO ] [MAIN ] Update Progress: 764/2372 symbols completed. ERJ took 36.2s. Estimated remaining: 3h 32m 37s. Rate: 7.6 symbols/min [2025-09-19T18:41:05.519998] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-19T18:41:05.609056] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T18:41:05.646474] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-19T18:41:05.709377] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:05.811305] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:05.819883] [DEBUG] [LOCAL ] ESE: Loaded 16775 existing records from primary storage. [2025-09-19T18:41:05.819996] [INFO ] [MAIN ] ESE: Loaded 16775 existing records. [2025-09-19T18:41:05.999984] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:06.013399] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-19T18:41:06.013477] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-19T18:41:06.014096] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-19T18:41:06.014156] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-19T18:41:06.159972] [DEBUG] [LOCAL ] ESI: Loaded 51232 existing records from primary storage. [2025-09-19T18:41:06.182866] [INFO ] [MAIN ] ESI: Loaded 51232 existing records. [2025-09-19T18:41:06.558535] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:06.577765] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-19T18:41:06.577704] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:06.578032] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-19T18:41:06.578120] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-19T18:41:06.580789] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-19T18:41:06.580877] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-19T18:41:06.939208] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:07.043220] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-19T18:41:07.072678] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T18:41:07.591301] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T18:41:07.690961] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T18:41:07.843242] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-19T18:41:08.643319] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-19T18:41:08.775266] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T18:41:08.860521] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T18:41:09.443248] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-19T18:41:09.604225] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T18:41:10.243284] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-19T18:41:10.853801] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T18:41:11.043288] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-19T18:41:11.843299] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-19T18:41:12.288192] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T18:41:12.643248] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-19T18:41:12.824412] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T18:41:13.155713] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T18:41:13.443306] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-19T18:41:14.243276] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-19T18:41:14.277923] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:41:14.810304] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:41:15.043257] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-19T18:41:15.843266] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-19T18:41:16.374146] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T18:41:16.545582] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T18:41:16.643219] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-19T18:41:17.443308] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-19T18:41:17.724211] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T18:41:17.886890] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T18:41:18.243284] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-19T18:41:18.691502] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T18:41:19.043307] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-19T18:41:19.843260] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-19T18:41:19.882742] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T18:41:20.643226] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-19T18:41:20.699474] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T18:41:20.710088] [INFO ] [REMOTE ] ES: Full fetch complete (76132 records). [2025-09-19T18:41:20.710226] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-19T18:41:21.120450] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-19T18:41:21.120582] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-19T18:41:21.121512] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-19T18:41:21.121576] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-19T18:41:21.123124] [DEBUG] [LOCAL ] ES: Trimmed 76132 records to 53295 (keeping 200 days of data) [2025-09-19T18:41:21.279146] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T18:41:21.455826] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-19T18:41:21.479831] [DEBUG] [LOCAL ] ES: Primary data saved (53295 records). [2025-09-19T18:41:21.479943] [INFO ] [MAIN ] ES: Full history saved. [2025-09-19T18:41:21.480115] [INFO ] [MAIN ] Update Progress: 765/2372 symbols completed. ES took 33.0s. Estimated remaining: 3h 32m 46s. Rate: 7.6 symbols/min [2025-09-19T18:41:21.653150] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:21.694696] [DEBUG] [LOCAL ] ESNT: Loaded 39104 existing records from primary storage. [2025-09-19T18:41:21.694929] [INFO ] [MAIN ] ESNT: Loaded 39104 existing records. [2025-09-19T18:41:21.888579] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:21.889150] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-19T18:41:21.889207] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-19T18:41:21.890402] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-19T18:41:21.890464] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-19T18:41:22.247510] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-19T18:41:22.273269] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:22.322672] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T18:41:22.817100] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T18:41:23.016986] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T18:41:23.043220] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-19T18:41:23.843280] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-19T18:41:24.191512] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:41:24.643280] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-19T18:41:25.325607] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T18:41:25.443293] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-19T18:41:25.868031] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T18:41:26.243296] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-19T18:41:26.854698] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T18:41:27.043291] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-19T18:41:27.843327] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-19T18:41:28.200288] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T18:41:28.205282] [INFO ] [REMOTE ] ESAB: Full fetch complete (35073 records). [2025-09-19T18:41:28.205377] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-19T18:41:28.640702] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-19T18:41:28.643761] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-19T18:41:28.643390] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-19T18:41:28.643568] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-19T18:41:28.644795] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-19T18:41:28.649030] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-19T18:41:28.667975] [DEBUG] [LOCAL ] ESAB: Trimmed 35073 records to 26149 (keeping 200 days of data) [2025-09-19T18:41:28.669342] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T18:41:28.673836] [INFO ] [REMOTE ] ESE: Full fetch complete (21800 records). [2025-09-19T18:41:28.673944] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-19T18:41:29.256848] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-19T18:41:29.258220] [DEBUG] [LOCAL ] ESAB: Primary data saved (26149 records). [2025-09-19T18:41:29.258322] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-19T18:41:29.258976] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-19T18:41:29.259057] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-19T18:41:29.259162] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-19T18:41:29.259503] [INFO ] [MAIN ] Update Progress: 766/2372 symbols completed. ESAB took 26.3s. Estimated remaining: 3h 32m 38s. Rate: 7.6 symbols/min [2025-09-19T18:41:29.305396] [DEBUG] [LOCAL ] ESE: Trimmed 21800 records to 16887 (keeping 200 days of data) [2025-09-19T18:41:29.446294] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-19T18:41:29.520341] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:29.567601] [DEBUG] [LOCAL ] ESE: Primary data saved (16887 records). [2025-09-19T18:41:29.567792] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-19T18:41:29.567892] [INFO ] [MAIN ] Update Progress: 767/2372 symbols completed. ESE took 24.2s. Estimated remaining: 3h 32m 14s. Rate: 7.6 symbols/min [2025-09-19T18:41:29.694858] [DEBUG] [LOCAL ] ESRT: Loaded 46741 existing records from primary storage. [2025-09-19T18:41:29.695451] [INFO ] [MAIN ] ESRT: Loaded 46741 existing records. [2025-09-19T18:41:29.887681] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:29.966986] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:29.967263] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-19T18:41:29.967311] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-19T18:41:29.968709] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-19T18:41:29.968773] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-19T18:41:30.263163] [DEBUG] [LOCAL ] ESS: Loaded 30329 existing records from primary storage. [2025-09-19T18:41:30.273913] [INFO ] [MAIN ] ESS: Loaded 30329 existing records. [2025-09-19T18:41:30.463050] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:30.466146] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-19T18:41:30.545461] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:30.545737] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-19T18:41:30.545795] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-19T18:41:30.546715] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-19T18:41:30.546777] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-19T18:41:30.906943] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:30.931243] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T18:41:31.043221] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-19T18:41:31.639612] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T18:41:31.843256] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-19T18:41:31.923209] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:41:32.643492] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-19T18:41:32.742903] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T18:41:33.443276] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-19T18:41:33.942253] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T18:41:34.044248] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T18:41:34.243246] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-19T18:41:35.043260] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-19T18:41:35.188107] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T18:41:35.843275] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-19T18:41:36.134897] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T18:41:36.142235] [INFO ] [REMOTE ] ESI: Full fetch complete (72267 records). [2025-09-19T18:41:36.142373] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-19T18:41:36.574161] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-19T18:41:36.574906] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-19T18:41:36.575896] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-19T18:41:36.576971] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T18:41:36.584911] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-19T18:41:36.587092] [DEBUG] [LOCAL ] ESI: Trimmed 72267 records to 51608 (keeping 200 days of data) [2025-09-19T18:41:36.643751] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-19T18:41:36.906318] [DEBUG] [LOCAL ] ESI: Primary data saved (51608 records). [2025-09-19T18:41:36.906482] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-19T18:41:36.906570] [INFO ] [MAIN ] Update Progress: 768/2372 symbols completed. ESI took 31.4s. Estimated remaining: 3h 32m 5s. Rate: 7.6 symbols/min [2025-09-19T18:41:37.075979] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:37.124289] [DEBUG] [LOCAL ] ESTC: Loaded 50598 existing records from primary storage. [2025-09-19T18:41:37.124428] [INFO ] [MAIN ] ESTC: Loaded 50598 existing records. [2025-09-19T18:41:37.301362] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:37.301615] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-19T18:41:37.301692] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-19T18:41:37.302888] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-19T18:41:37.302949] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-19T18:41:37.448473] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-19T18:41:37.678759] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:37.705912] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T18:41:38.243269] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-19T18:41:38.354344] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T18:41:39.043260] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-19T18:41:39.348270] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T18:41:39.668265] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:41:39.843262] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-19T18:41:40.643252] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-19T18:41:41.302119] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T18:41:41.443260] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-19T18:41:41.630225] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T18:41:42.243257] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-19T18:41:42.738247] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T18:41:43.043315] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-19T18:41:43.261023] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:41:43.776093] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T18:41:43.843226] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-19T18:41:44.371321] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T18:41:44.643268] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-19T18:41:45.443276] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-19T18:41:45.690636] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:41:46.243246] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-19T18:41:46.328361] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T18:41:47.043332] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-19T18:41:47.107021] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T18:41:47.693980] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T18:41:47.843261] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-19T18:41:48.643294] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-19T18:41:49.002575] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T18:41:49.234264] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:41:49.443289] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-19T18:41:49.813892] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T18:41:50.243278] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-19T18:41:50.945311] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T18:41:51.043271] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-19T18:41:51.843268] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-19T18:41:52.356843] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T18:41:52.408266] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T18:41:52.643256] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-19T18:41:53.443275] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-19T18:41:53.551438] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T18:41:54.243284] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-19T18:41:54.546474] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T18:41:55.043304] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-19T18:41:55.191134] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T18:41:55.843273] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-19T18:41:56.036739] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T18:41:56.643274] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-19T18:41:56.708958] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T18:41:56.714527] [INFO ] [REMOTE ] ESNT: Full fetch complete (57296 records). [2025-09-19T18:41:56.714633] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-19T18:41:57.167728] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-19T18:41:57.167817] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-19T18:41:57.168585] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-19T18:41:57.168625] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-19T18:41:57.169793] [DEBUG] [LOCAL ] ESNT: Trimmed 57296 records to 39389 (keeping 200 days of data) [2025-09-19T18:41:57.409155] [DEBUG] [LOCAL ] ESNT: Primary data saved (39389 records). [2025-09-19T18:41:57.409298] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-19T18:41:57.410217] [INFO ] [MAIN ] Update Progress: 769/2372 symbols completed. ESNT took 35.9s. Estimated remaining: 3h 32m 23s. Rate: 7.5 symbols/min [2025-09-19T18:41:57.453174] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-19T18:41:57.587402] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:57.648367] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-09-19T18:41:57.648514] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-09-19T18:41:57.827477] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:57.827837] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-19T18:41:57.828034] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-19T18:41:57.835205] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-19T18:41:57.848920] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T18:41:57.847844] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-19T18:41:57.946389] [INFO ] [REMOTE ] ESRT: Full fetch complete (66360 records). [2025-09-19T18:41:57.976101] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-19T18:41:58.497332] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:58.536979] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-19T18:41:58.660728] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-19T18:41:58.660907] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-19T18:41:58.661744] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-19T18:41:58.661823] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-19T18:41:58.692770] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T18:41:58.690787] [DEBUG] [LOCAL ] ESRT: Trimmed 66360 records to 47076 (keeping 200 days of data) [2025-09-19T18:41:58.984690] [DEBUG] [LOCAL ] ESRT: Primary data saved (47076 records). [2025-09-19T18:41:58.984830] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-19T18:41:58.984915] [INFO ] [MAIN ] Update Progress: 770/2372 symbols completed. ESRT took 29.7s. Estimated remaining: 3h 32m 2s. Rate: 7.6 symbols/min [2025-09-19T18:41:59.048870] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-19T18:41:59.157273] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:41:59.170851] [DEBUG] [LOCAL ] ETB: Loaded 12286 existing records from primary storage. [2025-09-19T18:41:59.170964] [INFO ] [MAIN ] ETB: Loaded 12286 existing records. [2025-09-19T18:41:59.353133] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:41:59.353504] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-19T18:41:59.353673] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-19T18:41:59.354173] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-19T18:41:59.354299] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-19T18:41:59.553407] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T18:41:59.741871] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:41:59.843226] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-19T18:42:00.643241] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-19T18:42:00.851743] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T18:42:00.859226] [INFO ] [REMOTE ] ESTC: Full fetch complete (72215 records). [2025-09-19T18:42:00.859349] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-19T18:42:01.162405] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T18:42:01.269842] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-19T18:42:01.270065] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-19T18:42:01.271107] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-19T18:42:01.271214] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-19T18:42:01.273546] [DEBUG] [LOCAL ] ESTC: Trimmed 72215 records to 50967 (keeping 200 days of data) [2025-09-19T18:42:01.426734] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-19T18:42:01.445429] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-19T18:42:01.624971] [DEBUG] [LOCAL ] ESTC: Primary data saved (50967 records). [2025-09-19T18:42:01.625122] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-19T18:42:01.625209] [INFO ] [MAIN ] Update Progress: 771/2372 symbols completed. ESTC took 24.7s. Estimated remaining: 3h 31m 43s. Rate: 7.6 symbols/min [2025-09-19T18:42:01.794821] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:01.823146] [DEBUG] [LOCAL ] ETD: Loaded 27603 existing records from primary storage. [2025-09-19T18:42:01.823290] [INFO ] [MAIN ] ETD: Loaded 27603 existing records. [2025-09-19T18:42:02.021348] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:02.021697] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-19T18:42:02.021789] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-19T18:42:02.022616] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-19T18:42:02.022724] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-19T18:42:02.254334] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-19T18:42:02.400186] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:02.610217] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T18:42:03.028822] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T18:42:03.043212] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-19T18:42:03.843258] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-19T18:42:04.241036] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T18:42:04.643243] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-19T18:42:05.204948] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-09-19T18:42:05.443289] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-19T18:42:05.818572] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T18:42:06.060449] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T18:42:06.243314] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-19T18:42:07.046007] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-19T18:42:07.331935] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:42:07.843278] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-19T18:42:08.207772] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T18:42:08.243528] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-19T18:42:08.652756] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-19T18:42:08.660306] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-19T18:42:09.443277] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-19T18:42:10.243230] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-19T18:42:10.408557] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T18:42:11.043304] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-19T18:42:11.367129] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-19T18:42:11.843276] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-19T18:42:11.876766] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T18:42:12.392423] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T18:42:12.643278] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-19T18:42:13.443292] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-19T18:42:14.243258] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-19T18:42:14.805988] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T18:42:14.964413] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-09-19T18:42:15.043274] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-19T18:42:15.234253] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:42:15.839150] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T18:42:15.843297] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-19T18:42:16.643319] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-19T18:42:16.967050] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T18:42:17.443291] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-19T18:42:17.639315] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:42:17.837189] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-19T18:42:18.243274] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-19T18:42:18.874050] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T18:42:18.878554] [INFO ] [REMOTE ] ESS: Full fetch complete (43309 records). [2025-09-19T18:42:18.878675] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-19T18:42:19.055686] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-19T18:42:19.271084] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-19T18:42:19.271220] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-19T18:42:19.271978] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-19T18:42:19.272048] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-19T18:42:19.273147] [DEBUG] [LOCAL ] ESS: Trimmed 43309 records to 30525 (keeping 200 days of data) [2025-09-19T18:42:19.466207] [DEBUG] [LOCAL ] ESS: Primary data saved (30525 records). [2025-09-19T18:42:19.466346] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-19T18:42:19.466434] [INFO ] [MAIN ] Update Progress: 772/2372 symbols completed. ESS took 49.9s. Estimated remaining: 3h 31m 55s. Rate: 7.5 symbols/min [2025-09-19T18:42:19.634737] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:19.652785] [DEBUG] [LOCAL ] ETG: Loaded 17132 existing records from primary storage. [2025-09-19T18:42:19.652917] [INFO ] [MAIN ] ETG: Loaded 17132 existing records. [2025-09-19T18:42:19.829637] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:19.829989] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-19T18:42:19.830048] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-19T18:42:19.830493] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-19T18:42:19.830552] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-19T18:42:19.861691] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-19T18:42:20.206145] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:20.236082] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:42:20.600584] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-19T18:42:20.643213] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-19T18:42:20.900499] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T18:42:21.443268] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-19T18:42:22.243268] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-19T18:42:22.956953] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T18:42:22.999582] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T18:42:23.043214] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-19T18:42:23.241792] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-19T18:42:23.843279] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-19T18:42:24.174910] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T18:42:24.179466] [INFO ] [REMOTE ] ETD: Full fetch complete (37901 records). [2025-09-19T18:42:24.179598] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-19T18:42:24.555805] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-19T18:42:24.555882] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-19T18:42:24.556517] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-19T18:42:24.556555] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-19T18:42:24.557390] [DEBUG] [LOCAL ] ETD: Trimmed 37901 records to 27755 (keeping 200 days of data) [2025-09-19T18:42:24.644281] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-19T18:42:24.722978] [DEBUG] [LOCAL ] ETD: Primary data saved (27755 records). [2025-09-19T18:42:24.723112] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-19T18:42:24.723196] [INFO ] [MAIN ] Update Progress: 773/2372 symbols completed. ETD took 23.1s. Estimated remaining: 3h 31m 42s. Rate: 7.6 symbols/min [2025-09-19T18:42:24.895410] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:24.913021] [DEBUG] [LOCAL ] ETJ: Loaded 17115 existing records from primary storage. [2025-09-19T18:42:24.913142] [INFO ] [MAIN ] ETJ: Loaded 17115 existing records. [2025-09-19T18:42:25.092390] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:25.092732] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-19T18:42:25.092910] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-19T18:42:25.098982] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-19T18:42:25.103451] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-19T18:42:25.136402] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T18:42:25.444597] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-19T18:42:25.466258] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:25.892893] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T18:42:26.243242] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-19T18:42:26.769126] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T18:42:27.043264] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-19T18:42:27.721017] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T18:42:27.722863] [INFO ] [REMOTE ] ETB: Full fetch complete (17781 records). [2025-09-19T18:42:27.722940] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-19T18:42:27.848377] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-19T18:42:28.096308] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-19T18:42:28.096388] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-19T18:42:28.096820] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-19T18:42:28.096880] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-19T18:42:28.097420] [DEBUG] [LOCAL ] ETB: Trimmed 17781 records to 12338 (keeping 200 days of data) [2025-09-19T18:42:28.172483] [DEBUG] [LOCAL ] ETB: Primary data saved (12338 records). [2025-09-19T18:42:28.172631] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-19T18:42:28.172765] [INFO ] [MAIN ] Update Progress: 774/2372 symbols completed. ETB took 29.2s. Estimated remaining: 3h 31m 25s. Rate: 7.6 symbols/min [2025-09-19T18:42:28.349754] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:28.405551] [DEBUG] [LOCAL ] ETN: Loaded 53258 existing records from primary storage. [2025-09-19T18:42:28.405729] [INFO ] [MAIN ] ETN: Loaded 53258 existing records. [2025-09-19T18:42:28.585692] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:28.586116] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-19T18:42:28.586187] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-19T18:42:28.587744] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-19T18:42:28.587808] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-19T18:42:28.643342] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-19T18:42:28.991166] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:28.993315] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-19T18:42:29.230434] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:42:29.443272] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-19T18:42:30.000346] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:42:30.243276] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-19T18:42:31.043236] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-19T18:42:31.480451] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T18:42:31.543525] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T18:42:31.843259] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-19T18:42:32.643270] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-19T18:42:33.443253] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-19T18:42:33.664163] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T18:42:33.694686] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-19T18:42:33.702843] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-19T18:42:33.702970] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-19T18:42:34.105512] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-19T18:42:34.105726] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-19T18:42:34.106815] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-19T18:42:34.118126] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T18:42:34.117765] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-19T18:42:34.129086] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54569 (keeping 200 days of data) [2025-09-19T18:42:34.135043] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T18:42:34.250694] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-19T18:42:34.467469] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-09-19T18:42:34.467604] [INFO ] [MAIN ] ET: Full history saved. [2025-09-19T18:42:34.467716] [INFO ] [MAIN ] Update Progress: 775/2372 symbols completed. ET took 37.1s. Estimated remaining: 3h 31m 13s. Rate: 7.6 symbols/min [2025-09-19T18:42:34.634635] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:34.642803] [DEBUG] [LOCAL ] ETO: Loaded 6678 existing records from primary storage. [2025-09-19T18:42:34.642901] [INFO ] [MAIN ] ETO: Loaded 6678 existing records. [2025-09-19T18:42:34.827074] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:34.827333] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-19T18:42:34.827391] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-19T18:42:34.827742] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-19T18:42:34.827802] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-19T18:42:35.048444] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-19T18:42:35.183281] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:35.738816] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T18:42:35.843218] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-19T18:42:36.643263] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-19T18:42:37.177667] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T18:42:37.417266] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-19T18:42:37.443227] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-19T18:42:37.693242] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T18:42:38.243232] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-19T18:42:38.265963] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T18:42:39.043275] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-19T18:42:39.636738] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T18:42:39.843275] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-19T18:42:40.643271] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-19T18:42:40.764809] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T18:42:40.941269] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:42:41.443267] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-19T18:42:42.247056] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-19T18:42:42.249426] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T18:42:43.043287] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-19T18:42:43.331527] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T18:42:43.411489] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T18:42:43.631583] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-19T18:42:43.843230] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-19T18:42:44.643300] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-19T18:42:45.175414] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T18:42:45.178389] [INFO ] [REMOTE ] ETG: Full fetch complete (25109 records). [2025-09-19T18:42:45.178482] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-19T18:42:45.448379] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-19T18:42:45.608263] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-19T18:42:45.608383] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-19T18:42:45.608963] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-19T18:42:45.609026] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-19T18:42:45.609961] [DEBUG] [LOCAL ] ETG: Trimmed 25109 records to 17227 (keeping 200 days of data) [2025-09-19T18:42:45.713493] [DEBUG] [LOCAL ] ETG: Primary data saved (17227 records). [2025-09-19T18:42:45.713633] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-19T18:42:45.713757] [INFO ] [MAIN ] Update Progress: 776/2372 symbols completed. ETG took 26.2s. Estimated remaining: 3h 31m 12s. Rate: 7.6 symbols/min [2025-09-19T18:42:45.851400] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T18:42:45.903576] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:45.960868] [DEBUG] [LOCAL ] ETR: Loaded 53626 existing records from primary storage. [2025-09-19T18:42:45.961010] [INFO ] [MAIN ] ETR: Loaded 53626 existing records. [2025-09-19T18:42:46.137639] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:46.137931] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-19T18:42:46.138004] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-19T18:42:46.139309] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-19T18:42:46.139375] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-19T18:42:46.248475] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-19T18:42:46.507497] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:47.043310] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-19T18:42:47.200370] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:42:47.572359] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T18:42:47.844980] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-19T18:42:47.846775] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T18:42:48.340393] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-19T18:42:48.643267] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-19T18:42:49.166818] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-19T18:42:49.443327] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-19T18:42:50.243265] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-19T18:42:50.331039] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T18:42:51.043300] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-19T18:42:51.843473] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-19T18:42:51.917172] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T18:42:51.929089] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T18:42:52.643309] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-19T18:42:53.443276] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-19T18:42:53.586610] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T18:42:53.628007] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T18:42:54.169463] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:42:54.172433] [INFO ] [REMOTE ] ETJ: Full fetch complete (24925 records). [2025-09-19T18:42:54.172511] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-19T18:42:54.248324] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-19T18:42:54.538408] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-19T18:42:54.538485] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-19T18:42:54.538989] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-19T18:42:54.539050] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-19T18:42:54.539722] [DEBUG] [LOCAL ] ETJ: Trimmed 24925 records to 17236 (keeping 200 days of data) [2025-09-19T18:42:54.639050] [DEBUG] [LOCAL ] ETJ: Primary data saved (17236 records). [2025-09-19T18:42:54.639186] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-19T18:42:54.639269] [INFO ] [MAIN ] Update Progress: 777/2372 symbols completed. ETJ took 29.9s. Estimated remaining: 3h 31m 6s. Rate: 7.6 symbols/min [2025-09-19T18:42:54.811328] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:42:54.833954] [DEBUG] [LOCAL ] ETV: Loaded 21803 existing records from primary storage. [2025-09-19T18:42:54.834074] [INFO ] [MAIN ] ETV: Loaded 21803 existing records. [2025-09-19T18:42:55.010566] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:42:55.010853] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-19T18:42:55.010901] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-19T18:42:55.011560] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-19T18:42:55.011620] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-19T18:42:55.053474] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-19T18:42:55.368973] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:42:55.843248] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-19T18:42:56.194544] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T18:42:56.643251] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-19T18:42:56.796924] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T18:42:57.148914] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T18:42:57.443269] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-19T18:42:57.649543] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T18:42:58.243265] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-19T18:42:59.043274] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-19T18:42:59.123239] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T18:42:59.843294] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-19T18:43:00.062717] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-19T18:43:00.643305] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-19T18:43:01.253495] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T18:43:01.396225] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T18:43:01.443222] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-19T18:43:02.243261] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-19T18:43:02.686143] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T18:43:02.695050] [INFO ] [REMOTE ] ETN: Full fetch complete (76560 records). [2025-09-19T18:43:02.695241] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-19T18:43:03.047738] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-19T18:43:03.114304] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T18:43:03.114556] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-19T18:43:03.116877] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-19T18:43:03.117958] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-19T18:43:03.118133] [INFO ] [REMOTE ] ETO: Full fetch complete (9281 records). [2025-09-19T18:43:03.118454] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-19T18:43:03.118373] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-19T18:43:03.221540] [DEBUG] [LOCAL ] ETN: Trimmed 76560 records to 53621 (keeping 200 days of data) [2025-09-19T18:43:03.522041] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T18:43:03.660911] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-19T18:43:03.661759] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-19T18:43:03.662499] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-19T18:43:03.662578] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-19T18:43:03.663937] [DEBUG] [LOCAL ] ETO: Trimmed 9281 records to 6704 (keeping 200 days of data) [2025-09-19T18:43:03.709064] [DEBUG] [LOCAL ] ETO: Primary data saved (6704 records). [2025-09-19T18:43:03.711254] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-19T18:43:03.711675] [INFO ] [MAIN ] Update Progress: 778/2372 symbols completed. ETO took 29.2s. Estimated remaining: 3h 31m 1s. Rate: 7.6 symbols/min [2025-09-19T18:43:03.847042] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-19T18:43:03.897940] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:04.030252] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T18:43:04.029476] [DEBUG] [LOCAL ] ETW: Loaded 25572 existing records from primary storage. [2025-09-19T18:43:04.035842] [INFO ] [MAIN ] ETW: Loaded 25572 existing records. [2025-09-19T18:43:04.231042] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:04.232115] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-19T18:43:04.232898] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-19T18:43:04.234539] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-19T18:43:04.235183] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-19T18:43:04.633904] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:04.644483] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-19T18:43:04.736540] [DEBUG] [LOCAL ] ETN: Primary data saved (53621 records). [2025-09-19T18:43:04.736878] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-19T18:43:04.737015] [INFO ] [MAIN ] Update Progress: 779/2372 symbols completed. ETN took 36.6s. Estimated remaining: 3h 30m 39s. Rate: 7.6 symbols/min [2025-09-19T18:43:04.920121] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:04.927018] [DEBUG] [LOCAL ] ETX: Loaded 4940 existing records from primary storage. [2025-09-19T18:43:04.927115] [INFO ] [MAIN ] ETX: Loaded 4940 existing records. [2025-09-19T18:43:05.100230] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:05.100472] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-19T18:43:05.100521] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-19T18:43:05.100861] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-19T18:43:05.100921] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-19T18:43:05.447995] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-19T18:43:05.472684] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:05.903951] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T18:43:06.221445] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T18:43:06.243210] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-19T18:43:07.043251] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-19T18:43:07.057962] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T18:43:07.129354] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-19T18:43:07.843243] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-19T18:43:08.024586] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T18:43:08.643237] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-19T18:43:09.199934] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:43:09.406432] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T18:43:09.443279] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-19T18:43:10.127899] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-19T18:43:10.243299] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-19T18:43:11.043274] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-19T18:43:11.843268] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-19T18:43:11.851155] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T18:43:11.872225] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T18:43:12.643228] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-19T18:43:13.148355] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:43:13.443310] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-19T18:43:14.188351] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T18:43:14.201017] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T18:43:14.243232] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-19T18:43:15.043278] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-19T18:43:15.239157] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:43:15.843246] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-19T18:43:16.643243] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-19T18:43:16.703094] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T18:43:17.113896] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-19T18:43:17.443253] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-19T18:43:17.650854] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T18:43:18.243278] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-19T18:43:18.951302] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T18:43:19.032496] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T18:43:19.043204] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-19T18:43:19.843270] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-19T18:43:20.314517] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T18:43:20.643274] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-19T18:43:21.324161] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:43:21.443332] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-19T18:43:21.872606] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T18:43:22.131025] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T18:43:22.243244] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-19T18:43:23.043272] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-19T18:43:23.848352] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-19T18:43:23.869629] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T18:43:24.346271] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T18:43:24.349873] [INFO ] [REMOTE ] ETV: Full fetch complete (31851 records). [2025-09-19T18:43:24.349957] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-19T18:43:24.648502] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-19T18:43:24.731924] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-19T18:43:24.732048] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-19T18:43:24.732835] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-19T18:43:24.732916] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-19T18:43:24.734057] [DEBUG] [LOCAL ] ETV: Trimmed 31851 records to 21937 (keeping 200 days of data) [2025-09-19T18:43:24.836746] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T18:43:24.886324] [DEBUG] [LOCAL ] ETV: Primary data saved (21937 records). [2025-09-19T18:43:24.886515] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-19T18:43:24.886671] [INFO ] [MAIN ] Update Progress: 780/2372 symbols completed. ETV took 30.2s. Estimated remaining: 3h 30m 56s. Rate: 7.5 symbols/min [2025-09-19T18:43:25.055322] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:25.082479] [DEBUG] [LOCAL ] ETY: Loaded 23221 existing records from primary storage. [2025-09-19T18:43:25.082626] [INFO ] [MAIN ] ETY: Loaded 23221 existing records. [2025-09-19T18:43:25.258187] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:25.258435] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-19T18:43:25.258483] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-19T18:43:25.259183] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-19T18:43:25.259280] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-19T18:43:25.454001] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-19T18:43:25.623423] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:25.667437] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:43:26.243282] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-19T18:43:26.429226] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T18:43:26.430768] [INFO ] [REMOTE ] ETX: Full fetch complete (6965 records). [2025-09-19T18:43:26.430840] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-19T18:43:26.806144] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-19T18:43:26.806247] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-19T18:43:26.806448] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-19T18:43:26.806489] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-19T18:43:26.806930] [DEBUG] [LOCAL ] ETX: Trimmed 6965 records to 4960 (keeping 200 days of data) [2025-09-19T18:43:26.842904] [DEBUG] [LOCAL ] ETX: Primary data saved (4960 records). [2025-09-19T18:43:26.843134] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-19T18:43:26.843297] [INFO ] [MAIN ] Update Progress: 781/2372 symbols completed. ETX took 22.1s. Estimated remaining: 3h 30m 35s. Rate: 7.6 symbols/min [2025-09-19T18:43:27.015406] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:27.035974] [DEBUG] [LOCAL ] EVC: Loaded 20499 existing records from primary storage. [2025-09-19T18:43:27.036096] [INFO ] [MAIN ] EVC: Loaded 20499 existing records. [2025-09-19T18:43:27.048746] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-19T18:43:27.216417] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:27.216720] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-19T18:43:27.216784] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-19T18:43:27.217421] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-19T18:43:27.217490] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-19T18:43:27.571060] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:27.843261] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-19T18:43:27.992914] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:43:28.360867] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T18:43:28.643268] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-19T18:43:28.892013] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T18:43:29.443243] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-19T18:43:29.460873] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T18:43:30.243270] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-19T18:43:31.043254] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-19T18:43:31.456878] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T18:43:31.469109] [INFO ] [REMOTE ] ETR: Full fetch complete (76955 records). [2025-09-19T18:43:31.469266] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-19T18:43:31.866760] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-19T18:43:31.894231] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T18:43:31.885400] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-19T18:43:31.894852] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-19T18:43:31.902563] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-19T18:43:31.902760] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-19T18:43:31.923438] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T18:43:31.928918] [DEBUG] [LOCAL ] ETR: Trimmed 76955 records to 54016 (keeping 200 days of data) [2025-09-19T18:43:32.290309] [DEBUG] [LOCAL ] ETR: Primary data saved (54016 records). [2025-09-19T18:43:32.290500] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-19T18:43:32.290710] [INFO ] [MAIN ] Update Progress: 782/2372 symbols completed. ETR took 46.6s. Estimated remaining: 3h 30m 22s. Rate: 7.6 symbols/min [2025-09-19T18:43:32.479431] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:32.510331] [DEBUG] [LOCAL ] EVEX: Loaded 29397 existing records from primary storage. [2025-09-19T18:43:32.510499] [INFO ] [MAIN ] EVEX: Loaded 29397 existing records. [2025-09-19T18:43:32.649262] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-19T18:43:32.698998] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:32.699267] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-19T18:43:32.699336] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-19T18:43:32.700251] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-19T18:43:32.700322] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-19T18:43:33.079759] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:33.297689] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T18:43:33.443231] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-19T18:43:34.243294] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-19T18:43:34.376097] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T18:43:34.545455] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T18:43:35.043256] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-19T18:43:35.609608] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:43:35.843277] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-19T18:43:35.952282] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T18:43:36.643276] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-19T18:43:36.952110] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T18:43:37.443273] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-19T18:43:38.100051] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T18:43:38.243217] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-19T18:43:38.663015] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T18:43:39.043282] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-19T18:43:39.843297] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-19T18:43:40.007256] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T18:43:40.467626] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T18:43:40.471410] [INFO ] [REMOTE ] ETW: Full fetch complete (36422 records). [2025-09-19T18:43:40.471533] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-19T18:43:40.693814] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-19T18:43:40.902765] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-19T18:43:40.902885] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-19T18:43:40.903755] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-19T18:43:40.903875] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-19T18:43:40.911673] [DEBUG] [LOCAL ] ETW: Trimmed 36422 records to 25741 (keeping 200 days of data) [2025-09-19T18:43:40.923067] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T18:43:41.098220] [DEBUG] [LOCAL ] ETW: Primary data saved (25741 records). [2025-09-19T18:43:41.098367] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-19T18:43:41.098485] [INFO ] [MAIN ] Update Progress: 783/2372 symbols completed. ETW took 37.4s. Estimated remaining: 3h 30m 16s. Rate: 7.6 symbols/min [2025-09-19T18:43:41.266567] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:41.277091] [DEBUG] [LOCAL ] EVF: Loaded 9156 existing records from primary storage. [2025-09-19T18:43:41.277206] [INFO ] [MAIN ] EVF: Loaded 9156 existing records. [2025-09-19T18:43:41.445407] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-19T18:43:41.459677] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:41.461213] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-19T18:43:41.461270] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-19T18:43:41.461779] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-19T18:43:41.461858] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-19T18:43:41.816299] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:42.229037] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T18:43:42.243241] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-19T18:43:42.871144] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:43:42.987048] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:43:43.043225] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-19T18:43:43.843234] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-19T18:43:43.924995] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T18:43:44.643284] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-19T18:43:45.113195] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T18:43:45.443289] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-19T18:43:46.059634] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T18:43:46.243229] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-19T18:43:46.333078] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T18:43:47.043303] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-19T18:43:47.226823] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T18:43:47.843275] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-19T18:43:48.075247] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T18:43:48.643294] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-19T18:43:48.684906] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T18:43:49.443283] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-19T18:43:49.662706] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T18:43:50.243238] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-19T18:43:50.670297] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:43:50.673502] [INFO ] [REMOTE ] ETY: Full fetch complete (34362 records). [2025-09-19T18:43:50.673580] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-19T18:43:51.050373] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-19T18:43:51.054766] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-19T18:43:51.054896] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-19T18:43:51.055590] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-19T18:43:51.055636] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-19T18:43:51.056705] [DEBUG] [LOCAL ] ETY: Trimmed 34362 records to 23320 (keeping 200 days of data) [2025-09-19T18:43:51.231771] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T18:43:51.231307] [DEBUG] [LOCAL ] ETY: Primary data saved (23320 records). [2025-09-19T18:43:51.236208] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-19T18:43:51.236525] [INFO ] [MAIN ] Update Progress: 784/2372 symbols completed. ETY took 26.3s. Estimated remaining: 3h 30m 13s. Rate: 7.6 symbols/min [2025-09-19T18:43:51.408134] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:51.416832] [DEBUG] [LOCAL ] EVG: Loaded 5860 existing records from primary storage. [2025-09-19T18:43:51.416948] [INFO ] [MAIN ] EVG: Loaded 5860 existing records. [2025-09-19T18:43:51.541132] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T18:43:51.610002] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:51.610317] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-19T18:43:51.610369] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-19T18:43:51.610810] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-19T18:43:51.610870] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-19T18:43:51.851598] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-19T18:43:51.984573] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:52.643310] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-19T18:43:52.723244] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T18:43:53.443284] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-19T18:43:53.829605] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:43:54.243267] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-19T18:43:54.635892] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T18:43:55.043303] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-19T18:43:55.653747] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T18:43:55.746457] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T18:43:55.843266] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-19T18:43:56.643282] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-19T18:43:57.058568] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T18:43:57.061691] [INFO ] [REMOTE ] EVC: Full fetch complete (31320 records). [2025-09-19T18:43:57.061798] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-19T18:43:57.437373] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-19T18:43:57.437729] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-19T18:43:57.438364] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-19T18:43:57.438408] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-19T18:43:57.439482] [DEBUG] [LOCAL ] EVC: Trimmed 31320 records to 20566 (keeping 200 days of data) [2025-09-19T18:43:57.443278] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-19T18:43:57.581171] [DEBUG] [LOCAL ] EVC: Primary data saved (20566 records). [2025-09-19T18:43:57.581308] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-19T18:43:57.581414] [INFO ] [MAIN ] Update Progress: 785/2372 symbols completed. EVC took 30.7s. Estimated remaining: 3h 30m 2s. Rate: 7.6 symbols/min [2025-09-19T18:43:57.761912] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:43:57.818577] [DEBUG] [LOCAL ] EVH: Loaded 49711 existing records from primary storage. [2025-09-19T18:43:57.818791] [INFO ] [MAIN ] EVH: Loaded 49711 existing records. [2025-09-19T18:43:57.939869] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T18:43:58.022047] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:43:58.022497] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-19T18:43:58.022572] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-19T18:43:58.031281] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-19T18:43:58.043727] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-19T18:43:58.109538] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:43:58.251932] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-19T18:43:58.412115] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:43:59.043279] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-19T18:43:59.432520] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:43:59.446935] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T18:43:59.843273] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-19T18:44:00.643299] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-19T18:44:01.435631] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T18:44:01.446054] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-19T18:44:01.619100] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:44:02.243284] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-19T18:44:03.000571] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T18:44:03.043236] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-19T18:44:03.584886] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T18:44:03.843275] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-19T18:44:04.643272] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-19T18:44:04.664877] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-19T18:44:04.988171] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T18:44:04.996457] [INFO ] [REMOTE ] EVEX: Full fetch complete (41339 records). [2025-09-19T18:44:04.996698] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-19T18:44:05.381398] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-19T18:44:05.381550] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-19T18:44:05.386512] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-19T18:44:05.387049] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-19T18:44:05.387242] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T18:44:05.390105] [DEBUG] [LOCAL ] EVEX: Trimmed 41339 records to 29763 (keeping 200 days of data) [2025-09-19T18:44:05.449872] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-19T18:44:05.561343] [DEBUG] [LOCAL ] EVEX: Primary data saved (29763 records). [2025-09-19T18:44:05.561491] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-19T18:44:05.561577] [INFO ] [MAIN ] Update Progress: 786/2372 symbols completed. EVEX took 33.3s. Estimated remaining: 3h 29m 54s. Rate: 7.6 symbols/min [2025-09-19T18:44:05.733320] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:05.745762] [DEBUG] [LOCAL ] EVN: Loaded 11003 existing records from primary storage. [2025-09-19T18:44:05.745877] [INFO ] [MAIN ] EVN: Loaded 11003 existing records. [2025-09-19T18:44:05.923264] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:05.923538] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-19T18:44:05.923598] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-19T18:44:05.924089] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-19T18:44:05.924149] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-19T18:44:06.245237] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-19T18:44:06.284319] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:06.351985] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T18:44:07.043282] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-19T18:44:07.132207] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T18:44:07.843276] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-19T18:44:07.874518] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T18:44:08.353141] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T18:44:08.643272] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-19T18:44:09.252309] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T18:44:09.443267] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-19T18:44:10.243263] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-19T18:44:10.822467] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:44:11.043300] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-19T18:44:11.843267] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-19T18:44:12.022729] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:44:12.061817] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T18:44:12.355493] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T18:44:12.643267] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-19T18:44:13.443275] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-19T18:44:13.692619] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T18:44:14.243257] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-19T18:44:14.577342] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:44:14.847674] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T18:44:15.043271] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-19T18:44:15.753990] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T18:44:15.755466] [INFO ] [REMOTE ] EVG: Full fetch complete (8047 records). [2025-09-19T18:44:15.755557] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-19T18:44:15.848359] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-19T18:44:16.131119] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-19T18:44:16.131244] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-19T18:44:16.131474] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-19T18:44:16.131528] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-19T18:44:16.132046] [DEBUG] [LOCAL ] EVG: Trimmed 8047 records to 5883 (keeping 200 days of data) [2025-09-19T18:44:16.171555] [DEBUG] [LOCAL ] EVG: Primary data saved (5883 records). [2025-09-19T18:44:16.171742] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-19T18:44:16.171882] [INFO ] [MAIN ] Update Progress: 787/2372 symbols completed. EVG took 24.9s. Estimated remaining: 3h 29m 51s. Rate: 7.6 symbols/min [2025-09-19T18:44:16.347859] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:16.396627] [DEBUG] [LOCAL ] EVR: Loaded 36199 existing records from primary storage. [2025-09-19T18:44:16.396799] [INFO ] [MAIN ] EVR: Loaded 36199 existing records. [2025-09-19T18:44:16.581291] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:16.581553] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-19T18:44:16.581613] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-19T18:44:16.582816] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-19T18:44:16.582876] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-19T18:44:16.648354] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-19T18:44:16.974503] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:17.443300] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-19T18:44:17.613209] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T18:44:17.773513] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T18:44:18.243290] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-19T18:44:18.949080] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T18:44:19.043269] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-19T18:44:19.424109] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:44:19.843268] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-19T18:44:20.034234] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T18:44:20.643273] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-19T18:44:21.364461] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T18:44:21.443225] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-19T18:44:22.195415] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T18:44:22.243242] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-19T18:44:23.041553] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T18:44:23.051170] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-19T18:44:23.843252] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-19T18:44:23.892119] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T18:44:24.117586] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:44:24.119337] [INFO ] [REMOTE ] EVF: Full fetch complete (11668 records). [2025-09-19T18:44:24.119407] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-19T18:44:24.479460] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-19T18:44:24.479567] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-19T18:44:24.479862] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-19T18:44:24.479922] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-19T18:44:24.480397] [DEBUG] [LOCAL ] EVF: Trimmed 11668 records to 9194 (keeping 200 days of data) [2025-09-19T18:44:24.534848] [DEBUG] [LOCAL ] EVF: Primary data saved (9194 records). [2025-09-19T18:44:24.534969] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-19T18:44:24.535053] [INFO ] [MAIN ] Update Progress: 788/2372 symbols completed. EVF took 43.4s. Estimated remaining: 3h 29m 44s. Rate: 7.6 symbols/min [2025-09-19T18:44:24.648392] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-19T18:44:24.712971] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:24.721729] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T18:44:24.739263] [DEBUG] [LOCAL ] EVT: Loaded 17782 existing records from primary storage. [2025-09-19T18:44:24.739370] [INFO ] [MAIN ] EVT: Loaded 17782 existing records. [2025-09-19T18:44:24.915288] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:24.915579] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-19T18:44:24.915628] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-19T18:44:24.916233] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-19T18:44:24.916292] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-19T18:44:25.267873] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:25.443253] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-19T18:44:26.243241] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-19T18:44:26.521569] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:44:26.616123] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T18:44:27.043265] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-19T18:44:27.843301] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-19T18:44:27.996599] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T18:44:28.075746] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T18:44:28.462893] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-19T18:44:28.643248] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-19T18:44:29.443259] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-19T18:44:29.698397] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T18:44:30.169902] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T18:44:30.172107] [INFO ] [REMOTE ] EVN: Full fetch complete (17450 records). [2025-09-19T18:44:30.172180] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-19T18:44:30.248356] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-19T18:44:30.534369] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-19T18:44:30.534446] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-19T18:44:30.534834] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-19T18:44:30.534898] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-19T18:44:30.535429] [DEBUG] [LOCAL ] EVN: Trimmed 17450 records to 11051 (keeping 200 days of data) [2025-09-19T18:44:30.600842] [DEBUG] [LOCAL ] EVN: Primary data saved (11051 records). [2025-09-19T18:44:30.600987] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-19T18:44:30.601072] [INFO ] [MAIN ] Update Progress: 789/2372 symbols completed. EVN took 25.0s. Estimated remaining: 3h 29m 32s. Rate: 7.6 symbols/min [2025-09-19T18:44:30.768701] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:30.795169] [DEBUG] [LOCAL ] EVTC: Loaded 26890 existing records from primary storage. [2025-09-19T18:44:30.795298] [INFO ] [MAIN ] EVTC: Loaded 26890 existing records. [2025-09-19T18:44:30.975775] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:30.976114] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-19T18:44:30.976178] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-19T18:44:30.977017] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-19T18:44:30.977075] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-19T18:44:31.051779] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-19T18:44:31.331314] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:31.618900] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T18:44:31.843251] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-19T18:44:32.643241] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-19T18:44:32.954688] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T18:44:33.140583] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T18:44:33.443247] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-19T18:44:34.024832] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:44:34.243258] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-19T18:44:35.043248] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-19T18:44:35.215849] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T18:44:35.606336] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T18:44:35.843230] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-19T18:44:36.643230] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-19T18:44:36.705466] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:44:37.443239] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-19T18:44:37.495839] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T18:44:37.824056] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:44:38.243239] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-19T18:44:38.379217] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T18:44:39.043264] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-19T18:44:39.843267] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-19T18:44:40.011194] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:44:40.521491] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:44:40.529077] [INFO ] [REMOTE ] EVH: Full fetch complete (71724 records). [2025-09-19T18:44:40.529232] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-19T18:44:40.648432] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-19T18:44:40.942027] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-19T18:44:40.942174] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-19T18:44:40.943115] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-19T18:44:40.943181] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-19T18:44:40.944739] [DEBUG] [LOCAL ] EVH: Trimmed 71724 records to 50085 (keeping 200 days of data) [2025-09-19T18:44:41.235503] [DEBUG] [LOCAL ] EVH: Primary data saved (50085 records). [2025-09-19T18:44:41.235682] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-19T18:44:41.235793] [INFO ] [MAIN ] Update Progress: 790/2372 symbols completed. EVH took 43.7s. Estimated remaining: 3h 29m 30s. Rate: 7.6 symbols/min [2025-09-19T18:44:41.413785] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:41.436903] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T18:44:41.443981] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-19T18:44:41.476894] [DEBUG] [LOCAL ] EVTL: Loaded 36740 existing records from primary storage. [2025-09-19T18:44:41.477076] [INFO ] [MAIN ] EVTL: Loaded 36740 existing records. [2025-09-19T18:44:41.662559] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:41.662918] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-19T18:44:41.662987] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-19T18:44:41.663910] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-19T18:44:41.663978] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-19T18:44:42.055882] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:42.243289] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-19T18:44:42.266391] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:44:42.699538] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T18:44:43.043243] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-19T18:44:43.843283] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-19T18:44:43.880306] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T18:44:44.225134] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T18:44:44.643297] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-19T18:44:44.751527] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T18:44:45.443338] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-19T18:44:46.038422] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T18:44:46.243278] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-19T18:44:46.785984] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T18:44:47.043280] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-19T18:44:47.843260] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-19T18:44:47.886221] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T18:44:47.978315] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T18:44:48.643268] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-19T18:44:48.707676] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T18:44:49.443347] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-19T18:44:50.243276] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-19T18:44:50.363410] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T18:44:50.987879] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T18:44:51.043239] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-19T18:44:51.385797] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T18:44:51.388490] [INFO ] [REMOTE ] EVT: Full fetch complete (25507 records). [2025-09-19T18:44:51.388576] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-19T18:44:51.764323] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-19T18:44:51.764409] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-19T18:44:51.764950] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-19T18:44:51.765013] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-19T18:44:51.765802] [DEBUG] [LOCAL ] EVT: Trimmed 25507 records to 17841 (keeping 200 days of data) [2025-09-19T18:44:51.845512] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-19T18:44:51.878823] [DEBUG] [LOCAL ] EVT: Primary data saved (17841 records). [2025-09-19T18:44:51.878952] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-19T18:44:51.879038] [INFO ] [MAIN ] Update Progress: 791/2372 symbols completed. EVT took 27.3s. Estimated remaining: 3h 29m 27s. Rate: 7.5 symbols/min [2025-09-19T18:44:52.054921] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:52.077717] [DEBUG] [LOCAL ] EVTR: Loaded 23028 existing records from primary storage. [2025-09-19T18:44:52.077872] [INFO ] [MAIN ] EVTR: Loaded 23028 existing records. [2025-09-19T18:44:52.265302] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:52.265609] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-19T18:44:52.265690] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-19T18:44:52.266420] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-19T18:44:52.266481] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-19T18:44:52.633771] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:52.646446] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-19T18:44:52.650979] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T18:44:52.891285] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T18:44:53.443266] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-19T18:44:54.002460] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:44:54.243318] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-19T18:44:55.048552] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-19T18:44:55.050870] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T18:44:55.055882] [INFO ] [REMOTE ] EVR: Full fetch complete (50675 records). [2025-09-19T18:44:55.055980] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-19T18:44:55.461811] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-19T18:44:55.461955] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-19T18:44:55.462703] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-19T18:44:55.462785] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-19T18:44:55.464112] [DEBUG] [LOCAL ] EVR: Trimmed 50675 records to 36434 (keeping 200 days of data) [2025-09-19T18:44:55.703727] [DEBUG] [LOCAL ] EVR: Primary data saved (36434 records). [2025-09-19T18:44:55.703883] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-19T18:44:55.703983] [INFO ] [MAIN ] Update Progress: 792/2372 symbols completed. EVR took 39.5s. Estimated remaining: 3h 29m 11s. Rate: 7.6 symbols/min [2025-09-19T18:44:55.845087] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-19T18:44:55.882486] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:55.913976] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T18:44:55.960731] [DEBUG] [LOCAL ] EW: Loaded 53787 existing records from primary storage. [2025-09-19T18:44:55.960877] [INFO ] [MAIN ] EW: Loaded 53787 existing records. [2025-09-19T18:44:56.169741] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:56.171518] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T18:44:56.175978] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-19T18:44:56.176767] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-19T18:44:56.177860] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-19T18:44:56.177921] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-19T18:44:56.545051] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:56.643221] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-19T18:44:57.070113] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:44:57.075233] [INFO ] [REMOTE ] EVTC: Full fetch complete (37882 records). [2025-09-19T18:44:57.075342] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-19T18:44:57.448085] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-19T18:44:57.458035] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-19T18:44:57.459400] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-19T18:44:57.460097] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-19T18:44:57.460163] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-19T18:44:57.461145] [DEBUG] [LOCAL ] EVTC: Trimmed 37882 records to 27089 (keeping 200 days of data) [2025-09-19T18:44:57.625516] [DEBUG] [LOCAL ] EVTC: Primary data saved (27089 records). [2025-09-19T18:44:57.625692] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-19T18:44:57.625827] [INFO ] [MAIN ] Update Progress: 793/2372 symbols completed. EVTC took 27.0s. Estimated remaining: 3h 28m 51s. Rate: 7.6 symbols/min [2025-09-19T18:44:57.800436] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:44:57.836806] [DEBUG] [LOCAL ] EXG: Loaded 35077 existing records from primary storage. [2025-09-19T18:44:57.836951] [INFO ] [MAIN ] EXG: Loaded 35077 existing records. [2025-09-19T18:44:58.013268] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:44:58.013505] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-19T18:44:58.013551] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-19T18:44:58.014411] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-19T18:44:58.014471] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-19T18:44:58.244710] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-19T18:44:58.385131] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:44:58.471901] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T18:44:58.724935] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T18:44:58.907925] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T18:44:59.043231] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-19T18:44:59.843282] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-19T18:45:00.643228] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-19T18:45:01.301207] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T18:45:01.443274] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-19T18:45:01.640724] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T18:45:01.658839] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T18:45:02.243313] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-19T18:45:03.043328] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-19T18:45:03.843274] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-19T18:45:05.150498] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T18:45:05.161138] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-19T18:45:05.427110] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (3.98 seconds). [2025-09-19T18:45:05.443212] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-19T18:45:05.604439] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (3.36 seconds). [2025-09-19T18:45:06.018109] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T18:45:06.243287] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-19T18:45:06.816537] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T18:45:07.043294] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-19T18:45:07.442252] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:45:07.448770] [INFO ] [REMOTE ] EVTL: Full fetch complete (49658 records). [2025-09-19T18:45:07.448931] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-19T18:45:07.449680] [FATAL] [VALIDATOR ] EVTL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:45:07.449801] [FATAL] [MAIN ] EVTL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:45:07.449880] [WARN ] [MAIN ] EVTL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:45:07.449984] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-19T18:45:07.450068] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-09-19T18:45:07.450108] [INFO ] [LOCAL ] EVTL: Starting deletion of derivative data. [2025-09-19T18:45:07.450543] [DEBUG] [LOCAL ] EVTL: Deleted derivative data file. [2025-09-19T18:45:07.450673] [INFO ] [MAIN ] Update Progress: 794/2372 symbols completed. EVTL took 26.2s. Estimated remaining: 3h 28m 47s. Rate: 7.6 symbols/min [2025-09-19T18:45:07.627385] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:07.679388] [DEBUG] [LOCAL ] EXK: Loaded 53465 existing records from primary storage. [2025-09-19T18:45:07.679568] [INFO ] [MAIN ] EXK: Loaded 53465 existing records. [2025-09-19T18:45:07.857482] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-19T18:45:07.864057] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:07.865202] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-19T18:45:07.865286] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-19T18:45:07.866626] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-19T18:45:07.866722] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-19T18:45:08.304262] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:08.324707] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T18:45:08.643288] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-19T18:45:08.998765] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T18:45:09.435125] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-19T18:45:09.446995] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-19T18:45:10.243323] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-19T18:45:10.954797] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T18:45:11.018910] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-19T18:45:11.043219] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-19T18:45:11.469923] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T18:45:11.843293] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-19T18:45:12.643304] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-19T18:45:13.056791] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T18:45:13.443273] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-19T18:45:13.971250] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T18:45:14.243280] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-19T18:45:15.043298] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-19T18:45:16.397588] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (3.75 seconds). [2025-09-19T18:45:16.410616] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-19T18:45:16.687957] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T18:45:16.697343] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-19T18:45:16.715448] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T18:45:16.816552] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (3.37 seconds). [2025-09-19T18:45:17.443298] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-19T18:45:17.892234] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T18:45:18.024525] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T18:45:18.243293] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-19T18:45:18.595112] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:45:19.043265] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-19T18:45:19.843280] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-19T18:45:20.322600] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T18:45:20.643227] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-19T18:45:20.780295] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T18:45:21.443273] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-19T18:45:21.756039] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T18:45:22.243277] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-19T18:45:22.848953] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T18:45:23.043238] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-19T18:45:23.107722] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T18:45:23.723405] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T18:45:23.843266] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-19T18:45:24.643262] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-19T18:45:25.090871] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T18:45:25.443267] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-19T18:45:25.685024] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-19T18:45:26.243263] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-19T18:45:26.319282] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T18:45:27.043265] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-19T18:45:27.264232] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T18:45:27.269401] [INFO ] [REMOTE ] EVTR: Full fetch complete (31339 records). [2025-09-19T18:45:27.269504] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-19T18:45:27.651039] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-19T18:45:27.651119] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-19T18:45:27.651706] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-19T18:45:27.651767] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-19T18:45:27.652517] [DEBUG] [LOCAL ] EVTR: Trimmed 31339 records to 23278 (keeping 200 days of data) [2025-09-19T18:45:27.775450] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T18:45:27.791742] [INFO ] [REMOTE ] EXG: Full fetch complete (50143 records). [2025-09-19T18:45:27.799934] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-19T18:45:27.855430] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-19T18:45:27.904808] [DEBUG] [LOCAL ] EVTR: Primary data saved (23278 records). [2025-09-19T18:45:27.912005] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-19T18:45:27.917506] [INFO ] [MAIN ] Update Progress: 795/2372 symbols completed. EVTR took 36.0s. Estimated remaining: 3h 29m 4s. Rate: 7.5 symbols/min [2025-09-19T18:45:28.344210] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:28.436777] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-19T18:45:28.436858] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-19T18:45:28.437547] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-19T18:45:28.437621] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-19T18:45:28.440034] [DEBUG] [LOCAL ] EXG: Trimmed 50143 records to 35265 (keeping 200 days of data) [2025-09-19T18:45:28.464207] [DEBUG] [LOCAL ] EXP: Loaded 30581 existing records from primary storage. [2025-09-19T18:45:28.464358] [INFO ] [MAIN ] EXP: Loaded 30581 existing records. [2025-09-19T18:45:28.765018] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:28.770122] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-19T18:45:28.778347] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-19T18:45:28.823822] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-19T18:45:28.864819] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-19T18:45:28.873873] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T18:45:28.912508] [INFO ] [REMOTE ] EW: Full fetch complete (77348 records). [2025-09-19T18:45:28.936670] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-19T18:45:29.577220] [DEBUG] [LOCAL ] EXG: Primary data saved (35265 records). [2025-09-19T18:45:29.607449] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-19T18:45:29.623416] [INFO ] [MAIN ] Update Progress: 796/2372 symbols completed. EXG took 32.0s. Estimated remaining: 3h 28m 44s. Rate: 7.6 symbols/min [2025-09-19T18:45:29.612709] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:29.659638] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-19T18:45:29.932506] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-19T18:45:29.932693] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-19T18:45:29.934185] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-19T18:45:29.932150] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:29.934733] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-19T18:45:29.953341] [DEBUG] [LOCAL ] EW: Trimmed 77348 records to 54177 (keeping 200 days of data) [2025-09-19T18:45:29.968888] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T18:45:30.064324] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-19T18:45:30.118493] [DEBUG] [LOCAL ] EXPD: Loaded 48569 existing records from primary storage. [2025-09-19T18:45:30.119914] [INFO ] [MAIN ] EXPD: Loaded 48569 existing records. [2025-09-19T18:45:30.405527] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:30.406515] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-19T18:45:30.407168] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-19T18:45:30.409403] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-19T18:45:30.410020] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-19T18:45:30.790091] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:30.790959] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-19T18:45:30.893795] [DEBUG] [LOCAL ] EW: Primary data saved (54177 records). [2025-09-19T18:45:30.893935] [INFO ] [MAIN ] EW: Full history saved. [2025-09-19T18:45:30.895524] [INFO ] [MAIN ] Update Progress: 797/2372 symbols completed. EW took 35.2s. Estimated remaining: 3h 28m 22s. Rate: 7.6 symbols/min [2025-09-19T18:45:31.076853] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T18:45:31.084055] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-19T18:45:32.336705] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T18:45:32.351089] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-19T18:45:32.385983] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T18:45:32.642537] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:45:32.648244] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-19T18:45:33.443268] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-19T18:45:34.524710] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T18:45:34.534525] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-19T18:45:34.693070] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T18:45:34.999285] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T18:45:35.043228] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-19T18:45:35.843290] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-19T18:45:36.225804] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T18:45:36.380995] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:45:36.643273] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-19T18:45:37.443317] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-19T18:45:38.233168] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T18:45:38.241164] [INFO ] [REMOTE ] EXK: Full fetch complete (76429 records). [2025-09-19T18:45:38.241350] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-19T18:45:38.647310] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-19T18:45:38.647427] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-19T18:45:38.648399] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-19T18:45:38.648482] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-19T18:45:38.650172] [DEBUG] [LOCAL ] EXK: Trimmed 76429 records to 53855 (keeping 200 days of data) [2025-09-19T18:45:38.765693] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T18:45:38.778905] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-19T18:45:39.043721] [DEBUG] [LOCAL ] EXK: Primary data saved (53855 records). [2025-09-19T18:45:39.063147] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-19T18:45:39.063530] [INFO ] [MAIN ] Update Progress: 798/2372 symbols completed. EXK took 31.6s. Estimated remaining: 3h 28m 15s. Rate: 7.6 symbols/min [2025-09-19T18:45:39.065307] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:45:39.072305] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-19T18:45:40.664713] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T18:45:40.676709] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-19T18:45:40.698179] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T18:45:40.706121] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-19T18:45:41.792754] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T18:45:41.799807] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-19T18:45:42.627565] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T18:45:42.640325] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-19T18:45:42.852165] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T18:45:43.043269] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-19T18:45:43.984715] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T18:45:43.994728] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-19T18:45:44.442937] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T18:45:44.643255] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-19T18:45:46.001793] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T18:45:46.012740] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-19T18:45:46.180503] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T18:45:46.185112] [INFO ] [REMOTE ] EXP: Full fetch complete (43111 records). [2025-09-19T18:45:46.185259] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-19T18:45:46.616983] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-19T18:45:46.617068] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-19T18:45:46.617741] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-19T18:45:46.617803] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-19T18:45:46.618884] [DEBUG] [LOCAL ] EXP: Trimmed 43111 records to 30759 (keeping 200 days of data) [2025-09-19T18:45:46.819117] [DEBUG] [LOCAL ] EXP: Primary data saved (30759 records). [2025-09-19T18:45:46.819292] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-19T18:45:46.819445] [INFO ] [MAIN ] Update Progress: 799/2372 symbols completed. EXP took 18.9s. Estimated remaining: 3h 28m 7s. Rate: 7.6 symbols/min [2025-09-19T18:45:47.950415] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T18:45:47.961384] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-19T18:45:49.858627] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T18:45:49.866287] [INFO ] [REMOTE ] EXPD: Full fetch complete (69168 records). [2025-09-19T18:45:49.866416] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-19T18:45:50.262609] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-19T18:45:50.262722] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-19T18:45:50.263671] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-19T18:45:50.263735] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-19T18:45:50.265188] [DEBUG] [LOCAL ] EXPD: Trimmed 69168 records to 48955 (keeping 200 days of data) [2025-09-19T18:45:50.595682] [DEBUG] [LOCAL ] EXPD: Primary data saved (48955 records). [2025-09-19T18:45:50.595862] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-19T18:45:50.596003] [INFO ] [MAIN ] Update Progress: 800/2372 symbols completed. EXPD took 21.0s. Estimated remaining: 3h 27m 51s. Rate: 7.6 symbols/min [2025-09-19T18:45:51.244289] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:51.320707] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:51.319835] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:51.324766] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:45:51.429526] [DEBUG] [LOCAL ] FAF: Loaded 42390 existing records from primary storage. [2025-09-19T18:45:51.430003] [INFO ] [MAIN ] FAF: Loaded 42390 existing records. [2025-09-19T18:45:51.526931] [DEBUG] [LOCAL ] FBIN: Loaded 50823 existing records from primary storage. [2025-09-19T18:45:51.564714] [INFO ] [MAIN ] FBIN: Loaded 50823 existing records. [2025-09-19T18:45:51.559358] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-09-19T18:45:51.585163] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-09-19T18:45:51.781102] [DEBUG] [LOCAL ] EXR: Loaded 45952 existing records from primary storage. [2025-09-19T18:45:51.859505] [INFO ] [MAIN ] EXR: Loaded 45952 existing records. [2025-09-19T18:45:51.868471] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:51.936064] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-19T18:45:51.964189] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-19T18:45:52.008948] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-19T18:45:52.081243] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-19T18:45:52.107073] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:52.180703] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:52.185957] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-19T18:45:52.231714] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-19T18:45:52.256639] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-19T18:45:52.267017] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-19T18:45:52.272321] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-19T18:45:52.267137] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-19T18:45:52.418016] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:45:52.423239] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-19T18:45:52.439292] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-19T18:45:52.513589] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-19T18:45:52.562460] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-19T18:45:52.585710] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-19T18:45:52.617038] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-19T18:45:53.484581] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:53.563271] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-19T18:45:53.572042] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:53.615287] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-19T18:45:53.714310] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:53.738789] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-19T18:45:53.778781] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:45:53.779085] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-19T18:45:55.118733] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:45:55.128860] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-19T18:45:55.411142] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T18:45:55.418450] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-19T18:45:55.751554] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T18:45:55.761375] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-19T18:45:56.449393] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-19T18:45:56.468305] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-19T18:45:56.521518] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T18:45:56.537282] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-19T18:45:57.293424] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:45:57.301287] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-19T18:45:57.632794] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:45:57.643236] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-19T18:45:57.893732] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T18:45:57.905121] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-19T18:45:58.733620] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-19T18:45:58.744296] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-19T18:45:58.804993] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T18:45:58.812469] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-19T18:45:58.941871] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T18:45:58.952583] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-19T18:45:59.771480] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T18:45:59.782415] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-19T18:46:00.150688] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T18:46:00.159910] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-19T18:46:00.392009] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T18:46:00.643286] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-19T18:46:01.210960] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T18:46:01.448347] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-19T18:46:01.467574] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-19T18:46:01.933633] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T18:46:02.100962] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T18:46:02.243304] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-19T18:46:03.043287] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-19T18:46:03.356676] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T18:46:03.843266] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-19T18:46:04.027631] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T18:46:04.643304] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-19T18:46:05.144258] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T18:46:05.443301] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-19T18:46:05.859278] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-09-19T18:46:05.992518] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T18:46:06.243277] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-19T18:46:06.940007] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:46:07.043250] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-19T18:46:07.360125] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T18:46:07.843266] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-19T18:46:08.643275] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-19T18:46:09.126175] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T18:46:09.243792] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:46:09.443386] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-19T18:46:10.243303] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-19T18:46:11.043330] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-19T18:46:11.385205] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-19T18:46:11.448274] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T18:46:11.457197] [INFO ] [REMOTE ] FBIN: Full fetch complete (72591 records). [2025-09-19T18:46:11.457472] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-19T18:46:11.699636] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T18:46:11.856001] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-19T18:46:11.916799] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-19T18:46:11.916902] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-19T18:46:11.917892] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-19T18:46:11.917982] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-19T18:46:11.920110] [DEBUG] [LOCAL ] FBIN: Trimmed 72591 records to 51209 (keeping 200 days of data) [2025-09-19T18:46:12.247159] [DEBUG] [LOCAL ] FBIN: Primary data saved (51209 records). [2025-09-19T18:46:12.247317] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-19T18:46:12.247473] [INFO ] [MAIN ] Update Progress: 801/2372 symbols completed. FBIN took 21.6s. Estimated remaining: 3h 28m 10s. Rate: 7.5 symbols/min [2025-09-19T18:46:12.426452] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:12.455073] [DEBUG] [LOCAL ] FBK: Loaded 25471 existing records from primary storage. [2025-09-19T18:46:12.455217] [INFO ] [MAIN ] FBK: Loaded 25471 existing records. [2025-09-19T18:46:12.642759] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:12.643270] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-19T18:46:12.643368] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-19T18:46:12.643460] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-19T18:46:12.644634] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-19T18:46:12.644763] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-19T18:46:12.970325] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T18:46:13.064983] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:13.443277] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-19T18:46:13.750394] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:46:14.243278] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-19T18:46:15.043249] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-19T18:46:15.113093] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-19T18:46:15.352575] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T18:46:15.368252] [INFO ] [REMOTE ] EXR: Full fetch complete (65662 records). [2025-09-19T18:46:15.369359] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-19T18:46:15.773949] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-19T18:46:15.782466] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-19T18:46:15.796769] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-19T18:46:15.796913] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-19T18:46:15.799469] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T18:46:15.808745] [DEBUG] [LOCAL ] EXR: Trimmed 65662 records to 46271 (keeping 200 days of data) [2025-09-19T18:46:15.884306] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-19T18:46:16.119940] [DEBUG] [LOCAL ] EXR: Primary data saved (46271 records). [2025-09-19T18:46:16.120083] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-19T18:46:16.120197] [INFO ] [MAIN ] Update Progress: 802/2372 symbols completed. EXR took 25.5s. Estimated remaining: 3h 27m 54s. Rate: 7.6 symbols/min [2025-09-19T18:46:16.302220] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:16.313690] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T18:46:16.365753] [DEBUG] [LOCAL ] FBP: Loaded 46725 existing records from primary storage. [2025-09-19T18:46:16.365917] [INFO ] [MAIN ] FBP: Loaded 46725 existing records. [2025-09-19T18:46:16.555875] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:16.556154] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-19T18:46:16.556202] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-19T18:46:16.557419] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-19T18:46:16.557479] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-19T18:46:16.648406] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-19T18:46:16.917741] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:17.058099] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T18:46:17.066064] [INFO ] [REMOTE ] FAF: Full fetch complete (57507 records). [2025-09-19T18:46:17.066251] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-19T18:46:17.455967] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-19T18:46:17.452873] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-19T18:46:17.456163] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-19T18:46:17.457274] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-19T18:46:17.458099] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-19T18:46:17.459518] [DEBUG] [LOCAL ] FAF: Trimmed 57507 records to 42663 (keeping 200 days of data) [2025-09-19T18:46:17.733747] [DEBUG] [LOCAL ] FAF: Primary data saved (42663 records). [2025-09-19T18:46:17.734320] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-19T18:46:17.734471] [INFO ] [MAIN ] Update Progress: 803/2372 symbols completed. FAF took 27.1s. Estimated remaining: 3h 27m 33s. Rate: 7.6 symbols/min [2025-09-19T18:46:17.823060] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T18:46:17.924346] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:17.961388] [DEBUG] [LOCAL ] FBRT: Loaded 34575 existing records from primary storage. [2025-09-19T18:46:17.961525] [INFO ] [MAIN ] FBRT: Loaded 34575 existing records. [2025-09-19T18:46:18.137312] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:18.137597] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-19T18:46:18.137666] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-19T18:46:18.138792] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-19T18:46:18.138853] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-19T18:46:18.248409] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-19T18:46:18.509112] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:19.043256] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-19T18:46:19.456335] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T18:46:19.569350] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T18:46:19.843267] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-19T18:46:20.328036] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:46:20.643267] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-19T18:46:21.443284] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-19T18:46:21.508180] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:46:21.939030] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T18:46:22.243262] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-19T18:46:22.460028] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T18:46:23.043252] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-19T18:46:23.843297] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-19T18:46:24.066951] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T18:46:24.643265] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-19T18:46:25.287089] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T18:46:25.443263] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-19T18:46:25.517124] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T18:46:25.773575] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:46:26.243267] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-19T18:46:26.440716] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:46:26.863769] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T18:46:26.875349] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-19T18:46:26.875525] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-19T18:46:27.048385] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-19T18:46:27.274922] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-19T18:46:27.275033] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-19T18:46:27.275984] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-19T18:46:27.276047] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-19T18:46:27.277527] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-19T18:46:27.617934] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-09-19T18:46:27.618074] [INFO ] [MAIN ] F: Full history saved. [2025-09-19T18:46:27.618169] [INFO ] [MAIN ] Update Progress: 804/2372 symbols completed. F took 37.0s. Estimated remaining: 3h 27m 29s. Rate: 7.6 symbols/min [2025-09-19T18:46:27.786489] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:27.802596] [DEBUG] [LOCAL ] FC: Loaded 15561 existing records from primary storage. [2025-09-19T18:46:27.802740] [INFO ] [MAIN ] FC: Loaded 15561 existing records. [2025-09-19T18:46:27.848349] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-19T18:46:28.029521] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:28.029792] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-19T18:46:28.029844] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-19T18:46:28.030330] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-19T18:46:28.030390] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-19T18:46:28.381286] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:28.394110] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:46:28.643250] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-19T18:46:29.049604] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T18:46:29.443259] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-19T18:46:29.578352] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:46:30.243269] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-19T18:46:31.043261] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-19T18:46:31.102159] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T18:46:31.124485] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-19T18:46:31.825333] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-19T18:46:31.843247] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-19T18:46:32.643237] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-19T18:46:33.041780] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T18:46:33.443240] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-19T18:46:33.904264] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T18:46:34.243262] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-19T18:46:35.043280] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-19T18:46:35.189920] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T18:46:35.833532] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T18:46:35.843204] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-19T18:46:36.600478] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T18:46:36.643223] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-19T18:46:36.842228] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:46:37.443323] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-19T18:46:37.909630] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T18:46:38.243293] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-19T18:46:38.839832] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T18:46:39.043312] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-19T18:46:39.562708] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T18:46:39.843263] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-19T18:46:40.572691] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:46:40.643224] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-19T18:46:41.443316] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-19T18:46:41.603161] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T18:46:42.016175] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T18:46:42.212597] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T18:46:42.243263] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-19T18:46:43.043284] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-19T18:46:43.257377] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T18:46:43.843326] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-19T18:46:44.484955] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T18:46:44.488922] [INFO ] [REMOTE ] FBK: Full fetch complete (32691 records). [2025-09-19T18:46:44.489031] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-19T18:46:44.665906] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-19T18:46:44.866981] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-19T18:46:44.867060] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-19T18:46:44.867673] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-19T18:46:44.867734] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-19T18:46:44.868803] [DEBUG] [LOCAL ] FBK: Trimmed 32691 records to 25716 (keeping 200 days of data) [2025-09-19T18:46:45.025766] [DEBUG] [LOCAL ] FBK: Primary data saved (25716 records). [2025-09-19T18:46:45.025908] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-19T18:46:45.025998] [INFO ] [MAIN ] Update Progress: 805/2372 symbols completed. FBK took 32.8s. Estimated remaining: 3h 27m 40s. Rate: 7.5 symbols/min [2025-09-19T18:46:45.215298] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T18:46:45.214724] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:45.262533] [DEBUG] [LOCAL ] FCF: Loaded 40259 existing records from primary storage. [2025-09-19T18:46:45.262702] [INFO ] [MAIN ] FCF: Loaded 40259 existing records. [2025-09-19T18:46:45.437981] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:45.438243] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-19T18:46:45.438292] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-19T18:46:45.439301] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-19T18:46:45.439363] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-19T18:46:45.454237] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-19T18:46:45.799686] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:46.018811] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T18:46:46.243260] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-19T18:46:46.811899] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T18:46:47.043265] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-19T18:46:47.300765] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T18:46:47.791725] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T18:46:47.843270] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-19T18:46:48.486438] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-19T18:46:48.489106] [INFO ] [REMOTE ] FC: Full fetch complete (21521 records). [2025-09-19T18:46:48.489189] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-19T18:46:48.648926] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-19T18:46:48.866834] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-19T18:46:48.866926] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-19T18:46:48.867425] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-19T18:46:48.867465] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-19T18:46:48.868306] [DEBUG] [LOCAL ] FC: Trimmed 21521 records to 15640 (keeping 200 days of data) [2025-09-19T18:46:48.957569] [DEBUG] [LOCAL ] FC: Primary data saved (15640 records). [2025-09-19T18:46:48.957743] [INFO ] [MAIN ] FC: Full history saved. [2025-09-19T18:46:48.957855] [INFO ] [MAIN ] Update Progress: 806/2372 symbols completed. FC took 21.3s. Estimated remaining: 3h 27m 24s. Rate: 7.6 symbols/min [2025-09-19T18:46:49.131223] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:49.160707] [DEBUG] [LOCAL ] FCN: Loaded 26543 existing records from primary storage. [2025-09-19T18:46:49.160869] [INFO ] [MAIN ] FCN: Loaded 26543 existing records. [2025-09-19T18:46:49.424483] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:49.424916] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-19T18:46:49.425007] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-19T18:46:49.426065] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-19T18:46:49.426145] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-19T18:46:49.448506] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-19T18:46:50.004946] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:50.243325] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-19T18:46:50.630191] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:46:51.043278] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-19T18:46:51.205432] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T18:46:51.226930] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T18:46:51.843264] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-19T18:46:52.643276] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-19T18:46:52.669673] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T18:46:52.676333] [INFO ] [REMOTE ] FBP: Full fetch complete (66291 records). [2025-09-19T18:46:52.676491] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-19T18:46:53.069770] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-19T18:46:53.069926] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-19T18:46:53.070976] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-19T18:46:53.071071] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-19T18:46:53.072601] [DEBUG] [LOCAL ] FBP: Trimmed 66291 records to 47037 (keeping 200 days of data) [2025-09-19T18:46:53.338305] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T18:46:53.373112] [INFO ] [REMOTE ] FBRT: Full fetch complete (48116 records). [2025-09-19T18:46:53.374263] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-19T18:46:53.448401] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-19T18:46:53.695599] [DEBUG] [LOCAL ] FBP: Primary data saved (47037 records). [2025-09-19T18:46:53.701005] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-19T18:46:53.724362] [INFO ] [MAIN ] Update Progress: 807/2372 symbols completed. FBP took 37.6s. Estimated remaining: 3h 27m 10s. Rate: 7.6 symbols/min [2025-09-19T18:46:54.009692] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-19T18:46:54.036774] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-19T18:46:54.036665] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:54.037752] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-19T18:46:54.037898] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-19T18:46:54.040240] [DEBUG] [LOCAL ] FBRT: Trimmed 48116 records to 34817 (keeping 200 days of data) [2025-09-19T18:46:54.157288] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T18:46:54.210271] [DEBUG] [LOCAL ] FCPT: Loaded 37843 existing records from primary storage. [2025-09-19T18:46:54.211004] [INFO ] [MAIN ] FCPT: Loaded 37843 existing records. [2025-09-19T18:46:54.247133] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-19T18:46:54.428458] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:46:54.430400] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-19T18:46:54.430566] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-19T18:46:54.481329] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-19T18:46:54.490541] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T18:46:54.489284] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-19T18:46:54.903363] [DEBUG] [LOCAL ] FBRT: Primary data saved (34817 records). [2025-09-19T18:46:54.924027] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:54.919478] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-19T18:46:54.924171] [INFO ] [MAIN ] Update Progress: 808/2372 symbols completed. FBRT took 37.2s. Estimated remaining: 3h 26m 49s. Rate: 7.6 symbols/min [2025-09-19T18:46:55.048375] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-19T18:46:55.105292] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:46:55.105512] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-19T18:46:55.105569] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-19T18:46:55.105732] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-19T18:46:55.105785] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-19T18:46:55.105829] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-19T18:46:55.105862] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-19T18:46:55.485071] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:46:55.843283] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-19T18:46:55.886981] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T18:46:56.434722] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T18:46:56.643262] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-19T18:46:57.011038] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T18:46:57.038344] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-19T18:46:57.443301] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-19T18:46:57.965839] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T18:46:58.243271] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-19T18:46:58.781510] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T18:46:59.043282] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-19T18:46:59.843270] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-19T18:47:00.437258] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T18:47:00.643276] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-19T18:47:00.997387] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-19T18:47:01.135403] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T18:47:01.443265] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-19T18:47:02.243269] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-19T18:47:03.043284] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-19T18:47:03.090034] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T18:47:03.312233] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T18:47:03.843263] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-19T18:47:04.188607] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-19T18:47:04.228772] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T18:47:04.643263] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-19T18:47:05.443276] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-19T18:47:06.021098] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-19T18:47:06.042496] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-19T18:47:06.243274] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-19T18:47:07.043269] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-19T18:47:07.843270] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-19T18:47:07.894114] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T18:47:08.234180] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-19T18:47:08.290334] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T18:47:08.643269] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-19T18:47:09.443271] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-19T18:47:10.243291] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-19T18:47:10.376633] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T18:47:10.431472] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T18:47:10.658180] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-19T18:47:11.043268] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-19T18:47:11.843271] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-19T18:47:12.644121] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-19T18:47:12.644057] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T18:47:12.645627] [INFO ] [REMOTE ] FCRX: Full fetch complete (1636 records). [2025-09-19T18:47:12.646453] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-19T18:47:12.862727] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:47:12.868256] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-19T18:47:12.868393] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:47:12.875577] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:47:12.875891] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-19T18:47:12.875998] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-19T18:47:12.876168] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-19T18:47:12.876237] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-19T18:47:12.876312] [INFO ] [MAIN ] Update Progress: 809/2372 symbols completed. FCRX took 18.0s. Estimated remaining: 3h 27m 0s. Rate: 7.6 symbols/min [2025-09-19T18:47:13.052664] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:13.067353] [DEBUG] [LOCAL ] FCT: Loaded 14486 existing records from primary storage. [2025-09-19T18:47:13.067474] [INFO ] [MAIN ] FCT: Loaded 14486 existing records. [2025-09-19T18:47:13.251194] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:13.251494] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-19T18:47:13.251549] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-19T18:47:13.252083] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-19T18:47:13.252145] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-19T18:47:13.448380] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-19T18:47:13.622550] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:14.247010] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-19T18:47:14.250959] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T18:47:15.043276] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-19T18:47:15.147210] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T18:47:15.843259] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-19T18:47:15.913296] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T18:47:15.931185] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T18:47:16.643252] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-19T18:47:16.832359] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:47:17.443271] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-19T18:47:18.243263] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-19T18:47:18.643013] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T18:47:19.043274] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-19T18:47:19.097137] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T18:47:19.710892] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T18:47:19.843258] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-19T18:47:20.173402] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T18:47:20.643271] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-19T18:47:21.109970] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T18:47:21.443285] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-19T18:47:22.003445] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:47:22.009401] [INFO ] [REMOTE ] FCF: Full fetch complete (57699 records). [2025-09-19T18:47:22.009529] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-19T18:47:22.010400] [FATAL] [VALIDATOR ] FCF: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T18:47:22.010494] [FATAL] [MAIN ] FCF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:47:22.010537] [WARN ] [MAIN ] FCF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:47:22.010578] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-19T18:47:22.010638] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-09-19T18:47:22.010720] [INFO ] [LOCAL ] FCF: Starting deletion of derivative data. [2025-09-19T18:47:22.011185] [DEBUG] [LOCAL ] FCF: Deleted derivative data file. [2025-09-19T18:47:22.011305] [INFO ] [MAIN ] Update Progress: 810/2372 symbols completed. FCF took 37.0s. Estimated remaining: 3h 26m 55s. Rate: 7.5 symbols/min [2025-09-19T18:47:22.192259] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:22.248385] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-19T18:47:22.251079] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-09-19T18:47:22.251293] [INFO ] [MAIN ] FCX: Loaded 54090 existing records. [2025-09-19T18:47:22.445159] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:22.445440] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-19T18:47:22.445517] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-19T18:47:22.446730] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-19T18:47:22.446791] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-19T18:47:22.832308] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T18:47:22.856132] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:23.043260] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-19T18:47:23.707117] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T18:47:23.712211] [INFO ] [REMOTE ] FCN: Full fetch complete (35504 records). [2025-09-19T18:47:23.712353] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-19T18:47:23.848439] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-19T18:47:24.215714] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-19T18:47:24.215823] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-19T18:47:24.216500] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-19T18:47:24.216541] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-19T18:47:24.217749] [DEBUG] [LOCAL ] FCN: Trimmed 35504 records to 26751 (keeping 200 days of data) [2025-09-19T18:47:24.328154] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T18:47:24.336518] [INFO ] [REMOTE ] FCPT: Full fetch complete (53177 records). [2025-09-19T18:47:24.338038] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-19T18:47:24.649063] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-19T18:47:24.783570] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-19T18:47:24.789276] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-19T18:47:24.799919] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-19T18:47:24.800440] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-19T18:47:24.802790] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:47:24.843461] [DEBUG] [LOCAL ] FCPT: Trimmed 53177 records to 38112 (keeping 200 days of data) [2025-09-19T18:47:24.950231] [DEBUG] [LOCAL ] FCN: Primary data saved (26751 records). [2025-09-19T18:47:24.952920] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-19T18:47:24.953607] [INFO ] [MAIN ] Update Progress: 811/2372 symbols completed. FCN took 36.0s. Estimated remaining: 3h 26m 37s. Rate: 7.6 symbols/min [2025-09-19T18:47:25.241764] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:25.311876] [DEBUG] [LOCAL ] FCPT: Primary data saved (38112 records). [2025-09-19T18:47:25.312059] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-19T18:47:25.312154] [INFO ] [MAIN ] Update Progress: 812/2372 symbols completed. FCPT took 31.6s. Estimated remaining: 3h 26m 14s. Rate: 7.6 symbols/min [2025-09-19T18:47:25.445054] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-19T18:47:25.487957] [DEBUG] [LOCAL ] FDP: Loaded 30690 existing records from primary storage. [2025-09-19T18:47:25.494703] [INFO ] [MAIN ] FDP: Loaded 30690 existing records. [2025-09-19T18:47:25.534079] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:25.730743] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:25.732029] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-19T18:47:25.732141] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-19T18:47:25.732591] [DEBUG] [LOCAL ] FDS: Loaded 25899 existing records from primary storage. [2025-09-19T18:47:25.732802] [INFO ] [MAIN ] FDS: Loaded 25899 existing records. [2025-09-19T18:47:25.764052] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-19T18:47:25.789748] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-19T18:47:26.086579] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:26.179608] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-19T18:47:26.186026] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-19T18:47:26.209407] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-19T18:47:26.220786] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-19T18:47:26.412158] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:26.423062] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-19T18:47:26.516230] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T18:47:26.700595] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:26.974795] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T18:47:27.043212] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-19T18:47:27.799989] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T18:47:27.843241] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-19T18:47:28.643282] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-19T18:47:28.886740] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T18:47:29.174102] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T18:47:29.443284] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-19T18:47:29.810811] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T18:47:30.243276] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-19T18:47:31.043303] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-19T18:47:31.210044] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T18:47:31.346029] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T18:47:31.843267] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-19T18:47:32.485914] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T18:47:32.643272] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-19T18:47:33.330058] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T18:47:33.443257] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-19T18:47:34.243287] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-19T18:47:34.292084] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T18:47:34.433414] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T18:47:35.043265] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-19T18:47:35.843273] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-19T18:47:36.076692] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:47:36.562553] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T18:47:36.643265] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-19T18:47:36.805159] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T18:47:37.443282] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-19T18:47:37.856222] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T18:47:38.243298] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-19T18:47:39.021266] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T18:47:39.043220] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-19T18:47:39.489842] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T18:47:39.843270] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-19T18:47:40.501522] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T18:47:40.643301] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-19T18:47:40.974958] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T18:47:41.443279] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-19T18:47:42.243269] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-19T18:47:42.499085] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T18:47:42.817069] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T18:47:42.883464] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:47:43.043296] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-19T18:47:43.843290] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-19T18:47:44.184327] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T18:47:44.187327] [INFO ] [REMOTE ] FCT: Full fetch complete (21229 records). [2025-09-19T18:47:44.187421] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-19T18:47:44.550521] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-19T18:47:44.550602] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-19T18:47:44.551045] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-19T18:47:44.551105] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-19T18:47:44.551687] [DEBUG] [LOCAL ] FCT: Trimmed 21229 records to 14568 (keeping 200 days of data) [2025-09-19T18:47:44.636959] [DEBUG] [LOCAL ] FCT: Primary data saved (14568 records). [2025-09-19T18:47:44.637153] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-19T18:47:44.637304] [INFO ] [MAIN ] Update Progress: 813/2372 symbols completed. FCT took 31.8s. Estimated remaining: 3h 26m 28s. Rate: 7.6 symbols/min [2025-09-19T18:47:44.649067] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-19T18:47:44.809965] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:44.863927] [DEBUG] [LOCAL ] FDX: Loaded 51948 existing records from primary storage. [2025-09-19T18:47:44.864070] [INFO ] [MAIN ] FDX: Loaded 51948 existing records. [2025-09-19T18:47:45.043174] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:45.043454] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-19T18:47:45.043514] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-19T18:47:45.044949] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-19T18:47:45.045038] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-19T18:47:45.407621] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:45.443259] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-19T18:47:45.689682] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:47:46.135845] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T18:47:46.243234] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-19T18:47:47.043294] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-19T18:47:47.398572] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T18:47:47.843233] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-19T18:47:47.860636] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T18:47:47.945803] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T18:47:47.950322] [INFO ] [REMOTE ] FDP: Full fetch complete (42783 records). [2025-09-19T18:47:47.950451] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-19T18:47:48.346233] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-19T18:47:48.346338] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-19T18:47:48.347010] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-19T18:47:48.347071] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-19T18:47:48.348038] [DEBUG] [LOCAL ] FDP: Trimmed 42783 records to 30932 (keeping 200 days of data) [2025-09-19T18:47:48.539555] [DEBUG] [LOCAL ] FDP: Primary data saved (30932 records). [2025-09-19T18:47:48.539734] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-19T18:47:48.539837] [INFO ] [MAIN ] Update Progress: 814/2372 symbols completed. FDP took 23.6s. Estimated remaining: 3h 26m 13s. Rate: 7.6 symbols/min [2025-09-19T18:47:48.646109] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-19T18:47:48.730025] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:48.784855] [DEBUG] [LOCAL ] FE: Loaded 53831 existing records from primary storage. [2025-09-19T18:47:48.785025] [INFO ] [MAIN ] FE: Loaded 53831 existing records. [2025-09-19T18:47:48.993116] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:47:48.993421] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-19T18:47:48.993502] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-19T18:47:48.994967] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-19T18:47:48.995050] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-19T18:47:49.381799] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:49.443282] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-19T18:47:49.711710] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T18:47:50.243277] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-19T18:47:50.596054] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T18:47:51.043279] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-19T18:47:51.215358] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T18:47:51.843282] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-19T18:47:52.188464] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T18:47:52.236584] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T18:47:52.643264] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-19T18:47:53.443222] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-19T18:47:53.581235] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T18:47:53.838473] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T18:47:54.243282] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-19T18:47:55.043307] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-19T18:47:55.198226] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T18:47:55.430343] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T18:47:55.843303] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-19T18:47:56.643267] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-19T18:47:57.015475] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T18:47:57.443280] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-19T18:47:57.908915] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:47:57.915997] [INFO ] [REMOTE ] FDS: Full fetch complete (36318 records). [2025-09-19T18:47:57.916269] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-19T18:47:58.156452] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T18:47:58.252805] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-19T18:47:58.381484] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-19T18:47:58.381571] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-19T18:47:58.382256] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-19T18:47:58.382319] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-19T18:47:58.383214] [DEBUG] [LOCAL ] FDS: Trimmed 36318 records to 26237 (keeping 200 days of data) [2025-09-19T18:47:58.550675] [DEBUG] [LOCAL ] FDS: Primary data saved (26237 records). [2025-09-19T18:47:58.550837] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-19T18:47:58.550930] [INFO ] [MAIN ] Update Progress: 815/2372 symbols completed. FDS took 33.2s. Estimated remaining: 3h 26m 9s. Rate: 7.6 symbols/min [2025-09-19T18:47:58.724951] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:47:58.725135] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-19T18:47:58.725241] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-19T18:47:58.725359] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-19T18:47:58.725399] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-19T18:47:58.725441] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-19T18:47:58.725473] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-19T18:47:59.051140] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-19T18:47:59.095056] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:47:59.213827] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:47:59.843293] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-19T18:47:59.914133] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:48:00.334422] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T18:48:00.643308] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-19T18:48:01.153077] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T18:48:01.443345] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-19T18:48:01.755540] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T18:48:02.243319] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-19T18:48:03.043270] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-19T18:48:03.843259] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-19T18:48:04.389816] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T18:48:04.643232] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-19T18:48:05.333037] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-19T18:48:05.362856] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (3.92 seconds). [2025-09-19T18:48:05.448456] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-19T18:48:05.465779] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-09-19T18:48:05.877864] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-09-19T18:48:06.243267] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-19T18:48:06.845027] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-19T18:48:07.043312] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-19T18:48:07.734392] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T18:48:07.843252] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-19T18:48:08.643288] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-19T18:48:09.443306] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-19T18:48:09.549054] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T18:48:09.621804] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T18:48:09.995029] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T18:48:10.152757] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T18:48:10.243312] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-19T18:48:10.647050] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T18:48:11.043268] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-19T18:48:11.476585] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-19T18:48:11.843263] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-19T18:48:12.643289] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-19T18:48:13.349832] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-19T18:48:13.443256] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-19T18:48:14.243264] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-19T18:48:14.949514] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-19T18:48:15.043237] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-19T18:48:15.051787] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T18:48:15.052704] [INFO ] [REMOTE ] FENG: Full fetch complete (2124 records). [2025-09-19T18:48:15.052778] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-19T18:48:15.232759] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T18:48:15.233008] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:48:15.233083] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:48:15.233196] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-19T18:48:15.233289] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-19T18:48:15.233345] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-19T18:48:15.233390] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-19T18:48:15.233450] [INFO ] [MAIN ] Update Progress: 816/2372 symbols completed. FENG took 16.7s. Estimated remaining: 3h 26m 17s. Rate: 7.5 symbols/min [2025-09-19T18:48:15.403355] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:15.458338] [DEBUG] [LOCAL ] FERG: Loaded 49429 existing records from primary storage. [2025-09-19T18:48:15.458496] [INFO ] [MAIN ] FERG: Loaded 49429 existing records. [2025-09-19T18:48:15.641086] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:15.641320] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-19T18:48:15.641367] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-19T18:48:15.642558] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-19T18:48:15.642617] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-19T18:48:15.854419] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-19T18:48:16.003477] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:16.612001] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T18:48:16.643212] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-19T18:48:16.951617] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-19T18:48:16.960211] [INFO ] [REMOTE ] FDX: Full fetch complete (74395 records). [2025-09-19T18:48:16.960356] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-19T18:48:17.373726] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-19T18:48:17.373820] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-19T18:48:17.374805] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-19T18:48:17.374868] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-19T18:48:17.376998] [DEBUG] [LOCAL ] FDX: Trimmed 74395 records to 52338 (keeping 200 days of data) [2025-09-19T18:48:17.467526] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-19T18:48:17.716187] [DEBUG] [LOCAL ] FDX: Primary data saved (52338 records). [2025-09-19T18:48:17.716394] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-19T18:48:17.716586] [INFO ] [MAIN ] Update Progress: 817/2372 symbols completed. FDX took 33.1s. Estimated remaining: 3h 25m 59s. Rate: 7.5 symbols/min [2025-09-19T18:48:17.894127] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:17.915574] [DEBUG] [LOCAL ] FET: Loaded 12836 existing records from primary storage. [2025-09-19T18:48:17.915746] [INFO ] [MAIN ] FET: Loaded 12836 existing records. [2025-09-19T18:48:18.109405] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:18.109867] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-19T18:48:18.109977] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-19T18:48:18.110502] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-19T18:48:18.110588] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-19T18:48:18.512848] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T18:48:18.534222] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:18.545168] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-19T18:48:18.954030] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T18:48:19.002380] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T18:48:19.043217] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-19T18:48:19.248156] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T18:48:19.843272] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-19T18:48:20.643268] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-19T18:48:20.934434] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T18:48:21.242124] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T18:48:21.443263] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-19T18:48:22.012015] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T18:48:22.021698] [INFO ] [REMOTE ] FCX: Full fetch complete (77739 records). [2025-09-19T18:48:22.021870] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-19T18:48:22.250485] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-19T18:48:22.326570] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T18:48:22.463277] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-19T18:48:22.463375] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-19T18:48:22.464669] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-19T18:48:22.464756] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-19T18:48:22.474415] [DEBUG] [LOCAL ] FCX: Trimmed 77739 records to 54480 (keeping 200 days of data) [2025-09-19T18:48:22.824235] [DEBUG] [LOCAL ] FCX: Primary data saved (54480 records). [2025-09-19T18:48:22.824401] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-19T18:48:22.824543] [INFO ] [MAIN ] Update Progress: 818/2372 symbols completed. FCX took 1m 1s. Estimated remaining: 3h 25m 46s. Rate: 7.6 symbols/min [2025-09-19T18:48:23.006006] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:23.036552] [DEBUG] [LOCAL ] FF: Loaded 26065 existing records from primary storage. [2025-09-19T18:48:23.036721] [INFO ] [MAIN ] FF: Loaded 26065 existing records. [2025-09-19T18:48:23.049690] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-19T18:48:23.220107] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:23.220363] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-19T18:48:23.220410] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-19T18:48:23.221207] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-19T18:48:23.221299] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-19T18:48:23.619135] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:23.843275] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-19T18:48:24.406165] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T18:48:24.416299] [INFO ] [REMOTE ] FE: Full fetch complete (77185 records). [2025-09-19T18:48:24.416457] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-19T18:48:24.653168] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-19T18:48:24.832376] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-19T18:48:24.832471] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-19T18:48:24.833479] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-19T18:48:24.833554] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-19T18:48:24.844244] [DEBUG] [LOCAL ] FE: Trimmed 77185 records to 54219 (keeping 200 days of data) [2025-09-19T18:48:25.189274] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T18:48:25.233831] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T18:48:25.255866] [DEBUG] [LOCAL ] FE: Primary data saved (54219 records). [2025-09-19T18:48:25.255997] [INFO ] [MAIN ] FE: Full history saved. [2025-09-19T18:48:25.256112] [INFO ] [MAIN ] Update Progress: 819/2372 symbols completed. FE took 36.7s. Estimated remaining: 3h 25m 27s. Rate: 7.6 symbols/min [2025-09-19T18:48:25.438323] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:25.446450] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-19T18:48:25.450518] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T18:48:25.458962] [DEBUG] [LOCAL ] FFA: Loaded 5628 existing records from primary storage. [2025-09-19T18:48:25.459050] [INFO ] [MAIN ] FFA: Loaded 5628 existing records. [2025-09-19T18:48:25.646541] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:25.646807] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-19T18:48:25.646860] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-19T18:48:25.647200] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-19T18:48:25.647261] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-19T18:48:26.011212] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:26.243235] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-19T18:48:27.038162] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T18:48:27.043221] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-19T18:48:27.506959] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T18:48:27.843256] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-19T18:48:28.262789] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T18:48:28.643276] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-19T18:48:29.329715] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-19T18:48:29.443280] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-19T18:48:29.536140] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T18:48:30.243265] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-19T18:48:30.949638] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T18:48:31.043261] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-19T18:48:31.148419] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:48:31.821119] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T18:48:31.843216] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-19T18:48:32.571017] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T18:48:32.643273] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-19T18:48:33.443285] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-19T18:48:34.243332] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-19T18:48:34.424035] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T18:48:34.550771] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T18:48:35.043275] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-19T18:48:35.127010] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T18:48:35.817410] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T18:48:35.843333] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-19T18:48:36.643281] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-19T18:48:37.444109] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-19T18:48:37.446958] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T18:48:37.611139] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T18:48:38.243289] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-19T18:48:39.043298] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-19T18:48:39.140356] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T18:48:39.573607] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T18:48:39.843237] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-19T18:48:39.974374] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T18:48:40.437345] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T18:48:40.643284] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-19T18:48:41.326896] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T18:48:41.443293] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-19T18:48:42.243281] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-19T18:48:42.441934] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:48:43.043301] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-19T18:48:43.323144] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T18:48:43.843289] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-19T18:48:44.643279] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-19T18:48:45.032031] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T18:48:45.118088] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T18:48:45.208927] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T18:48:45.443253] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-19T18:48:46.243282] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-19T18:48:46.684711] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T18:48:47.043309] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-19T18:48:47.468625] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:48:47.843275] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-19T18:48:48.643236] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-19T18:48:48.786941] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T18:48:48.790432] [INFO ] [REMOTE ] FF: Full fetch complete (37345 records). [2025-09-19T18:48:48.790517] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-19T18:48:49.060348] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T18:48:49.127449] [INFO ] [REMOTE ] FERG: Full fetch complete (71015 records). [2025-09-19T18:48:49.127752] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-19T18:48:49.289255] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T18:48:49.340736] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-19T18:48:49.351952] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-19T18:48:49.352751] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-19T18:48:49.357949] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-19T18:48:49.402934] [DEBUG] [LOCAL ] FF: Trimmed 37345 records to 26197 (keeping 200 days of data) [2025-09-19T18:48:49.444443] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-19T18:48:49.764088] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-19T18:48:49.764766] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-19T18:48:49.766048] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-19T18:48:49.766129] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-19T18:48:49.794705] [DEBUG] [LOCAL ] FERG: Trimmed 71015 records to 49797 (keeping 200 days of data) [2025-09-19T18:48:49.806369] [DEBUG] [LOCAL ] FF: Primary data saved (26197 records). [2025-09-19T18:48:49.806533] [INFO ] [MAIN ] FF: Full history saved. [2025-09-19T18:48:49.806665] [INFO ] [MAIN ] Update Progress: 820/2372 symbols completed. FF took 27.0s. Estimated remaining: 3h 25m 51s. Rate: 7.5 symbols/min [2025-09-19T18:48:50.074939] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:50.098034] [DEBUG] [LOCAL ] FFC: Loaded 16790 existing records from primary storage. [2025-09-19T18:48:50.099030] [INFO ] [MAIN ] FFC: Loaded 16790 existing records. [2025-09-19T18:48:50.245719] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-19T18:48:50.290019] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:50.290834] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-19T18:48:50.290888] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-19T18:48:50.291704] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-19T18:48:50.291806] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-19T18:48:50.793403] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:50.803240] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:48:50.806599] [INFO ] [REMOTE ] FET: Full fetch complete (18083 records). [2025-09-19T18:48:50.806940] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-19T18:48:51.047457] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-19T18:48:51.204062] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-19T18:48:51.204438] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-19T18:48:51.205099] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-19T18:48:51.205176] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-19T18:48:51.207132] [DEBUG] [LOCAL ] FET: Trimmed 18083 records to 12925 (keeping 200 days of data) [2025-09-19T18:48:51.332886] [DEBUG] [LOCAL ] FET: Primary data saved (12925 records). [2025-09-19T18:48:51.335689] [INFO ] [MAIN ] FET: Full history saved. [2025-09-19T18:48:51.336125] [INFO ] [MAIN ] Update Progress: 821/2372 symbols completed. FET took 33.6s. Estimated remaining: 3h 25m 31s. Rate: 7.5 symbols/min [2025-09-19T18:48:51.528684] [DEBUG] [LOCAL ] FERG: Primary data saved (49797 records). [2025-09-19T18:48:51.528561] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:51.528873] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-19T18:48:51.529016] [INFO ] [MAIN ] Update Progress: 822/2372 symbols completed. FERG took 36.3s. Estimated remaining: 3h 25m 8s. Rate: 7.6 symbols/min [2025-09-19T18:48:51.722608] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:51.736432] [DEBUG] [LOCAL ] FFWM: Loaded 36552 existing records from primary storage. [2025-09-19T18:48:51.736584] [INFO ] [MAIN ] FFWM: Loaded 36552 existing records. [2025-09-19T18:48:51.898933] [DEBUG] [LOCAL ] FG: Loaded 22428 existing records from primary storage. [2025-09-19T18:48:51.899350] [INFO ] [MAIN ] FG: Loaded 22428 existing records. [2025-09-19T18:48:52.036292] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:52.044690] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-19T18:48:52.049883] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-19T18:48:52.078822] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-19T18:48:52.089367] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-19T18:48:52.193298] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:52.238050] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-19T18:48:52.240851] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-19T18:48:52.247016] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-19T18:48:52.252223] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-19T18:48:52.480880] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-19T18:48:52.581165] [INFO ] [REMOTE ] FFA: Full fetch complete (8176 records). [2025-09-19T18:48:52.606949] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-19T18:48:52.881216] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:52.908218] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-19T18:48:53.076482] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:53.134200] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-19T18:48:53.179679] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T18:48:53.305072] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-19T18:48:53.305154] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-19T18:48:53.305416] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-19T18:48:53.305454] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-19T18:48:53.305891] [DEBUG] [LOCAL ] FFA: Trimmed 8176 records to 5687 (keeping 200 days of data) [2025-09-19T18:48:53.339564] [DEBUG] [LOCAL ] FFA: Primary data saved (5687 records). [2025-09-19T18:48:53.339678] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-19T18:48:53.339778] [INFO ] [MAIN ] Update Progress: 823/2372 symbols completed. FFA took 28.1s. Estimated remaining: 3h 24m 49s. Rate: 7.6 symbols/min [2025-09-19T18:48:53.448389] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-19T18:48:53.509861] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:48:53.518578] [DEBUG] [LOCAL ] FGN: Loaded 4071 existing records from primary storage. [2025-09-19T18:48:53.518721] [INFO ] [MAIN ] FGN: Loaded 4071 existing records. [2025-09-19T18:48:53.692469] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:48:53.692756] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-19T18:48:53.692812] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-19T18:48:53.693078] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-19T18:48:53.693137] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-19T18:48:54.050197] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:48:54.173456] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T18:48:54.243235] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-19T18:48:54.421909] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T18:48:54.652117] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T18:48:54.722933] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-19T18:48:55.043270] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-19T18:48:55.411333] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-19T18:48:55.843265] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-19T18:48:56.503796] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T18:48:56.643265] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-19T18:48:57.443283] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-19T18:48:58.143824] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T18:48:58.243276] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-19T18:48:58.274599] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T18:48:58.686356] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T18:48:59.043298] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-19T18:48:59.843272] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-19T18:49:00.529576] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T18:49:00.643235] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-19T18:49:01.036366] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T18:49:01.443259] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-19T18:49:01.885973] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:49:02.203204] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T18:49:02.243226] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-19T18:49:03.043310] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-19T18:49:03.190939] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T18:49:03.843273] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-19T18:49:04.599910] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T18:49:04.643219] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-19T18:49:04.716794] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T18:49:05.206854] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T18:49:05.443293] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-19T18:49:06.243260] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-19T18:49:06.906805] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-19T18:49:07.043280] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-19T18:49:07.277919] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T18:49:07.743277] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T18:49:07.843289] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-19T18:49:08.530609] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-19T18:49:08.531633] [INFO ] [REMOTE ] FGN: Full fetch complete (5769 records). [2025-09-19T18:49:08.531738] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-19T18:49:08.648358] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-19T18:49:08.904111] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-19T18:49:08.904222] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-19T18:49:08.904413] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-19T18:49:08.904466] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-19T18:49:08.904952] [DEBUG] [LOCAL ] FGN: Trimmed 5769 records to 4085 (keeping 200 days of data) [2025-09-19T18:49:08.930043] [DEBUG] [LOCAL ] FGN: Primary data saved (4085 records). [2025-09-19T18:49:08.930139] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-19T18:49:08.930220] [INFO ] [MAIN ] Update Progress: 824/2372 symbols completed. FGN took 15.6s. Estimated remaining: 3h 24m 55s. Rate: 7.6 symbols/min [2025-09-19T18:49:09.101773] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:09.101963] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-19T18:49:09.102006] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-19T18:49:09.102149] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-19T18:49:09.102190] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-19T18:49:09.102230] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-19T18:49:09.102261] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-19T18:49:09.451108] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-19T18:49:09.493730] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:10.243308] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-19T18:49:10.354330] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T18:49:10.518808] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:49:10.519347] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-19T18:49:11.043285] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-19T18:49:11.843266] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-19T18:49:11.979485] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T18:49:12.643270] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-19T18:49:13.007925] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T18:49:13.443263] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-19T18:49:14.243320] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-19T18:49:14.356166] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (4.91 seconds). [2025-09-19T18:49:14.420415] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:49:14.982231] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T18:49:15.043290] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-19T18:49:15.711176] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T18:49:15.843263] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-19T18:49:16.530135] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (3.09 seconds). [2025-09-19T18:49:16.643283] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-19T18:49:17.443275] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-19T18:49:18.243293] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-19T18:49:18.348671] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T18:49:18.879984] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-19T18:49:19.043279] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-19T18:49:19.558007] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T18:49:19.843267] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-19T18:49:20.091499] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T18:49:20.127527] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (3.48 seconds). [2025-09-19T18:49:20.423114] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T18:49:20.643287] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-19T18:49:21.443281] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-19T18:49:21.807504] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T18:49:22.243280] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-19T18:49:22.338669] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T18:49:23.043269] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-19T18:49:23.226349] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T18:49:23.843261] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-19T18:49:24.277829] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:49:24.628639] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T18:49:24.631546] [INFO ] [REMOTE ] FFC: Full fetch complete (24840 records). [2025-09-19T18:49:24.631623] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-19T18:49:24.653269] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-19T18:49:25.012140] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-19T18:49:25.012233] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-19T18:49:25.012783] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-19T18:49:25.012844] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-19T18:49:25.013537] [DEBUG] [LOCAL ] FFC: Trimmed 24840 records to 16868 (keeping 200 days of data) [2025-09-19T18:49:25.116246] [DEBUG] [LOCAL ] FFC: Primary data saved (16868 records). [2025-09-19T18:49:25.116388] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-19T18:49:25.116476] [INFO ] [MAIN ] Update Progress: 825/2372 symbols completed. FFC took 35.3s. Estimated remaining: 3h 25m 3s. Rate: 7.5 symbols/min [2025-09-19T18:49:25.288880] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:25.328944] [DEBUG] [LOCAL ] FHI: Loaded 41135 existing records from primary storage. [2025-09-19T18:49:25.329090] [INFO ] [MAIN ] FHI: Loaded 41135 existing records. [2025-09-19T18:49:25.448342] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-19T18:49:25.508781] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:25.509003] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-19T18:49:25.509067] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-19T18:49:25.510206] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-19T18:49:25.510427] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-19T18:49:25.868680] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:25.929998] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T18:49:26.243247] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-19T18:49:26.286264] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T18:49:27.043268] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-19T18:49:27.546551] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-19T18:49:27.843277] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-19T18:49:27.900169] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:49:28.643291] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-19T18:49:29.406795] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:49:29.411866] [INFO ] [REMOTE ] FFWM: Full fetch complete (51734 records). [2025-09-19T18:49:29.411968] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-19T18:49:29.448343] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-19T18:49:29.793053] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-19T18:49:29.793136] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-19T18:49:29.793896] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-19T18:49:29.793958] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-19T18:49:29.795088] [DEBUG] [LOCAL ] FFWM: Trimmed 51734 records to 36810 (keeping 200 days of data) [2025-09-19T18:49:30.011804] [DEBUG] [LOCAL ] FFWM: Primary data saved (36810 records). [2025-09-19T18:49:30.011999] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-19T18:49:30.012089] [INFO ] [MAIN ] Update Progress: 826/2372 symbols completed. FFWM took 38.7s. Estimated remaining: 3h 24m 49s. Rate: 7.5 symbols/min [2025-09-19T18:49:30.185791] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:30.247900] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-19T18:49:30.249899] [DEBUG] [LOCAL ] FHN: Loaded 53758 existing records from primary storage. [2025-09-19T18:49:30.249987] [INFO ] [MAIN ] FHN: Loaded 53758 existing records. [2025-09-19T18:49:30.443757] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:30.444586] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T18:49:30.447234] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-19T18:49:30.447345] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-19T18:49:30.448927] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-19T18:49:30.449031] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-19T18:49:30.595037] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:49:30.850146] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:31.043247] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-19T18:49:31.074717] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T18:49:31.078057] [INFO ] [REMOTE ] FG: Full fetch complete (27033 records). [2025-09-19T18:49:31.078135] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-19T18:49:31.444590] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-19T18:49:31.444737] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-19T18:49:31.445392] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-19T18:49:31.445449] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-19T18:49:31.446213] [DEBUG] [LOCAL ] FG: Trimmed 27033 records to 22587 (keeping 200 days of data) [2025-09-19T18:49:31.586265] [DEBUG] [LOCAL ] FG: Primary data saved (22587 records). [2025-09-19T18:49:31.586394] [INFO ] [MAIN ] FG: Full history saved. [2025-09-19T18:49:31.586478] [INFO ] [MAIN ] Update Progress: 827/2372 symbols completed. FG took 40.1s. Estimated remaining: 3h 24m 29s. Rate: 7.6 symbols/min [2025-09-19T18:49:31.754017] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:31.809362] [DEBUG] [LOCAL ] FI: Loaded 53888 existing records from primary storage. [2025-09-19T18:49:31.809505] [INFO ] [MAIN ] FI: Loaded 53888 existing records. [2025-09-19T18:49:31.851418] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-19T18:49:31.995669] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:31.996033] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-19T18:49:31.996109] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-19T18:49:31.997418] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-19T18:49:31.997487] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-19T18:49:32.360509] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:32.394569] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T18:49:32.594261] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T18:49:32.643301] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-19T18:49:33.443310] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-19T18:49:34.057048] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T18:49:34.058513] [INFO ] [REMOTE ] FGSN: Full fetch complete (7480 records). [2025-09-19T18:49:34.058587] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-19T18:49:34.261813] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-19T18:49:34.294912] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-19T18:49:34.295706] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:49:34.296242] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:49:34.296573] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-19T18:49:34.297187] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-19T18:49:34.300661] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:49:34.310597] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-19T18:49:34.316225] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-19T18:49:34.316374] [INFO ] [MAIN ] Update Progress: 828/2372 symbols completed. FGSN took 25.4s. Estimated remaining: 3h 24m 11s. Rate: 7.6 symbols/min [2025-09-19T18:49:34.502541] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:34.530400] [DEBUG] [LOCAL ] FICO: Loaded 20603 existing records from primary storage. [2025-09-19T18:49:34.530672] [INFO ] [MAIN ] FICO: Loaded 20603 existing records. [2025-09-19T18:49:34.730735] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:34.731121] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-19T18:49:34.731239] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-19T18:49:34.732144] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-19T18:49:34.732206] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-19T18:49:35.059260] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-19T18:49:35.101936] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:35.843272] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-19T18:49:35.950157] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T18:49:36.643249] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-19T18:49:37.229763] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T18:49:37.384349] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-19T18:49:37.443274] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-19T18:49:37.751694] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T18:49:38.243324] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-19T18:49:38.744049] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T18:49:39.043263] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-19T18:49:39.843276] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-19T18:49:39.965305] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T18:49:40.538962] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T18:49:40.610093] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T18:49:40.643215] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-19T18:49:41.443229] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-19T18:49:41.560461] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T18:49:42.243275] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-19T18:49:42.865433] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T18:49:43.043238] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-19T18:49:43.107611] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T18:49:43.843269] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-19T18:49:44.643282] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-19T18:49:44.861476] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T18:49:45.234312] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T18:49:45.443247] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-19T18:49:45.631781] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T18:49:46.243311] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-19T18:49:47.043351] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-19T18:49:47.532262] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T18:49:47.739176] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T18:49:47.843274] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-19T18:49:48.563441] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T18:49:48.643237] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-19T18:49:49.149425] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T18:49:49.443278] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-19T18:49:50.030200] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T18:49:50.243242] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-19T18:49:51.043250] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-19T18:49:51.144878] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T18:49:51.241780] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T18:49:51.843269] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-19T18:49:52.197407] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T18:49:52.643268] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-19T18:49:53.422214] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T18:49:53.443231] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-19T18:49:54.243293] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-19T18:49:54.307054] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T18:49:54.312677] [INFO ] [REMOTE ] FHI: Full fetch complete (57783 records). [2025-09-19T18:49:54.312802] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-19T18:49:54.695531] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-19T18:49:54.695614] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-19T18:49:54.696632] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-19T18:49:54.696738] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-19T18:49:54.698484] [DEBUG] [LOCAL ] FHI: Trimmed 57783 records to 41458 (keeping 200 days of data) [2025-09-19T18:49:54.955960] [DEBUG] [LOCAL ] FHI: Primary data saved (41458 records). [2025-09-19T18:49:54.956134] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-19T18:49:54.956273] [INFO ] [MAIN ] Update Progress: 829/2372 symbols completed. FHI took 29.8s. Estimated remaining: 3h 24m 27s. Rate: 7.5 symbols/min [2025-09-19T18:49:55.051736] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-19T18:49:55.137129] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:55.137336] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-19T18:49:55.137375] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-19T18:49:55.137536] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-19T18:49:55.137579] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-19T18:49:55.137620] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-19T18:49:55.137684] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-19T18:49:55.503192] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:49:55.627919] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T18:49:55.843259] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-19T18:49:56.612358] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T18:49:56.643225] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-19T18:49:57.201115] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T18:49:57.443266] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-19T18:49:58.243244] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-19T18:49:58.446434] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-19T18:49:58.836477] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:49:58.840195] [INFO ] [REMOTE ] FICO: Full fetch complete (28299 records). [2025-09-19T18:49:58.840277] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-19T18:49:58.923872] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-19T18:49:59.048503] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-19T18:49:59.175894] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T18:49:59.273727] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-19T18:49:59.273814] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-19T18:49:59.274391] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-19T18:49:59.274430] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-19T18:49:59.275225] [DEBUG] [LOCAL ] FICO: Trimmed 28299 records to 20784 (keeping 200 days of data) [2025-09-19T18:49:59.407813] [DEBUG] [LOCAL ] FICO: Primary data saved (20784 records). [2025-09-19T18:49:59.407945] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-19T18:49:59.408047] [INFO ] [MAIN ] Update Progress: 830/2372 symbols completed. FICO took 25.1s. Estimated remaining: 3h 24m 13s. Rate: 7.6 symbols/min [2025-09-19T18:49:59.577600] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:49:59.627058] [DEBUG] [LOCAL ] FIGS: Loaded 49441 existing records from primary storage. [2025-09-19T18:49:59.627255] [INFO ] [MAIN ] FIGS: Loaded 49441 existing records. [2025-09-19T18:49:59.845173] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-19T18:49:59.845422] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:49:59.846963] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-19T18:49:59.847034] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-19T18:49:59.848250] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-19T18:49:59.848311] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-19T18:50:00.216187] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-19T18:50:00.239375] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:00.643283] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-19T18:50:00.781866] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T18:50:01.018236] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-19T18:50:01.443324] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-19T18:50:02.115715] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T18:50:02.243308] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-19T18:50:03.043349] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-19T18:50:03.355988] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-19T18:50:03.771030] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T18:50:03.843322] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-19T18:50:04.643303] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-19T18:50:05.027913] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T18:50:05.443311] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-19T18:50:05.759576] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T18:50:06.243300] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-19T18:50:07.043374] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-19T18:50:07.467320] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:07.467808] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-19T18:50:07.496246] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T18:50:07.504633] [INFO ] [REMOTE ] FHN: Full fetch complete (77270 records). [2025-09-19T18:50:07.504820] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-19T18:50:07.843829] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-19T18:50:07.954106] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-19T18:50:07.954277] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-19T18:50:07.955688] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-19T18:50:07.955861] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-19T18:50:07.986489] [DEBUG] [LOCAL ] FHN: Trimmed 77270 records to 54148 (keeping 200 days of data) [2025-09-19T18:50:07.989188] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T18:50:08.357129] [DEBUG] [LOCAL ] FHN: Primary data saved (54148 records). [2025-09-19T18:50:08.357325] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-19T18:50:08.358101] [INFO ] [MAIN ] Update Progress: 831/2372 symbols completed. FHN took 38.3s. Estimated remaining: 3h 24m 7s. Rate: 7.5 symbols/min [2025-09-19T18:50:08.532053] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:08.576422] [DEBUG] [LOCAL ] FIHL: Loaded 40851 existing records from primary storage. [2025-09-19T18:50:08.576570] [INFO ] [MAIN ] FIHL: Loaded 40851 existing records. [2025-09-19T18:50:08.650560] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-19T18:50:08.760251] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:08.760513] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-19T18:50:08.760564] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-19T18:50:08.761457] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-19T18:50:08.761518] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-19T18:50:09.112685] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:09.443294] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-19T18:50:09.999894] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T18:50:10.243311] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-19T18:50:10.376796] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:50:10.560032] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-19T18:50:11.043279] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-19T18:50:11.843265] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-19T18:50:12.466539] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T18:50:12.643319] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-19T18:50:12.931315] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (3.49 seconds). [2025-09-19T18:50:13.443262] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-19T18:50:14.243290] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-19T18:50:14.376356] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-19T18:50:15.043295] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-19T18:50:15.250703] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T18:50:15.843284] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-19T18:50:16.610416] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:50:16.643223] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-19T18:50:17.008397] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:50:17.365881] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T18:50:17.443266] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-19T18:50:18.111723] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (5.47 seconds). [2025-09-19T18:50:18.243281] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-19T18:50:19.043291] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-19T18:50:19.567979] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T18:50:19.808982] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T18:50:19.817088] [INFO ] [REMOTE ] FI: Full fetch complete (77156 records). [2025-09-19T18:50:19.817239] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-19T18:50:19.850013] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-19T18:50:20.232913] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-19T18:50:20.233024] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-19T18:50:20.234028] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-19T18:50:20.234114] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-19T18:50:20.235932] [DEBUG] [LOCAL ] FI: Trimmed 77156 records to 54278 (keeping 200 days of data) [2025-09-19T18:50:20.356215] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T18:50:20.601724] [DEBUG] [LOCAL ] FI: Primary data saved (54278 records). [2025-09-19T18:50:20.601899] [INFO ] [MAIN ] FI: Full history saved. [2025-09-19T18:50:20.601993] [INFO ] [MAIN ] Update Progress: 832/2372 symbols completed. FI took 49.0s. Estimated remaining: 3h 24m 7s. Rate: 7.5 symbols/min [2025-09-19T18:50:20.665991] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-19T18:50:20.778363] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:20.788783] [DEBUG] [LOCAL ] FINS: Loaded 8252 existing records from primary storage. [2025-09-19T18:50:20.788902] [INFO ] [MAIN ] FINS: Loaded 8252 existing records. [2025-09-19T18:50:20.984319] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:20.984832] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-19T18:50:20.984905] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-19T18:50:20.985467] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-19T18:50:20.985531] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-19T18:50:21.347173] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:21.378572] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T18:50:21.443235] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-19T18:50:22.059516] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:50:22.144206] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (5.50 seconds). [2025-09-19T18:50:22.152104] [INFO ] [REMOTE ] FIG: Full fetch complete (14248 records). [2025-09-19T18:50:22.152245] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-19T18:50:22.249227] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-19T18:50:22.340388] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-19T18:50:22.340729] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:50:22.340815] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:50:22.340914] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-19T18:50:22.340996] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-19T18:50:22.341036] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-19T18:50:22.341094] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-19T18:50:22.341179] [INFO ] [MAIN ] Update Progress: 833/2372 symbols completed. FIG took 27.4s. Estimated remaining: 3h 23m 47s. Rate: 7.6 symbols/min [2025-09-19T18:50:22.517237] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:22.562026] [DEBUG] [LOCAL ] FINV: Loaded 45289 existing records from primary storage. [2025-09-19T18:50:22.562174] [INFO ] [MAIN ] FINV: Loaded 45289 existing records. [2025-09-19T18:50:22.742323] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:22.742577] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-19T18:50:22.742688] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-19T18:50:22.743765] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-19T18:50:22.743833] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-19T18:50:23.048366] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-19T18:50:23.107376] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:23.484932] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T18:50:23.843262] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-19T18:50:24.643273] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-19T18:50:25.509100] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T18:50:25.517444] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-19T18:50:26.367183] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T18:50:26.375068] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-19T18:50:26.721783] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:50:27.043263] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-19T18:50:27.593963] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T18:50:27.843294] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-19T18:50:28.190036] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T18:50:28.643308] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-19T18:50:29.821378] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T18:50:29.830225] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-19T18:50:29.866802] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (8.42 seconds). [2025-09-19T18:50:29.910773] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T18:50:29.916966] [INFO ] [REMOTE ] FIHL: Full fetch complete (55757 records). [2025-09-19T18:50:29.917077] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-19T18:50:30.263434] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-19T18:50:30.325900] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-19T18:50:30.325994] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-19T18:50:30.326979] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-19T18:50:30.327073] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-19T18:50:30.328427] [DEBUG] [LOCAL ] FIHL: Trimmed 55757 records to 41125 (keeping 200 days of data) [2025-09-19T18:50:30.585327] [DEBUG] [LOCAL ] FIHL: Primary data saved (41125 records). [2025-09-19T18:50:30.585477] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-19T18:50:30.586726] [INFO ] [MAIN ] Update Progress: 834/2372 symbols completed. FIHL took 22.2s. Estimated remaining: 3h 23m 40s. Rate: 7.6 symbols/min [2025-09-19T18:50:30.771432] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:30.829129] [DEBUG] [LOCAL ] FIS: Loaded 53758 existing records from primary storage. [2025-09-19T18:50:30.829301] [INFO ] [MAIN ] FIS: Loaded 53758 existing records. [2025-09-19T18:50:31.021233] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:31.021538] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-19T18:50:31.028052] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-19T18:50:31.034734] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T18:50:31.037216] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-19T18:50:31.038265] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-19T18:50:31.069457] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-19T18:50:31.396148] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:31.607420] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T18:50:31.843289] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-19T18:50:32.097111] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (9.05 seconds). [2025-09-19T18:50:32.643264] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-19T18:50:33.235559] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:50:33.443239] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-19T18:50:34.243263] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-19T18:50:34.407541] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (3.34 seconds). [2025-09-19T18:50:34.628772] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T18:50:34.636304] [INFO ] [REMOTE ] FIGS: Full fetch complete (71107 records). [2025-09-19T18:50:34.636466] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-19T18:50:35.055040] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-19T18:50:35.080133] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T18:50:35.078845] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-19T18:50:35.087909] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-19T18:50:35.089212] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-19T18:50:35.089557] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-19T18:50:35.091392] [DEBUG] [LOCAL ] FIGS: Trimmed 71107 records to 49796 (keeping 200 days of data) [2025-09-19T18:50:35.376110] [DEBUG] [LOCAL ] FIGS: Primary data saved (49796 records). [2025-09-19T18:50:35.376316] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-19T18:50:35.376497] [INFO ] [MAIN ] Update Progress: 835/2372 symbols completed. FIGS took 36.0s. Estimated remaining: 3h 23m 26s. Rate: 7.6 symbols/min [2025-09-19T18:50:35.552340] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:35.586846] [DEBUG] [LOCAL ] FIX: Loaded 31219 existing records from primary storage. [2025-09-19T18:50:35.586998] [INFO ] [MAIN ] FIX: Loaded 31219 existing records. [2025-09-19T18:50:35.772440] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:50:35.772775] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-19T18:50:35.772859] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-19T18:50:35.773826] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-19T18:50:35.773889] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-19T18:50:35.852094] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-19T18:50:36.037887] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T18:50:36.157473] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:36.188497] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T18:50:36.643266] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-19T18:50:37.256276] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T18:50:37.443304] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-19T18:50:38.103620] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:50:38.243329] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-19T18:50:39.043536] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-19T18:50:39.146441] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T18:50:39.471269] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:50:39.843283] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-19T18:50:40.643268] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-19T18:50:41.038785] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T18:50:41.208075] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T18:50:41.443292] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-19T18:50:41.580218] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T18:50:42.243274] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-19T18:50:43.043248] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-19T18:50:43.170491] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T18:50:43.843262] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-19T18:50:43.983082] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T18:50:44.446523] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-19T18:50:44.643326] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-19T18:50:45.443279] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-19T18:50:45.529826] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T18:50:45.871712] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T18:50:45.879493] [INFO ] [REMOTE ] FINV: Full fetch complete (63561 records). [2025-09-19T18:50:45.879635] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-19T18:50:46.251245] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-19T18:50:46.311873] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-19T18:50:46.311974] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-19T18:50:46.312931] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-19T18:50:46.313033] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-19T18:50:46.314468] [DEBUG] [LOCAL ] FINV: Trimmed 63561 records to 45658 (keeping 200 days of data) [2025-09-19T18:50:46.592932] [DEBUG] [LOCAL ] FINV: Primary data saved (45658 records). [2025-09-19T18:50:46.593069] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-19T18:50:46.593198] [INFO ] [MAIN ] Update Progress: 836/2372 symbols completed. FINV took 24.3s. Estimated remaining: 3h 23m 24s. Rate: 7.6 symbols/min [2025-09-19T18:50:46.791200] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:50:46.791494] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-19T18:50:46.791567] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-19T18:50:46.791811] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-19T18:50:46.791905] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-19T18:50:46.791989] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-19T18:50:46.792065] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-19T18:50:47.068529] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-19T18:50:47.198995] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:50:47.258045] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:50:47.585592] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T18:50:47.630289] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T18:50:47.843305] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-19T18:50:48.643299] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-19T18:50:49.285946] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T18:50:49.443293] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-19T18:50:50.245970] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-19T18:50:50.250860] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T18:50:51.043292] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-19T18:50:51.242199] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T18:50:51.320033] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:50:51.321710] [INFO ] [REMOTE ] FINS: Full fetch complete (12849 records). [2025-09-19T18:50:51.321814] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-19T18:50:51.700390] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-19T18:50:51.700468] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-19T18:50:51.700786] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-19T18:50:51.700846] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-19T18:50:51.701519] [DEBUG] [LOCAL ] FINS: Trimmed 12849 records to 8288 (keeping 200 days of data) [2025-09-19T18:50:51.758355] [DEBUG] [LOCAL ] FINS: Primary data saved (8288 records). [2025-09-19T18:50:51.758488] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-19T18:50:51.758592] [INFO ] [MAIN ] Update Progress: 837/2372 symbols completed. FINS took 31.2s. Estimated remaining: 3h 23m 11s. Rate: 7.6 symbols/min [2025-09-19T18:50:51.843280] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-19T18:50:52.068758] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:52.069110] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-19T18:50:52.643268] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-19T18:50:53.108202] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T18:50:53.443264] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-19T18:50:53.870990] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:53.871381] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-19T18:50:54.079957] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T18:50:54.243279] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-19T18:50:55.043270] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-19T18:50:55.784602] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:50:55.843296] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-19T18:50:56.643290] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-19T18:50:56.936803] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T18:50:57.443258] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-19T18:50:57.453181] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:57.454091] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-19T18:50:57.480076] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T18:50:58.243268] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-19T18:50:58.480878] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:50:58.481220] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-19T18:50:59.043285] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-19T18:50:59.592315] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T18:50:59.843269] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-19T18:51:00.076143] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:51:00.076524] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-19T18:51:00.335728] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T18:51:00.643272] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-19T18:51:01.443299] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-19T18:51:02.243280] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-19T18:51:02.588844] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T18:51:02.595465] [INFO ] [REMOTE ] FIX: Full fetch complete (45665 records). [2025-09-19T18:51:02.595608] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-19T18:51:02.874419] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:51:02.907117] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-19T18:51:02.995983] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-19T18:51:02.996073] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-19T18:51:02.996791] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-19T18:51:02.996854] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-19T18:51:03.000034] [DEBUG] [LOCAL ] FIX: Trimmed 45665 records to 31371 (keeping 200 days of data) [2025-09-19T18:51:03.070615] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-19T18:51:03.214008] [DEBUG] [LOCAL ] FIX: Primary data saved (31371 records). [2025-09-19T18:51:03.214141] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-19T18:51:03.214260] [INFO ] [MAIN ] Update Progress: 838/2372 symbols completed. FIX took 27.8s. Estimated remaining: 3h 23m 10s. Rate: 7.6 symbols/min [2025-09-19T18:51:04.455965] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T18:51:04.457424] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-19T18:51:05.071951] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T18:51:05.073599] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-19T18:51:05.122488] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (3.68 seconds). [2025-09-19T18:51:05.443237] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-19T18:51:05.478355] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-19T18:51:06.243267] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-19T18:51:07.123124] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T18:51:07.124165] [INFO ] [REMOTE ] FIXT: Full fetch complete (1690 records). [2025-09-19T18:51:07.124238] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-19T18:51:07.311943] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-19T18:51:07.312169] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:51:07.312267] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:51:07.312343] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-19T18:51:07.312411] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-19T18:51:07.312460] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-19T18:51:07.312529] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-19T18:51:07.312605] [INFO ] [MAIN ] Update Progress: 839/2372 symbols completed. FIXT took 20.7s. Estimated remaining: 3h 22m 55s. Rate: 7.6 symbols/min [2025-09-19T18:51:07.474063] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T18:51:07.486201] [INFO ] [REMOTE ] FIS: Full fetch complete (77169 records). [2025-09-19T18:51:07.486355] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-19T18:51:07.890095] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-19T18:51:07.890192] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-19T18:51:07.891136] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-19T18:51:07.891203] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-19T18:51:07.892811] [DEBUG] [LOCAL ] FIS: Trimmed 77169 records to 54148 (keeping 200 days of data) [2025-09-19T18:51:08.248069] [DEBUG] [LOCAL ] FIS: Primary data saved (54148 records). [2025-09-19T18:51:08.248349] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-19T18:51:08.249588] [INFO ] [MAIN ] Update Progress: 840/2372 symbols completed. FIS took 37.7s. Estimated remaining: 3h 22m 34s. Rate: 7.6 symbols/min [2025-09-19T18:51:08.913832] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:08.934732] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:08.986892] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:09.028394] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:09.039269] [DEBUG] [LOCAL ] FLC: Loaded 5787 existing records from primary storage. [2025-09-19T18:51:09.045978] [INFO ] [MAIN ] FLC: Loaded 5787 existing records. [2025-09-19T18:51:09.285336] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:09.315800] [DEBUG] [LOCAL ] FLO: Loaded 52245 existing records from primary storage. [2025-09-19T18:51:09.316850] [INFO ] [MAIN ] FLO: Loaded 52245 existing records. [2025-09-19T18:51:09.316993] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-19T18:51:09.316436] [DEBUG] [LOCAL ] FLNG: Loaded 34505 existing records from primary storage. [2025-09-19T18:51:09.322380] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-19T18:51:09.322574] [INFO ] [MAIN ] FLNG: Loaded 34505 existing records. [2025-09-19T18:51:09.340960] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-19T18:51:09.437853] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-19T18:51:09.609413] [DEBUG] [LOCAL ] FLG: Loaded 53725 existing records from primary storage. [2025-09-19T18:51:09.664479] [INFO ] [MAIN ] FLG: Loaded 53725 existing records. [2025-09-19T18:51:09.997253] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:10.045105] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-19T18:51:10.029491] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:10.080672] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-19T18:51:10.080572] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-19T18:51:10.110584] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-19T18:51:10.138878] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-19T18:51:10.188340] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-19T18:51:10.214332] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-19T18:51:10.325187] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-19T18:51:10.449692] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:10.547805] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-19T18:51:10.640982] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-19T18:51:10.678246] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:10.717028] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-19T18:51:10.745422] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-19T18:51:10.833745] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-19T18:51:11.210484] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:11.241120] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-19T18:51:11.477915] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:11.494911] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-19T18:51:11.603832] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:11.604155] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-19T18:51:11.624934] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T18:51:11.626949] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-19T18:51:12.428413] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T18:51:12.430289] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-19T18:51:13.999429] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-19T18:51:14.007197] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-19T18:51:14.456190] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T18:51:14.457872] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-19T18:51:14.683120] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-19T18:51:14.693634] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-19T18:51:14.894462] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-19T18:51:14.897027] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (3.29 seconds). [2025-09-19T18:51:14.921508] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-19T18:51:15.043270] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-19T18:51:15.195338] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T18:51:15.837819] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T18:51:15.843218] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-19T18:51:16.179075] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T18:51:16.240723] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T18:51:16.643292] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-19T18:51:16.856530] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T18:51:17.443296] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-19T18:51:17.812879] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-19T18:51:18.243238] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-19T18:51:18.306576] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T18:51:18.696265] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-19T18:51:19.043275] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-19T18:51:19.843265] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-19T18:51:19.893023] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T18:51:20.643268] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-19T18:51:21.443267] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-19T18:51:21.573202] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:51:22.048283] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T18:51:22.243267] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-19T18:51:22.326891] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T18:51:22.328235] [INFO ] [REMOTE ] FLC: Full fetch complete (8124 records). [2025-09-19T18:51:22.328305] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-19T18:51:22.693970] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-19T18:51:22.694136] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-19T18:51:22.694356] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-19T18:51:22.694397] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-19T18:51:22.694874] [DEBUG] [LOCAL ] FLC: Trimmed 8124 records to 5799 (keeping 200 days of data) [2025-09-19T18:51:22.729280] [DEBUG] [LOCAL ] FLC: Primary data saved (5799 records). [2025-09-19T18:51:22.729369] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-19T18:51:22.729447] [INFO ] [MAIN ] Update Progress: 841/2372 symbols completed. FLC took 14.5s. Estimated remaining: 3h 22m 38s. Rate: 7.6 symbols/min [2025-09-19T18:51:22.898938] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:22.899130] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-19T18:51:22.899166] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-19T18:51:22.899342] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-19T18:51:22.899385] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-19T18:51:22.899425] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-19T18:51:22.899456] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-19T18:51:23.053297] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-19T18:51:23.262804] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:23.719290] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T18:51:23.843256] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-19T18:51:24.351624] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T18:51:24.643263] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-19T18:51:25.443263] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-19T18:51:25.751776] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T18:51:25.880839] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T18:51:26.243263] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-19T18:51:27.043242] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-19T18:51:27.234907] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:51:27.629675] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T18:51:27.843271] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-19T18:51:28.643315] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-19T18:51:29.083792] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T18:51:29.094631] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-19T18:51:29.114909] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T18:51:29.242317] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T18:51:29.443260] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-19T18:51:30.243268] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-19T18:51:31.043269] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-19T18:51:31.414099] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T18:51:31.481636] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T18:51:31.843298] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-19T18:51:32.474465] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:51:32.643309] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-19T18:51:33.443283] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-19T18:51:33.731288] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:51:34.243239] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-19T18:51:34.339315] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T18:51:34.911809] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T18:51:35.043308] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-19T18:51:35.693384] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T18:51:35.843265] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-19T18:51:36.643284] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-19T18:51:36.936272] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:51:36.974801] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T18:51:37.443259] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-19T18:51:37.759270] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T18:51:38.243268] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-19T18:51:39.043276] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-19T18:51:39.423734] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T18:51:39.723381] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T18:51:39.729333] [INFO ] [REMOTE ] FLNG: Full fetch complete (50985 records). [2025-09-19T18:51:39.729433] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-19T18:51:39.848411] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-19T18:51:40.127185] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-19T18:51:40.127273] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-19T18:51:40.128021] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-19T18:51:40.128093] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-19T18:51:40.129295] [DEBUG] [LOCAL ] FLNG: Trimmed 50985 records to 34778 (keeping 200 days of data) [2025-09-19T18:51:40.347134] [DEBUG] [LOCAL ] FLNG: Primary data saved (34778 records). [2025-09-19T18:51:40.347279] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-19T18:51:40.347383] [INFO ] [MAIN ] Update Progress: 842/2372 symbols completed. FLNG took 32.1s. Estimated remaining: 3h 22m 47s. Rate: 7.5 symbols/min [2025-09-19T18:51:40.518299] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:40.570250] [DEBUG] [LOCAL ] FLR: Loaded 53510 existing records from primary storage. [2025-09-19T18:51:40.570402] [INFO ] [MAIN ] FLR: Loaded 53510 existing records. [2025-09-19T18:51:40.648499] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-19T18:51:40.750693] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:40.751195] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-19T18:51:40.751251] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-19T18:51:40.753026] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-19T18:51:40.753087] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-19T18:51:41.142371] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:41.137189] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T18:51:41.443237] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-19T18:51:41.980001] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T18:51:41.991461] [INFO ] [REMOTE ] FLG: Full fetch complete (77290 records). [2025-09-19T18:51:41.991693] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-19T18:51:42.253720] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-19T18:51:42.416865] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-19T18:51:42.417098] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-19T18:51:42.418320] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-19T18:51:42.418405] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-19T18:51:42.420405] [DEBUG] [LOCAL ] FLG: Trimmed 77290 records to 54112 (keeping 200 days of data) [2025-09-19T18:51:42.577974] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T18:51:42.808943] [DEBUG] [LOCAL ] FLG: Primary data saved (54112 records). [2025-09-19T18:51:42.809099] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-19T18:51:42.809188] [INFO ] [MAIN ] Update Progress: 843/2372 symbols completed. FLG took 34.6s. Estimated remaining: 3h 22m 30s. Rate: 7.6 symbols/min [2025-09-19T18:51:42.976157] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:43.024173] [DEBUG] [LOCAL ] FLS: Loaded 50538 existing records from primary storage. [2025-09-19T18:51:43.024324] [INFO ] [MAIN ] FLS: Loaded 50538 existing records. [2025-09-19T18:51:43.059231] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-19T18:51:43.232808] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:43.233161] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-19T18:51:43.233319] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-19T18:51:43.234692] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-19T18:51:43.234758] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-19T18:51:43.645763] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:43.660096] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T18:51:43.848856] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-19T18:51:43.853284] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T18:51:44.577147] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T18:51:44.643224] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-19T18:51:45.443297] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-19T18:51:45.500540] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T18:51:45.682905] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T18:51:46.243325] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-19T18:51:47.043264] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-19T18:51:47.575232] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T18:51:47.583829] [INFO ] [REMOTE ] FLO: Full fetch complete (74814 records). [2025-09-19T18:51:47.583995] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-19T18:51:47.852604] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-19T18:51:47.999185] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-19T18:51:47.999285] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-19T18:51:48.000310] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-19T18:51:48.000378] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-19T18:51:48.002978] [DEBUG] [LOCAL ] FLO: Trimmed 74814 records to 52630 (keeping 200 days of data) [2025-09-19T18:51:48.266348] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T18:51:48.387304] [DEBUG] [LOCAL ] FLO: Primary data saved (52630 records). [2025-09-19T18:51:48.387469] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-19T18:51:48.387565] [INFO ] [MAIN ] Update Progress: 844/2372 symbols completed. FLO took 40.1s. Estimated remaining: 3h 22m 17s. Rate: 7.6 symbols/min [2025-09-19T18:51:48.564950] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:48.605631] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T18:51:48.648349] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-19T18:51:48.651076] [DEBUG] [LOCAL ] FLUT: Loaded 51391 existing records from primary storage. [2025-09-19T18:51:48.651166] [INFO ] [MAIN ] FLUT: Loaded 51391 existing records. [2025-09-19T18:51:48.843178] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:48.843474] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-19T18:51:48.843533] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-19T18:51:48.844728] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-19T18:51:48.844792] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-19T18:51:49.233557] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:49.250602] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T18:51:49.443281] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-19T18:51:50.243781] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T18:51:50.244006] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-19T18:51:50.966879] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T18:51:51.043244] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-19T18:51:51.843320] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-19T18:51:52.370068] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T18:51:52.450399] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:51:52.455449] [INFO ] [REMOTE ] FLOC: Full fetch complete (36688 records). [2025-09-19T18:51:52.455597] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-19T18:51:52.646282] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-19T18:51:52.646135] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 170 unique days, need 200 days [2025-09-19T18:51:52.648203] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:51:52.648286] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:51:52.648367] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-19T18:51:52.648447] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-19T18:51:52.648592] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-19T18:51:52.648694] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-19T18:51:52.648793] [INFO ] [MAIN ] Update Progress: 845/2372 symbols completed. FLOC took 29.9s. Estimated remaining: 3h 22m 3s. Rate: 7.6 symbols/min [2025-09-19T18:51:52.828849] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:51:52.853245] [DEBUG] [LOCAL ] FLXR: Loaded 19746 existing records from primary storage. [2025-09-19T18:51:52.853478] [INFO ] [MAIN ] FLXR: Loaded 19746 existing records. [2025-09-19T18:51:53.028796] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:51:53.029039] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-19T18:51:53.029087] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-19T18:51:53.029819] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-19T18:51:53.029878] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-19T18:51:53.379612] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:51:53.417245] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T18:51:53.443212] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-19T18:51:54.243244] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-19T18:51:54.353509] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T18:51:54.688484] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T18:51:55.043278] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-19T18:51:55.523937] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T18:51:55.656501] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T18:51:55.843283] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-19T18:51:56.643308] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-19T18:51:57.362449] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T18:51:57.443361] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-19T18:51:58.033823] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T18:51:58.243282] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-19T18:51:58.968047] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T18:51:59.043326] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-19T18:51:59.420385] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T18:51:59.843270] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-19T18:52:00.373743] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:52:00.643314] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-19T18:52:01.386080] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T18:52:01.443244] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-19T18:52:02.243271] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-19T18:52:02.273302] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T18:52:03.018006] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-19T18:52:03.043239] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-19T18:52:03.843299] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-19T18:52:04.055049] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T18:52:04.521094] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T18:52:04.643234] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-19T18:52:04.695530] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T18:52:05.443290] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-19T18:52:06.243308] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-19T18:52:06.645313] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T18:52:06.670935] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T18:52:07.043269] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-19T18:52:07.843318] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-19T18:52:08.257252] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T18:52:08.344132] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T18:52:08.643277] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-19T18:52:09.329777] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T18:52:09.443242] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-19T18:52:09.640793] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T18:52:09.645506] [INFO ] [REMOTE ] FLXR: Full fetch complete (24484 records). [2025-09-19T18:52:09.645589] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-19T18:52:10.025951] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-19T18:52:10.026031] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-19T18:52:10.026526] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-19T18:52:10.026564] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-19T18:52:10.027253] [DEBUG] [LOCAL ] FLXR: Trimmed 24484 records to 19941 (keeping 200 days of data) [2025-09-19T18:52:10.156507] [DEBUG] [LOCAL ] FLXR: Primary data saved (19941 records). [2025-09-19T18:52:10.156690] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-19T18:52:10.156793] [INFO ] [MAIN ] Update Progress: 846/2372 symbols completed. FLXR took 17.5s. Estimated remaining: 3h 22m 12s. Rate: 7.5 symbols/min [2025-09-19T18:52:10.248341] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-19T18:52:10.335775] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:10.399287] [DEBUG] [LOCAL ] FMC: Loaded 52192 existing records from primary storage. [2025-09-19T18:52:10.399471] [INFO ] [MAIN ] FMC: Loaded 52192 existing records. [2025-09-19T18:52:10.581477] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:10.581794] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-19T18:52:10.581893] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-19T18:52:10.583394] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-19T18:52:10.583457] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-19T18:52:10.963420] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:11.043274] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-19T18:52:11.352914] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T18:52:11.843278] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-19T18:52:11.968944] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T18:52:12.643237] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-19T18:52:12.718162] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T18:52:13.076874] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T18:52:13.443268] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-19T18:52:13.992093] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T18:52:14.243266] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-19T18:52:14.931239] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T18:52:14.938802] [INFO ] [REMOTE ] FLS: Full fetch complete (71228 records). [2025-09-19T18:52:14.938917] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-19T18:52:15.048428] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-19T18:52:15.357014] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-19T18:52:15.357095] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-19T18:52:15.357979] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-19T18:52:15.358042] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-19T18:52:15.359532] [DEBUG] [LOCAL ] FLS: Trimmed 71228 records to 50924 (keeping 200 days of data) [2025-09-19T18:52:15.682049] [DEBUG] [LOCAL ] FLS: Primary data saved (50924 records). [2025-09-19T18:52:15.682239] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-19T18:52:15.682371] [INFO ] [MAIN ] Update Progress: 847/2372 symbols completed. FLS took 32.9s. Estimated remaining: 3h 21m 60s. Rate: 7.5 symbols/min [2025-09-19T18:52:15.859176] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-19T18:52:15.862406] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:15.870718] [DEBUG] [LOCAL ] FMN: Loaded 6239 existing records from primary storage. [2025-09-19T18:52:15.870828] [INFO ] [MAIN ] FMN: Loaded 6239 existing records. [2025-09-19T18:52:16.054009] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:16.054271] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-19T18:52:16.054319] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-19T18:52:16.054606] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-19T18:52:16.054701] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-19T18:52:16.432539] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:16.538122] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T18:52:16.617413] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T18:52:16.643226] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-19T18:52:17.270742] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T18:52:17.443242] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-19T18:52:17.539119] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T18:52:18.243279] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-19T18:52:19.043249] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-19T18:52:19.672958] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T18:52:19.705708] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T18:52:19.713701] [INFO ] [REMOTE ] FLR: Full fetch complete (76252 records). [2025-09-19T18:52:19.713849] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-19T18:52:19.854467] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-19T18:52:20.110871] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-19T18:52:20.111057] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-19T18:52:20.112150] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-19T18:52:20.112303] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-19T18:52:20.123477] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T18:52:20.127776] [DEBUG] [LOCAL ] FLR: Trimmed 76252 records to 53899 (keeping 200 days of data) [2025-09-19T18:52:20.444018] [DEBUG] [LOCAL ] FLR: Primary data saved (53899 records). [2025-09-19T18:52:20.444233] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-19T18:52:20.444373] [INFO ] [MAIN ] Update Progress: 848/2372 symbols completed. FLR took 40.1s. Estimated remaining: 3h 21m 46s. Rate: 7.6 symbols/min [2025-09-19T18:52:20.613536] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:20.644728] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-19T18:52:20.645539] [DEBUG] [LOCAL ] FMS: Loaded 30776 existing records from primary storage. [2025-09-19T18:52:20.646720] [INFO ] [MAIN ] FMS: Loaded 30776 existing records. [2025-09-19T18:52:20.832602] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:20.832907] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-19T18:52:20.832965] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-19T18:52:20.833850] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-19T18:52:20.833911] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-19T18:52:21.206449] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:21.443253] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-19T18:52:21.876719] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T18:52:21.964130] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T18:52:22.243273] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-19T18:52:22.846183] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T18:52:22.927490] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T18:52:23.043258] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-19T18:52:23.843271] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-19T18:52:24.161609] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:52:24.643335] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-19T18:52:25.432775] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T18:52:25.446145] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-19T18:52:25.540863] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T18:52:26.243272] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-19T18:52:26.286308] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T18:52:27.043283] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-19T18:52:27.746808] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T18:52:27.777270] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T18:52:27.843233] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-19T18:52:28.643274] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-19T18:52:29.443282] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-19T18:52:29.864815] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T18:52:29.872413] [INFO ] [REMOTE ] FLUT: Full fetch complete (72749 records). [2025-09-19T18:52:29.872594] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-19T18:52:30.244717] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-19T18:52:30.239440] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T18:52:30.312717] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-19T18:52:30.312821] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-19T18:52:30.313775] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-19T18:52:30.313843] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-19T18:52:30.315466] [DEBUG] [LOCAL ] FLUT: Trimmed 72749 records to 51736 (keeping 200 days of data) [2025-09-19T18:52:30.555570] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T18:52:30.670795] [DEBUG] [LOCAL ] FLUT: Primary data saved (51736 records). [2025-09-19T18:52:30.670968] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-19T18:52:30.671070] [INFO ] [MAIN ] Update Progress: 849/2372 symbols completed. FLUT took 42.3s. Estimated remaining: 3h 21m 42s. Rate: 7.6 symbols/min [2025-09-19T18:52:30.851033] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:30.892007] [DEBUG] [LOCAL ] FMX: Loaded 41086 existing records from primary storage. [2025-09-19T18:52:30.892171] [INFO ] [MAIN ] FMX: Loaded 41086 existing records. [2025-09-19T18:52:31.050072] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-19T18:52:31.095288] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:31.095720] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-19T18:52:31.095782] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-19T18:52:31.096855] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-19T18:52:31.096919] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-19T18:52:31.472612] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:31.843970] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-19T18:52:31.846367] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T18:52:32.482664] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T18:52:32.643294] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-19T18:52:32.973445] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:52:33.443247] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-19T18:52:33.695550] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T18:52:34.243278] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-19T18:52:34.526621] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T18:52:34.989940] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T18:52:35.043248] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-19T18:52:35.843285] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-19T18:52:35.885700] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T18:52:35.887293] [INFO ] [REMOTE ] FMN: Full fetch complete (10278 records). [2025-09-19T18:52:35.887369] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-19T18:52:36.259102] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-19T18:52:36.259183] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-19T18:52:36.259429] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-19T18:52:36.259467] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-19T18:52:36.259986] [DEBUG] [LOCAL ] FMN: Trimmed 10278 records to 6267 (keeping 200 days of data) [2025-09-19T18:52:36.301889] [DEBUG] [LOCAL ] FMN: Primary data saved (6267 records). [2025-09-19T18:52:36.302021] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-19T18:52:36.302112] [INFO ] [MAIN ] Update Progress: 850/2372 symbols completed. FMN took 20.6s. Estimated remaining: 3h 21m 30s. Rate: 7.6 symbols/min [2025-09-19T18:52:36.482668] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:36.486779] [DEBUG] [LOCAL ] FMY: Loaded 1360 existing records from primary storage. [2025-09-19T18:52:36.486877] [INFO ] [MAIN ] FMY: Loaded 1360 existing records. [2025-09-19T18:52:36.644451] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-19T18:52:36.672241] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:36.673339] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-19T18:52:36.673432] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-19T18:52:36.673731] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-19T18:52:36.673793] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-19T18:52:37.036933] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:37.443303] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-19T18:52:37.751250] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-19T18:52:38.116468] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T18:52:38.223300] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T18:52:38.243213] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-19T18:52:39.043256] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-19T18:52:39.808518] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T18:52:39.843261] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-19T18:52:40.643281] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-19T18:52:40.870886] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T18:52:41.183958] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T18:52:41.276627] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T18:52:41.443281] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-19T18:52:41.993606] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T18:52:42.243300] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-19T18:52:43.043307] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-19T18:52:43.856187] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-19T18:52:43.865028] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T18:52:43.979813] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T18:52:44.643262] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-19T18:52:45.443283] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-19T18:52:45.554561] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T18:52:45.714175] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:52:45.719099] [INFO ] [REMOTE ] FMS: Full fetch complete (42502 records). [2025-09-19T18:52:45.719184] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-19T18:52:46.117225] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-19T18:52:46.117315] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-19T18:52:46.118002] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-19T18:52:46.118064] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-19T18:52:46.119093] [DEBUG] [LOCAL ] FMS: Trimmed 42502 records to 30974 (keeping 200 days of data) [2025-09-19T18:52:46.243497] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-19T18:52:46.312158] [DEBUG] [LOCAL ] FMS: Primary data saved (30974 records). [2025-09-19T18:52:46.312320] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-19T18:52:46.312426] [INFO ] [MAIN ] Update Progress: 851/2372 symbols completed. FMS took 25.9s. Estimated remaining: 3h 21m 26s. Rate: 7.6 symbols/min [2025-09-19T18:52:46.480391] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:46.519784] [DEBUG] [LOCAL ] FN: Loaded 40044 existing records from primary storage. [2025-09-19T18:52:46.519952] [INFO ] [MAIN ] FN: Loaded 40044 existing records. [2025-09-19T18:52:46.697799] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:46.698043] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-19T18:52:46.698092] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-19T18:52:46.699460] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-19T18:52:46.699520] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-19T18:52:46.782855] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T18:52:47.059791] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-19T18:52:47.067039] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:47.596779] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-19T18:52:47.600826] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T18:52:47.843303] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-19T18:52:48.233577] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T18:52:48.643302] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-19T18:52:49.050339] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T18:52:49.443276] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-19T18:52:49.965453] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-19T18:52:50.243331] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-19T18:52:51.043286] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-19T18:52:51.843320] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-19T18:52:52.278328] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T18:52:52.402376] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T18:52:52.643303] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-19T18:52:52.975109] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T18:52:53.443269] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-19T18:52:53.964443] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T18:52:54.243307] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-19T18:52:54.299691] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T18:52:54.309376] [INFO ] [REMOTE ] FMC: Full fetch complete (74824 records). [2025-09-19T18:52:54.309583] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-19T18:52:54.726396] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T18:52:54.732836] [INFO ] [REMOTE ] FMY: Full fetch complete (1947 records). [2025-09-19T18:52:54.751983] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-19T18:52:54.752063] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-19T18:52:54.752134] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-19T18:52:54.753240] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-19T18:52:54.753335] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-19T18:52:54.859536] [DEBUG] [LOCAL ] FMC: Trimmed 74824 records to 52569 (keeping 200 days of data) [2025-09-19T18:52:55.048638] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-19T18:52:55.235564] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-19T18:52:55.235722] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-19T18:52:55.236133] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-19T18:52:55.236531] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-19T18:52:55.237828] [DEBUG] [LOCAL ] FMY: Trimmed 1947 records to 1403 (keeping 200 days of data) [2025-09-19T18:52:55.249991] [DEBUG] [LOCAL ] FMY: Primary data saved (1403 records). [2025-09-19T18:52:55.250681] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-19T18:52:55.251076] [INFO ] [MAIN ] Update Progress: 852/2372 symbols completed. FMY took 18.9s. Estimated remaining: 3h 21m 20s. Rate: 7.5 symbols/min [2025-09-19T18:52:55.438483] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:55.592470] [DEBUG] [LOCAL ] FNB: Loaded 52843 existing records from primary storage. [2025-09-19T18:52:55.593216] [INFO ] [MAIN ] FNB: Loaded 52843 existing records. [2025-09-19T18:52:55.792036] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:55.794198] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-19T18:52:55.794307] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-19T18:52:55.827686] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-19T18:52:55.827864] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-19T18:52:55.848349] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-19T18:52:56.200853] [DEBUG] [LOCAL ] FMC: Primary data saved (52569 records). [2025-09-19T18:52:56.211448] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-19T18:52:56.211725] [INFO ] [MAIN ] Update Progress: 853/2372 symbols completed. FMC took 46.1s. Estimated remaining: 3h 20m 59s. Rate: 7.6 symbols/min [2025-09-19T18:52:56.370497] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:56.450434] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:52:56.508153] [DEBUG] [LOCAL ] FND: Loaded 52560 existing records from primary storage. [2025-09-19T18:52:56.508345] [INFO ] [MAIN ] FND: Loaded 52560 existing records. [2025-09-19T18:52:56.648505] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-19T18:52:56.693094] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:52:56.693379] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-19T18:52:56.693429] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-19T18:52:56.694855] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-19T18:52:56.694927] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-19T18:52:57.076712] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:52:57.104127] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T18:52:57.144580] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T18:52:57.443296] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-19T18:52:58.132622] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T18:52:58.243279] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-19T18:52:59.043264] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-19T18:52:59.279677] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T18:52:59.843327] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-19T18:53:00.146089] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T18:53:00.428346] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T18:53:00.643283] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-19T18:53:01.443343] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-19T18:53:02.032070] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T18:53:02.243278] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-19T18:53:02.497323] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:53:03.036327] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T18:53:03.045548] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-19T18:53:03.599630] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T18:53:03.843264] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-19T18:53:04.189544] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T18:53:04.643307] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-19T18:53:05.443265] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-19T18:53:05.725802] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T18:53:05.937808] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T18:53:06.243276] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-19T18:53:07.049384] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-19T18:53:07.052787] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T18:53:07.766543] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T18:53:07.843226] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-19T18:53:08.643284] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-19T18:53:09.009882] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T18:53:09.231618] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T18:53:09.443283] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-19T18:53:09.792847] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T18:53:10.243265] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-19T18:53:11.043265] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-19T18:53:11.422047] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T18:53:11.534605] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T18:53:11.843282] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-19T18:53:12.521904] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T18:53:12.643263] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-19T18:53:13.443280] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-19T18:53:13.653603] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:53:14.243269] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-19T18:53:14.485559] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T18:53:14.732114] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T18:53:15.043273] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-19T18:53:15.637497] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T18:53:15.843258] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-19T18:53:16.643261] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-19T18:53:17.012839] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T18:53:17.221723] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T18:53:17.228495] [INFO ] [REMOTE ] FMX: Full fetch complete (57709 records). [2025-09-19T18:53:17.228664] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-19T18:53:17.449730] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-19T18:53:17.644778] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-19T18:53:17.644856] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-19T18:53:17.645790] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-19T18:53:17.645852] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-19T18:53:17.647985] [DEBUG] [LOCAL ] FMX: Trimmed 57709 records to 41399 (keeping 200 days of data) [2025-09-19T18:53:17.929233] [DEBUG] [LOCAL ] FMX: Primary data saved (41399 records). [2025-09-19T18:53:17.929359] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-19T18:53:17.929492] [INFO ] [MAIN ] Update Progress: 854/2372 symbols completed. FMX took 47.3s. Estimated remaining: 3h 21m 16s. Rate: 7.5 symbols/min [2025-09-19T18:53:18.110718] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:18.173174] [DEBUG] [LOCAL ] FNF: Loaded 49675 existing records from primary storage. [2025-09-19T18:53:18.173354] [INFO ] [MAIN ] FNF: Loaded 49675 existing records. [2025-09-19T18:53:18.248393] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-19T18:53:18.423304] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:18.424017] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-19T18:53:18.424122] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-19T18:53:18.425486] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-19T18:53:18.425553] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-19T18:53:18.851981] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:18.846393] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T18:53:19.043234] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-19T18:53:19.382184] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T18:53:19.843267] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-19T18:53:20.058794] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T18:53:20.643276] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-19T18:53:20.745609] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T18:53:21.421031] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T18:53:21.431338] [INFO ] [REMOTE ] FN: Full fetch complete (56528 records). [2025-09-19T18:53:21.431499] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-19T18:53:21.448460] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-19T18:53:21.839191] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-19T18:53:21.839344] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-19T18:53:21.840167] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-19T18:53:21.840230] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-19T18:53:21.841400] [DEBUG] [LOCAL ] FN: Trimmed 56528 records to 40301 (keeping 200 days of data) [2025-09-19T18:53:22.104751] [DEBUG] [LOCAL ] FN: Primary data saved (40301 records). [2025-09-19T18:53:22.104895] [INFO ] [MAIN ] FN: Full history saved. [2025-09-19T18:53:22.105014] [INFO ] [MAIN ] Update Progress: 855/2372 symbols completed. FN took 35.8s. Estimated remaining: 3h 21m 1s. Rate: 7.5 symbols/min [2025-09-19T18:53:22.258392] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-19T18:53:22.303330] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:22.363569] [DEBUG] [LOCAL ] FNV: Loaded 46795 existing records from primary storage. [2025-09-19T18:53:22.363753] [INFO ] [MAIN ] FNV: Loaded 46795 existing records. [2025-09-19T18:53:22.520873] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T18:53:22.615388] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:22.615700] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-19T18:53:22.615760] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-19T18:53:22.617268] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-19T18:53:22.617330] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-19T18:53:22.990624] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:23.044911] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-19T18:53:23.047503] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T18:53:23.497426] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T18:53:23.843280] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-19T18:53:24.643262] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-19T18:53:24.753370] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T18:53:25.224925] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T18:53:25.233868] [INFO ] [REMOTE ] FNB: Full fetch complete (75572 records). [2025-09-19T18:53:25.234045] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-19T18:53:25.450729] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-19T18:53:25.629190] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-19T18:53:25.629281] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-19T18:53:25.630218] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-19T18:53:25.630284] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-19T18:53:25.633776] [DEBUG] [LOCAL ] FNB: Trimmed 75572 records to 53229 (keeping 200 days of data) [2025-09-19T18:53:25.964296] [DEBUG] [LOCAL ] FNB: Primary data saved (53229 records). [2025-09-19T18:53:25.964437] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-19T18:53:25.964519] [INFO ] [MAIN ] Update Progress: 856/2372 symbols completed. FNB took 30.7s. Estimated remaining: 3h 20m 46s. Rate: 7.6 symbols/min [2025-09-19T18:53:26.137860] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:26.152184] [DEBUG] [LOCAL ] FOA: Loaded 13267 existing records from primary storage. [2025-09-19T18:53:26.152292] [INFO ] [MAIN ] FOA: Loaded 13267 existing records. [2025-09-19T18:53:26.249800] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-19T18:53:26.331162] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:26.331398] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-19T18:53:26.331446] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-19T18:53:26.332101] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-19T18:53:26.332161] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-19T18:53:26.686387] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:27.043278] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-19T18:53:28.583155] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T18:53:28.588184] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-19T18:53:29.261064] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (4.62 seconds). [2025-09-19T18:53:29.269499] [INFO ] [REMOTE ] FND: Full fetch complete (74351 records). [2025-09-19T18:53:29.269700] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-19T18:53:29.684701] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-19T18:53:29.684924] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-19T18:53:29.685984] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-19T18:53:29.686106] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-19T18:53:29.687754] [DEBUG] [LOCAL ] FND: Trimmed 74351 records to 52939 (keeping 200 days of data) [2025-09-19T18:53:30.032587] [DEBUG] [LOCAL ] FND: Primary data saved (52939 records). [2025-09-19T18:53:30.033371] [INFO ] [MAIN ] FND: Full history saved. [2025-09-19T18:53:30.034396] [INFO ] [MAIN ] Update Progress: 857/2372 symbols completed. FND took 33.8s. Estimated remaining: 3h 20m 31s. Rate: 7.6 symbols/min [2025-09-19T18:53:30.034228] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (4.58 seconds). [2025-09-19T18:53:30.107834] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-19T18:53:30.222259] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:30.237682] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T18:53:30.245705] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-19T18:53:30.251059] [DEBUG] [LOCAL ] FOF: Loaded 8432 existing records from primary storage. [2025-09-19T18:53:30.251195] [INFO ] [MAIN ] FOF: Loaded 8432 existing records. [2025-09-19T18:53:30.432040] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:30.432292] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-19T18:53:30.432352] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-19T18:53:30.432822] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-19T18:53:30.432881] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-19T18:53:30.829274] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (4.58 seconds). [2025-09-19T18:53:30.827982] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:30.838864] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-19T18:53:31.043302] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-19T18:53:31.490005] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:53:31.843282] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-19T18:53:32.010461] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T18:53:32.056624] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T18:53:32.643255] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-19T18:53:32.694735] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T18:53:32.771776] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T18:53:33.443285] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-19T18:53:34.251714] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-19T18:53:34.262056] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:53:34.572977] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:53:35.043286] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-19T18:53:35.200933] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:53:35.843347] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-19T18:53:36.643537] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-19T18:53:37.268903] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T18:53:37.443324] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-19T18:53:37.619215] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T18:53:37.689251] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T18:53:38.243255] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-19T18:53:38.569595] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T18:53:38.866200] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T18:53:39.043281] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-19T18:53:39.573444] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T18:53:39.843296] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-19T18:53:40.315689] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-19T18:53:40.643290] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-19T18:53:41.443313] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-19T18:53:42.007767] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T18:53:42.243295] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-19T18:53:43.043316] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-19T18:53:43.475181] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T18:53:43.843314] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-19T18:53:44.186739] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-19T18:53:44.270861] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T18:53:44.522761] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T18:53:44.643305] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-19T18:53:45.443286] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-19T18:53:46.243296] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-19T18:53:46.568305] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T18:53:46.841096] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T18:53:47.043305] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-19T18:53:47.347363] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:53:47.843272] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-19T18:53:48.496542] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T18:53:48.504716] [INFO ] [REMOTE ] FNF: Full fetch complete (69458 records). [2025-09-19T18:53:48.504940] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-19T18:53:48.648392] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-19T18:53:48.837725] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:53:48.936148] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-19T18:53:48.936263] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-19T18:53:48.937177] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-19T18:53:48.937251] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-19T18:53:48.938746] [DEBUG] [LOCAL ] FNF: Trimmed 69458 records to 50015 (keeping 200 days of data) [2025-09-19T18:53:49.238803] [DEBUG] [LOCAL ] FNF: Primary data saved (50015 records). [2025-09-19T18:53:49.238959] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-19T18:53:49.239050] [INFO ] [MAIN ] Update Progress: 858/2372 symbols completed. FNF took 31.3s. Estimated remaining: 3h 20m 43s. Rate: 7.5 symbols/min [2025-09-19T18:53:49.406199] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:49.426289] [DEBUG] [LOCAL ] FOR: Loaded 20451 existing records from primary storage. [2025-09-19T18:53:49.426411] [INFO ] [MAIN ] FOR: Loaded 20451 existing records. [2025-09-19T18:53:49.448353] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-19T18:53:49.606583] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:49.606850] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-19T18:53:49.606914] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-19T18:53:49.607484] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-19T18:53:49.607544] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-19T18:53:49.958156] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:50.243247] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-19T18:53:50.636305] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T18:53:50.654323] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T18:53:50.659406] [INFO ] [REMOTE ] FOA: Full fetch complete (22417 records). [2025-09-19T18:53:50.659685] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-19T18:53:51.051571] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-19T18:53:51.087242] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-19T18:53:51.087388] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-19T18:53:51.087919] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-19T18:53:51.087983] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-19T18:53:51.088677] [DEBUG] [LOCAL ] FOA: Trimmed 22417 records to 13348 (keeping 200 days of data) [2025-09-19T18:53:51.171322] [DEBUG] [LOCAL ] FOA: Primary data saved (13348 records). [2025-09-19T18:53:51.171461] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-19T18:53:51.171583] [INFO ] [MAIN ] Update Progress: 859/2372 symbols completed. FOA took 25.2s. Estimated remaining: 3h 20m 25s. Rate: 7.5 symbols/min [2025-09-19T18:53:51.342993] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:51.376733] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:53:51.399220] [DEBUG] [LOCAL ] FOUR: Loaded 49899 existing records from primary storage. [2025-09-19T18:53:51.399374] [INFO ] [MAIN ] FOUR: Loaded 49899 existing records. [2025-09-19T18:53:51.575189] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:51.575430] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-19T18:53:51.575489] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-19T18:53:51.576825] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-19T18:53:51.576886] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-19T18:53:51.848435] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-19T18:53:51.946225] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:52.432319] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T18:53:52.643265] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-19T18:53:52.805513] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T18:53:53.443264] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-19T18:53:54.243270] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-19T18:53:54.386495] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T18:53:54.530755] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:53:54.532900] [INFO ] [REMOTE ] FOF: Full fetch complete (11833 records). [2025-09-19T18:53:54.532971] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-19T18:53:54.890438] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-19T18:53:54.890522] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-19T18:53:54.890817] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-19T18:53:54.890879] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-19T18:53:54.891365] [DEBUG] [LOCAL ] FOF: Trimmed 11833 records to 8486 (keeping 200 days of data) [2025-09-19T18:53:54.943318] [DEBUG] [LOCAL ] FOF: Primary data saved (8486 records). [2025-09-19T18:53:54.943459] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-19T18:53:54.943563] [INFO ] [MAIN ] Update Progress: 860/2372 symbols completed. FOF took 24.9s. Estimated remaining: 3h 20m 9s. Rate: 7.6 symbols/min [2025-09-19T18:53:55.048380] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-19T18:53:55.124174] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:55.143734] [DEBUG] [LOCAL ] FPF: Loaded 17789 existing records from primary storage. [2025-09-19T18:53:55.143886] [INFO ] [MAIN ] FPF: Loaded 17789 existing records. [2025-09-19T18:53:55.325564] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:55.325829] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-19T18:53:55.325892] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-19T18:53:55.326515] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-19T18:53:55.326582] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-19T18:53:55.691434] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:53:55.701585] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T18:53:55.843269] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-19T18:53:56.395105] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T18:53:56.643242] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-19T18:53:57.117179] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T18:53:57.443282] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-19T18:53:58.243395] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-19T18:53:58.342344] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T18:53:58.515205] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T18:53:58.523044] [INFO ] [REMOTE ] FNV: Full fetch complete (65943 records). [2025-09-19T18:53:58.523290] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-19T18:53:58.946551] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-19T18:53:58.946699] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-19T18:53:58.947713] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-19T18:53:58.947778] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-19T18:53:58.949217] [DEBUG] [LOCAL ] FNV: Trimmed 65943 records to 47177 (keeping 200 days of data) [2025-09-19T18:53:59.044568] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-19T18:53:59.269923] [DEBUG] [LOCAL ] FNV: Primary data saved (47177 records). [2025-09-19T18:53:59.270091] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-19T18:53:59.270195] [INFO ] [MAIN ] Update Progress: 861/2372 symbols completed. FNV took 37.2s. Estimated remaining: 3h 19m 55s. Rate: 7.6 symbols/min [2025-09-19T18:53:59.440285] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:53:59.459911] [DEBUG] [LOCAL ] FPH: Loaded 19970 existing records from primary storage. [2025-09-19T18:53:59.460043] [INFO ] [MAIN ] FPH: Loaded 19970 existing records. [2025-09-19T18:53:59.641249] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:53:59.641568] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-19T18:53:59.641624] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-19T18:53:59.642298] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-19T18:53:59.642357] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-19T18:53:59.852174] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-19T18:54:00.034439] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:00.041755] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:54:00.123017] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T18:54:00.643275] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-19T18:54:00.844562] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T18:54:01.443284] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-19T18:54:02.243310] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-19T18:54:02.588691] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T18:54:02.786730] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T18:54:03.043278] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-19T18:54:03.843293] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-19T18:54:04.643271] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-19T18:54:05.548059] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (3.30 seconds). [2025-09-19T18:54:05.553100] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-19T18:54:05.698772] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-19T18:54:06.031701] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T18:54:06.243235] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-19T18:54:06.653771] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T18:54:06.866538] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T18:54:07.049710] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-19T18:54:07.054678] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T18:54:07.798352] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T18:54:07.843233] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-19T18:54:08.643309] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-19T18:54:09.125497] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T18:54:09.443266] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-19T18:54:10.243296] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-19T18:54:10.755865] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T18:54:10.787596] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T18:54:10.888214] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T18:54:11.043307] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-19T18:54:11.843246] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-19T18:54:12.388361] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T18:54:12.643298] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-19T18:54:13.264511] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T18:54:13.443269] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-19T18:54:13.592536] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T18:54:14.243270] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-19T18:54:15.043271] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-19T18:54:15.843252] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-19T18:54:15.993227] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-19T18:54:16.100846] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T18:54:16.643254] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-19T18:54:16.792272] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T18:54:16.817256] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T18:54:17.443248] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-19T18:54:18.243238] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-19T18:54:18.492544] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T18:54:18.677269] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T18:54:18.680894] [INFO ] [REMOTE ] FOR: Full fetch complete (29756 records). [2025-09-19T18:54:18.680980] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-19T18:54:19.064542] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-19T18:54:19.079137] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-19T18:54:19.079202] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-19T18:54:19.079919] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-19T18:54:19.080072] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-19T18:54:19.081160] [DEBUG] [LOCAL ] FOR: Trimmed 29756 records to 20598 (keeping 200 days of data) [2025-09-19T18:54:19.208036] [DEBUG] [LOCAL ] FOR: Primary data saved (20598 records). [2025-09-19T18:54:19.208187] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-19T18:54:19.208803] [INFO ] [MAIN ] Update Progress: 862/2372 symbols completed. FOR took 30.0s. Estimated remaining: 3h 20m 8s. Rate: 7.5 symbols/min [2025-09-19T18:54:19.384964] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:19.419984] [DEBUG] [LOCAL ] FPI: Loaded 31537 existing records from primary storage. [2025-09-19T18:54:19.420134] [INFO ] [MAIN ] FPI: Loaded 31537 existing records. [2025-09-19T18:54:19.605865] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:19.606153] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-19T18:54:19.606212] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-19T18:54:19.607091] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-19T18:54:19.607156] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-19T18:54:19.847841] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-19T18:54:19.889875] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:54:20.014131] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:20.562106] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:54:20.621067] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T18:54:20.643218] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-19T18:54:21.443324] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-19T18:54:22.248266] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-19T18:54:22.251582] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T18:54:22.343920] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T18:54:23.043296] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-19T18:54:23.130330] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T18:54:23.133224] [INFO ] [REMOTE ] FPF: Full fetch complete (26346 records). [2025-09-19T18:54:23.133303] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-19T18:54:23.512127] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-19T18:54:23.512216] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-19T18:54:23.512837] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-19T18:54:23.512901] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-19T18:54:23.513750] [DEBUG] [LOCAL ] FPF: Trimmed 26346 records to 17887 (keeping 200 days of data) [2025-09-19T18:54:23.627291] [DEBUG] [LOCAL ] FPF: Primary data saved (17887 records). [2025-09-19T18:54:23.627452] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-19T18:54:23.627561] [INFO ] [MAIN ] Update Progress: 863/2372 symbols completed. FPF took 28.7s. Estimated remaining: 3h 19m 54s. Rate: 7.5 symbols/min [2025-09-19T18:54:23.821303] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:23.848828] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-19T18:54:23.869723] [DEBUG] [LOCAL ] FR: Loaded 47153 existing records from primary storage. [2025-09-19T18:54:23.869911] [INFO ] [MAIN ] FR: Loaded 47153 existing records. [2025-09-19T18:54:24.059359] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:24.059614] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-19T18:54:24.059694] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-19T18:54:24.061034] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-19T18:54:24.061097] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-19T18:54:24.462688] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:24.643237] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-19T18:54:24.843128] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T18:54:25.257914] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T18:54:25.443248] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-19T18:54:25.921482] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T18:54:26.243304] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-19T18:54:26.867855] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T18:54:26.875423] [INFO ] [REMOTE ] FOUR: Full fetch complete (71892 records). [2025-09-19T18:54:26.875547] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-19T18:54:27.050957] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-19T18:54:27.284556] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-19T18:54:27.284665] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-19T18:54:27.285611] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-19T18:54:27.285708] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-19T18:54:27.290229] [DEBUG] [LOCAL ] FOUR: Trimmed 71892 records to 50265 (keeping 200 days of data) [2025-09-19T18:54:27.393926] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T18:54:27.606986] [DEBUG] [LOCAL ] FOUR: Primary data saved (50265 records). [2025-09-19T18:54:27.607131] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-19T18:54:27.607242] [INFO ] [MAIN ] Update Progress: 864/2372 symbols completed. FOUR took 36.4s. Estimated remaining: 3h 19m 39s. Rate: 7.6 symbols/min [2025-09-19T18:54:27.801393] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:27.817585] [DEBUG] [LOCAL ] FRA: Loaded 14867 existing records from primary storage. [2025-09-19T18:54:27.817772] [INFO ] [MAIN ] FRA: Loaded 14867 existing records. [2025-09-19T18:54:27.848505] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-19T18:54:28.011578] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:28.015720] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-19T18:54:28.015922] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-19T18:54:28.016416] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-19T18:54:28.016476] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-19T18:54:28.385976] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:28.626146] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T18:54:28.643285] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-19T18:54:29.443305] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-19T18:54:29.964900] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T18:54:30.236110] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T18:54:30.244572] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-19T18:54:30.604631] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T18:54:31.043266] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-19T18:54:31.613594] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T18:54:31.843309] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-19T18:54:31.992175] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T18:54:32.643279] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-19T18:54:33.443276] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-19T18:54:33.655165] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T18:54:33.893779] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T18:54:34.243276] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-19T18:54:34.501751] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T18:54:35.043274] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-19T18:54:35.843272] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-19T18:54:36.150899] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T18:54:36.393892] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T18:54:36.397518] [INFO ] [REMOTE ] FPH: Full fetch complete (31720 records). [2025-09-19T18:54:36.397611] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-19T18:54:36.648972] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-19T18:54:36.779681] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-19T18:54:36.779780] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-19T18:54:36.780392] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-19T18:54:36.780439] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-19T18:54:36.781187] [DEBUG] [LOCAL ] FPH: Trimmed 31720 records to 20104 (keeping 200 days of data) [2025-09-19T18:54:36.891570] [DEBUG] [LOCAL ] FPH: Primary data saved (20104 records). [2025-09-19T18:54:36.891742] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-19T18:54:36.891889] [INFO ] [MAIN ] Update Progress: 865/2372 symbols completed. FPH took 37.6s. Estimated remaining: 3h 19m 33s. Rate: 7.6 symbols/min [2025-09-19T18:54:37.062004] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:37.083590] [DEBUG] [LOCAL ] FRGE: Loaded 19155 existing records from primary storage. [2025-09-19T18:54:37.083807] [INFO ] [MAIN ] FRGE: Loaded 19155 existing records. [2025-09-19T18:54:37.259176] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:37.259474] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-19T18:54:37.259524] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-19T18:54:37.260224] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-19T18:54:37.260286] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-19T18:54:37.471812] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-19T18:54:37.621074] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:37.645729] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T18:54:38.169678] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T18:54:38.243254] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-19T18:54:38.780167] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T18:54:39.043268] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-19T18:54:39.843267] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-19T18:54:39.872240] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T18:54:40.648343] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-19T18:54:40.663838] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T18:54:40.685080] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T18:54:41.443280] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-19T18:54:41.885402] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T18:54:42.157783] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-19T18:54:42.243270] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-19T18:54:43.043299] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-19T18:54:43.843237] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-19T18:54:43.930227] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T18:54:44.174518] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T18:54:44.643293] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-19T18:54:44.924352] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T18:54:45.254000] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T18:54:45.443268] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-19T18:54:46.243297] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-19T18:54:47.043276] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-19T18:54:47.230796] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T18:54:47.652423] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T18:54:47.817436] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T18:54:47.843216] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-19T18:54:48.643310] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-19T18:54:49.388910] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T18:54:49.443221] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-19T18:54:50.243267] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-19T18:54:50.459679] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T18:54:50.545050] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T18:54:51.043285] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-19T18:54:51.124973] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T18:54:51.843268] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-19T18:54:52.643269] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-19T18:54:52.693984] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T18:54:52.696875] [INFO ] [REMOTE ] FRA: Full fetch complete (24345 records). [2025-09-19T18:54:52.697122] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-19T18:54:52.821894] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-19T18:54:53.116482] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-19T18:54:53.116574] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-19T18:54:53.117180] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-19T18:54:53.117255] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-19T18:54:53.117964] [DEBUG] [LOCAL ] FRA: Trimmed 24345 records to 14908 (keeping 200 days of data) [2025-09-19T18:54:53.208998] [DEBUG] [LOCAL ] FRA: Primary data saved (14908 records). [2025-09-19T18:54:53.209143] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-19T18:54:53.209230] [INFO ] [MAIN ] Update Progress: 866/2372 symbols completed. FRA took 25.6s. Estimated remaining: 3h 19m 40s. Rate: 7.5 symbols/min [2025-09-19T18:54:53.379577] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:53.433985] [DEBUG] [LOCAL ] FRO: Loaded 52317 existing records from primary storage. [2025-09-19T18:54:53.434138] [INFO ] [MAIN ] FRO: Loaded 52317 existing records. [2025-09-19T18:54:53.448470] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-19T18:54:53.619159] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:53.619617] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-19T18:54:53.619811] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-19T18:54:53.626283] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-19T18:54:53.626388] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-19T18:54:53.687828] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T18:54:54.005534] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:54.243294] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-19T18:54:55.043267] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-19T18:54:55.209638] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T18:54:55.254446] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T18:54:55.262490] [INFO ] [REMOTE ] FR: Full fetch complete (66589 records). [2025-09-19T18:54:55.262694] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-19T18:54:55.671848] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-19T18:54:55.671946] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-19T18:54:55.672889] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-19T18:54:55.672954] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-19T18:54:55.674622] [DEBUG] [LOCAL ] FR: Trimmed 66589 records to 47434 (keeping 200 days of data) [2025-09-19T18:54:55.858038] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-19T18:54:55.972622] [DEBUG] [LOCAL ] FR: Primary data saved (47434 records). [2025-09-19T18:54:55.972793] [INFO ] [MAIN ] FR: Full history saved. [2025-09-19T18:54:55.972902] [INFO ] [MAIN ] Update Progress: 867/2372 symbols completed. FR took 32.3s. Estimated remaining: 3h 19m 23s. Rate: 7.5 symbols/min [2025-09-19T18:54:56.161761] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T18:54:56.199625] [INFO ] [REMOTE ] FPI: Full fetch complete (44065 records). [2025-09-19T18:54:56.203233] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-19T18:54:56.203041] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:56.602811] [DEBUG] [LOCAL ] FRT: Loaded 42722 existing records from primary storage. [2025-09-19T18:54:56.613247] [INFO ] [MAIN ] FRT: Loaded 42722 existing records. [2025-09-19T18:54:56.656461] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-19T18:54:56.711623] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-19T18:54:56.729246] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-19T18:54:56.751282] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-19T18:54:56.751471] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-19T18:54:56.804699] [DEBUG] [LOCAL ] FPI: Trimmed 44065 records to 31700 (keeping 200 days of data) [2025-09-19T18:54:56.833786] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:56.834038] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-19T18:54:56.834095] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-19T18:54:56.835534] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-19T18:54:56.835671] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-19T18:54:57.355133] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:57.443235] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-19T18:54:57.448926] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T18:54:57.467166] [DEBUG] [LOCAL ] FPI: Primary data saved (31700 records). [2025-09-19T18:54:57.467279] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-19T18:54:57.467358] [INFO ] [MAIN ] Update Progress: 868/2372 symbols completed. FPI took 38.3s. Estimated remaining: 3h 19m 4s. Rate: 7.6 symbols/min [2025-09-19T18:54:57.645362] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:54:57.685567] [DEBUG] [LOCAL ] FSCO: Loaded 37079 existing records from primary storage. [2025-09-19T18:54:57.685730] [INFO ] [MAIN ] FSCO: Loaded 37079 existing records. [2025-09-19T18:54:57.877896] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:54:57.878227] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-19T18:54:57.878312] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-19T18:54:57.879256] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-19T18:54:57.879333] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-19T18:54:58.257346] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-19T18:54:58.263403] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:54:58.302762] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-19T18:54:59.043282] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-19T18:54:59.092507] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T18:54:59.416756] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T18:54:59.843278] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-19T18:55:00.643274] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-19T18:55:01.360268] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T18:55:01.443330] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-19T18:55:01.846575] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T18:55:02.079675] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T18:55:02.243280] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-19T18:55:03.043266] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-19T18:55:03.338363] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T18:55:03.843252] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-19T18:55:04.128613] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:55:04.130934] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T18:55:04.141894] [INFO ] [REMOTE ] FRGE: Full fetch complete (34593 records). [2025-09-19T18:55:04.142357] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-19T18:55:04.554425] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-19T18:55:04.554519] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-19T18:55:04.555447] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-19T18:55:04.555552] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-19T18:55:04.556470] [DEBUG] [LOCAL ] FRGE: Trimmed 34593 records to 19246 (keeping 200 days of data) [2025-09-19T18:55:04.661420] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-19T18:55:04.695791] [DEBUG] [LOCAL ] FRGE: Primary data saved (19246 records). [2025-09-19T18:55:04.695945] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-19T18:55:04.696089] [INFO ] [MAIN ] Update Progress: 869/2372 symbols completed. FRGE took 27.8s. Estimated remaining: 3h 18m 55s. Rate: 7.6 symbols/min [2025-09-19T18:55:04.872379] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:04.938996] [DEBUG] [LOCAL ] FSK: Loaded 49724 existing records from primary storage. [2025-09-19T18:55:04.939168] [INFO ] [MAIN ] FSK: Loaded 49724 existing records. [2025-09-19T18:55:05.135087] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:05.135345] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-19T18:55:05.135395] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-19T18:55:05.136529] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-19T18:55:05.136633] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-19T18:55:05.455040] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-19T18:55:05.498816] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:05.525340] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T18:55:06.243261] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-19T18:55:06.391280] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T18:55:07.043278] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-19T18:55:07.174215] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T18:55:07.726027] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T18:55:07.843266] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-19T18:55:08.643239] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-19T18:55:09.067400] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T18:55:09.264592] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T18:55:09.443236] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-19T18:55:10.213913] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T18:55:10.243214] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-19T18:55:11.043271] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-19T18:55:11.416896] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T18:55:11.843256] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-19T18:55:11.867384] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T18:55:12.643280] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-19T18:55:12.776684] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T18:55:13.285632] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T18:55:13.443232] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-19T18:55:14.176902] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T18:55:14.243257] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-19T18:55:15.043266] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-19T18:55:15.244940] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T18:55:15.843286] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-19T18:55:16.174006] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T18:55:16.413542] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T18:55:16.643272] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-19T18:55:17.016485] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T18:55:17.443246] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-19T18:55:18.250335] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-19T18:55:18.271019] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T18:55:19.043267] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-19T18:55:19.488247] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T18:55:19.586405] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T18:55:19.843263] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-19T18:55:20.163775] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T18:55:20.643264] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-19T18:55:21.253565] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T18:55:21.261263] [INFO ] [REMOTE ] FRT: Full fetch complete (60262 records). [2025-09-19T18:55:21.261432] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-19T18:55:21.450596] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-19T18:55:21.812712] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-19T18:55:21.812856] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-19T18:55:21.814806] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-19T18:55:21.814956] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-19T18:55:21.817036] [DEBUG] [LOCAL ] FRT: Trimmed 60262 records to 42999 (keeping 200 days of data) [2025-09-19T18:55:22.214974] [DEBUG] [LOCAL ] FRT: Primary data saved (42999 records). [2025-09-19T18:55:22.215238] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-19T18:55:22.215471] [INFO ] [MAIN ] Update Progress: 870/2372 symbols completed. FRT took 26.2s. Estimated remaining: 3h 19m 3s. Rate: 7.5 symbols/min [2025-09-19T18:55:22.248724] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-19T18:55:22.478896] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:22.544381] [DEBUG] [LOCAL ] FSLY: Loaded 51658 existing records from primary storage. [2025-09-19T18:55:22.544619] [INFO ] [MAIN ] FSLY: Loaded 51658 existing records. [2025-09-19T18:55:22.755853] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:22.756257] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-19T18:55:22.766159] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-19T18:55:22.783282] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-19T18:55:22.783422] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-19T18:55:22.852911] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T18:55:23.049136] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-19T18:55:23.166219] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:23.548427] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T18:55:23.843299] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-19T18:55:24.008121] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T18:55:24.643288] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-19T18:55:25.223323] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T18:55:25.235347] [INFO ] [REMOTE ] FRO: Full fetch complete (75468 records). [2025-09-19T18:55:25.235554] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-19T18:55:25.446390] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-19T18:55:25.686256] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-19T18:55:25.686475] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-19T18:55:25.687560] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-19T18:55:25.687734] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-19T18:55:25.708726] [DEBUG] [LOCAL ] FRO: Trimmed 75468 records to 52689 (keeping 200 days of data) [2025-09-19T18:55:25.723726] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T18:55:26.088100] [DEBUG] [LOCAL ] FRO: Primary data saved (52689 records). [2025-09-19T18:55:26.088489] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-19T18:55:26.088600] [INFO ] [MAIN ] Update Progress: 871/2372 symbols completed. FRO took 32.9s. Estimated remaining: 3h 18m 48s. Rate: 7.6 symbols/min [2025-09-19T18:55:26.245330] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-19T18:55:26.273777] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:26.338052] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T18:55:26.373361] [DEBUG] [LOCAL ] FSM: Loaded 53671 existing records from primary storage. [2025-09-19T18:55:26.373529] [INFO ] [MAIN ] FSM: Loaded 53671 existing records. [2025-09-19T18:55:26.566993] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:26.567387] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-19T18:55:26.567465] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-19T18:55:26.568945] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-19T18:55:26.569012] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-19T18:55:26.720361] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T18:55:26.976138] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:27.043259] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-19T18:55:27.843305] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-19T18:55:28.350115] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T18:55:28.643284] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-19T18:55:28.697702] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T18:55:29.046904] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T18:55:29.443249] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-19T18:55:30.243283] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-19T18:55:30.669324] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T18:55:31.043270] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-19T18:55:31.161371] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T18:55:31.167877] [INFO ] [REMOTE ] FSCO: Full fetch complete (53865 records). [2025-09-19T18:55:31.167981] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-19T18:55:31.576429] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-19T18:55:31.576605] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-19T18:55:31.577437] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-19T18:55:31.577517] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-19T18:55:31.579171] [DEBUG] [LOCAL ] FSCO: Trimmed 53865 records to 37339 (keeping 200 days of data) [2025-09-19T18:55:31.698859] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T18:55:31.844417] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-19T18:55:31.844292] [DEBUG] [LOCAL ] FSCO: Primary data saved (37339 records). [2025-09-19T18:55:31.845721] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-19T18:55:31.847039] [INFO ] [MAIN ] Update Progress: 872/2372 symbols completed. FSCO took 34.4s. Estimated remaining: 3h 18m 37s. Rate: 7.6 symbols/min [2025-09-19T18:55:32.020611] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:32.059582] [DEBUG] [LOCAL ] FSS: Loaded 35240 existing records from primary storage. [2025-09-19T18:55:32.059758] [INFO ] [MAIN ] FSS: Loaded 35240 existing records. [2025-09-19T18:55:32.237897] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:32.238139] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-19T18:55:32.238187] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-19T18:55:32.239104] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-19T18:55:32.239164] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-19T18:55:32.621268] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:32.643231] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-19T18:55:32.986520] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T18:55:33.027878] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:55:33.443248] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-19T18:55:34.136852] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T18:55:34.243307] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-19T18:55:35.043285] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-19T18:55:35.263465] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T18:55:35.356496] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T18:55:35.843267] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-19T18:55:36.643285] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-19T18:55:36.927950] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T18:55:37.443323] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-19T18:55:37.771506] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T18:55:38.243266] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-19T18:55:38.536942] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T18:55:38.927044] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T18:55:39.043297] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-19T18:55:39.811706] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T18:55:39.843233] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-19T18:55:40.643264] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-19T18:55:41.376215] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-19T18:55:41.443254] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-19T18:55:41.918249] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T18:55:42.243755] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-19T18:55:42.247532] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T18:55:43.043306] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-19T18:55:43.227846] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:55:43.589733] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T18:55:43.843275] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-19T18:55:44.435302] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T18:55:44.443050] [INFO ] [REMOTE ] FSK: Full fetch complete (71375 records). [2025-09-19T18:55:44.443192] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-19T18:55:44.652015] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-19T18:55:44.843136] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-19T18:55:44.843249] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-19T18:55:44.844338] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-19T18:55:44.844415] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-19T18:55:44.846088] [DEBUG] [LOCAL ] FSK: Trimmed 71375 records to 50114 (keeping 200 days of data) [2025-09-19T18:55:45.165336] [DEBUG] [LOCAL ] FSK: Primary data saved (50114 records). [2025-09-19T18:55:45.165519] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-19T18:55:45.165621] [INFO ] [MAIN ] Update Progress: 873/2372 symbols completed. FSK took 40.5s. Estimated remaining: 3h 18m 38s. Rate: 7.5 symbols/min [2025-09-19T18:55:45.346131] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:45.355228] [DEBUG] [LOCAL ] FT: Loaded 6372 existing records from primary storage. [2025-09-19T18:55:45.355358] [INFO ] [MAIN ] FT: Loaded 6372 existing records. [2025-09-19T18:55:45.452613] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-19T18:55:45.534235] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:45.534470] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-19T18:55:45.534531] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-19T18:55:45.534894] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-19T18:55:45.534978] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-19T18:55:45.900895] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:45.935845] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T18:55:46.243272] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-19T18:55:46.699407] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T18:55:46.732449] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T18:55:46.790870] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-19T18:55:47.043269] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-19T18:55:47.843266] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-19T18:55:48.649025] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-19T18:55:48.655627] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T18:55:48.929962] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T18:55:49.443254] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-19T18:55:50.155756] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T18:55:50.243243] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-19T18:55:50.570147] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T18:55:50.802221] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T18:55:51.043261] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-19T18:55:51.843270] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-19T18:55:52.643294] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-19T18:55:53.021774] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T18:55:53.443256] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-19T18:55:53.499995] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-19T18:55:53.706507] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T18:55:54.243266] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-19T18:55:54.851189] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T18:55:55.043269] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-19T18:55:55.843279] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-19T18:55:56.167129] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T18:55:56.261149] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T18:55:56.269684] [INFO ] [REMOTE ] FSM: Full fetch complete (76665 records). [2025-09-19T18:55:56.269901] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-19T18:55:56.654952] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-19T18:55:56.679868] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-19T18:55:56.679944] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-19T18:55:56.680931] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-19T18:55:56.681108] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-19T18:55:56.683014] [DEBUG] [LOCAL ] FSM: Trimmed 76665 records to 54061 (keeping 200 days of data) [2025-09-19T18:55:56.780540] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T18:55:57.005306] [DEBUG] [LOCAL ] FSM: Primary data saved (54061 records). [2025-09-19T18:55:57.005464] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-19T18:55:57.005594] [INFO ] [MAIN ] Update Progress: 874/2372 symbols completed. FSM took 30.9s. Estimated remaining: 3h 18m 37s. Rate: 7.5 symbols/min [2025-09-19T18:55:57.231539] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:57.244516] [DEBUG] [LOCAL ] FTHY: Loaded 11796 existing records from primary storage. [2025-09-19T18:55:57.244683] [INFO ] [MAIN ] FTHY: Loaded 11796 existing records. [2025-09-19T18:55:57.430938] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:57.431210] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-19T18:55:57.431260] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-19T18:55:57.431732] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-19T18:55:57.431795] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-19T18:55:57.452441] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-19T18:55:57.800664] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:58.006805] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T18:55:58.016100] [INFO ] [REMOTE ] FSLY: Full fetch complete (74994 records). [2025-09-19T18:55:58.016262] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-19T18:55:58.248457] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-19T18:55:58.449034] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-19T18:55:58.449195] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-19T18:55:58.450231] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-19T18:55:58.450300] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-19T18:55:58.451965] [DEBUG] [LOCAL ] FSLY: Trimmed 74994 records to 52048 (keeping 200 days of data) [2025-09-19T18:55:58.744889] [DEBUG] [LOCAL ] FSLY: Primary data saved (52048 records). [2025-09-19T18:55:58.745039] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-19T18:55:58.745128] [INFO ] [MAIN ] Update Progress: 875/2372 symbols completed. FSLY took 36.5s. Estimated remaining: 3h 18m 18s. Rate: 7.5 symbols/min [2025-09-19T18:55:58.925222] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:55:58.974852] [DEBUG] [LOCAL ] FTI: Loaded 53693 existing records from primary storage. [2025-09-19T18:55:58.975003] [INFO ] [MAIN ] FTI: Loaded 53693 existing records. [2025-09-19T18:55:59.048746] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-19T18:55:59.159007] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:55:59.159287] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-19T18:55:59.159351] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-19T18:55:59.160499] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-19T18:55:59.160560] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-19T18:55:59.533539] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:55:59.546105] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T18:55:59.574414] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T18:55:59.843261] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-19T18:55:59.849085] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T18:56:00.643268] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-19T18:56:01.443271] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-19T18:56:02.070853] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T18:56:02.243261] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-19T18:56:02.318568] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T18:56:02.595843] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T18:56:03.043277] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-19T18:56:03.843264] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-19T18:56:04.036782] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T18:56:04.152048] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T18:56:04.319694] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-19T18:56:04.643272] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-19T18:56:05.443267] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-19T18:56:05.778194] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T18:56:06.198562] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T18:56:06.243216] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-19T18:56:06.857717] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T18:56:06.859332] [INFO ] [REMOTE ] FT: Full fetch complete (9050 records). [2025-09-19T18:56:06.859411] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-19T18:56:07.044678] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-19T18:56:07.239106] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-19T18:56:07.239186] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-19T18:56:07.239441] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-19T18:56:07.239479] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-19T18:56:07.239948] [DEBUG] [LOCAL ] FT: Trimmed 9050 records to 6424 (keeping 200 days of data) [2025-09-19T18:56:07.278177] [DEBUG] [LOCAL ] FT: Primary data saved (6424 records). [2025-09-19T18:56:07.278326] [INFO ] [MAIN ] FT: Full history saved. [2025-09-19T18:56:07.278415] [INFO ] [MAIN ] Update Progress: 876/2372 symbols completed. FT took 22.1s. Estimated remaining: 3h 18m 11s. Rate: 7.5 symbols/min [2025-09-19T18:56:07.467195] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:07.502086] [DEBUG] [LOCAL ] FTK: Loaded 32184 existing records from primary storage. [2025-09-19T18:56:07.502239] [INFO ] [MAIN ] FTK: Loaded 32184 existing records. [2025-09-19T18:56:07.684202] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:07.684508] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-19T18:56:07.684560] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-19T18:56:07.685436] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-19T18:56:07.685499] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-19T18:56:07.847715] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-19T18:56:08.065541] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:08.215050] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T18:56:08.643290] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-19T18:56:09.443265] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-19T18:56:09.822755] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T18:56:09.905520] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T18:56:10.243270] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-19T18:56:10.806149] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-19T18:56:10.948946] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T18:56:10.953515] [INFO ] [REMOTE ] FSS: Full fetch complete (47990 records). [2025-09-19T18:56:10.953626] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-19T18:56:11.048484] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-19T18:56:11.344407] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-19T18:56:11.344503] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-19T18:56:11.345297] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-19T18:56:11.345362] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-19T18:56:11.346584] [DEBUG] [LOCAL ] FSS: Trimmed 47990 records to 35405 (keeping 200 days of data) [2025-09-19T18:56:11.573713] [DEBUG] [LOCAL ] FSS: Primary data saved (35405 records). [2025-09-19T18:56:11.573867] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-19T18:56:11.573954] [INFO ] [MAIN ] Update Progress: 877/2372 symbols completed. FSS took 39.7s. Estimated remaining: 3h 17m 57s. Rate: 7.6 symbols/min [2025-09-19T18:56:11.843286] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-19T18:56:12.036301] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:56:12.643261] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-19T18:56:12.839164] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T18:56:13.443271] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-19T18:56:13.624015] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T18:56:14.244250] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-19T18:56:14.248579] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T18:56:15.043275] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-19T18:56:15.198900] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T18:56:15.843320] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-19T18:56:16.152849] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T18:56:16.643261] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-19T18:56:17.096924] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T18:56:17.099139] [INFO ] [REMOTE ] FTHY: Full fetch complete (17673 records). [2025-09-19T18:56:17.099218] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-19T18:56:17.452783] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-19T18:56:17.464393] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-19T18:56:17.464484] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-19T18:56:17.464921] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-19T18:56:17.464982] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-19T18:56:17.465729] [DEBUG] [LOCAL ] FTHY: Trimmed 17673 records to 11845 (keeping 200 days of data) [2025-09-19T18:56:17.540212] [DEBUG] [LOCAL ] FTHY: Primary data saved (11845 records). [2025-09-19T18:56:17.540359] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-19T18:56:17.540459] [INFO ] [MAIN ] Update Progress: 878/2372 symbols completed. FTHY took 20.5s. Estimated remaining: 3h 17m 46s. Rate: 7.6 symbols/min [2025-09-19T18:56:18.322402] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T18:56:18.333932] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-19T18:56:18.459193] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T18:56:19.043261] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-19T18:56:20.293763] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T18:56:20.306684] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-19T18:56:20.358017] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T18:56:20.643289] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-19T18:56:21.645459] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T18:56:21.654356] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-19T18:56:21.821830] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T18:56:22.243298] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-19T18:56:22.788030] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T18:56:23.043327] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-19T18:56:23.668192] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T18:56:23.843289] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-19T18:56:24.682565] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T18:56:24.690416] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-19T18:56:25.399323] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T18:56:25.443218] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-19T18:56:26.240114] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T18:56:26.245442] [INFO ] [REMOTE ] FTK: Full fetch complete (42278 records). [2025-09-19T18:56:26.245568] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-19T18:56:26.634238] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-19T18:56:26.634326] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-19T18:56:26.635010] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-19T18:56:26.635073] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-19T18:56:26.636127] [DEBUG] [LOCAL ] FTK: Trimmed 42278 records to 32433 (keeping 200 days of data) [2025-09-19T18:56:26.827419] [DEBUG] [LOCAL ] FTK: Primary data saved (32433 records). [2025-09-19T18:56:26.827575] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-19T18:56:26.827711] [INFO ] [MAIN ] Update Progress: 879/2372 symbols completed. FTK took 19.5s. Estimated remaining: 3h 17m 40s. Rate: 7.6 symbols/min [2025-09-19T18:56:27.229460] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T18:56:27.241090] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-19T18:56:29.224155] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T18:56:29.232293] [INFO ] [REMOTE ] FTI: Full fetch complete (77122 records). [2025-09-19T18:56:29.232441] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-19T18:56:29.633322] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-19T18:56:29.633420] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-19T18:56:29.634381] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-19T18:56:29.634447] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-19T18:56:29.636065] [DEBUG] [LOCAL ] FTI: Trimmed 77122 records to 54083 (keeping 200 days of data) [2025-09-19T18:56:29.970502] [DEBUG] [LOCAL ] FTI: Primary data saved (54083 records). [2025-09-19T18:56:29.970728] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-19T18:56:29.970855] [INFO ] [MAIN ] Update Progress: 880/2372 symbols completed. FTI took 31.2s. Estimated remaining: 3h 17m 24s. Rate: 7.6 symbols/min [2025-09-19T18:56:30.545689] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:30.627916] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:30.676997] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:30.737800] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:30.740592] [DEBUG] [LOCAL ] FTWO: Loaded 1804 existing records from primary storage. [2025-09-19T18:56:30.741259] [INFO ] [MAIN ] FTWO: Loaded 1804 existing records. [2025-09-19T18:56:30.961803] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:30.978119] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-19T18:56:30.979285] [DEBUG] [LOCAL ] FUBO: Loaded 54089 existing records from primary storage. [2025-09-19T18:56:30.978392] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-19T18:56:30.988293] [INFO ] [MAIN ] FUBO: Loaded 54089 existing records. [2025-09-19T18:56:31.000890] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-19T18:56:31.032939] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-19T18:56:31.106375] [DEBUG] [LOCAL ] FTV: Loaded 53286 existing records from primary storage. [2025-09-19T18:56:31.156397] [INFO ] [MAIN ] FTV: Loaded 53286 existing records. [2025-09-19T18:56:31.201245] [DEBUG] [LOCAL ] FTS: Loaded 42466 existing records from primary storage. [2025-09-19T18:56:31.233763] [INFO ] [MAIN ] FTS: Loaded 42466 existing records. [2025-09-19T18:56:31.554966] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:31.649112] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-19T18:56:31.682069] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-19T18:56:31.772583] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:31.809615] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-19T18:56:31.853356] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-19T18:56:31.853271] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-19T18:56:31.860350] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-19T18:56:31.906256] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-19T18:56:31.931485] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-19T18:56:31.936803] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:32.058016] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-19T18:56:32.103111] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-19T18:56:32.134254] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-19T18:56:32.182899] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-19T18:56:32.243096] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:32.337926] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-19T18:56:33.035870] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:33.118236] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:33.115262] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-19T18:56:33.118558] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-19T18:56:33.207219] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:33.207564] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-19T18:56:33.212541] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T18:56:33.214404] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-19T18:56:33.881929] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T18:56:33.883626] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-19T18:56:34.300169] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-19T18:56:34.302063] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-19T18:56:34.493034] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T18:56:34.503561] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-19T18:56:34.834713] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T18:56:34.835935] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-19T18:56:34.915122] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T18:56:34.926469] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-19T18:56:34.962634] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T18:56:35.043256] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-19T18:56:35.336947] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T18:56:35.843268] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-19T18:56:36.242843] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T18:56:36.310002] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T18:56:36.587387] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T18:56:36.643221] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-19T18:56:37.443235] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-19T18:56:37.572311] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-19T18:56:38.243290] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-19T18:56:38.470714] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T18:56:38.842091] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-19T18:56:39.043265] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-19T18:56:39.114870] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T18:56:39.353342] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-19T18:56:39.843266] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-19T18:56:40.219107] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-19T18:56:40.643264] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-19T18:56:41.443299] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-19T18:56:42.243312] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-19T18:56:42.282767] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T18:56:42.710374] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T18:56:43.043305] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-19T18:56:43.843270] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-19T18:56:44.643330] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-19T18:56:44.716712] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-19T18:56:44.871928] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T18:56:44.872820] [INFO ] [REMOTE ] FTWO: Full fetch complete (3522 records). [2025-09-19T18:56:44.873017] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-19T18:56:45.082988] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T18:56:45.280259] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-19T18:56:45.280372] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-19T18:56:45.280505] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-19T18:56:45.280544] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-19T18:56:45.280927] [DEBUG] [LOCAL ] FTWO: Trimmed 3522 records to 1824 (keeping 200 days of data) [2025-09-19T18:56:45.292454] [DEBUG] [LOCAL ] FTWO: Primary data saved (1824 records). [2025-09-19T18:56:45.292528] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-19T18:56:45.292604] [INFO ] [MAIN ] Update Progress: 881/2372 symbols completed. FTWO took 15.3s. Estimated remaining: 3h 17m 29s. Rate: 7.6 symbols/min [2025-09-19T18:56:45.459129] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-19T18:56:45.463032] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:45.499708] [DEBUG] [LOCAL ] FUL: Loaded 33281 existing records from primary storage. [2025-09-19T18:56:45.499850] [INFO ] [MAIN ] FUL: Loaded 33281 existing records. [2025-09-19T18:56:45.678865] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:45.679139] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-19T18:56:45.679210] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-19T18:56:45.680290] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-19T18:56:45.680354] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-19T18:56:46.059496] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:56:46.086029] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T18:56:46.243265] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-19T18:56:47.043279] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-19T18:56:47.515585] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T18:56:47.843246] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-19T18:56:47.932296] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T18:56:48.643225] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-19T18:56:48.701580] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T18:56:49.346494] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T18:56:49.443311] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-19T18:56:50.243273] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-19T18:56:51.001484] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-19T18:56:51.043221] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-19T18:56:51.232383] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T18:56:51.456332] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T18:56:51.843286] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-19T18:56:52.643283] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-19T18:56:53.184595] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T18:56:53.443289] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-19T18:56:53.628002] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T18:56:53.741679] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T18:56:54.243274] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-19T18:56:55.043249] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-19T18:56:55.249755] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T18:56:55.819917] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T18:56:55.843221] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-19T18:56:56.643257] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-19T18:56:56.683833] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T18:56:57.443350] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-19T18:56:57.625919] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T18:56:58.183062] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T18:56:58.243232] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-19T18:56:58.510807] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T18:56:58.516994] [INFO ] [REMOTE ] FTS: Full fetch complete (60074 records). [2025-09-19T18:56:58.517127] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-19T18:56:58.915875] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-19T18:56:58.915965] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-19T18:56:58.916874] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-19T18:56:58.916954] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-19T18:56:58.918265] [DEBUG] [LOCAL ] FTS: Trimmed 60074 records to 42760 (keeping 200 days of data) [2025-09-19T18:56:59.046355] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-19T18:56:59.188175] [DEBUG] [LOCAL ] FTS: Primary data saved (42760 records). [2025-09-19T18:56:59.188320] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-19T18:56:59.188430] [INFO ] [MAIN ] Update Progress: 882/2372 symbols completed. FTS took 29.2s. Estimated remaining: 3h 17m 31s. Rate: 7.5 symbols/min [2025-09-19T18:56:59.389004] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:56:59.451279] [DEBUG] [LOCAL ] FUN: Loaded 51913 existing records from primary storage. [2025-09-19T18:56:59.451487] [INFO ] [MAIN ] FUN: Loaded 51913 existing records. [2025-09-19T18:56:59.636677] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:56:59.636978] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-19T18:56:59.637036] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-19T18:56:59.638322] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-19T18:56:59.638405] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-19T18:56:59.848439] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-19T18:57:00.007946] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:00.028368] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T18:57:00.071021] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T18:57:00.643280] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-19T18:57:01.443288] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-19T18:57:02.243284] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-19T18:57:02.707076] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-19T18:57:02.938985] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T18:57:03.043252] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-19T18:57:03.843242] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-19T18:57:04.370029] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (2.93 seconds). [2025-09-19T18:57:04.643406] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-19T18:57:04.965388] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T18:57:05.152332] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-19T18:57:05.443273] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-19T18:57:05.843452] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T18:57:06.243268] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-19T18:57:06.598810] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-19T18:57:06.859155] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T18:57:06.867146] [INFO ] [REMOTE ] FTV: Full fetch complete (76220 records). [2025-09-19T18:57:06.867282] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-19T18:57:07.047240] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-19T18:57:07.275588] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-19T18:57:07.275728] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-19T18:57:07.276778] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-19T18:57:07.276865] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-19T18:57:07.278521] [DEBUG] [LOCAL ] FTV: Trimmed 76220 records to 53674 (keeping 200 days of data) [2025-09-19T18:57:07.620232] [DEBUG] [LOCAL ] FTV: Primary data saved (53674 records). [2025-09-19T18:57:07.620378] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-19T18:57:07.620511] [INFO ] [MAIN ] Update Progress: 883/2372 symbols completed. FTV took 37.6s. Estimated remaining: 3h 17m 23s. Rate: 7.5 symbols/min [2025-09-19T18:57:07.746074] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T18:57:07.837881] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:07.843240] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-19T18:57:07.865404] [DEBUG] [LOCAL ] FVR: Loaded 22106 existing records from primary storage. [2025-09-19T18:57:07.865545] [INFO ] [MAIN ] FVR: Loaded 22106 existing records. [2025-09-19T18:57:08.059811] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:08.060262] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-19T18:57:08.060355] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-19T18:57:08.061172] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-19T18:57:08.061257] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-19T18:57:08.432665] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:08.643262] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-19T18:57:09.407960] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T18:57:09.413492] [INFO ] [REMOTE ] FUL: Full fetch complete (46593 records). [2025-09-19T18:57:09.413606] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-19T18:57:09.449296] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-19T18:57:09.859684] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-19T18:57:09.860465] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-19T18:57:09.861245] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-19T18:57:09.862070] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-19T18:57:09.869741] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-19T18:57:09.873292] [DEBUG] [LOCAL ] FUL: Trimmed 46593 records to 33507 (keeping 200 days of data) [2025-09-19T18:57:09.876056] [INFO ] [REMOTE ] FUBO: Full fetch complete (77750 records). [2025-09-19T18:57:09.876162] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-19T18:57:10.314999] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T18:57:10.349101] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-19T18:57:10.524833] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-19T18:57:10.526707] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-19T18:57:10.528803] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-19T18:57:10.533041] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-19T18:57:10.546801] [DEBUG] [LOCAL ] FUL: Primary data saved (33507 records). [2025-09-19T18:57:10.547043] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-19T18:57:10.547201] [INFO ] [MAIN ] Update Progress: 884/2372 symbols completed. FUL took 25.3s. Estimated remaining: 3h 17m 7s. Rate: 7.5 symbols/min [2025-09-19T18:57:10.582628] [DEBUG] [LOCAL ] FUBO: Trimmed 77750 records to 54479 (keeping 200 days of data) [2025-09-19T18:57:10.813195] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:10.866886] [DEBUG] [LOCAL ] FVRR: Loaded 40480 existing records from primary storage. [2025-09-19T18:57:10.869548] [INFO ] [MAIN ] FVRR: Loaded 40480 existing records. [2025-09-19T18:57:11.148052] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:11.156666] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-19T18:57:11.157528] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-19T18:57:11.161459] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-19T18:57:11.162005] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-19T18:57:11.298529] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T18:57:11.372334] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-19T18:57:11.678904] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:11.686043] [DEBUG] [LOCAL ] FUBO: Primary data saved (54479 records). [2025-09-19T18:57:11.686208] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-19T18:57:11.686345] [INFO ] [MAIN ] Update Progress: 885/2372 symbols completed. FUBO took 41.7s. Estimated remaining: 3h 16m 48s. Rate: 7.6 symbols/min [2025-09-19T18:57:11.798753] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:57:11.849486] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-19T18:57:11.875910] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:11.880325] [DEBUG] [LOCAL ] FXED: Loaded 1218 existing records from primary storage. [2025-09-19T18:57:11.880408] [INFO ] [MAIN ] FXED: Loaded 1218 existing records. [2025-09-19T18:57:12.066968] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:12.067273] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-19T18:57:12.067334] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-19T18:57:12.067717] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-19T18:57:12.067780] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-19T18:57:12.427805] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:12.643226] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-19T18:57:13.172336] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T18:57:13.240227] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T18:57:13.355134] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T18:57:13.443246] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-19T18:57:14.243232] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-19T18:57:14.446812] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T18:57:14.597278] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-19T18:57:15.043279] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-19T18:57:15.843263] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-19T18:57:16.643284] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-19T18:57:16.994759] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T18:57:17.443273] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-19T18:57:17.650478] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T18:57:18.243324] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-19T18:57:18.430631] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T18:57:18.631495] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T18:57:18.752558] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T18:57:19.043265] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-19T18:57:19.843278] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-19T18:57:20.259926] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T18:57:20.643283] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-19T18:57:21.443250] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-19T18:57:21.506223] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T18:57:21.847728] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T18:57:22.210706] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T18:57:22.243228] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-19T18:57:23.043312] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-19T18:57:23.383009] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-19T18:57:23.457317] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T18:57:23.843278] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-19T18:57:24.220623] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T18:57:24.643265] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-19T18:57:25.443262] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-19T18:57:25.849148] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T18:57:25.973481] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T18:57:26.243280] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-19T18:57:27.043307] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-19T18:57:27.347422] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T18:57:27.843341] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-19T18:57:28.223338] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-19T18:57:28.275124] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T18:57:28.643303] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-19T18:57:29.443287] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-19T18:57:30.243275] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-19T18:57:30.462019] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T18:57:30.462855] [INFO ] [REMOTE ] FXED: Full fetch complete (1767 records). [2025-09-19T18:57:30.462928] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-19T18:57:30.830205] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-19T18:57:30.830314] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-19T18:57:30.830536] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-19T18:57:30.830671] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-19T18:57:30.831176] [DEBUG] [LOCAL ] FXED: Trimmed 1767 records to 1232 (keeping 200 days of data) [2025-09-19T18:57:30.839901] [DEBUG] [LOCAL ] FXED: Primary data saved (1232 records). [2025-09-19T18:57:30.839988] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-19T18:57:30.840292] [INFO ] [MAIN ] Update Progress: 886/2372 symbols completed. FXED took 19.2s. Estimated remaining: 3h 16m 59s. Rate: 7.5 symbols/min [2025-09-19T18:57:31.044116] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-19T18:57:31.048454] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:31.053583] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-19T18:57:31.084421] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T18:57:31.135116] [DEBUG] [LOCAL ] G: Loaded 50126 existing records from primary storage. [2025-09-19T18:57:31.135269] [INFO ] [MAIN ] G: Loaded 50126 existing records. [2025-09-19T18:57:31.319772] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:31.320057] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-19T18:57:31.320107] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-19T18:57:31.321408] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-19T18:57:31.321472] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-19T18:57:31.708984] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:31.843299] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-19T18:57:32.405227] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T18:57:32.643282] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-19T18:57:33.443314] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-19T18:57:33.799463] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T18:57:33.824025] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T18:57:34.243310] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-19T18:57:35.043301] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-19T18:57:35.124361] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T18:57:35.223566] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T18:57:35.843261] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-19T18:57:36.643294] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-19T18:57:36.926360] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T18:57:37.248050] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T18:57:37.443284] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-19T18:57:37.814345] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T18:57:37.817558] [INFO ] [REMOTE ] FVR: Full fetch complete (30703 records). [2025-09-19T18:57:37.817845] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-19T18:57:38.191680] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-19T18:57:38.191786] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-19T18:57:38.192425] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-19T18:57:38.192479] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-19T18:57:38.193464] [DEBUG] [LOCAL ] FVR: Trimmed 30703 records to 22259 (keeping 200 days of data) [2025-09-19T18:57:38.254308] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-19T18:57:38.339158] [DEBUG] [LOCAL ] FVR: Primary data saved (22259 records). [2025-09-19T18:57:38.339284] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-19T18:57:38.339377] [INFO ] [MAIN ] Update Progress: 887/2372 symbols completed. FVR took 30.7s. Estimated remaining: 3h 16m 50s. Rate: 7.5 symbols/min [2025-09-19T18:57:38.512385] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:38.540598] [DEBUG] [LOCAL ] GAB: Loaded 27996 existing records from primary storage. [2025-09-19T18:57:38.540773] [INFO ] [MAIN ] GAB: Loaded 27996 existing records. [2025-09-19T18:57:38.720509] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:38.720854] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-19T18:57:38.720912] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-19T18:57:38.721676] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-19T18:57:38.721754] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-19T18:57:39.081325] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:39.075748] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-19T18:57:39.111563] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T18:57:39.843309] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-19T18:57:40.192139] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T18:57:40.224269] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T18:57:40.232193] [INFO ] [REMOTE ] FUN: Full fetch complete (72280 records). [2025-09-19T18:57:40.232346] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-19T18:57:40.630839] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-19T18:57:40.630964] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-19T18:57:40.631901] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-19T18:57:40.631975] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-19T18:57:40.633391] [DEBUG] [LOCAL ] FUN: Trimmed 72280 records to 52303 (keeping 200 days of data) [2025-09-19T18:57:40.643256] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-19T18:57:40.949664] [DEBUG] [LOCAL ] FUN: Primary data saved (52303 records). [2025-09-19T18:57:40.949815] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-19T18:57:40.950873] [INFO ] [MAIN ] Update Progress: 888/2372 symbols completed. FUN took 41.8s. Estimated remaining: 3h 16m 33s. Rate: 7.6 symbols/min [2025-09-19T18:57:41.125047] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:41.137720] [DEBUG] [LOCAL ] GAM: Loaded 4390 existing records from primary storage. [2025-09-19T18:57:41.137846] [INFO ] [MAIN ] GAM: Loaded 4390 existing records. [2025-09-19T18:57:41.367136] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:41.367429] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-19T18:57:41.367607] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-19T18:57:41.368017] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-19T18:57:41.368186] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-19T18:57:41.460855] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-19T18:57:41.521887] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:57:41.761761] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:42.243271] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-19T18:57:42.576730] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T18:57:42.685628] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-19T18:57:42.766934] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T18:57:42.773089] [INFO ] [REMOTE ] FVRR: Full fetch complete (58886 records). [2025-09-19T18:57:42.773207] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-19T18:57:43.048508] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-19T18:57:43.175340] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-19T18:57:43.175424] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-19T18:57:43.176248] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-19T18:57:43.176312] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-19T18:57:43.177540] [DEBUG] [LOCAL ] FVRR: Trimmed 58886 records to 40863 (keeping 200 days of data) [2025-09-19T18:57:43.413817] [DEBUG] [LOCAL ] FVRR: Primary data saved (40863 records). [2025-09-19T18:57:43.413985] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-19T18:57:43.414090] [INFO ] [MAIN ] Update Progress: 889/2372 symbols completed. FVRR took 32.9s. Estimated remaining: 3h 16m 16s. Rate: 7.6 symbols/min [2025-09-19T18:57:43.593422] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:43.603334] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T18:57:43.654396] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-09-19T18:57:43.654559] [INFO ] [MAIN ] GAP: Loaded 54045 existing records. [2025-09-19T18:57:43.833542] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:43.833849] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-19T18:57:43.833918] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-19T18:57:43.835186] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-19T18:57:43.835261] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-19T18:57:43.848397] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-19T18:57:44.205667] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:44.643267] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-19T18:57:45.202992] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T18:57:45.247116] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T18:57:45.443286] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-19T18:57:45.984332] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T18:57:46.243285] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-19T18:57:46.980059] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T18:57:47.043259] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-19T18:57:47.809803] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T18:57:47.843232] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-19T18:57:48.533913] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T18:57:48.643286] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-19T18:57:49.370269] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T18:57:49.443280] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-19T18:57:50.243264] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-19T18:57:50.599891] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T18:57:51.000207] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T18:57:51.043270] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-19T18:57:51.843270] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-19T18:57:52.359543] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-19T18:57:52.360558] [INFO ] [REMOTE ] GAM: Full fetch complete (6944 records). [2025-09-19T18:57:52.360627] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-19T18:57:52.648361] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-19T18:57:52.739477] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-19T18:57:52.739703] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-19T18:57:52.739997] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-19T18:57:52.740073] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-19T18:57:52.740843] [DEBUG] [LOCAL ] GAM: Trimmed 6944 records to 4398 (keeping 200 days of data) [2025-09-19T18:57:52.767108] [DEBUG] [LOCAL ] GAM: Primary data saved (4398 records). [2025-09-19T18:57:52.767214] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-19T18:57:52.767311] [INFO ] [MAIN ] Update Progress: 890/2372 symbols completed. GAM took 11.8s. Estimated remaining: 3h 16m 10s. Rate: 7.6 symbols/min [2025-09-19T18:57:52.957429] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:57:52.989981] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T18:57:53.015992] [DEBUG] [LOCAL ] GATX: Loaded 18177 existing records from primary storage. [2025-09-19T18:57:53.016129] [INFO ] [MAIN ] GATX: Loaded 18177 existing records. [2025-09-19T18:57:53.203444] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:57:53.203797] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-19T18:57:53.203854] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-19T18:57:53.204449] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-19T18:57:53.204512] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-19T18:57:53.449472] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-19T18:57:53.569414] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:57:54.243233] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-19T18:57:54.325892] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T18:57:55.043246] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-19T18:57:55.078517] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T18:57:55.445307] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T18:57:55.843262] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-19T18:57:56.643261] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-19T18:57:57.048703] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T18:57:57.144610] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T18:57:57.443292] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-19T18:57:58.243291] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-19T18:57:58.462597] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T18:57:58.679057] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T18:57:58.824550] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T18:57:59.043271] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-19T18:57:59.843279] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-19T18:58:00.300826] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T18:58:00.643276] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-19T18:58:01.443296] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-19T18:58:02.177960] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T18:58:02.243230] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-19T18:58:03.017273] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T18:58:03.043226] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-19T18:58:03.401439] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-19T18:58:03.554459] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T18:58:03.843272] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-19T18:58:04.223267] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T18:58:04.643271] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-19T18:58:05.374055] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T18:58:05.443218] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-19T18:58:06.243274] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-19T18:58:06.496362] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T18:58:06.572100] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T18:58:07.043286] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-19T18:58:07.843235] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-19T18:58:08.644496] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T18:58:08.644590] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-19T18:58:08.950198] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T18:58:09.027872] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T18:58:09.443280] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-19T18:58:09.636421] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T18:58:10.243264] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-19T18:58:11.043253] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-19T18:58:11.601001] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T18:58:11.764380] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T18:58:11.843259] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-19T18:58:12.643257] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-19T18:58:12.884920] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T18:58:12.892532] [INFO ] [REMOTE ] G: Full fetch complete (71544 records). [2025-09-19T18:58:12.892677] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-19T18:58:13.355289] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-19T18:58:13.355421] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-19T18:58:13.356419] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-19T18:58:13.356483] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-19T18:58:13.358246] [DEBUG] [LOCAL ] G: Trimmed 71544 records to 50508 (keeping 200 days of data) [2025-09-19T18:58:13.449953] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-19T18:58:13.622502] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T18:58:13.751590] [DEBUG] [LOCAL ] G: Primary data saved (50508 records). [2025-09-19T18:58:13.749826] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T18:58:13.756356] [INFO ] [MAIN ] G: Full history saved. [2025-09-19T18:58:13.756927] [INFO ] [MAIN ] Update Progress: 891/2372 symbols completed. G took 42.9s. Estimated remaining: 3h 16m 24s. Rate: 7.5 symbols/min [2025-09-19T18:58:13.926799] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:13.941594] [DEBUG] [LOCAL ] GBAB: Loaded 13156 existing records from primary storage. [2025-09-19T18:58:13.941740] [INFO ] [MAIN ] GBAB: Loaded 13156 existing records. [2025-09-19T18:58:14.116823] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:14.117098] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-19T18:58:14.117157] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-19T18:58:14.117687] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-19T18:58:14.117766] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-19T18:58:14.255595] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-19T18:58:14.480784] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:14.494347] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T18:58:15.043272] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-19T18:58:15.843261] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-19T18:58:16.404817] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T18:58:16.409382] [INFO ] [REMOTE ] GAB: Full fetch complete (39255 records). [2025-09-19T18:58:16.409484] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-19T18:58:16.660871] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-19T18:58:16.853086] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-19T18:58:16.853443] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-19T18:58:16.865216] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-19T18:58:16.865988] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-19T18:58:16.866080] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-19T18:58:16.868058] [DEBUG] [LOCAL ] GAB: Trimmed 39255 records to 28200 (keeping 200 days of data) [2025-09-19T18:58:16.881304] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T18:58:17.051823] [DEBUG] [LOCAL ] GAB: Primary data saved (28200 records). [2025-09-19T18:58:17.051965] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-19T18:58:17.052051] [INFO ] [MAIN ] Update Progress: 892/2372 symbols completed. GAB took 38.7s. Estimated remaining: 3h 16m 8s. Rate: 7.5 symbols/min [2025-09-19T18:58:17.219294] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:17.259352] [DEBUG] [LOCAL ] GBCI: Loaded 40386 existing records from primary storage. [2025-09-19T18:58:17.259513] [INFO ] [MAIN ] GBCI: Loaded 40386 existing records. [2025-09-19T18:58:17.435385] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:17.435636] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-19T18:58:17.435719] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-19T18:58:17.436743] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-19T18:58:17.436805] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-19T18:58:17.448326] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-19T18:58:17.817484] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:17.975322] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T18:58:18.243316] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-19T18:58:19.025636] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T18:58:19.043210] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-19T18:58:19.299333] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T18:58:19.843299] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-19T18:58:20.643337] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-19T18:58:21.443334] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-19T18:58:21.478464] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T18:58:21.609584] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T18:58:21.618243] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-19T18:58:21.618524] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-19T18:58:21.733963] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:58:21.783937] [INFO ] [REMOTE ] GATX: Full fetch complete (25276 records). [2025-09-19T18:58:21.803638] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-19T18:58:22.252164] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-19T18:58:22.263894] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-19T18:58:22.252316] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-19T18:58:22.265355] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-19T18:58:22.271764] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-19T18:58:22.351326] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 54435 (keeping 200 days of data) [2025-09-19T18:58:22.595758] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-19T18:58:22.597173] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-19T18:58:22.605394] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-19T18:58:22.613503] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-19T18:58:22.616376] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T18:58:22.625122] [DEBUG] [LOCAL ] GATX: Trimmed 25276 records to 18317 (keeping 200 days of data) [2025-09-19T18:58:22.984010] [DEBUG] [LOCAL ] GATX: Primary data saved (18317 records). [2025-09-19T18:58:22.984148] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-19T18:58:22.983909] [DEBUG] [LOCAL ] GAP: Primary data saved (54435 records). [2025-09-19T18:58:22.984350] [INFO ] [MAIN ] Update Progress: 893/2372 symbols completed. GATX took 30.2s. Estimated remaining: 3h 15m 57s. Rate: 7.5 symbols/min [2025-09-19T18:58:22.984788] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-19T18:58:23.016700] [INFO ] [MAIN ] Update Progress: 894/2372 symbols completed. GAP took 39.6s. Estimated remaining: 3h 15m 36s. Rate: 7.6 symbols/min [2025-09-19T18:58:23.048676] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-19T18:58:23.285028] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:23.320873] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-19T18:58:23.348951] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:23.349026] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-19T18:58:23.349306] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-19T18:58:23.349361] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-19T18:58:23.349409] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-19T18:58:23.349442] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-19T18:58:23.702070] [DEBUG] [LOCAL ] GBTG: Loaded 41003 existing records from primary storage. [2025-09-19T18:58:23.762688] [INFO ] [MAIN ] GBTG: Loaded 41003 existing records. [2025-09-19T18:58:23.765982] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:23.850888] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T18:58:23.850298] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-19T18:58:23.925769] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T18:58:24.012072] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:24.012350] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-19T18:58:24.012402] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-19T18:58:24.013431] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-19T18:58:24.013493] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-19T18:58:24.406065] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:24.435192] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T18:58:24.643283] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-19T18:58:25.443309] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-19T18:58:26.243264] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-19T18:58:26.360079] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T18:58:26.843323] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T18:58:27.043283] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-19T18:58:27.381483] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-19T18:58:27.698078] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T18:58:27.843265] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-19T18:58:28.220463] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-19T18:58:28.643287] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-19T18:58:29.044669] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T18:58:29.443315] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-19T18:58:29.807168] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-19T18:58:30.243268] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-19T18:58:31.043292] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-19T18:58:31.444360] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T18:58:31.833671] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T18:58:31.843246] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-19T18:58:32.643267] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-19T18:58:33.298128] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T18:58:33.443244] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-19T18:58:34.243294] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-19T18:58:34.292147] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T18:58:34.514973] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-19T18:58:34.534266] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T18:58:35.043270] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-19T18:58:35.843264] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-19T18:58:35.967419] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T18:58:36.126342] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-19T18:58:36.643309] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-19T18:58:37.443286] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-19T18:58:37.848988] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T18:58:37.997349] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T18:58:38.243273] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-19T18:58:38.659336] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-19T18:58:38.660109] [INFO ] [REMOTE ] GBLI: Full fetch complete (1418 records). [2025-09-19T18:58:38.660184] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-19T18:58:38.854908] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-19T18:58:38.855142] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:58:38.855215] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:58:38.855290] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-19T18:58:38.855370] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-19T18:58:38.855426] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-19T18:58:38.855470] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-19T18:58:38.855530] [INFO ] [MAIN ] Update Progress: 895/2372 symbols completed. GBLI took 15.9s. Estimated remaining: 3h 15m 41s. Rate: 7.5 symbols/min [2025-09-19T18:58:39.032209] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:39.043292] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-19T18:58:39.065850] [DEBUG] [LOCAL ] GBX: Loaded 29724 existing records from primary storage. [2025-09-19T18:58:39.065993] [INFO ] [MAIN ] GBX: Loaded 29724 existing records. [2025-09-19T18:58:39.247985] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:39.248221] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-19T18:58:39.248269] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-19T18:58:39.248992] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-19T18:58:39.249051] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-19T18:58:39.628611] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:39.843250] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-19T18:58:40.222855] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T18:58:40.642901] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T18:58:40.647909] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-19T18:58:41.443322] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-19T18:58:41.735956] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T18:58:42.243348] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-19T18:58:42.426764] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T18:58:43.043268] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-19T18:58:43.843269] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-19T18:58:44.015616] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T18:58:44.188270] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T18:58:44.599388] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T18:58:44.643265] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-19T18:58:45.443258] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-19T18:58:45.961675] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T18:58:46.243282] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-19T18:58:46.947426] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T18:58:47.043266] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-19T18:58:47.349583] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T18:58:47.843264] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-19T18:58:48.531377] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T18:58:48.643264] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-19T18:58:48.964278] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T18:58:49.443282] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-19T18:58:50.243267] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-19T18:58:50.327329] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T18:58:50.765030] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T18:58:51.043259] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-19T18:58:51.190491] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T18:58:51.196483] [INFO ] [REMOTE ] GBCI: Full fetch complete (57676 records). [2025-09-19T18:58:51.196595] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-19T18:58:51.607039] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-19T18:58:51.607120] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-19T18:58:51.607921] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-19T18:58:51.607982] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-19T18:58:51.609149] [DEBUG] [LOCAL ] GBCI: Trimmed 57676 records to 40713 (keeping 200 days of data) [2025-09-19T18:58:51.843454] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-19T18:58:51.871041] [DEBUG] [LOCAL ] GBCI: Primary data saved (40713 records). [2025-09-19T18:58:51.871159] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-19T18:58:51.871250] [INFO ] [MAIN ] Update Progress: 896/2372 symbols completed. GBCI took 34.8s. Estimated remaining: 3h 15m 41s. Rate: 7.5 symbols/min [2025-09-19T18:58:52.048378] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:52.092021] [DEBUG] [LOCAL ] GCI: Loaded 44615 existing records from primary storage. [2025-09-19T18:58:52.092181] [INFO ] [MAIN ] GCI: Loaded 44615 existing records. [2025-09-19T18:58:52.272031] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:52.272321] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-19T18:58:52.272373] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-19T18:58:52.273285] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-19T18:58:52.273347] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-19T18:58:52.643247] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-19T18:58:52.656518] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:53.110193] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T18:58:53.443272] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-19T18:58:53.537516] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T18:58:53.736149] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T18:58:53.739402] [INFO ] [REMOTE ] GBAB: Full fetch complete (20629 records). [2025-09-19T18:58:53.739491] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-19T18:58:54.171405] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-19T18:58:54.171515] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-19T18:58:54.172271] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-19T18:58:54.172495] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-19T18:58:54.173466] [DEBUG] [LOCAL ] GBAB: Trimmed 20629 records to 13219 (keeping 200 days of data) [2025-09-19T18:58:54.243483] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-19T18:58:54.259330] [DEBUG] [LOCAL ] GBAB: Primary data saved (13219 records). [2025-09-19T18:58:54.259482] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-19T18:58:54.259584] [INFO ] [MAIN ] Update Progress: 897/2372 symbols completed. GBAB took 40.5s. Estimated remaining: 3h 15m 24s. Rate: 7.5 symbols/min [2025-09-19T18:58:54.439782] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:58:54.465944] [DEBUG] [LOCAL ] GCO: Loaded 26118 existing records from primary storage. [2025-09-19T18:58:54.466154] [INFO ] [MAIN ] GCO: Loaded 26118 existing records. [2025-09-19T18:58:54.642337] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:58:54.642578] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-19T18:58:54.642628] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-19T18:58:54.643368] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-19T18:58:54.643428] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-19T18:58:55.008625] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:58:55.032344] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T18:58:55.043216] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-19T18:58:55.843381] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-19T18:58:55.867760] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T18:58:56.353797] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T18:58:56.643265] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-19T18:58:57.241031] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T18:58:57.443265] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-19T18:58:57.838335] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T18:58:58.243270] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-19T18:58:59.043278] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-19T18:58:59.178168] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T18:58:59.184400] [INFO ] [REMOTE ] GBTG: Full fetch complete (56710 records). [2025-09-19T18:58:59.184511] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-19T18:58:59.574389] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-19T18:58:59.574519] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-19T18:58:59.575380] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-19T18:58:59.575475] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-19T18:58:59.577038] [DEBUG] [LOCAL ] GBTG: Trimmed 56710 records to 41256 (keeping 200 days of data) [2025-09-19T18:58:59.684627] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T18:58:59.843251] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-19T18:58:59.843438] [DEBUG] [LOCAL ] GBTG: Primary data saved (41256 records). [2025-09-19T18:58:59.844314] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-19T18:58:59.844431] [INFO ] [MAIN ] Update Progress: 898/2372 symbols completed. GBTG took 36.8s. Estimated remaining: 3h 15m 13s. Rate: 7.6 symbols/min [2025-09-19T18:59:00.020335] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:00.038421] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T18:59:00.061077] [DEBUG] [LOCAL ] GCTS: Loaded 19626 existing records from primary storage. [2025-09-19T18:59:00.061287] [INFO ] [MAIN ] GCTS: Loaded 19626 existing records. [2025-09-19T18:59:00.244977] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:00.245242] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-19T18:59:00.245307] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-19T18:59:00.245955] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-19T18:59:00.246021] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-19T18:59:00.595859] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:00.643233] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-19T18:59:01.455273] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-19T18:59:01.461550] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T18:59:02.060056] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T18:59:02.243296] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-19T18:59:02.328775] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T18:59:03.043248] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-19T18:59:03.465508] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T18:59:03.843248] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-19T18:59:03.973210] [DEBUG] [REMOTE ] GCTS: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T18:59:03.973489] [WARN ] [REMOTE ] GCTS: No data returned for month 2025-01 [2025-09-19T18:59:04.322809] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T18:59:04.643285] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-19T18:59:05.443232] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-19T18:59:05.878174] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T18:59:06.243269] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-19T18:59:06.706805] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T18:59:07.010772] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T18:59:07.043243] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-19T18:59:07.843270] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-19T18:59:08.317527] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T18:59:08.643248] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-19T18:59:09.443253] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-19T18:59:09.534343] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T18:59:09.750133] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T18:59:10.243260] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-19T18:59:11.016562] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T18:59:11.043220] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-19T18:59:11.843265] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-19T18:59:12.114990] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T18:59:12.240579] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T18:59:12.643319] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-19T18:59:13.443287] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-19T18:59:13.482874] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T18:59:13.736619] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-19T18:59:14.243286] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-19T18:59:14.249157] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-19T18:59:15.043289] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-19T18:59:15.500475] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T18:59:15.843299] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-19T18:59:16.468049] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T18:59:16.643281] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-19T18:59:16.693943] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T18:59:17.443314] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-19T18:59:17.506262] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T18:59:17.510387] [INFO ] [REMOTE ] GBX: Full fetch complete (42691 records). [2025-09-19T18:59:17.510543] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-19T18:59:17.922526] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-19T18:59:17.922606] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-19T18:59:17.923303] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-19T18:59:17.923377] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-19T18:59:17.924365] [DEBUG] [LOCAL ] GBX: Trimmed 42691 records to 29882 (keeping 200 days of data) [2025-09-19T18:59:18.109222] [DEBUG] [LOCAL ] GBX: Primary data saved (29882 records). [2025-09-19T18:59:18.109365] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-19T18:59:18.109477] [INFO ] [MAIN ] Update Progress: 899/2372 symbols completed. GBX took 39.3s. Estimated remaining: 3h 15m 22s. Rate: 7.5 symbols/min [2025-09-19T18:59:18.256497] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-19T18:59:18.294138] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:18.302876] [DEBUG] [LOCAL ] GCV: Loaded 7097 existing records from primary storage. [2025-09-19T18:59:18.303521] [INFO ] [MAIN ] GCV: Loaded 7097 existing records. [2025-09-19T18:59:18.490812] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:18.491065] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-19T18:59:18.491112] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-19T18:59:18.491468] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-19T18:59:18.491535] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-19T18:59:18.867798] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:18.901543] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T18:59:19.043268] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-19T18:59:19.409476] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T18:59:19.413107] [INFO ] [REMOTE ] GCTS: Full fetch complete (24575 records). [2025-09-19T18:59:19.413202] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-19T18:59:19.619923] [WARN ] [VALIDATOR ] GCTS: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T18:59:19.620299] [FATAL] [MAIN ] GCTS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:59:19.620429] [WARN ] [MAIN ] GCTS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:59:19.620505] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-19T18:59:19.620596] [DEBUG] [LOCAL ] GCTS: No primary data file found to delete. [2025-09-19T18:59:19.620677] [INFO ] [LOCAL ] GCTS: Starting deletion of derivative data. [2025-09-19T18:59:19.621152] [DEBUG] [LOCAL ] GCTS: Deleted derivative data file. [2025-09-19T18:59:19.621298] [INFO ] [MAIN ] Update Progress: 900/2372 symbols completed. GCTS took 19.8s. Estimated remaining: 3h 15m 3s. Rate: 7.5 symbols/min [2025-09-19T18:59:19.806963] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:19.847347] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-19T18:59:19.868107] [DEBUG] [LOCAL ] GD: Loaded 47822 existing records from primary storage. [2025-09-19T18:59:19.868287] [INFO ] [MAIN ] GD: Loaded 47822 existing records. [2025-09-19T18:59:19.981958] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:59:20.071020] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:20.071296] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-19T18:59:20.071348] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-19T18:59:20.073440] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-19T18:59:20.073502] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-19T18:59:20.477962] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:20.643282] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-19T18:59:20.770789] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T18:59:21.443294] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-19T18:59:22.243304] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-19T18:59:22.599722] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-19T18:59:22.762013] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T18:59:22.797271] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T18:59:22.805353] [INFO ] [REMOTE ] GCI: Full fetch complete (63084 records). [2025-09-19T18:59:22.805493] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-19T18:59:23.048405] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-19T18:59:23.213468] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-19T18:59:23.213635] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-19T18:59:23.214845] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-19T18:59:23.214962] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-19T18:59:23.217323] [DEBUG] [LOCAL ] GCI: Trimmed 63084 records to 44929 (keeping 200 days of data) [2025-09-19T18:59:23.482187] [DEBUG] [LOCAL ] GCI: Primary data saved (44929 records). [2025-09-19T18:59:23.482313] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-19T18:59:23.482444] [INFO ] [MAIN ] Update Progress: 901/2372 symbols completed. GCI took 31.6s. Estimated remaining: 3h 14m 48s. Rate: 7.6 symbols/min [2025-09-19T18:59:23.657724] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:23.715390] [DEBUG] [LOCAL ] GDDY: Loaded 50203 existing records from primary storage. [2025-09-19T18:59:23.715553] [INFO ] [MAIN ] GDDY: Loaded 50203 existing records. [2025-09-19T18:59:23.843586] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-19T18:59:23.844949] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T18:59:23.915289] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:23.915578] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-19T18:59:23.915683] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-19T18:59:23.916853] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-19T18:59:23.916935] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-19T18:59:24.335079] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:24.643299] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-19T18:59:25.443307] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-19T18:59:25.614846] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T18:59:25.692708] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T18:59:26.243293] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-19T18:59:27.043271] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-19T18:59:27.253853] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T18:59:27.324105] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-19T18:59:27.717390] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T18:59:27.843226] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-19T18:59:28.476637] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T18:59:28.643328] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-19T18:59:29.443288] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-19T18:59:29.572506] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T18:59:30.161487] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T18:59:30.243212] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-19T18:59:30.817143] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T18:59:31.043346] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-19T18:59:31.843264] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-19T18:59:32.643342] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-19T18:59:33.084462] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T18:59:33.212703] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T18:59:33.443279] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-19T18:59:34.243338] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-19T18:59:35.043251] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-19T18:59:35.177451] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-19T18:59:35.182060] [INFO ] [REMOTE ] GCO: Full fetch complete (36092 records). [2025-09-19T18:59:35.182166] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-19T18:59:35.594278] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-19T18:59:35.594451] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-19T18:59:35.595127] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-19T18:59:35.595208] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-19T18:59:35.596435] [DEBUG] [LOCAL ] GCO: Trimmed 36092 records to 26266 (keeping 200 days of data) [2025-09-19T18:59:35.610223] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T18:59:35.746285] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-19T18:59:35.807353] [DEBUG] [LOCAL ] GCO: Primary data saved (26266 records). [2025-09-19T18:59:35.807489] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-19T18:59:35.807612] [INFO ] [MAIN ] Update Progress: 902/2372 symbols completed. GCO took 41.5s. Estimated remaining: 3h 14m 48s. Rate: 7.5 symbols/min [2025-09-19T18:59:35.848313] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-19T18:59:36.027277] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:36.032451] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T18:59:36.047503] [DEBUG] [LOCAL ] GDIV: Loaded 3803 existing records from primary storage. [2025-09-19T18:59:36.047628] [INFO ] [MAIN ] GDIV: Loaded 3803 existing records. [2025-09-19T18:59:36.235836] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:36.236110] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-19T18:59:36.236157] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-19T18:59:36.236519] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-19T18:59:36.236578] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-19T18:59:36.605937] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:36.643268] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-19T18:59:37.342770] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T18:59:37.344794] [INFO ] [REMOTE ] GCV: Full fetch complete (9274 records). [2025-09-19T18:59:37.344869] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-19T18:59:37.445332] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-19T18:59:37.707160] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-19T18:59:37.707273] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-19T18:59:37.707517] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-19T18:59:37.707592] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-19T18:59:37.708330] [DEBUG] [LOCAL ] GCV: Trimmed 9274 records to 7140 (keeping 200 days of data) [2025-09-19T18:59:37.754291] [DEBUG] [LOCAL ] GCV: Primary data saved (7140 records). [2025-09-19T18:59:37.754478] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-19T18:59:37.754602] [INFO ] [MAIN ] Update Progress: 903/2372 symbols completed. GCV took 19.6s. Estimated remaining: 3h 14m 30s. Rate: 7.6 symbols/min [2025-09-19T18:59:37.924870] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:37.925121] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-19T18:59:37.925194] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-19T18:59:37.925381] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-19T18:59:37.925434] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-19T18:59:37.925478] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-19T18:59:37.925510] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-19T18:59:38.107956] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T18:59:38.250179] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-19T18:59:38.332885] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:39.043222] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-19T18:59:39.156935] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T18:59:39.186689] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T18:59:39.843283] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-19T18:59:40.505273] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T18:59:40.643254] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-19T18:59:40.967842] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T18:59:41.301167] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T18:59:41.443304] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-19T18:59:41.966115] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T18:59:42.243266] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-19T18:59:42.999799] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T18:59:43.043222] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-19T18:59:43.843284] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-19T18:59:44.500141] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T18:59:44.643305] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-19T18:59:44.857405] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T18:59:45.181431] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T18:59:45.443294] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-19T18:59:46.243298] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-19T18:59:46.817812] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T18:59:47.043311] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-19T18:59:47.426636] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T18:59:47.843276] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-19T18:59:48.643383] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-19T18:59:48.951134] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-19T18:59:49.107917] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T18:59:49.340321] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T18:59:49.443222] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-19T18:59:50.243272] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-19T18:59:51.043301] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-19T18:59:51.366913] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T18:59:51.379148] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T18:59:51.843291] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-19T18:59:52.643278] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-19T18:59:52.791632] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T18:59:53.285748] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T18:59:53.329560] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T18:59:53.336283] [INFO ] [REMOTE ] GD: Full fetch complete (70556 records). [2025-09-19T18:59:53.336427] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-19T18:59:53.448425] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-19T18:59:53.745526] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-19T18:59:53.745760] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-19T18:59:53.746810] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-19T18:59:53.746882] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-19T18:59:53.752289] [DEBUG] [LOCAL ] GD: Trimmed 70556 records to 48133 (keeping 200 days of data) [2025-09-19T18:59:54.069998] [DEBUG] [LOCAL ] GD: Primary data saved (48133 records). [2025-09-19T18:59:54.070142] [INFO ] [MAIN ] GD: Full history saved. [2025-09-19T18:59:54.070254] [INFO ] [MAIN ] Update Progress: 904/2372 symbols completed. GD took 34.4s. Estimated remaining: 3h 14m 36s. Rate: 7.5 symbols/min [2025-09-19T18:59:54.249933] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:54.248078] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-19T18:59:54.262513] [DEBUG] [LOCAL ] GDO: Loaded 6087 existing records from primary storage. [2025-09-19T18:59:54.262635] [INFO ] [MAIN ] GDO: Loaded 6087 existing records. [2025-09-19T18:59:54.378235] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T18:59:54.452601] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:54.452890] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-19T18:59:54.452941] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-19T18:59:54.453578] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-19T18:59:54.453693] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-19T18:59:54.754307] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T18:59:54.823525] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:55.043266] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-19T18:59:55.762899] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T18:59:55.843235] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-19T18:59:56.643275] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-19T18:59:57.319082] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T18:59:57.443279] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-19T18:59:57.774955] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T18:59:57.929455] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T18:59:57.930612] [INFO ] [REMOTE ] GDL: Full fetch complete (3566 records). [2025-09-19T18:59:57.930708] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-19T18:59:58.139519] [WARN ] [VALIDATOR ] GDL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T18:59:58.139867] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T18:59:58.139969] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T18:59:58.140065] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-19T18:59:58.140194] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-19T18:59:58.140278] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-19T18:59:58.140370] [DEBUG] [LOCAL ] GDL: No derivative data file found to delete. [2025-09-19T18:59:58.140503] [INFO ] [MAIN ] Update Progress: 905/2372 symbols completed. GDL took 20.4s. Estimated remaining: 3h 14m 21s. Rate: 7.5 symbols/min [2025-09-19T18:59:58.245525] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-19T18:59:58.316436] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T18:59:58.370524] [DEBUG] [LOCAL ] GDOT: Loaded 38970 existing records from primary storage. [2025-09-19T18:59:58.370718] [INFO ] [MAIN ] GDOT: Loaded 38970 existing records. [2025-09-19T18:59:58.554061] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T18:59:58.554311] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-19T18:59:58.554393] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-19T18:59:58.555566] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-19T18:59:58.555630] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-19T18:59:58.921790] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T18:59:59.043258] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-19T18:59:59.843225] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-19T19:00:00.272846] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T19:00:00.512247] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T19:00:00.643260] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-19T19:00:00.825001] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T19:00:01.443271] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-19T19:00:02.243269] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-19T19:00:03.013843] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:00:03.039481] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-19T19:00:03.046851] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-19T19:00:03.048325] [INFO ] [REMOTE ] GDDY: Full fetch complete (71251 records). [2025-09-19T19:00:03.048439] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-19T19:00:03.472300] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-19T19:00:03.472394] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-19T19:00:03.473370] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-19T19:00:03.473447] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-19T19:00:03.474961] [DEBUG] [LOCAL ] GDDY: Trimmed 71251 records to 50573 (keeping 200 days of data) [2025-09-19T19:00:03.784878] [DEBUG] [LOCAL ] GDDY: Primary data saved (50573 records). [2025-09-19T19:00:03.785048] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-19T19:00:03.785164] [INFO ] [MAIN ] Update Progress: 906/2372 symbols completed. GDDY took 40.3s. Estimated remaining: 3h 14m 10s. Rate: 7.6 symbols/min [2025-09-19T19:00:03.851907] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-19T19:00:03.964080] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:03.984270] [DEBUG] [LOCAL ] GDV: Loaded 20129 existing records from primary storage. [2025-09-19T19:00:03.984411] [INFO ] [MAIN ] GDV: Loaded 20129 existing records. [2025-09-19T19:00:04.167896] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:04.168183] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-19T19:00:04.168234] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-19T19:00:04.169039] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-19T19:00:04.169101] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-19T19:00:04.538556] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:04.643330] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-19T19:00:04.919878] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-19T19:00:05.325508] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-19T19:00:05.443357] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-19T19:00:06.147327] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:00:06.243310] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-19T19:00:06.474708] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-19T19:00:07.036512] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T19:00:07.043205] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-19T19:00:07.843268] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-19T19:00:07.866824] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:00:08.436844] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T19:00:08.643235] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-19T19:00:08.789340] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T19:00:09.443256] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-19T19:00:09.851776] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T19:00:10.086444] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T19:00:10.243261] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-19T19:00:11.043223] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-19T19:00:11.555945] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T19:00:11.587887] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T19:00:11.843250] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-19T19:00:12.567526] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T19:00:12.643333] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-19T19:00:13.314118] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T19:00:13.443316] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-19T19:00:14.243272] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-19T19:00:15.043299] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-19T19:00:15.178249] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T19:00:15.843278] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-19T19:00:16.071675] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:00:16.642903] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T19:00:16.644519] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-19T19:00:17.196392] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-19T19:00:17.197963] [INFO ] [REMOTE ] GDIV: Full fetch complete (5430 records). [2025-09-19T19:00:17.198061] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-19T19:00:17.443343] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-19T19:00:17.581985] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-19T19:00:17.582075] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-19T19:00:17.582248] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-19T19:00:17.582288] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-19T19:00:17.582750] [DEBUG] [LOCAL ] GDIV: Trimmed 5430 records to 3814 (keeping 200 days of data) [2025-09-19T19:00:17.607447] [DEBUG] [LOCAL ] GDIV: Primary data saved (3814 records). [2025-09-19T19:00:17.607611] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-19T19:00:17.607737] [INFO ] [MAIN ] Update Progress: 907/2372 symbols completed. GDIV took 41.8s. Estimated remaining: 3h 14m 11s. Rate: 7.5 symbols/min [2025-09-19T19:00:17.789734] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:17.850108] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-09-19T19:00:17.850255] [INFO ] [MAIN ] GE: Loaded 54103 existing records. [2025-09-19T19:00:18.052152] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:18.052626] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-19T19:00:18.052814] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-19T19:00:18.061135] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-19T19:00:18.075502] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-19T19:00:18.139784] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T19:00:18.245752] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-19T19:00:18.477270] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:18.674957] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T19:00:19.019373] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T19:00:19.043214] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-19T19:00:19.843280] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-19T19:00:19.925351] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:00:19.927031] [INFO ] [REMOTE ] GDO: Full fetch complete (9537 records). [2025-09-19T19:00:19.927104] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-19T19:00:20.308384] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-19T19:00:20.308491] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-19T19:00:20.308770] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-19T19:00:20.308833] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-19T19:00:20.309318] [DEBUG] [LOCAL ] GDO: Trimmed 9537 records to 6116 (keeping 200 days of data) [2025-09-19T19:00:20.346668] [DEBUG] [LOCAL ] GDO: Primary data saved (6116 records). [2025-09-19T19:00:20.346795] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-19T19:00:20.346882] [INFO ] [MAIN ] Update Progress: 908/2372 symbols completed. GDO took 26.3s. Estimated remaining: 3h 13m 55s. Rate: 7.5 symbols/min [2025-09-19T19:00:20.522865] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:20.544217] [DEBUG] [LOCAL ] GEF: Loaded 20905 existing records from primary storage. [2025-09-19T19:00:20.544351] [INFO ] [MAIN ] GEF: Loaded 20905 existing records. [2025-09-19T19:00:20.645726] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-19T19:00:20.725197] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:20.725460] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-19T19:00:20.725508] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-19T19:00:20.726153] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-19T19:00:20.726214] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-19T19:00:21.046944] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T19:00:21.116910] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:21.443278] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-19T19:00:21.943276] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T19:00:22.190938] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:00:22.243307] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-19T19:00:23.043284] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-19T19:00:23.657837] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T19:00:23.843279] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-19T19:00:23.937073] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T19:00:24.643242] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-19T19:00:24.834968] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T19:00:25.443278] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-19T19:00:26.224585] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T19:00:26.227412] [INFO ] [REMOTE ] GDV: Full fetch complete (28833 records). [2025-09-19T19:00:26.227495] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-19T19:00:26.249160] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-19T19:00:26.612806] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-19T19:00:26.612938] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-19T19:00:26.613525] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-19T19:00:26.613568] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-19T19:00:26.614300] [DEBUG] [LOCAL ] GDV: Trimmed 28833 records to 20234 (keeping 200 days of data) [2025-09-19T19:00:26.736689] [DEBUG] [LOCAL ] GDV: Primary data saved (20234 records). [2025-09-19T19:00:26.736892] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-19T19:00:26.737019] [INFO ] [MAIN ] Update Progress: 909/2372 symbols completed. GDV took 23.0s. Estimated remaining: 3h 13m 44s. Rate: 7.6 symbols/min [2025-09-19T19:00:26.903917] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:26.939347] [DEBUG] [LOCAL ] GEL: Loaded 34789 existing records from primary storage. [2025-09-19T19:00:26.939516] [INFO ] [MAIN ] GEL: Loaded 34789 existing records. [2025-09-19T19:00:27.043403] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-19T19:00:27.123028] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:27.123374] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-19T19:00:27.123457] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-19T19:00:27.124452] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-19T19:00:27.124560] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-19T19:00:27.266601] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-19T19:00:27.556856] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:27.748633] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T19:00:27.843261] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-19T19:00:28.310955] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T19:00:28.643244] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-19T19:00:29.159857] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T19:00:29.443279] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-19T19:00:30.243248] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-19T19:00:30.701105] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T19:00:30.911079] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T19:00:31.043234] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-19T19:00:31.236855] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T19:00:31.843302] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-19T19:00:32.282436] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T19:00:32.643317] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-19T19:00:33.040141] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T19:00:33.443301] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-19T19:00:34.243246] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-19T19:00:34.513856] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T19:00:35.006142] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T19:00:35.043231] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-19T19:00:35.848324] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-19T19:00:35.859737] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:00:36.643273] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-19T19:00:36.785448] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:00:36.791468] [INFO ] [REMOTE ] GDOT: Full fetch complete (52329 records). [2025-09-19T19:00:36.791582] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-19T19:00:37.184475] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-19T19:00:37.184570] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-19T19:00:37.185363] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-19T19:00:37.185428] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-19T19:00:37.187476] [DEBUG] [LOCAL ] GDOT: Trimmed 52329 records to 39273 (keeping 200 days of data) [2025-09-19T19:00:37.434731] [DEBUG] [LOCAL ] GDOT: Primary data saved (39273 records). [2025-09-19T19:00:37.435002] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-19T19:00:37.435934] [INFO ] [MAIN ] Update Progress: 910/2372 symbols completed. GDOT took 39.3s. Estimated remaining: 3h 13m 41s. Rate: 7.5 symbols/min [2025-09-19T19:00:37.449200] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-19T19:00:37.464941] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:00:37.634901] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:37.694483] [DEBUG] [LOCAL ] GENI: Loaded 53304 existing records from primary storage. [2025-09-19T19:00:37.694687] [INFO ] [MAIN ] GENI: Loaded 53304 existing records. [2025-09-19T19:00:37.872988] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:37.873287] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-19T19:00:37.873337] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-19T19:00:37.874532] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-19T19:00:37.874604] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-19T19:00:38.251083] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-19T19:00:38.282254] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:38.548293] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T19:00:39.015585] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T19:00:39.043223] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-19T19:00:39.843239] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-19T19:00:39.888179] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T19:00:40.207985] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T19:00:40.643281] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-19T19:00:41.217903] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T19:00:41.443288] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-19T19:00:41.811125] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T19:00:42.243314] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-19T19:00:43.043471] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-19T19:00:43.501129] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T19:00:43.529282] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T19:00:43.843280] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-19T19:00:44.137182] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T19:00:44.643275] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-19T19:00:45.443273] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-19T19:00:46.248890] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-19T19:00:46.263275] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-19T19:00:46.298473] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T19:00:47.005485] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T19:00:47.043259] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-19T19:00:47.535540] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T19:00:47.843286] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-19T19:00:48.423246] [DEBUG] [REMOTE ] GE: Error fetching primary data for 2025-07: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-19T19:00:48.423421] [WARN ] [REMOTE ] GE: No data returned for month 2025-07 [2025-09-19T19:00:48.643296] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-19T19:00:48.723763] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T19:00:49.443322] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-19T19:00:50.243290] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-19T19:00:50.634753] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:00:50.698132] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T19:00:50.702199] [INFO ] [REMOTE ] GEF: Full fetch complete (29406 records). [2025-09-19T19:00:50.702304] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-19T19:00:51.046133] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-19T19:00:51.086103] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-19T19:00:51.086193] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-19T19:00:51.086903] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-19T19:00:51.086968] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-19T19:00:51.088208] [DEBUG] [LOCAL ] GEF: Trimmed 29406 records to 21067 (keeping 200 days of data) [2025-09-19T19:00:51.219140] [DEBUG] [LOCAL ] GEF: Primary data saved (21067 records). [2025-09-19T19:00:51.219270] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-19T19:00:51.219370] [INFO ] [MAIN ] Update Progress: 911/2372 symbols completed. GEF took 30.9s. Estimated remaining: 3h 13m 42s. Rate: 7.5 symbols/min [2025-09-19T19:00:51.389328] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:51.446952] [DEBUG] [LOCAL ] GEO: Loaded 52604 existing records from primary storage. [2025-09-19T19:00:51.447097] [INFO ] [MAIN ] GEO: Loaded 52604 existing records. [2025-09-19T19:00:51.627317] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:51.627933] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-19T19:00:51.628041] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-19T19:00:51.634377] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-19T19:00:51.634468] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-19T19:00:51.711424] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T19:00:51.755101] [INFO ] [REMOTE ] GEL: Full fetch complete (48661 records). [2025-09-19T19:00:51.755770] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-19T19:00:51.850017] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-19T19:00:52.243579] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:52.435130] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-19T19:00:52.435222] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-19T19:00:52.435993] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-19T19:00:52.436057] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-19T19:00:52.437166] [DEBUG] [LOCAL ] GEL: Trimmed 48661 records to 34950 (keeping 200 days of data) [2025-09-19T19:00:52.648690] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-19T19:00:52.662248] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:00:52.688629] [DEBUG] [LOCAL ] GEL: Primary data saved (34950 records). [2025-09-19T19:00:52.688823] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-19T19:00:52.688951] [INFO ] [MAIN ] Update Progress: 912/2372 symbols completed. GEL took 26.0s. Estimated remaining: 3h 13m 24s. Rate: 7.5 symbols/min [2025-09-19T19:00:52.860142] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:00:52.900936] [DEBUG] [LOCAL ] GES: Loaded 40812 existing records from primary storage. [2025-09-19T19:00:52.901110] [INFO ] [MAIN ] GES: Loaded 40812 existing records. [2025-09-19T19:00:53.079999] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:00:53.080282] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-19T19:00:53.080338] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-19T19:00:53.081322] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-19T19:00:53.081389] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-19T19:00:53.448367] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-19T19:00:53.454317] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:00:54.258607] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-19T19:00:54.261578] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T19:00:54.658900] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:00:55.043305] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-19T19:00:55.474321] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T19:00:55.843282] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-19T19:00:56.475802] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T19:00:56.643275] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-19T19:00:56.709588] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:00:57.443288] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-19T19:00:57.877930] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T19:00:58.243277] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-19T19:00:58.601139] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T19:00:59.043336] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-19T19:00:59.783338] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T19:00:59.791861] [INFO ] [REMOTE ] GE: Full fetch complete (69277 records). [2025-09-19T19:00:59.792039] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-19T19:00:59.867186] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-19T19:01:00.003323] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:01:00.036142] [WARN ] [VALIDATOR ] GE: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T19:01:00.037750] [FATAL] [MAIN ] GE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:01:00.038211] [WARN ] [MAIN ] GE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:01:00.038309] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-19T19:01:00.038415] [DEBUG] [LOCAL ] GE: No primary data file found to delete. [2025-09-19T19:01:00.038473] [INFO ] [LOCAL ] GE: Starting deletion of derivative data. [2025-09-19T19:01:00.038992] [DEBUG] [LOCAL ] GE: Deleted derivative data file. [2025-09-19T19:01:00.039106] [INFO ] [MAIN ] Update Progress: 913/2372 symbols completed. GE took 42.4s. Estimated remaining: 3h 13m 15s. Rate: 7.5 symbols/min [2025-09-19T19:01:00.224827] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:00.262369] [DEBUG] [LOCAL ] GETY: Loaded 36644 existing records from primary storage. [2025-09-19T19:01:00.262536] [INFO ] [MAIN ] GETY: Loaded 36644 existing records. [2025-09-19T19:01:00.439812] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:00.440115] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-19T19:01:00.440170] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-19T19:01:00.441042] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-19T19:01:00.441111] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-19T19:01:00.648817] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-19T19:01:00.809035] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:00.837567] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:01:01.443277] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-19T19:01:02.243342] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-19T19:01:02.368984] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-19T19:01:03.038969] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T19:01:03.047504] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-19T19:01:03.335630] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T19:01:03.602436] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T19:01:03.843276] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-19T19:01:04.643265] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-19T19:01:04.958804] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T19:01:05.437012] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:01:05.446361] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-19T19:01:06.121010] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T19:01:06.243259] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-19T19:01:07.043246] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-19T19:01:07.117298] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T19:01:07.843288] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-19T19:01:08.057911] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:01:08.643263] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-19T19:01:09.160493] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:01:09.443237] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-19T19:01:09.515975] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T19:01:10.060375] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T19:01:10.243258] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-19T19:01:10.947274] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T19:01:11.043334] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-19T19:01:11.843286] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-19T19:01:12.147181] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:01:12.625361] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T19:01:12.643218] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-19T19:01:13.443322] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-19T19:01:13.507854] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:01:14.243299] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-19T19:01:14.577726] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T19:01:14.625987] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:01:15.043293] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-19T19:01:15.784966] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:01:15.792900] [INFO ] [REMOTE ] GENI: Full fetch complete (75425 records). [2025-09-19T19:01:15.793043] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-19T19:01:15.852097] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-19T19:01:16.210745] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-19T19:01:16.210855] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-19T19:01:16.211897] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-19T19:01:16.211970] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-19T19:01:16.213581] [DEBUG] [LOCAL ] GENI: Trimmed 75425 records to 53692 (keeping 200 days of data) [2025-09-19T19:01:16.578344] [DEBUG] [LOCAL ] GENI: Primary data saved (53692 records). [2025-09-19T19:01:16.578559] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-19T19:01:16.578725] [INFO ] [MAIN ] Update Progress: 914/2372 symbols completed. GENI took 39.1s. Estimated remaining: 3h 13m 21s. Rate: 7.5 symbols/min [2025-09-19T19:01:16.654562] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-19T19:01:16.842985] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:16.929770] [DEBUG] [LOCAL ] GEV: Loaded 53548 existing records from primary storage. [2025-09-19T19:01:16.930029] [INFO ] [MAIN ] GEV: Loaded 53548 existing records. [2025-09-19T19:01:17.239296] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:17.253238] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-19T19:01:17.278848] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-19T19:01:17.282603] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-19T19:01:17.282477] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T19:01:17.286845] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-19T19:01:17.448417] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-19T19:01:17.800508] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:17.824391] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T19:01:18.243302] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-19T19:01:18.341031] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:01:19.043288] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-19T19:01:19.564591] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T19:01:19.576087] [INFO ] [REMOTE ] GEO: Full fetch complete (75636 records). [2025-09-19T19:01:19.576468] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-19T19:01:19.854537] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-19T19:01:20.046427] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-19T19:01:20.046662] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-19T19:01:20.048067] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-19T19:01:20.048166] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-19T19:01:20.074818] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:01:20.083752] [DEBUG] [LOCAL ] GEO: Trimmed 75636 records to 52962 (keeping 200 days of data) [2025-09-19T19:01:20.335829] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T19:01:20.446891] [DEBUG] [LOCAL ] GEO: Primary data saved (52962 records). [2025-09-19T19:01:20.447043] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-19T19:01:20.447161] [INFO ] [MAIN ] Update Progress: 915/2372 symbols completed. GEO took 29.2s. Estimated remaining: 3h 13m 6s. Rate: 7.5 symbols/min [2025-09-19T19:01:20.625111] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:20.630827] [DEBUG] [LOCAL ] GF: Loaded 3516 existing records from primary storage. [2025-09-19T19:01:20.630919] [INFO ] [MAIN ] GF: Loaded 3516 existing records. [2025-09-19T19:01:20.652387] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-19T19:01:20.823513] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:20.823799] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-19T19:01:20.823864] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-19T19:01:20.824140] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-19T19:01:20.824201] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-19T19:01:21.202997] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:21.443297] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-19T19:01:21.892966] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T19:01:21.941547] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T19:01:22.243298] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-19T19:01:22.492220] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:01:22.499579] [INFO ] [REMOTE ] GES: Full fetch complete (60260 records). [2025-09-19T19:01:22.499762] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-19T19:01:22.789009] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T19:01:22.917140] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-19T19:01:22.917239] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-19T19:01:22.918234] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-19T19:01:22.918302] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-19T19:01:22.919683] [DEBUG] [LOCAL ] GES: Trimmed 60260 records to 41008 (keeping 200 days of data) [2025-09-19T19:01:23.043499] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-19T19:01:23.189496] [DEBUG] [LOCAL ] GES: Primary data saved (41008 records). [2025-09-19T19:01:23.189662] [INFO ] [MAIN ] GES: Full history saved. [2025-09-19T19:01:23.189792] [INFO ] [MAIN ] Update Progress: 916/2372 symbols completed. GES took 30.5s. Estimated remaining: 3h 12m 50s. Rate: 7.6 symbols/min [2025-09-19T19:01:23.366925] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:23.402791] [DEBUG] [LOCAL ] GFF: Loaded 31421 existing records from primary storage. [2025-09-19T19:01:23.402970] [INFO ] [MAIN ] GFF: Loaded 31421 existing records. [2025-09-19T19:01:23.584371] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:23.584695] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-19T19:01:23.584758] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-19T19:01:23.585544] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-19T19:01:23.585602] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-19T19:01:23.850568] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-19T19:01:23.965537] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:24.546610] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T19:01:24.643300] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-19T19:01:25.202333] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T19:01:25.257555] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T19:01:25.443259] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-19T19:01:26.243298] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-19T19:01:27.043231] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-19T19:01:27.278990] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T19:01:27.704619] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T19:01:27.747142] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-19T19:01:27.843347] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-19T19:01:28.643296] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-19T19:01:29.329729] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T19:01:29.443269] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-19T19:01:30.243325] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-19T19:01:30.272731] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:01:31.018741] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T19:01:31.043239] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-19T19:01:31.843270] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-19T19:01:32.152718] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T19:01:32.297937] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T19:01:32.643318] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-19T19:01:32.836475] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T19:01:33.443341] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-19T19:01:34.243279] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-19T19:01:34.544233] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T19:01:34.910100] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T19:01:34.917883] [INFO ] [REMOTE ] GETY: Full fetch complete (55835 records). [2025-09-19T19:01:34.918005] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-19T19:01:35.035617] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T19:01:35.048079] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-19T19:01:35.352364] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-19T19:01:35.352485] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-19T19:01:35.353491] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-19T19:01:35.353579] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-19T19:01:35.355164] [DEBUG] [LOCAL ] GETY: Trimmed 55835 records to 36842 (keeping 200 days of data) [2025-09-19T19:01:35.583864] [DEBUG] [LOCAL ] GETY: Primary data saved (36842 records). [2025-09-19T19:01:35.584013] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-19T19:01:35.584153] [INFO ] [MAIN ] Update Progress: 917/2372 symbols completed. GETY took 35.5s. Estimated remaining: 3h 12m 49s. Rate: 7.5 symbols/min [2025-09-19T19:01:35.843274] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-19T19:01:36.516561] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T19:01:36.643327] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-19T19:01:36.735869] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:01:37.443291] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-19T19:01:38.004270] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T19:01:38.244184] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-19T19:01:38.248375] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T19:01:38.858307] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T19:01:39.043317] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-19T19:01:39.843282] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-19T19:01:40.269738] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-19T19:01:40.271142] [INFO ] [REMOTE ] GF: Full fetch complete (5403 records). [2025-09-19T19:01:40.271218] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-19T19:01:40.652070] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-19T19:01:40.658727] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-19T19:01:40.652178] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-19T19:01:40.662240] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-19T19:01:40.663109] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-19T19:01:40.666608] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T19:01:40.666901] [DEBUG] [LOCAL ] GF: Trimmed 5403 records to 3524 (keeping 200 days of data) [2025-09-19T19:01:40.710401] [DEBUG] [LOCAL ] GF: Primary data saved (3524 records). [2025-09-19T19:01:40.710617] [INFO ] [MAIN ] GF: Full history saved. [2025-09-19T19:01:40.710800] [INFO ] [MAIN ] Update Progress: 918/2372 symbols completed. GF took 20.3s. Estimated remaining: 3h 12m 37s. Rate: 7.5 symbols/min [2025-09-19T19:01:41.443308] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-19T19:01:42.843731] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T19:01:42.850176] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-19T19:01:42.978528] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T19:01:43.043247] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-19T19:01:43.968453] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T19:01:43.977498] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-19T19:01:45.157613] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T19:01:45.171307] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-19T19:01:45.562685] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:01:45.568385] [INFO ] [REMOTE ] GFF: Full fetch complete (44343 records). [2025-09-19T19:01:45.568557] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-19T19:01:45.955564] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-19T19:01:45.955675] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-19T19:01:45.956411] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-19T19:01:45.956504] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-19T19:01:45.957791] [DEBUG] [LOCAL ] GFF: Trimmed 44343 records to 31628 (keeping 200 days of data) [2025-09-19T19:01:46.162382] [DEBUG] [LOCAL ] GFF: Primary data saved (31628 records). [2025-09-19T19:01:46.162524] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-19T19:01:46.162681] [INFO ] [MAIN ] Update Progress: 919/2372 symbols completed. GFF took 23.0s. Estimated remaining: 3h 12m 25s. Rate: 7.6 symbols/min [2025-09-19T19:01:47.554178] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T19:01:47.566169] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-19T19:01:50.184997] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-19T19:01:50.196292] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-19T19:01:52.365066] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T19:01:52.372985] [INFO ] [REMOTE ] GEV: Full fetch complete (76994 records). [2025-09-19T19:01:52.373187] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-19T19:01:52.777368] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-19T19:01:52.777465] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-19T19:01:52.778466] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-19T19:01:52.778533] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-19T19:01:52.781542] [DEBUG] [LOCAL ] GEV: Trimmed 76994 records to 53932 (keeping 200 days of data) [2025-09-19T19:01:53.134502] [DEBUG] [LOCAL ] GEV: Primary data saved (53932 records). [2025-09-19T19:01:53.134667] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-19T19:01:53.135611] [INFO ] [MAIN ] Update Progress: 920/2372 symbols completed. GEV took 36.6s. Estimated remaining: 3h 12m 15s. Rate: 7.6 symbols/min [2025-09-19T19:01:53.773719] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:53.890138] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:53.945311] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:53.994905] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:01:54.019627] [DEBUG] [LOCAL ] GFR: Loaded 8593 existing records from primary storage. [2025-09-19T19:01:54.019820] [INFO ] [MAIN ] GFR: Loaded 8593 existing records. [2025-09-19T19:01:54.302694] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:54.304143] [DEBUG] [LOCAL ] GFI: Loaded 53483 existing records from primary storage. [2025-09-19T19:01:54.305368] [DEBUG] [LOCAL ] GFL: Loaded 48534 existing records from primary storage. [2025-09-19T19:01:54.306067] [INFO ] [MAIN ] GFI: Loaded 53483 existing records. [2025-09-19T19:01:54.305998] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-19T19:01:54.305926] [INFO ] [MAIN ] GFL: Loaded 48534 existing records. [2025-09-19T19:01:54.311412] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-19T19:01:54.442318] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-19T19:01:54.481873] [DEBUG] [LOCAL ] GGB: Loaded 51382 existing records from primary storage. [2025-09-19T19:01:54.481081] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-19T19:01:54.523702] [INFO ] [MAIN ] GGB: Loaded 51382 existing records. [2025-09-19T19:01:54.799877] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:54.951164] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-19T19:01:54.963335] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-19T19:01:54.963222] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:55.017107] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-19T19:01:55.094905] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-19T19:01:55.081451] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-19T19:01:55.136281] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:01:55.133105] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-19T19:01:55.150620] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-19T19:01:55.156179] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-19T19:01:55.184928] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-19T19:01:55.204113] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-19T19:01:55.305978] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-19T19:01:55.329965] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-19T19:01:55.825131] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:55.907448] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-19T19:01:56.312346] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:56.368438] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:56.376633] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-19T19:01:56.380511] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-19T19:01:56.464032] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:01:56.464301] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-19T19:01:57.143919] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:01:57.147324] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-19T19:01:57.573947] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T19:01:57.582872] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-19T19:01:58.022408] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T19:01:58.033937] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-19T19:01:58.058375] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T19:01:58.061041] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-19T19:01:58.589722] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T19:01:58.599971] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-19T19:01:58.740208] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-19T19:01:58.742585] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-19T19:01:59.046994] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T19:01:59.058206] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-19T19:01:59.310108] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T19:01:59.313527] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-19T19:01:59.945224] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:01:59.955922] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-19T19:02:00.077993] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T19:02:00.081522] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-19T19:02:00.230137] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T19:02:00.239856] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-19T19:02:00.721455] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T19:02:00.731892] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-19T19:02:01.278880] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T19:02:01.281832] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-19T19:02:02.109043] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T19:02:02.120312] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-19T19:02:02.743149] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-19T19:02:02.754003] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-19T19:02:03.055864] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:02:03.058024] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-19T19:02:03.722053] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (2.99 seconds). [2025-09-19T19:02:03.738821] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-19T19:02:03.801207] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T19:02:03.831726] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T19:02:03.843203] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-19T19:02:04.136618] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T19:02:04.643278] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-19T19:02:05.328082] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T19:02:05.443270] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-19T19:02:05.944795] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T19:02:06.243300] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-19T19:02:06.620034] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T19:02:07.043262] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-19T19:02:07.529509] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T19:02:07.843233] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-19T19:02:08.213850] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:02:08.643264] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-19T19:02:08.863991] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T19:02:09.101888] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T19:02:09.443295] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-19T19:02:10.243295] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-19T19:02:10.644542] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T19:02:10.789128] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T19:02:11.043374] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-19T19:02:11.843357] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-19T19:02:12.272430] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:02:12.319397] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T19:02:12.643301] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-19T19:02:13.172919] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T19:02:13.443310] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-19T19:02:13.568575] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T19:02:13.570088] [INFO ] [REMOTE ] GFR: Full fetch complete (13070 records). [2025-09-19T19:02:13.570160] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-19T19:02:13.925624] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-19T19:02:13.925730] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-19T19:02:13.925984] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-19T19:02:13.926022] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-19T19:02:13.926478] [DEBUG] [LOCAL ] GFR: Trimmed 13070 records to 8622 (keeping 200 days of data) [2025-09-19T19:02:13.975127] [DEBUG] [LOCAL ] GFR: Primary data saved (8622 records). [2025-09-19T19:02:13.975229] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-19T19:02:13.975320] [INFO ] [MAIN ] Update Progress: 921/2372 symbols completed. GFR took 20.8s. Estimated remaining: 3h 12m 28s. Rate: 7.5 symbols/min [2025-09-19T19:02:14.146700] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:14.192944] [DEBUG] [LOCAL ] GGG: Loaded 41430 existing records from primary storage. [2025-09-19T19:02:14.193104] [INFO ] [MAIN ] GGG: Loaded 41430 existing records. [2025-09-19T19:02:14.255422] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-19T19:02:14.372863] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:14.373089] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-19T19:02:14.373137] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-19T19:02:14.374151] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-19T19:02:14.374212] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-19T19:02:14.724660] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:15.053192] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-19T19:02:15.059895] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T19:02:15.843298] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-19T19:02:16.569165] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T19:02:16.643293] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-19T19:02:16.884874] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:02:17.003349] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T19:02:17.443298] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-19T19:02:18.243272] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-19T19:02:18.449857] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:02:19.043231] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-19T19:02:19.165835] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T19:02:19.843274] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-19T19:02:20.086603] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:02:20.094794] [INFO ] [REMOTE ] GFL: Full fetch complete (68663 records). [2025-09-19T19:02:20.094977] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-19T19:02:20.512853] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-19T19:02:20.512970] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-19T19:02:20.513962] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-19T19:02:20.514041] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-19T19:02:20.515709] [DEBUG] [LOCAL ] GFL: Trimmed 68663 records to 48895 (keeping 200 days of data) [2025-09-19T19:02:20.644159] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-19T19:02:20.839693] [DEBUG] [LOCAL ] GFL: Primary data saved (48895 records). [2025-09-19T19:02:20.839882] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-19T19:02:20.839999] [INFO ] [MAIN ] Update Progress: 922/2372 symbols completed. GFL took 27.7s. Estimated remaining: 3h 12m 18s. Rate: 7.5 symbols/min [2025-09-19T19:02:21.023003] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:21.038385] [DEBUG] [LOCAL ] GGT: Loaded 14214 existing records from primary storage. [2025-09-19T19:02:21.038515] [INFO ] [MAIN ] GGT: Loaded 14214 existing records. [2025-09-19T19:02:21.227743] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:21.228163] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-19T19:02:21.228404] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-19T19:02:21.228880] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-19T19:02:21.228954] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-19T19:02:21.385093] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T19:02:21.444697] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-19T19:02:21.648573] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:22.243322] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-19T19:02:23.304995] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T19:02:23.308607] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-19T19:02:23.479748] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (4.44 seconds). [2025-09-19T19:02:23.487640] [INFO ] [REMOTE ] GFI: Full fetch complete (76233 records). [2025-09-19T19:02:23.487844] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-19T19:02:23.878889] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-19T19:02:23.878992] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-19T19:02:23.879979] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-19T19:02:23.880048] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-19T19:02:23.881636] [DEBUG] [LOCAL ] GFI: Trimmed 76233 records to 53872 (keeping 200 days of data) [2025-09-19T19:02:23.978246] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:02:23.985165] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-19T19:02:24.235595] [DEBUG] [LOCAL ] GFI: Primary data saved (53872 records). [2025-09-19T19:02:24.235794] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-19T19:02:24.235912] [INFO ] [MAIN ] Update Progress: 923/2372 symbols completed. GFI took 31.1s. Estimated remaining: 3h 12m 3s. Rate: 7.5 symbols/min [2025-09-19T19:02:24.408508] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:24.413060] [DEBUG] [LOCAL ] GGZ: Loaded 2499 existing records from primary storage. [2025-09-19T19:02:24.413152] [INFO ] [MAIN ] GGZ: Loaded 2499 existing records. [2025-09-19T19:02:24.591728] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:24.592039] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-19T19:02:24.592114] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-19T19:02:24.592405] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-19T19:02:24.592466] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-19T19:02:24.985328] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:24.979971] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T19:02:24.987751] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-19T19:02:25.356751] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (4.71 seconds). [2025-09-19T19:02:25.364945] [INFO ] [REMOTE ] GGB: Full fetch complete (73956 records). [2025-09-19T19:02:25.365103] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-19T19:02:25.456429] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-19T19:02:25.687441] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T19:02:25.768312] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-19T19:02:25.768398] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-19T19:02:25.769356] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-19T19:02:25.769421] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-19T19:02:25.770853] [DEBUG] [LOCAL ] GGB: Trimmed 73956 records to 51759 (keeping 200 days of data) [2025-09-19T19:02:26.063789] [DEBUG] [LOCAL ] GGB: Primary data saved (51759 records). [2025-09-19T19:02:26.063939] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-19T19:02:26.064466] [INFO ] [MAIN ] Update Progress: 924/2372 symbols completed. GGB took 32.9s. Estimated remaining: 3h 11m 45s. Rate: 7.6 symbols/min [2025-09-19T19:02:26.235925] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:26.241414] [DEBUG] [LOCAL ] GHC: Loaded 2622 existing records from primary storage. [2025-09-19T19:02:26.241509] [INFO ] [MAIN ] GHC: Loaded 2622 existing records. [2025-09-19T19:02:26.272779] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-19T19:02:26.424625] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:26.425160] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-19T19:02:26.425319] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-19T19:02:26.425583] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-19T19:02:26.425668] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-19T19:02:26.593428] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T19:02:26.802069] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:27.043260] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-19T19:02:27.374449] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (5.93 seconds). [2025-09-19T19:02:27.541735] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T19:02:27.567807] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-19T19:02:27.843259] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-19T19:02:28.643234] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-19T19:02:29.055921] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T19:02:29.443262] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-19T19:02:29.983870] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T19:02:30.243296] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-19T19:02:30.486764] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:02:31.043284] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-19T19:02:31.419918] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T19:02:31.714266] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:02:31.843278] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-19T19:02:32.643318] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-19T19:02:32.980109] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:02:33.191565] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T19:02:33.443276] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-19T19:02:33.913331] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-19T19:02:34.243272] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-19T19:02:35.043313] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-19T19:02:35.631999] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T19:02:35.716089] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-19T19:02:35.843261] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-19T19:02:36.643283] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-19T19:02:36.719140] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-19T19:02:37.179349] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-19T19:02:37.443361] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-19T19:02:38.243273] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-19T19:02:38.764489] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-19T19:02:39.043291] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-19T19:02:39.193274] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T19:02:39.569361] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T19:02:39.843272] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-19T19:02:40.499160] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T19:02:40.643316] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-19T19:02:41.219170] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T19:02:41.443308] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-19T19:02:41.997755] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T19:02:42.243268] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-19T19:02:43.043303] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-19T19:02:43.794045] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T19:02:43.843222] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-19T19:02:44.158060] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T19:02:44.643263] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-19T19:02:45.238319] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T19:02:45.262225] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T19:02:45.263265] [INFO ] [REMOTE ] GGZ: Full fetch complete (4152 records). [2025-09-19T19:02:45.263361] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-19T19:02:45.451387] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-19T19:02:45.687835] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-19T19:02:45.688005] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-19T19:02:45.688184] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-19T19:02:45.688227] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-19T19:02:45.688708] [DEBUG] [LOCAL ] GGZ: Trimmed 4152 records to 2533 (keeping 200 days of data) [2025-09-19T19:02:45.705510] [DEBUG] [LOCAL ] GGZ: Primary data saved (2533 records). [2025-09-19T19:02:45.705622] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-19T19:02:45.705739] [INFO ] [MAIN ] Update Progress: 925/2372 symbols completed. GGZ took 21.5s. Estimated remaining: 3h 11m 56s. Rate: 7.5 symbols/min [2025-09-19T19:02:45.884917] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:45.892031] [DEBUG] [LOCAL ] GHG: Loaded 3161 existing records from primary storage. [2025-09-19T19:02:45.892192] [INFO ] [MAIN ] GHG: Loaded 3161 existing records. [2025-09-19T19:02:46.089751] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:46.090011] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-19T19:02:46.090068] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-19T19:02:46.090279] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-19T19:02:46.090339] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-19T19:02:46.245137] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-19T19:02:46.354429] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T19:02:46.460562] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:47.043281] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-19T19:02:47.566484] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:02:47.573638] [INFO ] [REMOTE ] GGT: Full fetch complete (18638 records). [2025-09-19T19:02:47.573533] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T19:02:47.573875] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-19T19:02:47.848372] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-19T19:02:47.957586] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-19T19:02:47.957744] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-19T19:02:47.958218] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-19T19:02:47.958260] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-19T19:02:47.958952] [DEBUG] [LOCAL ] GGT: Trimmed 18638 records to 14290 (keeping 200 days of data) [2025-09-19T19:02:48.051096] [DEBUG] [LOCAL ] GGT: Primary data saved (14290 records). [2025-09-19T19:02:48.051251] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-19T19:02:48.051340] [INFO ] [MAIN ] Update Progress: 926/2372 symbols completed. GGT took 27.2s. Estimated remaining: 3h 11m 39s. Rate: 7.5 symbols/min [2025-09-19T19:02:48.223139] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:48.232201] [DEBUG] [LOCAL ] GHI: Loaded 7029 existing records from primary storage. [2025-09-19T19:02:48.232319] [INFO ] [MAIN ] GHI: Loaded 7029 existing records. [2025-09-19T19:02:48.412613] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:48.412937] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-19T19:02:48.413008] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-19T19:02:48.413383] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-19T19:02:48.413441] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-19T19:02:48.523142] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T19:02:48.648368] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-19T19:02:48.794219] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:49.443275] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-19T19:02:49.965227] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:02:50.243264] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-19T19:02:50.617793] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T19:02:50.697018] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-19T19:02:51.043271] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-19T19:02:51.843263] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-19T19:02:52.314306] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-19T19:02:52.587486] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:02:52.593301] [INFO ] [REMOTE ] GGG: Full fetch complete (59324 records). [2025-09-19T19:02:52.593479] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-19T19:02:52.648531] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-19T19:02:52.982253] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-19T19:02:52.982333] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-19T19:02:52.983104] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-19T19:02:52.983177] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-19T19:02:52.984629] [DEBUG] [LOCAL ] GGG: Trimmed 59324 records to 41753 (keeping 200 days of data) [2025-09-19T19:02:53.234984] [DEBUG] [LOCAL ] GGG: Primary data saved (41753 records). [2025-09-19T19:02:53.235108] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-19T19:02:53.235219] [INFO ] [MAIN ] Update Progress: 927/2372 symbols completed. GGG took 39.3s. Estimated remaining: 3h 11m 27s. Rate: 7.5 symbols/min [2025-09-19T19:02:53.407869] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:02:53.414080] [DEBUG] [LOCAL ] GHLD: Loaded 4056 existing records from primary storage. [2025-09-19T19:02:53.414179] [INFO ] [MAIN ] GHLD: Loaded 4056 existing records. [2025-09-19T19:02:53.448485] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-19T19:02:53.596008] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:02:53.596262] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-19T19:02:53.596311] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-19T19:02:53.596696] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-19T19:02:53.596756] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-19T19:02:53.762741] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T19:02:53.995528] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:02:54.032023] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T19:02:54.243275] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-19T19:02:54.776667] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T19:02:55.043301] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-19T19:02:55.662122] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-19T19:02:55.843274] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-19T19:02:56.181023] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-19T19:02:56.643260] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-19T19:02:57.019789] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T19:02:57.443264] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-19T19:02:57.915609] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-19T19:02:58.243268] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-19T19:02:58.649117] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-19T19:02:59.043266] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-19T19:02:59.620118] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T19:02:59.843274] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-19T19:03:00.565484] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T19:03:00.643255] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-19T19:03:01.443261] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-19T19:03:01.453035] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-19T19:03:02.243276] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-19T19:03:02.971358] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T19:03:03.043262] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-19T19:03:03.843318] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-19T19:03:04.643267] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-19T19:03:04.710472] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T19:03:04.713962] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T19:03:04.718205] [INFO ] [REMOTE ] GHC: Full fetch complete (3230 records). [2025-09-19T19:03:04.718294] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-19T19:03:05.092833] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-19T19:03:05.092916] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-19T19:03:05.093025] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-19T19:03:05.093063] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-19T19:03:05.093463] [DEBUG] [LOCAL ] GHC: Trimmed 3230 records to 2646 (keeping 200 days of data) [2025-09-19T19:03:05.110450] [DEBUG] [LOCAL ] GHC: Primary data saved (2646 records). [2025-09-19T19:03:05.110519] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-19T19:03:05.110601] [INFO ] [MAIN ] Update Progress: 928/2372 symbols completed. GHC took 39.0s. Estimated remaining: 3h 11m 25s. Rate: 7.5 symbols/min [2025-09-19T19:03:05.287916] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:05.284560] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-09-19T19:03:05.308718] [DEBUG] [LOCAL ] GHM: Loaded 14400 existing records from primary storage. [2025-09-19T19:03:05.308864] [INFO ] [MAIN ] GHM: Loaded 14400 existing records. [2025-09-19T19:03:05.443342] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T19:03:05.448562] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-19T19:03:05.517307] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:05.517558] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-19T19:03:05.517823] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-19T19:03:05.518319] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-19T19:03:05.518381] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-19T19:03:05.886317] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:06.243234] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-19T19:03:06.294455] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T19:03:06.749572] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T19:03:07.043318] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-19T19:03:07.509309] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-19T19:03:07.843263] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-19T19:03:08.643303] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-19T19:03:08.822712] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T19:03:09.062321] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T19:03:09.443305] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-19T19:03:10.116493] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T19:03:10.243257] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-19T19:03:10.708932] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-19T19:03:11.043277] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-19T19:03:11.843318] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-19T19:03:12.027565] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T19:03:12.643283] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-19T19:03:13.035471] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:03:13.443266] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-19T19:03:14.243239] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-19T19:03:14.432791] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:03:14.744034] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T19:03:14.745402] [INFO ] [REMOTE ] GHLD: Full fetch complete (4664 records). [2025-09-19T19:03:14.745479] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-19T19:03:14.912092] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T19:03:14.941715] [INFO ] [REMOTE ] GHG: Full fetch complete (3959 records). [2025-09-19T19:03:15.007254] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-19T19:03:15.050996] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-19T19:03:15.241228] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-19T19:03:15.246445] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-19T19:03:15.251782] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-19T19:03:15.257344] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-19T19:03:15.288866] [DEBUG] [LOCAL ] GHLD: Trimmed 4664 records to 4080 (keeping 200 days of data) [2025-09-19T19:03:15.451360] [DEBUG] [LOCAL ] GHLD: Primary data saved (4080 records). [2025-09-19T19:03:15.451496] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-19T19:03:15.451951] [INFO ] [MAIN ] Update Progress: 929/2372 symbols completed. GHLD took 22.2s. Estimated remaining: 3h 11m 21s. Rate: 7.5 symbols/min [2025-09-19T19:03:15.643990] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-19T19:03:15.644456] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-19T19:03:15.650200] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-19T19:03:15.655407] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-19T19:03:15.698089] [DEBUG] [LOCAL ] GHG: Trimmed 3959 records to 3180 (keeping 200 days of data) [2025-09-19T19:03:15.720016] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:15.739051] [DEBUG] [LOCAL ] GHG: Primary data saved (3180 records). [2025-09-19T19:03:15.739172] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-19T19:03:15.739273] [INFO ] [MAIN ] Update Progress: 930/2372 symbols completed. GHG took 30.0s. Estimated remaining: 3h 11m 1s. Rate: 7.5 symbols/min [2025-09-19T19:03:15.848456] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-19T19:03:15.936181] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:15.911502] [DEBUG] [LOCAL ] GHY: Loaded 21293 existing records from primary storage. [2025-09-19T19:03:15.941957] [INFO ] [MAIN ] GHY: Loaded 21293 existing records. [2025-09-19T19:03:15.976144] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T19:03:16.146690] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:16.156352] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-19T19:03:16.156277] [DEBUG] [LOCAL ] GIB: Loaded 32695 existing records from primary storage. [2025-09-19T19:03:16.156523] [INFO ] [MAIN ] GIB: Loaded 32695 existing records. [2025-09-19T19:03:16.156458] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-19T19:03:16.188515] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-19T19:03:16.214304] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-19T19:03:16.501155] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:16.515979] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-19T19:03:16.517511] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-19T19:03:16.570587] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-19T19:03:16.603736] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-19T19:03:16.652604] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-19T19:03:16.921549] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:17.102365] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:17.127519] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T19:03:17.443273] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-19T19:03:17.670875] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T19:03:18.200164] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T19:03:18.243225] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-19T19:03:19.043319] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-19T19:03:19.190286] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:03:19.843272] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-19T19:03:19.871535] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T19:03:19.873185] [INFO ] [REMOTE ] GHI: Full fetch complete (11857 records). [2025-09-19T19:03:19.873263] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-19T19:03:20.255661] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-19T19:03:20.255775] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-19T19:03:20.256098] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-19T19:03:20.256138] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-19T19:03:20.256748] [DEBUG] [LOCAL ] GHI: Trimmed 11857 records to 7129 (keeping 200 days of data) [2025-09-19T19:03:20.305736] [DEBUG] [LOCAL ] GHI: Primary data saved (7129 records). [2025-09-19T19:03:20.305889] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-19T19:03:20.306040] [INFO ] [MAIN ] Update Progress: 931/2372 symbols completed. GHI took 32.3s. Estimated remaining: 3h 10m 48s. Rate: 7.6 symbols/min [2025-09-19T19:03:20.481480] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:20.497964] [DEBUG] [LOCAL ] GIC: Loaded 13973 existing records from primary storage. [2025-09-19T19:03:20.498097] [INFO ] [MAIN ] GIC: Loaded 13973 existing records. [2025-09-19T19:03:20.649382] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-19T19:03:20.681741] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:20.682077] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-19T19:03:20.682132] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-19T19:03:20.682774] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-19T19:03:20.682836] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-19T19:03:21.061952] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:21.075033] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T19:03:21.443296] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-19T19:03:22.067861] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T19:03:22.243338] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-19T19:03:22.932122] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T19:03:23.043291] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-19T19:03:23.545890] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:03:23.843279] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-19T19:03:24.161701] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T19:03:24.643310] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-19T19:03:25.456324] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-19T19:03:25.462149] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:03:25.483494] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T19:03:26.243235] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-19T19:03:26.792010] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:03:27.043264] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-19T19:03:27.127894] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T19:03:27.843290] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-19T19:03:28.218980] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:03:28.643278] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-19T19:03:28.743179] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-19T19:03:29.443310] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-19T19:03:29.987318] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T19:03:30.243302] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-19T19:03:30.438461] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T19:03:31.043285] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-19T19:03:31.843302] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-19T19:03:31.888951] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T19:03:32.413981] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:03:32.643280] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-19T19:03:33.283547] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T19:03:33.443241] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-19T19:03:33.845491] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:03:34.243263] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-19T19:03:34.277756] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T19:03:35.043280] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-19T19:03:35.468392] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T19:03:35.843272] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-19T19:03:36.096135] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T19:03:36.098585] [INFO ] [REMOTE ] GHM: Full fetch complete (21477 records). [2025-09-19T19:03:36.098697] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-19T19:03:36.469614] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-19T19:03:36.469747] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-19T19:03:36.470200] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-19T19:03:36.470241] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-19T19:03:36.470837] [DEBUG] [LOCAL ] GHM: Trimmed 21477 records to 14487 (keeping 200 days of data) [2025-09-19T19:03:36.556509] [DEBUG] [LOCAL ] GHM: Primary data saved (14487 records). [2025-09-19T19:03:36.556680] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-19T19:03:36.556800] [INFO ] [MAIN ] Update Progress: 932/2372 symbols completed. GHM took 31.4s. Estimated remaining: 3h 10m 52s. Rate: 7.5 symbols/min [2025-09-19T19:03:36.648365] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-19T19:03:36.740540] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:36.782170] [DEBUG] [LOCAL ] GIL: Loaded 43347 existing records from primary storage. [2025-09-19T19:03:36.782320] [INFO ] [MAIN ] GIL: Loaded 43347 existing records. [2025-09-19T19:03:36.967608] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:36.967897] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-19T19:03:36.967948] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-19T19:03:36.969174] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-19T19:03:36.969237] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-19T19:03:37.317519] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T19:03:37.364788] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:37.443240] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-19T19:03:38.113626] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:03:38.208922] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T19:03:38.243220] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-19T19:03:39.043251] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-19T19:03:39.506681] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T19:03:39.843275] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-19T19:03:40.643324] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-19T19:03:40.695584] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T19:03:40.785624] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T19:03:41.443266] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-19T19:03:41.453205] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T19:03:42.243283] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-19T19:03:43.043250] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-19T19:03:43.168917] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T19:03:43.269411] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T19:03:43.843266] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-19T19:03:44.148432] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T19:03:44.643237] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-19T19:03:44.728089] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:03:44.731120] [INFO ] [REMOTE ] GHY: Full fetch complete (31926 records). [2025-09-19T19:03:44.731205] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-19T19:03:45.097595] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-19T19:03:45.097737] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-19T19:03:45.098359] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-19T19:03:45.098403] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-19T19:03:45.099360] [DEBUG] [LOCAL ] GHY: Trimmed 31926 records to 21391 (keeping 200 days of data) [2025-09-19T19:03:45.231847] [DEBUG] [LOCAL ] GHY: Primary data saved (21391 records). [2025-09-19T19:03:45.231984] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-19T19:03:45.232067] [INFO ] [MAIN ] Update Progress: 933/2372 symbols completed. GHY took 29.8s. Estimated remaining: 3h 10m 46s. Rate: 7.5 symbols/min [2025-09-19T19:03:45.411948] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:45.447018] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-19T19:03:45.468950] [DEBUG] [LOCAL ] GIS: Loaded 54064 existing records from primary storage. [2025-09-19T19:03:45.469090] [INFO ] [MAIN ] GIS: Loaded 54064 existing records. [2025-09-19T19:03:45.664324] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:45.664609] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-19T19:03:45.664684] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-19T19:03:45.666148] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-19T19:03:45.666213] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-19T19:03:46.054983] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:46.056324] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T19:03:46.243323] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-19T19:03:47.043330] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-19T19:03:47.124399] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:03:47.664795] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T19:03:47.843269] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-19T19:03:48.181864] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T19:03:48.184889] [INFO ] [REMOTE ] GIC: Full fetch complete (20319 records). [2025-09-19T19:03:48.184979] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-19T19:03:48.558139] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-19T19:03:48.558255] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-19T19:03:48.558779] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-19T19:03:48.558852] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-19T19:03:48.559534] [DEBUG] [LOCAL ] GIC: Trimmed 20319 records to 14066 (keeping 200 days of data) [2025-09-19T19:03:48.643267] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-19T19:03:48.652851] [DEBUG] [LOCAL ] GIC: Primary data saved (14066 records). [2025-09-19T19:03:48.652947] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-19T19:03:48.653112] [INFO ] [MAIN ] Update Progress: 934/2372 symbols completed. GIC took 28.3s. Estimated remaining: 3h 10m 31s. Rate: 7.5 symbols/min [2025-09-19T19:03:48.825699] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:48.871192] [DEBUG] [LOCAL ] GKOS: Loaded 43478 existing records from primary storage. [2025-09-19T19:03:48.871335] [INFO ] [MAIN ] GKOS: Loaded 43478 existing records. [2025-09-19T19:03:49.050472] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:49.050809] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-19T19:03:49.050876] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-19T19:03:49.052097] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-19T19:03:49.052165] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-19T19:03:49.442014] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:49.443219] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-19T19:03:50.070635] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T19:03:50.243272] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-19T19:03:50.270668] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:03:50.778256] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T19:03:51.043270] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-19T19:03:51.843311] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-19T19:03:52.212705] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T19:03:52.583504] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T19:03:52.643226] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-19T19:03:53.138197] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:03:53.443268] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-19T19:03:53.701526] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T19:03:53.706410] [INFO ] [REMOTE ] GIB: Full fetch complete (44981 records). [2025-09-19T19:03:53.706504] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-19T19:03:54.102314] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-19T19:03:54.102437] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-19T19:03:54.103746] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-19T19:03:54.103828] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-19T19:03:54.108687] [DEBUG] [LOCAL ] GIB: Trimmed 44981 records to 32922 (keeping 200 days of data) [2025-09-19T19:03:54.245832] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-19T19:03:54.330031] [DEBUG] [LOCAL ] GIB: Primary data saved (32922 records). [2025-09-19T19:03:54.330185] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-19T19:03:54.330337] [INFO ] [MAIN ] Update Progress: 935/2372 symbols completed. GIB took 38.6s. Estimated remaining: 3h 10m 19s. Rate: 7.6 symbols/min [2025-09-19T19:03:54.511454] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:03:54.556604] [DEBUG] [LOCAL ] GL: Loaded 38494 existing records from primary storage. [2025-09-19T19:03:54.556794] [INFO ] [MAIN ] GL: Loaded 38494 existing records. [2025-09-19T19:03:54.774901] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:03:54.775164] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-19T19:03:54.775212] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-19T19:03:54.776615] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-19T19:03:54.776700] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-19T19:03:55.054110] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-19T19:03:55.137234] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:03:55.349837] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:03:55.843217] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-19T19:03:56.116821] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T19:03:56.643272] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-19T19:03:56.899074] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:03:57.443337] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-19T19:03:57.491384] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T19:03:58.243229] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-19T19:03:58.368788] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T19:03:59.043272] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-19T19:03:59.227808] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:03:59.734211] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:03:59.843229] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-19T19:04:00.643289] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-19T19:04:01.443279] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-19T19:04:01.500763] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:04:01.570545] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T19:04:02.243256] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-19T19:04:02.754740] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:04:02.788815] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T19:04:03.043308] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-19T19:04:03.843340] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-19T19:04:04.340513] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T19:04:04.643282] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-19T19:04:04.799581] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T19:04:05.233768] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T19:04:05.443315] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-19T19:04:06.243292] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-19T19:04:06.396184] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:04:06.655893] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:04:07.043350] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-19T19:04:07.843283] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-19T19:04:08.107732] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T19:04:08.643293] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-19T19:04:08.832466] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:04:09.443251] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-19T19:04:10.019663] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T19:04:10.243276] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-19T19:04:10.449298] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:04:10.457056] [INFO ] [REMOTE ] GIL: Full fetch complete (61188 records). [2025-09-19T19:04:10.457227] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-19T19:04:10.928279] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-19T19:04:10.928504] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-19T19:04:10.931330] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T19:04:10.930108] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-19T19:04:10.939277] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-19T19:04:10.944831] [DEBUG] [LOCAL ] GIL: Trimmed 61188 records to 43701 (keeping 200 days of data) [2025-09-19T19:04:11.052837] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-19T19:04:11.244784] [DEBUG] [LOCAL ] GIL: Primary data saved (43701 records). [2025-09-19T19:04:11.244931] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-19T19:04:11.245084] [INFO ] [MAIN ] Update Progress: 936/2372 symbols completed. GIL took 34.7s. Estimated remaining: 3h 10m 25s. Rate: 7.5 symbols/min [2025-09-19T19:04:11.443011] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:11.498087] [DEBUG] [LOCAL ] GLOB: Loaded 47525 existing records from primary storage. [2025-09-19T19:04:11.498274] [INFO ] [MAIN ] GLOB: Loaded 47525 existing records. [2025-09-19T19:04:11.694402] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:11.694743] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-19T19:04:11.694801] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-19T19:04:11.695973] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-19T19:04:11.696054] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-19T19:04:11.854310] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-19T19:04:12.121158] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:12.147909] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:04:12.643264] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-19T19:04:12.730676] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:04:13.443274] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-19T19:04:13.798782] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T19:04:13.994634] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T19:04:14.006405] [INFO ] [REMOTE ] GIS: Full fetch complete (77649 records). [2025-09-19T19:04:14.006573] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-19T19:04:14.255144] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-19T19:04:14.401124] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-19T19:04:14.401215] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-19T19:04:14.402273] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-19T19:04:14.402346] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-19T19:04:14.405405] [DEBUG] [LOCAL ] GIS: Trimmed 77649 records to 54454 (keeping 200 days of data) [2025-09-19T19:04:14.798102] [DEBUG] [LOCAL ] GIS: Primary data saved (54454 records). [2025-09-19T19:04:14.798674] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-19T19:04:14.798915] [INFO ] [MAIN ] Update Progress: 937/2372 symbols completed. GIS took 29.6s. Estimated remaining: 3h 10m 10s. Rate: 7.5 symbols/min [2025-09-19T19:04:14.992945] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:15.005918] [DEBUG] [LOCAL ] GLP: Loaded 9662 existing records from primary storage. [2025-09-19T19:04:15.006077] [INFO ] [MAIN ] GLP: Loaded 9662 existing records. [2025-09-19T19:04:15.048518] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-19T19:04:15.194162] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:15.194464] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-19T19:04:15.194518] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-19T19:04:15.195031] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-19T19:04:15.195093] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-19T19:04:15.563601] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:15.843270] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-19T19:04:16.006517] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T19:04:16.033420] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-19T19:04:16.041560] [INFO ] [REMOTE ] GKOS: Full fetch complete (59833 records). [2025-09-19T19:04:16.041794] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-19T19:04:16.425941] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-19T19:04:16.426039] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-19T19:04:16.426847] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-19T19:04:16.426911] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-19T19:04:16.428294] [DEBUG] [LOCAL ] GKOS: Trimmed 59833 records to 43831 (keeping 200 days of data) [2025-09-19T19:04:16.635508] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-19T19:04:16.664332] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-19T19:04:16.727774] [DEBUG] [LOCAL ] GKOS: Primary data saved (43831 records). [2025-09-19T19:04:16.728224] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-19T19:04:16.728343] [INFO ] [MAIN ] Update Progress: 938/2372 symbols completed. GKOS took 28.1s. Estimated remaining: 3h 9m 53s. Rate: 7.6 symbols/min [2025-09-19T19:04:16.907980] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:16.950465] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T19:04:16.999321] [DEBUG] [LOCAL ] GLW: Loaded 54025 existing records from primary storage. [2025-09-19T19:04:16.999529] [INFO ] [MAIN ] GLW: Loaded 54025 existing records. [2025-09-19T19:04:17.184357] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:17.184787] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-19T19:04:17.184849] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-19T19:04:17.186530] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-19T19:04:17.186595] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-19T19:04:17.448451] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-19T19:04:17.554758] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:17.631321] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T19:04:18.243286] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-19T19:04:18.825030] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T19:04:19.043328] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-19T19:04:19.843269] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-19T19:04:20.073737] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:04:20.643339] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-19T19:04:20.844915] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T19:04:20.910327] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T19:04:21.443317] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-19T19:04:21.846998] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T19:04:22.243330] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-19T19:04:22.632591] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T19:04:23.043301] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-19T19:04:23.220770] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T19:04:23.843267] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-19T19:04:24.520458] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T19:04:24.571754] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T19:04:24.643242] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-19T19:04:25.443321] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-19T19:04:26.243268] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-19T19:04:26.377194] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:04:26.701802] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T19:04:27.043276] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-19T19:04:27.843296] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-19T19:04:27.880404] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:04:28.643274] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-19T19:04:29.191204] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T19:04:29.238670] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-19T19:04:29.402753] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T19:04:29.443227] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-19T19:04:30.243269] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-19T19:04:31.043259] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-19T19:04:31.245834] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:04:31.843275] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-19T19:04:31.885555] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T19:04:32.165203] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T19:04:32.643276] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-19T19:04:33.403421] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:04:33.443255] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-19T19:04:34.233195] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:04:34.244307] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-19T19:04:34.307426] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T19:04:35.043290] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-19T19:04:35.843251] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-19T19:04:35.894081] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T19:04:36.643264] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-19T19:04:36.750135] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T19:04:36.771527] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T19:04:37.443279] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-19T19:04:38.243258] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-19T19:04:38.339029] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T19:04:38.819352] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T19:04:38.824398] [INFO ] [REMOTE ] GL: Full fetch complete (55777 records). [2025-09-19T19:04:38.824526] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-19T19:04:39.013707] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-19T19:04:39.048372] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-19T19:04:39.077961] [INFO ] [REMOTE ] GLP: Full fetch complete (14403 records). [2025-09-19T19:04:39.092704] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-19T19:04:39.400122] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-19T19:04:39.416326] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-19T19:04:39.450775] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-19T19:04:39.491801] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-19T19:04:39.537248] [DEBUG] [LOCAL ] GL: Trimmed 55777 records to 38747 (keeping 200 days of data) [2025-09-19T19:04:39.720036] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-19T19:04:39.720722] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-19T19:04:39.721760] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-19T19:04:39.722133] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-19T19:04:39.729728] [DEBUG] [LOCAL ] GLP: Trimmed 14403 records to 9735 (keeping 200 days of data) [2025-09-19T19:04:39.818056] [DEBUG] [LOCAL ] GLP: Primary data saved (9735 records). [2025-09-19T19:04:39.818996] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-19T19:04:39.819169] [INFO ] [MAIN ] Update Progress: 939/2372 symbols completed. GLP took 25.0s. Estimated remaining: 3h 10m 8s. Rate: 7.5 symbols/min [2025-09-19T19:04:39.851287] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-19T19:04:40.092448] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:40.165030] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-09-19T19:04:40.168143] [DEBUG] [LOCAL ] GL: Primary data saved (38747 records). [2025-09-19T19:04:40.168316] [INFO ] [MAIN ] GL: Full history saved. [2025-09-19T19:04:40.168408] [INFO ] [MAIN ] GM: Loaded 54118 existing records. [2025-09-19T19:04:40.173694] [INFO ] [MAIN ] Update Progress: 940/2372 symbols completed. GL took 45.8s. Estimated remaining: 3h 9m 49s. Rate: 7.5 symbols/min [2025-09-19T19:04:40.528134] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:40.530616] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-19T19:04:40.530369] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:40.530762] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-19T19:04:40.532069] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-19T19:04:40.532234] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-19T19:04:40.936262] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:40.936708] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-19T19:04:40.939697] [DEBUG] [LOCAL ] GME: Loaded 54149 existing records from primary storage. [2025-09-19T19:04:40.939976] [INFO ] [MAIN ] GME: Loaded 54149 existing records. [2025-09-19T19:04:41.122585] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:41.122909] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-19T19:04:41.122959] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-19T19:04:41.124222] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-19T19:04:41.124283] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-19T19:04:41.488871] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:41.489314] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-19T19:04:41.526698] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-19T19:04:41.954728] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T19:04:41.962169] [INFO ] [REMOTE ] GLOB: Full fetch complete (62982 records). [2025-09-19T19:04:41.962288] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-19T19:04:42.248390] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-19T19:04:42.354088] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-19T19:04:42.354180] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-19T19:04:42.355017] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-19T19:04:42.355128] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-19T19:04:42.356947] [DEBUG] [LOCAL ] GLOB: Trimmed 62982 records to 47899 (keeping 200 days of data) [2025-09-19T19:04:42.640423] [DEBUG] [LOCAL ] GLOB: Primary data saved (47899 records). [2025-09-19T19:04:42.640559] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-19T19:04:42.640921] [INFO ] [MAIN ] Update Progress: 941/2372 symbols completed. GLOB took 31.4s. Estimated remaining: 3h 9m 33s. Rate: 7.5 symbols/min [2025-09-19T19:04:42.811769] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:42.859094] [DEBUG] [LOCAL ] GMED: Loaded 48614 existing records from primary storage. [2025-09-19T19:04:42.859245] [INFO ] [MAIN ] GMED: Loaded 48614 existing records. [2025-09-19T19:04:43.037473] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:43.037777] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-19T19:04:43.037919] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-19T19:04:43.039010] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-19T19:04:43.039074] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-19T19:04:43.434678] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:43.435097] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-19T19:04:43.472345] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-19T19:04:43.843304] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-19T19:04:43.849358] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-19T19:04:44.477082] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T19:04:44.643249] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-19T19:04:45.185345] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T19:04:45.443271] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-19T19:04:46.216233] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-19T19:04:46.243218] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-19T19:04:46.979060] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T19:04:47.043293] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-19T19:04:47.275698] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:04:47.843271] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-19T19:04:48.507513] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T19:04:48.643225] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-19T19:04:48.692024] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-19T19:04:49.443265] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-19T19:04:50.184890] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T19:04:50.192957] [INFO ] [REMOTE ] GLW: Full fetch complete (77614 records). [2025-09-19T19:04:50.193100] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-19T19:04:50.258160] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-19T19:04:50.601762] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-19T19:04:50.601882] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-19T19:04:50.602925] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-19T19:04:50.603022] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-19T19:04:50.628518] [DEBUG] [LOCAL ] GLW: Trimmed 77614 records to 54415 (keeping 200 days of data) [2025-09-19T19:04:50.629363] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T19:04:50.989813] [DEBUG] [LOCAL ] GLW: Primary data saved (54415 records). [2025-09-19T19:04:50.989996] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-19T19:04:50.990286] [INFO ] [MAIN ] Update Progress: 942/2372 symbols completed. GLW took 34.3s. Estimated remaining: 3h 9m 25s. Rate: 7.5 symbols/min [2025-09-19T19:04:51.054332] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-19T19:04:51.168823] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:04:51.204474] [DEBUG] [LOCAL ] GMRE: Loaded 37946 existing records from primary storage. [2025-09-19T19:04:51.204635] [INFO ] [MAIN ] GMRE: Loaded 37946 existing records. [2025-09-19T19:04:51.387458] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:04:51.387914] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-19T19:04:51.387990] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-19T19:04:51.389098] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-19T19:04:51.389162] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-19T19:04:51.767947] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-19T19:04:51.809586] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:04:51.843218] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-19T19:04:52.643263] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-19T19:04:52.808450] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-19T19:04:52.995396] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T19:04:53.443264] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-19T19:04:53.789980] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:04:54.243243] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-19T19:04:54.265883] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:04:54.663563] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T19:04:55.043264] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-19T19:04:55.843271] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-19T19:04:56.643278] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-19T19:04:56.707307] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T19:04:56.812181] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-19T19:04:57.443281] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-19T19:04:57.727963] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:04:58.243271] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-19T19:04:58.709054] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:04:59.043259] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-19T19:04:59.136062] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T19:04:59.843264] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-19T19:05:00.309208] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T19:05:00.436863] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T19:05:00.643267] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-19T19:05:01.443241] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-19T19:05:01.469558] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:05:02.243267] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-19T19:05:02.769974] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T19:05:03.043262] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-19T19:05:03.854003] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-19T19:05:03.855612] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-19T19:05:04.347607] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T19:05:04.643267] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-19T19:05:05.176426] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T19:05:05.443279] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-19T19:05:05.634135] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-19T19:05:06.243330] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-19T19:05:06.947404] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T19:05:07.043337] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-19T19:05:07.105391] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T19:05:07.843279] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-19T19:05:07.950013] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T19:05:07.958229] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-19T19:05:07.958373] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-19T19:05:08.420106] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-19T19:05:08.420245] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-19T19:05:08.421499] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-19T19:05:08.421598] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-19T19:05:08.423505] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54508 (keeping 200 days of data) [2025-09-19T19:05:08.648536] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-19T19:05:08.877610] [DEBUG] [LOCAL ] GM: Primary data saved (54508 records). [2025-09-19T19:05:08.877880] [INFO ] [MAIN ] GM: Full history saved. [2025-09-19T19:05:08.878095] [INFO ] [MAIN ] Update Progress: 943/2372 symbols completed. GM took 29.1s. Estimated remaining: 3h 9m 32s. Rate: 7.5 symbols/min [2025-09-19T19:05:09.134634] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T19:05:09.231614] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:09.258226] [DEBUG] [LOCAL ] GNE: Loaded 17483 existing records from primary storage. [2025-09-19T19:05:09.258409] [INFO ] [MAIN ] GNE: Loaded 17483 existing records. [2025-09-19T19:05:09.452171] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-19T19:05:09.488386] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:09.488677] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-19T19:05:09.488763] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-19T19:05:09.489452] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-19T19:05:09.489516] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-19T19:05:09.873818] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:09.905390] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-09-19T19:05:10.243270] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-19T19:05:10.456676] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:05:10.858456] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-19T19:05:11.043302] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-19T19:05:11.176313] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T19:05:11.843312] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-19T19:05:12.459770] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T19:05:12.466639] [INFO ] [REMOTE ] GMED: Full fetch complete (69069 records). [2025-09-19T19:05:12.466807] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-19T19:05:12.646674] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-19T19:05:12.863305] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-19T19:05:12.863391] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-19T19:05:12.864282] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-19T19:05:12.864344] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-19T19:05:12.865742] [DEBUG] [LOCAL ] GMED: Trimmed 69069 records to 48979 (keeping 200 days of data) [2025-09-19T19:05:13.108622] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T19:05:13.187290] [DEBUG] [LOCAL ] GMED: Primary data saved (48979 records). [2025-09-19T19:05:13.187494] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-19T19:05:13.188131] [INFO ] [MAIN ] Update Progress: 944/2372 symbols completed. GMED took 30.5s. Estimated remaining: 3h 9m 19s. Rate: 7.5 symbols/min [2025-09-19T19:05:13.368204] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:13.413998] [DEBUG] [LOCAL ] GNK: Loaded 41207 existing records from primary storage. [2025-09-19T19:05:13.414188] [INFO ] [MAIN ] GNK: Loaded 41207 existing records. [2025-09-19T19:05:13.447415] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-19T19:05:13.620036] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:13.620321] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-19T19:05:13.620372] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-19T19:05:13.621499] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-19T19:05:13.621565] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-19T19:05:13.924378] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:05:14.050601] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:14.243290] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-19T19:05:15.043275] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-19T19:05:15.843301] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-19T19:05:15.929867] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T19:05:15.984428] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T19:05:16.179199] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-19T19:05:16.643299] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-19T19:05:17.334867] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:05:17.340667] [INFO ] [REMOTE ] GMRE: Full fetch complete (53464 records). [2025-09-19T19:05:17.340775] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-19T19:05:17.448468] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-19T19:05:17.720985] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-19T19:05:17.721066] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-19T19:05:17.721855] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-19T19:05:17.721918] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-19T19:05:17.723061] [DEBUG] [LOCAL ] GMRE: Trimmed 53464 records to 38263 (keeping 200 days of data) [2025-09-19T19:05:17.942470] [DEBUG] [LOCAL ] GMRE: Primary data saved (38263 records). [2025-09-19T19:05:17.942663] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-19T19:05:17.942805] [INFO ] [MAIN ] Update Progress: 945/2372 symbols completed. GMRE took 27.0s. Estimated remaining: 3h 9m 6s. Rate: 7.5 symbols/min [2025-09-19T19:05:18.118341] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:18.118616] [DEBUG] [LOCAL ] GNL: No existing data file found in primary storage. [2025-09-19T19:05:18.118696] [WARN ] [MAIN ] GNL: No existing data found, performing full refresh instead. [2025-09-19T19:05:18.118851] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-19T19:05:18.118895] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-19T19:05:18.118937] [DEBUG] [LOCAL ] GNL: No primary data file found to delete. [2025-09-19T19:05:18.118969] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-19T19:05:18.246584] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-19T19:05:18.511912] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:18.523816] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T19:05:19.043252] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-19T19:05:19.343901] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T19:05:19.843290] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-19T19:05:20.274064] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-19T19:05:20.317113] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:05:20.643270] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-19T19:05:20.784607] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T19:05:21.443289] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-19T19:05:22.243291] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-19T19:05:23.043283] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-19T19:05:23.369353] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-19T19:05:23.377346] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-09-19T19:05:23.377481] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-19T19:05:23.810143] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-19T19:05:23.810357] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-19T19:05:23.811626] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-19T19:05:23.811898] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-19T19:05:23.849592] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-19T19:05:23.860518] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 54539 (keeping 200 days of data) [2025-09-19T19:05:23.861387] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-19T19:05:23.977832] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:05:24.221996] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T19:05:24.241784] [DEBUG] [LOCAL ] GME: Primary data saved (54539 records). [2025-09-19T19:05:24.241924] [INFO ] [MAIN ] GME: Full history saved. [2025-09-19T19:05:24.242018] [INFO ] [MAIN ] Update Progress: 946/2372 symbols completed. GME took 44.0s. Estimated remaining: 3h 8m 56s. Rate: 7.5 symbols/min [2025-09-19T19:05:24.416368] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:24.466276] [DEBUG] [LOCAL ] GNRC: Loaded 45443 existing records from primary storage. [2025-09-19T19:05:24.466461] [INFO ] [MAIN ] GNRC: Loaded 45443 existing records. [2025-09-19T19:05:24.655313] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-19T19:05:24.661804] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:24.662890] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-19T19:05:24.663001] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-19T19:05:24.664299] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-19T19:05:24.664374] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-19T19:05:25.037534] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:25.443260] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-19T19:05:25.720295] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:05:25.995072] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:05:26.243251] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-19T19:05:27.043293] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-19T19:05:27.289831] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T19:05:27.843276] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-19T19:05:28.033688] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:05:28.643300] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-19T19:05:28.879198] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:05:29.443265] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-19T19:05:29.597213] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T19:05:30.243258] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-19T19:05:30.706771] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T19:05:31.043268] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-19T19:05:31.513761] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:05:31.843306] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-19T19:05:32.095704] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T19:05:32.436839] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T19:05:32.643258] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-19T19:05:33.104869] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T19:05:33.443241] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-19T19:05:33.871149] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T19:05:34.243272] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-19T19:05:34.902925] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T19:05:35.043259] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-19T19:05:35.843236] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-19T19:05:35.958244] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T19:05:36.643258] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-19T19:05:37.443284] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-19T19:05:37.720210] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T19:05:38.243324] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-19T19:05:38.438356] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T19:05:38.603138] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T19:05:39.043274] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-19T19:05:39.843270] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-19T19:05:40.150246] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T19:05:40.643270] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-19T19:05:40.896180] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T19:05:41.443267] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-19T19:05:42.399354] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:05:42.408731] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-19T19:05:43.165143] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (8.12 seconds). [2025-09-19T19:05:43.167922] [INFO ] [REMOTE ] GNE: Full fetch complete (22055 records). [2025-09-19T19:05:43.167994] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-19T19:05:43.556692] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-19T19:05:43.556873] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-19T19:05:43.557483] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-19T19:05:43.557768] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-19T19:05:43.559368] [DEBUG] [LOCAL ] GNE: Trimmed 22055 records to 17580 (keeping 200 days of data) [2025-09-19T19:05:43.665450] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T19:05:43.681469] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-19T19:05:43.715176] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:05:43.744231] [DEBUG] [LOCAL ] GNE: Primary data saved (17580 records). [2025-09-19T19:05:43.744386] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-19T19:05:43.744489] [INFO ] [MAIN ] Update Progress: 947/2372 symbols completed. GNE took 34.9s. Estimated remaining: 3h 9m 5s. Rate: 7.5 symbols/min [2025-09-19T19:05:43.847554] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-19T19:05:43.920535] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:43.930796] [DEBUG] [LOCAL ] GNT: Loaded 7870 existing records from primary storage. [2025-09-19T19:05:43.930888] [INFO ] [MAIN ] GNT: Loaded 7870 existing records. [2025-09-19T19:05:44.115193] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:44.115477] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-19T19:05:44.115524] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-19T19:05:44.115939] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-19T19:05:44.115999] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-19T19:05:44.492766] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:44.643281] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-19T19:05:45.445788] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T19:05:45.447465] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-19T19:05:45.482254] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T19:05:45.605560] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T19:05:45.748851] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (5.91 seconds). [2025-09-19T19:05:45.754482] [INFO ] [REMOTE ] GNK: Full fetch complete (57003 records). [2025-09-19T19:05:45.754580] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-19T19:05:46.066081] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T19:05:46.150563] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-19T19:05:46.150710] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-19T19:05:46.151507] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-19T19:05:46.151552] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-19T19:05:46.152929] [DEBUG] [LOCAL ] GNK: Trimmed 57003 records to 41479 (keeping 200 days of data) [2025-09-19T19:05:46.245794] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-19T19:05:46.409227] [DEBUG] [LOCAL ] GNK: Primary data saved (41479 records). [2025-09-19T19:05:46.409365] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-19T19:05:46.409463] [INFO ] [MAIN ] Update Progress: 948/2372 symbols completed. GNK took 33.2s. Estimated remaining: 3h 8m 49s. Rate: 7.5 symbols/min [2025-09-19T19:05:46.591791] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:46.601069] [DEBUG] [LOCAL ] GNTY: Loaded 7043 existing records from primary storage. [2025-09-19T19:05:46.601205] [INFO ] [MAIN ] GNTY: Loaded 7043 existing records. [2025-09-19T19:05:46.786563] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:46.786919] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-19T19:05:46.786998] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-19T19:05:46.787408] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-19T19:05:46.787470] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-19T19:05:47.056078] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-19T19:05:47.220144] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:47.843293] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-19T19:05:47.889959] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T19:05:48.136980] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T19:05:48.144071] [INFO ] [REMOTE ] GNL: Full fetch complete (68602 records). [2025-09-19T19:05:48.144235] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-19T19:05:48.553472] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-19T19:05:48.553554] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-19T19:05:48.554439] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-19T19:05:48.554502] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-19T19:05:48.555968] [DEBUG] [LOCAL ] GNL: Trimmed 68602 records to 48190 (keeping 200 days of data) [2025-09-19T19:05:48.643401] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-19T19:05:48.839139] [DEBUG] [LOCAL ] GNL: Primary data saved (48190 records). [2025-09-19T19:05:48.839277] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-19T19:05:48.839352] [INFO ] [MAIN ] Update Progress: 949/2372 symbols completed. GNL took 30.9s. Estimated remaining: 3h 8m 33s. Rate: 7.5 symbols/min [2025-09-19T19:05:49.008111] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:49.061052] [DEBUG] [LOCAL ] GNW: Loaded 51708 existing records from primary storage. [2025-09-19T19:05:49.061242] [INFO ] [MAIN ] GNW: Loaded 51708 existing records. [2025-09-19T19:05:49.252853] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:05:49.253157] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-19T19:05:49.253218] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-19T19:05:49.254272] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-19T19:05:49.254341] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-19T19:05:49.461468] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-19T19:05:49.600901] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T19:05:49.623429] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:49.726806] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T19:05:50.243261] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-19T19:05:50.482213] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T19:05:51.043274] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-19T19:05:51.843265] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-19T19:05:51.949339] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T19:05:52.172413] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T19:05:52.643251] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-19T19:05:53.168690] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:05:53.175802] [INFO ] [REMOTE ] GNRC: Full fetch complete (64995 records). [2025-09-19T19:05:53.175958] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-19T19:05:53.314113] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-19T19:05:53.448354] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-19T19:05:53.617476] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-19T19:05:53.617575] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-19T19:05:53.618441] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-19T19:05:53.618507] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-19T19:05:53.619969] [DEBUG] [LOCAL ] GNRC: Trimmed 64995 records to 45796 (keeping 200 days of data) [2025-09-19T19:05:53.917614] [DEBUG] [LOCAL ] GNRC: Primary data saved (45796 records). [2025-09-19T19:05:53.917795] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-19T19:05:53.917893] [INFO ] [MAIN ] Update Progress: 950/2372 symbols completed. GNRC took 29.7s. Estimated remaining: 3h 8m 21s. Rate: 7.6 symbols/min [2025-09-19T19:05:54.114153] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:05:54.114345] [DEBUG] [LOCAL ] GOF: No existing data file found in primary storage. [2025-09-19T19:05:54.114385] [WARN ] [MAIN ] GOF: No existing data found, performing full refresh instead. [2025-09-19T19:05:54.114530] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-19T19:05:54.114575] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-19T19:05:54.114618] [DEBUG] [LOCAL ] GOF: No primary data file found to delete. [2025-09-19T19:05:54.114678] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-19T19:05:54.248377] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-19T19:05:54.492436] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:05:54.503922] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T19:05:55.043268] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-19T19:05:55.311477] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T19:05:55.843273] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-19T19:05:56.643274] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-19T19:05:56.707844] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T19:05:56.943197] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:05:57.127949] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T19:05:57.443276] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-19T19:05:58.021507] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T19:05:58.243258] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-19T19:05:58.975578] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T19:05:59.043224] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-19T19:05:59.837748] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T19:05:59.843210] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-19T19:06:00.566374] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T19:06:00.643238] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-19T19:06:01.443274] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-19T19:06:01.823490] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T19:06:01.832557] [INFO ] [REMOTE ] GNT: Full fetch complete (10385 records). [2025-09-19T19:06:01.832831] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-19T19:06:02.250566] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-19T19:06:02.338314] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-19T19:06:02.338418] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-19T19:06:02.338805] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-19T19:06:02.339418] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-19T19:06:02.340393] [DEBUG] [LOCAL ] GNT: Trimmed 10385 records to 7944 (keeping 200 days of data) [2025-09-19T19:06:02.395113] [DEBUG] [LOCAL ] GNT: Primary data saved (7944 records). [2025-09-19T19:06:02.395282] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-19T19:06:02.395418] [INFO ] [MAIN ] Update Progress: 951/2372 symbols completed. GNT took 18.7s. Estimated remaining: 3h 8m 14s. Rate: 7.5 symbols/min [2025-09-19T19:06:02.600295] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:02.637130] [DEBUG] [LOCAL ] GOLF: Loaded 32291 existing records from primary storage. [2025-09-19T19:06:02.637275] [INFO ] [MAIN ] GOLF: Loaded 32291 existing records. [2025-09-19T19:06:02.813669] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:02.813950] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-19T19:06:02.814000] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-19T19:06:02.814826] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-19T19:06:02.814889] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-19T19:06:03.060974] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-19T19:06:03.187731] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:03.421140] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T19:06:03.843313] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-19T19:06:04.643334] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-19T19:06:04.827758] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-19T19:06:05.302755] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T19:06:05.443226] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-19T19:06:05.638020] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-19T19:06:05.989505] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T19:06:06.243291] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-19T19:06:06.384507] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T19:06:07.043291] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-19T19:06:07.763716] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T19:06:07.843271] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-19T19:06:08.617833] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T19:06:08.643235] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-19T19:06:09.443281] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-19T19:06:09.895446] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T19:06:09.937293] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:06:10.243281] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-19T19:06:10.341493] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-19T19:06:11.043327] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-19T19:06:11.843289] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-19T19:06:12.194430] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:06:12.273451] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T19:06:12.643285] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-19T19:06:13.443285] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-19T19:06:14.154487] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T19:06:14.243276] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-19T19:06:15.043322] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-19T19:06:15.160516] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T19:06:15.162301] [INFO ] [REMOTE ] GNTY: Full fetch complete (10151 records). [2025-09-19T19:06:15.162378] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-19T19:06:15.541801] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-19T19:06:15.541927] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-19T19:06:15.542363] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-19T19:06:15.542448] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-19T19:06:15.543058] [DEBUG] [LOCAL ] GNTY: Trimmed 10151 records to 7131 (keeping 200 days of data) [2025-09-19T19:06:15.614431] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-19T19:06:15.637183] [DEBUG] [LOCAL ] GNTY: Primary data saved (7131 records). [2025-09-19T19:06:15.637301] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-19T19:06:15.637404] [INFO ] [MAIN ] Update Progress: 952/2372 symbols completed. GNTY took 29.2s. Estimated remaining: 3h 8m 13s. Rate: 7.5 symbols/min [2025-09-19T19:06:15.808596] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:15.846439] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-19T19:06:15.867593] [DEBUG] [LOCAL ] GOOS: Loaded 46206 existing records from primary storage. [2025-09-19T19:06:15.867798] [INFO ] [MAIN ] GOOS: Loaded 46206 existing records. [2025-09-19T19:06:16.049755] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:16.050052] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-19T19:06:16.050145] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-19T19:06:16.051157] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-19T19:06:16.051220] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-19T19:06:16.429626] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:16.457970] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-19T19:06:16.643225] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-19T19:06:16.923909] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:06:17.263087] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T19:06:17.443271] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-19T19:06:18.243267] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-19T19:06:18.521961] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T19:06:19.043327] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-19T19:06:19.430517] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:06:19.529151] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T19:06:19.843274] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-19T19:06:20.643298] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-19T19:06:21.166329] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T19:06:21.342545] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T19:06:21.443236] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-19T19:06:22.243250] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-19T19:06:22.717351] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:06:23.043301] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-19T19:06:23.432793] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:06:23.441504] [INFO ] [REMOTE ] GNW: Full fetch complete (73410 records). [2025-09-19T19:06:23.441898] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-19T19:06:23.851191] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-19T19:06:23.915209] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-19T19:06:23.915334] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-19T19:06:23.916354] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-19T19:06:23.916451] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-19T19:06:23.920630] [DEBUG] [LOCAL ] GNW: Trimmed 73410 records to 52097 (keeping 200 days of data) [2025-09-19T19:06:24.066516] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T19:06:24.273559] [DEBUG] [LOCAL ] GNW: Primary data saved (52097 records). [2025-09-19T19:06:24.273765] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-19T19:06:24.273898] [INFO ] [MAIN ] Update Progress: 953/2372 symbols completed. GNW took 35.4s. Estimated remaining: 3h 8m 7s. Rate: 7.5 symbols/min [2025-09-19T19:06:24.465143] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:24.508618] [DEBUG] [LOCAL ] GOTU: Loaded 39755 existing records from primary storage. [2025-09-19T19:06:24.508815] [INFO ] [MAIN ] GOTU: Loaded 39755 existing records. [2025-09-19T19:06:24.648476] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-19T19:06:24.691460] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:24.691779] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-19T19:06:24.691861] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-19T19:06:24.692679] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-19T19:06:24.692773] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-19T19:06:25.071960] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:25.102766] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T19:06:25.323941] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T19:06:25.443254] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-19T19:06:26.243279] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-19T19:06:26.594190] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T19:06:26.895793] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T19:06:27.043315] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-19T19:06:27.843266] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-19T19:06:28.220515] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T19:06:28.481017] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T19:06:28.488195] [INFO ] [REMOTE ] GOLF: Full fetch complete (44765 records). [2025-09-19T19:06:28.488358] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-19T19:06:28.648372] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-19T19:06:28.887281] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-19T19:06:28.887369] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-19T19:06:28.888137] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-19T19:06:28.888201] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-19T19:06:28.889251] [DEBUG] [LOCAL ] GOLF: Trimmed 44765 records to 32439 (keeping 200 days of data) [2025-09-19T19:06:29.105407] [DEBUG] [LOCAL ] GOLF: Primary data saved (32439 records). [2025-09-19T19:06:29.105547] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-19T19:06:29.105699] [INFO ] [MAIN ] Update Progress: 954/2372 symbols completed. GOLF took 26.7s. Estimated remaining: 3h 7m 54s. Rate: 7.5 symbols/min [2025-09-19T19:06:29.287274] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:29.318988] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T19:06:29.370904] [DEBUG] [LOCAL ] GPC: Loaded 47187 existing records from primary storage. [2025-09-19T19:06:29.371074] [INFO ] [MAIN ] GPC: Loaded 47187 existing records. [2025-09-19T19:06:29.452149] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-19T19:06:29.564534] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:29.564821] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-19T19:06:29.564876] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-19T19:06:29.566160] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-19T19:06:29.566226] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-19T19:06:29.930803] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:30.243269] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-19T19:06:30.515506] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T19:06:30.982776] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T19:06:31.043289] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-19T19:06:31.843282] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-19T19:06:32.128173] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T19:06:32.643277] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-19T19:06:32.899801] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:06:33.443264] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-19T19:06:33.786110] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T19:06:34.243259] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-19T19:06:34.734295] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T19:06:34.885836] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:06:35.043285] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-19T19:06:35.843271] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-19T19:06:36.086543] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:06:36.643257] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-19T19:06:36.822170] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T19:06:37.344684] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T19:06:37.443227] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-19T19:06:38.243319] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-19T19:06:38.436692] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T19:06:38.443625] [INFO ] [REMOTE ] GOF: Full fetch complete (62252 records). [2025-09-19T19:06:38.443769] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-19T19:06:38.834226] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-19T19:06:38.834328] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-19T19:06:38.835186] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-19T19:06:38.835252] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-19T19:06:38.836573] [DEBUG] [LOCAL ] GOF: Trimmed 62252 records to 43673 (keeping 200 days of data) [2025-09-19T19:06:39.062869] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-19T19:06:39.122817] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T19:06:39.173466] [DEBUG] [LOCAL ] GOF: Primary data saved (43673 records). [2025-09-19T19:06:39.173615] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-19T19:06:39.173763] [INFO ] [MAIN ] Update Progress: 955/2372 symbols completed. GOF took 45.3s. Estimated remaining: 3h 7m 49s. Rate: 7.5 symbols/min [2025-09-19T19:06:39.340772] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:39.357778] [DEBUG] [LOCAL ] GPI: Loaded 15301 existing records from primary storage. [2025-09-19T19:06:39.357932] [INFO ] [MAIN ] GPI: Loaded 15301 existing records. [2025-09-19T19:06:39.531372] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:39.531612] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-19T19:06:39.531689] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-19T19:06:39.532282] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-19T19:06:39.532343] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-19T19:06:39.853976] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-19T19:06:39.890824] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:40.363966] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:06:40.643271] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-19T19:06:41.009782] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T19:06:41.492524] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-19T19:06:41.513803] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:06:41.887086] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:06:42.243289] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-19T19:06:43.043286] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-19T19:06:43.379351] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:06:43.843296] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-19T19:06:44.065204] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T19:06:44.643320] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-19T19:06:44.711281] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T19:06:45.372926] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:06:45.379575] [INFO ] [REMOTE ] GOOS: Full fetch complete (66198 records). [2025-09-19T19:06:45.379760] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-19T19:06:45.449142] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-19T19:06:45.795436] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-19T19:06:45.795534] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-19T19:06:45.796407] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-19T19:06:45.796473] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-19T19:06:45.801303] [DEBUG] [LOCAL ] GOOS: Trimmed 66198 records to 46476 (keeping 200 days of data) [2025-09-19T19:06:46.089189] [DEBUG] [LOCAL ] GOOS: Primary data saved (46476 records). [2025-09-19T19:06:46.089530] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-19T19:06:46.089709] [INFO ] [MAIN ] Update Progress: 956/2372 symbols completed. GOOS took 30.5s. Estimated remaining: 3h 7m 40s. Rate: 7.5 symbols/min [2025-09-19T19:06:46.248149] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-19T19:06:46.268229] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:06:46.299399] [DEBUG] [LOCAL ] GPJA: Loaded 4052 existing records from primary storage. [2025-09-19T19:06:46.301505] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T19:06:46.301872] [INFO ] [MAIN ] GPJA: Loaded 4052 existing records. [2025-09-19T19:06:46.450470] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T19:06:46.515818] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:06:46.516116] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-19T19:06:46.516166] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-19T19:06:46.516705] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-19T19:06:46.516765] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-19T19:06:46.881958] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:06:47.043272] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-19T19:06:47.843274] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-19T19:06:48.003546] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T19:06:48.035493] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:06:48.554109] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T19:06:48.643294] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-19T19:06:49.443270] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-19T19:06:50.136396] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T19:06:50.243292] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-19T19:06:50.740170] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T19:06:51.042485] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T19:06:51.045321] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-19T19:06:51.843205] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-19T19:06:52.546411] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T19:06:52.643264] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-19T19:06:52.967102] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T19:06:53.088123] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-19T19:06:53.443268] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-19T19:06:54.243290] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-19T19:06:55.043302] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-19T19:06:55.349327] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:06:55.358349] [INFO ] [REMOTE ] GPC: Full fetch complete (69142 records). [2025-09-19T19:06:55.358564] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-19T19:06:55.800026] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T19:06:55.830503] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T19:06:55.844006] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-19T19:06:55.864201] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-19T19:06:55.865583] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-19T19:06:55.866670] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-19T19:06:55.866860] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-19T19:06:55.869397] [DEBUG] [LOCAL ] GPC: Trimmed 69142 records to 47474 (keeping 200 days of data) [2025-09-19T19:06:56.192790] [DEBUG] [LOCAL ] GPC: Primary data saved (47474 records). [2025-09-19T19:06:56.192942] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-19T19:06:56.193042] [INFO ] [MAIN ] Update Progress: 957/2372 symbols completed. GPC took 27.1s. Estimated remaining: 3h 7m 35s. Rate: 7.5 symbols/min [2025-09-19T19:06:56.643328] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-19T19:06:56.916058] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-19T19:06:57.443265] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-19T19:06:58.243271] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-19T19:06:58.288830] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T19:06:58.313440] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T19:06:58.832973] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-19T19:06:59.043287] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-19T19:06:59.813663] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T19:06:59.843223] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-19T19:07:00.569195] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T19:07:00.643298] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-19T19:07:01.347977] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T19:07:01.443318] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-19T19:07:02.243354] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-19T19:07:03.043351] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-19T19:07:03.080372] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T19:07:03.293739] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T19:07:03.295119] [INFO ] [REMOTE ] GPJA: Full fetch complete (7285 records). [2025-09-19T19:07:03.295194] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-19T19:07:03.675788] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-19T19:07:03.675893] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-19T19:07:03.676094] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-19T19:07:03.676145] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-19T19:07:03.676583] [DEBUG] [LOCAL ] GPJA: Trimmed 7285 records to 4084 (keeping 200 days of data) [2025-09-19T19:07:03.702220] [DEBUG] [LOCAL ] GPJA: Primary data saved (4084 records). [2025-09-19T19:07:03.702354] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-19T19:07:03.702444] [INFO ] [MAIN ] Update Progress: 958/2372 symbols completed. GPJA took 17.6s. Estimated remaining: 3h 7m 26s. Rate: 7.5 symbols/min [2025-09-19T19:07:03.843301] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-19T19:07:04.175036] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T19:07:04.643279] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-19T19:07:05.433020] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:07:05.438947] [INFO ] [REMOTE ] GOTU: Full fetch complete (59973 records). [2025-09-19T19:07:05.439116] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-19T19:07:05.830444] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-19T19:07:05.830556] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-19T19:07:05.831449] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-19T19:07:05.831515] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-19T19:07:05.832851] [DEBUG] [LOCAL ] GOTU: Trimmed 59973 records to 40002 (keeping 200 days of data) [2025-09-19T19:07:06.053004] [DEBUG] [LOCAL ] GOTU: Primary data saved (40002 records). [2025-09-19T19:07:06.053140] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-19T19:07:06.053234] [INFO ] [MAIN ] Update Progress: 959/2372 symbols completed. GOTU took 41.8s. Estimated remaining: 3h 7m 10s. Rate: 7.5 symbols/min [2025-09-19T19:07:06.126821] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T19:07:06.131333] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-19T19:07:07.385956] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:07:07.389278] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-19T19:07:08.471403] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T19:07:08.474108] [INFO ] [REMOTE ] GPI: Full fetch complete (20862 records). [2025-09-19T19:07:08.474190] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-19T19:07:08.845771] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-19T19:07:08.845855] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-19T19:07:08.846403] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-19T19:07:08.846476] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-19T19:07:08.847213] [DEBUG] [LOCAL ] GPI: Trimmed 20862 records to 15365 (keeping 200 days of data) [2025-09-19T19:07:08.942278] [DEBUG] [LOCAL ] GPI: Primary data saved (15365 records). [2025-09-19T19:07:08.942428] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-19T19:07:08.942530] [INFO ] [MAIN ] Update Progress: 960/2372 symbols completed. GPI took 29.8s. Estimated remaining: 3h 6m 55s. Rate: 7.6 symbols/min [2025-09-19T19:07:09.540999] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:09.563275] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:09.700691] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:09.722605] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:09.748260] [DEBUG] [LOCAL ] GPOR: Loaded 23255 existing records from primary storage. [2025-09-19T19:07:09.748479] [INFO ] [MAIN ] GPOR: Loaded 23255 existing records. [2025-09-19T19:07:09.864236] [DEBUG] [LOCAL ] GPMT: Loaded 27022 existing records from primary storage. [2025-09-19T19:07:09.917852] [INFO ] [MAIN ] GPMT: Loaded 27022 existing records. [2025-09-19T19:07:10.031152] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:10.068437] [DEBUG] [LOCAL ] GPN: Loaded 52458 existing records from primary storage. [2025-09-19T19:07:10.068575] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-19T19:07:10.089830] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-19T19:07:10.089582] [INFO ] [MAIN ] GPN: Loaded 52458 existing records. [2025-09-19T19:07:10.148817] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-19T19:07:10.187406] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-19T19:07:10.188210] [DEBUG] [LOCAL ] GPK: Loaded 53057 existing records from primary storage. [2025-09-19T19:07:10.275219] [INFO ] [MAIN ] GPK: Loaded 53057 existing records. [2025-09-19T19:07:10.407575] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:10.509768] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-19T19:07:10.550981] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-19T19:07:10.597187] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-19T19:07:10.607750] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-19T19:07:10.597326] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:10.706952] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-19T19:07:10.707099] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-19T19:07:10.877226] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-19T19:07:10.877326] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:10.897712] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-19T19:07:10.972703] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-19T19:07:10.992673] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-19T19:07:11.056838] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-19T19:07:11.067196] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-19T19:07:11.458436] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:11.501557] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-19T19:07:11.987859] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:11.991322] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-19T19:07:11.990783] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:11.997671] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-19T19:07:12.073481] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:12.073770] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-19T19:07:13.062775] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T19:07:13.071602] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-19T19:07:13.340750] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T19:07:13.351314] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-19T19:07:13.509557] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T19:07:13.515742] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-19T19:07:14.117024] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T19:07:14.127344] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-19T19:07:14.609017] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T19:07:14.615559] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-19T19:07:14.630062] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T19:07:14.635778] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-19T19:07:15.570868] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T19:07:15.576291] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-19T19:07:15.591676] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T19:07:15.656564] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T19:07:15.843263] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-19T19:07:16.072969] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T19:07:16.359498] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T19:07:16.643284] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-19T19:07:17.330861] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:07:17.443264] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-19T19:07:18.243306] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-19T19:07:18.794569] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T19:07:19.043292] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-19T19:07:19.384396] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T19:07:19.537259] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T19:07:19.843296] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-19T19:07:20.598359] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:07:20.643219] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-19T19:07:21.349332] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:07:21.443234] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-19T19:07:22.215784] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T19:07:22.243246] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-19T19:07:22.985765] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:07:23.043230] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-19T19:07:23.546692] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T19:07:23.843362] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-19T19:07:24.643313] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-19T19:07:24.985087] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T19:07:25.443293] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-19T19:07:25.836258] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:07:25.874081] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T19:07:26.243368] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-19T19:07:26.982089] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T19:07:27.043277] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-19T19:07:27.683517] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T19:07:27.843311] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-19T19:07:28.643287] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-19T19:07:28.710524] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T19:07:29.023709] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T19:07:29.443298] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-19T19:07:29.884865] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T19:07:30.243322] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-19T19:07:30.587683] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T19:07:30.591043] [INFO ] [REMOTE ] GPMT: Full fetch complete (38103 records). [2025-09-19T19:07:30.591177] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-19T19:07:30.992966] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-19T19:07:30.993107] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-19T19:07:30.994311] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-19T19:07:30.994386] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-19T19:07:30.995758] [DEBUG] [LOCAL ] GPMT: Trimmed 38103 records to 27210 (keeping 200 days of data) [2025-09-19T19:07:31.046928] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-19T19:07:31.171013] [DEBUG] [LOCAL ] GPMT: Primary data saved (27210 records). [2025-09-19T19:07:31.171219] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-19T19:07:31.171352] [INFO ] [MAIN ] Update Progress: 961/2372 symbols completed. GPMT took 22.2s. Estimated remaining: 3h 7m 8s. Rate: 7.5 symbols/min [2025-09-19T19:07:31.357874] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:31.407319] [DEBUG] [LOCAL ] GPRK: Loaded 39501 existing records from primary storage. [2025-09-19T19:07:31.407488] [INFO ] [MAIN ] GPRK: Loaded 39501 existing records. [2025-09-19T19:07:31.585190] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:31.585487] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-19T19:07:31.585548] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-19T19:07:31.587300] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-19T19:07:31.587361] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-19T19:07:31.848614] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-19T19:07:31.960107] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:32.395009] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T19:07:32.425175] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T19:07:32.643273] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-19T19:07:33.443270] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-19T19:07:33.994611] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T19:07:34.243289] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-19T19:07:34.400887] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T19:07:35.043303] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-19T19:07:35.159881] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T19:07:35.405757] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T19:07:35.843278] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-19T19:07:36.643261] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-19T19:07:36.772043] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T19:07:37.443295] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-19T19:07:37.938099] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:07:37.965220] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:07:37.969515] [INFO ] [REMOTE ] GPOR: Full fetch complete (34854 records). [2025-09-19T19:07:37.969637] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-19T19:07:38.250705] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-19T19:07:38.352864] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-19T19:07:38.352955] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-19T19:07:38.353706] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-19T19:07:38.353771] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-19T19:07:38.354779] [DEBUG] [LOCAL ] GPOR: Trimmed 34854 records to 23489 (keeping 200 days of data) [2025-09-19T19:07:38.496403] [DEBUG] [LOCAL ] GPOR: Primary data saved (23489 records). [2025-09-19T19:07:38.496536] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-19T19:07:38.496621] [INFO ] [MAIN ] Update Progress: 962/2372 symbols completed. GPOR took 29.6s. Estimated remaining: 3h 6m 59s. Rate: 7.5 symbols/min [2025-09-19T19:07:38.676061] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:38.702323] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T19:07:38.732159] [DEBUG] [LOCAL ] GRBK: Loaded 27495 existing records from primary storage. [2025-09-19T19:07:38.732327] [INFO ] [MAIN ] GRBK: Loaded 27495 existing records. [2025-09-19T19:07:38.964244] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:38.964550] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-19T19:07:38.964715] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-19T19:07:38.965740] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-19T19:07:38.965802] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-19T19:07:39.048431] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-19T19:07:39.360639] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:39.843251] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-19T19:07:40.338345] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:07:40.552390] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T19:07:40.643240] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-19T19:07:41.443271] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-19T19:07:41.787732] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T19:07:42.167262] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-19T19:07:42.175406] [INFO ] [REMOTE ] GPK: Full fetch complete (75364 records). [2025-09-19T19:07:42.175544] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-19T19:07:42.248451] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-19T19:07:42.623065] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-19T19:07:42.623152] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-19T19:07:42.624214] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-19T19:07:42.624279] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-19T19:07:42.625856] [DEBUG] [LOCAL ] GPK: Trimmed 75364 records to 53444 (keeping 200 days of data) [2025-09-19T19:07:42.877754] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:07:43.006778] [DEBUG] [LOCAL ] GPK: Primary data saved (53444 records). [2025-09-19T19:07:43.007126] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-19T19:07:43.007460] [INFO ] [MAIN ] Update Progress: 963/2372 symbols completed. GPK took 34.1s. Estimated remaining: 3h 6m 46s. Rate: 7.5 symbols/min [2025-09-19T19:07:43.048462] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-19T19:07:43.198614] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:43.209045] [DEBUG] [LOCAL ] GRC: Loaded 8903 existing records from primary storage. [2025-09-19T19:07:43.209182] [INFO ] [MAIN ] GRC: Loaded 8903 existing records. [2025-09-19T19:07:43.407505] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:43.407824] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-19T19:07:43.407875] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-19T19:07:43.408246] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-19T19:07:43.408311] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-19T19:07:43.791109] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:43.808417] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T19:07:43.843215] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-19T19:07:44.643268] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-19T19:07:45.045238] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T19:07:45.129631] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T19:07:45.443284] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-19T19:07:45.612204] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:07:46.243280] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-19T19:07:47.001020] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:07:47.020538] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-19T19:07:47.043345] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-19T19:07:47.843333] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-19T19:07:48.643313] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-19T19:07:48.798420] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:07:48.929937] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T19:07:49.443266] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-19T19:07:50.243273] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-19T19:07:50.655022] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T19:07:50.663526] [INFO ] [REMOTE ] GPN: Full fetch complete (74790 records). [2025-09-19T19:07:50.663762] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-19T19:07:51.045819] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-19T19:07:51.089033] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-19T19:07:51.089259] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-19T19:07:51.090367] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-19T19:07:51.090670] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-19T19:07:51.099988] [DEBUG] [LOCAL ] GPN: Trimmed 74790 records to 52839 (keeping 200 days of data) [2025-09-19T19:07:51.115240] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T19:07:51.251639] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T19:07:51.484900] [DEBUG] [LOCAL ] GPN: Primary data saved (52839 records). [2025-09-19T19:07:51.485069] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-19T19:07:51.485194] [INFO ] [MAIN ] Update Progress: 964/2372 symbols completed. GPN took 42.5s. Estimated remaining: 3h 6m 39s. Rate: 7.5 symbols/min [2025-09-19T19:07:51.654754] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:07:51.674512] [DEBUG] [LOCAL ] GRDN: Loaded 19403 existing records from primary storage. [2025-09-19T19:07:51.674669] [INFO ] [MAIN ] GRDN: Loaded 19403 existing records. [2025-09-19T19:07:51.848423] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-19T19:07:51.852694] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:07:51.854068] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-19T19:07:51.854128] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-19T19:07:51.854905] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-19T19:07:51.854968] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-19T19:07:51.979863] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:07:52.253761] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:07:52.643275] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-19T19:07:53.295366] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:07:53.311060] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T19:07:53.443270] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-19T19:07:54.243270] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-19T19:07:54.986779] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T19:07:55.001507] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T19:07:55.043278] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-19T19:07:55.843262] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-19T19:07:56.643270] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-19T19:07:56.772321] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T19:07:57.177900] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T19:07:57.232808] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-19T19:07:57.443256] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-19T19:07:58.243297] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-19T19:07:59.030091] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T19:07:59.043230] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-19T19:07:59.573076] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:07:59.843223] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-19T19:08:00.363325] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:08:00.367688] [INFO ] [REMOTE ] GRBK: Full fetch complete (40721 records). [2025-09-19T19:08:00.367849] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-19T19:08:00.648451] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-19T19:08:00.763797] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-19T19:08:00.763878] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-19T19:08:00.764613] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-19T19:08:00.764682] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-19T19:08:00.765589] [DEBUG] [LOCAL ] GRBK: Trimmed 40721 records to 27675 (keeping 200 days of data) [2025-09-19T19:08:00.935343] [DEBUG] [LOCAL ] GRBK: Primary data saved (27675 records). [2025-09-19T19:08:00.935478] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-19T19:08:00.935560] [INFO ] [MAIN ] Update Progress: 965/2372 symbols completed. GRBK took 22.4s. Estimated remaining: 3h 6m 33s. Rate: 7.5 symbols/min [2025-09-19T19:08:01.107827] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:01.153759] [DEBUG] [LOCAL ] GRMN: Loaded 41972 existing records from primary storage. [2025-09-19T19:08:01.153907] [INFO ] [MAIN ] GRMN: Loaded 41972 existing records. [2025-09-19T19:08:01.338459] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:01.338828] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-19T19:08:01.338907] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-19T19:08:01.341035] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-19T19:08:01.341107] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-19T19:08:01.447894] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-19T19:08:01.575240] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T19:08:01.737620] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T19:08:01.780882] [INFO ] [REMOTE ] GPRK: Full fetch complete (57245 records). [2025-09-19T19:08:01.803924] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-19T19:08:01.803833] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:02.199929] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-19T19:08:02.200027] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-19T19:08:02.200949] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-19T19:08:02.201031] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-19T19:08:02.202438] [DEBUG] [LOCAL ] GPRK: Trimmed 57245 records to 39827 (keeping 200 days of data) [2025-09-19T19:08:02.256346] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-19T19:08:02.445521] [DEBUG] [LOCAL ] GPRK: Primary data saved (39827 records). [2025-09-19T19:08:02.445712] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-19T19:08:02.446794] [INFO ] [MAIN ] Update Progress: 966/2372 symbols completed. GPRK took 31.3s. Estimated remaining: 3h 6m 16s. Rate: 7.5 symbols/min [2025-09-19T19:08:02.622461] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:02.677905] [DEBUG] [LOCAL ] GRND: Loaded 50546 existing records from primary storage. [2025-09-19T19:08:02.678113] [INFO ] [MAIN ] GRND: Loaded 50546 existing records. [2025-09-19T19:08:02.854770] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:08:02.881472] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:02.881760] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-19T19:08:02.881854] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-19T19:08:02.883334] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-19T19:08:02.883398] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-19T19:08:03.048480] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-19T19:08:03.270077] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:03.278187] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-19T19:08:03.843284] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-19T19:08:04.112499] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T19:08:04.486904] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-19T19:08:04.643257] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-19T19:08:05.443278] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-19T19:08:05.534991] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T19:08:05.536988] [INFO ] [REMOTE ] GRC: Full fetch complete (12932 records). [2025-09-19T19:08:05.537061] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-19T19:08:05.919865] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-19T19:08:05.919949] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-19T19:08:05.920268] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-19T19:08:05.920310] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-19T19:08:05.920857] [DEBUG] [LOCAL ] GRC: Trimmed 12932 records to 8977 (keeping 200 days of data) [2025-09-19T19:08:05.982473] [DEBUG] [LOCAL ] GRC: Primary data saved (8977 records). [2025-09-19T19:08:05.982660] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-19T19:08:05.982774] [INFO ] [MAIN ] Update Progress: 967/2372 symbols completed. GRC took 23.0s. Estimated remaining: 3h 6m 1s. Rate: 7.6 symbols/min [2025-09-19T19:08:06.149151] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:06.182092] [DEBUG] [LOCAL ] GRNT: Loaded 34239 existing records from primary storage. [2025-09-19T19:08:06.182248] [INFO ] [MAIN ] GRNT: Loaded 34239 existing records. [2025-09-19T19:08:06.248512] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-19T19:08:06.361769] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:06.362046] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-19T19:08:06.362098] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-19T19:08:06.363249] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-19T19:08:06.363311] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-19T19:08:06.724303] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:07.043284] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-19T19:08:07.232128] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T19:08:07.369139] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T19:08:07.843278] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-19T19:08:08.643270] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-19T19:08:08.701667] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T19:08:08.955630] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T19:08:09.443274] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-19T19:08:10.000942] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T19:08:10.230102] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T19:08:10.243222] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-19T19:08:11.043288] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-19T19:08:11.404622] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T19:08:11.843264] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-19T19:08:12.454931] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:08:12.643264] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-19T19:08:13.410260] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:08:13.443235] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-19T19:08:14.243290] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-19T19:08:14.558922] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:08:14.741945] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T19:08:15.043279] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-19T19:08:15.843309] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-19T19:08:16.066245] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T19:08:16.643268] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-19T19:08:16.693781] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:08:17.443309] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-19T19:08:17.819887] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T19:08:18.070485] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T19:08:18.243257] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-19T19:08:18.664427] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T19:08:19.043264] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-19T19:08:19.730400] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T19:08:19.843279] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-19T19:08:20.466753] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T19:08:20.643261] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-19T19:08:21.072611] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T19:08:21.443282] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-19T19:08:22.096729] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T19:08:22.243263] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-19T19:08:23.043274] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-19T19:08:23.125874] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:08:23.843313] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-19T19:08:24.231024] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:08:24.573751] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:08:24.578596] [INFO ] [REMOTE ] GRDN: Full fetch complete (25738 records). [2025-09-19T19:08:24.578761] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-19T19:08:24.648430] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-19T19:08:24.981750] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-19T19:08:24.981891] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-19T19:08:24.982622] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-19T19:08:24.982721] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-19T19:08:24.983578] [DEBUG] [LOCAL ] GRDN: Trimmed 25738 records to 19583 (keeping 200 days of data) [2025-09-19T19:08:25.107701] [DEBUG] [LOCAL ] GRDN: Primary data saved (19583 records). [2025-09-19T19:08:25.107849] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-19T19:08:25.107961] [INFO ] [MAIN ] Update Progress: 968/2372 symbols completed. GRDN took 33.6s. Estimated remaining: 3h 6m 9s. Rate: 7.5 symbols/min [2025-09-19T19:08:25.278323] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:25.289225] [DEBUG] [LOCAL ] GROV: Loaded 9242 existing records from primary storage. [2025-09-19T19:08:25.289338] [INFO ] [MAIN ] GROV: Loaded 9242 existing records. [2025-09-19T19:08:25.448037] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-19T19:08:25.469544] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:25.470840] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-19T19:08:25.470892] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-19T19:08:25.471256] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-19T19:08:25.471375] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-19T19:08:25.853370] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T19:08:25.893836] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:26.061282] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T19:08:26.243302] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-19T19:08:26.907822] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T19:08:27.043314] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-19T19:08:27.331023] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T19:08:27.843314] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-19T19:08:28.643273] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-19T19:08:29.030805] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:08:29.066487] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T19:08:29.443267] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-19T19:08:29.854291] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:08:30.243320] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-19T19:08:30.995866] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:08:31.043224] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-19T19:08:31.285878] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T19:08:31.843282] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-19T19:08:32.500903] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T19:08:32.643240] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-19T19:08:32.955918] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T19:08:33.443262] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-19T19:08:33.833523] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T19:08:34.243270] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-19T19:08:35.043262] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-19T19:08:35.375879] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T19:08:35.483573] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T19:08:35.843295] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-19T19:08:36.388135] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T19:08:36.643274] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-19T19:08:36.760866] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T19:08:37.443307] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-19T19:08:38.136432] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:08:38.148827] [INFO ] [REMOTE ] GRND: Full fetch complete (70139 records). [2025-09-19T19:08:38.149088] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-19T19:08:38.251254] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-19T19:08:38.548715] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-19T19:08:38.548833] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-19T19:08:38.549877] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-19T19:08:38.549973] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-19T19:08:38.551532] [DEBUG] [LOCAL ] GRND: Trimmed 70139 records to 50876 (keeping 200 days of data) [2025-09-19T19:08:38.875589] [DEBUG] [LOCAL ] GRND: Primary data saved (50876 records). [2025-09-19T19:08:38.875768] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-19T19:08:38.876214] [INFO ] [MAIN ] Update Progress: 969/2372 symbols completed. GRND took 36.4s. Estimated remaining: 3h 6m 10s. Rate: 7.5 symbols/min [2025-09-19T19:08:39.057573] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:39.053850] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-19T19:08:39.075523] [DEBUG] [LOCAL ] GRX: Loaded 4423 existing records from primary storage. [2025-09-19T19:08:39.075697] [INFO ] [MAIN ] GRX: Loaded 4423 existing records. [2025-09-19T19:08:39.258470] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:39.259323] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-19T19:08:39.259403] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-19T19:08:39.259894] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-19T19:08:39.259991] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-19T19:08:39.356477] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:08:39.391807] [INFO ] [REMOTE ] GRMN: Full fetch complete (60315 records). [2025-09-19T19:08:39.431725] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-19T19:08:39.572352] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:08:39.639106] [INFO ] [REMOTE ] GRNT: Full fetch complete (48407 records). [2025-09-19T19:08:39.644448] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-19T19:08:40.102891] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:40.164844] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-19T19:08:40.211391] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T19:08:40.383044] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-19T19:08:40.399292] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-19T19:08:40.408270] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-19T19:08:40.408359] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-19T19:08:40.462278] [DEBUG] [LOCAL ] GRMN: Trimmed 60315 records to 42296 (keeping 200 days of data) [2025-09-19T19:08:40.556353] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-19T19:08:40.565963] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-19T19:08:40.566886] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-19T19:08:40.593007] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-19T19:08:40.608014] [DEBUG] [LOCAL ] GRNT: Trimmed 48407 records to 34483 (keeping 200 days of data) [2025-09-19T19:08:40.671334] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-19T19:08:40.968197] [DEBUG] [LOCAL ] GRNT: Primary data saved (34483 records). [2025-09-19T19:08:40.969174] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-19T19:08:40.969808] [INFO ] [MAIN ] Update Progress: 970/2372 symbols completed. GRNT took 35.0s. Estimated remaining: 3h 5m 53s. Rate: 7.5 symbols/min [2025-09-19T19:08:41.119567] [DEBUG] [LOCAL ] GRMN: Primary data saved (42296 records). [2025-09-19T19:08:41.136321] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-19T19:08:41.131028] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:08:41.136628] [INFO ] [MAIN ] Update Progress: 971/2372 symbols completed. GRMN took 40.2s. Estimated remaining: 3h 5m 34s. Rate: 7.5 symbols/min [2025-09-19T19:08:41.338592] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:41.439960] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:41.443250] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-19T19:08:41.526027] [DEBUG] [LOCAL ] GSBD: Loaded 39568 existing records from primary storage. [2025-09-19T19:08:41.526916] [INFO ] [MAIN ] GSBD: Loaded 39568 existing records. [2025-09-19T19:08:41.527198] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T19:08:41.528426] [DEBUG] [LOCAL ] GS: Loaded 52557 existing records from primary storage. [2025-09-19T19:08:41.561083] [INFO ] [MAIN ] GS: Loaded 52557 existing records. [2025-09-19T19:08:41.910766] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:41.917213] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-19T19:08:41.917314] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-19T19:08:41.916968] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:41.917591] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-19T19:08:41.917673] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-19T19:08:41.918415] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-19T19:08:41.918506] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-19T19:08:41.952317] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-19T19:08:41.969778] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-19T19:08:42.033156] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-19T19:08:42.263898] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-19T19:08:42.674159] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:42.669060] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:43.043274] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-19T19:08:43.548992] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T19:08:43.843273] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-19T19:08:44.643283] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-19T19:08:44.924251] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T19:08:45.334840] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T19:08:45.443271] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-19T19:08:45.708940] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T19:08:46.243283] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-19T19:08:47.043272] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-19T19:08:47.796539] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-19T19:08:47.843226] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-19T19:08:47.952757] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T19:08:48.231164] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:08:48.643287] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-19T19:08:49.443325] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-19T19:08:50.037492] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-19T19:08:50.083761] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-19T19:08:50.243259] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-19T19:08:50.291812] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T19:08:51.043291] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-19T19:08:51.843296] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-19T19:08:52.646297] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T19:08:52.646098] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-19T19:08:52.648999] [INFO ] [REMOTE ] GROV: Full fetch complete (14758 records). [2025-09-19T19:08:52.649139] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-19T19:08:52.791865] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-19T19:08:53.076038] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-19T19:08:53.076282] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-19T19:08:53.076692] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-19T19:08:53.076870] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-19T19:08:53.077609] [DEBUG] [LOCAL ] GROV: Trimmed 14758 records to 9258 (keeping 200 days of data) [2025-09-19T19:08:53.146798] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T19:08:53.166717] [DEBUG] [LOCAL ] GROV: Primary data saved (9258 records). [2025-09-19T19:08:53.166830] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-19T19:08:53.166911] [INFO ] [MAIN ] Update Progress: 972/2372 symbols completed. GROV took 28.1s. Estimated remaining: 3h 5m 32s. Rate: 7.5 symbols/min [2025-09-19T19:08:53.335720] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:08:53.402270] [DEBUG] [LOCAL ] GSK: Loaded 53892 existing records from primary storage. [2025-09-19T19:08:53.402432] [INFO ] [MAIN ] GSK: Loaded 53892 existing records. [2025-09-19T19:08:53.446598] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-19T19:08:53.524088] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T19:08:53.606102] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:08:53.606422] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-19T19:08:53.606472] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-19T19:08:53.607980] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-19T19:08:53.608044] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-19T19:08:53.974697] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:08:54.243268] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-19T19:08:55.043245] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-19T19:08:55.365172] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T19:08:55.843308] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-19T19:08:56.301330] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T19:08:56.643278] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-19T19:08:57.443239] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-19T19:08:57.489731] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T19:08:57.600493] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:08:58.187162] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:08:58.243405] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-19T19:08:58.684495] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T19:08:59.043382] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-19T19:08:59.843265] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-19T19:09:00.647421] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-19T19:09:00.651317] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-19T19:09:00.686806] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:09:01.309759] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T19:09:01.443256] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-19T19:09:01.564216] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T19:09:02.243321] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-19T19:09:03.043298] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-19T19:09:03.843279] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-19T19:09:04.493460] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T19:09:04.643262] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-19T19:09:05.236338] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-09-19T19:09:05.251213] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T19:09:05.388400] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (3.95 seconds). [2025-09-19T19:09:05.443219] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-19T19:09:06.031415] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-09-19T19:09:06.243297] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-19T19:09:07.043302] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-19T19:09:07.558266] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:09:07.843304] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-19T19:09:08.554901] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T19:09:08.643251] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-19T19:09:08.701815] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T19:09:09.443307] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-19T19:09:10.211616] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T19:09:10.243246] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-19T19:09:10.834593] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T19:09:11.035086] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:09:11.041422] [INFO ] [REMOTE ] GSBD: Full fetch complete (58411 records). [2025-09-19T19:09:11.041597] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-19T19:09:11.053999] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-19T19:09:11.453502] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-19T19:09:11.453764] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-19T19:09:11.454850] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-19T19:09:11.454926] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-19T19:09:11.456770] [DEBUG] [LOCAL ] GSBD: Trimmed 58411 records to 39847 (keeping 200 days of data) [2025-09-19T19:09:11.732135] [DEBUG] [LOCAL ] GSBD: Primary data saved (39847 records). [2025-09-19T19:09:11.732334] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-19T19:09:11.732518] [INFO ] [MAIN ] Update Progress: 973/2372 symbols completed. GSBD took 30.6s. Estimated remaining: 3h 5m 39s. Rate: 7.5 symbols/min [2025-09-19T19:09:11.853389] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-19T19:09:11.939625] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:11.963602] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T19:09:11.976118] [INFO ] [REMOTE ] GRX: Full fetch complete (6479 records). [2025-09-19T19:09:11.976357] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-19T19:09:12.144848] [DEBUG] [LOCAL ] GSL: Loaded 34128 existing records from primary storage. [2025-09-19T19:09:12.161123] [INFO ] [MAIN ] GSL: Loaded 34128 existing records. [2025-09-19T19:09:12.516998] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-19T19:09:12.529412] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-19T19:09:12.535093] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-19T19:09:12.540668] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-19T19:09:12.574942] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:12.575265] [DEBUG] [LOCAL ] GRX: Trimmed 6479 records to 4454 (keeping 200 days of data) [2025-09-19T19:09:12.597407] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-19T19:09:12.598287] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-19T19:09:12.612308] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-19T19:09:12.612598] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-19T19:09:12.622993] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-19T19:09:12.641723] [INFO ] [REMOTE ] GS: Full fetch complete (75895 records). [2025-09-19T19:09:12.661724] [DEBUG] [LOCAL ] GRX: Primary data saved (4454 records). [2025-09-19T19:09:12.674320] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-19T19:09:12.693097] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-19T19:09:12.693543] [INFO ] [MAIN ] Update Progress: 974/2372 symbols completed. GRX took 33.8s. Estimated remaining: 3h 5m 21s. Rate: 7.5 symbols/min [2025-09-19T19:09:13.363517] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:13.581817] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:13.586517] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-19T19:09:13.690015] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-19T19:09:13.690327] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-19T19:09:13.705037] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-19T19:09:13.705195] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-19T19:09:13.706959] [DEBUG] [LOCAL ] GS: Trimmed 75895 records to 52916 (keeping 200 days of data) [2025-09-19T19:09:13.791379] [DEBUG] [LOCAL ] GTES: Loaded 51111 existing records from primary storage. [2025-09-19T19:09:13.819508] [INFO ] [MAIN ] GTES: Loaded 51111 existing records. [2025-09-19T19:09:14.035228] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:14.036840] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-19T19:09:14.039521] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-19T19:09:14.101284] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-19T19:09:14.110625] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-19T19:09:14.562005] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:14.564420] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-19T19:09:14.661427] [DEBUG] [LOCAL ] GS: Primary data saved (52916 records). [2025-09-19T19:09:14.661556] [INFO ] [MAIN ] GS: Full history saved. [2025-09-19T19:09:14.661671] [INFO ] [MAIN ] Update Progress: 975/2372 symbols completed. GS took 33.7s. Estimated remaining: 3h 5m 5s. Rate: 7.5 symbols/min [2025-09-19T19:09:14.829032] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:14.877214] [DEBUG] [LOCAL ] GTLS: Loaded 43542 existing records from primary storage. [2025-09-19T19:09:14.877375] [INFO ] [MAIN ] GTLS: Loaded 43542 existing records. [2025-09-19T19:09:15.056848] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:15.057220] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-19T19:09:15.057298] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-19T19:09:15.058674] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-19T19:09:15.058739] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-19T19:09:15.392408] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (3.54 seconds). [2025-09-19T19:09:15.455119] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-19T19:09:15.499325] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:15.499673] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-19T19:09:16.010513] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T19:09:16.017531] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-19T19:09:16.053585] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T19:09:16.643288] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-19T19:09:16.743933] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:09:17.260037] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T19:09:17.397810] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T19:09:17.443228] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-19T19:09:18.243272] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-19T19:09:18.393007] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T19:09:19.043233] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-19T19:09:19.533445] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:09:19.625833] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T19:09:19.843264] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-19T19:09:20.643266] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-19T19:09:20.788457] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T19:09:21.443274] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-19T19:09:21.526981] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:09:22.243259] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-19T19:09:22.705814] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T19:09:22.801214] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T19:09:22.810172] [INFO ] [REMOTE ] GSK: Full fetch complete (77480 records). [2025-09-19T19:09:22.810300] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-19T19:09:23.048434] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-19T19:09:23.202797] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-19T19:09:23.202896] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-19T19:09:23.203874] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-19T19:09:23.203976] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-19T19:09:23.205675] [DEBUG] [LOCAL ] GSK: Trimmed 77480 records to 54278 (keeping 200 days of data) [2025-09-19T19:09:23.565002] [DEBUG] [LOCAL ] GSK: Primary data saved (54278 records). [2025-09-19T19:09:23.565202] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-19T19:09:23.565314] [INFO ] [MAIN ] Update Progress: 976/2372 symbols completed. GSK took 30.4s. Estimated remaining: 3h 4m 58s. Rate: 7.5 symbols/min [2025-09-19T19:09:23.789826] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:23.834975] [DEBUG] [LOCAL ] GTN: Loaded 46167 existing records from primary storage. [2025-09-19T19:09:23.835134] [INFO ] [MAIN ] GTN: Loaded 46167 existing records. [2025-09-19T19:09:23.866584] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-19T19:09:24.025430] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T19:09:24.073491] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:24.073781] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-19T19:09:24.073850] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-19T19:09:24.075225] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-19T19:09:24.075290] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-19T19:09:24.449662] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:24.643321] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-19T19:09:24.864486] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T19:09:25.443251] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-19T19:09:25.978933] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:09:26.034060] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T19:09:26.243269] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-19T19:09:26.818457] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T19:09:27.043272] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-19T19:09:27.848774] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-19T19:09:27.855973] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T19:09:28.643278] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-19T19:09:28.866481] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T19:09:29.218472] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:09:29.443277] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-19T19:09:30.202210] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T19:09:30.243224] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-19T19:09:30.921578] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T19:09:31.043267] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-19T19:09:31.843272] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-19T19:09:31.865832] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T19:09:32.391168] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T19:09:32.643265] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-19T19:09:33.443265] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-19T19:09:33.590337] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T19:09:34.045496] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T19:09:34.243297] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-19T19:09:35.043269] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-19T19:09:35.084970] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T19:09:35.659786] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T19:09:35.843232] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-19T19:09:36.643253] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-19T19:09:36.818873] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T19:09:37.309145] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T19:09:37.443278] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-19T19:09:37.778199] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T19:09:37.783344] [INFO ] [REMOTE ] GSL: Full fetch complete (48298 records). [2025-09-19T19:09:37.783453] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-19T19:09:38.157858] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-19T19:09:38.157945] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-19T19:09:38.158639] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-19T19:09:38.158727] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-19T19:09:38.159755] [DEBUG] [LOCAL ] GSL: Trimmed 48298 records to 34370 (keeping 200 days of data) [2025-09-19T19:09:38.247465] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-19T19:09:38.370579] [DEBUG] [LOCAL ] GSL: Primary data saved (34370 records). [2025-09-19T19:09:38.370750] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-19T19:09:38.370846] [INFO ] [MAIN ] Update Progress: 977/2372 symbols completed. GSL took 26.6s. Estimated remaining: 3h 5m 0s. Rate: 7.5 symbols/min [2025-09-19T19:09:38.536603] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:38.567061] [DEBUG] [LOCAL ] GTY: Loaded 30629 existing records from primary storage. [2025-09-19T19:09:38.567233] [INFO ] [MAIN ] GTY: Loaded 30629 existing records. [2025-09-19T19:09:38.747895] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:38.748198] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-19T19:09:38.748253] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-19T19:09:38.749207] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-19T19:09:38.749268] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-19T19:09:39.044698] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-19T19:09:39.125720] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:39.149748] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T19:09:39.158554] [INFO ] [REMOTE ] GTES: Full fetch complete (74009 records). [2025-09-19T19:09:39.158805] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-19T19:09:39.555858] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-19T19:09:39.556086] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-19T19:09:39.557116] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-19T19:09:39.557199] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-19T19:09:39.558823] [DEBUG] [LOCAL ] GTES: Trimmed 74009 records to 51492 (keeping 200 days of data) [2025-09-19T19:09:39.668313] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T19:09:39.852684] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-19T19:09:39.895470] [DEBUG] [LOCAL ] GTES: Primary data saved (51492 records). [2025-09-19T19:09:39.895591] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-19T19:09:39.895696] [INFO ] [MAIN ] Update Progress: 978/2372 symbols completed. GTES took 27.2s. Estimated remaining: 3h 4m 43s. Rate: 7.5 symbols/min [2025-09-19T19:09:40.067902] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:40.081585] [DEBUG] [LOCAL ] GUG: Loaded 12397 existing records from primary storage. [2025-09-19T19:09:40.081748] [INFO ] [MAIN ] GUG: Loaded 12397 existing records. [2025-09-19T19:09:40.261464] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:40.261747] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-19T19:09:40.261813] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-19T19:09:40.262248] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-19T19:09:40.262306] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-19T19:09:40.621220] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:40.645266] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-19T19:09:40.647688] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T19:09:40.678182] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T19:09:41.443261] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-19T19:09:42.104303] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T19:09:42.243253] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-19T19:09:43.043263] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-19T19:09:43.324079] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T19:09:43.703418] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T19:09:43.843214] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-19T19:09:44.287879] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:09:44.643262] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-19T19:09:45.309247] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:09:45.443264] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-19T19:09:45.907776] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T19:09:46.243275] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-19T19:09:47.043319] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-19T19:09:47.197535] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T19:09:47.381079] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T19:09:47.388435] [INFO ] [REMOTE ] GTLS: Full fetch complete (61451 records). [2025-09-19T19:09:47.388605] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-19T19:09:47.773221] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-19T19:09:47.773362] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-19T19:09:47.774208] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-19T19:09:47.774270] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-19T19:09:47.775476] [DEBUG] [LOCAL ] GTLS: Trimmed 61451 records to 43830 (keeping 200 days of data) [2025-09-19T19:09:47.860845] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-19T19:09:48.040368] [DEBUG] [LOCAL ] GTLS: Primary data saved (43830 records). [2025-09-19T19:09:48.040499] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-19T19:09:48.040582] [INFO ] [MAIN ] Update Progress: 979/2372 symbols completed. GTLS took 33.4s. Estimated remaining: 3h 4m 35s. Rate: 7.5 symbols/min [2025-09-19T19:09:48.217696] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:09:48.237871] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T19:09:48.255179] [DEBUG] [LOCAL ] GUT: Loaded 15707 existing records from primary storage. [2025-09-19T19:09:48.255286] [INFO ] [MAIN ] GUT: Loaded 15707 existing records. [2025-09-19T19:09:48.431064] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:09:48.431308] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-19T19:09:48.431367] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-19T19:09:48.431960] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-19T19:09:48.432020] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-19T19:09:48.652029] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-19T19:09:48.789409] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:09:49.443284] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-19T19:09:49.655122] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T19:09:49.757533] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T19:09:50.243278] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-19T19:09:50.633621] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T19:09:51.043283] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-19T19:09:51.401830] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T19:09:51.843295] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-19T19:09:52.643282] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-19T19:09:52.941316] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T19:09:53.443285] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-19T19:09:53.478766] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T19:09:53.595551] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T19:09:54.160905] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T19:09:54.243245] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-19T19:09:55.043281] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-19T19:09:55.395016] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T19:09:55.843264] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-19T19:09:56.606555] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T19:09:56.643220] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-19T19:09:56.975671] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T19:09:57.443220] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-19T19:09:57.990516] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T19:09:58.243274] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-19T19:09:59.043260] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-19T19:09:59.353231] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T19:09:59.531437] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:09:59.843292] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-19T19:09:59.882898] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T19:10:00.643253] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-19T19:10:00.757496] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T19:10:01.443289] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-19T19:10:02.243326] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-19T19:10:02.575056] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:10:02.656413] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T19:10:02.664556] [INFO ] [REMOTE ] GTN: Full fetch complete (66391 records). [2025-09-19T19:10:02.664812] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-19T19:10:03.048361] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-19T19:10:03.096836] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-19T19:10:03.096932] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-19T19:10:03.097916] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-19T19:10:03.097989] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-19T19:10:03.100864] [DEBUG] [LOCAL ] GTN: Trimmed 66391 records to 46463 (keeping 200 days of data) [2025-09-19T19:10:03.392881] [DEBUG] [LOCAL ] GTN: Primary data saved (46463 records). [2025-09-19T19:10:03.393119] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-19T19:10:03.393399] [INFO ] [MAIN ] Update Progress: 980/2372 symbols completed. GTN took 39.8s. Estimated remaining: 3h 4m 38s. Rate: 7.5 symbols/min [2025-09-19T19:10:03.569418] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:03.605702] [DEBUG] [LOCAL ] GVA: Loaded 34379 existing records from primary storage. [2025-09-19T19:10:03.605857] [INFO ] [MAIN ] GVA: Loaded 34379 existing records. [2025-09-19T19:10:03.791801] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:03.792398] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-19T19:10:03.792489] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-19T19:10:03.793534] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-19T19:10:03.793602] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-19T19:10:03.853918] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-19T19:10:04.000218] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T19:10:04.215173] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:04.380143] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:10:04.491920] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T19:10:04.643261] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-19T19:10:05.443278] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-19T19:10:06.243258] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-19T19:10:06.326253] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T19:10:06.866399] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T19:10:07.014365] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T19:10:07.043215] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-19T19:10:07.843308] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-19T19:10:08.165611] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T19:10:08.643270] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-19T19:10:08.905288] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T19:10:09.443272] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-19T19:10:09.797390] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T19:10:09.800106] [INFO ] [REMOTE ] GUT: Full fetch complete (23107 records). [2025-09-19T19:10:09.800210] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-19T19:10:10.167991] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-19T19:10:10.168097] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-19T19:10:10.168611] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-19T19:10:10.169300] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-19T19:10:10.170002] [DEBUG] [LOCAL ] GUT: Trimmed 23107 records to 15779 (keeping 200 days of data) [2025-09-19T19:10:10.243324] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-19T19:10:10.266717] [DEBUG] [LOCAL ] GUT: Primary data saved (15779 records). [2025-09-19T19:10:10.266829] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-19T19:10:10.266934] [INFO ] [MAIN ] Update Progress: 981/2372 symbols completed. GUT took 22.2s. Estimated remaining: 3h 4m 28s. Rate: 7.5 symbols/min [2025-09-19T19:10:10.439131] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:10.439343] [DEBUG] [LOCAL ] GWH: No existing data file found in primary storage. [2025-09-19T19:10:10.439404] [WARN ] [MAIN ] GWH: No existing data found, performing full refresh instead. [2025-09-19T19:10:10.439555] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-19T19:10:10.439598] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-19T19:10:10.439660] [DEBUG] [LOCAL ] GWH: No primary data file found to delete. [2025-09-19T19:10:10.439719] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-19T19:10:10.797799] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:11.043285] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-19T19:10:11.240446] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T19:10:11.843257] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-19T19:10:12.017675] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:10:12.643252] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-19T19:10:13.444940] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-19T19:10:13.454332] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T19:10:13.623427] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T19:10:14.146824] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T19:10:14.243292] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-19T19:10:15.043289] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-19T19:10:15.843252] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-19T19:10:15.905286] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T19:10:15.953231] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (5.71 seconds). [2025-09-19T19:10:15.962968] [INFO ] [REMOTE ] GTY: Full fetch complete (43037 records). [2025-09-19T19:10:15.963694] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-19T19:10:15.963613] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T19:10:15.997666] [INFO ] [REMOTE ] GUG: Full fetch complete (20015 records). [2025-09-19T19:10:16.030172] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-19T19:10:16.644393] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-19T19:10:16.655328] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-19T19:10:16.665741] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-19T19:10:16.693049] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T19:10:16.703520] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-19T19:10:16.741897] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-19T19:10:16.742676] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-19T19:10:16.742754] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-19T19:10:16.743003] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-19T19:10:16.743252] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-19T19:10:16.744211] [DEBUG] [LOCAL ] GUG: Trimmed 20015 records to 12453 (keeping 200 days of data) [2025-09-19T19:10:16.744123] [DEBUG] [LOCAL ] GTY: Trimmed 43037 records to 30827 (keeping 200 days of data) [2025-09-19T19:10:16.934792] [DEBUG] [LOCAL ] GUG: Primary data saved (12453 records). [2025-09-19T19:10:16.935409] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-19T19:10:16.935833] [INFO ] [MAIN ] Update Progress: 982/2372 symbols completed. GUG took 37.0s. Estimated remaining: 3h 4m 19s. Rate: 7.5 symbols/min [2025-09-19T19:10:17.162782] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:17.179030] [DEBUG] [LOCAL ] GTY: Primary data saved (30827 records). [2025-09-19T19:10:17.179156] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-19T19:10:17.179261] [INFO ] [MAIN ] Update Progress: 983/2372 symbols completed. GTY took 38.8s. Estimated remaining: 3h 3m 60s. Rate: 7.5 symbols/min [2025-09-19T19:10:17.372386] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:17.374279] [DEBUG] [LOCAL ] GWRE: Loaded 41721 existing records from primary storage. [2025-09-19T19:10:17.374451] [INFO ] [MAIN ] GWRE: Loaded 41721 existing records. [2025-09-19T19:10:17.443883] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-19T19:10:17.569623] [DEBUG] [LOCAL ] GWW: Loaded 20219 existing records from primary storage. [2025-09-19T19:10:17.569229] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:17.569927] [INFO ] [MAIN ] GWW: Loaded 20219 existing records. [2025-09-19T19:10:17.569866] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-19T19:10:17.570024] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-19T19:10:17.612674] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-19T19:10:17.634029] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-19T19:10:17.918093] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:17.951665] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-19T19:10:17.962692] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-19T19:10:18.015868] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-19T19:10:18.036726] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-19T19:10:18.234859] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:18.259069] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-19T19:10:18.433536] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T19:10:18.487584] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:18.726064] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T19:10:19.043292] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-19T19:10:19.843275] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-19T19:10:20.310942] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T19:10:20.586555] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T19:10:20.643285] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-19T19:10:21.429917] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:10:21.443213] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-19T19:10:22.107456] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T19:10:22.243262] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-19T19:10:22.787799] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:10:23.043262] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-19T19:10:23.767790] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T19:10:23.843240] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-19T19:10:24.419497] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T19:10:24.643253] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-19T19:10:25.406639] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:10:25.444101] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T19:10:25.443621] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-19T19:10:26.243267] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-19T19:10:26.993386] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:10:27.043243] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-19T19:10:27.597919] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:10:27.843268] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-19T19:10:28.643299] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-19T19:10:28.869406] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:10:28.893329] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T19:10:29.443265] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-19T19:10:30.243253] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-19T19:10:30.662601] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T19:10:30.747435] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T19:10:31.043270] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-19T19:10:31.149063] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T19:10:31.843290] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-19T19:10:32.643260] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-19T19:10:32.763782] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T19:10:33.153677] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:10:33.407515] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T19:10:33.443251] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-19T19:10:34.243279] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-19T19:10:34.866767] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T19:10:35.043249] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-19T19:10:35.565535] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T19:10:35.843256] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-19T19:10:35.936434] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T19:10:36.643273] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-19T19:10:37.443280] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-19T19:10:37.640612] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:10:38.225914] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T19:10:38.231981] [INFO ] [REMOTE ] GVA: Full fetch complete (48872 records). [2025-09-19T19:10:38.232101] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-19T19:10:38.248437] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-19T19:10:38.630261] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-19T19:10:38.630354] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-19T19:10:38.631123] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-19T19:10:38.631187] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-19T19:10:38.632386] [DEBUG] [LOCAL ] GVA: Trimmed 48872 records to 34588 (keeping 200 days of data) [2025-09-19T19:10:38.849847] [DEBUG] [LOCAL ] GVA: Primary data saved (34588 records). [2025-09-19T19:10:38.850015] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-19T19:10:38.850124] [INFO ] [MAIN ] Update Progress: 984/2372 symbols completed. GVA took 35.5s. Estimated remaining: 3h 4m 11s. Rate: 7.5 symbols/min [2025-09-19T19:10:39.032769] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:39.049738] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-19T19:10:39.051236] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T19:10:39.100467] [DEBUG] [LOCAL ] GXO: Loaded 48164 existing records from primary storage. [2025-09-19T19:10:39.100663] [INFO ] [MAIN ] GXO: Loaded 48164 existing records. [2025-09-19T19:10:39.283362] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:39.283622] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-19T19:10:39.283705] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-19T19:10:39.285241] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-19T19:10:39.285305] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-19T19:10:39.660892] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:39.843291] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-19T19:10:40.093001] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T19:10:40.508827] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T19:10:40.512388] [INFO ] [REMOTE ] GWW: Full fetch complete (29126 records). [2025-09-19T19:10:40.512483] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-19T19:10:40.653130] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-19T19:10:40.886882] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-19T19:10:40.886964] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-19T19:10:40.887548] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-19T19:10:40.887621] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-19T19:10:40.888410] [DEBUG] [LOCAL ] GWW: Trimmed 29126 records to 20360 (keeping 200 days of data) [2025-09-19T19:10:41.029143] [DEBUG] [LOCAL ] GWW: Primary data saved (20360 records). [2025-09-19T19:10:41.029274] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-19T19:10:41.029358] [INFO ] [MAIN ] Update Progress: 985/2372 symbols completed. GWW took 23.8s. Estimated remaining: 3h 3m 55s. Rate: 7.5 symbols/min [2025-09-19T19:10:41.199297] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:41.202592] [DEBUG] [LOCAL ] GYLD: Loaded 1538 existing records from primary storage. [2025-09-19T19:10:41.202695] [INFO ] [MAIN ] GYLD: Loaded 1538 existing records. [2025-09-19T19:10:41.381813] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:41.382182] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-19T19:10:41.382288] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-19T19:10:41.382556] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-19T19:10:41.382625] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-19T19:10:41.445872] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-19T19:10:41.781261] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T19:10:41.831335] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:42.169693] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T19:10:42.243268] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-19T19:10:43.043282] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-19T19:10:43.134277] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T19:10:43.137138] [INFO ] [REMOTE ] GWH: Full fetch complete (20491 records). [2025-09-19T19:10:43.137298] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-19T19:10:43.354841] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T19:10:43.528946] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T19:10:43.716351] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-19T19:10:43.716480] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-19T19:10:43.717413] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-19T19:10:43.717497] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-19T19:10:43.718983] [DEBUG] [LOCAL ] GWH: Trimmed 20491 records to 15335 (keeping 200 days of data) [2025-09-19T19:10:43.849094] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-19T19:10:43.849480] [DEBUG] [LOCAL ] GWH: Primary data saved (15335 records). [2025-09-19T19:10:43.849850] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-19T19:10:43.851323] [INFO ] [MAIN ] Update Progress: 986/2372 symbols completed. GWH took 33.6s. Estimated remaining: 3h 3m 40s. Rate: 7.5 symbols/min [2025-09-19T19:10:44.119533] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:44.194314] [DEBUG] [LOCAL ] H: Loaded 45362 existing records from primary storage. [2025-09-19T19:10:44.194570] [INFO ] [MAIN ] H: Loaded 45362 existing records. [2025-09-19T19:10:44.382758] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-19T19:10:44.430600] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:44.430994] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-19T19:10:44.431058] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-19T19:10:44.432333] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-19T19:10:44.432406] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-19T19:10:44.649786] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-19T19:10:44.822538] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:45.173499] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-19T19:10:45.443268] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-19T19:10:46.037509] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-19T19:10:46.243274] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-19T19:10:46.829795] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-19T19:10:47.043264] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-19T19:10:47.843268] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-19T19:10:48.643275] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-19T19:10:48.975579] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T19:10:48.985614] [INFO ] [REMOTE ] GWRE: Full fetch complete (61724 records). [2025-09-19T19:10:48.985779] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-19T19:10:49.086693] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-19T19:10:49.384477] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-19T19:10:49.384562] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-19T19:10:49.385394] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-19T19:10:49.385456] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-19T19:10:49.386741] [DEBUG] [LOCAL ] GWRE: Trimmed 61724 records to 41935 (keeping 200 days of data) [2025-09-19T19:10:49.445541] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-19T19:10:49.649533] [DEBUG] [LOCAL ] GWRE: Primary data saved (41935 records). [2025-09-19T19:10:49.649689] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-19T19:10:49.650978] [INFO ] [MAIN ] Update Progress: 987/2372 symbols completed. GWRE took 32.7s. Estimated remaining: 3h 3m 29s. Rate: 7.5 symbols/min [2025-09-19T19:10:49.849829] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:49.854835] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:10:49.913197] [DEBUG] [LOCAL ] HAE: Loaded 39825 existing records from primary storage. [2025-09-19T19:10:49.913367] [INFO ] [MAIN ] HAE: Loaded 39825 existing records. [2025-09-19T19:10:50.017303] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T19:10:50.109739] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:50.110067] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-19T19:10:50.110129] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-19T19:10:50.111134] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-19T19:10:50.111205] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-19T19:10:50.255429] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-19T19:10:50.477827] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:50.867031] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T19:10:51.043260] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-19T19:10:51.843341] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-19T19:10:52.643262] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-19T19:10:52.836556] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T19:10:53.366625] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T19:10:53.389301] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T19:10:53.443276] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-19T19:10:54.243290] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-19T19:10:55.043267] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-19T19:10:55.335114] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T19:10:55.843286] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-19T19:10:56.016502] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T19:10:56.173548] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T19:10:56.643308] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-19T19:10:57.247756] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-19T19:10:57.249132] [INFO ] [REMOTE ] GYLD: Full fetch complete (2039 records). [2025-09-19T19:10:57.249276] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-19T19:10:57.448541] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-19T19:10:57.656082] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-19T19:10:57.656441] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-19T19:10:57.656749] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-19T19:10:57.656881] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-19T19:10:57.657600] [DEBUG] [LOCAL ] GYLD: Trimmed 2039 records to 1576 (keeping 200 days of data) [2025-09-19T19:10:57.669891] [DEBUG] [LOCAL ] GYLD: Primary data saved (1576 records). [2025-09-19T19:10:57.669957] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-19T19:10:57.670088] [INFO ] [MAIN ] Update Progress: 988/2372 symbols completed. GYLD took 16.6s. Estimated remaining: 3h 3m 21s. Rate: 7.5 symbols/min [2025-09-19T19:10:57.860317] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:10:57.893127] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T19:10:57.957025] [DEBUG] [LOCAL ] HAFN: Loaded 44198 existing records from primary storage. [2025-09-19T19:10:57.957204] [INFO ] [MAIN ] HAFN: Loaded 44198 existing records. [2025-09-19T19:10:58.151805] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:10:58.152110] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-19T19:10:58.152174] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-19T19:10:58.153362] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-19T19:10:58.153438] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-19T19:10:58.250223] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-19T19:10:58.555921] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:10:59.054076] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-19T19:10:59.061081] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T19:10:59.843311] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-19T19:11:00.247549] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T19:11:00.643262] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-19T19:11:01.052495] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T19:11:01.366474] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T19:11:01.443272] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-19T19:11:01.847158] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T19:11:02.243279] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-19T19:11:03.043285] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-19T19:11:03.273500] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T19:11:03.430696] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T19:11:03.843299] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-19T19:11:04.643280] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-19T19:11:04.771827] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T19:11:05.443313] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-19T19:11:05.688458] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T19:11:06.078568] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:11:06.243318] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-19T19:11:07.051598] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-19T19:11:07.061810] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T19:11:07.843271] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-19T19:11:08.046508] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:11:08.643283] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-19T19:11:08.926559] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T19:11:09.443291] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-19T19:11:09.504842] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:11:10.041590] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T19:11:10.243316] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-19T19:11:11.043267] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-19T19:11:11.431191] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T19:11:11.563565] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:11:11.843264] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-19T19:11:12.435997] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T19:11:12.643257] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-19T19:11:13.443286] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-19T19:11:13.500750] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T19:11:14.243280] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-19T19:11:14.420498] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T19:11:14.427340] [INFO ] [REMOTE ] H: Full fetch complete (61641 records). [2025-09-19T19:11:14.427536] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-19T19:11:14.820407] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-19T19:11:14.820821] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-19T19:11:14.821920] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-19T19:11:14.822099] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-19T19:11:14.835429] [DEBUG] [LOCAL ] H: Trimmed 61641 records to 45614 (keeping 200 days of data) [2025-09-19T19:11:14.854833] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T19:11:15.053630] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-19T19:11:15.160329] [DEBUG] [LOCAL ] H: Primary data saved (45614 records). [2025-09-19T19:11:15.160469] [INFO ] [MAIN ] H: Full history saved. [2025-09-19T19:11:15.160587] [INFO ] [MAIN ] Update Progress: 989/2372 symbols completed. H took 31.3s. Estimated remaining: 3h 3m 27s. Rate: 7.5 symbols/min [2025-09-19T19:11:15.328204] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:15.395337] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-09-19T19:11:15.395740] [INFO ] [MAIN ] HAL: Loaded 54108 existing records. [2025-09-19T19:11:15.574146] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:15.574470] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-19T19:11:15.574526] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-19T19:11:15.576069] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-19T19:11:15.576131] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-19T19:11:15.852417] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-19T19:11:15.934067] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:16.310525] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T19:11:16.317368] [INFO ] [REMOTE ] GXO: Full fetch complete (70070 records). [2025-09-19T19:11:16.317492] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-19T19:11:16.648431] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-19T19:11:16.722951] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-19T19:11:16.723137] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-19T19:11:16.724064] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-19T19:11:16.724128] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-19T19:11:16.725628] [DEBUG] [LOCAL ] GXO: Trimmed 70070 records to 48518 (keeping 200 days of data) [2025-09-19T19:11:17.031708] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T19:11:17.032821] [DEBUG] [LOCAL ] GXO: Primary data saved (48518 records). [2025-09-19T19:11:17.039960] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-19T19:11:17.040202] [INFO ] [MAIN ] Update Progress: 990/2372 symbols completed. GXO took 38.2s. Estimated remaining: 3h 3m 10s. Rate: 7.5 symbols/min [2025-09-19T19:11:17.218266] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:17.246499] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T19:11:17.298963] [DEBUG] [LOCAL ] HASI: Loaded 47604 existing records from primary storage. [2025-09-19T19:11:17.299121] [INFO ] [MAIN ] HASI: Loaded 47604 existing records. [2025-09-19T19:11:17.448426] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-19T19:11:17.478852] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:17.479136] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-19T19:11:17.479340] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-19T19:11:17.480746] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-19T19:11:17.480807] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-19T19:11:17.841587] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:18.243273] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-19T19:11:18.883220] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T19:11:19.043237] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-19T19:11:19.174060] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T19:11:19.843270] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-19T19:11:19.898967] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T19:11:20.643246] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-19T19:11:21.277448] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T19:11:21.443272] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-19T19:11:21.674176] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:11:21.829475] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T19:11:22.243277] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-19T19:11:22.822143] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T19:11:23.043331] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-19T19:11:23.678537] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T19:11:23.686559] [INFO ] [REMOTE ] HAE: Full fetch complete (57554 records). [2025-09-19T19:11:23.686808] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-19T19:11:23.849717] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-19T19:11:24.094833] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-19T19:11:24.094939] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-19T19:11:24.095770] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-19T19:11:24.095844] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-19T19:11:24.098093] [DEBUG] [LOCAL ] HAE: Trimmed 57554 records to 40186 (keeping 200 days of data) [2025-09-19T19:11:24.339191] [DEBUG] [LOCAL ] HAE: Primary data saved (40186 records). [2025-09-19T19:11:24.339331] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-19T19:11:24.340076] [INFO ] [MAIN ] Update Progress: 991/2372 symbols completed. HAE took 34.7s. Estimated remaining: 3h 3m 1s. Rate: 7.5 symbols/min [2025-09-19T19:11:24.508946] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:24.561433] [DEBUG] [LOCAL ] HAYW: Loaded 49112 existing records from primary storage. [2025-09-19T19:11:24.561605] [INFO ] [MAIN ] HAYW: Loaded 49112 existing records. [2025-09-19T19:11:24.650743] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-19T19:11:24.745260] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:24.745530] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-19T19:11:24.745579] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-19T19:11:24.746766] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-19T19:11:24.746827] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-19T19:11:25.137897] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:25.169479] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T19:11:25.443271] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-19T19:11:25.586920] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:11:25.989236] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:11:26.243275] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-19T19:11:27.043256] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-19T19:11:27.373841] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T19:11:27.699423] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T19:11:27.843268] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-19T19:11:28.275740] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T19:11:28.643260] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-19T19:11:29.051872] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T19:11:29.443317] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-19T19:11:30.243288] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-19T19:11:30.487483] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:11:31.043276] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-19T19:11:31.280735] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:11:31.287016] [INFO ] [REMOTE ] HAFN: Full fetch complete (66131 records). [2025-09-19T19:11:31.287148] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-19T19:11:31.676942] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-19T19:11:31.677064] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-19T19:11:31.677946] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-19T19:11:31.678011] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-19T19:11:31.679389] [DEBUG] [LOCAL ] HAFN: Trimmed 66131 records to 44465 (keeping 200 days of data) [2025-09-19T19:11:31.853858] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-19T19:11:31.949710] [DEBUG] [LOCAL ] HAFN: Primary data saved (44465 records). [2025-09-19T19:11:31.949854] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-19T19:11:31.949952] [INFO ] [MAIN ] Update Progress: 992/2372 symbols completed. HAFN took 34.3s. Estimated remaining: 3h 2m 53s. Rate: 7.5 symbols/min [2025-09-19T19:11:32.125498] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:32.134254] [DEBUG] [LOCAL ] HBB: Loaded 7008 existing records from primary storage. [2025-09-19T19:11:32.134348] [INFO ] [MAIN ] HBB: Loaded 7008 existing records. [2025-09-19T19:11:32.314531] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:32.314906] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-19T19:11:32.315045] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-19T19:11:32.315420] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-19T19:11:32.315523] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-19T19:11:32.688009] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T19:11:32.726119] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:32.727202] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-19T19:11:32.935492] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T19:11:33.283831] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T19:11:33.333266] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T19:11:33.443250] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-19T19:11:34.243312] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-19T19:11:34.860903] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T19:11:35.043277] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-19T19:11:35.211212] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T19:11:35.843270] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-19T19:11:36.140087] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T19:11:36.643348] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-19T19:11:37.443319] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-19T19:11:37.654353] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T19:11:38.233453] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T19:11:38.243204] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-19T19:11:38.507055] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T19:11:39.043858] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-19T19:11:39.601599] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T19:11:39.843274] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-19T19:11:40.643255] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-19T19:11:40.746158] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T19:11:41.443272] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-19T19:11:41.740998] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-19T19:11:42.243269] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-19T19:11:42.432550] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:11:42.877136] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:11:43.043247] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-19T19:11:43.843292] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-19T19:11:44.284910] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T19:11:44.590927] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T19:11:44.643266] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-19T19:11:44.992717] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T19:11:45.443279] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-19T19:11:45.547798] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T19:11:46.243266] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-19T19:11:47.043268] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-19T19:11:47.098194] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T19:11:47.469757] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T19:11:47.843200] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-19T19:11:48.559239] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T19:11:48.560458] [INFO ] [REMOTE ] HBB: Full fetch complete (10087 records). [2025-09-19T19:11:48.560553] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-19T19:11:48.648392] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-19T19:11:48.951821] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-19T19:11:48.952080] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-19T19:11:48.952399] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-19T19:11:48.952497] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-19T19:11:48.953356] [DEBUG] [LOCAL ] HBB: Trimmed 10087 records to 7028 (keeping 200 days of data) [2025-09-19T19:11:48.998689] [DEBUG] [LOCAL ] HBB: Primary data saved (7028 records). [2025-09-19T19:11:48.998838] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-19T19:11:48.998926] [INFO ] [MAIN ] Update Progress: 993/2372 symbols completed. HBB took 17.0s. Estimated remaining: 3h 2m 57s. Rate: 7.5 symbols/min [2025-09-19T19:11:49.205822] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:49.202419] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T19:11:49.268073] [DEBUG] [LOCAL ] HBI: Loaded 53417 existing records from primary storage. [2025-09-19T19:11:49.268236] [INFO ] [MAIN ] HBI: Loaded 53417 existing records. [2025-09-19T19:11:49.445681] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-19T19:11:49.449174] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:49.450208] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-19T19:11:49.450293] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-19T19:11:49.451488] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-19T19:11:49.451552] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-19T19:11:49.808705] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:50.243313] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-19T19:11:50.472452] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T19:11:51.043310] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-19T19:11:51.788287] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T19:11:51.843313] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-19T19:11:52.097508] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T19:11:52.104519] [INFO ] [REMOTE ] HASI: Full fetch complete (67976 records). [2025-09-19T19:11:52.104680] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-19T19:11:52.503783] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-19T19:11:52.504100] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-19T19:11:52.505182] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-19T19:11:52.505296] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-19T19:11:52.522600] [DEBUG] [LOCAL ] HASI: Trimmed 67976 records to 47924 (keeping 200 days of data) [2025-09-19T19:11:52.537184] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T19:11:52.649796] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-19T19:11:52.846010] [DEBUG] [LOCAL ] HASI: Primary data saved (47924 records). [2025-09-19T19:11:52.846173] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-19T19:11:52.846316] [INFO ] [MAIN ] Update Progress: 994/2372 symbols completed. HASI took 35.8s. Estimated remaining: 3h 2m 44s. Rate: 7.5 symbols/min [2025-09-19T19:11:53.019368] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:53.075614] [DEBUG] [LOCAL ] HBM: Loaded 53302 existing records from primary storage. [2025-09-19T19:11:53.075837] [INFO ] [MAIN ] HBM: Loaded 53302 existing records. [2025-09-19T19:11:53.255870] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:53.256164] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-19T19:11:53.256226] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-19T19:11:53.257321] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-19T19:11:53.257383] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-19T19:11:53.452527] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-19T19:11:53.655560] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:53.748755] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T19:11:54.243277] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-19T19:11:54.498428] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T19:11:55.043330] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-19T19:11:55.650943] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T19:11:55.780446] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T19:11:55.843226] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-19T19:11:56.643285] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-19T19:11:56.908417] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T19:11:56.917331] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-19T19:11:56.917848] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-19T19:11:57.349538] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-19T19:11:57.349662] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-19T19:11:57.350782] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-19T19:11:57.350850] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-19T19:11:57.352622] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54498 (keeping 200 days of data) [2025-09-19T19:11:57.444348] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-19T19:11:57.718936] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T19:11:57.755502] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-09-19T19:11:57.755704] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-19T19:11:57.755826] [INFO ] [MAIN ] Update Progress: 995/2372 symbols completed. HAL took 42.6s. Estimated remaining: 3h 2m 32s. Rate: 7.5 symbols/min [2025-09-19T19:11:57.926727] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:57.972756] [DEBUG] [LOCAL ] HCA: Loaded 47753 existing records from primary storage. [2025-09-19T19:11:57.972907] [INFO ] [MAIN ] HCA: Loaded 47753 existing records. [2025-09-19T19:11:58.152739] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:11:58.153016] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-19T19:11:58.153069] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-19T19:11:58.154281] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-19T19:11:58.154340] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-19T19:11:58.248421] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-19T19:11:58.531774] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:11:58.560793] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T19:11:58.940274] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T19:11:58.947969] [INFO ] [REMOTE ] HAYW: Full fetch complete (71047 records). [2025-09-19T19:11:58.948115] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-19T19:11:59.050774] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-19T19:11:59.376400] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-19T19:11:59.376527] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-19T19:11:59.377793] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-19T19:11:59.377862] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-19T19:11:59.379428] [DEBUG] [LOCAL ] HAYW: Trimmed 71047 records to 49501 (keeping 200 days of data) [2025-09-19T19:11:59.656107] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T19:11:59.737846] [DEBUG] [LOCAL ] HAYW: Primary data saved (49501 records). [2025-09-19T19:11:59.738003] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-19T19:11:59.738516] [INFO ] [MAIN ] Update Progress: 996/2372 symbols completed. HAYW took 35.4s. Estimated remaining: 3h 2m 15s. Rate: 7.5 symbols/min [2025-09-19T19:11:59.843261] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-19T19:11:59.929200] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:11:59.979909] [DEBUG] [LOCAL ] HCC: Loaded 45777 existing records from primary storage. [2025-09-19T19:11:59.980092] [INFO ] [MAIN ] HCC: Loaded 45777 existing records. [2025-09-19T19:12:00.175016] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:00.175331] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-19T19:12:00.175387] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-19T19:12:00.176378] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-19T19:12:00.176439] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-19T19:12:00.531734] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:00.593911] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T19:12:00.643243] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-19T19:12:01.443338] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-19T19:12:01.952315] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:12:02.243293] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-19T19:12:02.969880] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-19T19:12:03.043241] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-19T19:12:03.843271] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-19T19:12:04.644433] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (3.20 seconds). [2025-09-19T19:12:04.652510] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-19T19:12:04.829518] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-19T19:12:04.962160] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:12:05.443316] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-19T19:12:06.024719] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T19:12:06.243272] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-19T19:12:06.359002] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T19:12:07.043321] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-19T19:12:07.697689] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-19T19:12:07.833244] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T19:12:07.843928] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-19T19:12:08.299634] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T19:12:08.643237] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-19T19:12:09.443288] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-19T19:12:09.732162] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T19:12:10.243302] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-19T19:12:10.334384] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T19:12:10.866127] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T19:12:11.043277] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-19T19:12:11.843283] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-19T19:12:12.094449] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T19:12:12.643268] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-19T19:12:12.993421] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T19:12:13.349583] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:12:13.443262] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-19T19:12:14.243274] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-19T19:12:15.043307] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-19T19:12:16.098072] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (3.45 seconds). [2025-09-19T19:12:16.110460] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-19T19:12:16.297499] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-19T19:12:16.574332] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-19T19:12:16.643267] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-19T19:12:17.443396] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-19T19:12:17.540974] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T19:12:18.163632] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T19:12:18.243262] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-19T19:12:18.514360] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-19T19:12:19.043288] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-19T19:12:19.406073] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T19:12:19.843300] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-19T19:12:20.238023] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:12:20.643288] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-19T19:12:21.116059] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T19:12:21.124264] [INFO ] [REMOTE ] HBM: Full fetch complete (76020 records). [2025-09-19T19:12:21.124451] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-19T19:12:21.445920] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-19T19:12:21.530976] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-19T19:12:21.531261] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-19T19:12:21.532339] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-19T19:12:21.543932] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-19T19:12:21.568148] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T19:12:21.579571] [DEBUG] [LOCAL ] HBM: Trimmed 76020 records to 53681 (keeping 200 days of data) [2025-09-19T19:12:21.910816] [DEBUG] [LOCAL ] HBM: Primary data saved (53681 records). [2025-09-19T19:12:21.910958] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-19T19:12:21.911041] [INFO ] [MAIN ] Update Progress: 997/2372 symbols completed. HBM took 29.1s. Estimated remaining: 3h 2m 27s. Rate: 7.5 symbols/min [2025-09-19T19:12:21.959272] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:12:22.243269] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-19T19:12:23.043291] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-19T19:12:23.433729] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T19:12:23.843316] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-19T19:12:24.089934] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T19:12:24.096742] [INFO ] [REMOTE ] HCC: Full fetch complete (64165 records). [2025-09-19T19:12:24.096911] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-19T19:12:24.496810] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-19T19:12:24.496901] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-19T19:12:24.497756] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-19T19:12:24.497819] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-19T19:12:24.499174] [DEBUG] [LOCAL ] HCC: Trimmed 64165 records to 46078 (keeping 200 days of data) [2025-09-19T19:12:24.778739] [DEBUG] [LOCAL ] HCC: Primary data saved (46078 records). [2025-09-19T19:12:24.778899] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-19T19:12:24.780091] [INFO ] [MAIN ] Update Progress: 998/2372 symbols completed. HCC took 25.0s. Estimated remaining: 3h 2m 12s. Rate: 7.5 symbols/min [2025-09-19T19:12:24.829395] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T19:12:24.840256] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-19T19:12:25.745443] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T19:12:25.756381] [INFO ] [REMOTE ] HCA: Full fetch complete (69292 records). [2025-09-19T19:12:25.756563] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-19T19:12:26.155008] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-19T19:12:26.155098] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-19T19:12:26.156072] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-19T19:12:26.156181] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-19T19:12:26.157943] [DEBUG] [LOCAL ] HCA: Trimmed 69292 records to 48109 (keeping 200 days of data) [2025-09-19T19:12:26.426600] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T19:12:26.442979] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-19T19:12:26.520230] [DEBUG] [LOCAL ] HCA: Primary data saved (48109 records). [2025-09-19T19:12:26.520442] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-19T19:12:26.520603] [INFO ] [MAIN ] Update Progress: 999/2372 symbols completed. HCA took 28.8s. Estimated remaining: 3h 1m 56s. Rate: 7.5 symbols/min [2025-09-19T19:12:28.120149] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T19:12:28.131367] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-19T19:12:30.090243] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T19:12:30.098358] [INFO ] [REMOTE ] HBI: Full fetch complete (76915 records). [2025-09-19T19:12:30.098515] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-19T19:12:30.502911] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-19T19:12:30.503000] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-19T19:12:30.504041] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-19T19:12:30.504108] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-19T19:12:30.505637] [DEBUG] [LOCAL ] HBI: Trimmed 76915 records to 53802 (keeping 200 days of data) [2025-09-19T19:12:30.835630] [DEBUG] [LOCAL ] HBI: Primary data saved (53802 records). [2025-09-19T19:12:30.835831] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-19T19:12:30.835965] [INFO ] [MAIN ] Update Progress: 1000/2372 symbols completed. HBI took 41.8s. Estimated remaining: 3h 1m 43s. Rate: 7.6 symbols/min [2025-09-19T19:12:31.400794] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:31.583920] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:31.575807] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:31.607471] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:31.608111] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-19T19:12:31.608165] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-19T19:12:31.608300] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-19T19:12:31.608341] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-19T19:12:31.608381] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-19T19:12:31.608426] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-19T19:12:31.710530] [DEBUG] [LOCAL ] HCI: Loaded 14062 existing records from primary storage. [2025-09-19T19:12:31.721525] [INFO ] [MAIN ] HCI: Loaded 14062 existing records. [2025-09-19T19:12:32.140430] [DEBUG] [LOCAL ] HDB: Loaded 52320 existing records from primary storage. [2025-09-19T19:12:32.168385] [INFO ] [MAIN ] HDB: Loaded 52320 existing records. [2025-09-19T19:12:32.174580] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:32.141493] [DEBUG] [LOCAL ] HD: Loaded 53908 existing records from primary storage. [2025-09-19T19:12:32.215282] [INFO ] [MAIN ] HD: Loaded 53908 existing records. [2025-09-19T19:12:32.241418] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-19T19:12:32.325210] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-19T19:12:32.433251] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-19T19:12:32.414722] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:32.466492] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-19T19:12:32.460376] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-19T19:12:32.677326] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:32.715307] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-19T19:12:32.720664] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-19T19:12:32.725927] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-19T19:12:32.782280] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-19T19:12:32.796035] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:32.958532] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-19T19:12:32.984308] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-19T19:12:33.027953] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-19T19:12:33.052633] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-19T19:12:33.070052] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-19T19:12:33.080483] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-19T19:12:33.222892] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:33.316936] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-19T19:12:33.344066] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-19T19:12:33.407820] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-19T19:12:33.646878] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:33.679713] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-19T19:12:33.786622] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:33.786954] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-19T19:12:33.836802] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-19T19:12:33.837633] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-19T19:12:34.555549] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-19T19:12:34.556840] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-19T19:12:34.567546] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:12:34.571095] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-19T19:12:34.823078] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-19T19:12:34.824006] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-19T19:12:35.101584] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-19T19:12:35.102518] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-19T19:12:35.478018] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T19:12:35.649232] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T19:12:35.843280] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-19T19:12:35.881875] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T19:12:35.940804] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T19:12:36.643256] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-19T19:12:36.806596] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T19:12:36.907322] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-19T19:12:37.443341] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-19T19:12:38.243319] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-19T19:12:38.625935] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-19T19:12:39.043260] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-19T19:12:39.226006] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:12:39.843293] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-19T19:12:40.177883] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T19:12:40.201046] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-19T19:12:40.201779] [INFO ] [REMOTE ] HCXY: Full fetch complete (606 records). [2025-09-19T19:12:40.201853] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-19T19:12:40.381228] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-19T19:12:40.381437] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:12:40.381521] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:12:40.381595] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-19T19:12:40.381709] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-19T19:12:40.381757] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-19T19:12:40.381838] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-19T19:12:40.381939] [INFO ] [MAIN ] Update Progress: 1001/2372 symbols completed. HCXY took 9.5s. Estimated remaining: 3h 1m 37s. Rate: 7.5 symbols/min [2025-09-19T19:12:40.551030] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:40.609791] [DEBUG] [LOCAL ] HE: Loaded 49698 existing records from primary storage. [2025-09-19T19:12:40.609977] [INFO ] [MAIN ] HE: Loaded 49698 existing records. [2025-09-19T19:12:40.648569] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-19T19:12:40.790118] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:40.790393] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-19T19:12:40.790440] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-19T19:12:40.791753] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-19T19:12:40.791813] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-19T19:12:41.164751] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:41.443268] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-19T19:12:42.243275] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-19T19:12:42.625769] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T19:12:43.043261] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-19T19:12:43.631422] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T19:12:43.843260] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-19T19:12:44.364362] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T19:12:44.409348] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:12:44.643250] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-19T19:12:45.443267] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-19T19:12:46.243267] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-19T19:12:46.328215] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-19T19:12:46.784065] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T19:12:46.802757] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T19:12:47.043315] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-19T19:12:47.677175] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T19:12:47.843340] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-19T19:12:48.604147] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T19:12:48.643310] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-19T19:12:48.965532] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T19:12:49.443278] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-19T19:12:50.243282] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-19T19:12:50.628465] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T19:12:51.043290] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-19T19:12:51.267119] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-19T19:12:51.843294] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-19T19:12:52.194258] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T19:12:52.449212] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T19:12:52.643308] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-19T19:12:53.443257] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-19T19:12:53.837335] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T19:12:54.225897] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T19:12:54.243214] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-19T19:12:55.043276] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-19T19:12:55.428792] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T19:12:55.843230] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-19T19:12:56.529942] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-19T19:12:56.644560] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-19T19:12:56.647936] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T19:12:57.443230] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-19T19:12:57.778181] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T19:12:57.879440] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T19:12:57.883718] [INFO ] [REMOTE ] HCI: Full fetch complete (19541 records). [2025-09-19T19:12:57.883854] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-19T19:12:58.246450] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-19T19:12:58.275707] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-19T19:12:58.275803] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-19T19:12:58.276290] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-19T19:12:58.276380] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-19T19:12:58.277406] [DEBUG] [LOCAL ] HCI: Trimmed 19541 records to 14144 (keeping 200 days of data) [2025-09-19T19:12:58.374921] [DEBUG] [LOCAL ] HCI: Primary data saved (14144 records). [2025-09-19T19:12:58.375065] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-19T19:12:58.375180] [INFO ] [MAIN ] Update Progress: 1002/2372 symbols completed. HCI took 27.5s. Estimated remaining: 3h 1m 43s. Rate: 7.5 symbols/min [2025-09-19T19:12:58.546295] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:12:58.586786] [DEBUG] [LOCAL ] HEI: Loaded 33217 existing records from primary storage. [2025-09-19T19:12:58.586924] [INFO ] [MAIN ] HEI: Loaded 33217 existing records. [2025-09-19T19:12:58.773972] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:12:58.774417] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-19T19:12:58.774543] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-19T19:12:58.775427] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-19T19:12:58.775517] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-19T19:12:59.048394] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-19T19:12:59.138059] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:12:59.629103] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T19:12:59.843261] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-19T19:13:00.131440] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:13:00.643283] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-19T19:13:00.819160] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:13:01.443271] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-19T19:13:02.206932] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-19T19:13:02.243233] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-19T19:13:02.400045] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T19:13:03.043231] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-19T19:13:03.391678] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T19:13:03.843274] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-19T19:13:04.213431] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:13:04.221459] [INFO ] [REMOTE ] HD: Full fetch complete (77436 records). [2025-09-19T19:13:04.221679] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-19T19:13:04.630908] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-19T19:13:04.631000] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-19T19:13:04.632104] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-19T19:13:04.632171] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-19T19:13:04.635997] [DEBUG] [LOCAL ] HD: Trimmed 77436 records to 54298 (keeping 200 days of data) [2025-09-19T19:13:04.643238] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-19T19:13:05.020344] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:13:05.034804] [DEBUG] [LOCAL ] HD: Primary data saved (54298 records). [2025-09-19T19:13:05.034934] [INFO ] [MAIN ] HD: Full history saved. [2025-09-19T19:13:05.035458] [INFO ] [MAIN ] Update Progress: 1003/2372 symbols completed. HD took 34.2s. Estimated remaining: 3h 1m 33s. Rate: 7.5 symbols/min [2025-09-19T19:13:05.209883] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:05.221284] [DEBUG] [LOCAL ] HEQ: Loaded 6239 existing records from primary storage. [2025-09-19T19:13:05.221397] [INFO ] [MAIN ] HEQ: Loaded 6239 existing records. [2025-09-19T19:13:05.398017] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:05.398275] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-19T19:13:05.398324] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-19T19:13:05.398713] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-19T19:13:05.398774] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-19T19:13:05.461560] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-19T19:13:05.759203] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:05.877425] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:13:05.916962] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T19:13:06.243262] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-19T19:13:07.043310] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-19T19:13:07.584389] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:13:07.803369] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T19:13:07.843223] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-19T19:13:08.643274] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-19T19:13:08.938930] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:13:09.443245] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-19T19:13:10.003366] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T19:13:10.011451] [INFO ] [REMOTE ] HE: Full fetch complete (72508 records). [2025-09-19T19:13:10.011572] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-19T19:13:10.244502] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-19T19:13:10.469671] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-19T19:13:10.469925] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-19T19:13:10.470904] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-19T19:13:10.478407] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-19T19:13:10.493639] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T19:13:10.501756] [DEBUG] [LOCAL ] HE: Trimmed 72508 records to 50053 (keeping 200 days of data) [2025-09-19T19:13:10.809548] [DEBUG] [LOCAL ] HE: Primary data saved (50053 records). [2025-09-19T19:13:10.809719] [INFO ] [MAIN ] HE: Full history saved. [2025-09-19T19:13:10.810174] [INFO ] [MAIN ] Update Progress: 1004/2372 symbols completed. HE took 30.4s. Estimated remaining: 3h 1m 22s. Rate: 7.5 symbols/min [2025-09-19T19:13:10.992635] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:11.016459] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T19:13:11.024601] [INFO ] [REMOTE ] HDB: Full fetch complete (75227 records). [2025-09-19T19:13:11.024845] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-19T19:13:11.060075] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-19T19:13:11.255586] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T19:13:11.374564] [DEBUG] [LOCAL ] HESM: Loaded 48477 existing records from primary storage. [2025-09-19T19:13:11.374796] [INFO ] [MAIN ] HESM: Loaded 48477 existing records. [2025-09-19T19:13:11.629586] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-19T19:13:11.649223] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-19T19:13:11.652069] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-19T19:13:11.659058] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-19T19:13:11.672834] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:11.673310] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-19T19:13:11.673465] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-19T19:13:11.673932] [DEBUG] [LOCAL ] HDB: Trimmed 75227 records to 52707 (keeping 200 days of data) [2025-09-19T19:13:11.674922] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-19T19:13:11.674984] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-19T19:13:11.856216] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-19T19:13:12.274740] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:12.383593] [DEBUG] [LOCAL ] HDB: Primary data saved (52707 records). [2025-09-19T19:13:12.383774] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-19T19:13:12.383928] [INFO ] [MAIN ] Update Progress: 1005/2372 symbols completed. HDB took 41.5s. Estimated remaining: 3h 1m 5s. Rate: 7.5 symbols/min [2025-09-19T19:13:12.563681] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:12.563944] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-19T19:13:12.564000] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-19T19:13:12.564149] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-19T19:13:12.564194] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-19T19:13:12.564235] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-19T19:13:12.564268] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-19T19:13:12.656509] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-19T19:13:12.680382] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T19:13:12.936281] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:12.959078] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T19:13:13.443306] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-19T19:13:14.021830] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T19:13:14.223808] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T19:13:14.243238] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-19T19:13:15.043234] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-19T19:13:15.221320] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T19:13:15.843258] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-19T19:13:16.643270] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-19T19:13:16.781873] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T19:13:16.809915] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:13:17.443262] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-19T19:13:18.148408] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T19:13:18.243225] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-19T19:13:19.025904] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T19:13:19.043210] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-19T19:13:19.843265] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-19T19:13:19.987938] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:13:20.599317] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:13:20.643226] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-19T19:13:20.690379] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-19T19:13:21.443265] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-19T19:13:22.177540] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T19:13:22.243307] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-19T19:13:22.292810] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T19:13:22.753067] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T19:13:23.043260] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-19T19:13:23.843272] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-19T19:13:23.884164] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-19T19:13:24.643308] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-19T19:13:25.340940] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T19:13:25.443269] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-19T19:13:25.646921] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T19:13:25.651430] [INFO ] [REMOTE ] HEI: Full fetch complete (49246 records). [2025-09-19T19:13:25.651530] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-19T19:13:26.045021] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-19T19:13:26.045104] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-19T19:13:26.045846] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-19T19:13:26.045908] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-19T19:13:26.047143] [DEBUG] [LOCAL ] HEI: Trimmed 49246 records to 33376 (keeping 200 days of data) [2025-09-19T19:13:26.243427] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-19T19:13:26.266815] [DEBUG] [LOCAL ] HEI: Primary data saved (33376 records). [2025-09-19T19:13:26.266914] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-19T19:13:26.267007] [INFO ] [MAIN ] Update Progress: 1006/2372 symbols completed. HEI took 27.9s. Estimated remaining: 3h 1m 6s. Rate: 7.5 symbols/min [2025-09-19T19:13:26.439332] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:26.439541] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-19T19:13:26.439583] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-19T19:13:26.439777] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-19T19:13:26.439819] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-19T19:13:26.439864] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-19T19:13:26.439955] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-19T19:13:26.683085] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-19T19:13:26.798358] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:26.903323] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T19:13:27.043276] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-19T19:13:27.559836] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-19T19:13:27.843270] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-19T19:13:28.643250] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-19T19:13:28.865565] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T19:13:28.868308] [INFO ] [REMOTE ] HEQ: Full fetch complete (9071 records). [2025-09-19T19:13:28.868393] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-19T19:13:29.239184] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-19T19:13:29.239260] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-19T19:13:29.239488] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-19T19:13:29.239525] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-19T19:13:29.239966] [DEBUG] [LOCAL ] HEQ: Trimmed 9071 records to 6366 (keeping 200 days of data) [2025-09-19T19:13:29.277771] [DEBUG] [LOCAL ] HEQ: Primary data saved (6366 records). [2025-09-19T19:13:29.277890] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-19T19:13:29.277973] [INFO ] [MAIN ] Update Progress: 1007/2372 symbols completed. HEQ took 24.2s. Estimated remaining: 3h 0m 51s. Rate: 7.5 symbols/min [2025-09-19T19:13:29.448326] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-19T19:13:29.481339] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:29.501000] [DEBUG] [LOCAL ] HFRO: Loaded 17680 existing records from primary storage. [2025-09-19T19:13:29.501130] [INFO ] [MAIN ] HFRO: Loaded 17680 existing records. [2025-09-19T19:13:29.682729] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:29.682989] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-19T19:13:29.683048] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-19T19:13:29.683632] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-19T19:13:29.683719] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-19T19:13:29.945761] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T19:13:30.065423] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:30.243260] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-19T19:13:30.421282] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T19:13:31.043269] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-19T19:13:31.555350] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T19:13:31.806203] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T19:13:31.843254] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-19T19:13:32.370366] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T19:13:32.643353] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-19T19:13:32.937536] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-19T19:13:33.443278] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-19T19:13:33.831391] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-19T19:13:34.243282] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-19T19:13:34.653512] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T19:13:35.043270] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-19T19:13:35.457585] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-19T19:13:35.843272] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-19T19:13:36.643312] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-19T19:13:37.222476] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T19:13:37.443314] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-19T19:13:37.948856] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T19:13:38.243274] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-19T19:13:38.737235] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-19T19:13:39.043274] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-19T19:13:39.217098] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:13:39.543912] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-19T19:13:39.544835] [INFO ] [REMOTE ] HFND: Full fetch complete (1810 records). [2025-09-19T19:13:39.544905] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-19T19:13:39.732511] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-19T19:13:39.732808] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:13:39.732882] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:13:39.732951] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-19T19:13:39.733015] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-19T19:13:39.733053] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-19T19:13:39.733108] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-19T19:13:39.733189] [INFO ] [MAIN ] Update Progress: 1008/2372 symbols completed. HFND took 13.5s. Estimated remaining: 3h 0m 46s. Rate: 7.5 symbols/min [2025-09-19T19:13:39.848383] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-19T19:13:39.908921] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:39.926024] [DEBUG] [LOCAL ] HGER: Loaded 12752 existing records from primary storage. [2025-09-19T19:13:39.926151] [INFO ] [MAIN ] HGER: Loaded 12752 existing records. [2025-09-19T19:13:40.108787] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:40.109066] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-19T19:13:40.109115] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-19T19:13:40.109678] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-19T19:13:40.109740] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-19T19:13:40.480355] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:40.643217] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-19T19:13:41.120586] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:13:41.443281] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-19T19:13:41.520027] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T19:13:42.243280] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-19T19:13:42.542629] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-19T19:13:43.043276] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-19T19:13:43.443378] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T19:13:43.843264] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-19T19:13:44.109094] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T19:13:44.643264] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-19T19:13:45.443262] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-19T19:13:45.528459] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T19:13:45.683975] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:13:45.716197] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-19T19:13:46.243288] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-19T19:13:47.043273] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-19T19:13:47.731863] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:13:47.739227] [INFO ] [REMOTE ] HESM: Full fetch complete (68575 records). [2025-09-19T19:13:47.739371] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-19T19:13:47.845686] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-19T19:13:47.858205] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T19:13:48.147423] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-19T19:13:48.143939] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-19T19:13:48.147686] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-19T19:13:48.148887] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-19T19:13:48.149710] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-19T19:13:48.151334] [DEBUG] [LOCAL ] HESM: Trimmed 68575 records to 48865 (keeping 200 days of data) [2025-09-19T19:13:48.456321] [DEBUG] [LOCAL ] HESM: Primary data saved (48865 records). [2025-09-19T19:13:48.456487] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-19T19:13:48.457112] [INFO ] [MAIN ] Update Progress: 1009/2372 symbols completed. HESM took 37.6s. Estimated remaining: 3h 0m 39s. Rate: 7.5 symbols/min [2025-09-19T19:13:48.626936] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:48.638369] [DEBUG] [LOCAL ] HGLB: Loaded 9804 existing records from primary storage. [2025-09-19T19:13:48.638493] [INFO ] [MAIN ] HGLB: Loaded 9804 existing records. [2025-09-19T19:13:48.643278] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-19T19:13:48.820763] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:48.821066] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-19T19:13:48.821129] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-19T19:13:48.821607] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-19T19:13:48.821701] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-19T19:13:49.180523] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:49.443295] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-19T19:13:49.940490] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T19:13:50.243281] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-19T19:13:50.314856] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T19:13:50.502137] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-19T19:13:51.043310] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-19T19:13:51.843306] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-19T19:13:52.012786] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T19:13:52.643251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-19T19:13:52.809874] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:13:52.904581] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-19T19:13:53.443276] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-19T19:13:54.243305] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-19T19:13:54.360568] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T19:13:54.504901] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-19T19:13:55.043275] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-19T19:13:55.843269] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-19T19:13:55.928412] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T19:13:56.332747] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-19T19:13:56.643298] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-19T19:13:57.443241] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-19T19:13:57.851975] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:13:58.243279] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-19T19:13:58.605526] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-19T19:13:58.606248] [INFO ] [REMOTE ] HF: Full fetch complete (511 records). [2025-09-19T19:13:58.606318] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-19T19:13:58.784979] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-19T19:13:58.785229] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:13:58.785325] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:13:58.785416] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-19T19:13:58.785600] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-19T19:13:58.785765] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-19T19:13:58.785987] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-19T19:13:58.786231] [INFO ] [MAIN ] Update Progress: 1010/2372 symbols completed. HF took 46.4s. Estimated remaining: 3h 0m 35s. Rate: 7.5 symbols/min [2025-09-19T19:13:58.858245] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T19:13:58.967193] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:13:58.981558] [DEBUG] [LOCAL ] HGTY: Loaded 12987 existing records from primary storage. [2025-09-19T19:13:58.981723] [INFO ] [MAIN ] HGTY: Loaded 12987 existing records. [2025-09-19T19:13:59.048441] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-19T19:13:59.162078] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:13:59.162344] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-19T19:13:59.162425] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-19T19:13:59.163000] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-19T19:13:59.163090] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-19T19:13:59.521546] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:13:59.843281] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-19T19:14:00.014524] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T19:14:00.652102] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-19T19:14:00.654404] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T19:14:01.443301] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-19T19:14:01.630533] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T19:14:02.243285] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-19T19:14:02.381493] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T19:14:03.043319] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-19T19:14:03.239728] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-19T19:14:03.712290] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:14:03.843262] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-19T19:14:04.643274] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-19T19:14:04.686607] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T19:14:05.443280] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-19T19:14:05.824350] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T19:14:06.243259] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-19T19:14:06.617913] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T19:14:07.043287] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-19T19:14:07.288510] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T19:14:07.843281] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-19T19:14:07.985412] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T19:14:08.643292] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-19T19:14:09.165913] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:14:09.443273] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-19T19:14:09.877837] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T19:14:09.881790] [INFO ] [REMOTE ] HFRO: Full fetch complete (28801 records). [2025-09-19T19:14:09.882036] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-19T19:14:10.248230] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-19T19:14:10.282184] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-19T19:14:10.282314] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-19T19:14:10.283789] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-19T19:14:10.284081] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-19T19:14:10.285717] [DEBUG] [LOCAL ] HFRO: Trimmed 28801 records to 17764 (keeping 200 days of data) [2025-09-19T19:14:10.377920] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:14:10.416164] [DEBUG] [LOCAL ] HFRO: Primary data saved (17764 records). [2025-09-19T19:14:10.416407] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-19T19:14:10.416533] [INFO ] [MAIN ] Update Progress: 1011/2372 symbols completed. HFRO took 41.1s. Estimated remaining: 3h 0m 32s. Rate: 7.5 symbols/min [2025-09-19T19:14:10.600239] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:10.653078] [DEBUG] [LOCAL ] HGV: Loaded 47467 existing records from primary storage. [2025-09-19T19:14:10.653297] [INFO ] [MAIN ] HGV: Loaded 47467 existing records. [2025-09-19T19:14:10.854629] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:10.854998] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-19T19:14:10.855091] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-19T19:14:10.856469] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-19T19:14:10.856532] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-19T19:14:11.052030] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-19T19:14:11.219962] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:11.499533] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T19:14:11.502992] [INFO ] [REMOTE ] HGER: Full fetch complete (15867 records). [2025-09-19T19:14:11.503064] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-19T19:14:11.849862] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-19T19:14:11.868390] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-19T19:14:11.868477] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-19T19:14:11.868868] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-19T19:14:11.868929] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-19T19:14:11.869582] [DEBUG] [LOCAL ] HGER: Trimmed 15867 records to 12933 (keeping 200 days of data) [2025-09-19T19:14:11.947368] [DEBUG] [LOCAL ] HGER: Primary data saved (12933 records). [2025-09-19T19:14:11.947520] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-19T19:14:11.947622] [INFO ] [MAIN ] Update Progress: 1012/2372 symbols completed. HGER took 32.2s. Estimated remaining: 3h 0m 15s. Rate: 7.5 symbols/min [2025-09-19T19:14:12.126104] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:12.126349] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T19:14:12.164109] [DEBUG] [LOCAL ] HHH: Loaded 33111 existing records from primary storage. [2025-09-19T19:14:12.164251] [INFO ] [MAIN ] HHH: Loaded 33111 existing records. [2025-09-19T19:14:12.339812] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:12.340088] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-19T19:14:12.340135] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-19T19:14:12.341146] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-19T19:14:12.341206] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-19T19:14:12.654235] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-19T19:14:12.701229] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:13.443288] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-19T19:14:13.638685] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T19:14:13.874249] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T19:14:14.243273] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-19T19:14:14.381616] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T19:14:15.043266] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-19T19:14:15.571256] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:14:15.843345] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-19T19:14:16.373505] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T19:14:16.643326] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-19T19:14:17.394940] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T19:14:17.443276] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-19T19:14:17.753968] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T19:14:18.243343] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-19T19:14:19.027495] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T19:14:19.043219] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-19T19:14:19.218667] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T19:14:19.843292] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-19T19:14:20.467577] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T19:14:20.643268] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-19T19:14:20.734081] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:14:21.443308] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-19T19:14:21.610898] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T19:14:22.243243] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-19T19:14:22.774993] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T19:14:23.043274] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-19T19:14:23.843265] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-19T19:14:24.040544] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T19:14:24.643309] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-19T19:14:24.829266] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T19:14:24.856056] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T19:14:25.443286] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-19T19:14:26.243294] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-19T19:14:26.284744] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-19T19:14:26.588790] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:14:27.043271] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-19T19:14:27.656242] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T19:14:27.843272] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-19T19:14:28.607156] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T19:14:28.611288] [INFO ] [REMOTE ] HGTY: Full fetch complete (17091 records). [2025-09-19T19:14:28.611373] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-19T19:14:28.648480] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-19T19:14:28.967415] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T19:14:29.008903] [INFO ] [REMOTE ] HGLB: Full fetch complete (14259 records). [2025-09-19T19:14:29.027756] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-19T19:14:29.036966] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-19T19:14:29.037133] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-19T19:14:29.037563] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-19T19:14:29.068708] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-19T19:14:29.141719] [DEBUG] [LOCAL ] HGTY: Trimmed 17091 records to 13154 (keeping 200 days of data) [2025-09-19T19:14:29.445406] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-19T19:14:29.488050] [DEBUG] [LOCAL ] HGTY: Primary data saved (13154 records). [2025-09-19T19:14:29.500068] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-19T19:14:29.500201] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-19T19:14:29.500313] [INFO ] [MAIN ] Update Progress: 1013/2372 symbols completed. HGTY took 30.7s. Estimated remaining: 3h 0m 20s. Rate: 7.5 symbols/min [2025-09-19T19:14:29.500396] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-19T19:14:29.501009] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-19T19:14:29.547354] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-19T19:14:29.613096] [DEBUG] [LOCAL ] HGLB: Trimmed 14259 records to 9853 (keeping 200 days of data) [2025-09-19T19:14:29.749776] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:29.761594] [DEBUG] [LOCAL ] HGLB: Primary data saved (9853 records). [2025-09-19T19:14:29.761809] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-19T19:14:29.761925] [INFO ] [MAIN ] Update Progress: 1014/2372 symbols completed. HGLB took 41.3s. Estimated remaining: 3h 0m 2s. Rate: 7.5 symbols/min [2025-09-19T19:14:29.980075] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:29.981624] [DEBUG] [LOCAL ] HI: Loaded 35349 existing records from primary storage. [2025-09-19T19:14:29.982237] [INFO ] [MAIN ] HI: Loaded 35349 existing records. [2025-09-19T19:14:30.183996] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:30.184528] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-19T19:14:30.184593] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-19T19:14:30.200997] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-19T19:14:30.201179] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-19T19:14:30.367122] [DEBUG] [LOCAL ] HIG: Loaded 51670 existing records from primary storage. [2025-09-19T19:14:30.386609] [INFO ] [MAIN ] HIG: Loaded 51670 existing records. [2025-09-19T19:14:30.748128] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:30.759025] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-19T19:14:30.772806] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-19T19:14:30.814859] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:30.815277] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-19T19:14:30.816791] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-19T19:14:30.816864] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-19T19:14:31.025781] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T19:14:31.126894] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-19T19:14:31.233595] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:31.256544] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T19:14:31.843260] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-19T19:14:32.340552] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T19:14:32.484928] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T19:14:32.643237] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-19T19:14:33.443265] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-19T19:14:33.660444] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T19:14:33.979959] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T19:14:34.243292] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-19T19:14:35.054308] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-19T19:14:35.062174] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T19:14:35.843284] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-19T19:14:36.181202] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T19:14:36.239437] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T19:14:36.643266] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-19T19:14:37.374254] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:14:37.379518] [INFO ] [REMOTE ] HHH: Full fetch complete (44917 records). [2025-09-19T19:14:37.379631] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-19T19:14:37.448350] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-19T19:14:37.797248] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-19T19:14:37.797355] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-19T19:14:37.798251] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-19T19:14:37.798319] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-19T19:14:37.799464] [DEBUG] [LOCAL ] HHH: Trimmed 44917 records to 33300 (keeping 200 days of data) [2025-09-19T19:14:38.018043] [DEBUG] [LOCAL ] HHH: Primary data saved (33300 records). [2025-09-19T19:14:38.018228] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-19T19:14:38.018374] [INFO ] [MAIN ] Update Progress: 1015/2372 symbols completed. HHH took 26.1s. Estimated remaining: 2h 59m 54s. Rate: 7.5 symbols/min [2025-09-19T19:14:38.205939] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:38.243730] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-19T19:14:38.245804] [DEBUG] [LOCAL ] HII: Loaded 35965 existing records from primary storage. [2025-09-19T19:14:38.245968] [INFO ] [MAIN ] HII: Loaded 35965 existing records. [2025-09-19T19:14:38.450109] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:38.450474] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-19T19:14:38.450576] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-19T19:14:38.452038] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-19T19:14:38.452124] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-19T19:14:38.596277] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T19:14:38.648671] [INFO ] [REMOTE ] HGV: Full fetch complete (65735 records). [2025-09-19T19:14:38.658681] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-19T19:14:39.101974] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:39.112511] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-19T19:14:39.310507] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-19T19:14:39.311109] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-19T19:14:39.312293] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-19T19:14:39.312387] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-19T19:14:39.317745] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T19:14:39.329049] [DEBUG] [LOCAL ] HGV: Trimmed 65735 records to 47765 (keeping 200 days of data) [2025-09-19T19:14:39.622243] [DEBUG] [LOCAL ] HGV: Primary data saved (47765 records). [2025-09-19T19:14:39.622446] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-19T19:14:39.622590] [INFO ] [MAIN ] Update Progress: 1016/2372 symbols completed. HGV took 29.2s. Estimated remaining: 2h 59m 38s. Rate: 7.5 symbols/min [2025-09-19T19:14:39.808774] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:39.843267] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-19T19:14:39.866997] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-09-19T19:14:39.867172] [INFO ] [MAIN ] HIMS: Loaded 54207 existing records. [2025-09-19T19:14:40.060382] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:40.061043] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-19T19:14:40.061174] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-19T19:14:40.062712] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-19T19:14:40.062775] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-19T19:14:40.373007] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T19:14:40.469760] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:40.496725] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T19:14:40.643236] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-19T19:14:41.371979] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T19:14:41.443257] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-19T19:14:41.776133] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T19:14:42.243278] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-19T19:14:43.043274] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-19T19:14:43.495758] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T19:14:43.571639] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T19:14:43.843247] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-19T19:14:44.093415] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T19:14:44.643291] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-19T19:14:45.443251] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-19T19:14:45.524493] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:14:46.243236] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-19T19:14:46.366820] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T19:14:47.043288] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-19T19:14:47.542073] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T19:14:47.843262] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-19T19:14:48.417056] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T19:14:48.643289] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-19T19:14:49.443315] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-19T19:14:49.478987] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T19:14:49.732388] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-19T19:14:50.243258] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-19T19:14:50.528392] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T19:14:51.043306] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-19T19:14:51.257808] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T19:14:51.803707] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T19:14:51.843243] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-19T19:14:52.643285] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-19T19:14:53.024444] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:14:53.169892] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T19:14:53.443291] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-19T19:14:53.908502] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T19:14:54.243333] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-19T19:14:55.043285] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-19T19:14:55.525817] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T19:14:55.843328] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-19T19:14:55.976871] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T19:14:56.643275] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-19T19:14:56.663945] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T19:14:57.450317] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-19T19:14:57.452354] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T19:14:57.748943] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T19:14:57.756164] [INFO ] [REMOTE ] HI: Full fetch complete (49677 records). [2025-09-19T19:14:57.756335] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-19T19:14:58.147089] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-19T19:14:58.147182] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-19T19:14:58.148332] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-19T19:14:58.148397] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-19T19:14:58.149932] [DEBUG] [LOCAL ] HI: Trimmed 49677 records to 35665 (keeping 200 days of data) [2025-09-19T19:14:58.243906] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-19T19:14:58.375946] [DEBUG] [LOCAL ] HI: Primary data saved (35665 records). [2025-09-19T19:14:58.376089] [INFO ] [MAIN ] HI: Full history saved. [2025-09-19T19:14:58.376179] [INFO ] [MAIN ] Update Progress: 1017/2372 symbols completed. HI took 28.9s. Estimated remaining: 2h 59m 44s. Rate: 7.5 symbols/min [2025-09-19T19:14:58.562175] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:14:58.587382] [DEBUG] [LOCAL ] HIO: Loaded 24268 existing records from primary storage. [2025-09-19T19:14:58.587528] [INFO ] [MAIN ] HIO: Loaded 24268 existing records. [2025-09-19T19:14:58.774950] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:14:58.775221] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-19T19:14:58.775272] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-19T19:14:58.776309] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-19T19:14:58.776379] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-19T19:14:59.053318] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-19T19:14:59.155373] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:14:59.804040] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T19:14:59.811539] [INFO ] [REMOTE ] HIG: Full fetch complete (73263 records). [2025-09-19T19:14:59.811758] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-19T19:14:59.854615] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-19T19:15:00.234147] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-19T19:15:00.234487] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-19T19:15:00.235613] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-19T19:15:00.235777] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-19T19:15:00.238341] [DEBUG] [LOCAL ] HIG: Trimmed 73263 records to 52033 (keeping 200 days of data) [2025-09-19T19:15:00.356263] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T19:15:00.395248] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-09-19T19:15:00.642916] [DEBUG] [LOCAL ] HIG: Primary data saved (52033 records). [2025-09-19T19:15:00.643055] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-19T19:15:00.644828] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-19T19:15:00.644764] [INFO ] [MAIN ] Update Progress: 1018/2372 symbols completed. HIG took 30.9s. Estimated remaining: 2h 59m 29s. Rate: 7.5 symbols/min [2025-09-19T19:15:00.817554] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:00.840105] [DEBUG] [LOCAL ] HIPO: Loaded 23127 existing records from primary storage. [2025-09-19T19:15:00.840233] [INFO ] [MAIN ] HIPO: Loaded 23127 existing records. [2025-09-19T19:15:01.017916] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:01.018189] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-19T19:15:01.018238] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-19T19:15:01.019048] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-19T19:15:01.019108] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-19T19:15:01.374954] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:01.399902] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T19:15:01.443216] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-19T19:15:02.243304] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-19T19:15:03.043285] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-19T19:15:04.428494] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (3.78 seconds). [2025-09-19T19:15:04.440053] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-19T19:15:05.157524] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-09-19T19:15:05.162963] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-19T19:15:05.649453] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-09-19T19:15:05.657046] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-19T19:15:05.773964] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-19T19:15:05.920431] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T19:15:06.243284] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-19T19:15:07.043331] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-19T19:15:07.399391] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:15:07.405022] [INFO ] [REMOTE ] HII: Full fetch complete (53446 records). [2025-09-19T19:15:07.405182] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-19T19:15:07.759719] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T19:15:07.868885] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-19T19:15:07.911542] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-19T19:15:07.917298] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-19T19:15:07.918280] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-19T19:15:07.918436] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-19T19:15:07.917192] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (3.48 seconds). [2025-09-19T19:15:07.934052] [DEBUG] [LOCAL ] HII: Trimmed 53446 records to 36225 (keeping 200 days of data) [2025-09-19T19:15:08.173597] [DEBUG] [LOCAL ] HII: Primary data saved (36225 records). [2025-09-19T19:15:08.173801] [INFO ] [MAIN ] HII: Full history saved. [2025-09-19T19:15:08.173918] [INFO ] [MAIN ] Update Progress: 1019/2372 symbols completed. HII took 30.2s. Estimated remaining: 2h 59m 20s. Rate: 7.5 symbols/min [2025-09-19T19:15:08.360997] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:08.374760] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T19:15:08.425923] [DEBUG] [LOCAL ] HIW: Loaded 45221 existing records from primary storage. [2025-09-19T19:15:08.426077] [INFO ] [MAIN ] HIW: Loaded 45221 existing records. [2025-09-19T19:15:08.612394] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:08.612712] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-19T19:15:08.612769] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-19T19:15:08.614075] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-19T19:15:08.614133] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-19T19:15:08.648424] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-19T19:15:09.011378] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:09.443265] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-19T19:15:09.506790] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T19:15:10.243268] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-19T19:15:11.043247] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-19T19:15:11.193727] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T19:15:11.477112] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T19:15:11.614497] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-19T19:15:11.843482] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-19T19:15:12.417254] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:15:12.643261] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-19T19:15:13.114062] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T19:15:13.443265] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-19T19:15:14.243268] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-19T19:15:15.043261] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-19T19:15:15.517080] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:15:15.623461] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (2.98 seconds). [2025-09-19T19:15:15.843236] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-19T19:15:15.863064] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T19:15:16.589441] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T19:15:16.643222] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-19T19:15:17.354683] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-19T19:15:17.378213] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T19:15:17.443226] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-19T19:15:18.243264] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-19T19:15:18.709944] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T19:15:19.043265] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-19T19:15:19.208712] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T19:15:19.843262] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-19T19:15:20.529022] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:15:20.533285] [INFO ] [REMOTE ] HIO: Full fetch complete (36881 records). [2025-09-19T19:15:20.533383] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-19T19:15:20.648350] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-19T19:15:20.920198] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-19T19:15:20.920279] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-19T19:15:20.920948] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-19T19:15:20.921034] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-19T19:15:20.921951] [DEBUG] [LOCAL ] HIO: Trimmed 36881 records to 24386 (keeping 200 days of data) [2025-09-19T19:15:21.069491] [DEBUG] [LOCAL ] HIO: Primary data saved (24386 records). [2025-09-19T19:15:21.069678] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-19T19:15:21.069803] [INFO ] [MAIN ] Update Progress: 1020/2372 symbols completed. HIO took 22.7s. Estimated remaining: 2h 59m 19s. Rate: 7.5 symbols/min [2025-09-19T19:15:21.264712] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:21.284632] [DEBUG] [LOCAL ] HIX: Loaded 20398 existing records from primary storage. [2025-09-19T19:15:21.284795] [INFO ] [MAIN ] HIX: Loaded 20398 existing records. [2025-09-19T19:15:21.451682] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-19T19:15:21.475819] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:21.476054] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-19T19:15:21.476133] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-19T19:15:21.476817] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-19T19:15:21.476893] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-19T19:15:21.812846] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T19:15:21.887928] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:22.243268] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-19T19:15:22.695792] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-19T19:15:23.043321] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-19T19:15:23.306819] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:15:23.486441] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T19:15:23.843262] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-19T19:15:24.643286] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-19T19:15:24.986468] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T19:15:24.990366] [INFO ] [REMOTE ] HIPO: Full fetch complete (31817 records). [2025-09-19T19:15:24.990498] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-19T19:15:25.380207] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-19T19:15:25.380302] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-19T19:15:25.381009] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-19T19:15:25.381074] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-19T19:15:25.382064] [DEBUG] [LOCAL ] HIPO: Trimmed 31817 records to 23241 (keeping 200 days of data) [2025-09-19T19:15:25.444504] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-19T19:15:25.539573] [DEBUG] [LOCAL ] HIPO: Primary data saved (23241 records). [2025-09-19T19:15:25.539744] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-19T19:15:25.539853] [INFO ] [MAIN ] Update Progress: 1021/2372 symbols completed. HIPO took 24.9s. Estimated remaining: 2h 59m 6s. Rate: 7.5 symbols/min [2025-09-19T19:15:25.718175] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:25.762820] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-19T19:15:25.784007] [DEBUG] [LOCAL ] HKD: Loaded 18070 existing records from primary storage. [2025-09-19T19:15:25.784141] [INFO ] [MAIN ] HKD: Loaded 18070 existing records. [2025-09-19T19:15:25.963582] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:25.963871] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-19T19:15:25.963922] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-19T19:15:25.964514] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-19T19:15:25.964576] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-19T19:15:26.244940] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-19T19:15:26.326281] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:26.839466] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:15:27.043408] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-19T19:15:27.095197] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-19T19:15:27.843292] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-19T19:15:28.538227] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T19:15:28.643268] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-19T19:15:29.211075] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-09-19T19:15:29.222076] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-19T19:15:29.222280] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-19T19:15:29.447766] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-19T19:15:29.582570] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T19:15:29.739414] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-19T19:15:29.739519] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-19T19:15:29.740509] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-19T19:15:29.740620] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-19T19:15:29.742490] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54597 (keeping 200 days of data) [2025-09-19T19:15:29.855463] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T19:15:30.119849] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-09-19T19:15:30.120005] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-19T19:15:30.120095] [INFO ] [MAIN ] Update Progress: 1022/2372 symbols completed. HIMS took 50.5s. Estimated remaining: 2h 58m 54s. Rate: 7.5 symbols/min [2025-09-19T19:15:30.247639] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-19T19:15:30.302566] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:30.363778] [DEBUG] [LOCAL ] HL: Loaded 54060 existing records from primary storage. [2025-09-19T19:15:30.363963] [INFO ] [MAIN ] HL: Loaded 54060 existing records. [2025-09-19T19:15:30.555681] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:30.556051] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-19T19:15:30.556113] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-19T19:15:30.557368] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-19T19:15:30.557440] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-19T19:15:30.940721] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T19:15:30.964818] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:31.043287] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-19T19:15:31.309601] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T19:15:31.843264] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-19T19:15:32.402076] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T19:15:32.643277] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-19T19:15:33.443247] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-19T19:15:33.674882] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T19:15:33.766035] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T19:15:34.243282] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-19T19:15:34.653290] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T19:15:35.043279] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-19T19:15:35.843273] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-19T19:15:36.390569] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T19:15:36.648939] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-19T19:15:36.663216] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T19:15:37.443296] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-19T19:15:37.552345] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:15:37.640494] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T19:15:38.243269] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-19T19:15:39.043264] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-19T19:15:39.143296] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T19:15:39.372149] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:15:39.843265] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-19T19:15:40.287863] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:15:40.643261] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-19T19:15:41.262715] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T19:15:41.286277] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T19:15:41.443258] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-19T19:15:42.243263] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-19T19:15:42.801842] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T19:15:43.043223] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-19T19:15:43.595001] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T19:15:43.843274] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-19T19:15:44.643395] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-19T19:15:45.094352] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T19:15:45.118464] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T19:15:45.443259] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-19T19:15:45.757289] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T19:15:46.243263] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-19T19:15:47.043290] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-19T19:15:47.520201] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:15:47.644924] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T19:15:47.650922] [INFO ] [REMOTE ] HKD: Full fetch complete (28636 records). [2025-09-19T19:15:47.651184] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-19T19:15:47.857246] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-19T19:15:48.096320] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-19T19:15:48.096448] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-19T19:15:48.097400] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-19T19:15:48.097506] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-19T19:15:48.099101] [DEBUG] [LOCAL ] HKD: Trimmed 28636 records to 18304 (keeping 200 days of data) [2025-09-19T19:15:48.216252] [DEBUG] [LOCAL ] HKD: Primary data saved (18304 records). [2025-09-19T19:15:48.216433] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-19T19:15:48.216628] [INFO ] [MAIN ] Update Progress: 1023/2372 symbols completed. HKD took 22.7s. Estimated remaining: 2h 58m 59s. Rate: 7.5 symbols/min [2025-09-19T19:15:48.401844] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:48.462956] [DEBUG] [LOCAL ] HLF: Loaded 49283 existing records from primary storage. [2025-09-19T19:15:48.463111] [INFO ] [MAIN ] HLF: Loaded 49283 existing records. [2025-09-19T19:15:48.652985] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-19T19:15:48.660898] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:48.662531] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-19T19:15:48.662596] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-19T19:15:48.664219] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-19T19:15:48.664432] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-19T19:15:49.054467] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T19:15:49.096302] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:49.443247] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-19T19:15:49.909151] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T19:15:49.914013] [INFO ] [REMOTE ] HIX: Full fetch complete (30735 records). [2025-09-19T19:15:49.914097] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-19T19:15:50.246085] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-19T19:15:50.321411] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-19T19:15:50.322160] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-19T19:15:50.323391] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-19T19:15:50.323484] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-19T19:15:50.325487] [DEBUG] [LOCAL ] HIX: Trimmed 30735 records to 20504 (keeping 200 days of data) [2025-09-19T19:15:50.455232] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T19:15:50.507610] [DEBUG] [LOCAL ] HIX: Primary data saved (20504 records). [2025-09-19T19:15:50.507786] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-19T19:15:50.507934] [INFO ] [MAIN ] Update Progress: 1024/2372 symbols completed. HIX took 29.4s. Estimated remaining: 2h 58m 44s. Rate: 7.5 symbols/min [2025-09-19T19:15:50.709290] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:50.763187] [DEBUG] [LOCAL ] HLI: Loaded 31662 existing records from primary storage. [2025-09-19T19:15:50.763337] [INFO ] [MAIN ] HLI: Loaded 31662 existing records. [2025-09-19T19:15:50.962163] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:50.962526] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-19T19:15:50.962631] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-19T19:15:50.964178] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-19T19:15:50.964244] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-19T19:15:51.053182] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-19T19:15:51.281346] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T19:15:51.383932] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:51.654041] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T19:15:51.843288] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-19T19:15:52.643276] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-19T19:15:53.421430] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-19T19:15:53.450386] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-19T19:15:53.453976] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T19:15:54.243262] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-19T19:15:54.513704] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T19:15:54.520719] [INFO ] [REMOTE ] HIW: Full fetch complete (64686 records). [2025-09-19T19:15:54.520869] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-19T19:15:54.919633] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-19T19:15:54.919778] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-19T19:15:54.920877] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-19T19:15:54.920966] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-19T19:15:54.933719] [DEBUG] [LOCAL ] HIW: Trimmed 64686 records to 45529 (keeping 200 days of data) [2025-09-19T19:15:54.959932] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T19:15:55.058890] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-19T19:15:55.248091] [DEBUG] [LOCAL ] HIW: Primary data saved (45529 records). [2025-09-19T19:15:55.248352] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-19T19:15:55.248575] [INFO ] [MAIN ] Update Progress: 1025/2372 symbols completed. HIW took 47.1s. Estimated remaining: 2h 58m 32s. Rate: 7.5 symbols/min [2025-09-19T19:15:55.441410] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:15:55.447249] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T19:15:55.492065] [DEBUG] [LOCAL ] HLIO: Loaded 28359 existing records from primary storage. [2025-09-19T19:15:55.492249] [INFO ] [MAIN ] HLIO: Loaded 28359 existing records. [2025-09-19T19:15:55.675278] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:15:55.675704] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-19T19:15:55.675761] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-19T19:15:55.676533] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-19T19:15:55.676592] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-19T19:15:55.848622] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-19T19:15:56.033206] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:15:56.546988] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T19:15:56.643288] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-19T19:15:57.443279] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-19T19:15:57.818803] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T19:15:57.841132] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T19:15:58.243279] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-19T19:15:59.043232] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-19T19:15:59.289485] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T19:15:59.568900] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T19:15:59.843267] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-19T19:16:00.643345] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-19T19:16:01.392399] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T19:16:01.443239] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-19T19:16:01.489491] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T19:16:01.804324] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T19:16:02.243272] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-19T19:16:02.984146] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:16:03.043248] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-19T19:16:03.843297] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-19T19:16:04.651965] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-19T19:16:04.658242] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T19:16:04.891071] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T19:16:04.985146] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T19:16:05.443268] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-19T19:16:06.243277] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-19T19:16:06.284201] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:16:07.043295] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-19T19:16:07.421193] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T19:16:07.429298] [INFO ] [REMOTE ] HL: Full fetch complete (77651 records). [2025-09-19T19:16:07.429445] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-19T19:16:07.848900] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-19T19:16:07.850713] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-19T19:16:07.850817] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-19T19:16:07.851878] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-19T19:16:07.852092] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-19T19:16:07.856845] [DEBUG] [LOCAL ] HL: Trimmed 77651 records to 54450 (keeping 200 days of data) [2025-09-19T19:16:08.216088] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T19:16:08.246458] [DEBUG] [LOCAL ] HL: Primary data saved (54450 records). [2025-09-19T19:16:08.246614] [INFO ] [MAIN ] HL: Full history saved. [2025-09-19T19:16:08.246749] [INFO ] [MAIN ] Update Progress: 1026/2372 symbols completed. HL took 38.1s. Estimated remaining: 2h 58m 30s. Rate: 7.5 symbols/min [2025-09-19T19:16:08.423382] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:08.457121] [DEBUG] [LOCAL ] HLLY: Loaded 33420 existing records from primary storage. [2025-09-19T19:16:08.457301] [INFO ] [MAIN ] HLLY: Loaded 33420 existing records. [2025-09-19T19:16:08.643854] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-19T19:16:08.647455] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:08.649042] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-19T19:16:08.649098] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-19T19:16:08.649912] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-19T19:16:08.650003] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-19T19:16:08.909587] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:16:09.055668] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:09.070461] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T19:16:09.443348] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-19T19:16:10.136392] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:16:10.243270] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-19T19:16:11.043260] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-19T19:16:11.176850] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T19:16:11.843297] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-19T19:16:12.296749] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T19:16:12.304179] [INFO ] [REMOTE ] HLF: Full fetch complete (71509 records). [2025-09-19T19:16:12.304352] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-19T19:16:12.648221] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-19T19:16:12.749362] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-19T19:16:12.749512] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-19T19:16:12.750544] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-19T19:16:12.750632] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-19T19:16:12.774971] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T19:16:12.775160] [DEBUG] [LOCAL ] HLF: Trimmed 71509 records to 49588 (keeping 200 days of data) [2025-09-19T19:16:13.075979] [DEBUG] [LOCAL ] HLF: Primary data saved (49588 records). [2025-09-19T19:16:13.076139] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-19T19:16:13.076855] [INFO ] [MAIN ] Update Progress: 1027/2372 symbols completed. HLF took 24.9s. Estimated remaining: 2h 58m 18s. Rate: 7.5 symbols/min [2025-09-19T19:16:13.253730] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:13.313235] [DEBUG] [LOCAL ] HLN: Loaded 53472 existing records from primary storage. [2025-09-19T19:16:13.313429] [INFO ] [MAIN ] HLN: Loaded 53472 existing records. [2025-09-19T19:16:13.445770] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-19T19:16:13.546669] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T19:16:13.553787] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:13.561236] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-19T19:16:13.562370] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-19T19:16:13.563604] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-19T19:16:13.563707] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-19T19:16:13.919602] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:14.243333] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-19T19:16:14.398895] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T19:16:15.043269] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-19T19:16:15.177967] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T19:16:15.843269] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-19T19:16:16.452797] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T19:16:16.568092] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T19:16:16.643275] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-19T19:16:17.276419] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:16:17.443282] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-19T19:16:18.245931] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-19T19:16:18.251703] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T19:16:18.729138] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T19:16:19.043301] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-19T19:16:19.132689] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T19:16:19.843278] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-19T19:16:20.205051] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:16:20.209601] [INFO ] [REMOTE ] HLI: Full fetch complete (45145 records). [2025-09-19T19:16:20.209732] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-19T19:16:20.607465] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-19T19:16:20.607555] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-19T19:16:20.608270] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-19T19:16:20.608334] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-19T19:16:20.609438] [DEBUG] [LOCAL ] HLI: Trimmed 45145 records to 31874 (keeping 200 days of data) [2025-09-19T19:16:20.669321] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-19T19:16:20.818496] [DEBUG] [LOCAL ] HLI: Primary data saved (31874 records). [2025-09-19T19:16:20.818674] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-19T19:16:20.818796] [INFO ] [MAIN ] Update Progress: 1028/2372 symbols completed. HLI took 30.3s. Estimated remaining: 2h 58m 10s. Rate: 7.5 symbols/min [2025-09-19T19:16:21.008767] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:21.067920] [DEBUG] [LOCAL ] HLT: Loaded 51154 existing records from primary storage. [2025-09-19T19:16:21.068085] [INFO ] [MAIN ] HLT: Loaded 51154 existing records. [2025-09-19T19:16:21.283495] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:21.283823] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-19T19:16:21.283893] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-19T19:16:21.285299] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-19T19:16:21.285366] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-19T19:16:21.450193] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-19T19:16:21.665226] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:21.695875] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T19:16:22.238391] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T19:16:22.246515] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-19T19:16:23.043265] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-19T19:16:23.409066] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T19:16:23.843262] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-19T19:16:24.171580] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T19:16:24.643271] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-19T19:16:24.901248] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T19:16:25.443283] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-19T19:16:25.485079] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:16:26.243281] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-19T19:16:26.534285] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T19:16:27.043248] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-19T19:16:27.622235] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T19:16:27.716638] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T19:16:27.843243] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-19T19:16:28.643285] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-19T19:16:28.940183] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T19:16:29.436696] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:16:29.444002] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-19T19:16:29.899903] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T19:16:29.903786] [INFO ] [REMOTE ] HLIO: Full fetch complete (36077 records). [2025-09-19T19:16:29.903884] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-19T19:16:30.248395] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-19T19:16:30.326828] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-19T19:16:30.326911] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-19T19:16:30.327638] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-19T19:16:30.327721] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-19T19:16:30.328695] [DEBUG] [LOCAL ] HLIO: Trimmed 36077 records to 28501 (keeping 200 days of data) [2025-09-19T19:16:30.513943] [DEBUG] [LOCAL ] HLIO: Primary data saved (28501 records). [2025-09-19T19:16:30.514090] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-19T19:16:30.514216] [INFO ] [MAIN ] Update Progress: 1029/2372 symbols completed. HLIO took 35.3s. Estimated remaining: 2h 58m 4s. Rate: 7.5 symbols/min [2025-09-19T19:16:30.708104] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:30.753561] [DEBUG] [LOCAL ] HLX: Loaded 48514 existing records from primary storage. [2025-09-19T19:16:30.753738] [INFO ] [MAIN ] HLX: Loaded 48514 existing records. [2025-09-19T19:16:30.942308] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:30.942747] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-19T19:16:30.942816] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-19T19:16:30.943850] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-19T19:16:30.943913] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-19T19:16:31.052276] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-19T19:16:31.335243] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:31.370240] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T19:16:31.627580] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:16:31.843258] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-19T19:16:32.643275] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-19T19:16:32.938496] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T19:16:33.048345] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:16:33.443272] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-19T19:16:34.180496] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:16:34.243317] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-19T19:16:34.970890] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T19:16:35.043298] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-19T19:16:35.843267] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-19T19:16:36.326349] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T19:16:36.643262] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-19T19:16:37.189903] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T19:16:37.339137] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T19:16:37.443266] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-19T19:16:38.243264] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-19T19:16:38.421409] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:16:39.043277] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-19T19:16:39.087115] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T19:16:39.093155] [INFO ] [REMOTE ] HLLY: Full fetch complete (46246 records). [2025-09-19T19:16:39.093267] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-19T19:16:39.492476] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-19T19:16:39.492664] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-19T19:16:39.493856] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-19T19:16:39.493932] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-19T19:16:39.495442] [DEBUG] [LOCAL ] HLLY: Trimmed 46246 records to 33735 (keeping 200 days of data) [2025-09-19T19:16:39.783821] [DEBUG] [LOCAL ] HLLY: Primary data saved (33735 records). [2025-09-19T19:16:39.784089] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-19T19:16:39.784299] [INFO ] [MAIN ] Update Progress: 1030/2372 symbols completed. HLLY took 31.5s. Estimated remaining: 2h 57m 58s. Rate: 7.5 symbols/min [2025-09-19T19:16:39.846048] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-19T19:16:40.194429] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:40.227319] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:16:40.307191] [DEBUG] [LOCAL ] HMC: Loaded 47409 existing records from primary storage. [2025-09-19T19:16:40.307428] [INFO ] [MAIN ] HMC: Loaded 47409 existing records. [2025-09-19T19:16:40.570265] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:40.570543] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-19T19:16:40.570592] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-19T19:16:40.571623] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-19T19:16:40.571723] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-19T19:16:40.649473] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-19T19:16:40.955296] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:41.166917] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T19:16:41.273342] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T19:16:41.443262] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-19T19:16:42.243264] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-19T19:16:42.681937] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T19:16:43.043270] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-19T19:16:43.430513] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T19:16:43.674246] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T19:16:43.843262] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-19T19:16:44.643275] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-19T19:16:45.037216] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:16:45.045324] [INFO ] [REMOTE ] HLN: Full fetch complete (76753 records). [2025-09-19T19:16:45.045471] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-19T19:16:45.449672] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-19T19:16:45.469439] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-19T19:16:45.469510] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-19T19:16:45.470516] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-19T19:16:45.470705] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-19T19:16:45.472415] [DEBUG] [LOCAL ] HLN: Trimmed 76753 records to 53862 (keeping 200 days of data) [2025-09-19T19:16:45.812794] [DEBUG] [LOCAL ] HLN: Primary data saved (53862 records). [2025-09-19T19:16:45.812981] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-19T19:16:45.813551] [INFO ] [MAIN ] Update Progress: 1031/2372 symbols completed. HLN took 32.7s. Estimated remaining: 2h 57m 48s. Rate: 7.5 symbols/min [2025-09-19T19:16:45.996087] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:46.035923] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T19:16:46.066410] [DEBUG] [LOCAL ] HMN: Loaded 23442 existing records from primary storage. [2025-09-19T19:16:46.066554] [INFO ] [MAIN ] HMN: Loaded 23442 existing records. [2025-09-19T19:16:46.244591] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-19T19:16:46.244808] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:46.246139] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-19T19:16:46.246199] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-19T19:16:46.246783] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-19T19:16:46.246946] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-19T19:16:46.637372] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:47.012317] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T19:16:47.043211] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-19T19:16:47.457426] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T19:16:47.843307] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-19T19:16:48.230603] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:16:48.643305] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-19T19:16:48.975097] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:16:49.443332] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-19T19:16:50.059377] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T19:16:50.243309] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-19T19:16:50.502768] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T19:16:51.043263] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-19T19:16:51.327107] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T19:16:51.843323] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-19T19:16:52.270906] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T19:16:52.278570] [INFO ] [REMOTE ] HLT: Full fetch complete (73452 records). [2025-09-19T19:16:52.278771] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-19T19:16:52.652793] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-19T19:16:52.675910] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-19T19:16:52.675981] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-19T19:16:52.676972] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-19T19:16:52.677042] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-19T19:16:52.678587] [DEBUG] [LOCAL ] HLT: Trimmed 73452 records to 51521 (keeping 200 days of data) [2025-09-19T19:16:52.960068] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T19:16:53.055747] [DEBUG] [LOCAL ] HLT: Primary data saved (51521 records). [2025-09-19T19:16:53.055915] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-19T19:16:53.056019] [INFO ] [MAIN ] Update Progress: 1032/2372 symbols completed. HLT took 32.2s. Estimated remaining: 2h 57m 39s. Rate: 7.5 symbols/min [2025-09-19T19:16:53.225884] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:53.280306] [DEBUG] [LOCAL ] HMY: Loaded 53515 existing records from primary storage. [2025-09-19T19:16:53.280488] [INFO ] [MAIN ] HMY: Loaded 53515 existing records. [2025-09-19T19:16:53.456715] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-19T19:16:53.462274] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:16:53.463437] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-19T19:16:53.463491] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-19T19:16:53.464664] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-19T19:16:53.464760] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-19T19:16:53.890122] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:53.922078] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:16:54.176536] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T19:16:54.243249] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-19T19:16:55.043258] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-19T19:16:55.437547] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T19:16:55.843253] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-19T19:16:56.243199] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T19:16:56.643233] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-19T19:16:57.315611] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:16:57.443301] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-19T19:16:57.679189] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:16:57.698960] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T19:16:57.704891] [INFO ] [REMOTE ] HLX: Full fetch complete (69112 records). [2025-09-19T19:16:57.705116] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-19T19:16:58.135470] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-19T19:16:58.135552] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-19T19:16:58.136543] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-19T19:16:58.136610] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-19T19:16:58.138010] [DEBUG] [LOCAL ] HLX: Trimmed 69112 records to 48858 (keeping 200 days of data) [2025-09-19T19:16:58.245205] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-19T19:16:58.429170] [DEBUG] [LOCAL ] HLX: Primary data saved (48858 records). [2025-09-19T19:16:58.429449] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-19T19:16:58.429568] [INFO ] [MAIN ] Update Progress: 1033/2372 symbols completed. HLX took 27.9s. Estimated remaining: 2h 57m 27s. Rate: 7.5 symbols/min [2025-09-19T19:16:58.598900] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:16:58.599138] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-19T19:16:58.599194] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-19T19:16:58.599339] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-19T19:16:58.599381] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-19T19:16:58.599420] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-19T19:16:58.599452] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-19T19:16:58.952551] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:16:59.043301] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-19T19:16:59.370782] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:16:59.469858] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T19:16:59.843280] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-19T19:17:00.073546] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:00.073909] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-19T19:17:00.643265] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-19T19:17:01.150218] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T19:17:01.443290] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-19T19:17:01.835202] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T19:17:02.243312] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-19T19:17:03.043260] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-19T19:17:03.513237] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T19:17:03.843280] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-19T19:17:04.081150] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T19:17:04.186094] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T19:17:04.643266] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-19T19:17:05.443239] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-19T19:17:05.706543] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:05.706900] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-19T19:17:05.982365] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T19:17:06.243253] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-19T19:17:06.793913] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T19:17:07.043277] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-19T19:17:07.843292] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-19T19:17:08.620051] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T19:17:08.645016] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-19T19:17:08.648788] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T19:17:09.443304] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-19T19:17:09.807916] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T19:17:10.196474] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T19:17:10.243233] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-19T19:17:10.856308] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-19T19:17:11.043236] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-19T19:17:11.843322] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-19T19:17:12.098916] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T19:17:12.105723] [INFO ] [REMOTE ] HMC: Full fetch complete (69725 records). [2025-09-19T19:17:12.105837] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-19T19:17:12.489855] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-19T19:17:12.489957] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-19T19:17:12.490929] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-19T19:17:12.490993] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-19T19:17:12.492505] [DEBUG] [LOCAL ] HMC: Trimmed 69725 records to 47743 (keeping 200 days of data) [2025-09-19T19:17:12.659227] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-19T19:17:12.776682] [DEBUG] [LOCAL ] HMC: Primary data saved (47743 records). [2025-09-19T19:17:12.776857] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-19T19:17:12.776952] [INFO ] [MAIN ] Update Progress: 1034/2372 symbols completed. HMC took 33.0s. Estimated remaining: 2h 57m 28s. Rate: 7.5 symbols/min [2025-09-19T19:17:12.947592] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:12.949272] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:12.949769] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-19T19:17:12.982235] [DEBUG] [LOCAL ] HNI: Loaded 29086 existing records from primary storage. [2025-09-19T19:17:12.982382] [INFO ] [MAIN ] HNI: Loaded 29086 existing records. [2025-09-19T19:17:13.163895] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:13.164783] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-19T19:17:13.164976] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-19T19:17:13.165854] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-19T19:17:13.165915] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-19T19:17:13.458514] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-19T19:17:13.508814] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T19:17:13.580337] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T19:17:13.629783] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:13.987208] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:13.987753] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-19T19:17:14.243293] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-19T19:17:15.043227] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-19T19:17:15.579501] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T19:17:15.843238] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-19T19:17:16.297306] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:17:16.643257] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-19T19:17:17.148560] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T19:17:17.443277] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-19T19:17:17.969639] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:17:17.973505] [INFO ] [REMOTE ] HMN: Full fetch complete (31553 records). [2025-09-19T19:17:17.973606] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-19T19:17:18.248421] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-19T19:17:18.382893] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-19T19:17:18.382981] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-19T19:17:18.383694] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-19T19:17:18.383755] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-19T19:17:18.384544] [DEBUG] [LOCAL ] HMN: Trimmed 31553 records to 23567 (keeping 200 days of data) [2025-09-19T19:17:18.501182] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T19:17:18.551466] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:17:18.552955] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-19T19:17:18.559185] [DEBUG] [LOCAL ] HMN: Primary data saved (23567 records). [2025-09-19T19:17:18.559330] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-19T19:17:18.559443] [INFO ] [MAIN ] Update Progress: 1035/2372 symbols completed. HMN took 32.7s. Estimated remaining: 2h 57m 17s. Rate: 7.5 symbols/min [2025-09-19T19:17:18.749807] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:18.803141] [DEBUG] [LOCAL ] HOG: Loaded 51670 existing records from primary storage. [2025-09-19T19:17:18.803338] [INFO ] [MAIN ] HOG: Loaded 51670 existing records. [2025-09-19T19:17:18.978523] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:18.978836] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-19T19:17:18.978898] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-19T19:17:18.981563] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-19T19:17:18.981632] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-19T19:17:19.048490] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-19T19:17:19.349876] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:19.843286] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-19T19:17:20.643276] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-19T19:17:21.394866] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-19T19:17:21.443228] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-19T19:17:21.745406] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:17:21.764082] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T19:17:22.243274] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-19T19:17:23.043290] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-19T19:17:23.308428] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T19:17:23.843297] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-19T19:17:23.956129] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:17:24.398274] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T19:17:24.643297] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-19T19:17:25.443222] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-19T19:17:26.058281] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T19:17:26.066821] [INFO ] [REMOTE ] HMY: Full fetch complete (76620 records). [2025-09-19T19:17:26.066967] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-19T19:17:26.249876] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-19T19:17:26.500104] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-19T19:17:26.500238] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-19T19:17:26.501306] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-19T19:17:26.501428] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-19T19:17:26.528406] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T19:17:26.537140] [DEBUG] [LOCAL ] HMY: Trimmed 76620 records to 53905 (keeping 200 days of data) [2025-09-19T19:17:26.864051] [DEBUG] [LOCAL ] HMY: Primary data saved (53905 records). [2025-09-19T19:17:26.864261] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-19T19:17:26.864378] [INFO ] [MAIN ] Update Progress: 1036/2372 symbols completed. HMY took 33.8s. Estimated remaining: 2h 57m 9s. Rate: 7.5 symbols/min [2025-09-19T19:17:27.061227] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:27.061441] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-19T19:17:27.087131] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T19:17:27.132946] [DEBUG] [LOCAL ] HOMB: Loaded 44071 existing records from primary storage. [2025-09-19T19:17:27.133099] [INFO ] [MAIN ] HOMB: Loaded 44071 existing records. [2025-09-19T19:17:27.314914] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:27.315162] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-19T19:17:27.315210] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-19T19:17:27.316261] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-19T19:17:27.316322] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-19T19:17:27.679158] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:27.843248] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-19T19:17:28.272884] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T19:17:28.643237] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-19T19:17:28.775757] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T19:17:29.443263] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-19T19:17:29.851416] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:17:30.243241] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-19T19:17:30.834845] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T19:17:30.956307] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:17:31.043292] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-19T19:17:31.843274] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-19T19:17:32.142414] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T19:17:32.410115] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T19:17:32.643286] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-19T19:17:33.443357] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-19T19:17:33.907511] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T19:17:33.989290] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T19:17:33.997404] [INFO ] [REMOTE ] HNGE: Full fetch complete (25381 records). [2025-09-19T19:17:33.997734] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-19T19:17:34.223318] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 83 unique days, need 200 days [2025-09-19T19:17:34.223878] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:17:34.223985] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:17:34.224086] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-19T19:17:34.224217] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-19T19:17:34.224289] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-19T19:17:34.224368] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-19T19:17:34.224496] [INFO ] [MAIN ] Update Progress: 1037/2372 symbols completed. HNGE took 35.8s. Estimated remaining: 2h 57m 1s. Rate: 7.5 symbols/min [2025-09-19T19:17:34.243302] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-19T19:17:34.850906] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T19:17:35.043272] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-19T19:17:35.599023] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T19:17:35.843280] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-19T19:17:36.643269] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-19T19:17:36.965956] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:17:37.349432] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T19:17:37.443234] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-19T19:17:38.243293] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-19T19:17:38.461278] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T19:17:39.043310] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-19T19:17:39.141302] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:17:39.843344] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-19T19:17:40.216763] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T19:17:40.541076] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T19:17:40.643259] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-19T19:17:41.221210] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T19:17:41.227055] [INFO ] [REMOTE ] HNI: Full fetch complete (40876 records). [2025-09-19T19:17:41.227150] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-19T19:17:41.452625] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-19T19:17:41.605310] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-19T19:17:41.605417] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-19T19:17:41.606183] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-19T19:17:41.606266] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-19T19:17:41.607255] [DEBUG] [LOCAL ] HNI: Trimmed 40876 records to 29351 (keeping 200 days of data) [2025-09-19T19:17:41.792810] [DEBUG] [LOCAL ] HNI: Primary data saved (29351 records). [2025-09-19T19:17:41.792953] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-19T19:17:41.793071] [INFO ] [MAIN ] Update Progress: 1038/2372 symbols completed. HNI took 29.0s. Estimated remaining: 2h 56m 52s. Rate: 7.5 symbols/min [2025-09-19T19:17:42.651863] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T19:17:42.663513] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-19T19:17:42.703340] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T19:17:43.043308] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-19T19:17:44.128286] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T19:17:44.143112] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-19T19:17:44.923885] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:17:44.933267] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-19T19:17:46.121876] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T19:17:46.129393] [INFO ] [REMOTE ] HOG: Full fetch complete (74231 records). [2025-09-19T19:17:46.129559] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-19T19:17:46.540004] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-19T19:17:46.540117] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-19T19:17:46.541229] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-19T19:17:46.541315] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-19T19:17:46.545913] [DEBUG] [LOCAL ] HOG: Trimmed 74231 records to 52045 (keeping 200 days of data) [2025-09-19T19:17:46.827963] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T19:17:46.843521] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-19T19:17:46.940456] [DEBUG] [LOCAL ] HOG: Primary data saved (52045 records). [2025-09-19T19:17:46.940602] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-19T19:17:46.941249] [INFO ] [MAIN ] Update Progress: 1039/2372 symbols completed. HOG took 28.4s. Estimated remaining: 2h 56m 41s. Rate: 7.5 symbols/min [2025-09-19T19:17:48.658279] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:17:48.667563] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-19T19:17:50.437853] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T19:17:50.445842] [INFO ] [REMOTE ] HOMB: Full fetch complete (63563 records). [2025-09-19T19:17:50.445969] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-19T19:17:50.870469] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-19T19:17:50.870558] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-19T19:17:50.871733] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-19T19:17:50.871811] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-19T19:17:50.873402] [DEBUG] [LOCAL ] HOMB: Trimmed 63563 records to 44380 (keeping 200 days of data) [2025-09-19T19:17:51.155271] [DEBUG] [LOCAL ] HOMB: Primary data saved (44380 records). [2025-09-19T19:17:51.155405] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-19T19:17:51.155529] [INFO ] [MAIN ] Update Progress: 1040/2372 symbols completed. HOMB took 24.3s. Estimated remaining: 2h 56m 28s. Rate: 7.5 symbols/min [2025-09-19T19:17:51.793218] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:51.895866] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:51.907748] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:51.918682] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:17:51.966760] [DEBUG] [LOCAL ] HOV: Loaded 13888 existing records from primary storage. [2025-09-19T19:17:51.966925] [INFO ] [MAIN ] HOV: Loaded 13888 existing records. [2025-09-19T19:17:52.104177] [DEBUG] [LOCAL ] HOUS: Loaded 44321 existing records from primary storage. [2025-09-19T19:17:52.104637] [INFO ] [MAIN ] HOUS: Loaded 44321 existing records. [2025-09-19T19:17:52.309731] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:52.326394] [DEBUG] [LOCAL ] HP: Loaded 52009 existing records from primary storage. [2025-09-19T19:17:52.343243] [INFO ] [MAIN ] HP: Loaded 52009 existing records. [2025-09-19T19:17:52.350932] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-19T19:17:52.439119] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-19T19:17:52.504943] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-09-19T19:17:52.505139] [INFO ] [MAIN ] HPE: Loaded 54087 existing records. [2025-09-19T19:17:52.538714] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:52.495712] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-19T19:17:52.581319] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-19T19:17:52.610658] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-19T19:17:52.627209] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-19T19:17:52.707717] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-19T19:17:52.787391] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-19T19:17:52.907818] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:53.072468] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-19T19:17:53.086261] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-19T19:17:53.117067] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-19T19:17:53.163955] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-19T19:17:53.163867] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:17:53.288425] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-19T19:17:53.360701] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-19T19:17:53.428699] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-19T19:17:53.491587] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-19T19:17:53.766856] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:53.836307] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-19T19:17:53.959149] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:53.998110] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-19T19:17:54.290024] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:54.300440] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-19T19:17:54.378175] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:17:54.378463] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-19T19:17:55.113254] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T19:17:55.117008] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-19T19:17:55.486311] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T19:17:55.494544] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-19T19:17:56.068049] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T19:17:56.072612] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-19T19:17:56.210580] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T19:17:56.220898] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-19T19:17:56.687922] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T19:17:56.699146] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-19T19:17:57.006266] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:17:57.010017] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-19T19:17:57.128242] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T19:17:57.137275] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-19T19:17:58.000272] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:17:58.010352] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-19T19:17:58.098609] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T19:17:58.101748] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-19T19:17:58.371161] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T19:17:58.379325] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-19T19:17:58.733332] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T19:17:58.744680] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-19T19:17:58.757342] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T19:17:59.043321] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-19T19:17:59.354219] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:17:59.613173] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T19:17:59.843244] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-19T19:18:00.144292] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T19:18:00.257308] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T19:18:00.643251] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-19T19:18:01.406762] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:18:01.443215] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-19T19:18:02.243371] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-19T19:18:02.615145] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:18:03.043278] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-19T19:18:03.843327] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-19T19:18:04.895335] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T19:18:04.899634] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-19T19:18:05.145494] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T19:18:05.443294] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-19T19:18:05.520945] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (4.08 seconds). [2025-09-19T19:18:05.610185] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T19:18:05.667380] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T19:18:06.243270] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-19T19:18:07.043272] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-19T19:18:07.699435] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T19:18:07.818699] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T19:18:07.843222] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-19T19:18:08.214809] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:18:08.643273] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-19T19:18:09.443274] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-19T19:18:10.004780] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T19:18:10.243287] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-19T19:18:10.357382] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:18:11.043301] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-19T19:18:11.668628] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T19:18:11.843277] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-19T19:18:12.329269] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T19:18:12.331755] [INFO ] [REMOTE ] HOV: Full fetch complete (19429 records). [2025-09-19T19:18:12.331829] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-19T19:18:12.653179] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-19T19:18:12.718224] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T19:18:12.791521] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-19T19:18:12.791625] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-19T19:18:12.792287] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-19T19:18:12.792351] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-19T19:18:12.792967] [DEBUG] [LOCAL ] HOV: Trimmed 19429 records to 13971 (keeping 200 days of data) [2025-09-19T19:18:12.882221] [DEBUG] [LOCAL ] HOV: Primary data saved (13971 records). [2025-09-19T19:18:12.882382] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-19T19:18:12.882480] [INFO ] [MAIN ] Update Progress: 1041/2372 symbols completed. HOV took 21.7s. Estimated remaining: 2h 56m 38s. Rate: 7.5 symbols/min [2025-09-19T19:18:13.049165] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:13.058761] [DEBUG] [LOCAL ] HPF: Loaded 7301 existing records from primary storage. [2025-09-19T19:18:13.058868] [INFO ] [MAIN ] HPF: Loaded 7301 existing records. [2025-09-19T19:18:13.233917] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:13.234194] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-19T19:18:13.234242] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-19T19:18:13.234769] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-19T19:18:13.234832] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-19T19:18:13.454272] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-19T19:18:13.603218] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:13.967823] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:18:14.243277] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-19T19:18:14.423904] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:18:15.043276] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-19T19:18:15.495208] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:18:15.843268] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-19T19:18:15.953622] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T19:18:16.151245] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T19:18:16.643279] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-19T19:18:17.443293] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-19T19:18:17.897100] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T19:18:17.986929] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T19:18:18.243264] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-19T19:18:19.043280] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-19T19:18:19.793102] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T19:18:19.843233] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-19T19:18:19.948532] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-19T19:18:19.956345] [INFO ] [REMOTE ] HP: Full fetch complete (73899 records). [2025-09-19T19:18:19.956475] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-19T19:18:20.359664] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-19T19:18:20.359758] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-19T19:18:20.360701] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-19T19:18:20.360776] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-19T19:18:20.362286] [DEBUG] [LOCAL ] HP: Trimmed 73899 records to 52374 (keeping 200 days of data) [2025-09-19T19:18:20.493814] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T19:18:20.504670] [INFO ] [REMOTE ] HOUS: Full fetch complete (62476 records). [2025-09-19T19:18:20.506107] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-19T19:18:20.678770] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-19T19:18:20.964129] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T19:18:21.058956] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-19T19:18:21.062821] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-19T19:18:21.063927] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-19T19:18:21.093173] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-19T19:18:21.119188] [DEBUG] [LOCAL ] HOUS: Trimmed 62476 records to 44658 (keeping 200 days of data) [2025-09-19T19:18:21.219290] [DEBUG] [LOCAL ] HP: Primary data saved (52374 records). [2025-09-19T19:18:21.220169] [INFO ] [MAIN ] HP: Full history saved. [2025-09-19T19:18:21.221492] [INFO ] [MAIN ] Update Progress: 1042/2372 symbols completed. HP took 30.1s. Estimated remaining: 2h 56m 30s. Rate: 7.5 symbols/min [2025-09-19T19:18:21.420472] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:21.439813] [DEBUG] [LOCAL ] HPI: Loaded 10086 existing records from primary storage. [2025-09-19T19:18:21.440329] [INFO ] [MAIN ] HPI: Loaded 10086 existing records. [2025-09-19T19:18:21.452063] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-19T19:18:21.730794] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:21.731909] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-19T19:18:21.732264] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-19T19:18:21.736695] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-19T19:18:21.736772] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-19T19:18:21.902789] [DEBUG] [LOCAL ] HOUS: Primary data saved (44658 records). [2025-09-19T19:18:21.935298] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-19T19:18:21.951798] [INFO ] [MAIN ] Update Progress: 1043/2372 symbols completed. HOUS took 30.8s. Estimated remaining: 2h 56m 13s. Rate: 7.5 symbols/min [2025-09-19T19:18:22.312397] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:22.309488] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:22.312769] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-19T19:18:22.361708] [DEBUG] [LOCAL ] HPP: Loaded 51117 existing records from primary storage. [2025-09-19T19:18:22.361855] [INFO ] [MAIN ] HPP: Loaded 51117 existing records. [2025-09-19T19:18:22.477572] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T19:18:22.552802] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:22.553090] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-19T19:18:22.553182] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-19T19:18:22.554528] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-19T19:18:22.554589] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-19T19:18:22.903509] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:23.043221] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-19T19:18:23.175037] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-19T19:18:23.191381] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T19:18:23.775683] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T19:18:23.843275] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-19T19:18:24.643280] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-19T19:18:25.266275] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T19:18:25.443324] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-19T19:18:25.788391] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T19:18:25.996230] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-19T19:18:26.243338] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-19T19:18:26.681564] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-19T19:18:27.043286] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-19T19:18:27.843245] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-19T19:18:28.106300] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T19:18:28.643264] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-19T19:18:29.443264] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-19T19:18:30.243275] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-19T19:18:30.393283] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-19T19:18:30.393727] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T19:18:30.405364] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-19T19:18:30.405507] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-19T19:18:30.847169] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-19T19:18:30.847294] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-19T19:18:30.848336] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-19T19:18:30.848470] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-19T19:18:30.924549] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-19T19:18:30.922805] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54477 (keeping 200 days of data) [2025-09-19T19:18:31.043235] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-19T19:18:31.277929] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T19:18:31.303987] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-09-19T19:18:31.304122] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-19T19:18:31.304226] [INFO ] [MAIN ] Update Progress: 1044/2372 symbols completed. HPE took 40.1s. Estimated remaining: 2h 56m 7s. Rate: 7.5 symbols/min [2025-09-19T19:18:31.490309] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:31.544626] [DEBUG] [LOCAL ] HPQ: Loaded 54059 existing records from primary storage. [2025-09-19T19:18:31.544816] [INFO ] [MAIN ] HPQ: Loaded 54059 existing records. [2025-09-19T19:18:31.741097] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:31.741373] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-19T19:18:31.741426] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-19T19:18:31.743109] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-19T19:18:31.743174] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-19T19:18:31.851717] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-19T19:18:32.075784] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T19:18:32.148336] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:32.643275] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-19T19:18:33.443278] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-19T19:18:33.512061] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:18:33.608446] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T19:18:33.610716] [INFO ] [REMOTE ] HPF: Full fetch complete (10803 records). [2025-09-19T19:18:33.610824] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-19T19:18:33.988946] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-19T19:18:33.989056] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-19T19:18:33.989326] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-19T19:18:33.989367] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-19T19:18:33.989868] [DEBUG] [LOCAL ] HPF: Trimmed 10803 records to 7364 (keeping 200 days of data) [2025-09-19T19:18:34.036567] [DEBUG] [LOCAL ] HPF: Primary data saved (7364 records). [2025-09-19T19:18:34.036729] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-19T19:18:34.036835] [INFO ] [MAIN ] Update Progress: 1045/2372 symbols completed. HPF took 21.2s. Estimated remaining: 2h 55m 52s. Rate: 7.5 symbols/min [2025-09-19T19:18:34.203805] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:34.215372] [DEBUG] [LOCAL ] HPS: Loaded 10359 existing records from primary storage. [2025-09-19T19:18:34.215489] [INFO ] [MAIN ] HPS: Loaded 10359 existing records. [2025-09-19T19:18:34.248323] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-19T19:18:34.402132] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:34.402579] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-19T19:18:34.402792] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-19T19:18:34.408815] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-19T19:18:34.409787] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T19:18:34.409539] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-19T19:18:34.801164] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:35.043268] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-19T19:18:35.843282] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-19T19:18:36.309171] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T19:18:36.422198] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T19:18:36.643285] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-19T19:18:36.846767] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T19:18:37.443277] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-19T19:18:38.243270] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-19T19:18:38.327659] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-19T19:18:38.577352] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:18:39.043276] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-19T19:18:39.213551] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T19:18:39.843307] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-19T19:18:40.643266] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-19T19:18:41.164890] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T19:18:41.205385] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-19T19:18:41.257619] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T19:18:41.443310] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-19T19:18:42.243310] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-19T19:18:43.043331] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-19T19:18:43.843411] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-19T19:18:43.974894] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-19T19:18:43.994187] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T19:18:44.027550] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T19:18:44.643282] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-19T19:18:44.855177] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T19:18:45.443280] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-19T19:18:45.544071] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T19:18:46.243285] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-19T19:18:47.043270] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-19T19:18:47.542325] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T19:18:47.577879] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:18:47.581274] [INFO ] [REMOTE ] HPI: Full fetch complete (13399 records). [2025-09-19T19:18:47.581351] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-19T19:18:47.848465] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-19T19:18:47.968002] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-19T19:18:47.968085] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-19T19:18:47.968441] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-19T19:18:47.968487] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-19T19:18:47.969008] [DEBUG] [LOCAL ] HPI: Trimmed 13399 records to 10185 (keeping 200 days of data) [2025-09-19T19:18:48.032263] [DEBUG] [LOCAL ] HPI: Primary data saved (10185 records). [2025-09-19T19:18:48.032399] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-19T19:18:48.032486] [INFO ] [MAIN ] Update Progress: 1046/2372 symbols completed. HPI took 26.8s. Estimated remaining: 2h 55m 52s. Rate: 7.5 symbols/min [2025-09-19T19:18:48.199039] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:48.223241] [DEBUG] [LOCAL ] HQH: Loaded 25114 existing records from primary storage. [2025-09-19T19:18:48.223370] [INFO ] [MAIN ] HQH: Loaded 25114 existing records. [2025-09-19T19:18:48.403731] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:48.404228] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-19T19:18:48.404355] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-19T19:18:48.405295] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-19T19:18:48.405358] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-19T19:18:48.603249] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T19:18:48.646283] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-19T19:18:48.847169] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:49.443281] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-19T19:18:49.662592] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T19:18:50.242765] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T19:18:50.253424] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-19T19:18:51.043258] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-19T19:18:51.301022] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:18:51.843292] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-19T19:18:52.065891] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T19:18:52.170208] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T19:18:52.643337] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-19T19:18:53.443306] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-19T19:18:53.827314] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:18:53.874275] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:18:54.243269] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-19T19:18:55.043272] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-19T19:18:55.135163] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T19:18:55.358126] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T19:18:55.843245] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-19T19:18:56.450861] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:18:56.643249] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-19T19:18:57.057493] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T19:18:57.059910] [INFO ] [REMOTE ] HPS: Full fetch complete (15139 records). [2025-09-19T19:18:57.059996] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-19T19:18:57.445295] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-19T19:18:57.445127] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-19T19:18:57.445677] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-19T19:18:57.447477] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-19T19:18:57.447553] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-19T19:18:57.448564] [DEBUG] [LOCAL ] HPS: Trimmed 15139 records to 10420 (keeping 200 days of data) [2025-09-19T19:18:57.519267] [DEBUG] [LOCAL ] HPS: Primary data saved (10420 records). [2025-09-19T19:18:57.519425] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-19T19:18:57.519515] [INFO ] [MAIN ] Update Progress: 1047/2372 symbols completed. HPS took 23.5s. Estimated remaining: 2h 55m 46s. Rate: 7.5 symbols/min [2025-09-19T19:18:57.694200] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:18:57.711790] [DEBUG] [LOCAL ] HQL: Loaded 16275 existing records from primary storage. [2025-09-19T19:18:57.711928] [INFO ] [MAIN ] HQL: Loaded 16275 existing records. [2025-09-19T19:18:57.887082] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:18:57.887371] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-19T19:18:57.887420] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-19T19:18:57.888066] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-19T19:18:57.888128] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-19T19:18:58.197297] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T19:18:58.252719] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-19T19:18:58.296037] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:18:59.043261] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-19T19:18:59.083066] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T19:18:59.533260] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T19:18:59.843262] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-19T19:19:00.643330] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-19T19:19:01.008162] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T19:19:01.443306] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-19T19:19:01.542218] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T19:19:01.550308] [INFO ] [REMOTE ] HPP: Full fetch complete (73354 records). [2025-09-19T19:19:01.550496] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-19T19:19:01.913130] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T19:19:01.998139] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-19T19:19:01.998236] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-19T19:19:01.999189] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-19T19:19:01.999258] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-19T19:19:02.000829] [DEBUG] [LOCAL ] HPP: Trimmed 73354 records to 51503 (keeping 200 days of data) [2025-09-19T19:19:02.257968] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-19T19:19:02.302134] [DEBUG] [LOCAL ] HPP: Primary data saved (51503 records). [2025-09-19T19:19:02.302348] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-19T19:19:02.302500] [INFO ] [MAIN ] Update Progress: 1048/2372 symbols completed. HPP took 40.3s. Estimated remaining: 2h 55m 34s. Rate: 7.5 symbols/min [2025-09-19T19:19:02.479400] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:02.538776] [DEBUG] [LOCAL ] HR: Loaded 52355 existing records from primary storage. [2025-09-19T19:19:02.538992] [INFO ] [MAIN ] HR: Loaded 52355 existing records. [2025-09-19T19:19:02.651605] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:19:02.733525] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:02.733843] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-19T19:19:02.733923] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-19T19:19:02.735146] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-19T19:19:02.735208] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-19T19:19:03.048360] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-19T19:19:03.091579] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:03.843313] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-19T19:19:03.990519] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T19:19:04.534570] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T19:19:04.643306] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-19T19:19:05.314161] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T19:19:05.443304] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-19T19:19:06.243314] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-19T19:19:06.346948] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T19:19:06.355529] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-19T19:19:06.355743] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-19T19:19:06.805495] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-19T19:19:06.805811] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-19T19:19:06.807918] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-19T19:19:06.808052] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-19T19:19:06.825286] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:19:06.832360] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 54448 (keeping 200 days of data) [2025-09-19T19:19:07.057011] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-19T19:19:07.207321] [DEBUG] [LOCAL ] HPQ: Primary data saved (54448 records). [2025-09-19T19:19:07.207536] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-19T19:19:07.207675] [INFO ] [MAIN ] Update Progress: 1049/2372 symbols completed. HPQ took 35.9s. Estimated remaining: 2h 55m 22s. Rate: 7.5 symbols/min [2025-09-19T19:19:07.397165] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:07.460475] [DEBUG] [LOCAL ] HRB: Loaded 48974 existing records from primary storage. [2025-09-19T19:19:07.460749] [INFO ] [MAIN ] HRB: Loaded 48974 existing records. [2025-09-19T19:19:07.672834] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:19:07.678985] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:07.683564] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-19T19:19:07.683637] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-19T19:19:07.685009] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-19T19:19:07.685078] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-19T19:19:07.846530] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-19T19:19:08.050711] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:08.607085] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:19:08.643270] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-19T19:19:09.443342] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-19T19:19:09.778666] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:19:09.991874] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T19:19:10.243277] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-19T19:19:10.621512] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T19:19:11.043289] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-19T19:19:11.843282] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-19T19:19:11.965780] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T19:19:12.419281] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T19:19:12.423139] [INFO ] [REMOTE ] HQH: Full fetch complete (37417 records). [2025-09-19T19:19:12.423227] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-19T19:19:12.618486] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T19:19:12.648898] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-19T19:19:12.830207] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-19T19:19:12.830310] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-19T19:19:12.831093] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-19T19:19:12.831157] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-19T19:19:12.832004] [DEBUG] [LOCAL ] HQH: Trimmed 37417 records to 25294 (keeping 200 days of data) [2025-09-19T19:19:12.987782] [DEBUG] [LOCAL ] HQH: Primary data saved (25294 records). [2025-09-19T19:19:12.987918] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-19T19:19:12.988033] [INFO ] [MAIN ] Update Progress: 1050/2372 symbols completed. HQH took 25.0s. Estimated remaining: 2h 55m 11s. Rate: 7.5 symbols/min [2025-09-19T19:19:13.158411] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:13.194348] [DEBUG] [LOCAL ] HRI: Loaded 33522 existing records from primary storage. [2025-09-19T19:19:13.194494] [INFO ] [MAIN ] HRI: Loaded 33522 existing records. [2025-09-19T19:19:13.388347] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:13.388731] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-19T19:19:13.388807] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-19T19:19:13.389872] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-19T19:19:13.389952] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-19T19:19:13.454751] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-19T19:19:13.749357] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:14.243287] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-19T19:19:14.661458] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:19:14.682746] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T19:19:15.043282] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-19T19:19:15.391796] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:19:15.843288] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-19T19:19:15.977087] [DEBUG] [REMOTE ] HRI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T19:19:15.977454] [WARN ] [REMOTE ] HRI: No data returned for month 2025-01 [2025-09-19T19:19:16.643270] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-19T19:19:16.856031] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T19:19:17.443312] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-19T19:19:18.243322] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-19T19:19:18.288871] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T19:19:19.043372] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-19T19:19:19.233926] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:19:19.447786] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T19:19:19.843311] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-19T19:19:20.650371] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-19T19:19:20.668693] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:19:21.443309] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-19T19:19:21.750920] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T19:19:22.243276] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-19T19:19:22.583771] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:19:22.803678] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T19:19:23.043276] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-19T19:19:23.492012] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T19:19:23.794020] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:19:23.843296] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-19T19:19:24.643270] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-19T19:19:25.446840] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-19T19:19:25.449288] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T19:19:26.243243] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-19T19:19:26.371629] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T19:19:27.043310] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-19T19:19:27.379140] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:19:27.457508] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T19:19:27.843277] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-19T19:19:28.643275] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-19T19:19:28.861413] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T19:19:28.980276] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T19:19:29.443272] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-19T19:19:30.243288] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-19T19:19:30.518956] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:19:30.615219] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:19:31.043284] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-19T19:19:31.731786] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T19:19:31.843262] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-19T19:19:31.974960] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T19:19:31.977578] [INFO ] [REMOTE ] HQL: Full fetch complete (24072 records). [2025-09-19T19:19:31.977691] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-19T19:19:32.362663] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-19T19:19:32.362759] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-19T19:19:32.363263] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-19T19:19:32.363302] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-19T19:19:32.363990] [DEBUG] [LOCAL ] HQL: Trimmed 24072 records to 16379 (keeping 200 days of data) [2025-09-19T19:19:32.473037] [DEBUG] [LOCAL ] HQL: Primary data saved (16379 records). [2025-09-19T19:19:32.473253] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-19T19:19:32.473400] [INFO ] [MAIN ] Update Progress: 1051/2372 symbols completed. HQL took 35.0s. Estimated remaining: 2h 55m 18s. Rate: 7.5 symbols/min [2025-09-19T19:19:32.652734] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-19T19:19:32.656346] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:32.723387] [DEBUG] [LOCAL ] HRL: Loaded 53469 existing records from primary storage. [2025-09-19T19:19:32.723588] [INFO ] [MAIN ] HRL: Loaded 53469 existing records. [2025-09-19T19:19:32.916278] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:32.916582] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-19T19:19:32.916668] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-19T19:19:32.918039] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-19T19:19:32.918101] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-19T19:19:33.319514] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:33.443264] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-19T19:19:33.880872] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:19:33.911609] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T19:19:34.243266] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-19T19:19:35.043263] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-19T19:19:35.315529] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T19:19:35.405283] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:19:35.410484] [INFO ] [REMOTE ] HRI: Full fetch complete (41920 records). [2025-09-19T19:19:35.410762] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-19T19:19:35.604780] [WARN ] [VALIDATOR ] HRI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T19:19:35.605259] [FATAL] [MAIN ] HRI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:19:35.605330] [WARN ] [MAIN ] HRI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:19:35.605402] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-19T19:19:35.605484] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-09-19T19:19:35.605612] [INFO ] [LOCAL ] HRI: Starting deletion of derivative data. [2025-09-19T19:19:35.606119] [DEBUG] [LOCAL ] HRI: Deleted derivative data file. [2025-09-19T19:19:35.608019] [INFO ] [MAIN ] Update Progress: 1052/2372 symbols completed. HRI took 22.6s. Estimated remaining: 2h 55m 4s. Rate: 7.5 symbols/min [2025-09-19T19:19:35.778134] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:35.812544] [DEBUG] [LOCAL ] HRTG: Loaded 32581 existing records from primary storage. [2025-09-19T19:19:35.812709] [INFO ] [MAIN ] HRTG: Loaded 32581 existing records. [2025-09-19T19:19:35.848373] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-19T19:19:35.996666] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:35.996907] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-19T19:19:35.996962] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-19T19:19:35.998079] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-19T19:19:35.998141] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-19T19:19:36.390392] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:36.643271] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-19T19:19:37.001814] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T19:19:37.443251] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-19T19:19:37.899938] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T19:19:37.937503] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:19:38.243275] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-19T19:19:39.043282] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-19T19:19:39.196716] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:19:39.678010] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T19:19:39.686580] [INFO ] [REMOTE ] HR: Full fetch complete (74806 records). [2025-09-19T19:19:39.686775] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-19T19:19:39.852633] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-19T19:19:40.118748] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-19T19:19:40.118845] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-19T19:19:40.119969] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-19T19:19:40.120037] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-19T19:19:40.121704] [DEBUG] [LOCAL ] HR: Trimmed 74806 records to 52730 (keeping 200 days of data) [2025-09-19T19:19:40.462523] [DEBUG] [LOCAL ] HR: Primary data saved (52730 records). [2025-09-19T19:19:40.462706] [INFO ] [MAIN ] HR: Full history saved. [2025-09-19T19:19:40.462812] [INFO ] [MAIN ] Update Progress: 1053/2372 symbols completed. HR took 38.2s. Estimated remaining: 2h 54m 52s. Rate: 7.5 symbols/min [2025-09-19T19:19:40.644439] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-19T19:19:40.657050] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:40.658281] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-09-19T19:19:40.658338] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-09-19T19:19:40.658491] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-19T19:19:40.658536] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-19T19:19:40.658579] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-09-19T19:19:40.658613] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-19T19:19:41.052114] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:41.083243] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T19:19:41.122640] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T19:19:41.443268] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-19T19:19:42.243315] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-19T19:19:42.700071] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T19:19:43.043244] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-19T19:19:43.390927] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T19:19:43.508951] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:19:43.843271] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-19T19:19:44.361693] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T19:19:44.643266] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-19T19:19:45.443294] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-19T19:19:45.666966] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T19:19:45.674373] [INFO ] [REMOTE ] HRB: Full fetch complete (69819 records). [2025-09-19T19:19:45.674500] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-19T19:19:45.997180] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:19:46.088039] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-19T19:19:46.088120] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-19T19:19:46.089032] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-19T19:19:46.089094] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-19T19:19:46.090434] [DEBUG] [LOCAL ] HRB: Trimmed 69819 records to 49332 (keeping 200 days of data) [2025-09-19T19:19:46.269444] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-19T19:19:46.398876] [DEBUG] [LOCAL ] HRB: Primary data saved (49332 records). [2025-09-19T19:19:46.399057] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-19T19:19:46.399172] [INFO ] [MAIN ] Update Progress: 1054/2372 symbols completed. HRB took 39.2s. Estimated remaining: 2h 54m 42s. Rate: 7.5 symbols/min [2025-09-19T19:19:46.573949] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:19:46.590474] [DEBUG] [LOCAL ] HSHP: Loaded 15834 existing records from primary storage. [2025-09-19T19:19:46.590610] [INFO ] [MAIN ] HSHP: Loaded 15834 existing records. [2025-09-19T19:19:46.770759] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:19:46.771017] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-19T19:19:46.771067] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-19T19:19:46.771513] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-19T19:19:46.771582] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-19T19:19:47.048420] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-19T19:19:47.150611] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:19:47.483415] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T19:19:47.590108] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T19:19:47.843265] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-19T19:19:48.643303] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-19T19:19:49.117904] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T19:19:49.155471] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T19:19:49.443287] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-19T19:19:50.243258] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-19T19:19:50.436486] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:19:50.742152] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T19:19:51.043302] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-19T19:19:51.843285] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-19T19:19:51.897292] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T19:19:52.151896] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T19:19:52.643275] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-19T19:19:53.443274] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-19T19:19:54.194550] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T19:19:54.243273] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-19T19:19:54.605442] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T19:19:54.778295] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T19:19:55.043274] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-19T19:19:55.843256] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-19T19:19:56.216805] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T19:19:56.275667] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T19:19:56.643287] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-19T19:19:57.443830] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-19T19:19:57.446231] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T19:19:58.243222] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-19T19:19:58.630472] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T19:19:58.923462] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:19:59.043264] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-19T19:19:59.205180] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T19:19:59.843254] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-19T19:20:00.643273] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-19T19:20:01.146789] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T19:20:01.372463] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:20:01.377607] [INFO ] [REMOTE ] HRTG: Full fetch complete (41916 records). [2025-09-19T19:20:01.377735] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-19T19:20:01.448402] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-19T19:20:01.814572] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-19T19:20:01.822347] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-19T19:20:01.823416] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-19T19:20:01.823525] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-19T19:20:01.825267] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T19:20:01.829416] [DEBUG] [LOCAL ] HRTG: Trimmed 41916 records to 32937 (keeping 200 days of data) [2025-09-19T19:20:02.045951] [DEBUG] [LOCAL ] HRTG: Primary data saved (32937 records). [2025-09-19T19:20:02.046117] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-19T19:20:02.046250] [INFO ] [MAIN ] Update Progress: 1055/2372 symbols completed. HRTG took 26.4s. Estimated remaining: 2h 54m 43s. Rate: 7.5 symbols/min [2025-09-19T19:20:02.223397] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:02.253734] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-19T19:20:02.284974] [DEBUG] [LOCAL ] HSY: Loaded 50876 existing records from primary storage. [2025-09-19T19:20:02.285178] [INFO ] [MAIN ] HSY: Loaded 50876 existing records. [2025-09-19T19:20:02.466007] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:02.466329] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-19T19:20:02.466497] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-19T19:20:02.467888] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-19T19:20:02.467958] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-19T19:20:02.829809] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:03.043253] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-19T19:20:03.180429] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T19:20:03.571770] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T19:20:03.843252] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-19T19:20:04.643264] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-19T19:20:05.111498] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T19:20:05.443275] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-19T19:20:05.927552] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T19:20:06.120842] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-19T19:20:06.243235] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-19T19:20:06.787993] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T19:20:07.043267] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-19T19:20:07.242866] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-19T19:20:07.843272] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-19T19:20:08.643285] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-19T19:20:09.132353] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T19:20:09.135672] [INFO ] [REMOTE ] HSHP: Full fetch complete (23660 records). [2025-09-19T19:20:09.135772] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-19T19:20:09.255906] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T19:20:09.448720] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-19T19:20:09.569724] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-19T19:20:09.569824] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-19T19:20:09.570385] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-19T19:20:09.570462] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-19T19:20:09.571155] [DEBUG] [LOCAL ] HSHP: Trimmed 23660 records to 16012 (keeping 200 days of data) [2025-09-19T19:20:09.666718] [DEBUG] [LOCAL ] HSHP: Primary data saved (16012 records). [2025-09-19T19:20:09.666862] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-19T19:20:09.666993] [INFO ] [MAIN ] Update Progress: 1056/2372 symbols completed. HSHP took 23.3s. Estimated remaining: 2h 54m 35s. Rate: 7.5 symbols/min [2025-09-19T19:20:09.836622] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:09.836833] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-19T19:20:09.836876] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-19T19:20:09.837026] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-19T19:20:09.837067] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-19T19:20:09.837106] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-19T19:20:09.837148] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-19T19:20:10.204351] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:10.243216] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-19T19:20:10.464521] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:20:10.464917] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-19T19:20:10.867115] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T19:20:11.043282] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-19T19:20:11.738094] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-19T19:20:11.746982] [INFO ] [REMOTE ] HRL: Full fetch complete (76693 records). [2025-09-19T19:20:11.747151] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-19T19:20:11.848839] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-19T19:20:12.171538] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-19T19:20:12.171639] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-19T19:20:12.172893] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-19T19:20:12.172973] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-19T19:20:12.181121] [DEBUG] [LOCAL ] HRL: Trimmed 76693 records to 53857 (keeping 200 days of data) [2025-09-19T19:20:12.528737] [DEBUG] [LOCAL ] HRL: Primary data saved (53857 records). [2025-09-19T19:20:12.528880] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-19T19:20:12.529033] [INFO ] [MAIN ] Update Progress: 1057/2372 symbols completed. HRL took 40.1s. Estimated remaining: 2h 54m 21s. Rate: 7.5 symbols/min [2025-09-19T19:20:12.648382] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-19T19:20:12.717194] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:12.733598] [DEBUG] [LOCAL ] HTD: Loaded 13557 existing records from primary storage. [2025-09-19T19:20:12.733756] [INFO ] [MAIN ] HTD: Loaded 13557 existing records. [2025-09-19T19:20:12.917199] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:12.917523] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-19T19:20:12.917573] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-19T19:20:12.918252] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-19T19:20:12.918322] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-19T19:20:12.961765] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:20:13.004412] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-19T19:20:13.286465] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:13.314520] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T19:20:13.443250] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-19T19:20:14.000846] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T19:20:14.243270] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-19T19:20:14.504174] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T19:20:14.516522] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-19T19:20:15.043265] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-19T19:20:15.843260] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-19T19:20:16.020497] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T19:20:16.643266] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-19T19:20:17.443283] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-19T19:20:17.618549] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-19T19:20:17.894838] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T19:20:18.243275] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-19T19:20:18.510736] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T19:20:19.043275] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-19T19:20:19.843289] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-19T19:20:20.250555] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:20:20.326367] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:20:20.643265] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-19T19:20:21.443325] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-19T19:20:21.814250] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:20:21.826937] [INFO ] [REMOTE ] HSBC: Full fetch complete (73550 records). [2025-09-19T19:20:21.827097] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-19T19:20:22.230259] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-19T19:20:22.230359] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-19T19:20:22.231394] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-19T19:20:22.231460] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-19T19:20:22.233067] [DEBUG] [LOCAL ] HSBC: Trimmed 73550 records to 51975 (keeping 200 days of data) [2025-09-19T19:20:22.243288] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-19T19:20:22.581956] [DEBUG] [LOCAL ] HSBC: Primary data saved (51975 records). [2025-09-19T19:20:22.582566] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-19T19:20:22.582691] [INFO ] [MAIN ] Update Progress: 1058/2372 symbols completed. HSBC took 42.1s. Estimated remaining: 2h 54m 15s. Rate: 7.5 symbols/min [2025-09-19T19:20:22.762216] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:22.762453] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-19T19:20:22.762510] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-19T19:20:22.762691] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-19T19:20:22.762747] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-19T19:20:22.762792] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-19T19:20:22.762825] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-19T19:20:23.120600] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:23.120946] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-19T19:20:23.341066] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-19T19:20:23.409689] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-19T19:20:23.445471] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T19:20:23.656229] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T19:20:23.843267] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-19T19:20:24.643290] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-19T19:20:25.443264] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-19T19:20:25.508668] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T19:20:25.647402] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T19:20:25.839587] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-19T19:20:26.243263] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-19T19:20:27.043264] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-19T19:20:27.071417] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T19:20:27.843269] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-19T19:20:28.643258] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-19T19:20:28.923004] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T19:20:29.302589] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T19:20:29.443314] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-19T19:20:29.680838] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T19:20:29.684422] [INFO ] [REMOTE ] HTB: Full fetch complete (7314 records). [2025-09-19T19:20:29.684586] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-19T19:20:29.966159] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 141 unique days, need 200 days [2025-09-19T19:20:29.966574] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:20:29.966691] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:20:29.966785] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-19T19:20:29.966881] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-19T19:20:29.966942] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-19T19:20:29.967013] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-19T19:20:29.967133] [INFO ] [MAIN ] Update Progress: 1059/2372 symbols completed. HTB took 20.3s. Estimated remaining: 2h 54m 7s. Rate: 7.5 symbols/min [2025-09-19T19:20:30.215766] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:30.243307] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-19T19:20:30.307714] [DEBUG] [LOCAL ] HTGC: Loaded 48106 existing records from primary storage. [2025-09-19T19:20:30.307908] [INFO ] [MAIN ] HTGC: Loaded 48106 existing records. [2025-09-19T19:20:30.528323] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:30.528593] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-19T19:20:30.528684] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-19T19:20:30.530657] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-19T19:20:30.530728] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-19T19:20:30.936966] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:31.043275] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-19T19:20:31.404858] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T19:20:31.431110] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-19T19:20:31.542883] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T19:20:31.843261] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-19T19:20:32.643274] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-19T19:20:32.823107] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T19:20:33.443285] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-19T19:20:34.243273] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-19T19:20:34.454596] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T19:20:34.631575] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-19T19:20:34.792033] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T19:20:35.043270] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-19T19:20:35.482598] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T19:20:35.843263] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-19T19:20:36.643350] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-19T19:20:37.443250] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-19T19:20:37.859547] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T19:20:37.888618] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T19:20:37.896123] [INFO ] [REMOTE ] HSY: Full fetch complete (73863 records). [2025-09-19T19:20:37.896277] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-19T19:20:38.248480] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-19T19:20:38.308874] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-19T19:20:38.308989] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-19T19:20:38.310441] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-19T19:20:38.310524] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-19T19:20:38.312255] [DEBUG] [LOCAL ] HSY: Trimmed 73863 records to 51230 (keeping 200 days of data) [2025-09-19T19:20:38.649260] [DEBUG] [LOCAL ] HSY: Primary data saved (51230 records). [2025-09-19T19:20:38.649420] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-19T19:20:38.650058] [INFO ] [MAIN ] Update Progress: 1060/2372 symbols completed. HSY took 36.6s. Estimated remaining: 2h 53m 60s. Rate: 7.5 symbols/min [2025-09-19T19:20:38.723869] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T19:20:38.826236] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:38.868798] [DEBUG] [LOCAL ] HTH: Loaded 33114 existing records from primary storage. [2025-09-19T19:20:38.868943] [INFO ] [MAIN ] HTH: Loaded 33114 existing records. [2025-09-19T19:20:39.048775] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:39.044487] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-19T19:20:39.050256] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-19T19:20:39.050370] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-19T19:20:39.051455] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-19T19:20:39.051523] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-19T19:20:39.436365] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:39.463503] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T19:20:39.843275] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-19T19:20:40.064319] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T19:20:40.643334] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-19T19:20:41.443274] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-19T19:20:41.805333] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T19:20:41.900186] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T19:20:42.243312] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-19T19:20:42.459728] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T19:20:42.462423] [INFO ] [REMOTE ] HTD: Full fetch complete (18833 records). [2025-09-19T19:20:42.462513] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-19T19:20:42.640575] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T19:20:42.833286] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-19T19:20:42.833368] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-19T19:20:42.833797] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-19T19:20:42.833858] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-19T19:20:42.834438] [DEBUG] [LOCAL ] HTD: Trimmed 18833 records to 13659 (keeping 200 days of data) [2025-09-19T19:20:42.919486] [DEBUG] [LOCAL ] HTD: Primary data saved (13659 records). [2025-09-19T19:20:42.919630] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-19T19:20:42.919766] [INFO ] [MAIN ] Update Progress: 1061/2372 symbols completed. HTD took 30.4s. Estimated remaining: 2h 53m 47s. Rate: 7.5 symbols/min [2025-09-19T19:20:43.061991] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-19T19:20:43.096153] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:43.135453] [DEBUG] [LOCAL ] HUBB: Loaded 37812 existing records from primary storage. [2025-09-19T19:20:43.135619] [INFO ] [MAIN ] HUBB: Loaded 37812 existing records. [2025-09-19T19:20:43.311016] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:43.311260] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-19T19:20:43.311308] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-19T19:20:43.312490] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-19T19:20:43.312554] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-19T19:20:43.678188] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:43.843264] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-19T19:20:44.130292] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-19T19:20:44.643292] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-19T19:20:44.817103] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:20:45.443265] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-19T19:20:45.711445] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T19:20:45.817588] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-19T19:20:46.243278] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-19T19:20:47.043270] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-19T19:20:47.520020] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T19:20:47.520751] [INFO ] [REMOTE ] HTFC: Full fetch complete (863 records). [2025-09-19T19:20:47.520821] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-19T19:20:47.707893] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-09-19T19:20:47.708152] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:20:47.708241] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:20:47.708336] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-19T19:20:47.708473] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-19T19:20:47.708547] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-19T19:20:47.708677] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-19T19:20:47.708788] [INFO ] [MAIN ] Update Progress: 1062/2372 symbols completed. HTFC took 25.1s. Estimated remaining: 2h 53m 35s. Rate: 7.5 symbols/min [2025-09-19T19:20:47.848367] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-19T19:20:47.920459] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:20:47.962494] [DEBUG] [LOCAL ] HUBS: Loaded 40122 existing records from primary storage. [2025-09-19T19:20:47.962669] [INFO ] [MAIN ] HUBS: Loaded 40122 existing records. [2025-09-19T19:20:48.176576] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:20:48.177178] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-19T19:20:48.177252] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-19T19:20:48.178376] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-19T19:20:48.178440] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-19T19:20:48.366728] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T19:20:48.577532] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:20:48.643309] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-19T19:20:49.414313] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:20:49.443285] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-19T19:20:50.241867] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T19:20:50.248593] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-19T19:20:51.043269] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-19T19:20:51.457517] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T19:20:51.843305] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-19T19:20:51.942806] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T19:20:52.643267] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-19T19:20:52.777684] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T19:20:53.443301] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-19T19:20:53.499854] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T19:20:54.243243] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-19T19:20:54.369129] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T19:20:55.032605] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T19:20:55.043217] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-19T19:20:55.843316] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-19T19:20:56.021232] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T19:20:56.643254] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-19T19:20:56.763912] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T19:20:57.443303] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-19T19:20:57.581711] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:20:58.243284] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-19T19:20:58.624061] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:20:59.043326] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-19T19:20:59.231927] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:20:59.843287] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-19T19:20:59.995551] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:21:00.304118] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T19:21:00.643319] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-19T19:21:01.443276] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-19T19:21:01.668224] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T19:21:02.243311] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-19T19:21:02.302877] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T19:21:03.043274] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-19T19:21:03.843283] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-19T19:21:04.612873] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-19T19:21:04.643246] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-19T19:21:04.969715] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (3.53 seconds). [2025-09-19T19:21:05.443331] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-19T19:21:05.649816] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-19T19:21:06.033891] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T19:21:06.215319] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T19:21:06.243235] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-19T19:21:07.043229] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-19T19:21:07.186565] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:21:07.193534] [INFO ] [REMOTE ] HTGC: Full fetch complete (68100 records). [2025-09-19T19:21:07.193689] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-19T19:21:07.604731] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-19T19:21:07.604840] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-19T19:21:07.605868] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-19T19:21:07.605946] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-19T19:21:07.607563] [DEBUG] [LOCAL ] HTGC: Trimmed 68100 records to 48422 (keeping 200 days of data) [2025-09-19T19:21:07.843446] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-19T19:21:07.928971] [DEBUG] [LOCAL ] HTGC: Primary data saved (48422 records). [2025-09-19T19:21:07.929123] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-19T19:21:07.929243] [INFO ] [MAIN ] Update Progress: 1063/2372 symbols completed. HTGC took 38.0s. Estimated remaining: 2h 53m 42s. Rate: 7.5 symbols/min [2025-09-19T19:21:08.116238] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:08.144766] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:21:08.202070] [DEBUG] [LOCAL ] HUM: Loaded 49197 existing records from primary storage. [2025-09-19T19:21:08.202260] [INFO ] [MAIN ] HUM: Loaded 49197 existing records. [2025-09-19T19:21:08.383987] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:08.384480] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-19T19:21:08.384586] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-19T19:21:08.392784] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-19T19:21:08.405764] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-19T19:21:08.412624] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T19:21:08.652121] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-19T19:21:08.786370] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:09.028504] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T19:21:09.443265] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-19T19:21:10.243272] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-19T19:21:10.385515] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T19:21:10.390547] [INFO ] [REMOTE ] HTH: Full fetch complete (46463 records). [2025-09-19T19:21:10.390668] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-19T19:21:10.784925] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-19T19:21:10.785009] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-19T19:21:10.785765] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-19T19:21:10.785829] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-19T19:21:10.787431] [DEBUG] [LOCAL ] HTH: Trimmed 46463 records to 33269 (keeping 200 days of data) [2025-09-19T19:21:10.995111] [DEBUG] [LOCAL ] HTH: Primary data saved (33269 records). [2025-09-19T19:21:10.995260] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-19T19:21:10.995619] [INFO ] [MAIN ] Update Progress: 1064/2372 symbols completed. HTH took 32.3s. Estimated remaining: 2h 53m 28s. Rate: 7.5 symbols/min [2025-09-19T19:21:11.060478] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-19T19:21:11.170609] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:11.229594] [DEBUG] [LOCAL ] HUN: Loaded 53591 existing records from primary storage. [2025-09-19T19:21:11.229774] [INFO ] [MAIN ] HUN: Loaded 53591 existing records. [2025-09-19T19:21:11.418206] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:11.418755] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-19T19:21:11.418858] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-19T19:21:11.420132] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-19T19:21:11.420195] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-19T19:21:11.787888] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:11.840221] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-19T19:21:11.839326] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T19:21:11.856562] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-19T19:21:12.643265] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-19T19:21:12.903350] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T19:21:13.443319] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-19T19:21:14.016690] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T19:21:14.243278] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-19T19:21:15.043302] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-19T19:21:15.325870] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-19T19:21:15.843291] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-19T19:21:16.106291] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T19:21:16.643272] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-19T19:21:17.708141] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-09-19T19:21:17.722289] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-19T19:21:17.846797] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T19:21:18.039333] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (3.00 seconds). [2025-09-19T19:21:18.243261] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-19T19:21:19.043269] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-19T19:21:19.082767] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-19T19:21:19.088930] [INFO ] [REMOTE ] HUBS: Full fetch complete (55454 records). [2025-09-19T19:21:19.089078] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-19T19:21:19.499793] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-19T19:21:19.499993] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-19T19:21:19.501045] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-19T19:21:19.501136] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-19T19:21:19.502761] [DEBUG] [LOCAL ] HUBS: Trimmed 55454 records to 40384 (keeping 200 days of data) [2025-09-19T19:21:19.629399] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T19:21:19.802720] [DEBUG] [LOCAL ] HUBS: Primary data saved (40384 records). [2025-09-19T19:21:19.802889] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-19T19:21:19.803049] [INFO ] [MAIN ] Update Progress: 1065/2372 symbols completed. HUBS took 32.1s. Estimated remaining: 2h 53m 21s. Rate: 7.5 symbols/min [2025-09-19T19:21:19.867351] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-19T19:21:19.984272] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:20.002345] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T19:21:20.008735] [INFO ] [REMOTE ] HUBB: Full fetch complete (53386 records). [2025-09-19T19:21:20.008915] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-19T19:21:20.348884] [DEBUG] [LOCAL ] HUYA: Loaded 44714 existing records from primary storage. [2025-09-19T19:21:20.360107] [INFO ] [MAIN ] HUYA: Loaded 44714 existing records. [2025-09-19T19:21:20.608962] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-19T19:21:20.622964] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-19T19:21:20.635218] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-19T19:21:20.649313] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-19T19:21:20.649064] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:20.650551] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-19T19:21:20.650766] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-19T19:21:20.651704] [DEBUG] [LOCAL ] HUBB: Trimmed 53386 records to 38022 (keeping 200 days of data) [2025-09-19T19:21:20.652188] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-19T19:21:20.652358] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-19T19:21:21.100083] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-19T19:21:21.170190] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-19T19:21:21.213390] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:21.336901] [DEBUG] [LOCAL ] HUBB: Primary data saved (38022 records). [2025-09-19T19:21:21.337160] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-19T19:21:21.337379] [INFO ] [MAIN ] Update Progress: 1066/2372 symbols completed. HUBB took 38.4s. Estimated remaining: 2h 53m 6s. Rate: 7.5 symbols/min [2025-09-19T19:21:21.445295] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-19T19:21:21.513668] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:21.551077] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T19:21:21.575259] [DEBUG] [LOCAL ] HVT: Loaded 16375 existing records from primary storage. [2025-09-19T19:21:21.575388] [INFO ] [MAIN ] HVT: Loaded 16375 existing records. [2025-09-19T19:21:21.751433] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:21.751741] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-19T19:21:21.751799] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-19T19:21:21.752266] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-19T19:21:21.752327] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-19T19:21:22.120132] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:22.243279] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-19T19:21:23.043322] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-19T19:21:23.156666] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:21:23.677157] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T19:21:23.843287] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-19T19:21:24.214569] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:21:24.319176] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T19:21:24.643279] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-19T19:21:25.146197] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:21:25.443264] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-19T19:21:26.243253] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-19T19:21:26.820877] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T19:21:27.043265] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-19T19:21:27.843266] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-19T19:21:27.911567] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:21:28.426992] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-19T19:21:28.643233] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-19T19:21:29.449711] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-19T19:21:29.470871] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-19T19:21:29.575829] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T19:21:30.243278] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-19T19:21:30.419589] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:21:30.688034] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T19:21:31.043271] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-19T19:21:31.843271] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-19T19:21:32.207564] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T19:21:32.650963] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-19T19:21:32.684492] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:21:32.717234] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T19:21:33.443274] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-19T19:21:34.084763] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:21:34.243268] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-19T19:21:35.043223] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-19T19:21:35.463607] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T19:21:35.668041] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T19:21:35.843246] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-19T19:21:36.643310] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-19T19:21:36.881005] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T19:21:37.443235] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-19T19:21:37.593149] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:21:38.243282] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-19T19:21:38.686816] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:21:38.878151] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T19:21:39.043336] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-19T19:21:39.843280] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-19T19:21:40.498537] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T19:21:40.531673] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-19T19:21:40.643228] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-19T19:21:41.443263] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-19T19:21:42.061365] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T19:21:42.069206] [INFO ] [REMOTE ] HUM: Full fetch complete (70952 records). [2025-09-19T19:21:42.069413] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-19T19:21:42.253736] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-19T19:21:42.477383] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-19T19:21:42.477485] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-19T19:21:42.478436] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-19T19:21:42.478502] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-19T19:21:42.480005] [DEBUG] [LOCAL ] HUM: Trimmed 70952 records to 49586 (keeping 200 days of data) [2025-09-19T19:21:42.596559] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T19:21:42.749492] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T19:21:42.858671] [DEBUG] [LOCAL ] HUM: Primary data saved (49586 records). [2025-09-19T19:21:42.858833] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-19T19:21:42.858925] [INFO ] [MAIN ] Update Progress: 1067/2372 symbols completed. HUM took 34.9s. Estimated remaining: 2h 53m 14s. Rate: 7.5 symbols/min [2025-09-19T19:21:43.037028] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:43.043275] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-19T19:21:43.095603] [DEBUG] [LOCAL ] HWM: Loaded 53421 existing records from primary storage. [2025-09-19T19:21:43.095800] [INFO ] [MAIN ] HWM: Loaded 53421 existing records. [2025-09-19T19:21:43.297168] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:43.297465] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-19T19:21:43.297525] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-19T19:21:43.299609] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-19T19:21:43.299708] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-19T19:21:43.656193] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:43.843244] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-19T19:21:43.903398] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T19:21:43.911197] [INFO ] [REMOTE ] HUN: Full fetch complete (76536 records). [2025-09-19T19:21:43.911332] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-19T19:21:44.300256] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-19T19:21:44.300371] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-19T19:21:44.301704] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-19T19:21:44.301849] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-19T19:21:44.304508] [DEBUG] [LOCAL ] HUN: Trimmed 76536 records to 53978 (keeping 200 days of data) [2025-09-19T19:21:44.636403] [DEBUG] [LOCAL ] HUN: Primary data saved (53978 records). [2025-09-19T19:21:44.636542] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-19T19:21:44.637893] [INFO ] [MAIN ] Update Progress: 1068/2372 symbols completed. HUN took 33.6s. Estimated remaining: 2h 52m 59s. Rate: 7.5 symbols/min [2025-09-19T19:21:44.669714] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-19T19:21:44.811835] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:44.838566] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T19:21:44.889093] [DEBUG] [LOCAL ] HXL: Loaded 46545 existing records from primary storage. [2025-09-19T19:21:44.889291] [INFO ] [MAIN ] HXL: Loaded 46545 existing records. [2025-09-19T19:21:45.077915] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T19:21:45.077406] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:45.081752] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-19T19:21:45.081912] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-19T19:21:45.083278] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-19T19:21:45.083339] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-19T19:21:45.434944] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:45.443213] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-19T19:21:46.243245] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-19T19:21:46.803409] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T19:21:47.043308] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-19T19:21:47.153212] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:21:47.345862] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T19:21:47.843271] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-19T19:21:48.643274] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-19T19:21:48.872625] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T19:21:48.879932] [INFO ] [REMOTE ] HUYA: Full fetch complete (63785 records). [2025-09-19T19:21:48.880123] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-19T19:21:49.275593] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-19T19:21:49.275735] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-19T19:21:49.276779] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-19T19:21:49.276867] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-19T19:21:49.278422] [DEBUG] [LOCAL ] HUYA: Trimmed 63785 records to 45033 (keeping 200 days of data) [2025-09-19T19:21:49.451730] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-19T19:21:49.545329] [DEBUG] [LOCAL ] HUYA: Primary data saved (45033 records). [2025-09-19T19:21:49.545671] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-19T19:21:49.545889] [INFO ] [MAIN ] Update Progress: 1069/2372 symbols completed. HUYA took 29.7s. Estimated remaining: 2h 52m 47s. Rate: 7.5 symbols/min [2025-09-19T19:21:49.730507] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:49.740002] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T19:21:49.744087] [INFO ] [REMOTE ] HVT: Full fetch complete (23835 records). [2025-09-19T19:21:49.744235] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-19T19:21:49.878356] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T19:21:49.900257] [DEBUG] [LOCAL ] HY: Loaded 10522 existing records from primary storage. [2025-09-19T19:21:49.914186] [INFO ] [MAIN ] HY: Loaded 10522 existing records. [2025-09-19T19:21:50.250592] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-19T19:21:50.317862] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:21:50.330691] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-19T19:21:50.341614] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-19T19:21:50.387947] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-19T19:21:50.388711] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-19T19:21:50.490691] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-19T19:21:50.501979] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-19T19:21:50.514320] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-19T19:21:50.522743] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-19T19:21:50.570561] [DEBUG] [LOCAL ] HVT: Trimmed 23835 records to 16524 (keeping 200 days of data) [2025-09-19T19:21:50.875117] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:50.897256] [DEBUG] [LOCAL ] HVT: Primary data saved (16524 records). [2025-09-19T19:21:50.897370] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-19T19:21:50.897448] [INFO ] [MAIN ] Update Progress: 1070/2372 symbols completed. HVT took 29.6s. Estimated remaining: 2h 52m 31s. Rate: 7.5 symbols/min [2025-09-19T19:21:51.044169] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-19T19:21:51.068572] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:21:51.068778] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-19T19:21:51.068831] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-19T19:21:51.069017] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-19T19:21:51.069089] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-19T19:21:51.069136] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-19T19:21:51.069169] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-19T19:21:51.443851] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:21:51.635788] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T19:21:51.699333] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T19:21:51.843233] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-19T19:21:51.990560] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:21:52.347543] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T19:21:52.643296] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-19T19:21:53.443281] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-19T19:21:54.243252] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-19T19:21:54.357522] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T19:21:54.631227] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-19T19:21:54.784245] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T19:21:55.043280] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-19T19:21:55.843253] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-19T19:21:56.050844] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T19:21:56.643281] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-19T19:21:57.443307] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-19T19:21:57.821306] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T19:21:58.114251] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-19T19:21:58.243321] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-19T19:21:58.613057] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:21:59.043299] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-19T19:21:59.843300] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-19T19:22:00.130520] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-19T19:22:00.458556] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T19:22:00.643303] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-19T19:22:01.023477] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T19:22:01.443275] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-19T19:22:01.748550] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T19:22:01.923024] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-19T19:22:02.243269] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-19T19:22:03.043361] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-19T19:22:03.462878] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T19:22:03.843269] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-19T19:22:04.643270] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-19T19:22:04.688131] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T19:22:04.725785] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-19T19:22:05.443307] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-19T19:22:05.816817] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-19T19:22:06.243279] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-19T19:22:06.385762] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T19:22:06.755175] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-19T19:22:07.043255] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-19T19:22:07.299214] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-19T19:22:07.843296] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-19T19:22:08.186874] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-19T19:22:08.187819] [INFO ] [REMOTE ] HYAC: Full fetch complete (873 records). [2025-09-19T19:22:08.187992] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-19T19:22:08.188730] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T19:22:08.188840] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:22:08.188932] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:22:08.189051] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-19T19:22:08.189193] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-19T19:22:08.189308] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-19T19:22:08.189407] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-19T19:22:08.189583] [INFO ] [MAIN ] Update Progress: 1071/2372 symbols completed. HYAC took 17.3s. Estimated remaining: 2h 52m 34s. Rate: 7.5 symbols/min [2025-09-19T19:22:08.390956] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:08.391204] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-19T19:22:08.391272] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-19T19:22:08.391496] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-19T19:22:08.391575] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-19T19:22:08.391686] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-19T19:22:08.391740] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-19T19:22:08.648513] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-19T19:22:08.765087] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:09.443281] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-19T19:22:10.052995] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-19T19:22:10.243298] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-19T19:22:10.681765] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:22:11.043281] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-19T19:22:11.273507] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T19:22:11.453859] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-19T19:22:11.843263] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-19T19:22:12.643285] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-19T19:22:12.762063] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T19:22:13.443256] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-19T19:22:14.243276] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-19T19:22:14.369879] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T19:22:14.658352] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T19:22:15.043276] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-19T19:22:15.843351] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-19T19:22:16.025795] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T19:22:16.102738] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-19T19:22:16.338511] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T19:22:16.643307] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-19T19:22:17.443257] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-19T19:22:17.813595] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-19T19:22:18.007545] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T19:22:18.010980] [INFO ] [REMOTE ] HY: Full fetch complete (15194 records). [2025-09-19T19:22:18.011089] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-19T19:22:18.248364] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-19T19:22:18.388386] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-19T19:22:18.388478] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-19T19:22:18.388862] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-19T19:22:18.388938] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-19T19:22:18.389700] [DEBUG] [LOCAL ] HY: Trimmed 15194 records to 10589 (keeping 200 days of data) [2025-09-19T19:22:18.466830] [DEBUG] [LOCAL ] HY: Primary data saved (10589 records). [2025-09-19T19:22:18.467001] [INFO ] [MAIN ] HY: Full history saved. [2025-09-19T19:22:18.467170] [INFO ] [MAIN ] Update Progress: 1072/2372 symbols completed. HY took 28.9s. Estimated remaining: 2h 52m 29s. Rate: 7.5 symbols/min [2025-09-19T19:22:18.648899] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:18.665279] [DEBUG] [LOCAL ] HYI: Loaded 8946 existing records from primary storage. [2025-09-19T19:22:18.665424] [INFO ] [MAIN ] HYI: Loaded 8946 existing records. [2025-09-19T19:22:18.756569] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-19T19:22:18.880236] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:18.880517] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-19T19:22:18.880567] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-19T19:22:18.880981] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-19T19:22:18.881242] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-19T19:22:19.051133] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-19T19:22:19.288056] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:19.843265] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-19T19:22:20.643277] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-19T19:22:21.015215] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T19:22:21.431447] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T19:22:21.448572] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-19T19:22:21.832099] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T19:22:22.243272] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-19T19:22:22.407190] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T19:22:22.620164] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-19T19:22:23.043265] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-19T19:22:23.843268] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-19T19:22:23.951541] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T19:22:24.643266] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-19T19:22:25.443267] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-19T19:22:25.814037] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-19T19:22:25.976278] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T19:22:26.243279] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-19T19:22:26.623405] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T19:22:26.630178] [INFO ] [REMOTE ] HXL: Full fetch complete (66098 records). [2025-09-19T19:22:26.630347] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-19T19:22:26.721351] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T19:22:27.043890] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-19T19:22:27.087781] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-19T19:22:27.087925] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-19T19:22:27.089250] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-19T19:22:27.089321] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-19T19:22:27.091136] [DEBUG] [LOCAL ] HXL: Trimmed 66098 records to 46858 (keeping 200 days of data) [2025-09-19T19:22:27.409111] [DEBUG] [LOCAL ] HXL: Primary data saved (46858 records). [2025-09-19T19:22:27.409285] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-19T19:22:27.409428] [INFO ] [MAIN ] Update Progress: 1073/2372 symbols completed. HXL took 42.8s. Estimated remaining: 2h 52m 23s. Rate: 7.5 symbols/min [2025-09-19T19:22:27.604152] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:27.642164] [DEBUG] [LOCAL ] HYT: Loaded 33425 existing records from primary storage. [2025-09-19T19:22:27.642312] [INFO ] [MAIN ] HYT: Loaded 33425 existing records. [2025-09-19T19:22:27.834943] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:27.835295] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-19T19:22:27.835352] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-19T19:22:27.836241] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-19T19:22:27.836304] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-19T19:22:27.849349] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-19T19:22:28.112048] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T19:22:28.235957] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:28.643270] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-19T19:22:29.443278] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-19T19:22:29.521613] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T19:22:29.760212] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:22:29.768264] [INFO ] [REMOTE ] HWM: Full fetch complete (76658 records). [2025-09-19T19:22:29.768497] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-19T19:22:29.877903] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-19T19:22:29.890076] [INFO ] [REMOTE ] HYBX: Full fetch complete (820 records). [2025-09-19T19:22:29.905695] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-19T19:22:29.926176] [FATAL] [VALIDATOR ] HYBX: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T19:22:29.964906] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:22:30.029175] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:22:30.084825] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-19T19:22:30.113224] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-19T19:22:30.138674] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-19T19:22:30.157693] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-19T19:22:30.176883] [INFO ] [MAIN ] Update Progress: 1074/2372 symbols completed. HYBX took 22.0s. Estimated remaining: 2h 52m 8s. Rate: 7.5 symbols/min [2025-09-19T19:22:30.199713] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-19T19:22:30.248349] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-19T19:22:30.262517] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-19T19:22:30.248465] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-19T19:22:30.283687] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-19T19:22:30.387068] [DEBUG] [LOCAL ] HWM: Trimmed 76658 records to 53803 (keeping 200 days of data) [2025-09-19T19:22:30.391007] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:30.403658] [DEBUG] [LOCAL ] HYTR: Loaded 3236 existing records from primary storage. [2025-09-19T19:22:30.403796] [INFO ] [MAIN ] HYTR: Loaded 3236 existing records. [2025-09-19T19:22:30.686507] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:30.688241] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-19T19:22:30.688576] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-19T19:22:30.690107] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-19T19:22:30.690424] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-19T19:22:31.043767] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-19T19:22:31.085534] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:31.327535] [DEBUG] [LOCAL ] HWM: Primary data saved (53803 records). [2025-09-19T19:22:31.327732] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-19T19:22:31.327861] [INFO ] [MAIN ] Update Progress: 1075/2372 symbols completed. HWM took 48.5s. Estimated remaining: 2h 51m 52s. Rate: 7.5 symbols/min [2025-09-19T19:22:31.510217] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:31.511789] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T19:22:31.546761] [DEBUG] [LOCAL ] HZO: Loaded 29607 existing records from primary storage. [2025-09-19T19:22:31.546908] [INFO ] [MAIN ] HZO: Loaded 29607 existing records. [2025-09-19T19:22:31.728328] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:31.728610] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-19T19:22:31.728695] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-19T19:22:31.729532] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-19T19:22:31.729603] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-19T19:22:31.850366] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-19T19:22:32.120327] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:32.596806] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T19:22:32.643246] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-19T19:22:32.649295] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T19:22:33.443272] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-19T19:22:34.210614] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T19:22:34.214988] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:22:34.243243] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-19T19:22:35.043422] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-19T19:22:35.678838] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:22:35.733608] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T19:22:35.843248] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-19T19:22:36.643274] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-19T19:22:37.302931] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T19:22:37.443268] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-19T19:22:37.474761] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:22:38.243268] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-19T19:22:38.299790] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-19T19:22:38.927768] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T19:22:39.043278] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-19T19:22:39.843274] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-19T19:22:40.643497] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-19T19:22:40.693287] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T19:22:41.175041] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:22:41.443279] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-19T19:22:41.531255] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:22:42.178842] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:22:42.243224] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-19T19:22:42.903899] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T19:22:43.043252] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-19T19:22:43.843264] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-19T19:22:44.578253] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T19:22:44.643301] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-19T19:22:44.756029] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T19:22:45.443266] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-19T19:22:45.858055] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:22:46.096659] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T19:22:46.243262] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-19T19:22:47.043271] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-19T19:22:47.634688] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T19:22:47.843252] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-19T19:22:48.651245] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-19T19:22:48.666691] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T19:22:48.678143] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T19:22:49.443307] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-19T19:22:49.935000] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T19:22:50.243293] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-19T19:22:50.365120] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T19:22:50.887164] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-19T19:22:50.888807] [INFO ] [REMOTE ] HYTR: Full fetch complete (4384 records). [2025-09-19T19:22:50.888944] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-19T19:22:51.054709] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-19T19:22:51.283921] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-19T19:22:51.284030] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-19T19:22:51.284223] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-19T19:22:51.284273] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-19T19:22:51.284746] [DEBUG] [LOCAL ] HYTR: Trimmed 4384 records to 3252 (keeping 200 days of data) [2025-09-19T19:22:51.307392] [DEBUG] [LOCAL ] HYTR: Primary data saved (3252 records). [2025-09-19T19:22:51.307504] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-19T19:22:51.307588] [INFO ] [MAIN ] Update Progress: 1076/2372 symbols completed. HYTR took 21.1s. Estimated remaining: 2h 51m 59s. Rate: 7.5 symbols/min [2025-09-19T19:22:51.480379] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:22:51.490094] [DEBUG] [LOCAL ] IAE: Loaded 5777 existing records from primary storage. [2025-09-19T19:22:51.490231] [INFO ] [MAIN ] IAE: Loaded 5777 existing records. [2025-09-19T19:22:51.667573] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:22:51.667858] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-19T19:22:51.667908] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-19T19:22:51.668201] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-19T19:22:51.668269] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-19T19:22:51.848870] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-19T19:22:52.029144] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:22:52.643756] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-19T19:22:52.645413] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T19:22:52.837508] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T19:22:52.838869] [INFO ] [REMOTE ] HYI: Full fetch complete (12876 records). [2025-09-19T19:22:52.838953] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-19T19:22:53.203543] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-19T19:22:53.203637] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-19T19:22:53.204052] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-19T19:22:53.204154] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-19T19:22:53.204729] [DEBUG] [LOCAL ] HYI: Trimmed 12876 records to 8995 (keeping 200 days of data) [2025-09-19T19:22:53.267469] [DEBUG] [LOCAL ] HYI: Primary data saved (8995 records). [2025-09-19T19:22:53.267694] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-19T19:22:53.267811] [INFO ] [MAIN ] Update Progress: 1077/2372 symbols completed. HYI took 34.8s. Estimated remaining: 2h 51m 44s. Rate: 7.5 symbols/min [2025-09-19T19:22:53.392393] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-19T19:22:53.443294] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-19T19:22:54.164664] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T19:22:54.243316] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-19T19:22:55.017489] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T19:22:55.043237] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-19T19:22:55.843251] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-19T19:22:56.115770] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T19:22:56.643284] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-19T19:22:57.443350] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-19T19:22:57.629302] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T19:22:58.243277] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-19T19:22:58.284619] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T19:22:58.324688] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:22:59.043282] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-19T19:22:59.805457] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T19:22:59.847176] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-19T19:22:59.849436] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T19:22:59.854746] [INFO ] [REMOTE ] HYT: Full fetch complete (46869 records). [2025-09-19T19:22:59.854843] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-19T19:23:00.261964] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-19T19:23:00.262052] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-19T19:23:00.262922] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-19T19:23:00.263001] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-19T19:23:00.264145] [DEBUG] [LOCAL ] HYT: Trimmed 46869 records to 33598 (keeping 200 days of data) [2025-09-19T19:23:00.466065] [DEBUG] [LOCAL ] HYT: Primary data saved (33598 records). [2025-09-19T19:23:00.466212] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-19T19:23:00.466298] [INFO ] [MAIN ] Update Progress: 1078/2372 symbols completed. HYT took 33.1s. Estimated remaining: 2h 51m 35s. Rate: 7.5 symbols/min [2025-09-19T19:23:00.643257] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-19T19:23:00.957312] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T19:23:01.443272] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-19T19:23:02.086849] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:23:02.243298] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-19T19:23:02.313067] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T19:23:03.043294] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-19T19:23:04.531363] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:23:04.533411] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-19T19:23:05.551606] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (3.31 seconds). [2025-09-19T19:23:05.557847] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-19T19:23:05.857962] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T19:23:05.860073] [INFO ] [REMOTE ] IAE: Full fetch complete (8401 records). [2025-09-19T19:23:05.860164] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-19T19:23:06.226057] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-19T19:23:06.226160] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-19T19:23:06.226411] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-19T19:23:06.226524] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-19T19:23:06.227099] [DEBUG] [LOCAL ] IAE: Trimmed 8401 records to 5839 (keeping 200 days of data) [2025-09-19T19:23:06.268919] [DEBUG] [LOCAL ] IAE: Primary data saved (5839 records). [2025-09-19T19:23:06.269096] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-19T19:23:06.269208] [INFO ] [MAIN ] Update Progress: 1079/2372 symbols completed. IAE took 15.0s. Estimated remaining: 2h 51m 24s. Rate: 7.5 symbols/min [2025-09-19T19:23:07.130563] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T19:23:07.137416] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-19T19:23:08.580075] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T19:23:08.589484] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-19T19:23:09.961737] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T19:23:09.966783] [INFO ] [REMOTE ] HZO: Full fetch complete (40438 records). [2025-09-19T19:23:09.966882] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-19T19:23:10.343935] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-19T19:23:10.344019] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-19T19:23:10.344731] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-19T19:23:10.344792] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-19T19:23:10.345717] [DEBUG] [LOCAL ] HZO: Trimmed 40438 records to 29856 (keeping 200 days of data) [2025-09-19T19:23:10.521953] [DEBUG] [LOCAL ] HZO: Primary data saved (29856 records). [2025-09-19T19:23:10.522179] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-19T19:23:10.522318] [INFO ] [MAIN ] Update Progress: 1080/2372 symbols completed. HZO took 39.2s. Estimated remaining: 2h 51m 12s. Rate: 7.5 symbols/min [2025-09-19T19:23:11.166483] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:11.172120] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:11.259371] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:11.263325] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:11.319580] [DEBUG] [LOCAL ] IBP: Loaded 29731 existing records from primary storage. [2025-09-19T19:23:11.319770] [INFO ] [MAIN ] IBP: Loaded 29731 existing records. [2025-09-19T19:23:11.486215] [DEBUG] [LOCAL ] IBM: Loaded 53999 existing records from primary storage. [2025-09-19T19:23:11.506339] [INFO ] [MAIN ] IBM: Loaded 53999 existing records. [2025-09-19T19:23:11.646079] [DEBUG] [LOCAL ] IAG: Loaded 53823 existing records from primary storage. [2025-09-19T19:23:11.674524] [INFO ] [MAIN ] IAG: Loaded 53823 existing records. [2025-09-19T19:23:11.674424] [DEBUG] [LOCAL ] IBN: Loaded 53316 existing records from primary storage. [2025-09-19T19:23:11.729706] [INFO ] [MAIN ] IBN: Loaded 53316 existing records. [2025-09-19T19:23:11.691677] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:11.758557] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-19T19:23:11.895067] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-19T19:23:12.001572] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-19T19:23:12.058614] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:12.058833] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-19T19:23:12.110191] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:12.099077] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-19T19:23:12.118058] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-19T19:23:12.147664] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-19T19:23:12.147483] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-19T19:23:12.168662] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-19T19:23:12.184635] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-19T19:23:12.184557] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-19T19:23:12.230397] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-19T19:23:12.439451] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:12.509378] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-19T19:23:12.553598] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-19T19:23:12.655796] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-19T19:23:12.656032] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-19T19:23:13.321081] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:13.396444] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-19T19:23:13.481034] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:13.481442] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-19T19:23:13.686596] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:13.688891] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-19T19:23:13.708551] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:13.708905] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-19T19:23:15.187243] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:23:15.192807] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-19T19:23:15.875059] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T19:23:15.886212] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-19T19:23:15.938746] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T19:23:15.949902] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-19T19:23:16.352770] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.96 seconds). [2025-09-19T19:23:16.363909] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-19T19:23:16.480288] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T19:23:16.485619] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-19T19:23:17.421795] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T19:23:17.432629] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-19T19:23:17.521188] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:23:17.532024] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-19T19:23:18.105832] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:23:18.111774] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-19T19:23:18.803213] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-19T19:23:18.813764] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-19T19:23:18.873452] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:23:18.883590] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-19T19:23:19.450841] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:23:19.461257] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-19T19:23:19.973018] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T19:23:19.979770] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-19T19:23:20.927701] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T19:23:20.938997] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-19T19:23:20.980436] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T19:23:20.990582] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-19T19:23:21.476310] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T19:23:21.487840] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-19T19:23:21.507704] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T19:23:22.243270] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-19T19:23:22.780539] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:23:23.043267] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-19T19:23:23.307848] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-19T19:23:23.363165] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T19:23:23.765798] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T19:23:23.843255] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-19T19:23:24.485500] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:23:24.647745] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-19T19:23:24.650898] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T19:23:25.443259] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-19T19:23:26.243265] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-19T19:23:27.043266] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-19T19:23:27.189913] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-19T19:23:27.381082] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T19:23:27.843281] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-19T19:23:28.264599] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T19:23:28.533254] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T19:23:28.643218] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-19T19:23:29.443270] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-19T19:23:29.776182] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T19:23:30.243250] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-19T19:23:30.314981] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T19:23:30.999290] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:23:31.043260] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-19T19:23:31.843259] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-19T19:23:32.643236] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-19T19:23:32.736979] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-19T19:23:32.849477] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:23:33.443267] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-19T19:23:33.964138] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:23:33.989032] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T19:23:33.993815] [INFO ] [REMOTE ] IBP: Full fetch complete (41042 records). [2025-09-19T19:23:33.993933] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-19T19:23:34.248397] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-19T19:23:34.379926] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-19T19:23:34.380053] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-19T19:23:34.380959] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-19T19:23:34.381036] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-19T19:23:34.382484] [DEBUG] [LOCAL ] IBP: Trimmed 41042 records to 29938 (keeping 200 days of data) [2025-09-19T19:23:34.579721] [DEBUG] [LOCAL ] IBP: Primary data saved (29938 records). [2025-09-19T19:23:34.579876] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-19T19:23:34.579968] [INFO ] [MAIN ] Update Progress: 1081/2372 symbols completed. IBP took 24.1s. Estimated remaining: 2h 51m 23s. Rate: 7.5 symbols/min [2025-09-19T19:23:34.757942] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:34.803167] [DEBUG] [LOCAL ] IBTA: Loaded 38598 existing records from primary storage. [2025-09-19T19:23:34.803314] [INFO ] [MAIN ] IBTA: Loaded 38598 existing records. [2025-09-19T19:23:34.981854] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:34.982120] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-19T19:23:34.982197] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-19T19:23:34.983194] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-19T19:23:34.983265] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-19T19:23:35.048321] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-19T19:23:35.343178] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:35.590573] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T19:23:35.598931] [INFO ] [REMOTE ] IAG: Full fetch complete (77195 records). [2025-09-19T19:23:35.599095] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-19T19:23:35.855410] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-19T19:23:36.010438] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-19T19:23:36.010592] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-19T19:23:36.011772] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-19T19:23:36.011984] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-19T19:23:36.013883] [DEBUG] [LOCAL ] IAG: Trimmed 77195 records to 54213 (keeping 200 days of data) [2025-09-19T19:23:36.331780] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T19:23:36.392907] [DEBUG] [LOCAL ] IAG: Primary data saved (54213 records). [2025-09-19T19:23:36.393138] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-19T19:23:36.393270] [INFO ] [MAIN ] Update Progress: 1082/2372 symbols completed. IAG took 25.9s. Estimated remaining: 2h 51m 8s. Rate: 7.5 symbols/min [2025-09-19T19:23:36.574505] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:36.635792] [DEBUG] [LOCAL ] ICE: Loaded 53416 existing records from primary storage. [2025-09-19T19:23:36.635978] [INFO ] [MAIN ] ICE: Loaded 53416 existing records. [2025-09-19T19:23:36.648903] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-19T19:23:36.844515] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:36.845045] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-19T19:23:36.845125] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-19T19:23:36.846594] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-19T19:23:36.846740] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-19T19:23:36.991177] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T19:23:37.263669] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:37.434440] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T19:23:37.443216] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-19T19:23:38.243238] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-19T19:23:38.742572] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:23:38.986199] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T19:23:39.043313] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-19T19:23:39.843270] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-19T19:23:40.674227] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-19T19:23:40.690283] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-19T19:23:40.698865] [INFO ] [REMOTE ] IBN: Full fetch complete (76289 records). [2025-09-19T19:23:40.699003] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-19T19:23:41.111171] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-19T19:23:41.111253] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-19T19:23:41.112305] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-19T19:23:41.112379] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-19T19:23:41.115750] [DEBUG] [LOCAL ] IBN: Trimmed 76289 records to 53699 (keeping 200 days of data) [2025-09-19T19:23:41.464291] [DEBUG] [LOCAL ] IBN: Primary data saved (53699 records). [2025-09-19T19:23:41.464475] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-19T19:23:41.464582] [INFO ] [MAIN ] Update Progress: 1083/2372 symbols completed. IBN took 30.9s. Estimated remaining: 2h 50m 56s. Rate: 7.5 symbols/min [2025-09-19T19:23:41.645509] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:41.681019] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-19T19:23:41.693330] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-19T19:23:41.725100] [DEBUG] [LOCAL ] ICL: Loaded 39304 existing records from primary storage. [2025-09-19T19:23:41.725268] [INFO ] [MAIN ] ICL: Loaded 39304 existing records. [2025-09-19T19:23:41.941210] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:41.941842] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-19T19:23:41.942019] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-19T19:23:41.943208] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-19T19:23:41.943395] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-19T19:23:42.117812] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:23:42.243380] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-19T19:23:42.318012] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T19:23:42.415397] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:43.043271] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-19T19:23:43.843306] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-19T19:23:44.220988] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T19:23:44.262007] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T19:23:44.270201] [INFO ] [REMOTE ] IBM: Full fetch complete (77612 records). [2025-09-19T19:23:44.270360] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-19T19:23:44.663480] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-19T19:23:44.691222] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-19T19:23:44.691380] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-19T19:23:44.692769] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-19T19:23:44.693275] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-19T19:23:44.727941] [DEBUG] [LOCAL ] IBM: Trimmed 77612 records to 54389 (keeping 200 days of data) [2025-09-19T19:23:44.731285] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:23:45.112882] [DEBUG] [LOCAL ] IBM: Primary data saved (54389 records). [2025-09-19T19:23:45.113046] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-19T19:23:45.113511] [INFO ] [MAIN ] Update Progress: 1084/2372 symbols completed. IBM took 34.6s. Estimated remaining: 2h 50m 43s. Rate: 7.5 symbols/min [2025-09-19T19:23:45.292931] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:23:45.334058] [DEBUG] [LOCAL ] IDA: Loaded 32258 existing records from primary storage. [2025-09-19T19:23:45.334234] [INFO ] [MAIN ] IDA: Loaded 32258 existing records. [2025-09-19T19:23:45.448393] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-19T19:23:45.530022] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:23:45.530496] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-19T19:23:45.530726] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-19T19:23:45.539253] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-19T19:23:45.552386] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-19T19:23:45.607200] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T19:23:45.957486] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:23:46.243297] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-19T19:23:46.730746] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T19:23:47.043329] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-19T19:23:47.216569] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:23:47.279066] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:23:47.843273] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-19T19:23:48.643250] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-19T19:23:48.733016] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:23:49.431627] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:23:49.443213] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-19T19:23:50.229404] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:23:50.243219] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-19T19:23:50.826257] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T19:23:51.043262] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-19T19:23:51.843272] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-19T19:23:51.884834] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T19:23:52.643317] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-19T19:23:53.077885] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T19:23:53.228083] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T19:23:53.443282] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-19T19:23:53.955975] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:23:54.243321] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-19T19:23:55.048370] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-19T19:23:55.060133] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:23:55.698258] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T19:23:55.843262] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-19T19:23:56.643333] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-19T19:23:57.093968] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T19:23:57.443268] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-19T19:23:57.637878] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T19:23:57.687297] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T19:23:58.243328] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-19T19:23:58.931619] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T19:23:59.043223] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-19T19:23:59.380952] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T19:23:59.387441] [INFO ] [REMOTE ] IBTA: Full fetch complete (50445 records). [2025-09-19T19:23:59.387573] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-19T19:23:59.773244] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-19T19:23:59.773344] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-19T19:23:59.774178] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-19T19:23:59.774242] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-19T19:23:59.775399] [DEBUG] [LOCAL ] IBTA: Trimmed 50445 records to 38885 (keeping 200 days of data) [2025-09-19T19:23:59.858749] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-19T19:24:00.002363] [DEBUG] [LOCAL ] IBTA: Primary data saved (38885 records). [2025-09-19T19:24:00.002510] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-19T19:24:00.002596] [INFO ] [MAIN ] Update Progress: 1085/2372 symbols completed. IBTA took 25.4s. Estimated remaining: 2h 50m 44s. Rate: 7.5 symbols/min [2025-09-19T19:24:00.190848] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:00.200818] [DEBUG] [LOCAL ] IDE: Loaded 8414 existing records from primary storage. [2025-09-19T19:24:00.200968] [INFO ] [MAIN ] IDE: Loaded 8414 existing records. [2025-09-19T19:24:00.380730] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:00.381018] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-19T19:24:00.381067] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-19T19:24:00.381460] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-19T19:24:00.381520] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-19T19:24:00.648404] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-19T19:24:00.768910] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:00.808414] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:24:01.443350] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-19T19:24:01.604386] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:24:02.243323] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-19T19:24:03.043285] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-19T19:24:03.503508] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-19T19:24:03.843341] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-19T19:24:04.931442] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T19:24:04.934431] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-19T19:24:05.162249] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (3.72 seconds). [2025-09-19T19:24:05.198222] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T19:24:05.339683] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-09-19T19:24:05.443984] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-19T19:24:05.446048] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T19:24:06.243269] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-19T19:24:07.043265] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-19T19:24:07.394588] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T19:24:07.402521] [INFO ] [REMOTE ] ICE: Full fetch complete (76758 records). [2025-09-19T19:24:07.402705] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-19T19:24:07.800855] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-19T19:24:07.800942] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-19T19:24:07.801915] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-19T19:24:07.801993] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-19T19:24:07.803536] [DEBUG] [LOCAL ] ICE: Trimmed 76758 records to 53803 (keeping 200 days of data) [2025-09-19T19:24:07.860757] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-19T19:24:07.933455] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:24:08.190910] [DEBUG] [LOCAL ] ICE: Primary data saved (53803 records). [2025-09-19T19:24:08.191074] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-19T19:24:08.194183] [INFO ] [MAIN ] Update Progress: 1086/2372 symbols completed. ICE took 31.8s. Estimated remaining: 2h 50m 36s. Rate: 7.5 symbols/min [2025-09-19T19:24:08.374548] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:08.400343] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T19:24:08.424388] [DEBUG] [LOCAL ] IDT: Loaded 17622 existing records from primary storage. [2025-09-19T19:24:08.424563] [INFO ] [MAIN ] IDT: Loaded 17622 existing records. [2025-09-19T19:24:08.602827] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:08.603092] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-19T19:24:08.603151] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-19T19:24:08.603701] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-19T19:24:08.603774] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-19T19:24:08.648483] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-19T19:24:08.905760] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T19:24:08.978048] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:09.443267] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-19T19:24:10.243315] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-19T19:24:10.312910] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T19:24:10.933562] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:24:11.043265] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-19T19:24:11.396477] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:24:11.843258] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-19T19:24:12.415991] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T19:24:12.420160] [INFO ] [REMOTE ] IDA: Full fetch complete (44646 records). [2025-09-19T19:24:12.420267] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-19T19:24:12.653246] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-19T19:24:12.808543] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-19T19:24:12.808632] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-19T19:24:12.809484] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-19T19:24:12.809547] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-19T19:24:12.810613] [DEBUG] [LOCAL ] IDA: Trimmed 44646 records to 32459 (keeping 200 days of data) [2025-09-19T19:24:13.023073] [DEBUG] [LOCAL ] IDA: Primary data saved (32459 records). [2025-09-19T19:24:13.023220] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-19T19:24:13.024476] [INFO ] [MAIN ] Update Progress: 1087/2372 symbols completed. IDA took 27.9s. Estimated remaining: 2h 50m 24s. Rate: 7.5 symbols/min [2025-09-19T19:24:13.199248] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:13.255404] [DEBUG] [LOCAL ] IEX: Loaded 38692 existing records from primary storage. [2025-09-19T19:24:13.255546] [INFO ] [MAIN ] IEX: Loaded 38692 existing records. [2025-09-19T19:24:13.431174] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:13.431481] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-19T19:24:13.431593] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-19T19:24:13.432482] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-19T19:24:13.432556] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-19T19:24:13.463446] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-19T19:24:13.801029] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:14.243278] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-19T19:24:14.673472] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T19:24:14.699353] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-19T19:24:15.043279] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-19T19:24:15.204346] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T19:24:15.843301] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-19T19:24:16.149965] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T19:24:16.623967] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T19:24:16.643218] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-19T19:24:16.776900] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:24:17.443289] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-19T19:24:18.236793] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:24:18.242735] [INFO ] [REMOTE ] ICL: Full fetch complete (56414 records). [2025-09-19T19:24:18.242897] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-19T19:24:18.243272] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-19T19:24:18.536203] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T19:24:18.656707] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-19T19:24:18.656796] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-19T19:24:18.657586] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-19T19:24:18.657626] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-19T19:24:18.658836] [DEBUG] [LOCAL ] ICL: Trimmed 56414 records to 39503 (keeping 200 days of data) [2025-09-19T19:24:18.900984] [DEBUG] [LOCAL ] ICL: Primary data saved (39503 records). [2025-09-19T19:24:18.901241] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-19T19:24:18.901374] [INFO ] [MAIN ] Update Progress: 1088/2372 symbols completed. ICL took 37.4s. Estimated remaining: 2h 50m 14s. Rate: 7.5 symbols/min [2025-09-19T19:24:19.048989] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-19T19:24:19.091868] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:19.166458] [DEBUG] [LOCAL ] IFF: Loaded 51320 existing records from primary storage. [2025-09-19T19:24:19.166676] [INFO ] [MAIN ] IFF: Loaded 51320 existing records. [2025-09-19T19:24:19.354033] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T19:24:19.433393] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:19.433790] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-19T19:24:19.433860] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-19T19:24:19.434971] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-19T19:24:19.435078] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-19T19:24:19.848556] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-19T19:24:19.997848] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:20.643303] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-19T19:24:20.714428] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:24:20.837402] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T19:24:21.443288] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-19T19:24:21.788689] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T19:24:22.243273] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-19T19:24:22.277601] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T19:24:23.043273] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-19T19:24:23.096806] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T19:24:23.843253] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-19T19:24:24.643256] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-19T19:24:25.436069] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T19:24:25.445044] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-19T19:24:25.546199] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T19:24:25.749221] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T19:24:25.925830] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-19T19:24:26.243229] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-19T19:24:27.043274] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-19T19:24:27.201848] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T19:24:27.843254] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-19T19:24:28.643275] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-19T19:24:28.707482] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:24:28.709237] [INFO ] [REMOTE ] IDE: Full fetch complete (12691 records). [2025-09-19T19:24:28.709318] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-19T19:24:29.081070] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-19T19:24:29.081405] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-19T19:24:29.082026] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-19T19:24:29.082130] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-19T19:24:29.083142] [DEBUG] [LOCAL ] IDE: Trimmed 12691 records to 8501 (keeping 200 days of data) [2025-09-19T19:24:29.155809] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T19:24:29.175892] [DEBUG] [LOCAL ] IDE: Primary data saved (8501 records). [2025-09-19T19:24:29.176010] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-19T19:24:29.176138] [INFO ] [MAIN ] Update Progress: 1089/2372 symbols completed. IDE took 29.2s. Estimated remaining: 2h 50m 9s. Rate: 7.5 symbols/min [2025-09-19T19:24:29.344817] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:29.375880] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T19:24:29.386251] [DEBUG] [LOCAL ] IFN: Loaded 18440 existing records from primary storage. [2025-09-19T19:24:29.386592] [INFO ] [MAIN ] IFN: Loaded 18440 existing records. [2025-09-19T19:24:29.448418] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-19T19:24:29.564847] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:29.565082] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-19T19:24:29.565136] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-19T19:24:29.565720] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-19T19:24:29.565792] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-19T19:24:29.919262] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:30.243256] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-19T19:24:31.043283] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-19T19:24:31.392342] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T19:24:31.501796] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T19:24:31.843243] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-19T19:24:32.643270] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-19T19:24:32.791284] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:24:33.443338] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-19T19:24:33.886284] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:24:33.921924] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:24:34.243319] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-19T19:24:35.043230] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-19T19:24:35.178948] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T19:24:35.629211] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T19:24:35.843280] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-19T19:24:36.642001] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T19:24:36.646005] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-19T19:24:37.443238] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-19T19:24:37.615287] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:24:37.870248] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T19:24:37.875307] [INFO ] [REMOTE ] IDT: Full fetch complete (22379 records). [2025-09-19T19:24:37.875478] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-19T19:24:38.247688] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-19T19:24:38.257024] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-19T19:24:38.257221] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-19T19:24:38.258612] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-19T19:24:38.258777] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-19T19:24:38.266064] [DEBUG] [LOCAL ] IDT: Trimmed 22379 records to 17777 (keeping 200 days of data) [2025-09-19T19:24:38.274081] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T19:24:38.392480] [DEBUG] [LOCAL ] IDT: Primary data saved (17777 records). [2025-09-19T19:24:38.392635] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-19T19:24:38.392875] [INFO ] [MAIN ] Update Progress: 1090/2372 symbols completed. IDT took 30.2s. Estimated remaining: 2h 50m 2s. Rate: 7.5 symbols/min [2025-09-19T19:24:38.616888] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:38.640883] [DEBUG] [LOCAL ] IFS: Loaded 23167 existing records from primary storage. [2025-09-19T19:24:38.641026] [INFO ] [MAIN ] IFS: Loaded 23167 existing records. [2025-09-19T19:24:38.821182] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:38.821628] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-19T19:24:38.821719] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-19T19:24:38.822398] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-19T19:24:38.822460] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-19T19:24:39.048468] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-19T19:24:39.231904] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:39.843258] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-19T19:24:39.920936] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T19:24:40.438599] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T19:24:40.490323] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T19:24:40.643289] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-19T19:24:41.443296] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-19T19:24:41.764114] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T19:24:42.243266] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-19T19:24:43.043274] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-19T19:24:43.199393] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T19:24:43.419092] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T19:24:43.843267] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-19T19:24:44.643235] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-19T19:24:44.739583] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T19:24:45.143626] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T19:24:45.443264] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-19T19:24:46.243244] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-19T19:24:46.595804] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T19:24:46.852726] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T19:24:47.043243] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-19T19:24:47.484056] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T19:24:47.843261] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-19T19:24:48.643280] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-19T19:24:48.928860] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:24:49.205064] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T19:24:49.344615] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T19:24:49.443299] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-19T19:24:50.243267] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-19T19:24:51.043282] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-19T19:24:51.212309] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T19:24:51.387093] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T19:24:51.395282] [INFO ] [REMOTE ] IFF: Full fetch complete (72728 records). [2025-09-19T19:24:51.395426] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-19T19:24:51.826865] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-19T19:24:51.827305] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-19T19:24:51.828252] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-19T19:24:51.828318] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-19T19:24:51.829839] [DEBUG] [LOCAL ] IFF: Trimmed 72728 records to 51702 (keeping 200 days of data) [2025-09-19T19:24:51.894597] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-19T19:24:52.172313] [DEBUG] [LOCAL ] IFF: Primary data saved (51702 records). [2025-09-19T19:24:52.172498] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-19T19:24:52.172629] [INFO ] [MAIN ] Update Progress: 1091/2372 symbols completed. IFF took 33.3s. Estimated remaining: 2h 50m 1s. Rate: 7.5 symbols/min [2025-09-19T19:24:52.357667] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:52.369409] [DEBUG] [LOCAL ] IGA: Loaded 9786 existing records from primary storage. [2025-09-19T19:24:52.369533] [INFO ] [MAIN ] IGA: Loaded 9786 existing records. [2025-09-19T19:24:52.573722] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:24:52.574030] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-19T19:24:52.574083] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-19T19:24:52.574528] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-19T19:24:52.574589] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-19T19:24:52.645843] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-19T19:24:53.012474] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:24:53.014909] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T19:24:53.252858] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T19:24:53.443278] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-19T19:24:53.908733] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T19:24:53.996450] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-19T19:24:54.243266] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-19T19:24:55.043283] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-19T19:24:55.152482] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T19:24:55.843296] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-19T19:24:55.989478] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T19:24:56.643231] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-19T19:24:57.295078] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:24:57.443256] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-19T19:24:58.243266] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-19T19:24:58.427942] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T19:24:58.441359] [INFO ] [REMOTE ] IEX: Full fetch complete (53225 records). [2025-09-19T19:24:58.442206] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T19:24:58.442292] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-19T19:24:58.488770] [INFO ] [REMOTE ] IFN: Full fetch complete (28964 records). [2025-09-19T19:24:58.525926] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-19T19:24:59.045733] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-19T19:24:59.236388] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T19:24:59.236667] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-19T19:24:59.236784] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-19T19:24:59.236903] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-19T19:24:59.236940] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-19T19:24:59.237328] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-19T19:24:59.238156] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-19T19:24:59.240860] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-19T19:24:59.241031] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-19T19:24:59.241973] [DEBUG] [LOCAL ] IFN: Trimmed 28964 records to 18547 (keeping 200 days of data) [2025-09-19T19:24:59.242557] [DEBUG] [LOCAL ] IEX: Trimmed 53225 records to 38987 (keeping 200 days of data) [2025-09-19T19:24:59.586282] [DEBUG] [LOCAL ] IFN: Primary data saved (18547 records). [2025-09-19T19:24:59.589178] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-19T19:24:59.590468] [INFO ] [MAIN ] Update Progress: 1092/2372 symbols completed. IFN took 30.4s. Estimated remaining: 2h 49m 52s. Rate: 7.5 symbols/min [2025-09-19T19:24:59.776762] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:24:59.782394] [DEBUG] [LOCAL ] IEX: Primary data saved (38987 records). [2025-09-19T19:24:59.782544] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-19T19:24:59.783022] [INFO ] [MAIN ] Update Progress: 1093/2372 symbols completed. IEX took 46.8s. Estimated remaining: 2h 49m 35s. Rate: 7.5 symbols/min [2025-09-19T19:24:59.850131] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-19T19:24:59.955720] [DEBUG] [LOCAL ] IGD: Loaded 19399 existing records from primary storage. [2025-09-19T19:24:59.980993] [INFO ] [MAIN ] IGD: Loaded 19399 existing records. [2025-09-19T19:24:59.980931] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:00.092424] [DEBUG] [LOCAL ] IGI: Loaded 3767 existing records from primary storage. [2025-09-19T19:25:00.095144] [INFO ] [MAIN ] IGI: Loaded 3767 existing records. [2025-09-19T19:25:00.321066] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:00.341191] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-19T19:25:00.349560] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-19T19:25:00.363011] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:00.363054] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-19T19:25:00.363226] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-19T19:25:00.363420] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-19T19:25:00.389133] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-19T19:25:00.437188] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-19T19:25:00.443680] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-19T19:25:00.722028] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T19:25:00.804774] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T19:25:00.810558] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-19T19:25:01.091594] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:01.144488] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:01.443268] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-19T19:25:02.138613] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T19:25:02.176092] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T19:25:02.243288] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-19T19:25:03.043283] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-19T19:25:03.370411] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T19:25:03.843255] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-19T19:25:04.251771] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:25:04.452622] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T19:25:04.643270] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-19T19:25:05.384135] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:25:05.443302] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-19T19:25:06.243272] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-19T19:25:06.341747] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T19:25:06.781638] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T19:25:07.043270] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-19T19:25:07.843267] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-19T19:25:08.126289] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T19:25:08.537937] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-19T19:25:08.643269] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-19T19:25:09.443278] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-19T19:25:10.061380] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T19:25:10.118302] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T19:25:10.243262] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-19T19:25:11.043283] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-19T19:25:11.492003] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T19:25:11.843365] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-19T19:25:11.982215] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T19:25:11.987749] [INFO ] [REMOTE ] IFS: Full fetch complete (31288 records). [2025-09-19T19:25:11.988069] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-19T19:25:12.598001] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-19T19:25:12.598173] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-19T19:25:12.600381] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-19T19:25:12.600572] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-19T19:25:12.603717] [DEBUG] [LOCAL ] IFS: Trimmed 31288 records to 23385 (keeping 200 days of data) [2025-09-19T19:25:12.691833] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-19T19:25:12.804515] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T19:25:12.839676] [DEBUG] [LOCAL ] IFS: Primary data saved (23385 records). [2025-09-19T19:25:12.839912] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-19T19:25:12.840069] [INFO ] [MAIN ] Update Progress: 1094/2372 symbols completed. IFS took 34.4s. Estimated remaining: 2h 49m 33s. Rate: 7.5 symbols/min [2025-09-19T19:25:13.048751] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:13.092998] [DEBUG] [LOCAL ] IGR: Loaded 30764 existing records from primary storage. [2025-09-19T19:25:13.093300] [INFO ] [MAIN ] IGR: Loaded 30764 existing records. [2025-09-19T19:25:13.289396] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T19:25:13.311605] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:13.311800] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-19T19:25:13.311861] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-19T19:25:13.312764] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-19T19:25:13.312824] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-19T19:25:13.449257] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-19T19:25:13.665784] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:14.243290] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-19T19:25:14.609318] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:25:14.611445] [INFO ] [REMOTE ] IGA: Full fetch complete (13525 records). [2025-09-19T19:25:14.611548] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-19T19:25:14.977150] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-19T19:25:14.977234] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-19T19:25:14.977567] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-19T19:25:14.977608] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-19T19:25:14.978322] [DEBUG] [LOCAL ] IGA: Trimmed 13525 records to 9829 (keeping 200 days of data) [2025-09-19T19:25:15.041415] [DEBUG] [LOCAL ] IGA: Primary data saved (9829 records). [2025-09-19T19:25:15.041560] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-19T19:25:15.041681] [INFO ] [MAIN ] Update Progress: 1095/2372 symbols completed. IGA took 22.9s. Estimated remaining: 2h 49m 19s. Rate: 7.5 symbols/min [2025-09-19T19:25:15.053261] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-19T19:25:15.218004] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:15.218250] [DEBUG] [LOCAL ] IH: No existing data file found in primary storage. [2025-09-19T19:25:15.218307] [WARN ] [MAIN ] IH: No existing data found, performing full refresh instead. [2025-09-19T19:25:15.218457] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-19T19:25:15.218499] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-19T19:25:15.218540] [DEBUG] [LOCAL ] IH: No primary data file found to delete. [2025-09-19T19:25:15.218572] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-19T19:25:15.607971] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:15.656023] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T19:25:15.843279] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-19T19:25:15.902919] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-19T19:25:16.643266] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-19T19:25:17.204970] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T19:25:17.443503] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-19T19:25:17.443387] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T19:25:18.145183] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T19:25:18.243240] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-19T19:25:19.019040] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T19:25:19.043220] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-19T19:25:19.795130] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T19:25:19.843233] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-19T19:25:20.475117] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T19:25:20.476328] [INFO ] [REMOTE ] IGI: Full fetch complete (5192 records). [2025-09-19T19:25:20.476418] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-19T19:25:20.655225] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-19T19:25:20.887107] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-19T19:25:20.887193] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-19T19:25:20.887360] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-19T19:25:20.887398] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-19T19:25:20.887821] [DEBUG] [LOCAL ] IGI: Trimmed 5192 records to 3784 (keeping 200 days of data) [2025-09-19T19:25:20.911054] [DEBUG] [LOCAL ] IGI: Primary data saved (3784 records). [2025-09-19T19:25:20.911185] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-19T19:25:20.911270] [INFO ] [MAIN ] Update Progress: 1096/2372 symbols completed. IGI took 21.1s. Estimated remaining: 2h 49m 8s. Rate: 7.5 symbols/min [2025-09-19T19:25:21.085955] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:21.095563] [DEBUG] [LOCAL ] IHD: Loaded 7264 existing records from primary storage. [2025-09-19T19:25:21.095714] [INFO ] [MAIN ] IHD: Loaded 7264 existing records. [2025-09-19T19:25:21.214982] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-19T19:25:21.278790] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:21.279076] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-19T19:25:21.279124] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-19T19:25:21.279547] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-19T19:25:21.279611] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-19T19:25:21.458512] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-19T19:25:21.674258] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:22.243266] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-19T19:25:22.271325] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T19:25:23.043273] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-19T19:25:23.683620] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:25:23.843276] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-19T19:25:23.985018] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T19:25:24.643339] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-19T19:25:25.315376] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T19:25:25.443243] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-19T19:25:26.071201] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:25:26.243253] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-19T19:25:26.985955] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T19:25:27.043265] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-19T19:25:27.456709] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:25:27.843245] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-19T19:25:28.050106] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T19:25:28.178109] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-19T19:25:28.643276] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-19T19:25:29.144766] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T19:25:29.443267] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-19T19:25:30.243286] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-19T19:25:30.898349] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T19:25:31.043263] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-19T19:25:31.179911] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T19:25:31.843250] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-19T19:25:31.973085] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T19:25:32.643260] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-19T19:25:32.791432] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T19:25:33.443261] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-19T19:25:34.243287] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-19T19:25:34.257725] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T19:25:34.285206] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:25:35.043268] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-19T19:25:35.168588] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T19:25:35.788704] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:25:35.843225] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-19T19:25:36.643255] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-19T19:25:37.053358] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:25:37.387274] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T19:25:37.443258] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-19T19:25:38.243264] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-19T19:25:38.393529] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:25:39.043277] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-19T19:25:39.471930] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T19:25:39.843259] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-19T19:25:39.874535] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T19:25:40.643310] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-19T19:25:41.000073] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T19:25:41.389545] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T19:25:41.443248] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-19T19:25:42.243245] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-19T19:25:42.606172] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:25:42.610037] [INFO ] [REMOTE ] IGD: Full fetch complete (29342 records). [2025-09-19T19:25:42.610139] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-19T19:25:42.720088] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T19:25:42.737138] [INFO ] [REMOTE ] IH: Full fetch complete (4914 records). [2025-09-19T19:25:42.760137] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-19T19:25:43.048364] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-19T19:25:43.313614] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-19T19:25:43.315967] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-19T19:25:43.322228] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-19T19:25:43.322307] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-19T19:25:43.368026] [DEBUG] [LOCAL ] IGD: Trimmed 29342 records to 19486 (keeping 200 days of data) [2025-09-19T19:25:43.442218] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-19T19:25:43.451572] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-19T19:25:43.451834] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-19T19:25:43.478286] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-19T19:25:43.481361] [DEBUG] [LOCAL ] IH: Trimmed 4914 records to 3638 (keeping 200 days of data) [2025-09-19T19:25:43.510885] [DEBUG] [LOCAL ] IH: Primary data saved (3638 records). [2025-09-19T19:25:43.511212] [INFO ] [MAIN ] IH: Full history saved. [2025-09-19T19:25:43.511605] [INFO ] [MAIN ] Update Progress: 1097/2372 symbols completed. IH took 28.5s. Estimated remaining: 2h 49m 17s. Rate: 7.5 symbols/min [2025-09-19T19:25:43.689558] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:43.711606] [DEBUG] [LOCAL ] IGD: Primary data saved (19486 records). [2025-09-19T19:25:43.719333] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-19T19:25:43.719482] [INFO ] [MAIN ] Update Progress: 1098/2372 symbols completed. IGD took 44.1s. Estimated remaining: 2h 49m 0s. Rate: 7.5 symbols/min [2025-09-19T19:25:43.719912] [DEBUG] [LOCAL ] IHG: Loaded 25038 existing records from primary storage. [2025-09-19T19:25:43.720024] [INFO ] [MAIN ] IHG: Loaded 25038 existing records. [2025-09-19T19:25:43.850969] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-19T19:25:44.076041] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:44.080057] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:44.080358] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-19T19:25:44.080479] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-19T19:25:44.081620] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-19T19:25:44.081773] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-19T19:25:44.353604] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T19:25:44.440381] [DEBUG] [LOCAL ] IHS: Loaded 39355 existing records from primary storage. [2025-09-19T19:25:44.446183] [INFO ] [MAIN ] IHS: Loaded 39355 existing records. [2025-09-19T19:25:44.633802] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:44.648453] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-19T19:25:44.718697] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:44.718940] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-19T19:25:44.718991] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-19T19:25:44.720153] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-19T19:25:44.720217] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-19T19:25:45.114155] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:45.429073] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T19:25:45.443210] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-19T19:25:45.681681] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T19:25:46.243290] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-19T19:25:46.890503] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T19:25:46.895548] [INFO ] [REMOTE ] IGR: Full fetch complete (45968 records). [2025-09-19T19:25:46.895676] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-19T19:25:47.050585] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-19T19:25:47.230138] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T19:25:47.236306] [INFO ] [REMOTE ] IHD: Full fetch complete (12014 records). [2025-09-19T19:25:47.241919] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-19T19:25:47.465469] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-19T19:25:47.470736] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-19T19:25:47.471700] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-19T19:25:47.476948] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-19T19:25:47.526833] [DEBUG] [LOCAL ] IGR: Trimmed 45968 records to 31042 (keeping 200 days of data) [2025-09-19T19:25:47.877056] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-19T19:25:47.888721] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-19T19:25:47.890056] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-19T19:25:47.890812] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-19T19:25:47.891429] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-19T19:25:47.898589] [DEBUG] [LOCAL ] IHD: Trimmed 12014 records to 7308 (keeping 200 days of data) [2025-09-19T19:25:47.962117] [DEBUG] [LOCAL ] IHD: Primary data saved (7308 records). [2025-09-19T19:25:47.965031] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-19T19:25:47.965997] [INFO ] [MAIN ] Update Progress: 1099/2372 symbols completed. IHD took 27.1s. Estimated remaining: 2h 48m 48s. Rate: 7.5 symbols/min [2025-09-19T19:25:48.205031] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:48.217824] [DEBUG] [LOCAL ] IIF: Loaded 5865 existing records from primary storage. [2025-09-19T19:25:48.221755] [INFO ] [MAIN ] IIF: Loaded 5865 existing records. [2025-09-19T19:25:48.352363] [DEBUG] [LOCAL ] IGR: Primary data saved (31042 records). [2025-09-19T19:25:48.357753] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-19T19:25:48.357941] [INFO ] [MAIN ] Update Progress: 1100/2372 symbols completed. IGR took 35.5s. Estimated remaining: 2h 48m 31s. Rate: 7.5 symbols/min [2025-09-19T19:25:48.481134] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:48.504602] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T19:25:48.521214] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-19T19:25:48.526433] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-19T19:25:48.548143] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-19T19:25:48.548290] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-19T19:25:48.645216] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-19T19:25:48.721785] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:25:48.939326] [DEBUG] [LOCAL ] IIIN: Loaded 17104 existing records from primary storage. [2025-09-19T19:25:48.966339] [INFO ] [MAIN ] IIIN: Loaded 17104 existing records. [2025-09-19T19:25:49.074735] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:49.240133] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:25:49.241614] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T19:25:49.241802] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-19T19:25:49.249524] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-19T19:25:49.250208] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-19T19:25:49.250268] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-19T19:25:49.452789] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-19T19:25:49.550078] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T19:25:49.638860] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:25:50.243277] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-19T19:25:50.925411] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T19:25:51.043322] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-19T19:25:51.200488] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T19:25:51.843260] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-19T19:25:52.644110] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-19T19:25:52.646202] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T19:25:53.167700] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T19:25:53.443257] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-19T19:25:53.544208] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T19:25:54.243275] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-19T19:25:55.043806] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T19:25:55.051931] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-19T19:25:55.129504] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T19:25:55.843280] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-19T19:25:56.505992] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T19:25:56.643223] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-19T19:25:57.443270] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-19T19:25:57.487766] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T19:25:58.231293] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:25:58.243214] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-19T19:25:58.288997] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T19:25:59.043309] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-19T19:25:59.784066] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:25:59.789280] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T19:25:59.843284] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-19T19:26:00.643272] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-19T19:26:01.077940] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T19:26:01.443308] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-19T19:26:01.533993] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:26:01.966592] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-19T19:26:02.243301] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-19T19:26:03.036666] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T19:26:03.043205] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-19T19:26:03.822812] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T19:26:03.843217] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-19T19:26:04.643270] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-19T19:26:04.695905] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-19T19:26:05.443354] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-19T19:26:06.243277] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-19T19:26:06.434262] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:26:06.514543] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T19:26:06.990755] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T19:26:07.043295] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-19T19:26:07.843284] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-19T19:26:08.581746] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T19:26:08.583263] [INFO ] [REMOTE ] IIF: Full fetch complete (9653 records). [2025-09-19T19:26:08.583351] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-19T19:26:08.648539] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-19T19:26:08.981145] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-19T19:26:08.981269] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-19T19:26:08.981941] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-19T19:26:08.982108] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-19T19:26:08.982801] [DEBUG] [LOCAL ] IIF: Trimmed 9653 records to 5891 (keeping 200 days of data) [2025-09-19T19:26:09.037163] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T19:26:09.059089] [DEBUG] [LOCAL ] IIF: Primary data saved (5891 records). [2025-09-19T19:26:09.059292] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-19T19:26:09.059438] [INFO ] [MAIN ] Update Progress: 1101/2372 symbols completed. IIF took 21.1s. Estimated remaining: 2h 48m 38s. Rate: 7.5 symbols/min [2025-09-19T19:26:09.248941] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:09.267008] [DEBUG] [LOCAL ] IIM: Loaded 16071 existing records from primary storage. [2025-09-19T19:26:09.267188] [INFO ] [MAIN ] IIM: Loaded 16071 existing records. [2025-09-19T19:26:09.452010] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-19T19:26:09.457781] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:09.458313] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-19T19:26:09.458401] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-19T19:26:09.460557] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-19T19:26:09.460633] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-19T19:26:09.862027] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:10.138891] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T19:26:10.243232] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-19T19:26:11.043301] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-19T19:26:11.203800] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:26:11.548824] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T19:26:11.843238] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-19T19:26:12.295244] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T19:26:12.643271] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-19T19:26:13.449908] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-19T19:26:13.454911] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T19:26:13.502521] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:26:13.506167] [INFO ] [REMOTE ] IHG: Full fetch complete (33478 records). [2025-09-19T19:26:13.506255] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-19T19:26:13.901621] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-19T19:26:13.901824] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-19T19:26:13.902548] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-19T19:26:13.902612] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-19T19:26:13.903565] [DEBUG] [LOCAL ] IHG: Trimmed 33478 records to 25214 (keeping 200 days of data) [2025-09-19T19:26:14.063398] [DEBUG] [LOCAL ] IHG: Primary data saved (25214 records). [2025-09-19T19:26:14.063532] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-19T19:26:14.063628] [INFO ] [MAIN ] Update Progress: 1102/2372 symbols completed. IHG took 30.6s. Estimated remaining: 2h 48m 27s. Rate: 7.5 symbols/min [2025-09-19T19:26:14.233438] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:14.243332] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-19T19:26:14.267281] [DEBUG] [LOCAL ] IIPR: Loaded 29843 existing records from primary storage. [2025-09-19T19:26:14.267427] [INFO ] [MAIN ] IIPR: Loaded 29843 existing records. [2025-09-19T19:26:14.445484] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:14.445944] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-19T19:26:14.445993] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-19T19:26:14.447071] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-19T19:26:14.447132] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-19T19:26:14.811956] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:14.851307] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T19:26:15.043280] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-19T19:26:15.433177] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T19:26:15.843275] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-19T19:26:16.643234] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-19T19:26:16.768995] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T19:26:17.092292] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T19:26:17.443261] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-19T19:26:17.821570] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T19:26:18.243278] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-19T19:26:18.960918] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T19:26:19.043274] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-19T19:26:19.568635] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:26:19.843237] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-19T19:26:20.252067] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T19:26:20.549898] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T19:26:20.643266] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-19T19:26:21.443293] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-19T19:26:21.790756] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T19:26:22.243290] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-19T19:26:22.893698] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T19:26:23.043278] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-19T19:26:23.515710] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T19:26:23.518071] [INFO ] [REMOTE ] IIIN: Full fetch complete (25264 records). [2025-09-19T19:26:23.518151] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-19T19:26:23.846790] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-19T19:26:23.890982] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-19T19:26:23.891072] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-19T19:26:23.891700] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-19T19:26:23.891778] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-19T19:26:23.896819] [DEBUG] [LOCAL ] IIIN: Trimmed 25264 records to 17183 (keeping 200 days of data) [2025-09-19T19:26:24.011336] [DEBUG] [LOCAL ] IIIN: Primary data saved (17183 records). [2025-09-19T19:26:24.011513] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-19T19:26:24.011715] [INFO ] [MAIN ] Update Progress: 1103/2372 symbols completed. IIIN took 35.6s. Estimated remaining: 2h 48m 21s. Rate: 7.5 symbols/min [2025-09-19T19:26:24.188221] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:24.203927] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T19:26:24.209272] [INFO ] [REMOTE ] IHS: Full fetch complete (52557 records). [2025-09-19T19:26:24.209381] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-19T19:26:24.531752] [DEBUG] [LOCAL ] IMAX: Loaded 43011 existing records from primary storage. [2025-09-19T19:26:24.537741] [INFO ] [MAIN ] IMAX: Loaded 43011 existing records. [2025-09-19T19:26:24.647046] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-19T19:26:24.722265] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-19T19:26:24.732881] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-19T19:26:24.744927] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-19T19:26:24.745050] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-19T19:26:24.810561] [DEBUG] [LOCAL ] IHS: Trimmed 52557 records to 39559 (keeping 200 days of data) [2025-09-19T19:26:24.836883] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:24.837171] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-19T19:26:24.837229] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-19T19:26:24.838554] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-19T19:26:24.838684] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-19T19:26:25.249312] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-19T19:26:25.346277] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:25.443233] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-19T19:26:25.479154] [DEBUG] [LOCAL ] IHS: Primary data saved (39559 records). [2025-09-19T19:26:25.479322] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-19T19:26:25.479460] [INFO ] [MAIN ] Update Progress: 1104/2372 symbols completed. IHS took 41.8s. Estimated remaining: 2h 48m 6s. Rate: 7.5 symbols/min [2025-09-19T19:26:25.654296] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:25.711118] [DEBUG] [LOCAL ] INFA: Loaded 50516 existing records from primary storage. [2025-09-19T19:26:25.711284] [INFO ] [MAIN ] INFA: Loaded 50516 existing records. [2025-09-19T19:26:25.888761] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:25.888995] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-19T19:26:25.889043] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-19T19:26:25.890435] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-19T19:26:25.890497] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-19T19:26:26.254920] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-19T19:26:26.260984] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:26.289583] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T19:26:26.954220] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T19:26:27.043225] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-19T19:26:27.418163] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T19:26:27.843251] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-19T19:26:28.406839] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-19T19:26:28.618238] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T19:26:28.643219] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-19T19:26:29.443301] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-19T19:26:30.247936] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-19T19:26:30.258622] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:26:31.043232] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-19T19:26:31.071335] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T19:26:31.154208] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T19:26:31.843273] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-19T19:26:32.560595] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T19:26:32.643269] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-19T19:26:32.972415] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:26:33.443277] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-19T19:26:34.243330] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-19T19:26:34.322542] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T19:26:34.921026] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T19:26:35.043285] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-19T19:26:35.383592] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T19:26:35.843282] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-19T19:26:36.643274] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-19T19:26:36.907983] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T19:26:37.014765] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T19:26:37.443263] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-19T19:26:37.822188] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T19:26:38.243308] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-19T19:26:38.710454] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:26:39.043267] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-19T19:26:39.441883] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T19:26:39.445355] [INFO ] [REMOTE ] IIM: Full fetch complete (25401 records). [2025-09-19T19:26:39.445503] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-19T19:26:39.830059] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-19T19:26:39.830148] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-19T19:26:39.830730] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-19T19:26:39.830818] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-19T19:26:39.831514] [DEBUG] [LOCAL ] IIM: Trimmed 25401 records to 16141 (keeping 200 days of data) [2025-09-19T19:26:39.882848] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-19T19:26:39.948367] [DEBUG] [LOCAL ] IIM: Primary data saved (16141 records). [2025-09-19T19:26:39.948579] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-19T19:26:39.948857] [INFO ] [MAIN ] Update Progress: 1105/2372 symbols completed. IIM took 30.9s. Estimated remaining: 2h 48m 5s. Rate: 7.5 symbols/min [2025-09-19T19:26:40.120336] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:40.193472] [DEBUG] [LOCAL ] INFY: Loaded 53988 existing records from primary storage. [2025-09-19T19:26:40.193733] [INFO ] [MAIN ] INFY: Loaded 53988 existing records. [2025-09-19T19:26:40.370138] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:40.370447] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-19T19:26:40.370514] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-19T19:26:40.372043] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-19T19:26:40.372127] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-19T19:26:40.654158] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-19T19:26:40.749870] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:40.869413] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T19:26:41.274941] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T19:26:41.443287] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-19T19:26:41.947714] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T19:26:42.243277] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-19T19:26:43.043264] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-19T19:26:43.313939] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:26:43.843288] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-19T19:26:44.351422] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T19:26:44.382973] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T19:26:44.643269] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-19T19:26:44.858685] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T19:26:45.443283] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-19T19:26:46.243278] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-19T19:26:46.647433] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T19:26:46.770075] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T19:26:47.043339] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-19T19:26:47.803462] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T19:26:47.808258] [INFO ] [REMOTE ] IIPR: Full fetch complete (44002 records). [2025-09-19T19:26:47.808362] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-19T19:26:47.851909] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-19T19:26:48.194546] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-19T19:26:48.194697] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-19T19:26:48.195406] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-19T19:26:48.195449] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-19T19:26:48.196474] [DEBUG] [LOCAL ] IIPR: Trimmed 44002 records to 30143 (keeping 200 days of data) [2025-09-19T19:26:48.414607] [DEBUG] [LOCAL ] IIPR: Primary data saved (30143 records). [2025-09-19T19:26:48.414794] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-19T19:26:48.414978] [INFO ] [MAIN ] Update Progress: 1106/2372 symbols completed. IIPR took 34.4s. Estimated remaining: 2h 47m 58s. Rate: 7.5 symbols/min [2025-09-19T19:26:48.594230] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:48.654801] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-19T19:26:48.658385] [DEBUG] [LOCAL ] ING: Loaded 51271 existing records from primary storage. [2025-09-19T19:26:48.658638] [INFO ] [MAIN ] ING: Loaded 51271 existing records. [2025-09-19T19:26:48.854217] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:48.854489] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-19T19:26:48.854538] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-19T19:26:48.856256] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-19T19:26:48.856318] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-19T19:26:49.283916] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:49.286598] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T19:26:49.443258] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-19T19:26:49.657245] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T19:26:50.243274] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-19T19:26:50.625994] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T19:26:50.802190] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T19:26:51.043279] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-19T19:26:51.372188] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T19:26:51.843261] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-19T19:26:52.643319] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-19T19:26:52.815318] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T19:26:53.443323] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-19T19:26:53.618924] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T19:26:53.625822] [INFO ] [REMOTE ] IMAX: Full fetch complete (59422 records). [2025-09-19T19:26:53.625967] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-19T19:26:54.029292] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-19T19:26:54.029394] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-19T19:26:54.030219] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-19T19:26:54.030283] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-19T19:26:54.031562] [DEBUG] [LOCAL ] IMAX: Trimmed 59422 records to 43331 (keeping 200 days of data) [2025-09-19T19:26:54.248873] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-19T19:26:54.342907] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T19:26:54.359151] [DEBUG] [LOCAL ] IMAX: Primary data saved (43331 records). [2025-09-19T19:26:54.359730] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-19T19:26:54.359874] [INFO ] [MAIN ] Update Progress: 1107/2372 symbols completed. IMAX took 30.3s. Estimated remaining: 2h 47m 48s. Rate: 7.5 symbols/min [2025-09-19T19:26:54.531342] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:54.567795] [DEBUG] [LOCAL ] INGM: Loaded 29495 existing records from primary storage. [2025-09-19T19:26:54.567942] [INFO ] [MAIN ] INGM: Loaded 29495 existing records. [2025-09-19T19:26:54.748272] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:54.748704] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-19T19:26:54.748784] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-19T19:26:54.749680] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-19T19:26:54.749741] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-19T19:26:55.046149] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-19T19:26:55.088328] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T19:26:55.220619] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:55.843254] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-19T19:26:56.055584] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:26:56.063267] [INFO ] [REMOTE ] INFA: Full fetch complete (71969 records). [2025-09-19T19:26:56.063436] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-19T19:26:56.484962] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-19T19:26:56.485297] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-19T19:26:56.486369] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-19T19:26:56.486435] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-19T19:26:56.488060] [DEBUG] [LOCAL ] INFA: Trimmed 71969 records to 50875 (keeping 200 days of data) [2025-09-19T19:26:56.665907] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-19T19:26:56.801346] [DEBUG] [LOCAL ] INFA: Primary data saved (50875 records). [2025-09-19T19:26:56.801506] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-19T19:26:56.801629] [INFO ] [MAIN ] Update Progress: 1108/2372 symbols completed. INFA took 31.3s. Estimated remaining: 2h 47m 33s. Rate: 7.5 symbols/min [2025-09-19T19:26:56.972760] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:26:57.015344] [DEBUG] [LOCAL ] INGR: Loaded 33638 existing records from primary storage. [2025-09-19T19:26:57.015511] [INFO ] [MAIN ] INGR: Loaded 33638 existing records. [2025-09-19T19:26:57.204347] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:26:57.204901] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-19T19:26:57.204970] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-19T19:26:57.206166] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-19T19:26:57.206226] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-19T19:26:57.415178] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T19:26:57.533330] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-19T19:26:57.617537] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:26:57.832141] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:26:58.243292] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-19T19:26:58.295621] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T19:26:59.043353] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-19T19:26:59.203542] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T19:26:59.439692] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T19:26:59.843320] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-19T19:27:00.643283] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-19T19:27:01.057199] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T19:27:01.443315] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-19T19:27:01.806420] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T19:27:02.243309] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-19T19:27:02.736421] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T19:27:03.043336] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-19T19:27:03.843384] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-19T19:27:04.621088] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (3.18 seconds). [2025-09-19T19:27:04.643269] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-19T19:27:04.847907] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:27:05.443282] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-19T19:27:05.767598] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (3.52 seconds). [2025-09-19T19:27:05.954596] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:27:05.987130] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:27:06.243264] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-19T19:27:07.043316] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-19T19:27:07.200167] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T19:27:07.843267] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-19T19:27:08.362909] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T19:27:08.604308] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T19:27:08.643264] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-19T19:27:09.443280] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-19T19:27:10.043369] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T19:27:10.215597] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T19:27:10.243234] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-19T19:27:11.043274] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-19T19:27:11.480207] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T19:27:11.843244] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-19T19:27:12.370970] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T19:27:12.379986] [INFO ] [REMOTE ] INFY: Full fetch complete (77535 records). [2025-09-19T19:27:12.380125] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-19T19:27:12.645722] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-19T19:27:12.818218] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:27:12.837753] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-19T19:27:12.837902] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-19T19:27:12.846101] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-19T19:27:12.846636] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-19T19:27:12.848892] [DEBUG] [LOCAL ] INFY: Trimmed 77535 records to 54378 (keeping 200 days of data) [2025-09-19T19:27:13.182171] [DEBUG] [LOCAL ] INFY: Primary data saved (54378 records). [2025-09-19T19:27:13.182341] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-19T19:27:13.183053] [INFO ] [MAIN ] Update Progress: 1109/2372 symbols completed. INFY took 33.2s. Estimated remaining: 2h 47m 35s. Rate: 7.5 symbols/min [2025-09-19T19:27:13.351626] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:13.393598] [DEBUG] [LOCAL ] INN: Loaded 42287 existing records from primary storage. [2025-09-19T19:27:13.393768] [INFO ] [MAIN ] INN: Loaded 42287 existing records. [2025-09-19T19:27:13.452707] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-19T19:27:13.581975] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:13.582287] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-19T19:27:13.582363] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-19T19:27:13.583450] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-19T19:27:13.583511] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-19T19:27:13.955748] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:14.243283] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-19T19:27:15.218851] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (3.38 seconds). [2025-09-19T19:27:15.229764] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-19T19:27:15.250470] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T19:27:15.368253] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T19:27:15.843248] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-19T19:27:16.070829] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T19:27:16.643229] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-19T19:27:16.969321] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:27:17.317452] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T19:27:17.443223] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-19T19:27:17.595772] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T19:27:18.243263] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-19T19:27:19.043263] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-19T19:27:19.333414] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:27:19.420692] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T19:27:19.843265] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-19T19:27:20.605536] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T19:27:20.643246] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-19T19:27:20.726550] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:27:20.730718] [INFO ] [REMOTE ] INGM: Full fetch complete (42097 records). [2025-09-19T19:27:20.730833] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-19T19:27:21.151621] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-19T19:27:21.151741] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-19T19:27:21.152446] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-19T19:27:21.152519] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-19T19:27:21.153609] [DEBUG] [LOCAL ] INGM: Trimmed 42097 records to 29659 (keeping 200 days of data) [2025-09-19T19:27:21.338552] [DEBUG] [LOCAL ] INGM: Primary data saved (29659 records). [2025-09-19T19:27:21.338730] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-19T19:27:21.338834] [INFO ] [MAIN ] Update Progress: 1110/2372 symbols completed. INGM took 27.0s. Estimated remaining: 2h 47m 27s. Rate: 7.5 symbols/min [2025-09-19T19:27:21.452685] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-19T19:27:21.537184] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:21.537367] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-19T19:27:21.537405] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-19T19:27:21.537550] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-19T19:27:21.537607] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-19T19:27:21.537703] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-19T19:27:21.537748] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-19T19:27:21.939323] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:21.941083] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:27:22.243354] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-19T19:27:23.043307] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-19T19:27:23.118398] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T19:27:23.843291] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-19T19:27:24.198802] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T19:27:24.207333] [INFO ] [REMOTE ] ING: Full fetch complete (73637 records). [2025-09-19T19:27:24.207543] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-19T19:27:24.619632] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-19T19:27:24.619943] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-19T19:27:24.622161] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-19T19:27:24.622386] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-19T19:27:24.625351] [DEBUG] [LOCAL ] ING: Trimmed 73637 records to 51617 (keeping 200 days of data) [2025-09-19T19:27:24.646409] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-19T19:27:24.650058] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T19:27:24.919923] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:27:24.921458] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-19T19:27:25.015041] [DEBUG] [LOCAL ] ING: Primary data saved (51617 records). [2025-09-19T19:27:25.015270] [INFO ] [MAIN ] ING: Full history saved. [2025-09-19T19:27:25.015384] [INFO ] [MAIN ] Update Progress: 1111/2372 symbols completed. ING took 36.6s. Estimated remaining: 2h 47m 14s. Rate: 7.5 symbols/min [2025-09-19T19:27:25.191386] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:25.232501] [DEBUG] [LOCAL ] INSP: Loaded 36882 existing records from primary storage. [2025-09-19T19:27:25.232741] [INFO ] [MAIN ] INSP: Loaded 36882 existing records. [2025-09-19T19:27:25.423864] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:25.424420] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-19T19:27:25.424504] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-19T19:27:25.445639] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-19T19:27:25.433332] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-19T19:27:25.446531] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-19T19:27:25.454499] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T19:27:25.860633] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:26.002006] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-19T19:27:26.243274] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-19T19:27:27.043269] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-19T19:27:27.843381] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-19T19:27:27.868405] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T19:27:27.974113] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:27:28.643280] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-19T19:27:29.443296] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-19T19:27:29.460551] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T19:27:29.470112] [INFO ] [REMOTE ] INGR: Full fetch complete (49654 records). [2025-09-19T19:27:29.470286] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-19T19:27:29.855403] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-19T19:27:29.855509] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-19T19:27:29.856486] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-19T19:27:29.856563] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-19T19:27:29.858036] [DEBUG] [LOCAL ] INGR: Trimmed 49654 records to 33927 (keeping 200 days of data) [2025-09-19T19:27:29.878463] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T19:27:30.099071] [DEBUG] [LOCAL ] INGR: Primary data saved (33927 records). [2025-09-19T19:27:30.099230] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-19T19:27:30.099320] [INFO ] [MAIN ] Update Progress: 1112/2372 symbols completed. INGR took 33.3s. Estimated remaining: 2h 47m 3s. Rate: 7.5 symbols/min [2025-09-19T19:27:30.254099] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-19T19:27:30.290672] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:30.338280] [DEBUG] [LOCAL ] INSW: Loaded 40985 existing records from primary storage. [2025-09-19T19:27:30.338424] [INFO ] [MAIN ] INSW: Loaded 40985 existing records. [2025-09-19T19:27:30.528402] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:30.528700] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-19T19:27:30.528805] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-19T19:27:30.530400] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-19T19:27:30.530462] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-19T19:27:30.896596] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:31.043272] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-19T19:27:31.151034] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T19:27:31.843295] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-19T19:27:31.880171] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T19:27:32.643308] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-19T19:27:32.847520] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T19:27:33.443365] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-19T19:27:33.632489] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:27:34.243300] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-19T19:27:34.320053] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T19:27:35.043281] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-19T19:27:35.227882] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:27:35.843310] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-19T19:27:36.643234] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-19T19:27:36.722933] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:27:37.443234] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-19T19:27:37.548260] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T19:27:37.652502] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T19:27:37.740321] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (3.50 seconds). [2025-09-19T19:27:38.243305] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-19T19:27:39.043265] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-19T19:27:39.334544] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T19:27:39.843249] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-19T19:27:40.024074] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T19:27:40.437454] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T19:27:40.643264] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-19T19:27:41.163306] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T19:27:41.443298] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-19T19:27:41.995189] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T19:27:42.243264] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-19T19:27:43.033398] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:27:43.043217] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-19T19:27:43.134262] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T19:27:43.843268] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-19T19:27:44.635835] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:27:44.643152] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-19T19:27:44.967577] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T19:27:45.443262] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-19T19:27:45.576461] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T19:27:46.243258] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-19T19:27:47.043274] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-19T19:27:47.083400] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T19:27:47.089086] [INFO ] [REMOTE ] INN: Full fetch complete (57866 records). [2025-09-19T19:27:47.089183] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-19T19:27:47.485582] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-19T19:27:47.485774] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-19T19:27:47.486593] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-19T19:27:47.486707] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-19T19:27:47.508117] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T19:27:47.516034] [DEBUG] [LOCAL ] INN: Trimmed 57866 records to 42564 (keeping 200 days of data) [2025-09-19T19:27:47.768194] [DEBUG] [LOCAL ] INN: Primary data saved (42564 records). [2025-09-19T19:27:47.768329] [INFO ] [MAIN ] INN: Full history saved. [2025-09-19T19:27:47.769015] [INFO ] [MAIN ] Update Progress: 1113/2372 symbols completed. INN took 34.6s. Estimated remaining: 2h 47m 6s. Rate: 7.5 symbols/min [2025-09-19T19:27:47.848351] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-19T19:27:47.942851] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:47.998570] [DEBUG] [LOCAL ] INVH: Loaded 53529 existing records from primary storage. [2025-09-19T19:27:47.998778] [INFO ] [MAIN ] INVH: Loaded 53529 existing records. [2025-09-19T19:27:48.194839] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:48.195147] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-19T19:27:48.195197] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-19T19:27:48.196261] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-19T19:27:48.196325] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-19T19:27:48.579728] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:48.597723] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T19:27:48.643223] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-19T19:27:49.298857] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T19:27:49.443321] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-19T19:27:50.243264] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-19T19:27:50.581523] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T19:27:50.912163] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T19:27:50.916444] [INFO ] [REMOTE ] INR: Full fetch complete (32460 records). [2025-09-19T19:27:50.916526] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-19T19:27:51.048507] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-19T19:27:51.115330] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 160 unique days, need 200 days [2025-09-19T19:27:51.115832] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:27:51.115906] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:27:51.115975] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-19T19:27:51.116043] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-19T19:27:51.116079] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-19T19:27:51.116133] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-19T19:27:51.116282] [INFO ] [MAIN ] Update Progress: 1114/2372 symbols completed. INR took 29.8s. Estimated remaining: 2h 46m 53s. Rate: 7.5 symbols/min [2025-09-19T19:27:51.286821] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:51.316489] [DEBUG] [LOCAL ] INVX: Loaded 29524 existing records from primary storage. [2025-09-19T19:27:51.316619] [INFO ] [MAIN ] INVX: Loaded 29524 existing records. [2025-09-19T19:27:51.492912] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:51.493169] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-19T19:27:51.493216] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-19T19:27:51.494000] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-19T19:27:51.494061] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-19T19:27:51.889863] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:51.884948] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-19T19:27:52.171698] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T19:27:52.643260] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-19T19:27:53.103282] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T19:27:53.443231] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-19T19:27:53.887239] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T19:27:54.243360] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-19T19:27:54.400472] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T19:27:54.718074] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:27:55.043341] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-19T19:27:55.843315] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-19T19:27:56.116600] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T19:27:56.123462] [INFO ] [REMOTE ] INSP: Full fetch complete (52155 records). [2025-09-19T19:27:56.123606] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-19T19:27:56.517624] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-19T19:27:56.517945] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-19T19:27:56.518974] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-19T19:27:56.519078] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-19T19:27:56.520933] [DEBUG] [LOCAL ] INSP: Trimmed 52155 records to 37158 (keeping 200 days of data) [2025-09-19T19:27:56.629109] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:27:56.643674] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-19T19:27:56.780171] [DEBUG] [LOCAL ] INSP: Primary data saved (37158 records). [2025-09-19T19:27:56.780315] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-19T19:27:56.780401] [INFO ] [MAIN ] Update Progress: 1115/2372 symbols completed. INSP took 31.8s. Estimated remaining: 2h 46m 42s. Rate: 7.5 symbols/min [2025-09-19T19:27:56.964681] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:27:57.017826] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-09-19T19:27:57.017999] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-09-19T19:27:57.209367] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:27:57.209622] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-19T19:27:57.209703] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-19T19:27:57.211054] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-19T19:27:57.211116] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-19T19:27:57.459383] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-19T19:27:57.594145] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:27:57.938725] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T19:27:58.252419] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-19T19:27:58.277589] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T19:27:58.931712] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T19:27:59.043291] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-19T19:27:59.843319] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-19T19:28:00.385524] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T19:28:00.643312] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-19T19:28:00.767491] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T19:28:01.443341] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-19T19:28:01.633757] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:28:02.243330] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-19T19:28:03.043331] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-19T19:28:03.095347] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T19:28:03.527299] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-09-19T19:28:03.849033] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-19T19:28:03.860921] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:28:04.643276] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-19T19:28:04.786303] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T19:28:05.443258] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-19T19:28:05.786886] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T19:28:05.878604] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:28:06.243265] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-19T19:28:07.043312] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-19T19:28:07.119243] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T19:28:07.125058] [INFO ] [REMOTE ] INSW: Full fetch complete (60934 records). [2025-09-19T19:28:07.125163] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-19T19:28:07.461622] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T19:28:07.546310] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-19T19:28:07.546391] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-19T19:28:07.547241] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-19T19:28:07.547306] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-19T19:28:07.548537] [DEBUG] [LOCAL ] INSW: Trimmed 60934 records to 41250 (keeping 200 days of data) [2025-09-19T19:28:07.797572] [DEBUG] [LOCAL ] INSW: Primary data saved (41250 records). [2025-09-19T19:28:07.797723] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-19T19:28:07.797815] [INFO ] [MAIN ] Update Progress: 1116/2372 symbols completed. INSW took 37.7s. Estimated remaining: 2h 46m 38s. Rate: 7.5 symbols/min [2025-09-19T19:28:07.852589] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-19T19:28:07.974042] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:08.025506] [DEBUG] [LOCAL ] IOT: Loaded 53863 existing records from primary storage. [2025-09-19T19:28:08.025718] [INFO ] [MAIN ] IOT: Loaded 53863 existing records. [2025-09-19T19:28:08.201600] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:08.201887] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-19T19:28:08.201943] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-19T19:28:08.203033] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-19T19:28:08.203094] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-19T19:28:08.549419] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:08.643223] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-19T19:28:09.443475] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-19T19:28:10.013466] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.97 seconds). [2025-09-19T19:28:10.033900] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T19:28:10.243278] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-19T19:28:10.874040] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T19:28:11.043229] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-19T19:28:11.083724] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:28:11.625816] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T19:28:11.843256] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-19T19:28:12.643334] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-19T19:28:13.042526] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T19:28:13.279620] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T19:28:13.443241] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-19T19:28:14.247812] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-19T19:28:14.254214] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T19:28:14.265120] [INFO ] [REMOTE ] INVH: Full fetch complete (76671 records). [2025-09-19T19:28:14.265286] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-19T19:28:14.655527] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-19T19:28:14.655615] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-19T19:28:14.656595] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-19T19:28:14.656683] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-19T19:28:14.658217] [DEBUG] [LOCAL ] INVH: Trimmed 76671 records to 53917 (keeping 200 days of data) [2025-09-19T19:28:14.977181] [DEBUG] [LOCAL ] INVH: Primary data saved (53917 records). [2025-09-19T19:28:14.977318] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-19T19:28:14.978680] [INFO ] [MAIN ] Update Progress: 1117/2372 symbols completed. INVH took 27.2s. Estimated remaining: 2h 46m 29s. Rate: 7.5 symbols/min [2025-09-19T19:28:15.043228] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-19T19:28:15.455036] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T19:28:15.770231] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T19:28:15.774579] [INFO ] [REMOTE ] INVX: Full fetch complete (44613 records). [2025-09-19T19:28:15.774751] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-19T19:28:15.848436] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-19T19:28:16.175563] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-19T19:28:16.175667] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-19T19:28:16.176378] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-19T19:28:16.176420] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-19T19:28:16.177359] [DEBUG] [LOCAL ] INVX: Trimmed 44613 records to 29676 (keeping 200 days of data) [2025-09-19T19:28:16.349344] [DEBUG] [LOCAL ] INVX: Primary data saved (29676 records). [2025-09-19T19:28:16.349484] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-19T19:28:16.349569] [INFO ] [MAIN ] Update Progress: 1118/2372 symbols completed. INVX took 25.2s. Estimated remaining: 2h 46m 14s. Rate: 7.5 symbols/min [2025-09-19T19:28:17.716070] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-19T19:28:17.726443] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-19T19:28:17.999058] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T19:28:18.010276] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-19T19:28:19.950490] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T19:28:19.964913] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-19T19:28:20.077059] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-19T19:28:20.088940] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-19T19:28:22.022117] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T19:28:22.033708] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-19T19:28:23.059868] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-19T19:28:23.071473] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-19T19:28:24.139668] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T19:28:24.151440] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-19T19:28:25.888102] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-19T19:28:25.899885] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-19T19:28:26.335246] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T19:28:26.347399] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-19T19:28:28.487297] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T19:28:28.499095] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-19T19:28:28.932318] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-09-19T19:28:28.943150] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-19T19:28:30.710234] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T19:28:30.720671] [INFO ] [REMOTE ] IOT: Full fetch complete (77376 records). [2025-09-19T19:28:30.720895] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-19T19:28:31.138227] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-19T19:28:31.138356] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-19T19:28:31.139778] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-19T19:28:31.139856] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-19T19:28:31.141608] [DEBUG] [LOCAL ] IOT: Trimmed 77376 records to 54252 (keeping 200 days of data) [2025-09-19T19:28:31.461127] [DEBUG] [LOCAL ] IOT: Primary data saved (54252 records). [2025-09-19T19:28:31.461265] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-19T19:28:31.461421] [INFO ] [MAIN ] Update Progress: 1119/2372 symbols completed. IOT took 23.7s. Estimated remaining: 2h 46m 14s. Rate: 7.5 symbols/min [2025-09-19T19:28:31.919382] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-19T19:28:31.931555] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-19T19:28:34.872296] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-09-19T19:28:34.884158] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-19T19:28:37.843411] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-19T19:28:37.851373] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-19T19:28:37.851522] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-19T19:28:38.269837] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-19T19:28:38.269942] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-19T19:28:38.270931] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-19T19:28:38.271002] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-19T19:28:38.272714] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-09-19T19:28:38.613454] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-09-19T19:28:38.613616] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-19T19:28:38.613748] [INFO ] [MAIN ] Update Progress: 1120/2372 symbols completed. IONQ took 41.8s. Estimated remaining: 2h 46m 5s. Rate: 7.5 symbols/min [2025-09-19T19:28:39.220252] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:39.176597] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:39.333634] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:39.354441] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:39.376810] [DEBUG] [LOCAL ] IQI: Loaded 18112 existing records from primary storage. [2025-09-19T19:28:39.377119] [INFO ] [MAIN ] IQI: Loaded 18112 existing records. [2025-09-19T19:28:39.521338] [DEBUG] [LOCAL ] IPI: Loaded 21585 existing records from primary storage. [2025-09-19T19:28:39.533431] [INFO ] [MAIN ] IPI: Loaded 21585 existing records. [2025-09-19T19:28:39.724551] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:39.750582] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-19T19:28:39.756559] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-19T19:28:39.768521] [DEBUG] [LOCAL ] IP: Loaded 53719 existing records from primary storage. [2025-09-19T19:28:39.773983] [INFO ] [MAIN ] IP: Loaded 53719 existing records. [2025-09-19T19:28:39.784516] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-19T19:28:39.810297] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-19T19:28:39.983251] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:39.996840] [DEBUG] [LOCAL ] IPG: Loaded 53723 existing records from primary storage. [2025-09-19T19:28:40.053177] [INFO ] [MAIN ] IPG: Loaded 53723 existing records. [2025-09-19T19:28:40.063614] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-19T19:28:40.069256] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-19T19:28:40.165552] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-19T19:28:40.202745] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-19T19:28:40.344759] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:40.477708] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-19T19:28:40.587162] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-19T19:28:40.650173] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-19T19:28:40.693379] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:40.733773] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-19T19:28:40.777183] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-19T19:28:40.811828] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-19T19:28:40.906953] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-19T19:28:41.052791] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:41.032557] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-19T19:28:41.058380] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-19T19:28:41.369058] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:41.396372] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-19T19:28:41.696715] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:41.719890] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-19T19:28:41.810218] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:41.810548] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-19T19:28:42.387014] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:28:42.392151] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-19T19:28:42.486470] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T19:28:42.491136] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-19T19:28:43.114468] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:28:43.126000] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-19T19:28:43.178239] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-19T19:28:43.182212] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-19T19:28:43.570755] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T19:28:43.575179] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-19T19:28:43.770461] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T19:28:43.782177] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-19T19:28:44.349534] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T19:28:44.354156] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-19T19:28:44.531156] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:28:44.541766] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-19T19:28:44.767981] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T19:28:44.773154] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-19T19:28:45.065378] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T19:28:45.070718] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-19T19:28:45.707321] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:28:45.717991] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-19T19:28:45.856880] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T19:28:45.860678] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-19T19:28:46.324773] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T19:28:46.330108] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-19T19:28:46.503595] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T19:28:46.513759] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-19T19:28:47.099585] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T19:28:47.104879] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-19T19:28:47.583583] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T19:28:47.595180] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-19T19:28:47.789462] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T19:28:47.795489] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-19T19:28:48.031075] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:28:48.034924] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-19T19:28:48.939030] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-19T19:28:48.950575] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-19T19:28:48.982127] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:28:48.989390] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-19T19:28:49.225308] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:28:49.229286] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-19T19:28:49.325204] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T19:28:49.337681] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-19T19:28:50.533775] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T19:28:50.540318] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-19T19:28:50.683863] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T19:28:50.689298] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-19T19:28:50.923971] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:28:50.935984] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-19T19:28:51.038818] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T19:28:51.052353] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-19T19:28:51.423242] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T19:28:51.429798] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-19T19:28:51.712949] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:28:51.843242] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-19T19:28:52.334303] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T19:28:52.339046] [INFO ] [REMOTE ] IQI: Full fetch complete (27297 records). [2025-09-19T19:28:52.339173] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-19T19:28:52.756829] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-19T19:28:52.757000] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-19T19:28:52.758026] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-19T19:28:52.758135] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-19T19:28:52.759742] [DEBUG] [LOCAL ] IQI: Trimmed 27297 records to 18200 (keeping 200 days of data) [2025-09-19T19:28:52.943992] [DEBUG] [LOCAL ] IQI: Primary data saved (18200 records). [2025-09-19T19:28:52.943816] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T19:28:52.944426] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-19T19:28:52.954929] [INFO ] [MAIN ] Update Progress: 1121/2372 symbols completed. IQI took 14.3s. Estimated remaining: 2h 46m 4s. Rate: 7.5 symbols/min [2025-09-19T19:28:52.957452] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T19:28:52.989797] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-19T19:28:53.139008] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:53.157978] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T19:28:53.161441] [INFO ] [REMOTE ] IPI: Full fetch complete (28923 records). [2025-09-19T19:28:53.161541] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-19T19:28:53.456508] [DEBUG] [LOCAL ] IQV: Loaded 50871 existing records from primary storage. [2025-09-19T19:28:53.456607] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-19T19:28:53.479454] [INFO ] [MAIN ] IQV: Loaded 50871 existing records. [2025-09-19T19:28:53.719528] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-19T19:28:53.719981] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-19T19:28:53.720605] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-19T19:28:53.720708] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-19T19:28:53.771972] [DEBUG] [LOCAL ] IPI: Trimmed 28923 records to 21673 (keeping 200 days of data) [2025-09-19T19:28:53.802128] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:53.802442] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-19T19:28:53.802494] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-19T19:28:53.804719] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-19T19:28:53.804791] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-19T19:28:54.303017] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:54.304861] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-19T19:28:54.342878] [DEBUG] [LOCAL ] IPI: Primary data saved (21673 records). [2025-09-19T19:28:54.343146] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-19T19:28:54.343261] [INFO ] [MAIN ] Update Progress: 1122/2372 symbols completed. IPI took 15.7s. Estimated remaining: 2h 45m 49s. Rate: 7.5 symbols/min [2025-09-19T19:28:54.529523] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:28:54.591062] [DEBUG] [LOCAL ] IR: Loaded 53086 existing records from primary storage. [2025-09-19T19:28:54.591209] [INFO ] [MAIN ] IR: Loaded 53086 existing records. [2025-09-19T19:28:54.778204] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:28:54.778544] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-19T19:28:54.778602] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-19T19:28:54.780262] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-19T19:28:54.780325] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-19T19:28:55.158839] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:28:55.159405] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-19T19:28:55.193399] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T19:28:55.234768] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T19:28:55.843274] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-19T19:28:55.962420] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T19:28:56.643314] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-19T19:28:57.170406] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T19:28:57.443255] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-19T19:28:57.665980] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:28:58.243272] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-19T19:28:58.555471] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:28:59.043308] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-19T19:28:59.339823] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T19:28:59.843306] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-19T19:29:00.179990] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T19:29:00.265455] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T19:29:00.643280] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-19T19:29:01.443326] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-19T19:29:01.917179] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T19:29:02.243365] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-19T19:29:02.617671] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:29:03.043289] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-19T19:29:03.295606] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T19:29:03.843298] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-19T19:29:04.370076] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T19:29:04.643245] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-19T19:29:05.420350] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T19:29:05.443233] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-19T19:29:05.833003] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:29:06.243370] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-19T19:29:06.661947] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T19:29:06.672398] [INFO ] [REMOTE ] IP: Full fetch complete (77036 records). [2025-09-19T19:29:06.672534] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-19T19:29:07.081686] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-19T19:29:07.077851] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-19T19:29:07.082731] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-19T19:29:07.083808] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-19T19:29:07.083967] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-19T19:29:07.085594] [DEBUG] [LOCAL ] IP: Trimmed 77036 records to 54109 (keeping 200 days of data) [2025-09-19T19:29:07.207223] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:29:07.464103] [DEBUG] [LOCAL ] IP: Primary data saved (54109 records). [2025-09-19T19:29:07.464525] [INFO ] [MAIN ] IP: Full history saved. [2025-09-19T19:29:07.464663] [INFO ] [MAIN ] Update Progress: 1123/2372 symbols completed. IP took 28.8s. Estimated remaining: 2h 45m 47s. Rate: 7.5 symbols/min [2025-09-19T19:29:07.640232] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:07.692539] [DEBUG] [LOCAL ] IRM: Loaded 49920 existing records from primary storage. [2025-09-19T19:29:07.692896] [INFO ] [MAIN ] IRM: Loaded 49920 existing records. [2025-09-19T19:29:07.850498] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-19T19:29:07.885229] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:07.885556] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-19T19:29:07.885607] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-19T19:29:07.887563] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-19T19:29:07.887665] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-19T19:29:08.292355] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:08.314262] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T19:29:08.323862] [INFO ] [REMOTE ] IPG: Full fetch complete (77247 records). [2025-09-19T19:29:08.324012] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-19T19:29:08.648449] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-19T19:29:08.737840] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-19T19:29:08.737932] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-19T19:29:08.738982] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-19T19:29:08.739050] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-19T19:29:08.740556] [DEBUG] [LOCAL ] IPG: Trimmed 77247 records to 54113 (keeping 200 days of data) [2025-09-19T19:29:09.098132] [DEBUG] [LOCAL ] IPG: Primary data saved (54113 records). [2025-09-19T19:29:09.098313] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-19T19:29:09.100534] [INFO ] [MAIN ] Update Progress: 1124/2372 symbols completed. IPG took 30.5s. Estimated remaining: 2h 45m 32s. Rate: 7.5 symbols/min [2025-09-19T19:29:09.307246] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:09.309732] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T19:29:09.345303] [DEBUG] [LOCAL ] IRS: Loaded 21446 existing records from primary storage. [2025-09-19T19:29:09.345429] [INFO ] [MAIN ] IRS: Loaded 21446 existing records. [2025-09-19T19:29:09.448387] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-19T19:29:09.546184] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:09.546481] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-19T19:29:09.546537] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-19T19:29:09.547213] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-19T19:29:09.547276] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-19T19:29:09.947769] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:09.977077] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T19:29:10.243249] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-19T19:29:10.856313] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T19:29:11.043237] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-19T19:29:11.149608] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T19:29:11.666735] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T19:29:11.843250] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-19T19:29:12.643267] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-19T19:29:13.032369] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:29:13.443270] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-19T19:29:13.779268] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T19:29:13.936403] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T19:29:14.243255] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-19T19:29:15.043318] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-19T19:29:15.359463] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T19:29:15.843250] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-19T19:29:16.247606] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T19:29:16.643237] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-19T19:29:17.091049] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T19:29:17.443233] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-19T19:29:18.037332] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T19:29:18.044193] [INFO ] [REMOTE ] IQV: Full fetch complete (72502 records). [2025-09-19T19:29:18.044315] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-19T19:29:18.244460] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-19T19:29:18.343349] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T19:29:18.479687] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-19T19:29:18.479798] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-19T19:29:18.480824] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-19T19:29:18.480902] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-19T19:29:18.482560] [DEBUG] [LOCAL ] IQV: Trimmed 72502 records to 51146 (keeping 200 days of data) [2025-09-19T19:29:18.794483] [DEBUG] [LOCAL ] IQV: Primary data saved (51146 records). [2025-09-19T19:29:18.794629] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-19T19:29:18.794753] [INFO ] [MAIN ] Update Progress: 1125/2372 symbols completed. IQV took 25.8s. Estimated remaining: 2h 45m 26s. Rate: 7.5 symbols/min [2025-09-19T19:29:18.965173] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:19.016588] [DEBUG] [LOCAL ] IRT: Loaded 50772 existing records from primary storage. [2025-09-19T19:29:19.016758] [INFO ] [MAIN ] IRT: Loaded 50772 existing records. [2025-09-19T19:29:19.048438] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-19T19:29:19.222598] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T19:29:19.244849] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:19.245416] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-19T19:29:19.245842] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-19T19:29:19.247157] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-19T19:29:19.247216] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-19T19:29:19.599094] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:19.843249] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-19T19:29:20.403265] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T19:29:20.425978] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T19:29:20.643274] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-19T19:29:21.443279] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-19T19:29:21.878597] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T19:29:21.921675] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:29:22.243278] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-19T19:29:23.043314] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-19T19:29:23.504085] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T19:29:23.542124] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T19:29:23.550063] [INFO ] [REMOTE ] IR: Full fetch complete (76050 records). [2025-09-19T19:29:23.550198] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-19T19:29:23.849729] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-19T19:29:23.953080] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-19T19:29:23.953162] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-19T19:29:23.954123] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-19T19:29:23.954185] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-19T19:29:23.955622] [DEBUG] [LOCAL ] IR: Trimmed 76050 records to 53476 (keeping 200 days of data) [2025-09-19T19:29:24.293137] [DEBUG] [LOCAL ] IR: Primary data saved (53476 records). [2025-09-19T19:29:24.293306] [INFO ] [MAIN ] IR: Full history saved. [2025-09-19T19:29:24.293402] [INFO ] [MAIN ] Update Progress: 1126/2372 symbols completed. IR took 29.9s. Estimated remaining: 2h 45m 15s. Rate: 7.5 symbols/min [2025-09-19T19:29:24.467854] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:24.485607] [DEBUG] [LOCAL ] ISD: Loaded 15949 existing records from primary storage. [2025-09-19T19:29:24.485762] [INFO ] [MAIN ] ISD: Loaded 15949 existing records. [2025-09-19T19:29:24.647438] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-19T19:29:24.669873] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:24.670045] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-19T19:29:24.670093] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-19T19:29:24.670639] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-19T19:29:24.670733] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-19T19:29:25.051549] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:25.086588] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T19:29:25.443273] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-19T19:29:25.706670] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:29:25.988750] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:29:26.243270] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-19T19:29:27.043330] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-19T19:29:27.320213] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:29:27.419431] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T19:29:27.843336] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-19T19:29:28.643265] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-19T19:29:28.841259] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T19:29:29.195158] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T19:29:29.443256] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-19T19:29:29.834825] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T19:29:30.243304] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-19T19:29:31.054554] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-19T19:29:31.057146] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T19:29:31.626122] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:29:31.843227] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-19T19:29:32.294974] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T19:29:32.643272] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-19T19:29:33.443309] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-19T19:29:33.888981] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T19:29:33.909695] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:29:34.243315] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-19T19:29:34.817974] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T19:29:34.823182] [INFO ] [REMOTE ] IRS: Full fetch complete (32135 records). [2025-09-19T19:29:34.823269] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-19T19:29:35.048602] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-19T19:29:35.203498] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-19T19:29:35.203582] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-19T19:29:35.204300] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-19T19:29:35.204364] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-19T19:29:35.205207] [DEBUG] [LOCAL ] IRS: Trimmed 32135 records to 21712 (keeping 200 days of data) [2025-09-19T19:29:35.334297] [DEBUG] [LOCAL ] IRS: Primary data saved (21712 records). [2025-09-19T19:29:35.334444] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-19T19:29:35.334532] [INFO ] [MAIN ] Update Progress: 1127/2372 symbols completed. IRS took 26.2s. Estimated remaining: 2h 45m 10s. Rate: 7.5 symbols/min [2025-09-19T19:29:35.526149] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:35.568582] [DEBUG] [LOCAL ] IT: Loaded 41428 existing records from primary storage. [2025-09-19T19:29:35.568768] [INFO ] [MAIN ] IT: Loaded 41428 existing records. [2025-09-19T19:29:35.746102] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:35.746423] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-19T19:29:35.746488] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-19T19:29:35.747571] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-19T19:29:35.747630] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-19T19:29:35.847913] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-19T19:29:36.109885] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:36.170389] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T19:29:36.444682] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T19:29:36.643234] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-19T19:29:37.056082] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T19:29:37.443299] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-19T19:29:38.243237] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-19T19:29:38.628560] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:29:38.636092] [INFO ] [REMOTE ] IRM: Full fetch complete (72286 records). [2025-09-19T19:29:38.636259] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-19T19:29:38.985969] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T19:29:39.047974] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-19T19:29:39.065603] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-19T19:29:39.066886] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-19T19:29:39.067905] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-19T19:29:39.068066] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-19T19:29:39.069616] [DEBUG] [LOCAL ] IRM: Trimmed 72286 records to 50281 (keeping 200 days of data) [2025-09-19T19:29:39.418632] [DEBUG] [LOCAL ] IRM: Primary data saved (50281 records). [2025-09-19T19:29:39.418806] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-19T19:29:39.419198] [INFO ] [MAIN ] Update Progress: 1128/2372 symbols completed. IRM took 32.0s. Estimated remaining: 2h 44m 58s. Rate: 7.5 symbols/min [2025-09-19T19:29:39.590535] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:39.629175] [DEBUG] [LOCAL ] ITGR: Loaded 31906 existing records from primary storage. [2025-09-19T19:29:39.629355] [INFO ] [MAIN ] ITGR: Loaded 31906 existing records. [2025-09-19T19:29:39.812260] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:39.812803] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-19T19:29:39.812877] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-19T19:29:39.814043] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-19T19:29:39.814120] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-19T19:29:39.846014] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-19T19:29:40.154199] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T19:29:40.226787] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:40.498422] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T19:29:40.643294] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-19T19:29:40.735864] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T19:29:41.443266] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-19T19:29:41.909082] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T19:29:42.243307] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-19T19:29:43.043270] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-19T19:29:43.073601] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T19:29:43.623631] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:29:43.843258] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-19T19:29:44.319543] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:29:44.643265] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-19T19:29:45.443300] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-19T19:29:45.686851] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T19:29:45.938056] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T19:29:46.243281] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-19T19:29:46.777795] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:29:47.043265] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-19T19:29:47.835430] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T19:29:47.843214] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-19T19:29:48.110597] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T19:29:48.643318] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-19T19:29:49.443256] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-19T19:29:49.694561] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T19:29:49.715276] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T19:29:49.717809] [INFO ] [REMOTE ] ISD: Full fetch complete (23886 records). [2025-09-19T19:29:49.717885] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-19T19:29:50.124974] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-19T19:29:50.125078] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-19T19:29:50.125750] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-19T19:29:50.125816] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-19T19:29:50.126515] [DEBUG] [LOCAL ] ISD: Trimmed 23886 records to 16019 (keeping 200 days of data) [2025-09-19T19:29:50.224047] [DEBUG] [LOCAL ] ISD: Primary data saved (16019 records). [2025-09-19T19:29:50.224191] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-19T19:29:50.224278] [INFO ] [MAIN ] Update Progress: 1129/2372 symbols completed. ISD took 25.9s. Estimated remaining: 2h 44m 53s. Rate: 7.5 symbols/min [2025-09-19T19:29:50.255437] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-19T19:29:50.410961] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:29:50.453140] [DEBUG] [LOCAL ] ITT: Loaded 33669 existing records from primary storage. [2025-09-19T19:29:50.453324] [INFO ] [MAIN ] ITT: Loaded 33669 existing records. [2025-09-19T19:29:50.636371] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:29:50.636676] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-19T19:29:50.636745] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-19T19:29:50.637735] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-19T19:29:50.637798] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-19T19:29:51.011430] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:29:51.043220] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-19T19:29:51.095329] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T19:29:51.843271] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-19T19:29:52.268310] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T19:29:52.407416] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T19:29:52.643269] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-19T19:29:53.435389] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T19:29:53.443214] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-19T19:29:54.190610] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T19:29:54.245796] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-19T19:29:55.043302] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-19T19:29:55.183951] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T19:29:55.843263] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-19T19:29:55.875071] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T19:29:56.643276] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-19T19:29:56.959013] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T19:29:57.443277] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-19T19:29:57.630525] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T19:29:57.744637] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T19:29:58.243275] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-19T19:29:59.043244] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-19T19:29:59.095078] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:29:59.663827] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T19:29:59.843274] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-19T19:30:00.643242] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-19T19:30:00.736993] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:30:01.443412] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-19T19:30:01.749711] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:30:01.757532] [INFO ] [REMOTE ] IRT: Full fetch complete (72294 records). [2025-09-19T19:30:01.757740] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-19T19:30:02.190857] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-19T19:30:02.190972] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-19T19:30:02.192019] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-19T19:30:02.192085] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-19T19:30:02.193718] [DEBUG] [LOCAL ] IRT: Trimmed 72294 records to 51127 (keeping 200 days of data) [2025-09-19T19:30:02.248325] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-19T19:30:02.517539] [DEBUG] [LOCAL ] IRT: Primary data saved (51127 records). [2025-09-19T19:30:02.517718] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-19T19:30:02.517829] [INFO ] [MAIN ] Update Progress: 1130/2372 symbols completed. IRT took 43.7s. Estimated remaining: 2h 44m 50s. Rate: 7.5 symbols/min [2025-09-19T19:30:02.685526] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:02.685749] [DEBUG] [LOCAL ] ITUB: No existing data file found in primary storage. [2025-09-19T19:30:02.685804] [WARN ] [MAIN ] ITUB: No existing data found, performing full refresh instead. [2025-09-19T19:30:02.685945] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-19T19:30:02.685988] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-19T19:30:02.686027] [DEBUG] [LOCAL ] ITUB: No primary data file found to delete. [2025-09-19T19:30:02.686058] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-19T19:30:03.050853] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:03.051288] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-19T19:30:03.082233] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T19:30:03.843358] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-19T19:30:04.387512] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-19T19:30:04.643472] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-19T19:30:05.833036] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (3.58 seconds). [2025-09-19T19:30:05.841950] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-19T19:30:06.469876] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:30:06.475587] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-19T19:30:06.569759] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (3.52 seconds). [2025-09-19T19:30:06.613845] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-19T19:30:07.043350] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-19T19:30:07.662126] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:30:07.843327] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-19T19:30:07.872198] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T19:30:07.877356] [INFO ] [REMOTE ] ITGR: Full fetch complete (41133 records). [2025-09-19T19:30:07.877467] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-19T19:30:08.283662] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-19T19:30:08.283757] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-19T19:30:08.284429] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-19T19:30:08.284469] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-19T19:30:08.285427] [DEBUG] [LOCAL ] ITGR: Trimmed 41133 records to 32189 (keeping 200 days of data) [2025-09-19T19:30:08.494627] [DEBUG] [LOCAL ] ITGR: Primary data saved (32189 records). [2025-09-19T19:30:08.494812] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-19T19:30:08.494933] [INFO ] [MAIN ] Update Progress: 1131/2372 symbols completed. ITGR took 29.1s. Estimated remaining: 2h 44m 40s. Rate: 7.5 symbols/min [2025-09-19T19:30:08.658249] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-19T19:30:08.693328] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:08.696770] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T19:30:08.752252] [DEBUG] [LOCAL ] ITW: Loaded 46843 existing records from primary storage. [2025-09-19T19:30:08.752437] [INFO ] [MAIN ] ITW: Loaded 46843 existing records. [2025-09-19T19:30:08.951824] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:08.952323] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-19T19:30:08.952387] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-19T19:30:08.953602] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-19T19:30:08.953693] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-19T19:30:09.344432] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:09.443279] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-19T19:30:09.922133] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T19:30:10.243345] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-19T19:30:10.737376] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T19:30:11.043283] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-19T19:30:11.304721] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:30:11.778029] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:30:11.785277] [INFO ] [REMOTE ] IT: Full fetch complete (54871 records). [2025-09-19T19:30:11.785530] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-19T19:30:11.850729] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-19T19:30:12.211446] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-19T19:30:12.211614] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-19T19:30:12.212894] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-19T19:30:12.212968] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-19T19:30:12.214301] [DEBUG] [LOCAL ] IT: Trimmed 54871 records to 41777 (keeping 200 days of data) [2025-09-19T19:30:12.475452] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T19:30:12.504092] [DEBUG] [LOCAL ] IT: Primary data saved (41777 records). [2025-09-19T19:30:12.504241] [INFO ] [MAIN ] IT: Full history saved. [2025-09-19T19:30:12.504330] [INFO ] [MAIN ] Update Progress: 1132/2372 symbols completed. IT took 37.2s. Estimated remaining: 2h 44m 28s. Rate: 7.5 symbols/min [2025-09-19T19:30:12.649760] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-19T19:30:12.686180] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:12.734070] [DEBUG] [LOCAL ] IVR: Loaded 48089 existing records from primary storage. [2025-09-19T19:30:12.734283] [INFO ] [MAIN ] IVR: Loaded 48089 existing records. [2025-09-19T19:30:12.922346] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:12.922591] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-19T19:30:12.922660] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-19T19:30:12.923945] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-19T19:30:12.924006] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-19T19:30:13.279675] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:13.353378] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T19:30:13.443227] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-19T19:30:14.243266] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-19T19:30:14.794800] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T19:30:15.043279] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-19T19:30:15.843304] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-19T19:30:16.326844] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-09-19T19:30:16.643257] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-19T19:30:17.300776] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-09-19T19:30:17.443292] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-19T19:30:17.587410] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T19:30:18.113469] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T19:30:18.243232] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-19T19:30:18.996796] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T19:30:19.043220] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-19T19:30:19.713591] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:30:19.843260] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-19T19:30:20.201673] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (5.16 seconds). [2025-09-19T19:30:20.205926] [INFO ] [REMOTE ] ITT: Full fetch complete (46494 records). [2025-09-19T19:30:20.206035] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-19T19:30:20.206605] [FATAL] [VALIDATOR ] ITT: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T19:30:20.206715] [FATAL] [MAIN ] ITT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:30:20.206758] [WARN ] [MAIN ] ITT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:30:20.206824] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-19T19:30:20.206890] [DEBUG] [LOCAL ] ITT: No primary data file found to delete. [2025-09-19T19:30:20.206925] [INFO ] [LOCAL ] ITT: Starting deletion of derivative data. [2025-09-19T19:30:20.207405] [DEBUG] [LOCAL ] ITT: Deleted derivative data file. [2025-09-19T19:30:20.207502] [INFO ] [MAIN ] Update Progress: 1133/2372 symbols completed. ITT took 30.0s. Estimated remaining: 2h 44m 19s. Rate: 7.5 symbols/min [2025-09-19T19:30:20.379055] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:20.414289] [DEBUG] [LOCAL ] IVT: Loaded 31317 existing records from primary storage. [2025-09-19T19:30:20.414433] [INFO ] [MAIN ] IVT: Loaded 31317 existing records. [2025-09-19T19:30:20.626903] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:20.627160] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-19T19:30:20.627207] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-19T19:30:20.628115] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-19T19:30:20.628175] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-19T19:30:20.659687] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-19T19:30:20.985399] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:21.038050] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:30:21.443266] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-19T19:30:22.126586] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T19:30:22.243231] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-19T19:30:22.759912] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T19:30:23.043263] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-19T19:30:23.089516] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T19:30:23.843276] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-19T19:30:24.359728] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T19:30:24.643273] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-19T19:30:25.361403] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T19:30:25.453300] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-19T19:30:25.458839] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-19T19:30:26.139879] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T19:30:26.243231] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-19T19:30:27.043271] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-19T19:30:27.370246] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:30:27.843314] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-19T19:30:28.181716] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T19:30:28.562497] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T19:30:28.643216] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-19T19:30:29.320484] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T19:30:29.443228] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-19T19:30:30.243347] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-19T19:30:30.306830] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T19:30:30.315224] [INFO ] [REMOTE ] ITUB: Full fetch complete (77166 records). [2025-09-19T19:30:30.315451] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-19T19:30:30.718696] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-19T19:30:30.718797] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-19T19:30:30.719864] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-19T19:30:30.719945] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-19T19:30:30.722068] [DEBUG] [LOCAL ] ITUB: Trimmed 77166 records to 54074 (keeping 200 days of data) [2025-09-19T19:30:30.952569] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T19:30:31.049683] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-19T19:30:31.078391] [DEBUG] [LOCAL ] ITUB: Primary data saved (54074 records). [2025-09-19T19:30:31.078539] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-19T19:30:31.078720] [INFO ] [MAIN ] Update Progress: 1134/2372 symbols completed. ITUB took 28.6s. Estimated remaining: 2h 44m 15s. Rate: 7.5 symbols/min [2025-09-19T19:30:31.247975] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:31.306745] [DEBUG] [LOCAL ] IVZ: Loaded 53534 existing records from primary storage. [2025-09-19T19:30:31.306890] [INFO ] [MAIN ] IVZ: Loaded 53534 existing records. [2025-09-19T19:30:31.482782] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:31.483036] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-19T19:30:31.483090] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-19T19:30:31.485199] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-19T19:30:31.485268] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-19T19:30:31.840778] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:31.843230] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-19T19:30:32.064340] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T19:30:32.174599] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T19:30:32.643255] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-19T19:30:33.443255] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-19T19:30:33.885445] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T19:30:34.243250] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-19T19:30:34.775633] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T19:30:35.043264] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-19T19:30:35.397850] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T19:30:35.843231] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-19T19:30:35.975769] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T19:30:36.477855] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T19:30:36.643252] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-19T19:30:37.443295] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-19T19:30:37.709167] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T19:30:38.243272] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-19T19:30:38.507261] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:30:38.851639] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T19:30:39.043279] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-19T19:30:39.843273] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-19T19:30:40.075724] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T19:30:40.083462] [INFO ] [REMOTE ] ITW: Full fetch complete (66628 records). [2025-09-19T19:30:40.083663] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-19T19:30:40.507820] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-19T19:30:40.508555] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-19T19:30:40.510543] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-19T19:30:40.510686] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-19T19:30:40.509481] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T19:30:40.519324] [DEBUG] [LOCAL ] ITW: Trimmed 66628 records to 47147 (keeping 200 days of data) [2025-09-19T19:30:40.644030] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-19T19:30:40.837539] [DEBUG] [LOCAL ] ITW: Primary data saved (47147 records). [2025-09-19T19:30:40.837722] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-19T19:30:40.839255] [INFO ] [MAIN ] Update Progress: 1135/2372 symbols completed. ITW took 32.3s. Estimated remaining: 2h 44m 9s. Rate: 7.5 symbols/min [2025-09-19T19:30:41.015214] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:41.046613] [DEBUG] [LOCAL ] IX: Loaded 23003 existing records from primary storage. [2025-09-19T19:30:41.046784] [INFO ] [MAIN ] IX: Loaded 23003 existing records. [2025-09-19T19:30:41.229211] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:41.229488] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-19T19:30:41.229537] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-19T19:30:41.230192] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-19T19:30:41.230271] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-19T19:30:41.448781] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-19T19:30:41.600349] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:41.723089] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:30:42.243269] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-19T19:30:42.731385] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T19:30:43.044863] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-19T19:30:43.054787] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T19:30:43.067843] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T19:30:43.843271] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-19T19:30:44.643249] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-19T19:30:45.212448] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T19:30:45.443265] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-19T19:30:45.521965] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T19:30:45.876345] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:30:45.932357] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T19:30:46.243293] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-19T19:30:47.043273] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-19T19:30:47.843293] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-19T19:30:48.196412] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:30:48.309466] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:30:48.643345] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-19T19:30:49.376686] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:30:49.381894] [INFO ] [REMOTE ] IVT: Full fetch complete (45589 records). [2025-09-19T19:30:49.382001] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-19T19:30:49.450445] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-19T19:30:49.774319] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-19T19:30:49.774397] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-19T19:30:49.775114] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-19T19:30:49.775175] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-19T19:30:49.776501] [DEBUG] [LOCAL ] IVT: Trimmed 45589 records to 31539 (keeping 200 days of data) [2025-09-19T19:30:49.974824] [DEBUG] [LOCAL ] IVT: Primary data saved (31539 records). [2025-09-19T19:30:49.974959] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-19T19:30:49.975041] [INFO ] [MAIN ] Update Progress: 1136/2372 symbols completed. IVT took 29.8s. Estimated remaining: 2h 44m 2s. Rate: 7.5 symbols/min [2025-09-19T19:30:50.144129] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:50.194435] [DEBUG] [LOCAL ] J: Loaded 40914 existing records from primary storage. [2025-09-19T19:30:50.194597] [INFO ] [MAIN ] J: Loaded 40914 existing records. [2025-09-19T19:30:50.258448] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-19T19:30:50.374619] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:50.374893] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-19T19:30:50.374940] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-19T19:30:50.375918] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-19T19:30:50.375977] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-19T19:30:50.726093] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:50.873899] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T19:30:50.880922] [INFO ] [REMOTE ] IVR: Full fetch complete (68908 records). [2025-09-19T19:30:50.881036] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-19T19:30:51.053350] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-19T19:30:51.273297] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-19T19:30:51.273383] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-19T19:30:51.274287] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-19T19:30:51.274350] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-19T19:30:51.276692] [DEBUG] [LOCAL ] IVR: Trimmed 68908 records to 48461 (keeping 200 days of data) [2025-09-19T19:30:51.568283] [DEBUG] [LOCAL ] IVR: Primary data saved (48461 records). [2025-09-19T19:30:51.568572] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-19T19:30:51.568707] [INFO ] [MAIN ] Update Progress: 1137/2372 symbols completed. IVR took 39.1s. Estimated remaining: 2h 43m 47s. Rate: 7.5 symbols/min [2025-09-19T19:30:51.745106] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:30:51.760709] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T19:30:51.804417] [DEBUG] [LOCAL ] JBGS: Loaded 42727 existing records from primary storage. [2025-09-19T19:30:51.804690] [INFO ] [MAIN ] JBGS: Loaded 42727 existing records. [2025-09-19T19:30:51.847677] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-19T19:30:52.023572] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:30:52.025583] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-19T19:30:52.036533] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-19T19:30:52.036874] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-19T19:30:52.037947] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-19T19:30:52.038010] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-19T19:30:52.399117] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:30:52.643301] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-19T19:30:52.908165] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T19:30:53.443324] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-19T19:30:53.474221] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T19:30:54.243288] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-19T19:30:54.311026] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T19:30:55.043235] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-19T19:30:55.357421] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T19:30:55.428776] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:30:55.843270] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-19T19:30:56.643298] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-19T19:30:56.708925] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:30:57.443232] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-19T19:30:57.615299] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:30:57.969984] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:30:58.243285] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-19T19:30:59.038572] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T19:30:59.046009] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-19T19:30:59.843220] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-19T19:30:59.989197] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:31:00.372677] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:31:00.643304] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-19T19:31:01.443366] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-19T19:31:01.731744] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T19:31:02.241143] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T19:31:02.251485] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-19T19:31:02.748828] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T19:31:03.043315] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-19T19:31:03.414247] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T19:31:03.843324] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-19T19:31:04.643343] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-19T19:31:04.914731] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:31:05.443291] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-19T19:31:05.887716] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T19:31:05.900034] [INFO ] [REMOTE ] IVZ: Full fetch complete (76716 records). [2025-09-19T19:31:05.900284] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-19T19:31:06.248415] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-19T19:31:06.337115] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-19T19:31:06.337229] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-19T19:31:06.338271] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-19T19:31:06.338347] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-19T19:31:06.340014] [DEBUG] [LOCAL ] IVZ: Trimmed 76716 records to 53923 (keeping 200 days of data) [2025-09-19T19:31:06.631097] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:31:06.763054] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T19:31:06.791070] [DEBUG] [LOCAL ] IVZ: Primary data saved (53923 records). [2025-09-19T19:31:06.791278] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-19T19:31:06.791382] [INFO ] [MAIN ] Update Progress: 1138/2372 symbols completed. IVZ took 35.7s. Estimated remaining: 2h 43m 47s. Rate: 7.5 symbols/min [2025-09-19T19:31:06.972463] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:07.019744] [DEBUG] [LOCAL ] JBI: Loaded 44548 existing records from primary storage. [2025-09-19T19:31:07.019922] [INFO ] [MAIN ] JBI: Loaded 44548 existing records. [2025-09-19T19:31:07.053421] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-19T19:31:07.224135] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:07.224445] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-19T19:31:07.224496] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-19T19:31:07.225755] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-19T19:31:07.225817] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-19T19:31:07.643721] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:07.843270] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-19T19:31:08.266263] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T19:31:08.269991] [INFO ] [REMOTE ] IX: Full fetch complete (26640 records). [2025-09-19T19:31:08.270116] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-19T19:31:08.647859] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-19T19:31:08.648453] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-19T19:31:08.649290] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-19T19:31:08.649900] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-19T19:31:08.649964] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-19T19:31:08.650786] [DEBUG] [LOCAL ] IX: Trimmed 26640 records to 23105 (keeping 200 days of data) [2025-09-19T19:31:08.791247] [DEBUG] [LOCAL ] IX: Primary data saved (23105 records). [2025-09-19T19:31:08.791440] [INFO ] [MAIN ] IX: Full history saved. [2025-09-19T19:31:08.791677] [INFO ] [MAIN ] Update Progress: 1139/2372 symbols completed. IX took 28.0s. Estimated remaining: 2h 43m 33s. Rate: 7.5 symbols/min [2025-09-19T19:31:08.971102] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:09.003878] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:31:09.050120] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:31:09.094018] [DEBUG] [LOCAL ] JBL: Loaded 48738 existing records from primary storage. [2025-09-19T19:31:09.094192] [INFO ] [MAIN ] JBL: Loaded 48738 existing records. [2025-09-19T19:31:09.279174] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:09.279458] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-19T19:31:09.279508] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-19T19:31:09.280783] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-19T19:31:09.280846] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-19T19:31:09.456593] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-19T19:31:09.645225] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:10.243274] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-19T19:31:10.634310] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T19:31:11.043262] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-19T19:31:11.315627] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:31:11.843285] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-19T19:31:12.117004] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T19:31:12.643265] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-19T19:31:12.821483] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T19:31:13.443276] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-19T19:31:13.714066] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T19:31:14.243267] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-19T19:31:14.300194] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:31:15.043280] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-19T19:31:15.136066] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:31:15.843306] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-19T19:31:16.563087] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T19:31:16.643259] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-19T19:31:17.040662] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T19:31:17.443263] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-19T19:31:17.598205] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:31:18.102615] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T19:31:18.243250] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-19T19:31:19.043263] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-19T19:31:19.411690] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:31:19.843262] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-19T19:31:20.321611] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:31:20.401578] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T19:31:20.408203] [INFO ] [REMOTE ] JBGS: Full fetch complete (58894 records). [2025-09-19T19:31:20.408366] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-19T19:31:20.650190] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-19T19:31:20.813481] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-19T19:31:20.813584] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-19T19:31:20.814421] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-19T19:31:20.814500] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-19T19:31:20.815971] [DEBUG] [LOCAL ] JBGS: Trimmed 58894 records to 43083 (keeping 200 days of data) [2025-09-19T19:31:21.103520] [DEBUG] [LOCAL ] JBGS: Primary data saved (43083 records). [2025-09-19T19:31:21.103724] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-19T19:31:21.103831] [INFO ] [MAIN ] Update Progress: 1140/2372 symbols completed. JBGS took 29.5s. Estimated remaining: 2h 43m 29s. Rate: 7.5 symbols/min [2025-09-19T19:31:21.285036] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:21.310565] [DEBUG] [LOCAL ] JBND: Loaded 25327 existing records from primary storage. [2025-09-19T19:31:21.310732] [INFO ] [MAIN ] JBND: Loaded 25327 existing records. [2025-09-19T19:31:21.452217] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-19T19:31:21.498521] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:21.498869] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-19T19:31:21.498955] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-19T19:31:21.499620] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-19T19:31:21.499709] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-19T19:31:21.882768] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:21.906859] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T19:31:22.148046] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T19:31:22.243266] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-19T19:31:23.043287] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-19T19:31:23.170415] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T19:31:23.843284] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-19T19:31:24.028997] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T19:31:24.345411] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T19:31:24.643248] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-19T19:31:25.075739] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T19:31:25.443273] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-19T19:31:26.207862] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:31:26.243219] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-19T19:31:27.043272] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-19T19:31:27.187680] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:31:27.194022] [INFO ] [REMOTE ] J: Full fetch complete (59233 records). [2025-09-19T19:31:27.194160] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-19T19:31:27.633037] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-19T19:31:27.641590] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-19T19:31:27.648031] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-19T19:31:27.648115] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-19T19:31:27.659547] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T19:31:27.668500] [DEBUG] [LOCAL ] J: Trimmed 59233 records to 41236 (keeping 200 days of data) [2025-09-19T19:31:27.855204] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-19T19:31:27.937098] [DEBUG] [LOCAL ] J: Primary data saved (41236 records). [2025-09-19T19:31:27.937227] [INFO ] [MAIN ] J: Full history saved. [2025-09-19T19:31:27.937307] [INFO ] [MAIN ] Update Progress: 1141/2372 symbols completed. J took 38.0s. Estimated remaining: 2h 43m 20s. Rate: 7.5 symbols/min [2025-09-19T19:31:28.103904] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:28.104087] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-19T19:31:28.104125] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-19T19:31:28.104266] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-19T19:31:28.104321] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-19T19:31:28.104387] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-19T19:31:28.104421] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-19T19:31:28.456992] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:28.643270] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-19T19:31:28.871984] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T19:31:28.882451] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:28.883541] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-19T19:31:29.443314] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-19T19:31:29.498913] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T19:31:29.504765] [INFO ] [REMOTE ] JBI: Full fetch complete (64719 records). [2025-09-19T19:31:29.504912] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-19T19:31:29.896832] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-19T19:31:29.896940] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-19T19:31:29.897803] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-19T19:31:29.897866] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-19T19:31:29.899279] [DEBUG] [LOCAL ] JBI: Trimmed 64719 records to 44819 (keeping 200 days of data) [2025-09-19T19:31:30.152047] [DEBUG] [LOCAL ] JBI: Primary data saved (44819 records). [2025-09-19T19:31:30.152186] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-19T19:31:30.152286] [INFO ] [MAIN ] Update Progress: 1142/2372 symbols completed. JBI took 23.4s. Estimated remaining: 2h 43m 6s. Rate: 7.5 symbols/min [2025-09-19T19:31:30.249954] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-19T19:31:30.328272] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:30.328451] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-19T19:31:30.328489] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-19T19:31:30.328682] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-19T19:31:30.328736] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-19T19:31:30.328778] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-19T19:31:30.328811] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-19T19:31:30.596824] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:30.608919] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-19T19:31:30.689764] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:30.700060] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T19:31:31.043280] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-19T19:31:31.290492] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:31.290981] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-19T19:31:31.843263] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-19T19:31:32.086936] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:32.087289] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-19T19:31:32.643262] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-19T19:31:32.872081] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:32.872498] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-19T19:31:33.443283] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-19T19:31:34.243277] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-19T19:31:34.481570] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:34.481936] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-19T19:31:34.925223] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T19:31:35.043273] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-19T19:31:35.843268] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-19T19:31:36.074593] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:31:36.074989] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-19T19:31:36.643275] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-19T19:31:36.663058] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:31:37.443315] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-19T19:31:38.243294] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-19T19:31:38.676143] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:31:38.754457] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:31:39.043274] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-19T19:31:39.348517] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T19:31:39.843297] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-19T19:31:40.643324] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-19T19:31:41.087436] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:31:41.443301] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-19T19:31:41.870436] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:31:41.956515] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T19:31:42.243313] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-19T19:31:43.043303] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-19T19:31:43.359997] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T19:31:43.558027] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T19:31:43.843293] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-19T19:31:44.643306] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-19T19:31:45.036589] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T19:31:45.118974] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T19:31:45.443311] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-19T19:31:46.248383] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-19T19:31:46.260156] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T19:31:46.268042] [INFO ] [REMOTE ] JBL: Full fetch complete (69818 records). [2025-09-19T19:31:46.268213] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-19T19:31:46.672709] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-19T19:31:46.672804] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-19T19:31:46.673835] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-19T19:31:46.673903] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-19T19:31:46.675406] [DEBUG] [LOCAL ] JBL: Trimmed 69818 records to 49097 (keeping 200 days of data) [2025-09-19T19:31:46.796885] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T19:31:47.019152] [DEBUG] [LOCAL ] JBL: Primary data saved (49097 records). [2025-09-19T19:31:47.019315] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-19T19:31:47.019909] [INFO ] [MAIN ] Update Progress: 1143/2372 symbols completed. JBL took 38.2s. Estimated remaining: 2h 43m 8s. Rate: 7.5 symbols/min [2025-09-19T19:31:47.051005] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-19T19:31:47.203104] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:47.212925] [DEBUG] [LOCAL ] JCE: Loaded 6445 existing records from primary storage. [2025-09-19T19:31:47.213048] [INFO ] [MAIN ] JCE: Loaded 6445 existing records. [2025-09-19T19:31:47.398919] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:47.399180] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-19T19:31:47.399242] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-19T19:31:47.399777] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-19T19:31:47.399845] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-19T19:31:47.781493] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:47.843218] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-19T19:31:48.374257] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T19:31:48.381797] [INFO ] [REMOTE ] JBS: Full fetch complete (25599 records). [2025-09-19T19:31:48.381883] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-19T19:31:48.582408] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-19T19:31:48.583022] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:31:48.596950] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:31:48.597444] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T19:31:48.603090] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-19T19:31:48.603536] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-19T19:31:48.603598] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-19T19:31:48.603730] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-19T19:31:48.603803] [INFO ] [MAIN ] Update Progress: 1144/2372 symbols completed. JBS took 20.7s. Estimated remaining: 2h 42m 53s. Rate: 7.5 symbols/min [2025-09-19T19:31:48.648527] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-19T19:31:48.732476] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T19:31:48.799213] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:48.853486] [DEBUG] [LOCAL ] JCI: Loaded 53940 existing records from primary storage. [2025-09-19T19:31:48.853677] [INFO ] [MAIN ] JCI: Loaded 53940 existing records. [2025-09-19T19:31:49.035871] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:49.036157] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-19T19:31:49.036240] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-19T19:31:49.037816] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-19T19:31:49.037876] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-19T19:31:49.395699] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:49.443212] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-19T19:31:49.990345] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:31:50.243301] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-19T19:31:51.043331] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-19T19:31:51.585367] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T19:31:51.657463] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T19:31:51.843281] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-19T19:31:52.643291] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-19T19:31:52.665593] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T19:31:53.443298] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-19T19:31:53.481528] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T19:31:53.862823] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T19:31:54.243269] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-19T19:31:55.043269] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-19T19:31:55.151771] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:31:55.671903] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T19:31:55.843370] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-19T19:31:56.643337] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-19T19:31:56.881115] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T19:31:56.945146] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T19:31:56.950558] [INFO ] [REMOTE ] JBND: Full fetch complete (33007 records). [2025-09-19T19:31:56.950716] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-19T19:31:57.426808] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-19T19:31:57.426892] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-19T19:31:57.427568] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-19T19:31:57.427610] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-19T19:31:57.428520] [DEBUG] [LOCAL ] JBND: Trimmed 33007 records to 25580 (keeping 200 days of data) [2025-09-19T19:31:57.481185] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-19T19:31:57.593409] [DEBUG] [LOCAL ] JBND: Primary data saved (25580 records). [2025-09-19T19:31:57.593573] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-19T19:31:57.593716] [INFO ] [MAIN ] Update Progress: 1145/2372 symbols completed. JBND took 36.5s. Estimated remaining: 2h 42m 46s. Rate: 7.5 symbols/min [2025-09-19T19:31:57.779303] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:31:57.827682] [DEBUG] [LOCAL ] JEF: Loaded 50392 existing records from primary storage. [2025-09-19T19:31:57.827864] [INFO ] [MAIN ] JEF: Loaded 50392 existing records. [2025-09-19T19:31:58.020336] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:31:58.020610] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-19T19:31:58.020693] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-19T19:31:58.022408] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-19T19:31:58.022472] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-19T19:31:58.274204] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-19T19:31:58.243760] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-19T19:31:58.427797] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:31:58.450401] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T19:31:59.043300] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-19T19:31:59.843304] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-19T19:32:00.321009] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:32:00.621738] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T19:32:00.643261] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-19T19:32:00.947846] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:32:01.443282] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-19T19:32:01.593357] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T19:32:02.243262] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-19T19:32:03.043303] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-19T19:32:03.585953] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T19:32:03.732065] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:32:03.843263] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-19T19:32:04.643297] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-19T19:32:04.989596] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T19:32:05.306763] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T19:32:05.312448] [INFO ] [REMOTE ] JBTM: Full fetch complete (41333 records). [2025-09-19T19:32:05.312567] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-19T19:32:05.428932] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T19:32:05.446351] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-19T19:32:05.538600] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T19:32:05.539269] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:32:05.539371] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:32:05.539474] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-19T19:32:05.539665] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-19T19:32:05.539745] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-19T19:32:05.539863] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-19T19:32:05.540001] [INFO ] [MAIN ] Update Progress: 1146/2372 symbols completed. JBTM took 35.4s. Estimated remaining: 2h 42m 38s. Rate: 7.5 symbols/min [2025-09-19T19:32:05.715503] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:05.758797] [DEBUG] [LOCAL ] JELD: Loaded 46566 existing records from primary storage. [2025-09-19T19:32:05.758939] [INFO ] [MAIN ] JELD: Loaded 46566 existing records. [2025-09-19T19:32:05.936279] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:05.936612] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-19T19:32:05.936717] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-19T19:32:05.937750] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-19T19:32:05.937815] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-19T19:32:06.256704] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-19T19:32:06.299054] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:07.043321] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-19T19:32:07.143489] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:32:07.245186] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:32:07.843261] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-19T19:32:08.648336] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-19T19:32:08.662025] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:32:09.443261] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-19T19:32:09.808925] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:32:10.243266] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-19T19:32:10.354947] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T19:32:10.712476] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T19:32:11.043269] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-19T19:32:11.297692] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T19:32:11.774888] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T19:32:11.843245] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-19T19:32:12.643293] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-19T19:32:13.443264] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-19T19:32:13.675527] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T19:32:13.678318] [INFO ] [REMOTE ] JCE: Full fetch complete (9022 records). [2025-09-19T19:32:13.678432] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-19T19:32:14.155494] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T19:32:14.156035] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-19T19:32:14.167579] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-19T19:32:14.167944] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-19T19:32:14.168031] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-19T19:32:14.169552] [DEBUG] [LOCAL ] JCE: Trimmed 9022 records to 6521 (keeping 200 days of data) [2025-09-19T19:32:14.210220] [DEBUG] [LOCAL ] JCE: Primary data saved (6521 records). [2025-09-19T19:32:14.210359] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-19T19:32:14.210471] [INFO ] [MAIN ] Update Progress: 1147/2372 symbols completed. JCE took 27.2s. Estimated remaining: 2h 42m 31s. Rate: 7.5 symbols/min [2025-09-19T19:32:14.253132] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-19T19:32:14.385829] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:14.396321] [DEBUG] [LOCAL ] JEQ: Loaded 9046 existing records from primary storage. [2025-09-19T19:32:14.396427] [INFO ] [MAIN ] JEQ: Loaded 9046 existing records. [2025-09-19T19:32:14.575092] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:14.575410] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-19T19:32:14.575465] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-19T19:32:14.575886] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-19T19:32:14.575946] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-19T19:32:14.929782] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:15.043257] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-19T19:32:15.088190] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T19:32:15.743558] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T19:32:15.813516] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T19:32:15.843230] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-19T19:32:16.643279] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-19T19:32:16.762476] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T19:32:17.443262] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-19T19:32:18.243265] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-19T19:32:18.930604] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-19T19:32:18.948721] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T19:32:19.043199] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-19T19:32:19.353476] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T19:32:19.843283] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-19T19:32:20.643266] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-19T19:32:20.876223] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T19:32:21.000761] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T19:32:21.443280] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-19T19:32:22.243272] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-19T19:32:22.404752] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T19:32:22.593273] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T19:32:23.043268] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-19T19:32:23.843276] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-19T19:32:23.881906] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T19:32:23.939860] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T19:32:24.643275] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-19T19:32:25.372500] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T19:32:25.443226] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-19T19:32:25.647381] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T19:32:26.243408] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-19T19:32:26.245013] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T19:32:27.043317] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-19T19:32:27.843265] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-19T19:32:28.033112] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T19:32:28.084057] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:32:28.643307] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-19T19:32:29.443292] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-19T19:32:29.558873] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T19:32:29.560718] [INFO ] [REMOTE ] JEQ: Full fetch complete (11374 records). [2025-09-19T19:32:29.560803] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-19T19:32:29.946821] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-19T19:32:29.946996] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-19T19:32:29.947277] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-19T19:32:29.947319] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-19T19:32:29.947913] [DEBUG] [LOCAL ] JEQ: Trimmed 11374 records to 9163 (keeping 200 days of data) [2025-09-19T19:32:30.018004] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T19:32:30.029265] [INFO ] [REMOTE ] JEF: Full fetch complete (72782 records). [2025-09-19T19:32:30.030065] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-19T19:32:30.193941] [DEBUG] [LOCAL ] JEQ: Primary data saved (9163 records). [2025-09-19T19:32:30.206302] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-19T19:32:30.210775] [INFO ] [MAIN ] Update Progress: 1148/2372 symbols completed. JEQ took 16.0s. Estimated remaining: 2h 42m 31s. Rate: 7.5 symbols/min [2025-09-19T19:32:30.250558] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-19T19:32:30.647980] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:30.648226] [DEBUG] [LOCAL ] JFR: No existing data file found in primary storage. [2025-09-19T19:32:30.648331] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-19T19:32:30.648405] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-19T19:32:30.648466] [WARN ] [MAIN ] JFR: No existing data found, performing full refresh instead. [2025-09-19T19:32:30.649745] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-19T19:32:30.648720] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-19T19:32:30.649858] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-19T19:32:30.649901] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-19T19:32:30.650112] [DEBUG] [LOCAL ] JFR: No primary data file found to delete. [2025-09-19T19:32:30.650174] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-19T19:32:30.756733] [DEBUG] [LOCAL ] JEF: Trimmed 72782 records to 50767 (keeping 200 days of data) [2025-09-19T19:32:31.151661] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:31.152867] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-19T19:32:31.381723] [DEBUG] [LOCAL ] JEF: Primary data saved (50767 records). [2025-09-19T19:32:31.381865] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-19T19:32:31.381954] [INFO ] [MAIN ] Update Progress: 1149/2372 symbols completed. JEF took 33.8s. Estimated remaining: 2h 42m 16s. Rate: 7.5 symbols/min [2025-09-19T19:32:31.608094] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:31.610537] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T19:32:31.639157] [DEBUG] [LOCAL ] JGH: Loaded 11091 existing records from primary storage. [2025-09-19T19:32:31.639296] [INFO ] [MAIN ] JGH: Loaded 11091 existing records. [2025-09-19T19:32:31.838603] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:31.838891] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-19T19:32:31.838948] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-19T19:32:31.839387] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-19T19:32:31.839448] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-19T19:32:31.874723] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-19T19:32:32.211428] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:32.558532] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T19:32:32.643257] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-19T19:32:32.866554] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:32:33.443252] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-19T19:32:33.529862] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T19:32:33.538088] [INFO ] [REMOTE ] JCI: Full fetch complete (77405 records). [2025-09-19T19:32:33.538249] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-19T19:32:33.942001] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-19T19:32:33.942112] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-19T19:32:33.943148] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-19T19:32:33.943235] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-19T19:32:33.944954] [DEBUG] [LOCAL ] JCI: Trimmed 77405 records to 54330 (keeping 200 days of data) [2025-09-19T19:32:34.244810] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-19T19:32:34.292330] [DEBUG] [LOCAL ] JCI: Primary data saved (54330 records). [2025-09-19T19:32:34.297565] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-19T19:32:34.298015] [INFO ] [MAIN ] Update Progress: 1150/2372 symbols completed. JCI took 45.7s. Estimated remaining: 2h 42m 3s. Rate: 7.5 symbols/min [2025-09-19T19:32:34.504315] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T19:32:34.525002] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T19:32:34.529326] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:34.601910] [DEBUG] [LOCAL ] JHG: Loaded 48523 existing records from primary storage. [2025-09-19T19:32:34.602099] [INFO ] [MAIN ] JHG: Loaded 48523 existing records. [2025-09-19T19:32:34.796457] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:34.796757] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-19T19:32:34.796816] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-19T19:32:34.798290] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-19T19:32:34.798365] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-19T19:32:35.048485] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-19T19:32:35.186209] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:35.843290] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-19T19:32:35.869181] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T19:32:35.968776] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T19:32:36.643272] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-19T19:32:37.443313] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-19T19:32:37.655819] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T19:32:38.223087] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T19:32:38.243279] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-19T19:32:38.384158] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:32:39.043265] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-19T19:32:39.106040] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T19:32:39.843299] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-19T19:32:40.643273] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-19T19:32:40.724416] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T19:32:40.786076] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T19:32:41.443281] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-19T19:32:42.243267] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-19T19:32:42.417393] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:32:42.619325] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T19:32:43.043287] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-19T19:32:43.843317] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-19T19:32:43.915002] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T19:32:43.982171] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T19:32:44.643275] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-19T19:32:45.443349] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-19T19:32:45.974377] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T19:32:46.243267] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-19T19:32:46.472800] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T19:32:46.572744] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T19:32:47.043285] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-19T19:32:47.843338] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-19T19:32:48.211918] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:32:48.508440] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:32:48.643318] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-19T19:32:49.443289] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-19T19:32:49.857927] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T19:32:49.867630] [INFO ] [REMOTE ] JELD: Full fetch complete (63316 records). [2025-09-19T19:32:49.867858] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-19T19:32:50.247521] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-19T19:32:50.272253] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-19T19:32:50.272344] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-19T19:32:50.273538] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-19T19:32:50.273658] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-19T19:32:50.276323] [DEBUG] [LOCAL ] JELD: Trimmed 63316 records to 46906 (keeping 200 days of data) [2025-09-19T19:32:50.580631] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T19:32:50.601569] [DEBUG] [LOCAL ] JELD: Primary data saved (46906 records). [2025-09-19T19:32:50.601713] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-19T19:32:50.601913] [INFO ] [MAIN ] Update Progress: 1151/2372 symbols completed. JELD took 45.1s. Estimated remaining: 2h 42m 4s. Rate: 7.5 symbols/min [2025-09-19T19:32:50.777240] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:50.785097] [DEBUG] [LOCAL ] JHI: Loaded 3809 existing records from primary storage. [2025-09-19T19:32:50.785205] [INFO ] [MAIN ] JHI: Loaded 3809 existing records. [2025-09-19T19:32:50.968881] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:50.969411] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-19T19:32:50.969563] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-19T19:32:50.975594] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-19T19:32:50.987420] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-19T19:32:50.988300] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T19:32:51.052753] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-19T19:32:51.388845] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T19:32:51.400505] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:51.843335] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-19T19:32:52.523567] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-19T19:32:52.643333] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-19T19:32:53.058684] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T19:32:53.443280] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-19T19:32:54.108749] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:32:54.175538] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T19:32:54.243226] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-19T19:32:55.043295] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-19T19:32:55.730115] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:32:55.843288] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-19T19:32:56.643239] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-19T19:32:56.747277] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T19:32:56.782993] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T19:32:57.443287] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-19T19:32:58.110714] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T19:32:58.123251] [INFO ] [REMOTE ] JFR: Full fetch complete (47936 records). [2025-09-19T19:32:58.123684] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-19T19:32:58.248354] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-19T19:32:58.549260] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-19T19:32:58.549357] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-19T19:32:58.550132] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-19T19:32:58.550196] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-19T19:32:58.551358] [DEBUG] [LOCAL ] JFR: Trimmed 47936 records to 31079 (keeping 200 days of data) [2025-09-19T19:32:58.760834] [DEBUG] [LOCAL ] JFR: Primary data saved (31079 records). [2025-09-19T19:32:58.760984] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-19T19:32:58.761069] [INFO ] [MAIN ] Update Progress: 1152/2372 symbols completed. JFR took 28.5s. Estimated remaining: 2h 41m 56s. Rate: 7.5 symbols/min [2025-09-19T19:32:58.941839] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:32:58.947673] [DEBUG] [LOCAL ] JHS: Loaded 2939 existing records from primary storage. [2025-09-19T19:32:58.947833] [INFO ] [MAIN ] JHS: Loaded 2939 existing records. [2025-09-19T19:32:59.048772] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-19T19:32:59.104046] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T19:32:59.143945] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:32:59.146273] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-19T19:32:59.146360] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-19T19:32:59.146794] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-19T19:32:59.146879] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-19T19:32:59.623753] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:32:59.670447] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T19:32:59.843304] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-19T19:33:00.111409] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T19:33:00.619499] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T19:33:00.643221] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-19T19:33:01.320244] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T19:33:01.443294] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-19T19:33:02.243274] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-19T19:33:02.978962] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:33:02.981494] [INFO ] [REMOTE ] JGH: Full fetch complete (14738 records). [2025-09-19T19:33:02.981566] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-19T19:33:03.048418] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-19T19:33:03.359081] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-19T19:33:03.359407] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-19T19:33:03.359831] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-19T19:33:03.359893] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-19T19:33:03.361130] [DEBUG] [LOCAL ] JGH: Trimmed 14738 records to 11148 (keeping 200 days of data) [2025-09-19T19:33:03.441256] [DEBUG] [LOCAL ] JGH: Primary data saved (11148 records). [2025-09-19T19:33:03.441401] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-19T19:33:03.441503] [INFO ] [MAIN ] Update Progress: 1153/2372 symbols completed. JGH took 32.1s. Estimated remaining: 2h 41m 45s. Rate: 7.5 symbols/min [2025-09-19T19:33:03.618243] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:03.675131] [DEBUG] [LOCAL ] JHX: Loaded 49336 existing records from primary storage. [2025-09-19T19:33:03.675277] [INFO ] [MAIN ] JHX: Loaded 49336 existing records. [2025-09-19T19:33:03.782695] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T19:33:03.857979] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-19T19:33:03.864511] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:03.864833] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-19T19:33:03.864884] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-19T19:33:03.867105] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-19T19:33:03.867176] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-19T19:33:04.223270] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:04.643271] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-19T19:33:04.787197] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T19:33:05.443241] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-19T19:33:05.677073] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T19:33:05.981018] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-09-19T19:33:06.126845] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T19:33:06.243277] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-19T19:33:06.968727] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T19:33:07.043264] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-19T19:33:07.813282] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-19T19:33:07.814759] [INFO ] [REMOTE ] JHI: Full fetch complete (5302 records). [2025-09-19T19:33:07.814829] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-19T19:33:07.848434] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-19T19:33:08.197748] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-19T19:33:08.197868] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-19T19:33:08.198055] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-19T19:33:08.198098] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-19T19:33:08.198474] [DEBUG] [LOCAL ] JHI: Trimmed 5302 records to 3819 (keeping 200 days of data) [2025-09-19T19:33:08.223127] [DEBUG] [LOCAL ] JHI: Primary data saved (3819 records). [2025-09-19T19:33:08.223265] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-19T19:33:08.223370] [INFO ] [MAIN ] Update Progress: 1154/2372 symbols completed. JHI took 17.6s. Estimated remaining: 2h 41m 33s. Rate: 7.5 symbols/min [2025-09-19T19:33:08.407327] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:08.426912] [DEBUG] [LOCAL ] JILL: Loaded 16786 existing records from primary storage. [2025-09-19T19:33:08.427029] [INFO ] [MAIN ] JILL: Loaded 16786 existing records. [2025-09-19T19:33:08.610972] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:08.611504] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-19T19:33:08.611610] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-19T19:33:08.615637] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-19T19:33:08.615826] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-19T19:33:08.648952] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T19:33:08.648489] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-19T19:33:08.994998] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:09.443267] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-19T19:33:10.243255] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-19T19:33:10.596689] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:33:10.643071] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:33:10.651547] [INFO ] [REMOTE ] JHG: Full fetch complete (68584 records). [2025-09-19T19:33:10.651707] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-19T19:33:10.861021] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T19:33:11.048384] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-19T19:33:11.095198] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-19T19:33:11.095282] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-19T19:33:11.096208] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-19T19:33:11.096281] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-19T19:33:11.097711] [DEBUG] [LOCAL ] JHG: Trimmed 68584 records to 48849 (keeping 200 days of data) [2025-09-19T19:33:11.411543] [DEBUG] [LOCAL ] JHG: Primary data saved (48849 records). [2025-09-19T19:33:11.411716] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-19T19:33:11.411837] [INFO ] [MAIN ] Update Progress: 1155/2372 symbols completed. JHG took 37.1s. Estimated remaining: 2h 41m 20s. Rate: 7.5 symbols/min [2025-09-19T19:33:11.579255] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:11.624862] [DEBUG] [LOCAL ] JKS: Loaded 40528 existing records from primary storage. [2025-09-19T19:33:11.625028] [INFO ] [MAIN ] JKS: Loaded 40528 existing records. [2025-09-19T19:33:11.810086] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:11.810400] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-19T19:33:11.810482] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-19T19:33:11.811745] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-19T19:33:11.811803] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-19T19:33:11.848395] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-19T19:33:12.178621] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:12.187100] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T19:33:12.643235] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-19T19:33:12.922410] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T19:33:13.443270] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-19T19:33:13.672441] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T19:33:14.134809] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T19:33:14.243250] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-19T19:33:15.043268] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-19T19:33:15.843265] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-19T19:33:16.430585] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T19:33:16.452485] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T19:33:16.643261] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-19T19:33:17.335784] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:33:17.336544] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T19:33:17.443277] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-19T19:33:18.243303] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-19T19:33:19.043325] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-19T19:33:19.439305] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T19:33:19.482053] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T19:33:19.698321] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T19:33:19.843289] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-19T19:33:20.643330] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-19T19:33:21.336578] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T19:33:21.443263] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-19T19:33:21.515461] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T19:33:21.983557] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-19T19:33:22.243268] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-19T19:33:23.043257] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-19T19:33:23.078122] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T19:33:23.079534] [INFO ] [REMOTE ] JHS: Full fetch complete (4469 records). [2025-09-19T19:33:23.079612] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-19T19:33:23.438708] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-19T19:33:23.438799] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-19T19:33:23.438952] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-19T19:33:23.438989] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-19T19:33:23.439365] [DEBUG] [LOCAL ] JHS: Trimmed 4469 records to 2951 (keeping 200 days of data) [2025-09-19T19:33:23.457863] [DEBUG] [LOCAL ] JHS: Primary data saved (2951 records). [2025-09-19T19:33:23.457969] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-19T19:33:23.458051] [INFO ] [MAIN ] Update Progress: 1156/2372 symbols completed. JHS took 24.7s. Estimated remaining: 2h 41m 17s. Rate: 7.5 symbols/min [2025-09-19T19:33:23.633099] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:23.670223] [DEBUG] [LOCAL ] JLL: Loaded 32581 existing records from primary storage. [2025-09-19T19:33:23.670363] [INFO ] [MAIN ] JLL: Loaded 32581 existing records. [2025-09-19T19:33:23.847215] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-19T19:33:23.847380] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:23.847715] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-19T19:33:23.848677] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-19T19:33:23.849408] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-19T19:33:23.849508] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-19T19:33:24.203095] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:24.643265] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-19T19:33:25.105902] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T19:33:25.443274] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-19T19:33:26.089639] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T19:33:26.243287] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-19T19:33:26.333847] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-19T19:33:26.885865] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T19:33:27.043237] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-19T19:33:27.843275] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-19T19:33:28.475305] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T19:33:28.503113] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T19:33:28.643270] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-19T19:33:29.443304] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-19T19:33:29.579545] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:33:29.950860] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:33:30.243263] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-19T19:33:31.048987] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-19T19:33:31.061802] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:33:31.085561] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T19:33:31.843280] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-19T19:33:32.643293] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-19T19:33:33.105715] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T19:33:33.325570] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T19:33:33.342371] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:33:33.443251] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-19T19:33:34.243324] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-19T19:33:35.043238] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-19T19:33:35.150347] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T19:33:35.843271] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-19T19:33:36.197060] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:33:36.643319] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-19T19:33:37.058691] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T19:33:37.443362] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-19T19:33:37.764584] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:33:38.243285] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-19T19:33:38.723805] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:33:38.731675] [INFO ] [REMOTE ] JHX: Full fetch complete (56062 records). [2025-09-19T19:33:38.731802] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-19T19:33:39.048339] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-19T19:33:39.118195] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-19T19:33:39.118435] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-19T19:33:39.119271] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-19T19:33:39.119334] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-19T19:33:39.120629] [DEBUG] [LOCAL ] JHX: Trimmed 56062 records to 49724 (keeping 200 days of data) [2025-09-19T19:33:39.373024] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T19:33:39.465993] [DEBUG] [LOCAL ] JHX: Primary data saved (49724 records). [2025-09-19T19:33:39.466159] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-19T19:33:39.466253] [INFO ] [MAIN ] Update Progress: 1157/2372 symbols completed. JHX took 36.0s. Estimated remaining: 2h 41m 17s. Rate: 7.5 symbols/min [2025-09-19T19:33:39.788465] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T19:33:39.843265] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-19T19:33:40.217339] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:33:40.643272] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-19T19:33:41.450149] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-19T19:33:41.452880] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T19:33:41.755480] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T19:33:41.758728] [INFO ] [REMOTE ] JILL: Full fetch complete (23118 records). [2025-09-19T19:33:41.758820] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-19T19:33:42.146945] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-19T19:33:42.147080] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-19T19:33:42.147596] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-19T19:33:42.147638] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-19T19:33:42.148418] [DEBUG] [LOCAL ] JILL: Trimmed 23118 records to 16934 (keeping 200 days of data) [2025-09-19T19:33:42.244153] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-19T19:33:42.254806] [DEBUG] [LOCAL ] JILL: Primary data saved (16934 records). [2025-09-19T19:33:42.254905] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-19T19:33:42.254989] [INFO ] [MAIN ] Update Progress: 1158/2372 symbols completed. JILL took 34.0s. Estimated remaining: 2h 41m 4s. Rate: 7.5 symbols/min [2025-09-19T19:33:43.143221] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:33:43.154518] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-19T19:33:43.943545] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:33:43.951415] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-19T19:33:44.904158] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T19:33:44.915775] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-19T19:33:45.495288] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:33:45.501051] [INFO ] [REMOTE ] JLL: Full fetch complete (44857 records). [2025-09-19T19:33:45.501164] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-19T19:33:45.897521] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-19T19:33:45.897624] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-19T19:33:45.898401] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-19T19:33:45.898459] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-19T19:33:45.899712] [DEBUG] [LOCAL ] JLL: Trimmed 44857 records to 32790 (keeping 200 days of data) [2025-09-19T19:33:46.109365] [DEBUG] [LOCAL ] JLL: Primary data saved (32790 records). [2025-09-19T19:33:46.109553] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-19T19:33:46.109681] [INFO ] [MAIN ] Update Progress: 1159/2372 symbols completed. JLL took 22.7s. Estimated remaining: 2h 40m 52s. Rate: 7.5 symbols/min [2025-09-19T19:33:47.211977] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T19:33:47.221203] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-19T19:33:48.921333] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:33:48.929617] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-19T19:33:50.776609] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T19:33:50.782855] [INFO ] [REMOTE ] JKS: Full fetch complete (59701 records). [2025-09-19T19:33:50.782963] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-19T19:33:51.169608] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-19T19:33:51.169725] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-19T19:33:51.170550] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-19T19:33:51.170593] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-19T19:33:51.172015] [DEBUG] [LOCAL ] JKS: Trimmed 59701 records to 40779 (keeping 200 days of data) [2025-09-19T19:33:51.421352] [DEBUG] [LOCAL ] JKS: Primary data saved (40779 records). [2025-09-19T19:33:51.421553] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-19T19:33:51.421719] [INFO ] [MAIN ] Update Progress: 1160/2372 symbols completed. JKS took 40.0s. Estimated remaining: 2h 40m 41s. Rate: 7.5 symbols/min [2025-09-19T19:33:51.972529] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:52.060867] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-19T19:33:52.038861] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:52.071326] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-19T19:33:52.143561] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-19T19:33:52.147913] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:52.143476] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:33:52.148558] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-19T19:33:52.148930] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-19T19:33:52.149124] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-19T19:33:52.226693] [DEBUG] [LOCAL ] JLS: Loaded 4135 existing records from primary storage. [2025-09-19T19:33:52.248638] [INFO ] [MAIN ] JLS: Loaded 4135 existing records. [2025-09-19T19:33:52.454408] [DEBUG] [LOCAL ] JMIA: Loaded 50812 existing records from primary storage. [2025-09-19T19:33:52.498435] [INFO ] [MAIN ] JMIA: Loaded 50812 existing records. [2025-09-19T19:33:52.827241] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-09-19T19:33:52.890112] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-09-19T19:33:52.858768] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:52.926216] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-19T19:33:52.982023] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-19T19:33:53.044466] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:53.084894] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-19T19:33:53.077073] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-19T19:33:53.105461] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-19T19:33:53.101729] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:53.111619] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-19T19:33:53.154965] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-19T19:33:53.247158] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-19T19:33:53.283740] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-19T19:33:53.283627] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:33:53.338735] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-19T19:33:53.359939] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-19T19:33:53.425710] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-19T19:33:53.463921] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-19T19:33:54.180113] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T19:33:54.188736] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:54.222350] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-19T19:33:54.242605] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-19T19:33:54.283589] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:54.302776] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-19T19:33:54.420339] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:33:54.420671] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-19T19:33:54.723286] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T19:33:54.724267] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-19T19:33:55.211942] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T19:33:55.218193] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-19T19:33:55.218441] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-19T19:33:55.221106] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-19T19:33:55.619597] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T19:33:55.620665] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-19T19:33:55.919458] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T19:33:55.921059] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-19T19:33:56.140270] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-19T19:33:56.141452] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-19T19:33:56.717099] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T19:33:56.719441] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-19T19:33:56.755981] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T19:33:56.759267] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-19T19:33:56.761158] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-19T19:33:57.175755] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-19T19:33:57.443277] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-19T19:33:57.473539] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T19:33:57.557132] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T19:33:58.243272] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-19T19:33:58.850538] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T19:33:59.043266] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-19T19:33:59.625051] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T19:33:59.813525] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-19T19:33:59.843277] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-19T19:34:00.397530] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-19T19:34:00.398409] [INFO ] [REMOTE ] JMM: Full fetch complete (2299 records). [2025-09-19T19:34:00.398479] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-19T19:34:00.587601] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-19T19:34:00.587852] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:34:00.587922] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:34:00.588036] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-19T19:34:00.588115] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-19T19:34:00.588153] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-19T19:34:00.588193] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-19T19:34:00.588263] [INFO ] [MAIN ] Update Progress: 1161/2372 symbols completed. JMM took 9.2s. Estimated remaining: 2h 40m 34s. Rate: 7.5 symbols/min [2025-09-19T19:34:00.650580] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-19T19:34:00.766799] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:00.820924] [DEBUG] [LOCAL ] JOBY: Loaded 54188 existing records from primary storage. [2025-09-19T19:34:00.821099] [INFO ] [MAIN ] JOBY: Loaded 54188 existing records. [2025-09-19T19:34:01.001561] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:01.001874] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-19T19:34:01.001958] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-19T19:34:01.003601] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-19T19:34:01.003686] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-19T19:34:01.414857] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:01.443256] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-19T19:34:02.243322] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-19T19:34:03.043296] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-19T19:34:03.168435] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-19T19:34:03.230157] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T19:34:03.437209] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T19:34:03.843280] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-19T19:34:04.643269] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-19T19:34:05.380403] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:34:05.443264] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-19T19:34:05.911393] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T19:34:06.208849] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (3.17 seconds). [2025-09-19T19:34:06.243258] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-19T19:34:07.043284] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-19T19:34:07.720208] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T19:34:07.843283] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-19T19:34:08.081282] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-19T19:34:08.643275] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-19T19:34:08.977425] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-19T19:34:09.443272] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-19T19:34:10.103424] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T19:34:10.243297] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-19T19:34:10.859862] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-19T19:34:11.043268] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-19T19:34:11.166816] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-19T19:34:11.734324] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T19:34:11.843268] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-19T19:34:12.332449] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-09-19T19:34:12.643284] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-19T19:34:13.443276] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-19T19:34:14.171843] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T19:34:14.173428] [INFO ] [REMOTE ] JLS: Full fetch complete (5753 records). [2025-09-19T19:34:14.173506] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-19T19:34:14.248824] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-19T19:34:14.606516] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-19T19:34:14.620759] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-19T19:34:14.621128] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-19T19:34:14.622296] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-19T19:34:14.623815] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-19T19:34:14.625584] [DEBUG] [LOCAL ] JLS: Trimmed 5753 records to 4152 (keeping 200 days of data) [2025-09-19T19:34:14.708617] [DEBUG] [LOCAL ] JLS: Primary data saved (4152 records). [2025-09-19T19:34:14.709615] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-19T19:34:14.711323] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T19:34:14.711625] [INFO ] [MAIN ] Update Progress: 1162/2372 symbols completed. JLS took 23.3s. Estimated remaining: 2h 40m 33s. Rate: 7.5 symbols/min [2025-09-19T19:34:14.914985] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:14.945435] [DEBUG] [LOCAL ] JOE: Loaded 25031 existing records from primary storage. [2025-09-19T19:34:14.945712] [INFO ] [MAIN ] JOE: Loaded 25031 existing records. [2025-09-19T19:34:15.050353] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-19T19:34:15.148417] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:15.148779] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-19T19:34:15.148841] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-19T19:34:15.149763] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-19T19:34:15.149831] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-19T19:34:15.543747] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:15.843315] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-19T19:34:16.643274] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-19T19:34:17.118362] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-19T19:34:17.394613] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-19T19:34:17.443237] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-19T19:34:17.741853] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:34:18.243307] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-19T19:34:18.645514] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T19:34:19.043318] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-19T19:34:19.843298] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-19T19:34:20.190828] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-19T19:34:20.643333] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-19T19:34:20.869098] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-19T19:34:20.919836] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:34:20.988860] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T19:34:21.443273] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-19T19:34:22.243296] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-19T19:34:23.043280] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-19T19:34:23.457339] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-19T19:34:23.504618] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T19:34:23.556145] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T19:34:23.843307] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-19T19:34:24.643301] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-19T19:34:25.270130] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T19:34:25.306306] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T19:34:25.443310] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-19T19:34:26.243309] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-19T19:34:26.823104] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T19:34:27.043319] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-19T19:34:27.849145] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-19T19:34:27.851859] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T19:34:27.903497] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T19:34:27.911748] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-19T19:34:27.911909] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-19T19:34:28.322017] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-19T19:34:28.322118] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-19T19:34:28.323242] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-19T19:34:28.323323] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-19T19:34:28.325060] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54533 (keeping 200 days of data) [2025-09-19T19:34:28.649053] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-19T19:34:28.677786] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-09-19T19:34:28.677910] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-19T19:34:28.677990] [INFO ] [MAIN ] Update Progress: 1163/2372 symbols completed. JNJ took 37.3s. Estimated remaining: 2h 40m 31s. Rate: 7.5 symbols/min [2025-09-19T19:34:28.846068] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:28.854817] [DEBUG] [LOCAL ] JOF: Loaded 7219 existing records from primary storage. [2025-09-19T19:34:28.854920] [INFO ] [MAIN ] JOF: Loaded 7219 existing records. [2025-09-19T19:34:29.040444] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:29.040978] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-19T19:34:29.041037] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-19T19:34:29.041676] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-19T19:34:29.041777] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-19T19:34:29.434260] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:29.448359] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-19T19:34:29.461146] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-19T19:34:29.474563] [INFO ] [REMOTE ] JMIA: Full fetch complete (73210 records). [2025-09-19T19:34:29.474754] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-19T19:34:29.868760] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-19T19:34:29.868890] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-19T19:34:29.869938] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-19T19:34:29.870048] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-19T19:34:29.885765] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:34:29.885895] [DEBUG] [LOCAL ] JMIA: Trimmed 73210 records to 51198 (keeping 200 days of data) [2025-09-19T19:34:30.197764] [DEBUG] [LOCAL ] JMIA: Primary data saved (51198 records). [2025-09-19T19:34:30.197901] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-19T19:34:30.197989] [INFO ] [MAIN ] Update Progress: 1164/2372 symbols completed. JMIA took 38.8s. Estimated remaining: 2h 40m 16s. Rate: 7.5 symbols/min [2025-09-19T19:34:30.263578] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-19T19:34:30.377189] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:30.419054] [DEBUG] [LOCAL ] JPC: Loaded 37578 existing records from primary storage. [2025-09-19T19:34:30.419219] [INFO ] [MAIN ] JPC: Loaded 37578 existing records. [2025-09-19T19:34:30.577920] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T19:34:30.617871] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:30.618154] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-19T19:34:30.618303] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-19T19:34:30.629416] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-19T19:34:30.634683] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-19T19:34:30.717600] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-09-19T19:34:31.039504] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:31.043219] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-19T19:34:31.597618] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:34:31.843285] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-19T19:34:32.517139] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:34:32.643264] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-19T19:34:33.242082] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T19:34:33.412603] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T19:34:33.443218] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-19T19:34:34.243308] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-19T19:34:34.309184] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T19:34:35.043269] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-19T19:34:35.331426] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T19:34:35.843277] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-19T19:34:36.014764] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T19:34:36.643267] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-19T19:34:37.443315] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-19T19:34:38.165418] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T19:34:38.179930] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:34:38.243272] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-19T19:34:39.043228] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-19T19:34:39.216198] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-09-19T19:34:39.570929] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:34:39.574914] [INFO ] [REMOTE ] JOE: Full fetch complete (36431 records). [2025-09-19T19:34:39.575028] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-19T19:34:39.852845] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-19T19:34:39.980712] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-19T19:34:39.980848] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-19T19:34:39.981832] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-19T19:34:39.981929] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-19T19:34:39.983489] [DEBUG] [LOCAL ] JOE: Trimmed 36431 records to 25189 (keeping 200 days of data) [2025-09-19T19:34:40.140872] [DEBUG] [LOCAL ] JOE: Primary data saved (25189 records). [2025-09-19T19:34:40.141001] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-19T19:34:40.141084] [INFO ] [MAIN ] Update Progress: 1165/2372 symbols completed. JOE took 25.4s. Estimated remaining: 2h 40m 10s. Rate: 7.5 symbols/min [2025-09-19T19:34:40.311314] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:40.319026] [DEBUG] [LOCAL ] JPI: Loaded 5496 existing records from primary storage. [2025-09-19T19:34:40.319148] [INFO ] [MAIN ] JPI: Loaded 5496 existing records. [2025-09-19T19:34:40.517772] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:40.518020] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-19T19:34:40.518068] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-19T19:34:40.518418] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-19T19:34:40.518478] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-19T19:34:40.646830] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-19T19:34:40.901002] [INFO ] [REMOTE ] JPI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:40.917499] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T19:34:41.443299] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-19T19:34:41.454200] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T19:34:42.243333] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-19T19:34:42.828755] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-19T19:34:42.997570] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:34:43.043227] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-19T19:34:43.166577] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T19:34:43.843300] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-19T19:34:43.919369] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T19:34:44.643298] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-12. [2025-09-19T19:34:45.443271] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-19T19:34:45.496954] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:34:45.566579] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T19:34:46.243278] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-19T19:34:47.043314] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-01. [2025-09-19T19:34:47.298005] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T19:34:47.299942] [INFO ] [REMOTE ] JOF: Full fetch complete (9465 records). [2025-09-19T19:34:47.300022] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-19T19:34:47.696608] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-19T19:34:47.696741] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-19T19:34:47.697002] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-19T19:34:47.697077] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-19T19:34:47.697898] [DEBUG] [LOCAL ] JOF: Trimmed 9465 records to 7259 (keeping 200 days of data) [2025-09-19T19:34:47.743625] [DEBUG] [LOCAL ] JOF: Primary data saved (7259 records). [2025-09-19T19:34:47.743812] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-19T19:34:47.743925] [INFO ] [MAIN ] Update Progress: 1166/2372 symbols completed. JOF took 19.1s. Estimated remaining: 2h 40m 2s. Rate: 7.5 symbols/min [2025-09-19T19:34:47.843751] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-19T19:34:47.899724] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T19:34:47.933979] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:47.991009] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-09-19T19:34:47.991160] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-09-19T19:34:48.167476] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:48.167783] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-19T19:34:48.167840] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-19T19:34:48.169716] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-19T19:34:48.169777] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-19T19:34:48.533477] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:48.557548] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (3.11 seconds). [2025-09-19T19:34:48.566984] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-19T19:34:48.567180] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-19T19:34:48.648372] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-19T19:34:48.976061] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-19T19:34:48.976154] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-19T19:34:48.977171] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-19T19:34:48.977238] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-19T19:34:48.978782] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54578 (keeping 200 days of data) [2025-09-19T19:34:49.308889] [DEBUG] [LOCAL ] JOBY: Primary data saved (54578 records). [2025-09-19T19:34:49.309046] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-19T19:34:49.310129] [INFO ] [MAIN ] Update Progress: 1167/2372 symbols completed. JOBY took 48.7s. Estimated remaining: 2h 39m 47s. Rate: 7.5 symbols/min [2025-09-19T19:34:49.443398] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-19T19:34:49.446315] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T19:34:49.504572] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:34:49.547579] [DEBUG] [LOCAL ] JQC: Loaded 34199 existing records from primary storage. [2025-09-19T19:34:49.547774] [INFO ] [MAIN ] JQC: Loaded 34199 existing records. [2025-09-19T19:34:49.750134] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:34:49.750563] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-19T19:34:49.750788] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-19T19:34:49.752024] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-19T19:34:49.752093] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-19T19:34:49.895696] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T19:34:50.160826] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:34:50.243219] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-19T19:34:51.043265] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-19T19:34:51.768635] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T19:34:51.843315] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-19T19:34:51.944858] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T19:34:52.410781] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.97 seconds). [2025-09-19T19:34:52.643263] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-19T19:34:53.448950] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-19T19:34:53.460836] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T19:34:54.243283] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-19T19:34:55.043291] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-19T19:34:55.091358] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T19:34:55.133797] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-19T19:34:55.843235] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-19T19:34:56.118863] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:34:56.162406] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T19:34:56.643261] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-19T19:34:57.443333] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-19T19:34:57.496397] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T19:34:58.243256] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-19T19:34:58.361755] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-19T19:34:58.895388] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T19:34:59.043271] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-19T19:34:59.843272] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-19T19:34:59.876693] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:35:00.643268] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-19T19:35:00.775145] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T19:35:01.343130] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T19:35:01.443281] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-19T19:35:02.164107] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T19:35:02.243309] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-19T19:35:02.610896] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-19T19:35:03.043301] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-19T19:35:03.843319] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-19T19:35:03.927710] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T19:35:03.953292] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T19:35:04.643275] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-19T19:35:05.443272] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-19T19:35:05.500176] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:35:05.502349] [INFO ] [REMOTE ] JPI: Full fetch complete (7875 records). [2025-09-19T19:35:05.502486] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-19T19:35:05.890878] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-19T19:35:05.891000] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-19T19:35:05.891299] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-19T19:35:05.891379] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-19T19:35:05.892035] [DEBUG] [LOCAL ] JPI: Trimmed 7875 records to 5528 (keeping 200 days of data) [2025-09-19T19:35:05.930558] [DEBUG] [LOCAL ] JPI: Primary data saved (5528 records). [2025-09-19T19:35:05.930709] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-19T19:35:05.930878] [INFO ] [MAIN ] Update Progress: 1168/2372 symbols completed. JPI took 25.8s. Estimated remaining: 2h 39m 48s. Rate: 7.5 symbols/min [2025-09-19T19:35:06.108993] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:06.130045] [DEBUG] [LOCAL ] JRI: Loaded 15258 existing records from primary storage. [2025-09-19T19:35:06.130207] [INFO ] [MAIN ] JRI: Loaded 15258 existing records. [2025-09-19T19:35:06.248419] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-19T19:35:06.315121] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:06.315415] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-19T19:35:06.315468] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-19T19:35:06.316147] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-19T19:35:06.316223] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-19T19:35:06.712491] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:06.821630] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-19T19:35:06.859423] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T19:35:07.043288] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-19T19:35:07.843262] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-19T19:35:08.000350] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T19:35:08.008985] [INFO ] [REMOTE ] JPC: Full fetch complete (55813 records). [2025-09-19T19:35:08.009228] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-19T19:35:08.493614] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-19T19:35:08.493761] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-19T19:35:08.494803] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-19T19:35:08.494877] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-19T19:35:08.499167] [DEBUG] [LOCAL ] JPC: Trimmed 55813 records to 37802 (keeping 200 days of data) [2025-09-19T19:35:08.648674] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-19T19:35:08.663874] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T19:35:08.800939] [DEBUG] [LOCAL ] JPC: Primary data saved (37802 records). [2025-09-19T19:35:08.801089] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-19T19:35:08.801192] [INFO ] [MAIN ] Update Progress: 1169/2372 symbols completed. JPC took 38.6s. Estimated remaining: 2h 39m 35s. Rate: 7.5 symbols/min [2025-09-19T19:35:08.976356] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:08.993665] [DEBUG] [LOCAL ] JRS: Loaded 11157 existing records from primary storage. [2025-09-19T19:35:08.994012] [INFO ] [MAIN ] JRS: Loaded 11157 existing records. [2025-09-19T19:35:09.183787] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:09.184216] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-19T19:35:09.184273] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-19T19:35:09.184920] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-19T19:35:09.184980] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-19T19:35:09.448357] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-19T19:35:09.538275] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:10.019940] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T19:35:10.243238] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-19T19:35:10.344680] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-19T19:35:10.372032] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T19:35:11.043288] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-19T19:35:11.092624] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T19:35:11.843272] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-19T19:35:12.643270] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-19T19:35:12.685324] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:35:13.036870] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T19:35:13.150105] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T19:35:13.443282] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-19T19:35:14.243275] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-19T19:35:14.620614] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T19:35:15.043288] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-19T19:35:15.843284] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-19T19:35:16.611616] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T19:35:16.643230] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-19T19:35:16.798305] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-19T19:35:16.816782] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T19:35:17.443296] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-19T19:35:17.763876] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T19:35:18.165898] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T19:35:18.243245] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-19T19:35:19.043295] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-19T19:35:19.190254] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:35:19.843300] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-19T19:35:20.643329] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-19T19:35:21.236882] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T19:35:21.242203] [INFO ] [REMOTE ] JQC: Full fetch complete (48658 records). [2025-09-19T19:35:21.242306] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-19T19:35:21.451416] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-19T19:35:21.667795] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-19T19:35:21.667961] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-19T19:35:21.669186] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-19T19:35:21.669355] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-19T19:35:21.679354] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T19:35:21.683533] [DEBUG] [LOCAL ] JQC: Trimmed 48658 records to 34392 (keeping 200 days of data) [2025-09-19T19:35:21.825614] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-19T19:35:21.961898] [DEBUG] [LOCAL ] JQC: Primary data saved (34392 records). [2025-09-19T19:35:21.962055] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-19T19:35:21.962208] [INFO ] [MAIN ] Update Progress: 1170/2372 symbols completed. JQC took 32.7s. Estimated remaining: 2h 39m 33s. Rate: 7.5 symbols/min [2025-09-19T19:35:22.132243] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:22.186804] [DEBUG] [LOCAL ] JXN: Loaded 46440 existing records from primary storage. [2025-09-19T19:35:22.186954] [INFO ] [MAIN ] JXN: Loaded 46440 existing records. [2025-09-19T19:35:22.249568] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-19T19:35:22.368033] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:22.368316] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-19T19:35:22.368365] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-19T19:35:22.369720] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-19T19:35:22.369780] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-19T19:35:22.732209] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:22.743591] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:35:23.043305] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-19T19:35:23.348373] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T19:35:23.843283] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-19T19:35:24.643306] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-19T19:35:25.423691] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T19:35:25.443215] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-19T19:35:25.521287] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T19:35:25.594418] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T19:35:26.243273] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-19T19:35:27.043374] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-19T19:35:27.386630] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T19:35:27.717118] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T19:35:27.727348] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-19T19:35:27.727534] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-19T19:35:27.843366] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-19T19:35:27.877934] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T19:35:27.904835] [INFO ] [REMOTE ] JRS: Full fetch complete (15992 records). [2025-09-19T19:35:27.930883] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-19T19:35:28.386978] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-19T19:35:28.421521] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-19T19:35:28.434856] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-19T19:35:28.453098] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-19T19:35:28.521441] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54574 (keeping 200 days of data) [2025-09-19T19:35:28.557058] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-19T19:35:28.557215] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-19T19:35:28.560404] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-19T19:35:28.560473] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-19T19:35:28.561350] [DEBUG] [LOCAL ] JRS: Trimmed 15992 records to 11214 (keeping 200 days of data) [2025-09-19T19:35:28.648720] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-19T19:35:28.729178] [DEBUG] [LOCAL ] JRS: Primary data saved (11214 records). [2025-09-19T19:35:28.731539] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-19T19:35:28.731705] [INFO ] [MAIN ] Update Progress: 1171/2372 symbols completed. JRS took 19.9s. Estimated remaining: 2h 39m 23s. Rate: 7.5 symbols/min [2025-09-19T19:35:28.918625] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:29.056131] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:35:29.101401] [DEBUG] [LOCAL ] K: Loaded 50133 existing records from primary storage. [2025-09-19T19:35:29.102546] [INFO ] [MAIN ] K: Loaded 50133 existing records. [2025-09-19T19:35:29.323251] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:29.325730] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-19T19:35:29.327190] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-19T19:35:29.329409] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-19T19:35:29.329505] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-19T19:35:29.450191] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-19T19:35:29.818481] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:29.826685] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-09-19T19:35:29.826794] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-19T19:35:29.826895] [INFO ] [MAIN ] Update Progress: 1172/2372 symbols completed. JPM took 42.1s. Estimated remaining: 2h 39m 8s. Rate: 7.5 symbols/min [2025-09-19T19:35:29.993630] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:30.011284] [DEBUG] [LOCAL ] KAI: Loaded 13769 existing records from primary storage. [2025-09-19T19:35:30.011422] [INFO ] [MAIN ] KAI: Loaded 13769 existing records. [2025-09-19T19:35:30.196476] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:30.197120] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-19T19:35:30.197399] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-19T19:35:30.198187] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-19T19:35:30.198332] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-19T19:35:30.250721] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-19T19:35:30.319383] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T19:35:30.601271] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:30.610521] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T19:35:31.043306] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-19T19:35:31.843267] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-19T19:35:32.356585] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T19:35:32.594285] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T19:35:32.643228] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-19T19:35:33.443245] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-19T19:35:33.526442] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:35:34.125188] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T19:35:34.243253] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-19T19:35:34.353946] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T19:35:35.043265] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-19T19:35:35.843304] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-19T19:35:36.044137] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:35:36.643294] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-19T19:35:37.042099] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T19:35:37.224337] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T19:35:37.443274] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-19T19:35:38.243231] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-19T19:35:38.356185] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T19:35:39.043273] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-19T19:35:39.389283] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:35:39.449219] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T19:35:39.843266] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-19T19:35:40.643271] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-19T19:35:40.775903] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T19:35:41.149988] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T19:35:41.443284] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-19T19:35:41.884234] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:35:42.243286] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-19T19:35:43.043272] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-19T19:35:43.391677] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T19:35:43.843261] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-19T19:35:44.077409] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T19:35:44.322867] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T19:35:44.563372] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T19:35:44.567009] [INFO ] [REMOTE ] JRI: Full fetch complete (23146 records). [2025-09-19T19:35:44.567098] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-19T19:35:44.648360] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-19T19:35:44.944549] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-19T19:35:44.944685] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-19T19:35:44.945216] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-19T19:35:44.945269] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-19T19:35:44.946057] [DEBUG] [LOCAL ] JRI: Trimmed 23146 records to 15354 (keeping 200 days of data) [2025-09-19T19:35:45.046696] [DEBUG] [LOCAL ] JRI: Primary data saved (15354 records). [2025-09-19T19:35:45.046838] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-19T19:35:45.046929] [INFO ] [MAIN ] Update Progress: 1173/2372 symbols completed. JRI took 39.1s. Estimated remaining: 2h 39m 8s. Rate: 7.5 symbols/min [2025-09-19T19:35:45.213547] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:45.262739] [DEBUG] [LOCAL ] KAR: Loaded 40396 existing records from primary storage. [2025-09-19T19:35:45.262961] [INFO ] [MAIN ] KAR: Loaded 40396 existing records. [2025-09-19T19:35:45.449627] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:45.445947] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-19T19:35:45.450699] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-19T19:35:45.450770] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-19T19:35:45.451826] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-19T19:35:45.451886] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-19T19:35:45.811209] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:46.243267] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-19T19:35:46.577944] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T19:35:46.812938] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:35:47.043314] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-19T19:35:47.843282] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-19T19:35:47.988387] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:35:48.175080] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:35:48.643298] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-19T19:35:49.235372] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:35:49.443278] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-19T19:35:50.229788] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T19:35:50.244351] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-19T19:35:50.361796] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T19:35:51.043287] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-19T19:35:51.843296] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-19T19:35:52.178252] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T19:35:52.643245] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-19T19:35:52.882198] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:35:52.930411] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T19:35:53.443299] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-19T19:35:54.146428] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T19:35:54.153743] [INFO ] [REMOTE ] JXN: Full fetch complete (65303 records). [2025-09-19T19:35:54.153922] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-19T19:35:54.249981] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-19T19:35:54.540320] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-19T19:35:54.540426] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-19T19:35:54.541291] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-19T19:35:54.541353] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-19T19:35:54.542683] [DEBUG] [LOCAL ] JXN: Trimmed 65303 records to 46816 (keeping 200 days of data) [2025-09-19T19:35:54.765621] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T19:35:54.843978] [DEBUG] [LOCAL ] JXN: Primary data saved (46816 records). [2025-09-19T19:35:54.844123] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-19T19:35:54.844604] [INFO ] [MAIN ] Update Progress: 1174/2372 symbols completed. JXN took 32.9s. Estimated remaining: 2h 39m 2s. Rate: 7.5 symbols/min [2025-09-19T19:35:55.010622] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:55.034993] [DEBUG] [LOCAL ] KB: Loaded 24589 existing records from primary storage. [2025-09-19T19:35:55.035123] [INFO ] [MAIN ] KB: Loaded 24589 existing records. [2025-09-19T19:35:55.048388] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-19T19:35:55.214823] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:55.215076] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-19T19:35:55.215132] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-19T19:35:55.215819] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-19T19:35:55.215879] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-19T19:35:55.570581] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:55.843302] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-19T19:35:55.971863] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T19:35:56.110847] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T19:35:56.643279] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-19T19:35:57.443288] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-19T19:35:57.636171] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T19:35:57.643793] [INFO ] [REMOTE ] K: Full fetch complete (71809 records). [2025-09-19T19:35:57.643918] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-19T19:35:58.061610] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-19T19:35:58.061875] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-19T19:35:58.062961] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-19T19:35:58.063136] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-19T19:35:58.087992] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T19:35:58.096435] [DEBUG] [LOCAL ] K: Trimmed 71809 records to 50518 (keeping 200 days of data) [2025-09-19T19:35:58.278593] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-19T19:35:58.416338] [DEBUG] [LOCAL ] K: Primary data saved (50518 records). [2025-09-19T19:35:58.416497] [INFO ] [MAIN ] K: Full history saved. [2025-09-19T19:35:58.416588] [INFO ] [MAIN ] Update Progress: 1175/2372 symbols completed. K took 29.7s. Estimated remaining: 2h 38m 49s. Rate: 7.5 symbols/min [2025-09-19T19:35:58.586954] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:35:58.610306] [DEBUG] [LOCAL ] KBDC: Loaded 20772 existing records from primary storage. [2025-09-19T19:35:58.610474] [INFO ] [MAIN ] KBDC: Loaded 20772 existing records. [2025-09-19T19:35:58.799580] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:35:58.799955] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-19T19:35:58.800023] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-19T19:35:58.800709] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-19T19:35:58.800772] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-19T19:35:59.058954] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-19T19:35:59.164526] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:35:59.181060] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T19:35:59.843251] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-19T19:35:59.946128] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T19:36:00.238416] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T19:36:00.240732] [INFO ] [REMOTE ] KAI: Full fetch complete (18745 records). [2025-09-19T19:36:00.240805] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-19T19:36:00.603721] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-19T19:36:00.603806] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-19T19:36:00.604191] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-19T19:36:00.604234] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-19T19:36:00.604816] [DEBUG] [LOCAL ] KAI: Trimmed 18745 records to 13884 (keeping 200 days of data) [2025-09-19T19:36:00.648300] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-19T19:36:00.694165] [DEBUG] [LOCAL ] KAI: Primary data saved (13884 records). [2025-09-19T19:36:00.694272] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-19T19:36:00.694351] [INFO ] [MAIN ] Update Progress: 1176/2372 symbols completed. KAI took 30.9s. Estimated remaining: 2h 38m 36s. Rate: 7.5 symbols/min [2025-09-19T19:36:00.875638] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:00.931578] [DEBUG] [LOCAL ] KBH: Loaded 49212 existing records from primary storage. [2025-09-19T19:36:00.931813] [INFO ] [MAIN ] KBH: Loaded 49212 existing records. [2025-09-19T19:36:01.090522] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:36:01.140147] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:01.140450] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-19T19:36:01.140500] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-19T19:36:01.141858] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-19T19:36:01.141920] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-19T19:36:01.448453] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-19T19:36:01.511739] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:02.039202] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T19:36:02.243280] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-19T19:36:03.043294] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-19T19:36:03.843279] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-19T19:36:04.066635] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-19T19:36:04.643251] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-19T19:36:05.045428] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T19:36:05.181179] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T19:36:05.443283] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-19T19:36:05.711568] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (3.47 seconds). [2025-09-19T19:36:05.990400] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T19:36:06.243278] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-19T19:36:07.043229] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-19T19:36:07.137187] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:36:07.593854] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:36:07.845379] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-19T19:36:07.849776] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T19:36:08.643262] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-19T19:36:09.443281] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-19T19:36:09.667684] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:36:10.045568] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T19:36:10.243257] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-19T19:36:11.043297] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-19T19:36:11.294318] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T19:36:11.843280] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-19T19:36:11.889997] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T19:36:12.643268] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-19T19:36:12.791543] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:36:12.880427] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T19:36:13.443268] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-19T19:36:14.243296] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-19T19:36:14.355900] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:36:15.043308] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-19T19:36:15.364101] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:36:15.843284] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-19T19:36:16.643322] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-19T19:36:17.469433] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (3.23 seconds). [2025-09-19T19:36:17.477086] [INFO ] [REMOTE ] KAR: Full fetch complete (56605 records). [2025-09-19T19:36:17.487022] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-19T19:36:17.487963] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:36:17.524546] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-19T19:36:17.889697] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-19T19:36:17.889815] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-19T19:36:17.890754] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-19T19:36:17.890876] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-19T19:36:17.892530] [DEBUG] [LOCAL ] KAR: Trimmed 56605 records to 40650 (keeping 200 days of data) [2025-09-19T19:36:18.002377] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (2.96 seconds). [2025-09-19T19:36:18.168271] [DEBUG] [LOCAL ] KAR: Primary data saved (40650 records). [2025-09-19T19:36:18.168406] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-19T19:36:18.168490] [INFO ] [MAIN ] Update Progress: 1177/2372 symbols completed. KAR took 33.1s. Estimated remaining: 2h 38m 37s. Rate: 7.5 symbols/min [2025-09-19T19:36:18.247229] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-19T19:36:18.325400] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T19:36:18.379456] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:18.396405] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T19:36:18.448388] [DEBUG] [LOCAL ] KBR: Loaded 48678 existing records from primary storage. [2025-09-19T19:36:18.448565] [INFO ] [MAIN ] KBR: Loaded 48678 existing records. [2025-09-19T19:36:18.634379] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:18.634703] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-19T19:36:18.634761] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-19T19:36:18.636238] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-19T19:36:18.636300] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-19T19:36:19.001414] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:19.043222] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-19T19:36:19.843263] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-19T19:36:20.307519] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T19:36:20.497948] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T19:36:20.643229] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-19T19:36:21.120354] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T19:36:21.443260] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-19T19:36:22.243263] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-19T19:36:22.559200] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T19:36:23.052137] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-19T19:36:23.053288] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T19:36:23.059285] [INFO ] [REMOTE ] KBDC: Full fetch complete (27587 records). [2025-09-19T19:36:23.059378] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-19T19:36:23.433840] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-19T19:36:23.433918] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-19T19:36:23.434413] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-19T19:36:23.434452] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-19T19:36:23.435190] [DEBUG] [LOCAL ] KBDC: Trimmed 27587 records to 20999 (keeping 200 days of data) [2025-09-19T19:36:23.558911] [DEBUG] [LOCAL ] KBDC: Primary data saved (20999 records). [2025-09-19T19:36:23.559048] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-19T19:36:23.559188] [INFO ] [MAIN ] Update Progress: 1178/2372 symbols completed. KBDC took 25.1s. Estimated remaining: 2h 38m 27s. Rate: 7.5 symbols/min [2025-09-19T19:36:23.733950] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:23.785321] [DEBUG] [LOCAL ] KD: Loaded 52684 existing records from primary storage. [2025-09-19T19:36:23.785474] [INFO ] [MAIN ] KD: Loaded 52684 existing records. [2025-09-19T19:36:23.853070] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-19T19:36:23.972308] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:23.972836] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-19T19:36:23.972894] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-19T19:36:23.974500] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-19T19:36:23.974578] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-19T19:36:24.169604] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:36:24.435984] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:24.643219] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-19T19:36:24.988973] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T19:36:25.187557] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T19:36:25.443278] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-19T19:36:26.243262] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-19T19:36:27.043300] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-19T19:36:27.115818] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T19:36:27.119110] [INFO ] [REMOTE ] KB: Full fetch complete (34880 records). [2025-09-19T19:36:27.119231] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-19T19:36:27.525503] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-19T19:36:27.525670] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-19T19:36:27.526541] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-19T19:36:27.526707] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-19T19:36:27.527910] [DEBUG] [LOCAL ] KB: Trimmed 34880 records to 24706 (keeping 200 days of data) [2025-09-19T19:36:27.650796] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-09-19T19:36:27.729815] [DEBUG] [LOCAL ] KB: Primary data saved (24706 records). [2025-09-19T19:36:27.729981] [INFO ] [MAIN ] KB: Full history saved. [2025-09-19T19:36:27.730085] [INFO ] [MAIN ] Update Progress: 1179/2372 symbols completed. KB took 32.9s. Estimated remaining: 2h 38m 15s. Rate: 7.5 symbols/min [2025-09-19T19:36:27.848347] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-19T19:36:27.907588] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:27.914612] [DEBUG] [LOCAL ] KEN: Loaded 4756 existing records from primary storage. [2025-09-19T19:36:27.914781] [INFO ] [MAIN ] KEN: Loaded 4756 existing records. [2025-09-19T19:36:28.105513] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:28.105803] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-19T19:36:28.105891] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-19T19:36:28.106214] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-19T19:36:28.106274] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-19T19:36:28.485710] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:28.522957] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T19:36:28.643224] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-19T19:36:28.975262] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T19:36:29.443290] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-19T19:36:29.676064] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T19:36:29.874185] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T19:36:30.243306] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-19T19:36:31.043264] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-19T19:36:31.394217] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T19:36:31.695430] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T19:36:31.843270] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-19T19:36:32.423019] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T19:36:32.643266] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-19T19:36:32.985716] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-19T19:36:33.443287] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-19T19:36:34.011263] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T19:36:34.243230] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-19T19:36:34.267940] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T19:36:35.043280] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-19T19:36:35.843233] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-19T19:36:36.277072] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T19:36:36.310136] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T19:36:36.643276] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-19T19:36:37.099475] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T19:36:37.443269] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-19T19:36:37.892017] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:36:38.153262] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T19:36:38.243302] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-19T19:36:39.043279] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-19T19:36:39.843276] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-19T19:36:40.275741] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T19:36:40.643321] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-19T19:36:40.987349] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:36:41.016404] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T19:36:41.443326] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-19T19:36:42.244332] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-19T19:36:42.248947] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T19:36:42.661128] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T19:36:43.043281] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-19T19:36:43.843278] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-19T19:36:44.089270] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:36:44.096816] [INFO ] [REMOTE ] KBH: Full fetch complete (70406 records). [2025-09-19T19:36:44.096959] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-19T19:36:44.488492] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-19T19:36:44.488658] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-19T19:36:44.489584] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-19T19:36:44.489629] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-19T19:36:44.491145] [DEBUG] [LOCAL ] KBH: Trimmed 70406 records to 49581 (keeping 200 days of data) [2025-09-19T19:36:44.671044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-19T19:36:44.807903] [DEBUG] [LOCAL ] KBH: Primary data saved (49581 records). [2025-09-19T19:36:44.808044] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-19T19:36:44.808128] [INFO ] [MAIN ] Update Progress: 1180/2372 symbols completed. KBH took 44.1s. Estimated remaining: 2h 38m 16s. Rate: 7.5 symbols/min [2025-09-19T19:36:44.982605] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:45.023801] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T19:36:45.061504] [DEBUG] [LOCAL ] KEP: Loaded 30415 existing records from primary storage. [2025-09-19T19:36:45.061702] [INFO ] [MAIN ] KEP: Loaded 30415 existing records. [2025-09-19T19:36:45.247301] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:45.247615] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-19T19:36:45.247701] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-19T19:36:45.248796] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-19T19:36:45.248859] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-19T19:36:45.451225] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-19T19:36:45.518007] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T19:36:45.626318] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:45.670367] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T19:36:46.243277] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-19T19:36:47.043286] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-19T19:36:47.675685] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T19:36:47.774069] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T19:36:47.775216] [INFO ] [REMOTE ] KEN: Full fetch complete (5959 records). [2025-09-19T19:36:47.775285] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-19T19:36:47.849627] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-19T19:36:48.141964] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-19T19:36:48.142092] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-19T19:36:48.142268] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-19T19:36:48.147911] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-19T19:36:48.159234] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T19:36:48.159332] [DEBUG] [LOCAL ] KEN: Trimmed 5959 records to 4795 (keeping 200 days of data) [2025-09-19T19:36:48.195441] [DEBUG] [LOCAL ] KEN: Primary data saved (4795 records). [2025-09-19T19:36:48.195587] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-19T19:36:48.195702] [INFO ] [MAIN ] Update Progress: 1181/2372 symbols completed. KEN took 20.5s. Estimated remaining: 2h 38m 4s. Rate: 7.5 symbols/min [2025-09-19T19:36:48.373451] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:48.414413] [DEBUG] [LOCAL ] KEX: Loaded 38096 existing records from primary storage. [2025-09-19T19:36:48.414550] [INFO ] [MAIN ] KEX: Loaded 38096 existing records. [2025-09-19T19:36:48.590822] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:48.591128] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-19T19:36:48.591186] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-19T19:36:48.592303] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-19T19:36:48.592371] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-19T19:36:48.650550] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-19T19:36:48.957390] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:49.443303] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-19T19:36:50.248522] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-19T19:36:50.262672] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T19:36:50.719237] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T19:36:51.043282] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-19T19:36:51.442450] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T19:36:51.565676] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T19:36:51.843268] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-19T19:36:52.541125] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T19:36:52.643231] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-19T19:36:53.044576] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T19:36:53.443282] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-19T19:36:54.243291] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-19T19:36:54.497139] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T19:36:54.504163] [INFO ] [REMOTE ] KBR: Full fetch complete (69843 records). [2025-09-19T19:36:54.504285] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-19T19:36:54.829835] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T19:36:54.921172] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-19T19:36:54.921259] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-19T19:36:54.922168] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-19T19:36:54.922241] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-19T19:36:54.923792] [DEBUG] [LOCAL ] KBR: Trimmed 69843 records to 48981 (keeping 200 days of data) [2025-09-19T19:36:55.043330] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-19T19:36:55.225303] [DEBUG] [LOCAL ] KBR: Primary data saved (48981 records). [2025-09-19T19:36:55.225450] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-19T19:36:55.225537] [INFO ] [MAIN ] Update Progress: 1182/2372 symbols completed. KBR took 37.1s. Estimated remaining: 2h 37m 55s. Rate: 7.5 symbols/min [2025-09-19T19:36:55.394778] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:55.394968] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-19T19:36:55.395006] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-19T19:36:55.395146] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-19T19:36:55.395189] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-19T19:36:55.395245] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-19T19:36:55.395306] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-19T19:36:55.755213] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:55.817548] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T19:36:55.843225] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-19T19:36:56.643280] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-19T19:36:57.180882] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T19:36:57.188762] [INFO ] [REMOTE ] KD: Full fetch complete (75573 records). [2025-09-19T19:36:57.188911] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-19T19:36:57.449741] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-19T19:36:57.444507] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T19:36:57.620512] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-19T19:36:57.620594] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-19T19:36:57.621554] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-19T19:36:57.621618] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-19T19:36:57.623123] [DEBUG] [LOCAL ] KD: Trimmed 75573 records to 53065 (keeping 200 days of data) [2025-09-19T19:36:57.932137] [DEBUG] [LOCAL ] KD: Primary data saved (53065 records). [2025-09-19T19:36:57.932270] [INFO ] [MAIN ] KD: Full history saved. [2025-09-19T19:36:57.932353] [INFO ] [MAIN ] Update Progress: 1183/2372 symbols completed. KD took 34.4s. Estimated remaining: 2h 37m 41s. Rate: 7.5 symbols/min [2025-09-19T19:36:58.099229] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:36:58.142535] [DEBUG] [LOCAL ] KEYS: Loaded 43754 existing records from primary storage. [2025-09-19T19:36:58.142733] [INFO ] [MAIN ] KEYS: Loaded 43754 existing records. [2025-09-19T19:36:58.248336] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-19T19:36:58.321115] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:36:58.321331] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-19T19:36:58.321378] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-19T19:36:58.322694] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-19T19:36:58.322755] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-19T19:36:58.671764] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:36:58.768067] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T19:36:58.823595] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T19:36:59.043262] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-19T19:36:59.843276] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-19T19:37:00.014612] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T19:37:00.643276] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-19T19:37:00.826831] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T19:37:01.368256] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T19:37:01.443235] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-19T19:37:02.243266] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-19T19:37:02.436152] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:37:03.043263] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-19T19:37:03.125762] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T19:37:03.843275] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-19T19:37:04.260261] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T19:37:04.648433] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-19T19:37:04.650515] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T19:37:05.316768] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T19:37:05.443232] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-19T19:37:05.848326] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T19:37:06.243266] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-19T19:37:07.043252] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-19T19:37:07.239488] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:37:07.843257] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-19T19:37:08.146826] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T19:37:08.643268] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-19T19:37:08.735633] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T19:37:09.443271] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-19T19:37:09.758358] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:37:10.086420] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T19:37:10.243228] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-19T19:37:10.968815] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T19:37:11.043232] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-19T19:37:11.638447] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T19:37:11.843247] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-19T19:37:12.424547] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T19:37:12.428790] [INFO ] [REMOTE ] KEP: Full fetch complete (41568 records). [2025-09-19T19:37:12.428881] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-19T19:37:12.648458] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-19T19:37:12.806217] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-19T19:37:12.806296] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-19T19:37:12.806990] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-19T19:37:12.807051] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-19T19:37:12.807973] [DEBUG] [LOCAL ] KEP: Trimmed 41568 records to 30662 (keeping 200 days of data) [2025-09-19T19:37:12.980670] [DEBUG] [LOCAL ] KEP: Primary data saved (30662 records). [2025-09-19T19:37:12.980807] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-19T19:37:12.980893] [INFO ] [MAIN ] Update Progress: 1184/2372 symbols completed. KEP took 28.2s. Estimated remaining: 2h 37m 41s. Rate: 7.5 symbols/min [2025-09-19T19:37:13.155252] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:13.159520] [DEBUG] [LOCAL ] KF: Loaded 2515 existing records from primary storage. [2025-09-19T19:37:13.159609] [INFO ] [MAIN ] KF: Loaded 2515 existing records. [2025-09-19T19:37:13.337440] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:13.337794] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-19T19:37:13.337874] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-19T19:37:13.338166] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-19T19:37:13.338260] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-19T19:37:13.451627] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-19T19:37:13.709165] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:13.732016] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:37:14.243235] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-19T19:37:14.717922] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T19:37:15.043251] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-19T19:37:15.370728] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:37:15.493114] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:37:15.843281] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-19T19:37:16.643271] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-19T19:37:17.058028] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T19:37:17.065028] [INFO ] [REMOTE ] KEX: Full fetch complete (55278 records). [2025-09-19T19:37:17.065154] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-19T19:37:17.450236] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-19T19:37:17.449524] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-19T19:37:17.451586] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-19T19:37:17.452906] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-19T19:37:17.453308] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-19T19:37:17.455219] [DEBUG] [LOCAL ] KEX: Trimmed 55278 records to 38420 (keeping 200 days of data) [2025-09-19T19:37:17.640880] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:37:17.757442] [DEBUG] [LOCAL ] KEX: Primary data saved (38420 records). [2025-09-19T19:37:17.757595] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-19T19:37:17.758901] [INFO ] [MAIN ] Update Progress: 1185/2372 symbols completed. KEX took 29.6s. Estimated remaining: 2h 37m 29s. Rate: 7.5 symbols/min [2025-09-19T19:37:17.928024] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:17.948580] [DEBUG] [LOCAL ] KFRC: Loaded 19331 existing records from primary storage. [2025-09-19T19:37:17.948737] [INFO ] [MAIN ] KFRC: Loaded 19331 existing records. [2025-09-19T19:37:18.116613] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T19:37:18.139376] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:18.139732] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-19T19:37:18.141231] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-19T19:37:18.141888] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-19T19:37:18.141961] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-19T19:37:18.248080] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-19T19:37:18.511181] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:18.800087] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T19:37:19.043294] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-19T19:37:19.843341] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-19T19:37:19.948043] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T19:37:20.385988] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T19:37:20.643275] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-19T19:37:21.201968] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T19:37:21.443331] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-19T19:37:21.857448] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-19T19:37:21.889196] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:37:22.243309] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-19T19:37:23.043301] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-19T19:37:23.843300] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-19T19:37:24.191038] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T19:37:24.523511] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T19:37:24.643262] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-19T19:37:24.953342] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:37:24.960280] [INFO ] [REMOTE ] KEYS: Full fetch complete (63003 records). [2025-09-19T19:37:24.960455] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-19T19:37:25.348962] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-19T19:37:25.349121] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-19T19:37:25.350024] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-19T19:37:25.350091] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-19T19:37:25.351445] [DEBUG] [LOCAL ] KEYS: Trimmed 63003 records to 44107 (keeping 200 days of data) [2025-09-19T19:37:25.443284] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-19T19:37:25.633934] [DEBUG] [LOCAL ] KEYS: Primary data saved (44107 records). [2025-09-19T19:37:25.634131] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-19T19:37:25.634285] [INFO ] [MAIN ] Update Progress: 1186/2372 symbols completed. KEYS took 27.7s. Estimated remaining: 2h 37m 21s. Rate: 7.5 symbols/min [2025-09-19T19:37:25.807977] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:25.817827] [DEBUG] [LOCAL ] KFS: Loaded 8191 existing records from primary storage. [2025-09-19T19:37:25.817930] [INFO ] [MAIN ] KFS: Loaded 8191 existing records. [2025-09-19T19:37:26.001485] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:26.001791] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-19T19:37:26.001845] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-19T19:37:26.002213] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-19T19:37:26.002284] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-19T19:37:26.197198] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T19:37:26.243233] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-19T19:37:26.401451] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:27.013548] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T19:37:27.043281] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-19T19:37:27.551951] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T19:37:27.559068] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-19T19:37:27.843286] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-19T19:37:28.643268] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-19T19:37:28.806997] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T19:37:29.254537] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T19:37:29.443303] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-19T19:37:29.967624] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T19:37:30.243273] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-19T19:37:31.043309] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-19T19:37:31.843251] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-19T19:37:32.236001] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T19:37:32.335040] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:37:32.498001] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T19:37:32.643265] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-19T19:37:33.443275] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-19T19:37:33.744173] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T19:37:34.169501] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T19:37:34.243247] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-19T19:37:35.043298] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-19T19:37:35.843357] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-19T19:37:36.189830] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T19:37:36.197150] [INFO ] [REMOTE ] KEY: Full fetch complete (77253 records). [2025-09-19T19:37:36.197319] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-19T19:37:36.399376] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T19:37:36.400262] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:37:36.411800] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:37:36.412893] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:37:36.412497] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-19T19:37:36.413052] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-19T19:37:36.417157] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-19T19:37:36.417931] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-19T19:37:36.418062] [INFO ] [MAIN ] Update Progress: 1187/2372 symbols completed. KEY took 41.2s. Estimated remaining: 2h 37m 16s. Rate: 7.5 symbols/min [2025-09-19T19:37:36.584628] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:36.589095] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T19:37:36.625626] [DEBUG] [LOCAL ] KFY: Loaded 31051 existing records from primary storage. [2025-09-19T19:37:36.625815] [INFO ] [MAIN ] KFY: Loaded 31051 existing records. [2025-09-19T19:37:36.648434] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-19T19:37:36.806798] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:36.807015] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-19T19:37:36.807071] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-19T19:37:36.808043] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-19T19:37:36.808106] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-19T19:37:37.167795] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:37.162581] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-19T19:37:37.169080] [INFO ] [REMOTE ] KF: Full fetch complete (3911 records). [2025-09-19T19:37:37.169152] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-19T19:37:37.444535] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-19T19:37:37.523341] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-19T19:37:37.523439] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-19T19:37:37.523595] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-19T19:37:37.523636] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-19T19:37:37.524125] [DEBUG] [LOCAL ] KF: Trimmed 3911 records to 2520 (keeping 200 days of data) [2025-09-19T19:37:37.541842] [DEBUG] [LOCAL ] KF: Primary data saved (2520 records). [2025-09-19T19:37:37.541907] [INFO ] [MAIN ] KF: Full history saved. [2025-09-19T19:37:37.542002] [INFO ] [MAIN ] Update Progress: 1188/2372 symbols completed. KF took 24.6s. Estimated remaining: 2h 37m 1s. Rate: 7.5 symbols/min [2025-09-19T19:37:37.707409] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:37.786396] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-09-19T19:37:37.786576] [INFO ] [MAIN ] KGC: Loaded 54089 existing records. [2025-09-19T19:37:37.961303] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:37.961588] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-19T19:37:37.961638] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-19T19:37:37.963337] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-19T19:37:37.963400] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-19T19:37:38.248397] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-19T19:37:38.323950] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:38.657827] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:37:39.043267] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-19T19:37:39.488136] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T19:37:39.779740] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T19:37:39.843258] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-19T19:37:40.413882] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T19:37:40.643249] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-19T19:37:41.443276] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-19T19:37:41.564531] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T19:37:42.243234] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-19T19:37:42.795123] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T19:37:43.043254] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-19T19:37:43.332680] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T19:37:43.843283] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-19T19:37:44.002957] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T19:37:44.643246] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-19T19:37:44.754048] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T19:37:45.443266] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-19T19:37:46.243269] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-19T19:37:46.732833] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T19:37:46.980887] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T19:37:47.043253] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-19T19:37:47.609422] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T19:37:47.843265] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-19T19:37:48.643295] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-19T19:37:49.010312] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T19:37:49.028326] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T19:37:49.443286] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-19T19:37:50.196894] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T19:37:50.243225] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-19T19:37:51.043290] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-19T19:37:51.112081] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T19:37:51.843257] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-19T19:37:51.849225] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T19:37:51.963675] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T19:37:52.643260] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-19T19:37:53.429424] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:37:53.433369] [INFO ] [REMOTE ] KFRC: Full fetch complete (25086 records). [2025-09-19T19:37:53.433456] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-19T19:37:53.448358] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-19T19:37:53.803189] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-19T19:37:53.803331] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-19T19:37:53.803900] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-19T19:37:53.803962] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-19T19:37:53.804634] [DEBUG] [LOCAL ] KFRC: Trimmed 25086 records to 19497 (keeping 200 days of data) [2025-09-19T19:37:53.941731] [DEBUG] [LOCAL ] KFRC: Primary data saved (19497 records). [2025-09-19T19:37:53.941868] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-19T19:37:53.941975] [INFO ] [MAIN ] Update Progress: 1189/2372 symbols completed. KFRC took 36.2s. Estimated remaining: 2h 37m 2s. Rate: 7.5 symbols/min [2025-09-19T19:37:54.113048] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:54.151089] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T19:37:54.185412] [DEBUG] [LOCAL ] KGS: Loaded 46132 existing records from primary storage. [2025-09-19T19:37:54.185573] [INFO ] [MAIN ] KGS: Loaded 46132 existing records. [2025-09-19T19:37:54.249546] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-19T19:37:54.380570] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:54.381182] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-19T19:37:54.381243] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-19T19:37:54.382395] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-19T19:37:54.382460] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-19T19:37:54.744069] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:55.043232] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-19T19:37:55.396700] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T19:37:55.396892] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T19:37:55.411808] [INFO ] [REMOTE ] KFS: Full fetch complete (10364 records). [2025-09-19T19:37:55.411976] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-19T19:37:55.780673] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-19T19:37:55.780763] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-19T19:37:55.781009] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-19T19:37:55.781046] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-19T19:37:55.781488] [DEBUG] [LOCAL ] KFS: Trimmed 10364 records to 8270 (keeping 200 days of data) [2025-09-19T19:37:55.832616] [DEBUG] [LOCAL ] KFS: Primary data saved (8270 records). [2025-09-19T19:37:55.832785] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-19T19:37:55.832944] [INFO ] [MAIN ] Update Progress: 1190/2372 symbols completed. KFS took 30.2s. Estimated remaining: 2h 36m 48s. Rate: 7.5 symbols/min [2025-09-19T19:37:55.848408] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-19T19:37:56.022476] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:37:56.096500] [DEBUG] [LOCAL ] KIM: Loaded 53461 existing records from primary storage. [2025-09-19T19:37:56.096707] [INFO ] [MAIN ] KIM: Loaded 53461 existing records. [2025-09-19T19:37:56.282999] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:37:56.283266] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-19T19:37:56.283317] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-19T19:37:56.284688] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-19T19:37:56.284752] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-19T19:37:56.654153] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-19T19:37:56.676153] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:37:56.886788] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T19:37:57.443298] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-19T19:37:58.243254] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-19T19:37:58.295498] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T19:37:58.328126] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T19:37:59.043238] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-19T19:37:59.153144] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T19:37:59.843263] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-19T19:38:00.266565] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T19:38:00.643233] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-19T19:38:01.311436] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T19:38:01.443282] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-19T19:38:01.597199] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T19:38:02.243300] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-19T19:38:02.407736] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:38:03.043235] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-19T19:38:03.499076] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T19:38:03.560046] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:38:03.843269] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-19T19:38:04.594608] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T19:38:04.643224] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-19T19:38:05.443269] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-19T19:38:05.700089] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:38:06.243277] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-19T19:38:06.484259] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:38:07.043252] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-19T19:38:07.663328] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T19:38:07.688737] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T19:38:07.693860] [INFO ] [REMOTE ] KFY: Full fetch complete (43862 records). [2025-09-19T19:38:07.693957] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-19T19:38:07.845019] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-19T19:38:08.071850] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-19T19:38:08.071932] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-19T19:38:08.072674] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-19T19:38:08.072736] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-19T19:38:08.073668] [DEBUG] [LOCAL ] KFY: Trimmed 43862 records to 31278 (keeping 200 days of data) [2025-09-19T19:38:08.275048] [DEBUG] [LOCAL ] KFY: Primary data saved (31278 records). [2025-09-19T19:38:08.275225] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-19T19:38:08.275349] [INFO ] [MAIN ] Update Progress: 1191/2372 symbols completed. KFY took 31.9s. Estimated remaining: 2h 36m 44s. Rate: 7.5 symbols/min [2025-09-19T19:38:08.443617] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:08.465975] [DEBUG] [LOCAL ] KIO: Loaded 21562 existing records from primary storage. [2025-09-19T19:38:08.466107] [INFO ] [MAIN ] KIO: Loaded 21562 existing records. [2025-09-19T19:38:08.641808] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:38:08.642097] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-19T19:38:08.642148] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-19T19:38:08.642975] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-19T19:38:08.643049] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-19T19:38:08.674219] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-19T19:38:09.040004] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:09.066040] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T19:38:09.443224] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-19T19:38:10.199794] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-19T19:38:10.243224] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-19T19:38:10.837931] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T19:38:11.043257] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-19T19:38:11.132581] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:38:11.843244] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-19T19:38:11.996192] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T19:38:12.084096] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:38:12.643279] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-19T19:38:13.443366] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-19T19:38:13.574003] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T19:38:13.610447] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:38:14.243327] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-19T19:38:15.043358] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-19T19:38:15.268282] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T19:38:15.577594] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T19:38:15.843334] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-19T19:38:16.643290] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-19T19:38:16.951929] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T19:38:17.443274] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-19T19:38:17.838174] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:38:18.136974] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:38:18.243251] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-19T19:38:19.043279] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-19T19:38:19.498217] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T19:38:19.535210] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T19:38:19.547149] [INFO ] [REMOTE ] KGC: Full fetch complete (77689 records). [2025-09-19T19:38:19.547333] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-19T19:38:19.848475] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-19T19:38:19.966741] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-19T19:38:19.966850] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-19T19:38:19.967951] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-19T19:38:19.968042] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-19T19:38:19.969827] [DEBUG] [LOCAL ] KGC: Trimmed 77689 records to 54479 (keeping 200 days of data) [2025-09-19T19:38:20.323626] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-09-19T19:38:20.323789] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-19T19:38:20.323876] [INFO ] [MAIN ] Update Progress: 1192/2372 symbols completed. KGC took 42.8s. Estimated remaining: 2h 36m 40s. Rate: 7.5 symbols/min [2025-09-19T19:38:20.507371] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:20.563534] [DEBUG] [LOCAL ] KKR: Loaded 53901 existing records from primary storage. [2025-09-19T19:38:20.563709] [INFO ] [MAIN ] KKR: Loaded 53901 existing records. [2025-09-19T19:38:20.648474] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-19T19:38:20.757628] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:38:20.757900] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-19T19:38:20.757970] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-19T19:38:20.759227] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-19T19:38:20.759288] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-19T19:38:21.140210] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:21.175113] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T19:38:21.182433] [INFO ] [REMOTE ] KGS: Full fetch complete (65780 records). [2025-09-19T19:38:21.182559] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-19T19:38:21.451561] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-19T19:38:21.576069] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-19T19:38:21.576155] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-19T19:38:21.577048] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-19T19:38:21.577111] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-19T19:38:21.578405] [DEBUG] [LOCAL ] KGS: Trimmed 65780 records to 46501 (keeping 200 days of data) [2025-09-19T19:38:21.854522] [DEBUG] [LOCAL ] KGS: Primary data saved (46501 records). [2025-09-19T19:38:21.854675] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-19T19:38:21.855299] [INFO ] [MAIN ] Update Progress: 1193/2372 symbols completed. KGS took 27.9s. Estimated remaining: 2h 36m 26s. Rate: 7.5 symbols/min [2025-09-19T19:38:22.058841] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T19:38:22.058219] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:22.073328] [DEBUG] [LOCAL ] KKRS: Loaded 5768 existing records from primary storage. [2025-09-19T19:38:22.073452] [INFO ] [MAIN ] KKRS: Loaded 5768 existing records. [2025-09-19T19:38:22.271847] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-19T19:38:22.277956] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:38:22.291039] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-19T19:38:22.291127] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-19T19:38:22.293176] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-19T19:38:22.291821] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-19T19:38:22.303612] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-19T19:38:22.692480] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:23.043308] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-19T19:38:23.133775] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T19:38:23.393488] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T19:38:23.843319] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-19T19:38:24.643318] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-19T19:38:24.998851] [DEBUG] [REMOTE ] KKR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T19:38:24.999338] [WARN ] [REMOTE ] KKR: No data returned for month 2025-01 [2025-09-19T19:38:25.038193] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T19:38:25.043452] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T19:38:25.443278] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-19T19:38:26.243256] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-19T19:38:26.742494] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T19:38:26.926293] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T19:38:27.043298] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-19T19:38:27.843348] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-19T19:38:28.454204] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T19:38:28.643362] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-19T19:38:29.035631] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T19:38:29.443294] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-19T19:38:29.924123] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T19:38:30.243299] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-19T19:38:31.043286] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-19T19:38:31.432876] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T19:38:31.843305] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-19T19:38:31.897724] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:38:32.390931] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T19:38:32.394281] [INFO ] [REMOTE ] KIO: Full fetch complete (30987 records). [2025-09-19T19:38:32.394456] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-19T19:38:32.658690] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-19T19:38:32.634064] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T19:38:32.788392] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-19T19:38:32.788485] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-19T19:38:32.789118] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-19T19:38:32.789181] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-19T19:38:32.790074] [DEBUG] [LOCAL ] KIO: Trimmed 30987 records to 21731 (keeping 200 days of data) [2025-09-19T19:38:32.929283] [DEBUG] [LOCAL ] KIO: Primary data saved (21731 records). [2025-09-19T19:38:32.929420] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-19T19:38:32.929518] [INFO ] [MAIN ] Update Progress: 1194/2372 symbols completed. KIO took 24.7s. Estimated remaining: 2h 36m 21s. Rate: 7.5 symbols/min [2025-09-19T19:38:33.108351] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:33.108606] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-19T19:38:33.108684] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-19T19:38:33.108854] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-19T19:38:33.108916] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-19T19:38:33.108983] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-19T19:38:33.109038] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-19T19:38:33.457280] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-19T19:38:33.466148] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:34.243286] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-19T19:38:34.702759] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T19:38:34.710506] [INFO ] [REMOTE ] KIM: Full fetch complete (76821 records). [2025-09-19T19:38:34.710687] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-19T19:38:35.045967] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-19T19:38:35.101432] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-19T19:38:35.101514] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-19T19:38:35.102498] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-19T19:38:35.102590] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-19T19:38:35.104136] [DEBUG] [LOCAL ] KIM: Trimmed 76821 records to 53850 (keeping 200 days of data) [2025-09-19T19:38:35.326595] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:35.327626] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-19T19:38:35.433342] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T19:38:35.457485] [DEBUG] [LOCAL ] KIM: Primary data saved (53850 records). [2025-09-19T19:38:35.457607] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-19T19:38:35.457746] [INFO ] [MAIN ] Update Progress: 1195/2372 symbols completed. KIM took 39.6s. Estimated remaining: 2h 36m 8s. Rate: 7.5 symbols/min [2025-09-19T19:38:35.626891] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:35.627212] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-19T19:38:35.627300] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-19T19:38:35.627666] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-19T19:38:35.627763] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-19T19:38:35.627840] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-19T19:38:35.627903] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-19T19:38:35.849183] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-19T19:38:35.999436] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:36.033017] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-19T19:38:36.643278] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-19T19:38:36.802383] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:38:37.443283] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-19T19:38:38.244552] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-19T19:38:38.247237] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T19:38:38.790712] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:38.791124] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-19T19:38:38.824609] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T19:38:39.043276] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-19T19:38:39.800738] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T19:38:39.843319] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-19T19:38:40.066622] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:40.067020] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-19T19:38:40.643313] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-19T19:38:41.443264] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-19T19:38:41.675189] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:41.675506] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-19T19:38:42.243282] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-19T19:38:42.484820] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:42.485152] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-19T19:38:42.727483] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T19:38:43.043271] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-19T19:38:43.263756] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:43.264173] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-19T19:38:43.843289] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-19T19:38:44.607474] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T19:38:44.643288] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-19T19:38:45.443266] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-19T19:38:46.110727] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T19:38:46.111937] [INFO ] [REMOTE ] KKRS: Full fetch complete (8041 records). [2025-09-19T19:38:46.112008] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-19T19:38:46.250700] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-19T19:38:46.473194] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-19T19:38:46.473273] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-19T19:38:46.473489] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-19T19:38:46.473526] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-19T19:38:46.473959] [DEBUG] [LOCAL ] KKRS: Trimmed 8041 records to 5784 (keeping 200 days of data) [2025-09-19T19:38:46.509468] [DEBUG] [LOCAL ] KKRS: Primary data saved (5784 records). [2025-09-19T19:38:46.509598] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-19T19:38:46.509709] [INFO ] [MAIN ] Update Progress: 1196/2372 symbols completed. KKRS took 24.7s. Estimated remaining: 2h 36m 3s. Rate: 7.5 symbols/min [2025-09-19T19:38:46.687930] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:38:46.726076] [DEBUG] [LOCAL ] KLC: Loaded 36441 existing records from primary storage. [2025-09-19T19:38:46.726216] [INFO ] [MAIN ] KLC: Loaded 36441 existing records. [2025-09-19T19:38:46.830993] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T19:38:46.916333] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:38:46.916866] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-19T19:38:46.917002] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-19T19:38:46.917936] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-19T19:38:46.918000] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-19T19:38:47.045960] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-19T19:38:47.259856] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T19:38:47.346180] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:38:47.342949] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:47.346719] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-19T19:38:47.843256] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-19T19:38:48.318035] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:48.318361] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-19T19:38:48.643262] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-19T19:38:48.884469] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:48.884848] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-19T19:38:49.443303] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-19T19:38:50.243253] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-19T19:38:50.772066] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T19:38:51.043279] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-19T19:38:51.273835] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:51.274172] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-19T19:38:51.843219] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-19T19:38:51.888344] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T19:38:52.643353] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-19T19:38:53.443325] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-19T19:38:53.672539] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:53.672942] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-19T19:38:53.972987] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:38:54.005249] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T19:38:54.243306] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-19T19:38:55.043321] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-19T19:38:55.148945] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T19:38:55.268272] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:55.268798] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-19T19:38:55.843284] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-19T19:38:56.061852] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:56.062200] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-19T19:38:56.643310] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-19T19:38:56.875632] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:38:56.875893] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-19T19:38:57.443286] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-19T19:38:58.243339] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-19T19:38:58.504157] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T19:38:58.506102] [INFO ] [REMOTE ] KKRT: Full fetch complete (8236 records). [2025-09-19T19:38:58.506175] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-19T19:38:58.698319] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 78 unique days, need 200 days [2025-09-19T19:38:58.698576] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:38:58.698671] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:38:58.698733] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-19T19:38:58.698806] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-19T19:38:58.698863] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-19T19:38:58.698921] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-19T19:38:58.699032] [INFO ] [MAIN ] Update Progress: 1197/2372 symbols completed. KKRT took 25.8s. Estimated remaining: 2h 35m 59s. Rate: 7.5 symbols/min [2025-09-19T19:38:59.043281] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-19T19:38:59.669801] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:38:59.843307] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-19T19:39:00.614508] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T19:39:00.618887] [INFO ] [REMOTE ] KLAR: Full fetch complete (2901 records). [2025-09-19T19:39:00.619014] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-19T19:39:00.651728] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-19T19:39:00.806471] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 8 unique days, need 200 days [2025-09-19T19:39:00.806777] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:39:00.807118] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:39:00.807201] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-19T19:39:00.807388] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-19T19:39:00.807491] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-19T19:39:00.821624] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-19T19:39:00.821822] [INFO ] [MAIN ] Update Progress: 1198/2372 symbols completed. KLAR took 25.4s. Estimated remaining: 2h 35m 46s. Rate: 7.5 symbols/min [2025-09-19T19:39:00.823145] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T19:39:01.443320] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-19T19:39:03.212056] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-19T19:39:03.219728] [INFO ] [REMOTE ] KKR: Full fetch complete (69671 records). [2025-09-19T19:39:03.219843] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-19T19:39:03.411213] [WARN ] [VALIDATOR ] KKR: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T19:39:03.411934] [FATAL] [MAIN ] KKR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:39:03.412007] [WARN ] [MAIN ] KKR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:39:03.412077] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-19T19:39:03.412141] [DEBUG] [LOCAL ] KKR: No primary data file found to delete. [2025-09-19T19:39:03.412175] [INFO ] [LOCAL ] KKR: Starting deletion of derivative data. [2025-09-19T19:39:03.412674] [DEBUG] [LOCAL ] KKR: Deleted derivative data file. [2025-09-19T19:39:03.412795] [INFO ] [MAIN ] Update Progress: 1199/2372 symbols completed. KKR took 43.1s. Estimated remaining: 2h 35m 32s. Rate: 7.5 symbols/min [2025-09-19T19:39:04.398353] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-09-19T19:39:04.406130] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-19T19:39:06.035090] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T19:39:06.043487] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-19T19:39:07.581076] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:39:07.589051] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-19T19:39:09.102604] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T19:39:09.109951] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-19T19:39:10.621249] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T19:39:10.628851] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-19T19:39:11.887513] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T19:39:11.896097] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-19T19:39:13.557223] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T19:39:13.563666] [INFO ] [REMOTE ] KLC: Full fetch complete (50807 records). [2025-09-19T19:39:13.563785] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-19T19:39:13.959169] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-19T19:39:13.959277] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-19T19:39:13.960069] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-19T19:39:13.960131] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-19T19:39:13.961258] [DEBUG] [LOCAL ] KLC: Trimmed 50807 records to 36718 (keeping 200 days of data) [2025-09-19T19:39:14.165202] [DEBUG] [LOCAL ] KLC: Primary data saved (36718 records). [2025-09-19T19:39:14.165340] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-19T19:39:14.165437] [INFO ] [MAIN ] Update Progress: 1200/2372 symbols completed. KLC took 27.7s. Estimated remaining: 2h 35m 27s. Rate: 7.5 symbols/min [2025-09-19T19:39:14.791254] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:14.775343] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:14.828671] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:14.843261] [DEBUG] [LOCAL ] KMPB: Loaded 3640 existing records from primary storage. [2025-09-19T19:39:14.873336] [INFO ] [MAIN ] KMPB: Loaded 3640 existing records. [2025-09-19T19:39:14.974736] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:15.152193] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:15.148348] [DEBUG] [LOCAL ] KMPR: Loaded 38088 existing records from primary storage. [2025-09-19T19:39:15.152713] [INFO ] [MAIN ] KMPR: Loaded 38088 existing records. [2025-09-19T19:39:15.158796] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-19T19:39:15.184744] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-19T19:39:15.244316] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-19T19:39:15.256307] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-19T19:39:15.269324] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-09-19T19:39:15.326695] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-09-19T19:39:15.357757] [DEBUG] [LOCAL ] KLG: Loaded 42255 existing records from primary storage. [2025-09-19T19:39:15.375472] [INFO ] [MAIN ] KLG: Loaded 42255 existing records. [2025-09-19T19:39:15.718637] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:15.756954] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-19T19:39:15.777639] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-19T19:39:15.925696] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-19T19:39:15.941817] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-19T19:39:16.030361] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:16.065683] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-19T19:39:16.020615] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:16.088514] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-19T19:39:16.122560] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-19T19:39:16.122734] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-19T19:39:16.154570] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-19T19:39:16.174368] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-19T19:39:16.174929] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-19T19:39:16.174516] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-19T19:39:16.484162] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:16.548406] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-19T19:39:17.100724] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:17.128626] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-19T19:39:17.291082] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:17.301802] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-19T19:39:17.367964] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:17.368388] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-19T19:39:17.461121] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T19:39:17.463405] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-19T19:39:17.771237] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-19T19:39:17.772473] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-19T19:39:18.297623] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T19:39:18.299049] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-19T19:39:18.718688] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T19:39:18.724618] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-19T19:39:18.966323] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T19:39:18.968006] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-19T19:39:19.007529] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T19:39:19.016908] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-19T19:39:19.136105] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T19:39:19.147497] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-19T19:39:19.311963] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-19T19:39:19.313445] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-19T19:39:19.861768] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T19:39:19.863256] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-19T19:39:20.233366] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T19:39:20.239105] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-19T19:39:20.548291] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-19T19:39:20.550080] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-19T19:39:20.814435] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T19:39:20.823992] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-19T19:39:21.086068] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T19:39:21.097586] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-19T19:39:21.188056] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T19:39:21.189510] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-19T19:39:21.516481] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T19:39:21.523283] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-19T19:39:21.920704] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T19:39:22.243294] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-19T19:39:22.488292] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:39:22.676468] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T19:39:22.878705] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T19:39:22.942272] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T19:39:22.943327] [INFO ] [REMOTE ] KMPB: Full fetch complete (4840 records). [2025-09-19T19:39:22.943427] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-19T19:39:23.046482] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-19T19:39:23.306203] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-19T19:39:23.306282] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-19T19:39:23.306430] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-19T19:39:23.306468] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-19T19:39:23.306868] [DEBUG] [LOCAL ] KMPB: Trimmed 4840 records to 3656 (keeping 200 days of data) [2025-09-19T19:39:23.328987] [DEBUG] [LOCAL ] KMPB: Primary data saved (3656 records). [2025-09-19T19:39:23.329066] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-19T19:39:23.329149] [INFO ] [MAIN ] Update Progress: 1201/2372 symbols completed. KMPB took 9.1s. Estimated remaining: 2h 35m 20s. Rate: 7.5 symbols/min [2025-09-19T19:39:23.496439] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:23.541711] [DEBUG] [LOCAL ] KMT: Loaded 43538 existing records from primary storage. [2025-09-19T19:39:23.541895] [INFO ] [MAIN ] KMT: Loaded 43538 existing records. [2025-09-19T19:39:23.723102] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:23.723606] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-19T19:39:23.723720] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-19T19:39:23.726262] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-19T19:39:23.726331] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-19T19:39:23.848540] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-19T19:39:24.093622] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:24.643289] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-19T19:39:24.926060] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T19:39:25.443232] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-19T19:39:25.896636] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:39:26.198334] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-19T19:39:26.243230] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-19T19:39:27.043319] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-19T19:39:27.843304] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-19T19:39:28.108995] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T19:39:28.643300] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-19T19:39:28.720981] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T19:39:28.874848] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:39:29.443280] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-19T19:39:29.540103] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T19:39:30.243298] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-19T19:39:30.369225] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T19:39:31.043302] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-19T19:39:31.298689] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T19:39:31.843296] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-19T19:39:32.462781] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T19:39:32.608332] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T19:39:32.643225] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-19T19:39:33.443286] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-19T19:39:33.655875] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T19:39:34.243267] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-19T19:39:34.398868] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T19:39:35.043241] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-19T19:39:35.422115] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T19:39:35.703919] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T19:39:35.843271] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-19T19:39:36.226705] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T19:39:36.643264] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-19T19:39:37.443264] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-19T19:39:37.635218] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:39:38.243275] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-19T19:39:38.427541] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:39:38.809256] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T19:39:39.043331] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-19T19:39:39.843278] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-19T19:39:40.383281] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T19:39:40.643296] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-19T19:39:41.443234] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-19T19:39:41.534138] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:39:41.657498] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-19T19:39:41.998451] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T19:39:42.005088] [INFO ] [REMOTE ] KMPR: Full fetch complete (50106 records). [2025-09-19T19:39:42.005185] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-19T19:39:42.253224] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-19T19:39:42.392105] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-19T19:39:42.392224] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-19T19:39:42.393173] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-19T19:39:42.393253] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-19T19:39:42.394555] [DEBUG] [LOCAL ] KMPR: Trimmed 50106 records to 38460 (keeping 200 days of data) [2025-09-19T19:39:42.665255] [DEBUG] [LOCAL ] KMPR: Primary data saved (38460 records). [2025-09-19T19:39:42.665456] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-19T19:39:42.665629] [INFO ] [MAIN ] Update Progress: 1202/2372 symbols completed. KMPR took 28.5s. Estimated remaining: 2h 35m 23s. Rate: 7.5 symbols/min [2025-09-19T19:39:42.839260] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:42.898528] [DEBUG] [LOCAL ] KMX: Loaded 53480 existing records from primary storage. [2025-09-19T19:39:42.898731] [INFO ] [MAIN ] KMX: Loaded 53480 existing records. [2025-09-19T19:39:43.048421] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-19T19:39:43.079244] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:43.079605] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-19T19:39:43.079713] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-19T19:39:43.089941] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-19T19:39:43.096352] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-19T19:39:43.183207] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T19:39:43.495493] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:43.529271] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T19:39:43.843264] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-19T19:39:44.643306] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-19T19:39:45.310804] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T19:39:45.443266] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-19T19:39:45.834511] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T19:39:46.243269] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-19T19:39:46.269226] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T19:39:46.276403] [INFO ] [REMOTE ] KLG: Full fetch complete (61873 records). [2025-09-19T19:39:46.276568] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-19T19:39:46.663443] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-19T19:39:46.663532] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-19T19:39:46.664494] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-19T19:39:46.664560] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-19T19:39:46.666114] [DEBUG] [LOCAL ] KLG: Trimmed 61873 records to 42547 (keeping 200 days of data) [2025-09-19T19:39:46.952668] [DEBUG] [LOCAL ] KLG: Primary data saved (42547 records). [2025-09-19T19:39:46.952929] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-19T19:39:46.953138] [INFO ] [MAIN ] Update Progress: 1203/2372 symbols completed. KLG took 32.8s. Estimated remaining: 2h 35m 12s. Rate: 7.5 symbols/min [2025-09-19T19:39:47.051967] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-19T19:39:47.135750] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:47.177224] [DEBUG] [LOCAL ] KN: Loaded 39405 existing records from primary storage. [2025-09-19T19:39:47.177362] [INFO ] [MAIN ] KN: Loaded 39405 existing records. [2025-09-19T19:39:47.353243] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:47.353522] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-19T19:39:47.353573] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-19T19:39:47.354698] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-19T19:39:47.354800] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-19T19:39:47.751940] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:47.779623] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T19:39:47.789768] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-19T19:39:47.789927] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-19T19:39:47.855028] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-19T19:39:48.209413] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-19T19:39:48.209520] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-19T19:39:48.210564] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-19T19:39:48.210787] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-19T19:39:48.214820] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54473 (keeping 200 days of data) [2025-09-19T19:39:48.323867] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T19:39:48.607780] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-09-19T19:39:48.607967] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-19T19:39:48.608136] [INFO ] [MAIN ] Update Progress: 1204/2372 symbols completed. KMI took 34.4s. Estimated remaining: 2h 34m 58s. Rate: 7.5 symbols/min [2025-09-19T19:39:48.651769] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-19T19:39:48.782697] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:48.825003] [DEBUG] [LOCAL ] KNF: Loaded 36005 existing records from primary storage. [2025-09-19T19:39:48.825173] [INFO ] [MAIN ] KNF: Loaded 36005 existing records. [2025-09-19T19:39:49.018924] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:49.019701] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-19T19:39:49.019855] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-19T19:39:49.020876] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-19T19:39:49.020967] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-19T19:39:49.314093] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T19:39:49.424756] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T19:39:49.472422] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:49.465899] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-19T19:39:50.243268] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-19T19:39:50.569785] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:39:51.035065] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:39:51.043223] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-19T19:39:51.843322] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-19T19:39:51.945514] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T19:39:52.643283] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-19T19:39:53.060623] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T19:39:53.443281] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-19T19:39:53.676097] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T19:39:53.689617] [INFO ] [REMOTE ] KMT: Full fetch complete (61894 records). [2025-09-19T19:39:53.689883] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-19T19:39:54.136283] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-19T19:39:54.136511] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-19T19:39:54.137495] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-19T19:39:54.137637] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-19T19:39:54.139169] [DEBUG] [LOCAL ] KMT: Trimmed 61894 records to 43803 (keeping 200 days of data) [2025-09-19T19:39:54.222074] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T19:39:54.255229] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-19T19:39:54.438079] [DEBUG] [LOCAL ] KMT: Primary data saved (43803 records). [2025-09-19T19:39:54.438248] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-19T19:39:54.438361] [INFO ] [MAIN ] Update Progress: 1205/2372 symbols completed. KMT took 31.1s. Estimated remaining: 2h 34m 48s. Rate: 7.5 symbols/min [2025-09-19T19:39:54.616715] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:39:54.644214] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T19:39:54.657038] [DEBUG] [LOCAL ] KNOP: Loaded 9985 existing records from primary storage. [2025-09-19T19:39:54.657176] [INFO ] [MAIN ] KNOP: Loaded 9985 existing records. [2025-09-19T19:39:54.834212] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:39:54.834511] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-19T19:39:54.834561] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-19T19:39:54.835126] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-19T19:39:54.835187] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-19T19:39:55.050629] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-19T19:39:55.199019] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:39:55.843241] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-19T19:39:55.939589] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:39:56.198568] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T19:39:56.643275] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-19T19:39:57.443299] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-19T19:39:57.503210] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:39:58.243275] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-19T19:39:58.608514] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T19:39:58.835526] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-19T19:39:59.043272] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-19T19:39:59.233310] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T19:39:59.843268] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-19T19:39:59.944310] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T19:40:00.643261] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-19T19:40:01.271595] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T19:40:01.443334] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-19T19:40:02.243283] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-19T19:40:02.748816] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T19:40:03.043315] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-19T19:40:03.182877] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T19:40:03.843273] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-19T19:40:03.881373] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T19:40:04.643274] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-19T19:40:04.692860] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T19:40:05.443282] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-19T19:40:05.589139] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T19:40:06.248571] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-19T19:40:06.259223] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-19T19:40:06.415930] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T19:40:07.043269] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-19T19:40:07.843263] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-19T19:40:07.933254] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T19:40:08.623585] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T19:40:08.643213] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-19T19:40:09.391331] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T19:40:09.443238] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-19T19:40:10.243278] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-19T19:40:10.726040] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:40:10.733830] [INFO ] [REMOTE ] KMX: Full fetch complete (75895 records). [2025-09-19T19:40:10.733972] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-19T19:40:11.045879] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-19T19:40:11.134550] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-19T19:40:11.134693] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-19T19:40:11.135781] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-19T19:40:11.135958] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-19T19:40:11.137623] [DEBUG] [LOCAL ] KMX: Trimmed 75895 records to 53867 (keeping 200 days of data) [2025-09-19T19:40:11.253871] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T19:40:11.499809] [DEBUG] [LOCAL ] KMX: Primary data saved (53867 records). [2025-09-19T19:40:11.499968] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-19T19:40:11.500836] [INFO ] [MAIN ] Update Progress: 1206/2372 symbols completed. KMX took 28.8s. Estimated remaining: 2h 34m 49s. Rate: 7.5 symbols/min [2025-09-19T19:40:11.671846] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:11.698254] [DEBUG] [LOCAL ] KNSL: Loaded 18273 existing records from primary storage. [2025-09-19T19:40:11.698405] [INFO ] [MAIN ] KNSL: Loaded 18273 existing records. [2025-09-19T19:40:11.844239] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-19T19:40:11.882066] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:11.882564] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-19T19:40:11.882663] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-19T19:40:11.883969] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-19T19:40:11.884047] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-19T19:40:11.996795] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:40:12.220970] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T19:40:12.286511] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:12.643338] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-19T19:40:13.443278] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-19T19:40:13.473935] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T19:40:14.042495] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T19:40:14.243303] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-19T19:40:15.043341] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-19T19:40:15.063573] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-19T19:40:15.069691] [INFO ] [REMOTE ] KN: Full fetch complete (56268 records). [2025-09-19T19:40:15.069806] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-19T19:40:15.455371] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-19T19:40:15.455453] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-19T19:40:15.456381] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-19T19:40:15.456444] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-19T19:40:15.458401] [DEBUG] [LOCAL ] KN: Trimmed 56268 records to 39680 (keeping 200 days of data) [2025-09-19T19:40:15.690262] [DEBUG] [LOCAL ] KN: Primary data saved (39680 records). [2025-09-19T19:40:15.690401] [INFO ] [MAIN ] KN: Full history saved. [2025-09-19T19:40:15.690488] [INFO ] [MAIN ] Update Progress: 1207/2372 symbols completed. KN took 28.7s. Estimated remaining: 2h 34m 37s. Rate: 7.5 symbols/min [2025-09-19T19:40:15.870064] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:15.866452] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-19T19:40:15.888316] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T19:40:15.894635] [INFO ] [REMOTE ] KNF: Full fetch complete (50110 records). [2025-09-19T19:40:15.894843] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-19T19:40:16.212731] [DEBUG] [LOCAL ] KNTK: Loaded 46485 existing records from primary storage. [2025-09-19T19:40:16.223804] [INFO ] [MAIN ] KNTK: Loaded 46485 existing records. [2025-09-19T19:40:16.501906] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-19T19:40:16.501776] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:16.502158] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-19T19:40:16.503375] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-19T19:40:16.503665] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-19T19:40:16.503551] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-19T19:40:16.503886] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-19T19:40:16.515242] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-19T19:40:16.517054] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-19T19:40:16.518110] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T19:40:16.510441] [DEBUG] [LOCAL ] KNF: Trimmed 50110 records to 36245 (keeping 200 days of data) [2025-09-19T19:40:16.648151] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-19T19:40:16.812609] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T19:40:17.034101] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:17.135815] [DEBUG] [LOCAL ] KNF: Primary data saved (36245 records). [2025-09-19T19:40:17.135959] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-19T19:40:17.136044] [INFO ] [MAIN ] Update Progress: 1208/2372 symbols completed. KNF took 28.5s. Estimated remaining: 2h 34m 23s. Rate: 7.5 symbols/min [2025-09-19T19:40:17.317145] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:17.371184] [DEBUG] [LOCAL ] KNX: Loaded 52977 existing records from primary storage. [2025-09-19T19:40:17.371359] [INFO ] [MAIN ] KNX: Loaded 52977 existing records. [2025-09-19T19:40:17.449535] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-19T19:40:17.561155] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:17.561431] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-19T19:40:17.561511] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-19T19:40:17.566550] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-19T19:40:17.566719] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-19T19:40:17.931948] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:18.196423] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T19:40:18.243292] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-19T19:40:18.594621] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:40:19.043312] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-19T19:40:19.843279] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-19T19:40:19.992234] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:40:20.073726] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T19:40:20.643272] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-19T19:40:21.443281] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-19T19:40:21.507326] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T19:40:21.531723] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T19:40:22.243268] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-19T19:40:23.043300] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-19T19:40:23.521297] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T19:40:23.843266] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-19T19:40:23.881026] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T19:40:23.926052] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T19:40:24.643284] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-19T19:40:25.443271] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-19T19:40:25.637959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T19:40:25.987738] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T19:40:26.243325] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-19T19:40:26.649556] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T19:40:27.043315] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-19T19:40:27.843251] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-19T19:40:28.215489] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T19:40:28.324787] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:40:28.643316] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-19T19:40:29.040067] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T19:40:29.139827] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T19:40:29.443281] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-19T19:40:30.243268] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-19T19:40:31.043320] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-19T19:40:31.267222] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T19:40:31.269337] [INFO ] [REMOTE ] KNOP: Full fetch complete (14742 records). [2025-09-19T19:40:31.269408] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-19T19:40:31.646448] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-19T19:40:31.646666] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-19T19:40:31.647200] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-19T19:40:31.647309] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-19T19:40:31.648110] [DEBUG] [LOCAL ] KNOP: Trimmed 14742 records to 10092 (keeping 200 days of data) [2025-09-19T19:40:31.746348] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T19:40:31.781017] [DEBUG] [LOCAL ] KNOP: Primary data saved (10092 records). [2025-09-19T19:40:31.781263] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-19T19:40:31.781411] [INFO ] [MAIN ] Update Progress: 1209/2372 symbols completed. KNOP took 37.3s. Estimated remaining: 2h 34m 21s. Rate: 7.5 symbols/min [2025-09-19T19:40:31.852056] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-19T19:40:32.029246] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:32.098500] [DEBUG] [LOCAL ] KO: Loaded 54208 existing records from primary storage. [2025-09-19T19:40:32.098718] [INFO ] [MAIN ] KO: Loaded 54208 existing records. [2025-09-19T19:40:32.353338] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:32.353935] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-19T19:40:32.354026] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-19T19:40:32.361829] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-19T19:40:32.374693] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-19T19:40:32.383782] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T19:40:32.650535] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-19T19:40:32.941346] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:33.443323] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-19T19:40:33.940714] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T19:40:34.024888] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T19:40:34.243309] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-19T19:40:35.043284] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-19T19:40:35.843338] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-19T19:40:36.246477] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T19:40:36.472233] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-09-19T19:40:36.504007] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T19:40:36.643276] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-19T19:40:37.443271] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-19T19:40:37.768633] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T19:40:38.243311] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-19T19:40:38.680429] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T19:40:39.043249] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-19T19:40:39.469588] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-19T19:40:39.843276] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-19T19:40:40.152404] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T19:40:40.643292] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-19T19:40:40.954237] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T19:40:41.027789] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T19:40:41.030984] [INFO ] [REMOTE ] KNSL: Full fetch complete (26719 records). [2025-09-19T19:40:41.031125] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-19T19:40:41.431293] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-19T19:40:41.431436] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-19T19:40:41.432089] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-19T19:40:41.432155] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-19T19:40:41.432968] [DEBUG] [LOCAL ] KNSL: Trimmed 26719 records to 18452 (keeping 200 days of data) [2025-09-19T19:40:41.495961] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-19T19:40:41.563931] [DEBUG] [LOCAL ] KNSL: Primary data saved (18452 records). [2025-09-19T19:40:41.564080] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-19T19:40:41.564167] [INFO ] [MAIN ] Update Progress: 1210/2372 symbols completed. KNSL took 30.1s. Estimated remaining: 2h 34m 15s. Rate: 7.5 symbols/min [2025-09-19T19:40:41.737705] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:41.778734] [DEBUG] [LOCAL ] KODK: Loaded 43791 existing records from primary storage. [2025-09-19T19:40:41.778885] [INFO ] [MAIN ] KODK: Loaded 43791 existing records. [2025-09-19T19:40:41.976554] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:41.976913] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-19T19:40:41.976984] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-19T19:40:41.978256] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-19T19:40:41.978319] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-19T19:40:42.248421] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-19T19:40:42.359986] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:43.043266] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-19T19:40:43.386137] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:40:43.430298] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-19T19:40:43.688845] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T19:40:43.843255] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-19T19:40:44.514238] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T19:40:44.643242] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-19T19:40:45.443282] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-19T19:40:45.856028] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T19:40:45.916093] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T19:40:45.923265] [INFO ] [REMOTE ] KNTK: Full fetch complete (63757 records). [2025-09-19T19:40:45.923391] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-19T19:40:46.248404] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-19T19:40:46.318287] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-19T19:40:46.318373] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-19T19:40:46.319291] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-19T19:40:46.319354] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-19T19:40:46.320837] [DEBUG] [LOCAL ] KNTK: Trimmed 63757 records to 46851 (keeping 200 days of data) [2025-09-19T19:40:46.642268] [DEBUG] [LOCAL ] KNTK: Primary data saved (46851 records). [2025-09-19T19:40:46.642448] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-19T19:40:46.642589] [INFO ] [MAIN ] Update Progress: 1211/2372 symbols completed. KNTK took 31.0s. Estimated remaining: 2h 34m 4s. Rate: 7.5 symbols/min [2025-09-19T19:40:46.823303] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:46.849509] [DEBUG] [LOCAL ] KOF: Loaded 26218 existing records from primary storage. [2025-09-19T19:40:46.849670] [INFO ] [MAIN ] KOF: Loaded 26218 existing records. [2025-09-19T19:40:47.027266] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:47.027545] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-19T19:40:47.027593] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-19T19:40:47.028340] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-19T19:40:47.028399] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-19T19:40:47.060325] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-19T19:40:47.398801] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:47.843270] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-19T19:40:48.112229] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:40:48.419079] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-09-19T19:40:48.498499] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T19:40:48.506360] [INFO ] [REMOTE ] KNX: Full fetch complete (75667 records). [2025-09-19T19:40:48.506503] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-19T19:40:48.654076] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-19T19:40:48.919241] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-19T19:40:48.919330] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-19T19:40:48.920440] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-19T19:40:48.920563] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-19T19:40:48.922218] [DEBUG] [LOCAL ] KNX: Trimmed 75667 records to 53366 (keeping 200 days of data) [2025-09-19T19:40:49.257390] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T19:40:49.274426] [DEBUG] [LOCAL ] KNX: Primary data saved (53366 records). [2025-09-19T19:40:49.274610] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-19T19:40:49.274764] [INFO ] [MAIN ] Update Progress: 1212/2372 symbols completed. KNX took 32.1s. Estimated remaining: 2h 33m 51s. Rate: 7.5 symbols/min [2025-09-19T19:40:49.452989] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:40:49.449460] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-19T19:40:49.473037] [DEBUG] [LOCAL ] KOP: Loaded 18197 existing records from primary storage. [2025-09-19T19:40:49.473171] [INFO ] [MAIN ] KOP: Loaded 18197 existing records. [2025-09-19T19:40:49.661785] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:40:49.662056] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-19T19:40:49.662105] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-19T19:40:49.662833] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-19T19:40:49.662895] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-19T19:40:50.049685] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:40:50.243251] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-19T19:40:50.658313] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T19:40:51.043267] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-19T19:40:51.418076] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T19:40:51.843357] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-19T19:40:52.264468] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-19T19:40:52.643300] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-19T19:40:52.882877] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T19:40:53.005953] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T19:40:53.443266] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-19T19:40:54.243298] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-19T19:40:55.043289] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-19T19:40:55.186883] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T19:40:55.491688] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-19T19:40:55.750843] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T19:40:55.843259] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-19T19:40:56.472463] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:40:56.643262] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-19T19:40:57.443244] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-19T19:40:57.763639] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:40:57.975135] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T19:40:58.243278] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-19T19:40:59.043317] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-19T19:40:59.596528] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T19:40:59.843294] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-19T19:41:00.186497] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-09-19T19:41:00.643291] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-19T19:41:00.732062] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T19:41:01.267698] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T19:41:01.443307] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-19T19:41:02.243272] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-19T19:41:02.586093] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T19:41:03.043253] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-19T19:41:03.693754] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-09-19T19:41:03.717902] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-19T19:41:03.823890] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T19:41:03.843227] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-19T19:41:04.643219] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-19T19:41:05.192629] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:41:05.443276] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-19T19:41:05.879165] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T19:41:06.243274] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-19T19:41:07.043258] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-19T19:41:07.445976] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:41:07.597498] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T19:41:07.843248] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-19T19:41:08.643326] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-19T19:41:09.397735] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T19:41:09.443270] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-19T19:41:09.552932] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-19T19:41:09.988673] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T19:41:09.992114] [INFO ] [REMOTE ] KOP: Full fetch complete (25353 records). [2025-09-19T19:41:09.992186] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-19T19:41:10.249950] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-19T19:41:10.375028] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-19T19:41:10.375114] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-19T19:41:10.375633] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-19T19:41:10.375712] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-19T19:41:10.376411] [DEBUG] [LOCAL ] KOP: Trimmed 25353 records to 18334 (keeping 200 days of data) [2025-09-19T19:41:10.487761] [DEBUG] [LOCAL ] KOP: Primary data saved (18334 records). [2025-09-19T19:41:10.487919] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-19T19:41:10.488079] [INFO ] [MAIN ] Update Progress: 1213/2372 symbols completed. KOP took 21.2s. Estimated remaining: 2h 33m 56s. Rate: 7.5 symbols/min [2025-09-19T19:41:10.656231] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:10.659780] [DEBUG] [LOCAL ] KORE: Loaded 1964 existing records from primary storage. [2025-09-19T19:41:10.659855] [INFO ] [MAIN ] KORE: Loaded 1964 existing records. [2025-09-19T19:41:10.837768] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:10.838097] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-19T19:41:10.838167] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-19T19:41:10.838411] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-19T19:41:10.838469] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-19T19:41:11.054673] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-19T19:41:11.226266] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:41:11.230513] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:11.843322] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-19T19:41:12.643230] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-19T19:41:12.896587] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:41:12.902735] [INFO ] [REMOTE ] KODK: Full fetch complete (63704 records). [2025-09-19T19:41:12.902849] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-19T19:41:13.309300] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-19T19:41:13.309513] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-19T19:41:13.310466] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-19T19:41:13.310552] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-19T19:41:13.328829] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T19:41:13.334672] [DEBUG] [LOCAL ] KODK: Trimmed 63704 records to 44070 (keeping 200 days of data) [2025-09-19T19:41:13.445143] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-19T19:41:13.562269] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (3.31 seconds). [2025-09-19T19:41:13.571866] [INFO ] [REMOTE ] KO: Full fetch complete (77994 records). [2025-09-19T19:41:13.572543] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-19T19:41:13.934875] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T19:41:14.028892] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-19T19:41:14.032220] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-19T19:41:14.033424] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-19T19:41:14.033515] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-19T19:41:14.053494] [DEBUG] [LOCAL ] KO: Trimmed 77994 records to 54598 (keeping 200 days of data) [2025-09-19T19:41:14.059590] [DEBUG] [LOCAL ] KODK: Primary data saved (44070 records). [2025-09-19T19:41:14.125742] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-19T19:41:14.127760] [INFO ] [MAIN ] Update Progress: 1214/2372 symbols completed. KODK took 32.6s. Estimated remaining: 2h 33m 44s. Rate: 7.5 symbols/min [2025-09-19T19:41:14.250185] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-19T19:41:14.341511] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:14.472374] [DEBUG] [LOCAL ] KOS: Loaded 53459 existing records from primary storage. [2025-09-19T19:41:14.499634] [INFO ] [MAIN ] KOS: Loaded 53459 existing records. [2025-09-19T19:41:14.701790] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:14.704816] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-19T19:41:14.706113] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-19T19:41:14.708457] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-19T19:41:14.708913] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-19T19:41:14.798667] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T19:41:15.045674] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-19T19:41:15.177052] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:15.229385] [DEBUG] [LOCAL ] KO: Primary data saved (54598 records). [2025-09-19T19:41:15.229516] [INFO ] [MAIN ] KO: Full history saved. [2025-09-19T19:41:15.229602] [INFO ] [MAIN ] Update Progress: 1215/2372 symbols completed. KO took 43.4s. Estimated remaining: 2h 33m 29s. Rate: 7.5 symbols/min [2025-09-19T19:41:15.416803] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:15.468967] [DEBUG] [LOCAL ] KR: Loaded 54072 existing records from primary storage. [2025-09-19T19:41:15.469115] [INFO ] [MAIN ] KR: Loaded 54072 existing records. [2025-09-19T19:41:15.612132] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T19:41:15.675902] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:15.676163] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-19T19:41:15.676215] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-19T19:41:15.677706] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-19T19:41:15.677771] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-19T19:41:15.856086] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-19T19:41:16.043566] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:16.527068] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T19:41:16.601906] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T19:41:16.643258] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-19T19:41:17.443313] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-19T19:41:17.977843] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T19:41:18.243258] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-19T19:41:18.807346] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T19:41:19.043280] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-19T19:41:19.843289] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-19T19:41:19.900190] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T19:41:19.906010] [INFO ] [REMOTE ] KOF: Full fetch complete (37037 records). [2025-09-19T19:41:19.906314] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-19T19:41:20.324125] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-19T19:41:20.324219] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-19T19:41:20.324963] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-19T19:41:20.325031] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-19T19:41:20.325981] [DEBUG] [LOCAL ] KOF: Trimmed 37037 records to 26373 (keeping 200 days of data) [2025-09-19T19:41:20.502994] [DEBUG] [LOCAL ] KOF: Primary data saved (26373 records). [2025-09-19T19:41:20.503154] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-19T19:41:20.503260] [INFO ] [MAIN ] Update Progress: 1216/2372 symbols completed. KOF took 33.9s. Estimated remaining: 2h 33m 19s. Rate: 7.5 symbols/min [2025-09-19T19:41:20.652075] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-19T19:41:20.681969] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:20.733230] [DEBUG] [LOCAL ] KRC: Loaded 48795 existing records from primary storage. [2025-09-19T19:41:20.733453] [INFO ] [MAIN ] KRC: Loaded 48795 existing records. [2025-09-19T19:41:20.919899] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:20.920298] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-19T19:41:20.920424] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-19T19:41:20.921731] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-19T19:41:20.921797] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-19T19:41:21.267121] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-19T19:41:21.286124] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T19:41:21.353822] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:21.443247] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-19T19:41:22.113208] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:41:22.243274] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-19T19:41:22.795439] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T19:41:23.043270] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-19T19:41:23.486087] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-19T19:41:23.514297] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T19:41:23.843279] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-19T19:41:24.643281] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-19T19:41:25.443303] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-19T19:41:26.213816] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-19T19:41:26.243332] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-19T19:41:26.396762] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T19:41:26.826193] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-19T19:41:27.043271] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-19T19:41:27.453853] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T19:41:27.843282] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-19T19:41:28.409198] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T19:41:28.643266] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-19T19:41:29.318404] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:41:29.443262] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-19T19:41:29.925239] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:41:30.243275] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-19T19:41:31.043293] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-19T19:41:31.585447] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T19:41:31.843262] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-19T19:41:32.419330] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-19T19:41:32.643272] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-19T19:41:32.917090] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T19:41:33.443269] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-19T19:41:33.878391] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T19:41:34.027360] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T19:41:34.028264] [INFO ] [REMOTE ] KORE: Full fetch complete (6106 records). [2025-09-19T19:41:34.028334] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-19T19:41:34.250565] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-19T19:41:34.416920] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-19T19:41:34.417005] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-19T19:41:34.417205] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-19T19:41:34.417245] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-19T19:41:34.417624] [DEBUG] [LOCAL ] KORE: Trimmed 6106 records to 1975 (keeping 200 days of data) [2025-09-19T19:41:34.429035] [DEBUG] [LOCAL ] KORE: Primary data saved (1975 records). [2025-09-19T19:41:34.429110] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-19T19:41:34.429216] [INFO ] [MAIN ] Update Progress: 1217/2372 symbols completed. KORE took 23.9s. Estimated remaining: 2h 33m 17s. Rate: 7.5 symbols/min [2025-09-19T19:41:34.605522] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:34.644687] [DEBUG] [LOCAL ] KREF: Loaded 37241 existing records from primary storage. [2025-09-19T19:41:34.644837] [INFO ] [MAIN ] KREF: Loaded 37241 existing records. [2025-09-19T19:41:34.827884] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:34.828384] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-19T19:41:34.828557] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-19T19:41:34.829700] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-19T19:41:34.829783] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-19T19:41:35.024572] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T19:41:35.063395] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-19T19:41:35.246183] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:35.843291] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-19T19:41:36.417768] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:41:36.543167] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T19:41:36.643232] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-19T19:41:37.443266] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-19T19:41:37.939383] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T19:41:38.243281] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-19T19:41:38.525072] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T19:41:38.910086] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-19T19:41:39.043295] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-19T19:41:39.843288] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-19T19:41:40.338480] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T19:41:40.643415] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-19T19:41:41.285694] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T19:41:41.443272] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-19T19:41:41.501898] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T19:41:41.510093] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-09-19T19:41:41.510259] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-19T19:41:41.934059] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-19T19:41:41.934153] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-19T19:41:41.935206] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-19T19:41:41.935272] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-19T19:41:41.936833] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 54462 (keeping 200 days of data) [2025-09-19T19:41:42.259442] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-19T19:41:42.289793] [DEBUG] [LOCAL ] KR: Primary data saved (54462 records). [2025-09-19T19:41:42.289958] [INFO ] [MAIN ] KR: Full history saved. [2025-09-19T19:41:42.290138] [INFO ] [MAIN ] Update Progress: 1218/2372 symbols completed. KR took 27.1s. Estimated remaining: 2h 33m 8s. Rate: 7.5 symbols/min [2025-09-19T19:41:42.474230] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:42.522174] [DEBUG] [LOCAL ] KRG: Loaded 49537 existing records from primary storage. [2025-09-19T19:41:42.522335] [INFO ] [MAIN ] KRG: Loaded 49537 existing records. [2025-09-19T19:41:42.721509] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:42.721942] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-19T19:41:42.722084] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-19T19:41:42.723500] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-19T19:41:42.723624] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-19T19:41:42.875149] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T19:41:43.052471] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-19T19:41:43.168244] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:43.186276] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:41:43.651803] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T19:41:43.843252] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-19T19:41:44.643288] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-19T19:41:45.284097] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T19:41:45.443315] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-19T19:41:45.772353] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T19:41:46.243267] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-19T19:41:46.458004] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T19:41:47.053989] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-19T19:41:47.056985] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T19:41:47.725524] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T19:41:47.843278] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-19T19:41:48.643284] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-19T19:41:49.109367] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T19:41:49.443270] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-19T19:41:49.720302] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T19:41:50.243265] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-19T19:41:50.596338] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:41:51.043266] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-19T19:41:51.187319] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T19:41:51.843300] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-19T19:41:51.918594] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:41:52.317309] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T19:41:52.643260] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-19T19:41:53.443237] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-19T19:41:53.482760] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T19:41:53.491077] [INFO ] [REMOTE ] KOS: Full fetch complete (76834 records). [2025-09-19T19:41:53.491320] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-19T19:41:53.897739] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-19T19:41:53.897830] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-19T19:41:53.898820] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-19T19:41:53.898910] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-19T19:41:53.901049] [DEBUG] [LOCAL ] KOS: Trimmed 76834 records to 53842 (keeping 200 days of data) [2025-09-19T19:41:54.225796] [DEBUG] [LOCAL ] KOS: Primary data saved (53842 records). [2025-09-19T19:41:54.225965] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-19T19:41:54.226449] [INFO ] [MAIN ] Update Progress: 1219/2372 symbols completed. KOS took 40.1s. Estimated remaining: 2h 33m 4s. Rate: 7.5 symbols/min [2025-09-19T19:41:54.251682] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-19T19:41:54.402372] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:54.402582] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-19T19:41:54.402722] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-19T19:41:54.403081] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-19T19:41:54.403255] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-19T19:41:54.403378] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-19T19:41:54.403731] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-19T19:41:54.809402] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:54.812110] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T19:41:55.043231] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-19T19:41:55.123801] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T19:41:55.843226] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-19T19:41:56.519326] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T19:41:56.529289] [INFO ] [REMOTE ] KRC: Full fetch complete (69546 records). [2025-09-19T19:41:56.529455] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-19T19:41:56.648406] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-19T19:41:56.917367] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-19T19:41:56.917581] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-19T19:41:56.918716] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-19T19:41:56.918829] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-19T19:41:56.922274] [DEBUG] [LOCAL ] KRC: Trimmed 69546 records to 49159 (keeping 200 days of data) [2025-09-19T19:41:56.994586] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:41:57.033000] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-19T19:41:57.074393] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T19:41:57.290623] [DEBUG] [LOCAL ] KRC: Primary data saved (49159 records). [2025-09-19T19:41:57.290942] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-19T19:41:57.291066] [INFO ] [MAIN ] Update Progress: 1220/2372 symbols completed. KRC took 36.8s. Estimated remaining: 2h 32m 52s. Rate: 7.5 symbols/min [2025-09-19T19:41:57.455198] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-19T19:41:57.458381] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:41:57.488048] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T19:41:57.517738] [DEBUG] [LOCAL ] KRO: Loaded 25967 existing records from primary storage. [2025-09-19T19:41:57.517886] [INFO ] [MAIN ] KRO: Loaded 25967 existing records. [2025-09-19T19:41:57.696795] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:41:57.697100] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-19T19:41:57.697150] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-19T19:41:57.698120] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-19T19:41:57.698181] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-19T19:41:57.730540] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:41:57.768335] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-19T19:41:58.060956] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:41:58.243265] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-19T19:41:59.043260] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-19T19:41:59.843286] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-19T19:41:59.938626] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T19:42:00.643238] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-19T19:42:01.176583] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T19:42:01.218391] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T19:42:01.443262] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-19T19:42:02.036000] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T19:42:02.243266] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-19T19:42:03.043264] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-19T19:42:03.843268] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-19T19:42:05.102865] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-19T19:42:05.111071] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-19T19:42:06.029817] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (4.59 seconds). [2025-09-19T19:42:06.040177] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-19T19:42:06.156260] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-19T19:42:06.243269] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-19T19:42:06.348065] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T19:42:06.928166] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (3.08 seconds). [2025-09-19T19:42:06.934111] [INFO ] [REMOTE ] KREF: Full fetch complete (51638 records). [2025-09-19T19:42:06.934235] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-19T19:42:07.048430] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-19T19:42:07.336919] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-19T19:42:07.337025] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-19T19:42:07.337825] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-19T19:42:07.337889] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-19T19:42:07.339408] [DEBUG] [LOCAL ] KREF: Trimmed 51638 records to 37539 (keeping 200 days of data) [2025-09-19T19:42:07.587737] [DEBUG] [LOCAL ] KREF: Primary data saved (37539 records). [2025-09-19T19:42:07.587947] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-19T19:42:07.588091] [INFO ] [MAIN ] Update Progress: 1221/2372 symbols completed. KREF took 33.2s. Estimated remaining: 2h 32m 46s. Rate: 7.5 symbols/min [2025-09-19T19:42:07.790711] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:07.840029] [DEBUG] [LOCAL ] KRP: Loaded 38364 existing records from primary storage. [2025-09-19T19:42:07.840207] [INFO ] [MAIN ] KRP: Loaded 38364 existing records. [2025-09-19T19:42:08.030190] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:08.030636] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-19T19:42:08.031177] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-19T19:42:08.047928] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-19T19:42:08.058848] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-19T19:42:08.121224] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T19:42:08.207293] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-19T19:42:08.421709] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T19:42:08.447379] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T19:42:08.508750] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:08.643264] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-19T19:42:09.443289] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-19T19:42:09.996834] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T19:42:10.243302] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-19T19:42:10.452046] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T19:42:11.043276] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-19T19:42:11.085103] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T19:42:11.843262] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-19T19:42:11.938042] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T19:42:12.643312] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-19T19:42:13.030363] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:42:13.037792] [INFO ] [REMOTE ] KRG: Full fetch complete (70899 records). [2025-09-19T19:42:13.037949] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-19T19:42:13.423712] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-19T19:42:13.423823] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-19T19:42:13.424778] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-19T19:42:13.424844] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-19T19:42:13.427340] [DEBUG] [LOCAL ] KRG: Trimmed 70899 records to 49895 (keeping 200 days of data) [2025-09-19T19:42:13.443286] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-19T19:42:13.756933] [DEBUG] [LOCAL ] KRG: Primary data saved (49895 records). [2025-09-19T19:42:13.757129] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-19T19:42:13.757295] [INFO ] [MAIN ] Update Progress: 1222/2372 symbols completed. KRG took 31.5s. Estimated remaining: 2h 32m 36s. Rate: 7.5 symbols/min [2025-09-19T19:42:13.926060] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:13.984558] [DEBUG] [LOCAL ] KSS: Loaded 54002 existing records from primary storage. [2025-09-19T19:42:13.984760] [INFO ] [MAIN ] KSS: Loaded 54002 existing records. [2025-09-19T19:42:14.163579] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:14.163923] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-19T19:42:14.164070] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-19T19:42:14.165801] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-19T19:42:14.165868] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-19T19:42:14.497021] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T19:42:14.568714] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-19T19:42:14.597986] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:15.043320] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-19T19:42:15.193442] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-19T19:42:15.843352] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-19T19:42:15.966196] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-19T19:42:16.656197] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-19T19:42:16.663073] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T19:42:16.775107] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T19:42:17.443243] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-19T19:42:17.494106] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T19:42:17.972692] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T19:42:18.243324] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-19T19:42:19.043359] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-19T19:42:19.551734] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T19:42:19.843268] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-19T19:42:20.035133] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T19:42:20.643308] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-19T19:42:21.184711] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T19:42:21.443245] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-19T19:42:21.557478] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T19:42:22.224216] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T19:42:22.243224] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-19T19:42:22.314414] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-19T19:42:23.043266] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-19T19:42:23.843258] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-19T19:42:23.924616] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T19:42:24.370818] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:42:24.643262] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-19T19:42:25.443300] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-19T19:42:26.139475] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T19:42:26.243311] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-19T19:42:26.389344] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:42:26.843954] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T19:42:26.851858] [INFO ] [REMOTE ] KRMN: Full fetch complete (48832 records). [2025-09-19T19:42:26.852038] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-19T19:42:27.043675] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-19T19:42:27.058732] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 151 unique days, need 200 days [2025-09-19T19:42:27.059581] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:42:27.059693] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:42:27.059798] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-19T19:42:27.059962] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-19T19:42:27.060033] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-19T19:42:27.060124] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-19T19:42:27.060265] [INFO ] [MAIN ] Update Progress: 1223/2372 symbols completed. KRMN took 32.8s. Estimated remaining: 2h 32m 33s. Rate: 7.5 symbols/min [2025-09-19T19:42:27.284987] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:27.349691] [DEBUG] [LOCAL ] KT: Loaded 46030 existing records from primary storage. [2025-09-19T19:42:27.349908] [INFO ] [MAIN ] KT: Loaded 46030 existing records. [2025-09-19T19:42:27.536267] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:27.536713] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-19T19:42:27.536836] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-19T19:42:27.538391] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-19T19:42:27.538455] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-19T19:42:27.852105] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-19T19:42:27.941353] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:28.595451] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T19:42:28.622141] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T19:42:28.627068] [INFO ] [REMOTE ] KRO: Full fetch complete (34701 records). [2025-09-19T19:42:28.627205] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-19T19:42:28.649330] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-19T19:42:29.034627] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-19T19:42:29.034769] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-19T19:42:29.035578] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-19T19:42:29.035677] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-19T19:42:29.036810] [DEBUG] [LOCAL ] KRO: Trimmed 34701 records to 26145 (keeping 200 days of data) [2025-09-19T19:42:29.198216] [DEBUG] [LOCAL ] KRO: Primary data saved (26145 records). [2025-09-19T19:42:29.198373] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-19T19:42:29.198462] [INFO ] [MAIN ] Update Progress: 1224/2372 symbols completed. KRO took 31.9s. Estimated remaining: 2h 32m 20s. Rate: 7.5 symbols/min [2025-09-19T19:42:29.428118] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:29.452559] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-19T19:42:29.455460] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T19:42:29.498740] [DEBUG] [LOCAL ] KTB: Loaded 41629 existing records from primary storage. [2025-09-19T19:42:29.498889] [INFO ] [MAIN ] KTB: Loaded 41629 existing records. [2025-09-19T19:42:29.678845] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:29.679229] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-19T19:42:29.679292] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-19T19:42:29.680223] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-19T19:42:29.680287] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-19T19:42:30.046530] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:30.243275] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-19T19:42:31.020398] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-19T19:42:31.043220] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-19T19:42:31.305571] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T19:42:31.849181] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-19T19:42:31.863217] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:42:32.643326] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-19T19:42:33.060846] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T19:42:33.443280] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-19T19:42:33.694375] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T19:42:34.238222] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:42:34.245923] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-19T19:42:35.043235] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-19T19:42:35.283437] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T19:42:35.843269] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-19T19:42:35.931682] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T19:42:36.643278] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-19T19:42:37.056115] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T19:42:37.443308] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-19T19:42:37.813558] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T19:42:38.243361] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-19T19:42:38.398871] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:42:39.049486] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-19T19:42:39.056426] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T19:42:39.843271] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-19T19:42:40.584786] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T19:42:40.593306] [INFO ] [REMOTE ] KSS: Full fetch complete (77643 records). [2025-09-19T19:42:40.593459] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-19T19:42:40.659611] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-19T19:42:41.020482] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-19T19:42:41.020594] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-19T19:42:41.021620] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-19T19:42:41.021717] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-19T19:42:41.023279] [DEBUG] [LOCAL ] KSS: Trimmed 77643 records to 54391 (keeping 200 days of data) [2025-09-19T19:42:41.278850] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T19:42:41.394128] [DEBUG] [LOCAL ] KSS: Primary data saved (54391 records). [2025-09-19T19:42:41.394287] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-19T19:42:41.394377] [INFO ] [MAIN ] Update Progress: 1225/2372 symbols completed. KSS took 27.6s. Estimated remaining: 2h 32m 16s. Rate: 7.5 symbols/min [2025-09-19T19:42:41.453547] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-19T19:42:41.591839] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:41.608524] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T19:42:41.614597] [INFO ] [REMOTE ] KRP: Full fetch complete (54876 records). [2025-09-19T19:42:41.614897] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-19T19:42:41.733688] [DEBUG] [LOCAL ] KTF: Loaded 13268 existing records from primary storage. [2025-09-19T19:42:41.733899] [INFO ] [MAIN ] KTF: Loaded 13268 existing records. [2025-09-19T19:42:42.143676] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:42.183857] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-19T19:42:42.215499] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-19T19:42:42.229173] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-19T19:42:42.229315] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-19T19:42:42.230313] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-19T19:42:42.230262] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-19T19:42:42.230412] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-19T19:42:42.230553] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-19T19:42:42.339317] [DEBUG] [LOCAL ] KRP: Trimmed 54876 records to 38635 (keeping 200 days of data) [2025-09-19T19:42:42.721834] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:42.724690] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-19T19:42:42.769727] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:42:42.927458] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T19:42:42.945290] [DEBUG] [LOCAL ] KRP: Primary data saved (38635 records). [2025-09-19T19:42:42.945419] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-19T19:42:42.945498] [INFO ] [MAIN ] Update Progress: 1226/2372 symbols completed. KRP took 35.4s. Estimated remaining: 2h 32m 2s. Rate: 7.5 symbols/min [2025-09-19T19:42:43.048445] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-19T19:42:43.127241] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:43.127446] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-19T19:42:43.127484] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-19T19:42:43.127632] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-19T19:42:43.127732] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-19T19:42:43.127802] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-19T19:42:43.127839] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-19T19:42:43.511831] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:42:43.843266] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-19T19:42:43.857420] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T19:42:44.643263] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-19T19:42:44.800995] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T19:42:45.104219] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T19:42:45.443279] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-19T19:42:45.575884] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T19:42:46.243299] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-19T19:42:47.043272] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-19T19:42:47.218323] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T19:42:47.557963] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-19T19:42:47.843266] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-19T19:42:48.071154] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T19:42:48.643277] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-19T19:42:49.443270] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-19T19:42:49.471150] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T19:42:50.202364] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T19:42:50.243237] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-19T19:42:50.558149] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T19:42:51.043288] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-19T19:42:51.610801] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T19:42:51.843271] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-19T19:42:52.182562] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T19:42:52.643284] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-19T19:42:53.443279] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-19T19:42:53.555326] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T19:42:53.604835] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T19:42:54.243268] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-19T19:42:54.746938] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T19:42:55.021336] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T19:42:55.043235] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-19T19:42:55.843303] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-19T19:42:56.171330] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T19:42:56.643268] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-19T19:42:57.443286] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-19T19:42:57.546491] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:42:57.801172] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-19T19:42:58.243302] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-19T19:42:58.573533] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T19:42:58.580593] [INFO ] [REMOTE ] KT: Full fetch complete (66886 records). [2025-09-19T19:42:58.580739] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-19T19:42:58.978752] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-19T19:42:58.978868] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-19T19:42:58.979804] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-19T19:42:58.979867] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-19T19:42:58.981198] [DEBUG] [LOCAL ] KT: Trimmed 66886 records to 46373 (keeping 200 days of data) [2025-09-19T19:42:59.046060] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-19T19:42:59.208313] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T19:42:59.283533] [DEBUG] [LOCAL ] KT: Primary data saved (46373 records). [2025-09-19T19:42:59.283703] [INFO ] [MAIN ] KT: Full history saved. [2025-09-19T19:42:59.284417] [INFO ] [MAIN ] Update Progress: 1227/2372 symbols completed. KT took 32.2s. Estimated remaining: 2h 32m 2s. Rate: 7.5 symbols/min [2025-09-19T19:42:59.465127] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:42:59.524386] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-09-19T19:42:59.524545] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-09-19T19:42:59.703453] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:42:59.703749] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-19T19:42:59.703805] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-19T19:42:59.705153] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-19T19:42:59.705217] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-19T19:42:59.848373] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-19T19:43:00.075431] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:00.512764] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-19T19:43:00.643277] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-19T19:43:00.810104] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T19:43:00.815873] [INFO ] [REMOTE ] KTB: Full fetch complete (57368 records). [2025-09-19T19:43:00.815980] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-19T19:43:01.200244] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-19T19:43:01.200333] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-19T19:43:01.201161] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-19T19:43:01.201225] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-19T19:43:01.202414] [DEBUG] [LOCAL ] KTB: Trimmed 57368 records to 41933 (keeping 200 days of data) [2025-09-19T19:43:01.443623] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-19T19:43:01.465480] [DEBUG] [LOCAL ] KTB: Primary data saved (41933 records). [2025-09-19T19:43:01.465595] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-19T19:43:01.465698] [INFO ] [MAIN ] Update Progress: 1228/2372 symbols completed. KTB took 32.3s. Estimated remaining: 2h 31m 48s. Rate: 7.5 symbols/min [2025-09-19T19:43:01.643637] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:01.700266] [DEBUG] [LOCAL ] KVYO: Loaded 50181 existing records from primary storage. [2025-09-19T19:43:01.700430] [INFO ] [MAIN ] KVYO: Loaded 50181 existing records. [2025-09-19T19:43:01.899384] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:01.899731] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-19T19:43:01.899788] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-19T19:43:01.900882] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-19T19:43:01.900943] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-19T19:43:02.248376] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-19T19:43:02.294426] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:02.724876] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T19:43:02.793528] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T19:43:02.822117] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T19:43:03.043274] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-19T19:43:03.843268] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-19T19:43:04.367171] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-19T19:43:04.643309] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-19T19:43:05.006003] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T19:43:05.443309] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-19T19:43:05.622408] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T19:43:06.160144] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T19:43:06.243229] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-19T19:43:07.043240] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-19T19:43:07.124472] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:43:07.125761] [INFO ] [REMOTE ] KUKE: Full fetch complete (7942 records). [2025-09-19T19:43:07.125836] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-19T19:43:07.306789] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T19:43:07.307032] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:43:07.307098] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:43:07.307146] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-19T19:43:07.307202] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-19T19:43:07.307246] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-19T19:43:07.307284] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-19T19:43:07.307362] [INFO ] [MAIN ] Update Progress: 1229/2372 symbols completed. KUKE took 24.4s. Estimated remaining: 2h 31m 38s. Rate: 7.5 symbols/min [2025-09-19T19:43:07.482490] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:07.519850] [DEBUG] [LOCAL ] KW: Loaded 40949 existing records from primary storage. [2025-09-19T19:43:07.519989] [INFO ] [MAIN ] KW: Loaded 40949 existing records. [2025-09-19T19:43:07.712882] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:07.713217] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-19T19:43:07.713279] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-19T19:43:07.714206] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-19T19:43:07.714268] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-19T19:43:07.848360] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-19T19:43:08.099461] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:08.643252] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-19T19:43:08.854316] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T19:43:09.053231] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T19:43:09.443272] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-19T19:43:10.243289] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-19T19:43:10.591672] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T19:43:11.043339] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-19T19:43:11.482473] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T19:43:11.578741] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T19:43:11.843306] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-19T19:43:12.643297] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-19T19:43:12.832227] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T19:43:13.443238] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-19T19:43:13.491244] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T19:43:14.122300] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T19:43:14.125268] [INFO ] [REMOTE ] KTF: Full fetch complete (18396 records). [2025-09-19T19:43:14.125371] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-19T19:43:14.248399] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-19T19:43:14.501881] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-19T19:43:14.501974] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-19T19:43:14.502362] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-19T19:43:14.502402] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-19T19:43:14.503029] [DEBUG] [LOCAL ] KTF: Trimmed 18396 records to 13320 (keeping 200 days of data) [2025-09-19T19:43:14.584846] [DEBUG] [LOCAL ] KTF: Primary data saved (13320 records). [2025-09-19T19:43:14.584980] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-19T19:43:14.585083] [INFO ] [MAIN ] Update Progress: 1230/2372 symbols completed. KTF took 33.2s. Estimated remaining: 2h 31m 30s. Rate: 7.5 symbols/min [2025-09-19T19:43:14.760143] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:14.793709] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-19T19:43:14.817517] [DEBUG] [LOCAL ] KWR: Loaded 17058 existing records from primary storage. [2025-09-19T19:43:14.817688] [INFO ] [MAIN ] KWR: Loaded 17058 existing records. [2025-09-19T19:43:14.996494] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:14.996841] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-19T19:43:14.996924] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-19T19:43:14.997464] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-19T19:43:14.997527] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-19T19:43:15.052739] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-19T19:43:15.359783] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:15.843279] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-19T19:43:16.112389] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T19:43:16.643285] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-19T19:43:16.743696] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T19:43:17.443239] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-19T19:43:17.633865] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T19:43:18.018967] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T19:43:18.243262] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-19T19:43:19.043293] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-19T19:43:19.128415] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:43:19.427873] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T19:43:19.843317] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-19T19:43:20.643324] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-19T19:43:20.833312] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T19:43:21.033123] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T19:43:21.443313] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-19T19:43:22.169004] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T19:43:22.235268] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T19:43:22.243220] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-19T19:43:23.043273] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-19T19:43:23.843278] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-19T19:43:24.433795] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T19:43:24.643259] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-19T19:43:24.925542] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T19:43:25.038518] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T19:43:25.443286] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-19T19:43:26.098106] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T19:43:26.243263] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-19T19:43:27.043313] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-19T19:43:27.506771] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T19:43:27.717397] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:43:27.843282] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-19T19:43:28.643256] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-19T19:43:29.275460] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T19:43:29.443272] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-19T19:43:29.886162] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T19:43:30.111966] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T19:43:30.120968] [INFO ] [REMOTE ] KVUE: Full fetch complete (77669 records). [2025-09-19T19:43:30.121178] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-19T19:43:30.248608] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-19T19:43:30.660448] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-19T19:43:30.660610] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-19T19:43:30.662125] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-19T19:43:30.662217] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-19T19:43:30.664736] [DEBUG] [LOCAL ] KVUE: Trimmed 77669 records to 54447 (keeping 200 days of data) [2025-09-19T19:43:31.044041] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-19T19:43:31.071558] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-09-19T19:43:31.071827] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-19T19:43:31.071954] [INFO ] [MAIN ] Update Progress: 1231/2372 symbols completed. KVUE took 31.8s. Estimated remaining: 2h 31m 30s. Rate: 7.5 symbols/min [2025-09-19T19:43:31.274206] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:31.303286] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T19:43:31.342671] [DEBUG] [LOCAL ] KYN: Loaded 30666 existing records from primary storage. [2025-09-19T19:43:31.342852] [INFO ] [MAIN ] KYN: Loaded 30666 existing records. [2025-09-19T19:43:31.542172] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:31.542501] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-19T19:43:31.542566] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-19T19:43:31.543578] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-19T19:43:31.543665] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-19T19:43:31.853403] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-19T19:43:31.910509] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:31.942559] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T19:43:32.593010] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:43:32.643240] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-19T19:43:33.443288] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-19T19:43:33.731130] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T19:43:34.243283] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-19T19:43:34.462609] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T19:43:35.043312] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-19T19:43:35.153395] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:43:35.644816] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T19:43:35.843275] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-19T19:43:36.261492] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T19:43:36.643278] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-19T19:43:37.368097] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T19:43:37.443272] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-19T19:43:37.712697] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T19:43:37.715146] [INFO ] [REMOTE ] KWR: Full fetch complete (24031 records). [2025-09-19T19:43:37.715224] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-19T19:43:38.119084] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-19T19:43:38.119165] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-19T19:43:38.119694] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-19T19:43:38.119767] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-19T19:43:38.120472] [DEBUG] [LOCAL ] KWR: Trimmed 24031 records to 17129 (keeping 200 days of data) [2025-09-19T19:43:38.226587] [DEBUG] [LOCAL ] KWR: Primary data saved (17129 records). [2025-09-19T19:43:38.226764] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-19T19:43:38.226870] [INFO ] [MAIN ] Update Progress: 1232/2372 symbols completed. KWR took 23.6s. Estimated remaining: 2h 31m 21s. Rate: 7.5 symbols/min [2025-09-19T19:43:38.248542] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-19T19:43:38.400239] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:38.439239] [DEBUG] [LOCAL ] L: Loaded 41224 existing records from primary storage. [2025-09-19T19:43:38.439442] [INFO ] [MAIN ] L: Loaded 41224 existing records. [2025-09-19T19:43:38.635577] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:38.635885] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-19T19:43:38.635944] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-19T19:43:38.637273] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-19T19:43:38.637344] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-19T19:43:39.042668] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:39.043217] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-19T19:43:39.073506] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:43:39.843334] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-19T19:43:40.214599] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:43:40.225694] [INFO ] [REMOTE ] KVYO: Full fetch complete (71282 records). [2025-09-19T19:43:40.225999] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-19T19:43:40.646856] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-19T19:43:40.647270] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-19T19:43:40.647623] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-19T19:43:40.649493] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-19T19:43:40.649579] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-19T19:43:40.651681] [DEBUG] [LOCAL ] KVYO: Trimmed 71282 records to 50569 (keeping 200 days of data) [2025-09-19T19:43:40.899166] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:43:41.012297] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:43:41.040366] [DEBUG] [LOCAL ] KVYO: Primary data saved (50569 records). [2025-09-19T19:43:41.040523] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-19T19:43:41.040629] [INFO ] [MAIN ] Update Progress: 1233/2372 symbols completed. KVYO took 39.6s. Estimated remaining: 2h 31m 8s. Rate: 7.5 symbols/min [2025-09-19T19:43:41.225518] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:41.275556] [DEBUG] [LOCAL ] LAC: Loaded 52671 existing records from primary storage. [2025-09-19T19:43:41.275762] [INFO ] [MAIN ] LAC: Loaded 52671 existing records. [2025-09-19T19:43:41.459079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-19T19:43:41.465671] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:41.466571] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-19T19:43:41.466623] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-19T19:43:41.468181] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-19T19:43:41.468259] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-19T19:43:41.823482] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:41.970697] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T19:43:42.243267] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-19T19:43:43.043256] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-19T19:43:43.277243] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T19:43:43.381743] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T19:43:43.843271] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-19T19:43:44.643321] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-19T19:43:44.856221] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:43:44.862055] [INFO ] [REMOTE ] KW: Full fetch complete (56759 records). [2025-09-19T19:43:44.862162] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-19T19:43:45.294749] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-19T19:43:45.294925] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-19T19:43:45.295886] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-19T19:43:45.295964] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-19T19:43:45.297682] [DEBUG] [LOCAL ] KW: Trimmed 56759 records to 41246 (keeping 200 days of data) [2025-09-19T19:43:45.471342] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-19T19:43:45.549321] [DEBUG] [LOCAL ] KW: Primary data saved (41246 records). [2025-09-19T19:43:45.549444] [INFO ] [MAIN ] KW: Full history saved. [2025-09-19T19:43:45.549599] [INFO ] [MAIN ] Update Progress: 1234/2372 symbols completed. KW took 38.2s. Estimated remaining: 2h 30m 57s. Rate: 7.5 symbols/min [2025-09-19T19:43:45.742339] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:43:45.767911] [DEBUG] [LOCAL ] LAD: Loaded 24252 existing records from primary storage. [2025-09-19T19:43:45.768046] [INFO ] [MAIN ] LAD: Loaded 24252 existing records. [2025-09-19T19:43:45.971129] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:43:45.971476] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-19T19:43:45.971552] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-19T19:43:45.972237] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-19T19:43:45.972311] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-19T19:43:46.334185] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:43:46.334675] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-19T19:43:46.392197] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-19T19:43:46.409058] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T19:43:47.043245] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-19T19:43:47.086855] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:43:47.843275] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-19T19:43:47.906348] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-19T19:43:48.643245] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-19T19:43:49.190421] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T19:43:49.443264] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-19T19:43:49.597447] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:43:50.066452] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T19:43:50.243254] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-19T19:43:51.043315] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-19T19:43:51.154512] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T19:43:51.843264] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-19T19:43:52.138194] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T19:43:52.524688] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T19:43:52.643261] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-19T19:43:53.443248] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-19T19:43:53.948799] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T19:43:54.243233] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-19T19:43:54.415085] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T19:43:55.043286] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-19T19:43:55.122150] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T19:43:55.843240] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-19T19:43:56.482005] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:43:56.568951] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T19:43:56.643224] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-19T19:43:57.443274] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-19T19:43:57.567539] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T19:43:58.243312] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-19T19:43:58.866279] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T19:43:58.989571] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T19:43:59.043226] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-19T19:43:59.843283] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-19T19:44:00.040155] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T19:44:00.552043] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T19:44:00.643257] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-19T19:44:01.443297] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-19T19:44:01.489965] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:44:01.639720] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T19:44:01.644576] [INFO ] [REMOTE ] KYN: Full fetch complete (45200 records). [2025-09-19T19:44:01.644760] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-19T19:44:02.048075] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-19T19:44:02.048211] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-19T19:44:02.049122] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-19T19:44:02.049220] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-19T19:44:02.050539] [DEBUG] [LOCAL ] KYN: Trimmed 45200 records to 30875 (keeping 200 days of data) [2025-09-19T19:44:02.246496] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-19T19:44:02.266384] [DEBUG] [LOCAL ] KYN: Primary data saved (30875 records). [2025-09-19T19:44:02.266570] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-19T19:44:02.266782] [INFO ] [MAIN ] Update Progress: 1235/2372 symbols completed. KYN took 31.2s. Estimated remaining: 2h 30m 57s. Rate: 7.5 symbols/min [2025-09-19T19:44:02.468319] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:02.521340] [DEBUG] [LOCAL ] LADR: Loaded 38963 existing records from primary storage. [2025-09-19T19:44:02.522169] [INFO ] [MAIN ] LADR: Loaded 38963 existing records. [2025-09-19T19:44:02.707406] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:02.707913] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-19T19:44:02.707983] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-19T19:44:02.709093] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-19T19:44:02.709167] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-19T19:44:03.062579] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-19T19:44:03.067865] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:03.213787] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T19:44:03.843247] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-19T19:44:03.958881] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T19:44:04.643335] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-19T19:44:05.081309] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T19:44:05.163170] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T19:44:05.443282] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-19T19:44:05.918887] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T19:44:06.243304] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-19T19:44:06.800986] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T19:44:06.808876] [INFO ] [REMOTE ] L: Full fetch complete (59458 records). [2025-09-19T19:44:06.809051] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-19T19:44:07.055391] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-19T19:44:07.234619] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-19T19:44:07.234737] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-19T19:44:07.235668] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-19T19:44:07.235731] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-19T19:44:07.236982] [DEBUG] [LOCAL ] L: Trimmed 59458 records to 41511 (keeping 200 days of data) [2025-09-19T19:44:07.507165] [DEBUG] [LOCAL ] L: Primary data saved (41511 records). [2025-09-19T19:44:07.507302] [INFO ] [MAIN ] L: Full history saved. [2025-09-19T19:44:07.507426] [INFO ] [MAIN ] Update Progress: 1236/2372 symbols completed. L took 29.3s. Estimated remaining: 2h 30m 47s. Rate: 7.5 symbols/min [2025-09-19T19:44:07.687501] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:07.693938] [DEBUG] [LOCAL ] LANV: Loaded 2666 existing records from primary storage. [2025-09-19T19:44:07.694049] [INFO ] [MAIN ] LANV: Loaded 2666 existing records. [2025-09-19T19:44:07.850687] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-19T19:44:07.894374] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:07.895766] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-19T19:44:07.895855] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-19T19:44:07.896215] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-19T19:44:07.896287] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-19T19:44:08.252876] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T19:44:08.300968] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:08.643284] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-19T19:44:09.235312] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T19:44:09.346789] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T19:44:09.443275] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-19T19:44:09.523385] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-19T19:44:10.107984] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T19:44:10.243347] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-19T19:44:11.043311] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-19T19:44:11.843288] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-19T19:44:12.442175] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T19:44:12.643240] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-19T19:44:12.766004] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T19:44:12.962985] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T19:44:13.443279] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-19T19:44:14.243286] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-19T19:44:14.790273] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T19:44:14.804865] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T19:44:14.806122] [INFO ] [REMOTE ] LAC: Full fetch complete (75958 records). [2025-09-19T19:44:14.806450] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-19T19:44:15.048356] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-19T19:44:15.238706] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-19T19:44:15.238915] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-19T19:44:15.240081] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-19T19:44:15.240289] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-19T19:44:15.242594] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T19:44:15.252257] [DEBUG] [LOCAL ] LAC: Trimmed 75958 records to 53062 (keeping 200 days of data) [2025-09-19T19:44:15.487716] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-19T19:44:15.584830] [DEBUG] [LOCAL ] LAC: Primary data saved (53062 records). [2025-09-19T19:44:15.584976] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-19T19:44:15.585095] [INFO ] [MAIN ] Update Progress: 1237/2372 symbols completed. LAC took 34.5s. Estimated remaining: 2h 30m 39s. Rate: 7.5 symbols/min [2025-09-19T19:44:15.843308] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-19T19:44:16.643272] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-19T19:44:17.054521] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-19T19:44:17.207890] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T19:44:17.443269] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-19T19:44:17.946116] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T19:44:18.243320] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-19T19:44:18.777310] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-19T19:44:19.043261] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-19T19:44:19.843259] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-19T19:44:20.352583] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T19:44:20.356108] [INFO ] [REMOTE ] LAD: Full fetch complete (35342 records). [2025-09-19T19:44:20.356308] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-19T19:44:20.648968] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-19T19:44:20.745089] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-19T19:44:20.745183] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-19T19:44:20.745886] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-19T19:44:20.745948] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-19T19:44:20.746929] [DEBUG] [LOCAL ] LAD: Trimmed 35342 records to 24380 (keeping 200 days of data) [2025-09-19T19:44:20.915464] [DEBUG] [LOCAL ] LAD: Primary data saved (24380 records). [2025-09-19T19:44:20.915607] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-19T19:44:20.915732] [INFO ] [MAIN ] Update Progress: 1238/2372 symbols completed. LAD took 35.4s. Estimated remaining: 2h 30m 29s. Rate: 7.5 symbols/min [2025-09-19T19:44:21.210347] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:44:21.248824] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T19:44:21.443327] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-19T19:44:22.128253] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T19:44:22.243315] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-19T19:44:23.043311] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-19T19:44:23.100911] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:44:23.102878] [INFO ] [REMOTE ] LANV: Full fetch complete (4336 records). [2025-09-19T19:44:23.102988] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-19T19:44:23.662498] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-19T19:44:23.662706] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-19T19:44:23.663014] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-19T19:44:23.663092] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-19T19:44:23.663975] [DEBUG] [LOCAL ] LANV: Trimmed 4336 records to 2699 (keeping 200 days of data) [2025-09-19T19:44:23.682912] [DEBUG] [LOCAL ] LANV: Primary data saved (2699 records). [2025-09-19T19:44:23.683054] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-19T19:44:23.683159] [INFO ] [MAIN ] Update Progress: 1239/2372 symbols completed. LANV took 16.2s. Estimated remaining: 2h 30m 16s. Rate: 7.5 symbols/min [2025-09-19T19:44:24.922838] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:44:24.930625] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-19T19:44:26.466397] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T19:44:26.474351] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-19T19:44:28.167189] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T19:44:28.176383] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-19T19:44:29.746778] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T19:44:29.754859] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-19T19:44:31.650544] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T19:44:31.656882] [INFO ] [REMOTE ] LADR: Full fetch complete (54903 records). [2025-09-19T19:44:31.657030] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-19T19:44:32.071845] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-19T19:44:32.071978] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-19T19:44:32.073044] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-19T19:44:32.073136] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-19T19:44:32.074807] [DEBUG] [LOCAL ] LADR: Trimmed 54903 records to 39244 (keeping 200 days of data) [2025-09-19T19:44:32.318283] [DEBUG] [LOCAL ] LADR: Primary data saved (39244 records). [2025-09-19T19:44:32.318431] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-19T19:44:32.319825] [INFO ] [MAIN ] Update Progress: 1240/2372 symbols completed. LADR took 30.1s. Estimated remaining: 2h 30m 9s. Rate: 7.5 symbols/min [2025-09-19T19:44:32.985768] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:33.023019] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:33.066019] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-19T19:44:33.065442] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:33.066202] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-19T19:44:33.046229] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:33.066680] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-19T19:44:33.066803] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-19T19:44:33.067886] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-19T19:44:33.073560] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-19T19:44:33.194897] [DEBUG] [LOCAL ] LAW: Loaded 13988 existing records from primary storage. [2025-09-19T19:44:33.195272] [INFO ] [MAIN ] LAW: Loaded 13988 existing records. [2025-09-19T19:44:33.503709] [DEBUG] [LOCAL ] LAZ: Loaded 45782 existing records from primary storage. [2025-09-19T19:44:33.524251] [INFO ] [MAIN ] LAZ: Loaded 45782 existing records. [2025-09-19T19:44:33.561468] [DEBUG] [LOCAL ] LB: Loaded 38177 existing records from primary storage. [2025-09-19T19:44:33.666815] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:33.658137] [INFO ] [MAIN ] LB: Loaded 38177 existing records. [2025-09-19T19:44:33.786392] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-19T19:44:33.848050] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-19T19:44:33.872486] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:33.883176] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-19T19:44:33.890581] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-19T19:44:33.927823] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-19T19:44:34.105422] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:34.137619] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-19T19:44:34.163133] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-19T19:44:34.220881] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-19T19:44:34.228483] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:34.228586] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-19T19:44:34.249790] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:44:34.281187] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-19T19:44:34.275749] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-19T19:44:34.311740] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-19T19:44:34.358184] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-19T19:44:34.363797] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-19T19:44:34.312256] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-19T19:44:35.096906] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:35.128126] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-19T19:44:35.213056] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:35.224580] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-19T19:44:35.306785] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:35.307150] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-19T19:44:35.419321] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T19:44:35.422447] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-19T19:44:36.377002] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:44:36.380940] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-19T19:44:37.141972] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T19:44:37.150960] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-19T19:44:37.227479] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T19:44:37.236397] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-19T19:44:37.264726] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T19:44:37.274222] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-19T19:44:37.339841] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T19:44:37.343412] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-19T19:44:38.472187] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T19:44:38.476217] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-19T19:44:38.887959] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T19:44:38.897133] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-19T19:44:38.934997] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T19:44:38.945417] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-19T19:44:39.022356] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T19:44:39.032052] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-19T19:44:39.506073] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T19:44:39.509637] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-19T19:44:40.453507] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T19:44:40.457112] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-19T19:44:40.581894] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T19:44:40.643254] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-19T19:44:40.896301] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T19:44:41.178258] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-19T19:44:41.443269] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-19T19:44:41.556364] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T19:44:42.243275] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-19T19:44:42.412120] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T19:44:43.010986] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T19:44:43.043225] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-19T19:44:43.258119] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T19:44:43.624936] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-19T19:44:43.843269] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-19T19:44:44.643276] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-19T19:44:45.374150] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T19:44:45.396547] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T19:44:45.443265] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-19T19:44:46.243272] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-19T19:44:47.043348] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-19T19:44:47.321638] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T19:44:47.843328] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-19T19:44:47.949932] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T19:44:48.643253] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-19T19:44:48.836447] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T19:44:48.943613] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T19:44:48.946571] [INFO ] [REMOTE ] LAW: Full fetch complete (20680 records). [2025-09-19T19:44:48.946677] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-19T19:44:49.320522] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-19T19:44:49.320818] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-19T19:44:49.321315] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-19T19:44:49.321356] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-19T19:44:49.322005] [DEBUG] [LOCAL ] LAW: Trimmed 20680 records to 14108 (keeping 200 days of data) [2025-09-19T19:44:49.402740] [DEBUG] [LOCAL ] LAW: Primary data saved (14108 records). [2025-09-19T19:44:49.402904] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-19T19:44:49.402994] [INFO ] [MAIN ] Update Progress: 1241/2372 symbols completed. LAW took 17.1s. Estimated remaining: 2h 30m 9s. Rate: 7.5 symbols/min [2025-09-19T19:44:49.448467] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-19T19:44:49.579974] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:49.645220] [DEBUG] [LOCAL ] LBRT: Loaded 53311 existing records from primary storage. [2025-09-19T19:44:49.645382] [INFO ] [MAIN ] LBRT: Loaded 53311 existing records. [2025-09-19T19:44:49.827877] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:49.828251] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-19T19:44:49.828319] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-19T19:44:49.829931] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-19T19:44:49.829996] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-19T19:44:50.208031] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:50.231083] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T19:44:50.243221] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-19T19:44:51.043253] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-19T19:44:51.210144] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T19:44:51.843312] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-19T19:44:52.060356] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:44:52.643235] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-19T19:44:53.205573] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T19:44:53.443277] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-19T19:44:53.650750] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T19:44:54.243271] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-19T19:44:54.546173] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:44:55.043261] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-19T19:44:55.429034] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:44:55.843260] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-19T19:44:55.893126] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T19:44:56.631152] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T19:44:56.636243] [INFO ] [REMOTE ] LB: Full fetch complete (56158 records). [2025-09-19T19:44:56.636344] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-19T19:44:56.649568] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-19T19:44:57.042997] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-19T19:44:57.043102] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-19T19:44:57.044169] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-19T19:44:57.044237] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-19T19:44:57.045533] [DEBUG] [LOCAL ] LB: Trimmed 56158 records to 38376 (keeping 200 days of data) [2025-09-19T19:44:57.287844] [DEBUG] [LOCAL ] LB: Primary data saved (38376 records). [2025-09-19T19:44:57.288017] [INFO ] [MAIN ] LB: Full history saved. [2025-09-19T19:44:57.288380] [INFO ] [MAIN ] Update Progress: 1242/2372 symbols completed. LB took 25.0s. Estimated remaining: 2h 30m 1s. Rate: 7.5 symbols/min [2025-09-19T19:44:57.454797] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-19T19:44:57.458239] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:44:57.506269] [DEBUG] [LOCAL ] LC: Loaded 48396 existing records from primary storage. [2025-09-19T19:44:57.506421] [INFO ] [MAIN ] LC: Loaded 48396 existing records. [2025-09-19T19:44:57.688960] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:44:57.689480] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-19T19:44:57.689550] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-19T19:44:57.690803] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-19T19:44:57.690866] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-19T19:44:58.079941] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T19:44:58.124431] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:44:58.243269] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-19T19:44:58.801007] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T19:44:59.043251] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-19T19:44:59.405250] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:44:59.843268] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-19T19:45:00.148958] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T19:45:00.643298] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-19T19:45:00.996188] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:45:01.443306] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-19T19:45:01.946229] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T19:45:02.243313] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-19T19:45:02.880171] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T19:45:03.043299] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-19T19:45:03.843338] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-19T19:45:04.834182] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (3.39 seconds). [2025-09-19T19:45:04.841049] [INFO ] [REMOTE ] LAZ: Full fetch complete (65705 records). [2025-09-19T19:45:04.841171] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-19T19:45:05.226845] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-19T19:45:05.226925] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-19T19:45:05.227820] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-19T19:45:05.227882] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-19T19:45:05.229171] [DEBUG] [LOCAL ] LAZ: Trimmed 65705 records to 46085 (keeping 200 days of data) [2025-09-19T19:45:05.514363] [DEBUG] [LOCAL ] LAZ: Primary data saved (46085 records). [2025-09-19T19:45:05.514517] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-19T19:45:05.514607] [INFO ] [MAIN ] Update Progress: 1243/2372 symbols completed. LAZ took 33.2s. Estimated remaining: 2h 29m 53s. Rate: 7.5 symbols/min [2025-09-19T19:45:05.684231] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:05.713383] [DEBUG] [LOCAL ] LCII: Loaded 28969 existing records from primary storage. [2025-09-19T19:45:05.713539] [INFO ] [MAIN ] LCII: Loaded 28969 existing records. [2025-09-19T19:45:05.892050] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:05.892458] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-19T19:45:05.892546] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-19T19:45:05.893420] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-19T19:45:05.893481] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-19T19:45:06.224632] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (3.98 seconds). [2025-09-19T19:45:06.288090] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-19T19:45:06.322299] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:06.323073] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-19T19:45:06.396635] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-19T19:45:06.408904] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-19T19:45:06.719856] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (3.68 seconds). [2025-09-19T19:45:06.727453] [INFO ] [REMOTE ] LAR: Full fetch complete (53671 records). [2025-09-19T19:45:06.727563] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-19T19:45:06.917142] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-09-19T19:45:06.917858] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:45:06.917931] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:45:06.918006] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-19T19:45:06.918083] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-19T19:45:06.918120] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-19T19:45:06.918225] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-19T19:45:06.918323] [INFO ] [MAIN ] Update Progress: 1244/2372 symbols completed. LAR took 34.6s. Estimated remaining: 2h 29m 39s. Rate: 7.5 symbols/min [2025-09-19T19:45:07.118501] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:07.162722] [DEBUG] [LOCAL ] LDI: Loaded 43745 existing records from primary storage. [2025-09-19T19:45:07.162895] [INFO ] [MAIN ] LDI: Loaded 43745 existing records. [2025-09-19T19:45:07.339346] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:07.339708] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-19T19:45:07.339771] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-19T19:45:07.340936] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-19T19:45:07.340996] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-19T19:45:07.702629] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:07.703315] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-19T19:45:07.719476] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T19:45:07.843260] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-19T19:45:08.284340] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T19:45:08.464058] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T19:45:08.607295] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T19:45:08.643228] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-19T19:45:09.441678] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T19:45:09.444795] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-19T19:45:10.054963] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T19:45:10.243253] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-19T19:45:11.043261] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-19T19:45:11.367700] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T19:45:11.848368] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-19T19:45:11.867279] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T19:45:12.643313] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-19T19:45:12.990031] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T19:45:13.443277] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-19T19:45:13.850015] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T19:45:14.243277] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-19T19:45:14.309127] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T19:45:15.043241] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-19T19:45:15.726187] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T19:45:15.836296] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T19:45:15.843522] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-19T19:45:16.643329] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-19T19:45:16.801210] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T19:45:17.443331] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-19T19:45:18.058574] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T19:45:18.243267] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-19T19:45:18.628454] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:45:18.978737] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:45:19.043306] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-19T19:45:19.830299] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T19:45:19.843228] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-19T19:45:20.443547] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T19:45:20.643271] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-19T19:45:21.443319] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-19T19:45:21.896594] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T19:45:22.171173] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T19:45:22.243225] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-19T19:45:23.043219] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-19T19:45:23.237051] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T19:45:23.622947] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T19:45:23.843294] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-19T19:45:24.643279] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-19T19:45:25.050326] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T19:45:25.443278] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-19T19:45:25.563436] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T19:45:25.898682] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T19:45:25.902240] [INFO ] [REMOTE ] LCII: Full fetch complete (38907 records). [2025-09-19T19:45:25.902336] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-19T19:45:26.253439] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-19T19:45:26.297416] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-19T19:45:26.297502] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-19T19:45:26.298299] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-19T19:45:26.298363] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-19T19:45:26.299476] [DEBUG] [LOCAL ] LCII: Trimmed 38907 records to 29177 (keeping 200 days of data) [2025-09-19T19:45:26.501482] [DEBUG] [LOCAL ] LCII: Primary data saved (29177 records). [2025-09-19T19:45:26.501673] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-19T19:45:26.501795] [INFO ] [MAIN ] Update Progress: 1245/2372 symbols completed. LCII took 21.0s. Estimated remaining: 2h 29m 42s. Rate: 7.5 symbols/min [2025-09-19T19:45:26.679184] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:26.730862] [DEBUG] [LOCAL ] LDOS: Loaded 46352 existing records from primary storage. [2025-09-19T19:45:26.731040] [INFO ] [MAIN ] LDOS: Loaded 46352 existing records. [2025-09-19T19:45:26.918899] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:26.919154] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-19T19:45:26.919204] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-19T19:45:26.920735] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-19T19:45:26.920797] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-19T19:45:27.048381] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-19T19:45:27.306616] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:27.478813] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T19:45:27.843301] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-19T19:45:27.961820] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:45:28.643322] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-19T19:45:29.233874] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T19:45:29.241565] [INFO ] [REMOTE ] LC: Full fetch complete (70300 records). [2025-09-19T19:45:29.241750] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-19T19:45:29.448939] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-19T19:45:29.662452] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-19T19:45:29.662542] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-19T19:45:29.663609] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-19T19:45:29.663698] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-19T19:45:29.665203] [DEBUG] [LOCAL ] LC: Trimmed 70300 records to 48747 (keeping 200 days of data) [2025-09-19T19:45:29.892782] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T19:45:29.903735] [INFO ] [REMOTE ] LBRT: Full fetch complete (76486 records). [2025-09-19T19:45:29.904496] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-19T19:45:30.435056] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-19T19:45:30.436936] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-19T19:45:30.437994] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-19T19:45:30.438077] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-19T19:45:30.447062] [DEBUG] [LOCAL ] LBRT: Trimmed 76486 records to 53697 (keeping 200 days of data) [2025-09-19T19:45:30.520679] [DEBUG] [LOCAL ] LC: Primary data saved (48747 records). [2025-09-19T19:45:30.546545] [INFO ] [MAIN ] LC: Full history saved. [2025-09-19T19:45:30.548102] [INFO ] [MAIN ] Update Progress: 1246/2372 symbols completed. LC took 33.3s. Estimated remaining: 2h 29m 30s. Rate: 7.5 symbols/min [2025-09-19T19:45:30.733297] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:30.756919] [DEBUG] [LOCAL ] LDP: Loaded 13295 existing records from primary storage. [2025-09-19T19:45:30.757170] [INFO ] [MAIN ] LDP: Loaded 13295 existing records. [2025-09-19T19:45:30.908569] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:45:30.965985] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-19T19:45:30.999722] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:31.001718] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-19T19:45:31.001788] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-19T19:45:31.002832] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-19T19:45:31.003143] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-19T19:45:31.500729] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:31.506096] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-19T19:45:31.622885] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T19:45:31.649736] [DEBUG] [LOCAL ] LBRT: Primary data saved (53697 records). [2025-09-19T19:45:31.649917] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-19T19:45:31.650017] [INFO ] [MAIN ] Update Progress: 1247/2372 symbols completed. LBRT took 42.2s. Estimated remaining: 2h 29m 16s. Rate: 7.5 symbols/min [2025-09-19T19:45:31.829591] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:31.843281] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-19T19:45:31.874190] [DEBUG] [LOCAL ] LEA: Loaded 42219 existing records from primary storage. [2025-09-19T19:45:31.874347] [INFO ] [MAIN ] LEA: Loaded 42219 existing records. [2025-09-19T19:45:32.056894] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:32.057227] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-19T19:45:32.057302] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-19T19:45:32.058718] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-19T19:45:32.058783] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-19T19:45:32.423728] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:32.643271] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-19T19:45:32.788085] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T19:45:32.994127] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T19:45:33.443276] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-19T19:45:33.678810] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:45:34.039250] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T19:45:34.243261] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-19T19:45:35.026066] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T19:45:35.043222] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-19T19:45:35.843268] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-19T19:45:35.918271] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T19:45:36.643281] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-19T19:45:37.299263] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T19:45:37.443300] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-19T19:45:38.099995] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T19:45:38.108182] [INFO ] [REMOTE ] LDI: Full fetch complete (59993 records). [2025-09-19T19:45:38.108300] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-19T19:45:38.258664] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-19T19:45:38.527934] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-19T19:45:38.528064] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-19T19:45:38.529099] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-19T19:45:38.529238] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-19T19:45:38.552340] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T19:45:38.552527] [DEBUG] [LOCAL ] LDI: Trimmed 59993 records to 44135 (keeping 200 days of data) [2025-09-19T19:45:38.818510] [DEBUG] [LOCAL ] LDI: Primary data saved (44135 records). [2025-09-19T19:45:38.818676] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-19T19:45:38.818788] [INFO ] [MAIN ] Update Progress: 1248/2372 symbols completed. LDI took 31.9s. Estimated remaining: 2h 29m 7s. Rate: 7.5 symbols/min [2025-09-19T19:45:38.995169] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:39.046075] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-19T19:45:39.048505] [DEBUG] [LOCAL ] LEG: Loaded 50752 existing records from primary storage. [2025-09-19T19:45:39.048763] [INFO ] [MAIN ] LEG: Loaded 50752 existing records. [2025-09-19T19:45:39.239028] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:39.239352] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-19T19:45:39.239421] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-19T19:45:39.240939] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-19T19:45:39.241012] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-19T19:45:39.645253] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:39.688202] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T19:45:39.723822] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:45:39.843226] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-19T19:45:40.643280] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-19T19:45:40.649602] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T19:45:41.443280] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-19T19:45:41.739145] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T19:45:42.243333] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-19T19:45:42.633160] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T19:45:43.043231] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-19T19:45:43.191259] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T19:45:43.403589] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T19:45:43.843277] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-19T19:45:44.643284] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-19T19:45:44.851748] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T19:45:44.928904] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T19:45:45.443316] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-19T19:45:46.243311] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-19T19:45:46.577367] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T19:45:47.043255] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-19T19:45:47.339625] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T19:45:47.569738] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T19:45:47.843267] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-19T19:45:48.581206] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T19:45:48.643226] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-19T19:45:48.933245] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-19T19:45:49.443259] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-19T19:45:50.243274] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-19T19:45:50.461451] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T19:45:50.482500] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T19:45:51.043294] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-19T19:45:51.384106] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T19:45:51.843263] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-19T19:45:52.643306] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-19T19:45:52.854245] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:45:52.860814] [INFO ] [REMOTE ] LDOS: Full fetch complete (67887 records). [2025-09-19T19:45:52.860945] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-19T19:45:53.257271] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-19T19:45:53.257532] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-19T19:45:53.258788] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-19T19:45:53.258914] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-19T19:45:53.261167] [DEBUG] [LOCAL ] LDOS: Trimmed 67887 records to 46704 (keeping 200 days of data) [2025-09-19T19:45:53.377844] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T19:45:53.482811] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-19T19:45:53.605682] [DEBUG] [LOCAL ] LDOS: Primary data saved (46704 records). [2025-09-19T19:45:53.605846] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-19T19:45:53.605959] [INFO ] [MAIN ] Update Progress: 1249/2372 symbols completed. LDOS took 27.1s. Estimated remaining: 2h 29m 6s. Rate: 7.5 symbols/min [2025-09-19T19:45:53.790784] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:45:53.859391] [DEBUG] [LOCAL ] LEN: Loaded 53574 existing records from primary storage. [2025-09-19T19:45:53.859560] [INFO ] [MAIN ] LEN: Loaded 53574 existing records. [2025-09-19T19:45:54.045553] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:45:54.045874] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-19T19:45:54.045929] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-19T19:45:54.047630] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-19T19:45:54.047721] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-19T19:45:54.267075] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-19T19:45:54.432058] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:45:54.471753] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T19:45:55.043266] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-19T19:45:55.310531] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T19:45:55.702943] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T19:45:55.843258] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-19T19:45:56.643282] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-19T19:45:57.128954] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T19:45:57.228406] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T19:45:57.443273] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-19T19:45:57.588314] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T19:45:58.243277] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-19T19:45:59.043243] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-19T19:45:59.263259] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T19:45:59.269895] [INFO ] [REMOTE ] LEA: Full fetch complete (60998 records). [2025-09-19T19:45:59.270053] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-19T19:45:59.688580] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-19T19:45:59.688704] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-19T19:45:59.689585] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-19T19:45:59.689662] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-19T19:45:59.691023] [DEBUG] [LOCAL ] LEA: Trimmed 60998 records to 42546 (keeping 200 days of data) [2025-09-19T19:45:59.881173] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-19T19:45:59.977681] [DEBUG] [LOCAL ] LEA: Primary data saved (42546 records). [2025-09-19T19:45:59.977841] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-19T19:45:59.978044] [INFO ] [MAIN ] Update Progress: 1250/2372 symbols completed. LEA took 28.3s. Estimated remaining: 2h 28m 56s. Rate: 7.5 symbols/min [2025-09-19T19:46:00.182091] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:00.227918] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T19:46:00.252334] [DEBUG] [LOCAL ] LEO: Loaded 17840 existing records from primary storage. [2025-09-19T19:46:00.253846] [INFO ] [MAIN ] LEO: Loaded 17840 existing records. [2025-09-19T19:46:00.254250] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T19:46:00.300753] [INFO ] [REMOTE ] LDP: Full fetch complete (19501 records). [2025-09-19T19:46:00.322774] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-19T19:46:00.612436] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:00.614735] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-19T19:46:00.630857] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-19T19:46:00.642110] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-19T19:46:00.652917] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-19T19:46:00.652682] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-19T19:46:01.008964] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-19T19:46:01.023490] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-19T19:46:01.033867] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-19T19:46:01.053937] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-19T19:46:01.122822] [DEBUG] [LOCAL ] LDP: Trimmed 19501 records to 13351 (keeping 200 days of data) [2025-09-19T19:46:01.281281] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:01.301618] [DEBUG] [LOCAL ] LDP: Primary data saved (13351 records). [2025-09-19T19:46:01.301794] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-19T19:46:01.301938] [INFO ] [MAIN ] Update Progress: 1251/2372 symbols completed. LDP took 30.8s. Estimated remaining: 2h 28m 42s. Rate: 7.5 symbols/min [2025-09-19T19:46:01.447962] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-19T19:46:01.480527] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:01.549226] [DEBUG] [LOCAL ] LEVI: Loaded 51868 existing records from primary storage. [2025-09-19T19:46:01.549396] [INFO ] [MAIN ] LEVI: Loaded 51868 existing records. [2025-09-19T19:46:01.728848] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:01.729092] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-19T19:46:01.729161] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-19T19:46:01.730232] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-19T19:46:01.730294] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-19T19:46:02.120419] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:02.190320] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T19:46:02.188689] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T19:46:02.243271] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-19T19:46:02.748806] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T19:46:03.043267] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-19T19:46:03.843276] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-19T19:46:04.160041] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T19:46:04.242019] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T19:46:04.643280] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-19T19:46:05.443269] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-19T19:46:05.758691] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T19:46:06.243232] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-19T19:46:06.584725] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T19:46:06.724804] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T19:46:07.043247] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-19T19:46:07.843268] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-19T19:46:08.262078] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T19:46:08.331247] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T19:46:08.643272] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-19T19:46:09.443322] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-19T19:46:10.071469] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T19:46:10.245387] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-19T19:46:10.507442] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:46:11.043319] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-19T19:46:11.611333] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T19:46:11.843324] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-19T19:46:12.162059] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T19:46:12.174334] [INFO ] [REMOTE ] LEG: Full fetch complete (73212 records). [2025-09-19T19:46:12.174591] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-19T19:46:12.625340] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T19:46:12.624200] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-19T19:46:12.631138] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-19T19:46:12.632611] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-19T19:46:12.632746] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-19T19:46:12.634176] [DEBUG] [LOCAL ] LEG: Trimmed 73212 records to 51158 (keeping 200 days of data) [2025-09-19T19:46:12.643236] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-19T19:46:12.976738] [DEBUG] [LOCAL ] LEG: Primary data saved (51158 records). [2025-09-19T19:46:12.976904] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-19T19:46:12.977054] [INFO ] [MAIN ] Update Progress: 1252/2372 symbols completed. LEG took 34.2s. Estimated remaining: 2h 28m 38s. Rate: 7.5 symbols/min [2025-09-19T19:46:13.163067] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:13.182500] [DEBUG] [LOCAL ] LFT: Loaded 17989 existing records from primary storage. [2025-09-19T19:46:13.182716] [INFO ] [MAIN ] LFT: Loaded 17989 existing records. [2025-09-19T19:46:13.365750] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:13.365992] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-19T19:46:13.366042] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-19T19:46:13.366623] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-19T19:46:13.366729] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-19T19:46:13.456140] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-19T19:46:13.719022] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:13.796607] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T19:46:14.068920] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T19:46:14.243265] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-19T19:46:15.043337] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-19T19:46:15.505324] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T19:46:15.843283] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-19T19:46:16.467566] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T19:46:16.504550] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T19:46:16.643262] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-19T19:46:17.443291] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-19T19:46:17.831936] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:46:18.110700] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-19T19:46:18.243273] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-19T19:46:18.808921] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T19:46:19.043253] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-19T19:46:19.731063] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T19:46:19.767495] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T19:46:19.843266] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-19T19:46:20.643281] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-19T19:46:21.443279] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-19T19:46:21.879592] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T19:46:22.243322] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-19T19:46:22.479362] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T19:46:22.926414] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T19:46:23.043258] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-19T19:46:23.843263] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-19T19:46:23.966507] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T19:46:24.044438] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:46:24.643307] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-19T19:46:24.967444] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T19:46:25.443297] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-19T19:46:26.243248] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-19T19:46:26.359350] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T19:46:26.541215] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T19:46:27.043270] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-19T19:46:27.286721] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T19:46:27.289522] [INFO ] [REMOTE ] LEO: Full fetch complete (27174 records). [2025-09-19T19:46:27.289608] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-19T19:46:27.654453] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-19T19:46:27.654560] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-19T19:46:27.655156] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-19T19:46:27.655221] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-19T19:46:27.656118] [DEBUG] [LOCAL ] LEO: Trimmed 27174 records to 17935 (keeping 200 days of data) [2025-09-19T19:46:27.768304] [DEBUG] [LOCAL ] LEO: Primary data saved (17935 records). [2025-09-19T19:46:27.768458] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-19T19:46:27.768545] [INFO ] [MAIN ] Update Progress: 1253/2372 symbols completed. LEO took 27.8s. Estimated remaining: 2h 28m 36s. Rate: 7.5 symbols/min [2025-09-19T19:46:27.848381] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-19T19:46:27.946275] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:27.959398] [DEBUG] [LOCAL ] LGI: Loaded 10235 existing records from primary storage. [2025-09-19T19:46:27.959500] [INFO ] [MAIN ] LGI: Loaded 10235 existing records. [2025-09-19T19:46:28.132740] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:28.132959] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-19T19:46:28.133006] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-19T19:46:28.133412] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-19T19:46:28.133472] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-19T19:46:28.480622] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:28.643215] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-19T19:46:29.263758] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T19:46:29.443228] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-19T19:46:29.832745] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T19:46:29.947283] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T19:46:30.243258] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-19T19:46:31.043310] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-19T19:46:31.843271] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-19T19:46:31.946272] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-19T19:46:31.955605] [INFO ] [REMOTE ] LEN: Full fetch complete (76971 records). [2025-09-19T19:46:31.955748] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-19T19:46:32.348142] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-19T19:46:32.353476] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-19T19:46:32.360242] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-19T19:46:32.360335] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-19T19:46:32.361745] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T19:46:32.368497] [DEBUG] [LOCAL ] LEN: Trimmed 76971 records to 53964 (keeping 200 days of data) [2025-09-19T19:46:32.389676] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T19:46:32.461578] [INFO ] [REMOTE ] LEVI: Full fetch complete (74434 records). [2025-09-19T19:46:32.487816] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-19T19:46:32.563376] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T19:46:32.646634] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-19T19:46:33.048464] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-19T19:46:33.050424] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-19T19:46:33.052153] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-19T19:46:33.052499] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-19T19:46:33.069542] [DEBUG] [LOCAL ] LEVI: Trimmed 74434 records to 52245 (keeping 200 days of data) [2025-09-19T19:46:33.285168] [DEBUG] [LOCAL ] LEN: Primary data saved (53964 records). [2025-09-19T19:46:33.286983] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-19T19:46:33.290190] [INFO ] [MAIN ] Update Progress: 1254/2372 symbols completed. LEN took 39.7s. Estimated remaining: 2h 28m 26s. Rate: 7.5 symbols/min [2025-09-19T19:46:33.450957] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-19T19:46:33.580309] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:33.687599] [DEBUG] [LOCAL ] LEVI: Primary data saved (52245 records). [2025-09-19T19:46:33.688247] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-19T19:46:33.698407] [INFO ] [MAIN ] Update Progress: 1255/2372 symbols completed. LEVI took 32.4s. Estimated remaining: 2h 28m 11s. Rate: 7.5 symbols/min [2025-09-19T19:46:33.743065] [DEBUG] [LOCAL ] LH: Loaded 39098 existing records from primary storage. [2025-09-19T19:46:33.769475] [INFO ] [MAIN ] LH: Loaded 39098 existing records. [2025-09-19T19:46:34.006243] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:34.069353] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T19:46:34.070954] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:34.076740] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-19T19:46:34.076805] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-19T19:46:34.077901] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-19T19:46:34.077961] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-19T19:46:34.259271] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-19T19:46:34.407444] [DEBUG] [LOCAL ] LHX: Loaded 49373 existing records from primary storage. [2025-09-19T19:46:34.413214] [INFO ] [MAIN ] LHX: Loaded 49373 existing records. [2025-09-19T19:46:34.561836] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:34.597639] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T19:46:34.678071] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:34.678285] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-19T19:46:34.678354] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-19T19:46:34.679692] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-19T19:46:34.679754] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-19T19:46:35.025779] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:35.043217] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-19T19:46:35.669368] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T19:46:35.843281] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-19T19:46:36.542450] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:46:36.643291] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-19T19:46:37.072080] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T19:46:37.443282] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-19T19:46:37.633159] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T19:46:38.243269] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-19T19:46:39.043271] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-19T19:46:39.403373] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T19:46:39.477563] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T19:46:39.843271] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-19T19:46:39.980560] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T19:46:40.643261] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-19T19:46:41.443234] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-19T19:46:41.491856] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T19:46:41.963632] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T19:46:42.243278] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-19T19:46:42.441481] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T19:46:43.043309] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-19T19:46:43.389859] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T19:46:43.392436] [INFO ] [REMOTE ] LFT: Full fetch complete (23894 records). [2025-09-19T19:46:43.392519] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-19T19:46:43.762113] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-19T19:46:43.762194] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-19T19:46:43.762700] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-19T19:46:43.762789] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-19T19:46:43.763452] [DEBUG] [LOCAL ] LFT: Trimmed 23894 records to 18069 (keeping 200 days of data) [2025-09-19T19:46:43.843330] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-19T19:46:43.874300] [DEBUG] [LOCAL ] LFT: Primary data saved (18069 records). [2025-09-19T19:46:43.874459] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-19T19:46:43.874549] [INFO ] [MAIN ] Update Progress: 1256/2372 symbols completed. LFT took 30.9s. Estimated remaining: 2h 28m 5s. Rate: 7.5 symbols/min [2025-09-19T19:46:44.048189] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:44.077043] [DEBUG] [LOCAL ] LII: Loaded 28933 existing records from primary storage. [2025-09-19T19:46:44.077210] [INFO ] [MAIN ] LII: Loaded 28933 existing records. [2025-09-19T19:46:44.256084] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:44.256350] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-19T19:46:44.256409] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-19T19:46:44.257147] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-19T19:46:44.257207] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-19T19:46:44.614569] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:44.643210] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-19T19:46:44.748718] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T19:46:44.771801] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T19:46:45.443273] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-19T19:46:46.053423] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T19:46:46.243271] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-19T19:46:46.304064] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T19:46:47.043267] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-19T19:46:47.843292] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-19T19:46:48.124013] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T19:46:48.643285] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-19T19:46:48.949638] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T19:46:49.009762] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T19:46:49.443270] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-19T19:46:50.163219] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T19:46:50.243261] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-19T19:46:51.043238] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-19T19:46:51.698987] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T19:46:51.843243] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-19T19:46:51.870031] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T19:46:51.957064] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T19:46:51.958751] [INFO ] [REMOTE ] LGI: Full fetch complete (14270 records). [2025-09-19T19:46:51.958822] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-19T19:46:52.320767] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-19T19:46:52.320866] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-19T19:46:52.321206] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-19T19:46:52.321256] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-19T19:46:52.322043] [DEBUG] [LOCAL ] LGI: Trimmed 14270 records to 10308 (keeping 200 days of data) [2025-09-19T19:46:52.389860] [DEBUG] [LOCAL ] LGI: Primary data saved (10308 records). [2025-09-19T19:46:52.390004] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-19T19:46:52.390092] [INFO ] [MAIN ] Update Progress: 1257/2372 symbols completed. LGI took 24.6s. Estimated remaining: 2h 27m 58s. Rate: 7.5 symbols/min [2025-09-19T19:46:52.556961] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:46:52.600971] [DEBUG] [LOCAL ] LION: Loaded 42669 existing records from primary storage. [2025-09-19T19:46:52.601131] [INFO ] [MAIN ] LION: Loaded 42669 existing records. [2025-09-19T19:46:52.654542] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-19T19:46:52.784291] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:46:52.784531] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-19T19:46:52.784593] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-19T19:46:52.785449] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-19T19:46:52.785509] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-19T19:46:53.136442] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:46:53.443273] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-19T19:46:53.601764] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:46:54.243246] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-19T19:46:54.575349] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T19:46:55.043289] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-19T19:46:55.152146] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T19:46:55.173697] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T19:46:55.843269] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-19T19:46:56.643268] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-19T19:46:56.816241] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:46:57.127325] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:46:57.443263] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-19T19:46:58.243331] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-19T19:46:58.417062] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T19:46:59.050299] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-19T19:46:59.055147] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T19:46:59.153994] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T19:46:59.843268] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-19T19:47:00.643278] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-19T19:47:01.189882] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T19:47:01.443293] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-19T19:47:01.781209] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T19:47:02.194817] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T19:47:02.243283] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-19T19:47:02.657965] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T19:47:03.043266] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-19T19:47:03.843305] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-19T19:47:04.352456] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T19:47:04.501227] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T19:47:04.643238] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-19T19:47:05.352406] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:47:05.443252] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-19T19:47:06.243253] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-19T19:47:06.280252] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T19:47:07.033001] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T19:47:07.043466] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-19T19:47:07.812028] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T19:47:07.817219] [INFO ] [REMOTE ] LH: Full fetch complete (54893 records). [2025-09-19T19:47:07.817330] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-19T19:47:07.851843] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-19T19:47:08.234861] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-19T19:47:08.234942] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-19T19:47:08.235892] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-19T19:47:08.235958] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-19T19:47:08.237300] [DEBUG] [LOCAL ] LH: Trimmed 54893 records to 39293 (keeping 200 days of data) [2025-09-19T19:47:08.502592] [DEBUG] [LOCAL ] LH: Primary data saved (39293 records). [2025-09-19T19:47:08.502812] [INFO ] [MAIN ] LH: Full history saved. [2025-09-19T19:47:08.502914] [INFO ] [MAIN ] Update Progress: 1258/2372 symbols completed. LH took 35.2s. Estimated remaining: 2h 27m 57s. Rate: 7.5 symbols/min [2025-09-19T19:47:08.649060] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-19T19:47:08.676253] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:08.683227] [DEBUG] [LOCAL ] LITB: Loaded 4298 existing records from primary storage. [2025-09-19T19:47:08.683364] [INFO ] [MAIN ] LITB: Loaded 4298 existing records. [2025-09-19T19:47:08.862289] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:08.862684] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-19T19:47:08.862767] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-19T19:47:08.863055] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-19T19:47:08.863118] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-19T19:47:09.233994] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:09.264099] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T19:47:09.291160] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T19:47:09.443239] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-19T19:47:10.243251] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-19T19:47:10.803550] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T19:47:10.834588] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T19:47:11.043256] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-19T19:47:11.314376] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T19:47:11.843330] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-19T19:47:12.643266] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-19T19:47:13.011109] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T19:47:13.377321] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:47:13.381781] [INFO ] [REMOTE ] LII: Full fetch complete (41056 records). [2025-09-19T19:47:13.381877] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-19T19:47:13.448467] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-19T19:47:13.756984] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-19T19:47:13.757120] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-19T19:47:13.757897] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-19T19:47:13.757960] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-19T19:47:13.759043] [DEBUG] [LOCAL ] LII: Trimmed 41056 records to 29065 (keeping 200 days of data) [2025-09-19T19:47:13.855612] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-19T19:47:13.950557] [DEBUG] [LOCAL ] LII: Primary data saved (29065 records). [2025-09-19T19:47:13.950746] [INFO ] [MAIN ] LII: Full history saved. [2025-09-19T19:47:13.950973] [INFO ] [MAIN ] Update Progress: 1259/2372 symbols completed. LII took 30.1s. Estimated remaining: 2h 27m 47s. Rate: 7.5 symbols/min [2025-09-19T19:47:14.101336] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T19:47:14.171811] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:14.226929] [DEBUG] [LOCAL ] LLY: Loaded 53688 existing records from primary storage. [2025-09-19T19:47:14.227101] [INFO ] [MAIN ] LLY: Loaded 53688 existing records. [2025-09-19T19:47:14.248381] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-19T19:47:14.413235] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:14.413507] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-19T19:47:14.413601] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-19T19:47:14.415386] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-19T19:47:14.415465] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-19T19:47:14.785608] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:14.867294] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-19T19:47:15.043265] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-19T19:47:15.843266] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-19T19:47:16.643255] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-19T19:47:16.662853] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T19:47:17.025387] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T19:47:17.443304] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-19T19:47:18.243280] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-19T19:47:18.381388] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T19:47:18.715095] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T19:47:18.722493] [INFO ] [REMOTE ] LHX: Full fetch complete (70859 records). [2025-09-19T19:47:18.722601] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-19T19:47:19.057727] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-19T19:47:19.116299] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-19T19:47:19.116381] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-19T19:47:19.117613] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-19T19:47:19.117701] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-19T19:47:19.119176] [DEBUG] [LOCAL ] LHX: Trimmed 70859 records to 49633 (keeping 200 days of data) [2025-09-19T19:47:19.438849] [DEBUG] [LOCAL ] LHX: Primary data saved (49633 records). [2025-09-19T19:47:19.439018] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-19T19:47:19.439142] [INFO ] [MAIN ] Update Progress: 1260/2372 symbols completed. LHX took 45.7s. Estimated remaining: 2h 27m 36s. Rate: 7.5 symbols/min [2025-09-19T19:47:19.544907] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-19T19:47:19.617403] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:19.669888] [DEBUG] [LOCAL ] LMND: Loaded 52260 existing records from primary storage. [2025-09-19T19:47:19.670076] [INFO ] [MAIN ] LMND: Loaded 52260 existing records. [2025-09-19T19:47:19.847278] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-19T19:47:19.847445] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:19.848488] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-19T19:47:19.848547] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-19T19:47:19.849785] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-19T19:47:19.849847] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-19T19:47:20.209950] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:20.338614] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-19T19:47:20.643295] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-19T19:47:20.734264] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T19:47:21.178947] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T19:47:21.443342] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-19T19:47:22.243290] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-19T19:47:22.759848] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T19:47:23.043276] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-19T19:47:23.658742] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T19:47:23.843264] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-19T19:47:24.643264] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-19T19:47:25.443237] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-19T19:47:25.514568] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T19:47:25.516134] [INFO ] [REMOTE ] LITB: Full fetch complete (5546 records). [2025-09-19T19:47:25.516206] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-19T19:47:25.915589] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-19T19:47:25.915929] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-19T19:47:25.916120] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-19T19:47:25.916239] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-19T19:47:25.917137] [DEBUG] [LOCAL ] LITB: Trimmed 5546 records to 4328 (keeping 200 days of data) [2025-09-19T19:47:25.968501] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.93 seconds). [2025-09-19T19:47:25.986280] [DEBUG] [LOCAL ] LITB: Primary data saved (4328 records). [2025-09-19T19:47:25.986477] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-19T19:47:25.986630] [INFO ] [MAIN ] Update Progress: 1261/2372 symbols completed. LITB took 17.5s. Estimated remaining: 2h 27m 27s. Rate: 7.5 symbols/min [2025-09-19T19:47:26.140445] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-19T19:47:26.206957] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:26.253671] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-19T19:47:26.256732] [DEBUG] [LOCAL ] LMT: Loaded 50362 existing records from primary storage. [2025-09-19T19:47:26.256993] [INFO ] [MAIN ] LMT: Loaded 50362 existing records. [2025-09-19T19:47:26.438583] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:26.438900] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-19T19:47:26.438948] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-19T19:47:26.440569] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-19T19:47:26.440632] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-19T19:47:26.862291] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:27.043243] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-19T19:47:27.562830] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T19:47:27.569935] [INFO ] [REMOTE ] LION: Full fetch complete (53379 records). [2025-09-19T19:47:27.570034] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-19T19:47:27.851221] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-19T19:47:27.956051] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-19T19:47:27.956129] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-19T19:47:27.957002] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-19T19:47:27.957064] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-19T19:47:27.958264] [DEBUG] [LOCAL ] LION: Trimmed 53379 records to 43038 (keeping 200 days of data) [2025-09-19T19:47:28.201681] [DEBUG] [LOCAL ] LION: Primary data saved (43038 records). [2025-09-19T19:47:28.201830] [INFO ] [MAIN ] LION: Full history saved. [2025-09-19T19:47:28.201925] [INFO ] [MAIN ] Update Progress: 1262/2372 symbols completed. LION took 35.8s. Estimated remaining: 2h 27m 14s. Rate: 7.5 symbols/min [2025-09-19T19:47:28.371916] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:28.421778] [DEBUG] [LOCAL ] LNC: Loaded 52021 existing records from primary storage. [2025-09-19T19:47:28.421928] [INFO ] [MAIN ] LNC: Loaded 52021 existing records. [2025-09-19T19:47:28.598827] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:28.599072] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-19T19:47:28.599121] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-19T19:47:28.600134] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-19T19:47:28.600194] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-19T19:47:28.971223] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:28.971547] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-19T19:47:29.005112] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-19T19:47:29.404152] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-19T19:47:29.443219] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-19T19:47:30.207495] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T19:47:30.243320] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-19T19:47:30.831757] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T19:47:31.043340] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-19T19:47:31.838239] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-19T19:47:31.848167] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-19T19:47:32.324793] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T19:47:32.643274] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-19T19:47:32.932031] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T19:47:33.443274] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-19T19:47:33.534874] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T19:47:34.243312] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-19T19:47:34.990032] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-19T19:47:35.043226] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-19T19:47:35.310184] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T19:47:35.843307] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-19T19:47:36.540110] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T19:47:36.643224] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-19T19:47:37.201037] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T19:47:37.443277] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-19T19:47:37.617631] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T19:47:38.097404] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T19:47:38.243269] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-19T19:47:39.043282] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-19T19:47:39.657506] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T19:47:39.843227] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-19T19:47:40.540413] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-19T19:47:40.631481] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:47:40.643235] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-19T19:47:41.443270] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-19T19:47:42.187794] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-19T19:47:42.243239] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-19T19:47:42.623323] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T19:47:43.043265] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-19T19:47:43.843331] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-19T19:47:44.464309] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-09-19T19:47:44.643266] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-19T19:47:44.805370] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-19T19:47:44.845609] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T19:47:45.443276] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-19T19:47:46.243743] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-19T19:47:46.243637] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T19:47:46.995000] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-19T19:47:47.043229] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-19T19:47:47.843274] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-19T19:47:48.125573] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-19T19:47:48.238347] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T19:47:48.643266] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-19T19:47:49.146412] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T19:47:49.443231] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-19T19:47:49.997066] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T19:47:50.104792] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T19:47:50.243259] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-19T19:47:51.043263] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-19T19:47:51.848221] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-19T19:47:51.856918] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T19:47:52.513065] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T19:47:52.522051] [INFO ] [REMOTE ] LMND: Full fetch complete (75270 records). [2025-09-19T19:47:52.522218] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-19T19:47:52.648475] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-19T19:47:52.928478] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-19T19:47:52.928575] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-19T19:47:52.929633] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-19T19:47:52.929726] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-19T19:47:52.931322] [DEBUG] [LOCAL ] LMND: Trimmed 75270 records to 52648 (keeping 200 days of data) [2025-09-19T19:47:53.242130] [DEBUG] [LOCAL ] LMND: Primary data saved (52648 records). [2025-09-19T19:47:53.242278] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-19T19:47:53.242363] [INFO ] [MAIN ] Update Progress: 1263/2372 symbols completed. LMND took 33.8s. Estimated remaining: 2h 27m 21s. Rate: 7.5 symbols/min [2025-09-19T19:47:53.420990] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:53.429256] [DEBUG] [LOCAL ] LND: Loaded 5231 existing records from primary storage. [2025-09-19T19:47:53.429397] [INFO ] [MAIN ] LND: Loaded 5231 existing records. [2025-09-19T19:47:53.660570] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:53.661019] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-19T19:47:53.661085] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-19T19:47:53.661468] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-19T19:47:53.661565] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-19T19:47:54.120225] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:54.124339] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-19T19:47:54.123997] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-09-19T19:47:54.143233] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-19T19:47:54.156295] [INFO ] [REMOTE ] LNC: Full fetch complete (73917 records). [2025-09-19T19:47:54.156510] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-19T19:47:54.250602] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-19T19:47:54.598248] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-19T19:47:54.598367] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-19T19:47:54.599371] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-19T19:47:54.599436] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-19T19:47:54.600915] [DEBUG] [LOCAL ] LNC: Trimmed 73917 records to 52409 (keeping 200 days of data) [2025-09-19T19:47:54.917908] [DEBUG] [LOCAL ] LNC: Primary data saved (52409 records). [2025-09-19T19:47:54.918082] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-19T19:47:54.918234] [INFO ] [MAIN ] Update Progress: 1264/2372 symbols completed. LNC took 26.7s. Estimated remaining: 2h 27m 8s. Rate: 7.5 symbols/min [2025-09-19T19:47:55.095813] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:55.147147] [DEBUG] [LOCAL ] LNG: Loaded 51931 existing records from primary storage. [2025-09-19T19:47:55.147364] [INFO ] [MAIN ] LNG: Loaded 51931 existing records. [2025-09-19T19:47:55.289476] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T19:47:55.301228] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-19T19:47:55.350695] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-19T19:47:55.375606] [INFO ] [REMOTE ] LMT: Full fetch complete (72557 records). [2025-09-19T19:47:55.375801] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:55.376121] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-19T19:47:55.376349] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-19T19:47:55.376761] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-19T19:47:55.389128] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-19T19:47:55.409944] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-19T19:47:56.130622] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:56.148494] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-19T19:47:56.148839] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-19T19:47:56.148996] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-19T19:47:56.154740] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-19T19:47:56.156124] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-19T19:47:56.157408] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-19T19:47:56.160986] [DEBUG] [LOCAL ] LMT: Trimmed 72557 records to 50702 (keeping 200 days of data) [2025-09-19T19:47:56.484833] [DEBUG] [LOCAL ] LMT: Primary data saved (50702 records). [2025-09-19T19:47:56.484964] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-19T19:47:56.485056] [INFO ] [MAIN ] Update Progress: 1265/2372 symbols completed. LMT took 30.5s. Estimated remaining: 2h 26m 54s. Rate: 7.5 symbols/min [2025-09-19T19:47:56.650265] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-19T19:47:56.653867] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:47:56.668219] [DEBUG] [LOCAL ] LNN: Loaded 11338 existing records from primary storage. [2025-09-19T19:47:56.668420] [INFO ] [MAIN ] LNN: Loaded 11338 existing records. [2025-09-19T19:47:56.849692] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:47:56.849985] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-19T19:47:56.850033] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-19T19:47:56.850408] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-19T19:47:56.850466] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-19T19:47:57.208670] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:47:57.219039] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T19:47:57.263377] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (3.01 seconds). [2025-09-19T19:47:57.443270] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-19T19:47:57.533371] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T19:47:58.243244] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-19T19:47:58.393291] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T19:47:59.043301] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-19T19:47:59.843349] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-19T19:48:00.006278] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T19:48:00.643268] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-19T19:48:01.207758] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-09-19T19:48:01.216757] [INFO ] [REMOTE ] LLY: Full fetch complete (77254 records). [2025-09-19T19:48:01.216950] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-19T19:48:01.457161] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-19T19:48:01.620743] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-19T19:48:01.620976] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-19T19:48:01.628900] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-19T19:48:01.629004] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-19T19:48:01.630147] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T19:48:01.635362] [DEBUG] [LOCAL ] LLY: Trimmed 77254 records to 54077 (keeping 200 days of data) [2025-09-19T19:48:02.008527] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T19:48:02.044610] [DEBUG] [LOCAL ] LLY: Primary data saved (54077 records). [2025-09-19T19:48:02.044765] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-19T19:48:02.046566] [INFO ] [MAIN ] Update Progress: 1266/2372 symbols completed. LLY took 48.1s. Estimated remaining: 2h 26m 44s. Rate: 7.5 symbols/min [2025-09-19T19:48:02.222426] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:02.243259] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-19T19:48:02.271786] [DEBUG] [LOCAL ] LOAR: Loaded 41811 existing records from primary storage. [2025-09-19T19:48:02.271922] [INFO ] [MAIN ] LOAR: Loaded 41811 existing records. [2025-09-19T19:48:02.452275] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:02.452543] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-19T19:48:02.452592] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-19T19:48:02.453544] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-19T19:48:02.453615] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-19T19:48:02.811992] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:03.043263] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-19T19:48:03.661202] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T19:48:03.843268] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-19T19:48:04.643278] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-19T19:48:05.254289] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T19:48:05.443316] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-19T19:48:05.783087] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T19:48:05.960982] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-09-19T19:48:06.243304] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-19T19:48:06.258781] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T19:48:06.307492] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (4.06 seconds). [2025-09-19T19:48:07.043261] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-19T19:48:07.652208] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:48:07.789904] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T19:48:07.843269] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-19T19:48:08.643283] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-19T19:48:08.970375] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T19:48:09.443297] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-19T19:48:10.243314] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-19T19:48:10.377907] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T19:48:10.455258] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T19:48:10.972156] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T19:48:11.043297] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-19T19:48:11.705449] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-19T19:48:11.843281] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-19T19:48:12.643285] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-19T19:48:13.329023] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T19:48:13.443321] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-19T19:48:14.243323] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-19T19:48:15.043283] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-19T19:48:15.814877] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T19:48:15.843262] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-19T19:48:15.951599] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-19T19:48:16.137685] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T19:48:16.139130] [INFO ] [REMOTE ] LND: Full fetch complete (8939 records). [2025-09-19T19:48:16.139266] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-19T19:48:16.264102] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (3.62 seconds). [2025-09-19T19:48:16.576785] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-19T19:48:16.576895] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-19T19:48:16.577158] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-19T19:48:16.577230] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-19T19:48:16.577733] [DEBUG] [LOCAL ] LND: Trimmed 8939 records to 5257 (keeping 200 days of data) [2025-09-19T19:48:16.611123] [DEBUG] [LOCAL ] LND: Primary data saved (5257 records). [2025-09-19T19:48:16.611284] [INFO ] [MAIN ] LND: Full history saved. [2025-09-19T19:48:16.611487] [INFO ] [MAIN ] Update Progress: 1267/2372 symbols completed. LND took 23.4s. Estimated remaining: 2h 26m 42s. Rate: 7.5 symbols/min [2025-09-19T19:48:16.648464] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-19T19:48:16.792670] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:16.828153] [DEBUG] [LOCAL ] LOB: Loaded 27714 existing records from primary storage. [2025-09-19T19:48:16.828296] [INFO ] [MAIN ] LOB: Loaded 27714 existing records. [2025-09-19T19:48:17.019232] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:17.025007] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-19T19:48:17.025086] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-19T19:48:17.029920] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-19T19:48:17.030286] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:48:17.030385] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-19T19:48:17.412355] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:17.443240] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-19T19:48:18.243251] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-19T19:48:18.294689] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T19:48:18.977231] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T19:48:19.043240] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-19T19:48:19.843255] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-19T19:48:20.273804] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T19:48:20.376783] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T19:48:20.643285] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-19T19:48:21.026588] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:48:21.443236] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-19T19:48:21.888961] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T19:48:22.243326] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-19T19:48:23.043288] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-19T19:48:23.141106] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-19T19:48:23.469854] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:48:23.843292] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-19T19:48:24.250834] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T19:48:24.643279] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-19T19:48:25.263608] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T19:48:25.265850] [INFO ] [REMOTE ] LNN: Full fetch complete (15484 records). [2025-09-19T19:48:25.265976] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-19T19:48:25.492446] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-19T19:48:25.684109] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-19T19:48:25.684186] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-19T19:48:25.684520] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-19T19:48:25.684558] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-19T19:48:25.685252] [DEBUG] [LOCAL ] LNN: Trimmed 15484 records to 11397 (keeping 200 days of data) [2025-09-19T19:48:25.766247] [DEBUG] [LOCAL ] LNN: Primary data saved (11397 records). [2025-09-19T19:48:25.766379] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-19T19:48:25.766509] [INFO ] [MAIN ] Update Progress: 1268/2372 symbols completed. LNN took 29.3s. Estimated remaining: 2h 26m 35s. Rate: 7.5 symbols/min [2025-09-19T19:48:25.936074] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:25.947228] [DEBUG] [LOCAL ] LOCL: Loaded 3492 existing records from primary storage. [2025-09-19T19:48:25.947381] [INFO ] [MAIN ] LOCL: Loaded 3492 existing records. [2025-09-19T19:48:26.128810] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:26.129230] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-19T19:48:26.129286] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-19T19:48:26.129568] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-19T19:48:26.129628] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-19T19:48:26.252707] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-19T19:48:26.453137] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-19T19:48:26.539403] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:27.043243] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-19T19:48:27.621849] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T19:48:27.843221] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-19T19:48:28.158437] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T19:48:28.643289] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-19T19:48:29.128238] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T19:48:29.223532] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T19:48:29.443265] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-19T19:48:30.243320] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-19T19:48:30.536227] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T19:48:31.043309] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-19T19:48:31.519569] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:48:31.526993] [INFO ] [REMOTE ] LNG: Full fetch complete (74651 records). [2025-09-19T19:48:31.527122] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-19T19:48:31.848420] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-19T19:48:31.923207] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-19T19:48:31.923317] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-19T19:48:31.924413] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-19T19:48:31.924522] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-19T19:48:31.928238] [DEBUG] [LOCAL ] LNG: Trimmed 74651 records to 52311 (keeping 200 days of data) [2025-09-19T19:48:32.062195] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T19:48:32.071204] [INFO ] [REMOTE ] LOAR: Full fetch complete (56166 records). [2025-09-19T19:48:32.072101] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-19T19:48:32.212371] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T19:48:32.510231] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-19T19:48:32.510545] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-19T19:48:32.511721] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-19T19:48:32.512016] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-19T19:48:32.516101] [DEBUG] [LOCAL ] LOAR: Trimmed 56166 records to 42056 (keeping 200 days of data) [2025-09-19T19:48:32.649636] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-19T19:48:32.946106] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T19:48:33.000588] [DEBUG] [LOCAL ] LNG: Primary data saved (52311 records). [2025-09-19T19:48:33.001418] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-19T19:48:33.001337] [DEBUG] [LOCAL ] LOAR: Primary data saved (42056 records). [2025-09-19T19:48:33.001677] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-19T19:48:33.001612] [INFO ] [MAIN ] Update Progress: 1269/2372 symbols completed. LNG took 38.1s. Estimated remaining: 2h 26m 26s. Rate: 7.5 symbols/min [2025-09-19T19:48:33.002095] [INFO ] [MAIN ] Update Progress: 1270/2372 symbols completed. LOAR took 31.0s. Estimated remaining: 2h 26m 12s. Rate: 7.5 symbols/min [2025-09-19T19:48:33.347449] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:33.346051] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:33.391245] [DEBUG] [LOCAL ] LOMA: Loaded 31637 existing records from primary storage. [2025-09-19T19:48:33.391400] [INFO ] [MAIN ] LOMA: Loaded 31637 existing records. [2025-09-19T19:48:33.455206] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-19T19:48:33.609702] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:33.610085] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-19T19:48:33.610155] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-19T19:48:33.611077] [DEBUG] [LOCAL ] LOW: Loaded 53348 existing records from primary storage. [2025-09-19T19:48:33.611149] [INFO ] [MAIN ] LOW: Loaded 53348 existing records. [2025-09-19T19:48:33.611183] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-19T19:48:33.642549] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-19T19:48:34.063525] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:34.093997] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-19T19:48:34.094439] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-19T19:48:34.116232] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-19T19:48:34.169989] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-19T19:48:34.171903] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-19T19:48:34.175523] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:34.245130] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-19T19:48:34.475222] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T19:48:34.580496] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:35.043299] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-19T19:48:35.849808] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-19T19:48:35.865079] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:48:36.276058] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-19T19:48:36.479841] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T19:48:36.643309] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-19T19:48:36.938620] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-19T19:48:37.443270] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-19T19:48:38.243303] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-19T19:48:39.043264] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-19T19:48:39.138719] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T19:48:39.628358] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T19:48:39.843250] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-19T19:48:40.070284] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T19:48:40.446357] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T19:48:40.643264] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-19T19:48:41.176637] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-19T19:48:41.443273] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-19T19:48:42.243263] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-19T19:48:43.026052] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T19:48:43.043216] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-19T19:48:43.658675] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T19:48:43.663392] [INFO ] [REMOTE ] LOB: Full fetch complete (37482 records). [2025-09-19T19:48:43.663483] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-19T19:48:43.844925] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-19T19:48:44.046165] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-19T19:48:44.046255] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-19T19:48:44.046946] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-19T19:48:44.047010] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-19T19:48:44.047870] [DEBUG] [LOCAL ] LOB: Trimmed 37482 records to 27973 (keeping 200 days of data) [2025-09-19T19:48:44.236711] [DEBUG] [LOCAL ] LOB: Primary data saved (27973 records). [2025-09-19T19:48:44.237096] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-19T19:48:44.237219] [INFO ] [MAIN ] Update Progress: 1271/2372 symbols completed. LOB took 27.6s. Estimated remaining: 2h 26m 6s. Rate: 7.5 symbols/min [2025-09-19T19:48:44.407675] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:44.456983] [DEBUG] [LOCAL ] LPG: Loaded 40699 existing records from primary storage. [2025-09-19T19:48:44.457130] [INFO ] [MAIN ] LPG: Loaded 40699 existing records. [2025-09-19T19:48:44.639273] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:44.639592] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-19T19:48:44.639697] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-19T19:48:44.646320] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-19T19:48:44.646269] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-19T19:48:44.654622] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-19T19:48:44.664518] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T19:48:45.029914] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:45.350250] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:48:45.443286] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-19T19:48:45.934493] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T19:48:45.999602] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T19:48:46.243267] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-19T19:48:47.043269] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-19T19:48:47.074365] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T19:48:47.075945] [INFO ] [REMOTE ] LOCL: Full fetch complete (4791 records). [2025-09-19T19:48:47.076017] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-19T19:48:47.447386] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-19T19:48:47.447471] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-19T19:48:47.447620] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-19T19:48:47.447692] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-19T19:48:47.448109] [DEBUG] [LOCAL ] LOCL: Trimmed 4791 records to 3558 (keeping 200 days of data) [2025-09-19T19:48:47.470059] [DEBUG] [LOCAL ] LOCL: Primary data saved (3558 records). [2025-09-19T19:48:47.470128] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-19T19:48:47.470204] [INFO ] [MAIN ] Update Progress: 1272/2372 symbols completed. LOCL took 21.7s. Estimated remaining: 2h 25m 54s. Rate: 7.5 symbols/min [2025-09-19T19:48:47.637440] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:48:47.665090] [DEBUG] [LOCAL ] LPL: Loaded 25276 existing records from primary storage. [2025-09-19T19:48:47.665224] [INFO ] [MAIN ] LPL: Loaded 25276 existing records. [2025-09-19T19:48:47.844335] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:48:47.844158] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-19T19:48:47.844679] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-19T19:48:47.845556] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-19T19:48:47.846320] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-19T19:48:47.846416] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-19T19:48:48.200091] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:48:48.643273] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-19T19:48:48.821791] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T19:48:49.316878] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T19:48:49.448356] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-19T19:48:49.457350] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-19T19:48:50.243265] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-19T19:48:51.043265] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-19T19:48:51.388975] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T19:48:51.843242] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-19T19:48:52.327019] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T19:48:52.357137] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T19:48:52.643251] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-19T19:48:53.443260] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-19T19:48:54.062961] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T19:48:54.243260] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-19T19:48:54.460984] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T19:48:54.634927] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T19:48:55.043262] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-19T19:48:55.843265] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-19T19:48:56.209172] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:48:56.643272] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-19T19:48:56.824769] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T19:48:56.934436] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T19:48:57.443306] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-19T19:48:58.243241] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-19T19:48:58.898783] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T19:48:59.043256] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-19T19:48:59.265116] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T19:48:59.400702] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T19:48:59.843235] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-19T19:49:00.513938] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:49:00.643285] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-19T19:49:01.443322] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-19T19:49:01.681911] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T19:49:02.243348] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-19T19:49:02.675886] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T19:49:02.806872] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T19:49:03.043307] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-19T19:49:03.503752] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T19:49:03.843264] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-19T19:49:03.932882] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:49:04.643257] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-19T19:49:05.443270] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-19T19:49:05.635087] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:49:06.049194] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T19:49:06.243267] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-19T19:49:06.653584] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:49:07.043333] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-19T19:49:07.833949] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T19:49:07.843206] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-19T19:49:08.643278] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-19T19:49:09.259077] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T19:49:09.443295] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-19T19:49:09.616050] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T19:49:09.622837] [INFO ] [REMOTE ] LOMA: Full fetch complete (48161 records). [2025-09-19T19:49:09.622956] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-19T19:49:10.008000] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-19T19:49:10.008106] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-19T19:49:10.008969] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-19T19:49:10.009042] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-19T19:49:10.010167] [DEBUG] [LOCAL ] LOMA: Trimmed 48161 records to 32010 (keeping 200 days of data) [2025-09-19T19:49:10.198765] [DEBUG] [LOCAL ] LOMA: Primary data saved (32010 records). [2025-09-19T19:49:10.198945] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-19T19:49:10.199051] [INFO ] [MAIN ] Update Progress: 1273/2372 symbols completed. LOMA took 37.2s. Estimated remaining: 2h 25m 59s. Rate: 7.5 symbols/min [2025-09-19T19:49:10.246886] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-19T19:49:10.384064] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:10.411585] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T19:49:10.457413] [DEBUG] [LOCAL ] LPX: Loaded 40075 existing records from primary storage. [2025-09-19T19:49:10.457566] [INFO ] [MAIN ] LPX: Loaded 40075 existing records. [2025-09-19T19:49:10.641097] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:10.641375] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-19T19:49:10.641440] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-19T19:49:10.642426] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-19T19:49:10.642487] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-19T19:49:10.897050] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:49:11.041533] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:11.043228] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-19T19:49:11.843290] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-19T19:49:12.648434] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-19T19:49:12.648619] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-19T19:49:12.756731] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:49:12.847292] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T19:49:13.443288] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-19T19:49:13.837475] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T19:49:13.844877] [INFO ] [REMOTE ] LPG: Full fetch complete (60159 records). [2025-09-19T19:49:13.845146] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-19T19:49:14.248290] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-19T19:49:14.268850] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-19T19:49:14.268992] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-19T19:49:14.270357] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-19T19:49:14.270681] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-19T19:49:14.272675] [DEBUG] [LOCAL ] LPG: Trimmed 60159 records to 40939 (keeping 200 days of data) [2025-09-19T19:49:14.566967] [DEBUG] [LOCAL ] LPG: Primary data saved (40939 records). [2025-09-19T19:49:14.567176] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-19T19:49:14.568740] [INFO ] [MAIN ] Update Progress: 1274/2372 symbols completed. LPG took 30.3s. Estimated remaining: 2h 25m 48s. Rate: 7.5 symbols/min [2025-09-19T19:49:14.751896] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:14.802345] [DEBUG] [LOCAL ] LRN: Loaded 40443 existing records from primary storage. [2025-09-19T19:49:14.802579] [INFO ] [MAIN ] LRN: Loaded 40443 existing records. [2025-09-19T19:49:14.989086] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:14.989534] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-19T19:49:14.989594] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-19T19:49:14.990636] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-19T19:49:14.990732] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-19T19:49:15.048440] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-19T19:49:15.383110] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:15.410303] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T19:49:15.843240] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-19T19:49:16.484352] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-19T19:49:16.492172] [INFO ] [REMOTE ] LOW: Full fetch complete (76466 records). [2025-09-19T19:49:16.492302] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-19T19:49:16.671067] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-19T19:49:16.903550] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T19:49:16.935481] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-19T19:49:16.936405] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-19T19:49:16.937639] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-19T19:49:16.937783] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-19T19:49:16.940207] [DEBUG] [LOCAL ] LOW: Trimmed 76466 records to 53729 (keeping 200 days of data) [2025-09-19T19:49:17.066437] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T19:49:17.320425] [DEBUG] [LOCAL ] LOW: Primary data saved (53729 records). [2025-09-19T19:49:17.320581] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-19T19:49:17.321922] [INFO ] [MAIN ] Update Progress: 1275/2372 symbols completed. LOW took 44.3s. Estimated remaining: 2h 25m 36s. Rate: 7.5 symbols/min [2025-09-19T19:49:17.448344] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-19T19:49:17.492127] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:17.539417] [DEBUG] [LOCAL ] LSPD: Loaded 43972 existing records from primary storage. [2025-09-19T19:49:17.539564] [INFO ] [MAIN ] LSPD: Loaded 43972 existing records. [2025-09-19T19:49:17.715342] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:17.715625] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-19T19:49:17.715711] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-19T19:49:17.716681] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-19T19:49:17.716741] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-19T19:49:18.079514] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:18.243279] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-19T19:49:18.393249] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T19:49:19.043318] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-19T19:49:19.258081] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T19:49:19.674395] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T19:49:19.843277] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-19T19:49:20.643270] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-19T19:49:20.925265] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T19:49:21.021335] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T19:49:21.443302] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-19T19:49:22.243279] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-19T19:49:22.379737] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:49:22.385455] [INFO ] [REMOTE ] LPL: Full fetch complete (34241 records). [2025-09-19T19:49:22.385570] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-19T19:49:22.794830] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-19T19:49:22.794928] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-19T19:49:22.795700] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-19T19:49:22.795809] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-19T19:49:22.797238] [DEBUG] [LOCAL ] LPL: Trimmed 34241 records to 25507 (keeping 200 days of data) [2025-09-19T19:49:22.912504] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T19:49:22.982730] [DEBUG] [LOCAL ] LPL: Primary data saved (25507 records). [2025-09-19T19:49:22.982884] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-19T19:49:22.982975] [INFO ] [MAIN ] Update Progress: 1276/2372 symbols completed. LPL took 35.5s. Estimated remaining: 2h 25m 26s. Rate: 7.5 symbols/min [2025-09-19T19:49:23.048352] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-19T19:49:23.164972] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:23.201720] [DEBUG] [LOCAL ] LTC: Loaded 30192 existing records from primary storage. [2025-09-19T19:49:23.201874] [INFO ] [MAIN ] LTC: Loaded 30192 existing records. [2025-09-19T19:49:23.391194] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:23.391743] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-19T19:49:23.391858] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-19T19:49:23.392822] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-19T19:49:23.392889] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-19T19:49:23.664938] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T19:49:23.789561] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:23.843219] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-19T19:49:24.643300] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-19T19:49:25.016725] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T19:49:25.238018] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:49:25.443253] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-19T19:49:26.243325] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-19T19:49:26.449769] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T19:49:27.043297] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-19T19:49:27.526307] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T19:49:27.783275] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T19:49:27.843238] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-19T19:49:28.643303] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-19T19:49:28.826000] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T19:49:29.443278] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-19T19:49:29.566508] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T19:49:30.102451] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T19:49:30.243262] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-19T19:49:31.043245] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-19T19:49:31.167380] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T19:49:31.368045] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T19:49:31.843268] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-19T19:49:32.275580] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T19:49:32.643329] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-19T19:49:33.030624] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T19:49:33.443291] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-19T19:49:34.243255] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-19T19:49:34.347736] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T19:49:35.043292] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-19T19:49:35.285786] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T19:49:35.706082] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T19:49:35.843268] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-19T19:49:36.198720] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T19:49:36.643330] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-19T19:49:37.363801] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T19:49:37.443226] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-19T19:49:37.850145] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T19:49:38.243299] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-19T19:49:38.973189] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-19T19:49:39.043227] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-19T19:49:39.843317] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-19T19:49:39.936494] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T19:49:39.942357] [INFO ] [REMOTE ] LPX: Full fetch complete (58326 records). [2025-09-19T19:49:39.942485] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-19T19:49:40.327812] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-19T19:49:40.327956] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-19T19:49:40.328809] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-19T19:49:40.328874] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-19T19:49:40.330133] [DEBUG] [LOCAL ] LPX: Trimmed 58326 records to 40396 (keeping 200 days of data) [2025-09-19T19:49:40.575066] [DEBUG] [LOCAL ] LPX: Primary data saved (40396 records). [2025-09-19T19:49:40.575198] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-19T19:49:40.575280] [INFO ] [MAIN ] Update Progress: 1277/2372 symbols completed. LPX took 30.4s. Estimated remaining: 2h 25m 26s. Rate: 7.5 symbols/min [2025-09-19T19:49:40.643276] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-19T19:49:41.188125] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T19:49:41.443297] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-19T19:49:41.496139] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T19:49:41.502590] [INFO ] [REMOTE ] LSPD: Full fetch complete (61744 records). [2025-09-19T19:49:41.502717] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-19T19:49:41.904446] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-19T19:49:41.904525] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-19T19:49:41.905414] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-19T19:49:41.905489] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-19T19:49:41.907425] [DEBUG] [LOCAL ] LSPD: Trimmed 61744 records to 44246 (keeping 200 days of data) [2025-09-19T19:49:42.159785] [DEBUG] [LOCAL ] LSPD: Primary data saved (44246 records). [2025-09-19T19:49:42.160003] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-19T19:49:42.160125] [INFO ] [MAIN ] Update Progress: 1278/2372 symbols completed. LSPD took 24.8s. Estimated remaining: 2h 25m 13s. Rate: 7.5 symbols/min [2025-09-19T19:49:42.176277] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T19:49:42.243215] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-19T19:49:42.869607] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T19:49:43.043263] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-19T19:49:43.854187] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T19:49:43.862410] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-19T19:49:44.817412] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T19:49:44.826509] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-19T19:49:45.399718] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T19:49:45.443217] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-19T19:49:46.022607] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:49:46.243250] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-19T19:49:47.075553] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T19:49:47.080022] [INFO ] [REMOTE ] LTC: Full fetch complete (42731 records). [2025-09-19T19:49:47.080122] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-19T19:49:47.476004] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-19T19:49:47.476206] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-19T19:49:47.477021] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-19T19:49:47.477159] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-19T19:49:47.478459] [DEBUG] [LOCAL ] LTC: Trimmed 42731 records to 30403 (keeping 200 days of data) [2025-09-19T19:49:47.495825] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T19:49:47.591498] [INFO ] [REMOTE ] LRN: Full fetch complete (58420 records). [2025-09-19T19:49:47.591992] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-19T19:49:48.000593] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-19T19:49:48.001004] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-19T19:49:48.002137] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-19T19:49:48.002440] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-19T19:49:48.008361] [DEBUG] [LOCAL ] LRN: Trimmed 58420 records to 40764 (keeping 200 days of data) [2025-09-19T19:49:48.325711] [DEBUG] [LOCAL ] LRN: Primary data saved (40764 records). [2025-09-19T19:49:48.327020] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-19T19:49:48.327678] [INFO ] [MAIN ] Update Progress: 1279/2372 symbols completed. LRN took 33.8s. Estimated remaining: 2h 25m 3s. Rate: 7.5 symbols/min [2025-09-19T19:49:48.329193] [DEBUG] [LOCAL ] LTC: Primary data saved (30403 records). [2025-09-19T19:49:48.329461] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-19T19:49:48.329555] [INFO ] [MAIN ] Update Progress: 1280/2372 symbols completed. LTC took 25.3s. Estimated remaining: 2h 24m 48s. Rate: 7.5 symbols/min [2025-09-19T19:49:48.922074] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:48.987940] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:48.991939] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:49.029081] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-19T19:49:49.037975] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-19T19:49:49.059923] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:49:49.060688] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-19T19:49:49.060899] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-19T19:49:49.061087] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-19T19:49:49.061141] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-19T19:49:49.418254] [DEBUG] [LOCAL ] LU: Loaded 49316 existing records from primary storage. [2025-09-19T19:49:49.417052] [DEBUG] [LOCAL ] LTM: Loaded 35889 existing records from primary storage. [2025-09-19T19:49:49.442361] [INFO ] [MAIN ] LTM: Loaded 35889 existing records. [2025-09-19T19:49:49.423799] [INFO ] [MAIN ] LU: Loaded 49316 existing records. [2025-09-19T19:49:49.519605] [DEBUG] [LOCAL ] LTH: Loaded 52311 existing records from primary storage. [2025-09-19T19:49:49.544226] [INFO ] [MAIN ] LTH: Loaded 52311 existing records. [2025-09-19T19:49:49.793322] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:49.840496] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-19T19:49:50.056849] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:50.107742] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:50.113211] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:49:50.113815] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-19T19:49:50.114073] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-19T19:49:50.114202] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-19T19:49:50.114028] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-19T19:49:50.114338] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-19T19:49:50.113972] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-19T19:49:50.115269] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-19T19:49:50.115330] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-19T19:49:50.126421] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-19T19:49:50.126370] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-19T19:49:50.158316] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-19T19:49:50.151628] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-19T19:49:51.129614] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:51.160402] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:51.160794] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-19T19:49:51.166887] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-19T19:49:51.251490] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:49:51.251928] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-19T19:49:51.266324] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T19:49:51.271497] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-19T19:49:52.426107] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T19:49:52.430870] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-19T19:49:52.838173] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:49:52.846329] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-19T19:49:52.963999] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T19:49:52.973264] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-19T19:49:53.047217] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T19:49:53.443287] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-19T19:49:53.811299] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T19:49:54.243235] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-19T19:49:54.408891] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T19:49:54.921671] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T19:49:55.044220] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-19T19:49:55.044111] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T19:49:55.843300] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-19T19:49:56.052420] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:49:56.643314] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-19T19:49:56.842477] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:49:57.405535] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T19:49:57.443235] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-19T19:49:58.150895] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T19:49:58.243216] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-19T19:49:59.043344] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-19T19:49:59.450875] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T19:49:59.830306] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T19:49:59.843266] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-19T19:50:00.643332] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-19T19:50:01.172608] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T19:50:01.431256] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T19:50:01.443238] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-19T19:50:01.553329] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T19:50:02.243316] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-19T19:50:02.525960] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T19:50:03.043325] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-19T19:50:03.843290] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-19T19:50:04.074358] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:50:04.644081] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-19T19:50:04.646383] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T19:50:05.443276] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-19T19:50:05.709359] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:50:06.200899] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T19:50:06.243275] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-19T19:50:06.826094] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T19:50:07.043302] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-19T19:50:07.843274] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-19T19:50:08.127312] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T19:50:08.216174] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T19:50:08.643283] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-19T19:50:09.443327] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-19T19:50:09.985068] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T19:50:10.243275] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-19T19:50:10.536184] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T19:50:10.746013] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T19:50:10.752997] [INFO ] [REMOTE ] LTM: Full fetch complete (46466 records). [2025-09-19T19:50:10.753111] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-19T19:50:11.046419] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-19T19:50:11.139333] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-19T19:50:11.139413] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-19T19:50:11.140184] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-19T19:50:11.140247] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-19T19:50:11.141358] [DEBUG] [LOCAL ] LTM: Trimmed 46466 records to 36215 (keeping 200 days of data) [2025-09-19T19:50:11.356104] [DEBUG] [LOCAL ] LTM: Primary data saved (36215 records). [2025-09-19T19:50:11.356334] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-19T19:50:11.356443] [INFO ] [MAIN ] Update Progress: 1281/2372 symbols completed. LTM took 23.0s. Estimated remaining: 2h 24m 53s. Rate: 7.5 symbols/min [2025-09-19T19:50:11.530659] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:11.582432] [DEBUG] [LOCAL ] LUMN: Loaded 54024 existing records from primary storage. [2025-09-19T19:50:11.582661] [INFO ] [MAIN ] LUMN: Loaded 54024 existing records. [2025-09-19T19:50:11.772455] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:11.773047] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-19T19:50:11.773146] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-19T19:50:11.774932] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-19T19:50:11.774997] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-19T19:50:11.845751] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-19T19:50:12.095321] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T19:50:12.182730] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:12.470497] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T19:50:12.643260] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-19T19:50:13.443269] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-19T19:50:14.137443] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T19:50:14.243301] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-19T19:50:14.838728] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T19:50:15.043266] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-19T19:50:15.419425] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T19:50:15.643355] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T19:50:15.843274] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-19T19:50:16.643322] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-19T19:50:16.898564] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T19:50:17.443298] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-19T19:50:18.179930] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T19:50:18.243222] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-19T19:50:18.663673] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T19:50:18.838060] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T19:50:18.841867] [INFO ] [REMOTE ] LUCK: Full fetch complete (39748 records). [2025-09-19T19:50:18.841950] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-19T19:50:19.032508] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-19T19:50:19.033096] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:50:19.033185] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:50:19.033262] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-19T19:50:19.033360] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-19T19:50:19.033417] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-19T19:50:19.033479] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-19T19:50:19.033566] [INFO ] [MAIN ] Update Progress: 1282/2372 symbols completed. LUCK took 30.7s. Estimated remaining: 2h 24m 45s. Rate: 7.5 symbols/min [2025-09-19T19:50:19.048494] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-19T19:50:19.207548] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:19.264256] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-09-19T19:50:19.264437] [INFO ] [MAIN ] LUV: Loaded 54079 existing records. [2025-09-19T19:50:19.446609] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:19.446877] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-19T19:50:19.446927] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-19T19:50:19.448883] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-19T19:50:19.448956] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-19T19:50:19.806004] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:19.843213] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-19T19:50:20.051802] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:50:20.643288] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-19T19:50:20.974218] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T19:50:21.443266] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-19T19:50:21.973708] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T19:50:22.243261] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-19T19:50:22.825936] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T19:50:23.043234] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-19T19:50:23.365867] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T19:50:23.373983] [INFO ] [REMOTE ] LTH: Full fetch complete (73818 records). [2025-09-19T19:50:23.374120] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-19T19:50:23.782772] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-19T19:50:23.782899] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-19T19:50:23.784081] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-19T19:50:23.784148] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-19T19:50:23.786067] [DEBUG] [LOCAL ] LTH: Trimmed 73818 records to 52690 (keeping 200 days of data) [2025-09-19T19:50:23.846161] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-19T19:50:24.104840] [DEBUG] [LOCAL ] LTH: Primary data saved (52690 records). [2025-09-19T19:50:24.104995] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-19T19:50:24.105116] [INFO ] [MAIN ] Update Progress: 1283/2372 symbols completed. LTH took 35.8s. Estimated remaining: 2h 24m 35s. Rate: 7.5 symbols/min [2025-09-19T19:50:24.289081] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:24.289621] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-19T19:50:24.289749] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-19T19:50:24.290099] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-19T19:50:24.290334] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-19T19:50:24.290491] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-19T19:50:24.290758] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-19T19:50:24.357114] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T19:50:24.430546] [INFO ] [REMOTE ] LU: Full fetch complete (70474 records). [2025-09-19T19:50:24.436386] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-19T19:50:25.048976] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:25.055179] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-19T19:50:25.158323] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-19T19:50:25.158418] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-19T19:50:25.159587] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-19T19:50:25.159693] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-19T19:50:25.161602] [DEBUG] [LOCAL ] LU: Trimmed 70474 records to 49686 (keeping 200 days of data) [2025-09-19T19:50:25.344735] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:25.354544] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-19T19:50:25.448121] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-19T19:50:25.511228] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T19:50:25.529779] [DEBUG] [LOCAL ] LU: Primary data saved (49686 records). [2025-09-19T19:50:25.529906] [INFO ] [MAIN ] LU: Full history saved. [2025-09-19T19:50:25.530030] [INFO ] [MAIN ] Update Progress: 1284/2372 symbols completed. LU took 37.2s. Estimated remaining: 2h 24m 21s. Rate: 7.5 symbols/min [2025-09-19T19:50:25.724626] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:25.785168] [DEBUG] [LOCAL ] LVS: Loaded 53957 existing records from primary storage. [2025-09-19T19:50:25.785339] [INFO ] [MAIN ] LVS: Loaded 53957 existing records. [2025-09-19T19:50:25.942941] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:25.983480] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-19T19:50:25.990264] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:25.990865] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-19T19:50:25.990943] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-19T19:50:25.992987] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-19T19:50:25.993061] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-19T19:50:26.246731] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-19T19:50:26.312776] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-19T19:50:26.426807] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:26.755807] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:26.756149] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-19T19:50:27.043272] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-19T19:50:27.275052] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:27.275408] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-19T19:50:27.843283] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-19T19:50:28.643274] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-19T19:50:29.443320] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-19T19:50:30.100374] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T19:50:30.203533] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T19:50:30.243230] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-19T19:50:31.043280] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-19T19:50:31.288237] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:50:31.288589] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-19T19:50:31.475718] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T19:50:31.843285] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-19T19:50:32.421341] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T19:50:32.643282] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-19T19:50:33.443287] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-19T19:50:33.983089] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T19:50:34.084184] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T19:50:34.243253] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-19T19:50:35.043270] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-19T19:50:35.450392] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T19:50:35.843276] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-19T19:50:36.127681] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T19:50:36.608336] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T19:50:36.643226] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-19T19:50:37.443323] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-19T19:50:37.773576] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T19:50:38.243322] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-19T19:50:39.055119] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-19T19:50:39.058974] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-19T19:50:39.477200] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T19:50:39.683626] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T19:50:39.843266] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-19T19:50:40.643257] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-19T19:50:40.711890] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T19:50:41.443261] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-19T19:50:41.754015] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T19:50:42.134834] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T19:50:42.243274] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-19T19:50:43.043269] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-19T19:50:43.537033] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T19:50:43.540825] [INFO ] [REMOTE ] LUXE: Full fetch complete (12535 records). [2025-09-19T19:50:43.541003] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-19T19:50:43.748170] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 98 unique days, need 200 days [2025-09-19T19:50:43.749241] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:50:43.749605] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:50:43.749729] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-19T19:50:43.749847] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-19T19:50:43.750289] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-19T19:50:43.750369] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-19T19:50:43.750542] [INFO ] [MAIN ] Update Progress: 1285/2372 symbols completed. LUXE took 19.6s. Estimated remaining: 2h 24m 22s. Rate: 7.5 symbols/min [2025-09-19T19:50:43.847149] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-19T19:50:43.861242] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-19T19:50:43.971557] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:43.992687] [DEBUG] [LOCAL ] LVWR: Loaded 17218 existing records from primary storage. [2025-09-19T19:50:43.992918] [INFO ] [MAIN ] LVWR: Loaded 17218 existing records. [2025-09-19T19:50:44.167478] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:44.167773] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-19T19:50:44.167827] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-19T19:50:44.168373] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-19T19:50:44.168437] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-19T19:50:44.525185] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:44.643258] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-19T19:50:45.447004] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-19T19:50:45.452239] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-19T19:50:45.462128] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-19T19:50:45.462252] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-19T19:50:45.676557] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T19:50:45.873140] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-19T19:50:45.873228] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-19T19:50:45.874262] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-19T19:50:45.874430] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-19T19:50:45.876376] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 54414 (keeping 200 days of data) [2025-09-19T19:50:46.127077] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:50:46.243349] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-19T19:50:46.255775] [DEBUG] [LOCAL ] LUMN: Primary data saved (54414 records). [2025-09-19T19:50:46.255988] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-19T19:50:46.256105] [INFO ] [MAIN ] Update Progress: 1286/2372 symbols completed. LUMN took 34.9s. Estimated remaining: 2h 24m 9s. Rate: 7.5 symbols/min [2025-09-19T19:50:46.430127] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:46.485513] [DEBUG] [LOCAL ] LW: Loaded 51681 existing records from primary storage. [2025-09-19T19:50:46.485739] [INFO ] [MAIN ] LW: Loaded 51681 existing records. [2025-09-19T19:50:46.667022] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:46.667256] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-19T19:50:46.667303] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-19T19:50:46.668865] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-19T19:50:46.668927] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-19T19:50:47.028213] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:47.043214] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-19T19:50:47.767856] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T19:50:47.843229] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-19T19:50:48.400571] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T19:50:48.643260] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-19T19:50:49.436254] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-19T19:50:49.446982] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-19T19:50:50.158839] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T19:50:50.159604] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T19:50:50.243229] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-19T19:50:50.663498] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T19:50:51.043263] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-19T19:50:51.742596] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T19:50:51.843275] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-19T19:50:52.181049] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T19:50:52.535245] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-19T19:50:52.643275] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-19T19:50:53.443262] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-19T19:50:54.243245] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-19T19:50:54.834334] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T19:50:54.993294] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T19:50:55.043223] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-19T19:50:55.380775] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T19:50:55.843264] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-19T19:50:56.643235] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-19T19:50:57.261162] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T19:50:57.443252] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-19T19:50:57.903593] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T19:50:57.913777] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-19T19:50:57.913937] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-19T19:50:58.249557] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-19T19:50:58.322318] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-19T19:50:58.322409] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-19T19:50:58.323434] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-19T19:50:58.323498] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-19T19:50:58.325017] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 54469 (keeping 200 days of data) [2025-09-19T19:50:58.694891] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T19:50:58.716099] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-09-19T19:50:58.716212] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-19T19:50:58.716344] [INFO ] [MAIN ] Update Progress: 1287/2372 symbols completed. LUV took 39.7s. Estimated remaining: 2h 24m 5s. Rate: 7.5 symbols/min [2025-09-19T19:50:58.888687] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:50:58.900257] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T19:50:58.918479] [DEBUG] [LOCAL ] LXFR: Loaded 17313 existing records from primary storage. [2025-09-19T19:50:58.918603] [INFO ] [MAIN ] LXFR: Loaded 17313 existing records. [2025-09-19T19:50:59.058410] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-19T19:50:59.100059] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:50:59.100256] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-19T19:50:59.100340] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-19T19:50:59.101113] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-19T19:50:59.101174] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-19T19:50:59.467847] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:50:59.843267] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-19T19:51:00.330892] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:51:00.338842] [INFO ] [REMOTE ] LVS: Full fetch complete (77515 records). [2025-09-19T19:51:00.338968] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-19T19:51:00.648401] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-19T19:51:00.736344] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-19T19:51:00.736424] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-19T19:51:00.737430] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-19T19:51:00.737515] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-19T19:51:00.739036] [DEBUG] [LOCAL ] LVS: Trimmed 77515 records to 54347 (keeping 200 days of data) [2025-09-19T19:51:01.003486] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T19:51:01.092727] [DEBUG] [LOCAL ] LVS: Primary data saved (54347 records). [2025-09-19T19:51:01.092903] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-19T19:51:01.093582] [INFO ] [MAIN ] Update Progress: 1288/2372 symbols completed. LVS took 35.6s. Estimated remaining: 2h 23m 52s. Rate: 7.5 symbols/min [2025-09-19T19:51:01.272170] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:01.307081] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T19:51:01.363208] [DEBUG] [LOCAL ] LXP: Loaded 51004 existing records from primary storage. [2025-09-19T19:51:01.363397] [INFO ] [MAIN ] LXP: Loaded 51004 existing records. [2025-09-19T19:51:01.448457] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-19T19:51:01.553602] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:01.553911] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-19T19:51:01.553968] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-19T19:51:01.555347] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-19T19:51:01.555408] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-19T19:51:01.914025] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:02.243297] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-19T19:51:03.043285] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-19T19:51:03.447488] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-19T19:51:03.843274] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-19T19:51:04.951076] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (3.50 seconds). [2025-09-19T19:51:04.962324] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-19T19:51:05.666218] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T19:51:05.671118] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-19T19:51:06.000940] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (2.96 seconds). [2025-09-19T19:51:06.245979] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-19T19:51:06.250447] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (4.01 seconds). [2025-09-19T19:51:06.271837] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T19:51:06.412534] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:51:07.043349] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-19T19:51:07.273473] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T19:51:07.843285] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-19T19:51:08.607493] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:51:08.643224] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-19T19:51:09.172715] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T19:51:09.443362] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-19T19:51:10.243291] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-19T19:51:10.609294] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T19:51:10.689924] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T19:51:11.043246] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-19T19:51:11.114216] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T19:51:11.117850] [INFO ] [REMOTE ] LVWR: Full fetch complete (19635 records). [2025-09-19T19:51:11.117930] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-19T19:51:11.486888] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-19T19:51:11.486995] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-19T19:51:11.487416] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-19T19:51:11.487469] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-19T19:51:11.488284] [DEBUG] [LOCAL ] LVWR: Trimmed 19635 records to 17439 (keeping 200 days of data) [2025-09-19T19:51:11.597497] [DEBUG] [LOCAL ] LVWR: Primary data saved (17439 records). [2025-09-19T19:51:11.597661] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-19T19:51:11.597765] [INFO ] [MAIN ] Update Progress: 1289/2372 symbols completed. LVWR took 27.8s. Estimated remaining: 2h 23m 46s. Rate: 7.5 symbols/min [2025-09-19T19:51:11.766732] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:11.802101] [DEBUG] [LOCAL ] LXU: Loaded 32513 existing records from primary storage. [2025-09-19T19:51:11.802276] [INFO ] [MAIN ] LXU: Loaded 32513 existing records. [2025-09-19T19:51:11.848368] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-19T19:51:11.984539] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:11.984835] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-19T19:51:11.984885] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-19T19:51:11.985915] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-19T19:51:11.985978] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-19T19:51:12.444903] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:12.643300] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-19T19:51:12.928026] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T19:51:12.937950] [INFO ] [REMOTE ] LW: Full fetch complete (74632 records). [2025-09-19T19:51:12.938191] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-19T19:51:13.465479] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-19T19:51:13.447054] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-19T19:51:13.475688] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-19T19:51:13.479866] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-19T19:51:13.482201] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-19T19:51:13.482062] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T19:51:13.489299] [DEBUG] [LOCAL ] LW: Trimmed 74632 records to 52035 (keeping 200 days of data) [2025-09-19T19:51:13.833907] [DEBUG] [LOCAL ] LW: Primary data saved (52035 records). [2025-09-19T19:51:13.834181] [INFO ] [MAIN ] LW: Full history saved. [2025-09-19T19:51:13.834345] [INFO ] [MAIN ] Update Progress: 1290/2372 symbols completed. LW took 27.6s. Estimated remaining: 2h 23m 34s. Rate: 7.5 symbols/min [2025-09-19T19:51:13.985466] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T19:51:14.061802] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:14.114719] [DEBUG] [LOCAL ] LYB: Loaded 53989 existing records from primary storage. [2025-09-19T19:51:14.114886] [INFO ] [MAIN ] LYB: Loaded 53989 existing records. [2025-09-19T19:51:14.248386] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-19T19:51:14.309403] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:14.309742] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-19T19:51:14.309817] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-19T19:51:14.311763] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-19T19:51:14.311837] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-19T19:51:14.686862] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:14.696886] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:51:15.041997] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T19:51:15.046012] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-19T19:51:15.843273] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-19T19:51:16.299759] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T19:51:16.643330] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-19T19:51:16.677199] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-19T19:51:17.443282] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-19T19:51:18.243286] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-19T19:51:18.654586] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T19:51:18.803803] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T19:51:19.043270] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-19T19:51:19.843274] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-19T19:51:20.378124] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T19:51:20.517177] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T19:51:20.606343] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T19:51:20.609047] [INFO ] [REMOTE ] LXFR: Full fetch complete (25108 records). [2025-09-19T19:51:20.609127] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-19T19:51:20.648433] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-19T19:51:21.017311] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-19T19:51:21.017405] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-19T19:51:21.018219] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-19T19:51:21.018301] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-19T19:51:21.019486] [DEBUG] [LOCAL ] LXFR: Trimmed 25108 records to 17450 (keeping 200 days of data) [2025-09-19T19:51:21.133804] [DEBUG] [LOCAL ] LXFR: Primary data saved (17450 records). [2025-09-19T19:51:21.133995] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-19T19:51:21.134117] [INFO ] [MAIN ] Update Progress: 1291/2372 symbols completed. LXFR took 22.4s. Estimated remaining: 2h 23m 25s. Rate: 7.5 symbols/min [2025-09-19T19:51:21.312713] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:21.367860] [DEBUG] [LOCAL ] LYG: Loaded 53313 existing records from primary storage. [2025-09-19T19:51:21.368048] [INFO ] [MAIN ] LYG: Loaded 53313 existing records. [2025-09-19T19:51:21.448369] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-19T19:51:21.579744] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:21.580066] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-19T19:51:21.580124] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-19T19:51:21.581359] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-19T19:51:21.581422] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-19T19:51:21.997176] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:22.243290] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-19T19:51:22.592810] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T19:51:23.043290] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-19T19:51:23.831703] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-19T19:51:23.843217] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-19T19:51:23.894256] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:51:24.422717] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T19:51:24.643268] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-19T19:51:25.443364] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-19T19:51:25.760538] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T19:51:26.164334] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T19:51:26.243309] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-19T19:51:26.620259] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T19:51:27.043331] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-19T19:51:27.567041] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T19:51:27.843278] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-19T19:51:28.648397] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-19T19:51:28.663252] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T19:51:28.795846] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:51:29.443269] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-19T19:51:30.243286] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-19T19:51:30.678679] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T19:51:31.043277] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-19T19:51:31.517193] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T19:51:31.826833] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T19:51:31.843217] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-19T19:51:32.643320] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-19T19:51:33.021600] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T19:51:33.408101] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T19:51:33.443281] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-19T19:51:34.150957] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T19:51:34.243283] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-19T19:51:35.043303] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-19T19:51:35.414380] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:51:35.422324] [INFO ] [REMOTE ] LXP: Full fetch complete (72394 records). [2025-09-19T19:51:35.422487] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-19T19:51:35.846957] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-19T19:51:35.867101] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-19T19:51:35.868005] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-19T19:51:35.869169] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-19T19:51:35.869353] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-19T19:51:35.871160] [DEBUG] [LOCAL ] LXP: Trimmed 72394 records to 51359 (keeping 200 days of data) [2025-09-19T19:51:36.156408] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:51:36.243679] [DEBUG] [LOCAL ] LXP: Primary data saved (51359 records). [2025-09-19T19:51:36.243841] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-19T19:51:36.244219] [INFO ] [MAIN ] Update Progress: 1292/2372 symbols completed. LXP took 35.2s. Estimated remaining: 2h 23m 23s. Rate: 7.5 symbols/min [2025-09-19T19:51:36.417707] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:36.473318] [DEBUG] [LOCAL ] LYV: Loaded 51684 existing records from primary storage. [2025-09-19T19:51:36.473471] [INFO ] [MAIN ] LYV: Loaded 51684 existing records. [2025-09-19T19:51:36.645377] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-19T19:51:36.660130] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:36.660439] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-19T19:51:36.660514] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-19T19:51:36.661703] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-19T19:51:36.661764] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-19T19:51:37.048417] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:37.151806] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T19:51:37.324288] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T19:51:37.443258] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-19T19:51:38.243295] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-19T19:51:38.576799] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T19:51:38.935061] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T19:51:38.939300] [INFO ] [REMOTE ] LXU: Full fetch complete (44832 records). [2025-09-19T19:51:38.939444] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-19T19:51:39.051470] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-19T19:51:39.333820] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-19T19:51:39.333917] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-19T19:51:39.334720] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-19T19:51:39.334785] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-19T19:51:39.335955] [DEBUG] [LOCAL ] LXU: Trimmed 44832 records to 32691 (keeping 200 days of data) [2025-09-19T19:51:39.515303] [DEBUG] [LOCAL ] LXU: Primary data saved (32691 records). [2025-09-19T19:51:39.515445] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-19T19:51:39.515542] [INFO ] [MAIN ] Update Progress: 1293/2372 symbols completed. LXU took 27.9s. Estimated remaining: 2h 23m 11s. Rate: 7.5 symbols/min [2025-09-19T19:51:39.693016] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:39.732169] [DEBUG] [LOCAL ] LZB: Loaded 35776 existing records from primary storage. [2025-09-19T19:51:39.732320] [INFO ] [MAIN ] LZB: Loaded 35776 existing records. [2025-09-19T19:51:39.848578] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-19T19:51:39.909144] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:39.909354] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-19T19:51:39.909402] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-19T19:51:39.910282] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-19T19:51:39.910343] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-19T19:51:40.263963] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:40.299117] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T19:51:40.643327] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-19T19:51:41.221811] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T19:51:41.443271] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-19T19:51:41.927842] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T19:51:42.243276] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-19T19:51:42.933793] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T19:51:43.043246] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-19T19:51:43.226715] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T19:51:43.834238] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T19:51:43.844976] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-19T19:51:44.643243] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-19T19:51:45.289284] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T19:51:45.443240] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-19T19:51:45.673187] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T19:51:46.243231] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-19T19:51:46.941841] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T19:51:47.043238] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-19T19:51:47.669918] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T19:51:47.681616] [INFO ] [REMOTE ] LYB: Full fetch complete (77441 records). [2025-09-19T19:51:47.681904] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-19T19:51:47.857949] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-19T19:51:48.094761] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-19T19:51:48.094881] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-19T19:51:48.097539] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-19T19:51:48.097748] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-19T19:51:48.100819] [DEBUG] [LOCAL ] LYB: Trimmed 77441 records to 54378 (keeping 200 days of data) [2025-09-19T19:51:48.234243] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T19:51:48.494798] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T19:51:48.521514] [DEBUG] [LOCAL ] LYB: Primary data saved (54378 records). [2025-09-19T19:51:48.521729] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-19T19:51:48.521842] [INFO ] [MAIN ] Update Progress: 1294/2372 symbols completed. LYB took 34.7s. Estimated remaining: 2h 23m 4s. Rate: 7.5 symbols/min [2025-09-19T19:51:48.648393] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-19T19:51:48.707408] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:51:48.724038] [DEBUG] [LOCAL ] LZM: Loaded 13504 existing records from primary storage. [2025-09-19T19:51:48.724163] [INFO ] [MAIN ] LZM: Loaded 13504 existing records. [2025-09-19T19:51:48.916863] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:51:48.917211] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-19T19:51:48.917274] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-19T19:51:48.917717] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-19T19:51:48.917776] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-19T19:51:49.335149] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:51:49.336116] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T19:51:49.443252] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-19T19:51:50.243274] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-19T19:51:50.727518] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T19:51:50.762448] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T19:51:51.043290] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-19T19:51:51.843265] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-19T19:51:52.388388] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T19:51:52.643309] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-19T19:51:52.885554] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T19:51:53.161298] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T19:51:53.443265] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-19T19:51:54.243270] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-19T19:51:54.697829] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T19:51:55.043272] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-19T19:51:55.095860] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T19:51:55.176260] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T19:51:55.843282] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-19T19:51:56.643268] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-19T19:51:57.033822] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:51:57.443315] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-19T19:51:57.578104] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T19:51:57.985346] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T19:51:58.243271] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-19T19:51:59.040262] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-19T19:51:59.047254] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-19T19:51:59.049011] [INFO ] [REMOTE ] LYG: Full fetch complete (76059 records). [2025-09-19T19:51:59.049100] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-19T19:51:59.174130] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:51:59.457719] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-19T19:51:59.457817] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-19T19:51:59.458901] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-19T19:51:59.458986] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-19T19:51:59.460581] [DEBUG] [LOCAL ] LYG: Trimmed 76059 records to 53679 (keeping 200 days of data) [2025-09-19T19:51:59.792004] [DEBUG] [LOCAL ] LYG: Primary data saved (53679 records). [2025-09-19T19:51:59.792194] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-19T19:51:59.792320] [INFO ] [MAIN ] Update Progress: 1295/2372 symbols completed. LYG took 38.7s. Estimated remaining: 2h 22m 59s. Rate: 7.5 symbols/min [2025-09-19T19:51:59.849405] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-19T19:51:59.974219] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:00.031979] [DEBUG] [LOCAL ] M: Loaded 53926 existing records from primary storage. [2025-09-19T19:52:00.032170] [INFO ] [MAIN ] M: Loaded 53926 existing records. [2025-09-19T19:52:00.218622] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:00.218918] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-19T19:52:00.218969] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-19T19:52:00.220310] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-19T19:52:00.220374] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-19T19:52:00.582633] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:00.643247] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-19T19:52:00.800806] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T19:52:01.443339] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-19T19:52:02.086344] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T19:52:02.243329] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-19T19:52:02.356860] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T19:52:02.624054] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T19:52:03.043263] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-19T19:52:03.843296] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-19T19:52:04.179280] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T19:52:04.436804] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T19:52:04.643324] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-19T19:52:05.096533] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-19T19:52:05.443305] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-19T19:52:06.187692] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T19:52:06.243336] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-19T19:52:06.349197] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T19:52:07.043324] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-19T19:52:07.843276] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-19T19:52:08.375563] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T19:52:08.643288] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-19T19:52:08.689986] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T19:52:09.443351] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-19T19:52:09.893013] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T19:52:09.900768] [INFO ] [REMOTE ] LYV: Full fetch complete (73712 records). [2025-09-19T19:52:09.900942] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-19T19:52:10.262223] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-19T19:52:10.325629] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-19T19:52:10.325807] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-19T19:52:10.326923] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-19T19:52:10.327147] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-19T19:52:10.329161] [DEBUG] [LOCAL ] LYV: Trimmed 73712 records to 52036 (keeping 200 days of data) [2025-09-19T19:52:10.454718] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:52:10.697053] [DEBUG] [LOCAL ] LYV: Primary data saved (52036 records). [2025-09-19T19:52:10.697210] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-19T19:52:10.698019] [INFO ] [MAIN ] Update Progress: 1296/2372 symbols completed. LYV took 34.5s. Estimated remaining: 2h 22m 53s. Rate: 7.5 symbols/min [2025-09-19T19:52:10.876176] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:10.934407] [DEBUG] [LOCAL ] MA: Loaded 52979 existing records from primary storage. [2025-09-19T19:52:10.934571] [INFO ] [MAIN ] MA: Loaded 52979 existing records. [2025-09-19T19:52:11.051316] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-19T19:52:11.138382] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:11.138671] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-19T19:52:11.138734] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-19T19:52:11.140477] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-19T19:52:11.140541] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-19T19:52:11.525731] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T19:52:11.529890] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T19:52:11.563518] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:11.569474] [INFO ] [REMOTE ] LZB: Full fetch complete (50064 records). [2025-09-19T19:52:11.569574] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-19T19:52:11.853039] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-19T19:52:11.960414] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-19T19:52:11.960601] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-19T19:52:11.961540] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-19T19:52:11.961606] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-19T19:52:11.963075] [DEBUG] [LOCAL ] LZB: Trimmed 50064 records to 36007 (keeping 200 days of data) [2025-09-19T19:52:12.200883] [DEBUG] [LOCAL ] LZB: Primary data saved (36007 records). [2025-09-19T19:52:12.201084] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-19T19:52:12.201233] [INFO ] [MAIN ] Update Progress: 1297/2372 symbols completed. LZB took 32.7s. Estimated remaining: 2h 22m 40s. Rate: 7.5 symbols/min [2025-09-19T19:52:12.400205] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:12.448924] [DEBUG] [LOCAL ] MAA: Loaded 43351 existing records from primary storage. [2025-09-19T19:52:12.449076] [INFO ] [MAIN ] MAA: Loaded 43351 existing records. [2025-09-19T19:52:12.643294] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-19T19:52:12.647910] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:12.649336] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-19T19:52:12.649415] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-19T19:52:12.650719] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-19T19:52:12.650798] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-19T19:52:12.951674] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T19:52:13.038511] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:13.287205] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T19:52:13.443269] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-19T19:52:14.243287] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-19T19:52:14.375126] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T19:52:15.043271] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-19T19:52:15.238765] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T19:52:15.317062] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T19:52:15.843271] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-19T19:52:16.643258] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-19T19:52:16.897407] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T19:52:16.917061] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T19:52:16.920495] [INFO ] [REMOTE ] LZM: Full fetch complete (17606 records). [2025-09-19T19:52:16.920586] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-19T19:52:17.336533] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-19T19:52:17.336617] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-19T19:52:17.337023] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-19T19:52:17.337079] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-19T19:52:17.337682] [DEBUG] [LOCAL ] LZM: Trimmed 17606 records to 13614 (keeping 200 days of data) [2025-09-19T19:52:17.411887] [DEBUG] [LOCAL ] LZM: Primary data saved (13614 records). [2025-09-19T19:52:17.412029] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-19T19:52:17.412118] [INFO ] [MAIN ] Update Progress: 1298/2372 symbols completed. LZM took 28.9s. Estimated remaining: 2h 22m 30s. Rate: 7.5 symbols/min [2025-09-19T19:52:17.448369] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-19T19:52:17.582131] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:17.629187] [DEBUG] [LOCAL ] MAC: Loaded 50122 existing records from primary storage. [2025-09-19T19:52:17.629381] [INFO ] [MAIN ] MAC: Loaded 50122 existing records. [2025-09-19T19:52:17.810218] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:17.810522] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-19T19:52:17.810594] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-19T19:52:17.811857] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-19T19:52:17.811920] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-19T19:52:18.202143] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:18.243222] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-19T19:52:18.503621] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T19:52:19.043255] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-19T19:52:19.714880] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T19:52:19.843252] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-19T19:52:20.502371] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T19:52:20.643231] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-19T19:52:20.822961] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T19:52:21.443282] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-19T19:52:21.943381] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T19:52:22.243309] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-19T19:52:22.401800] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T19:52:23.043274] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-19T19:52:23.579405] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T19:52:23.843285] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-19T19:52:24.091740] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T19:52:24.643255] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-19T19:52:25.331181] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-19T19:52:25.443230] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-19T19:52:25.579918] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T19:52:26.032019] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T19:52:26.243244] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-19T19:52:27.043340] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-19T19:52:27.390727] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T19:52:27.790843] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T19:52:27.843228] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-19T19:52:28.238677] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T19:52:28.643268] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-19T19:52:29.316794] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T19:52:29.443261] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-19T19:52:30.243267] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-19T19:52:30.904250] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T19:52:31.043265] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-19T19:52:31.329622] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T19:52:31.843279] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-19T19:52:32.015174] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T19:52:32.551620] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T19:52:32.643283] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-19T19:52:33.443277] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-19T19:52:33.722561] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T19:52:33.856193] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T19:52:34.243262] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-19T19:52:35.048965] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-19T19:52:35.070323] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:52:35.843330] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-19T19:52:36.087610] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T19:52:36.643270] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-19T19:52:36.928172] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T19:52:37.443239] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-19T19:52:38.039540] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T19:52:38.243306] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-19T19:52:38.801451] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T19:52:39.043267] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-19T19:52:39.233620] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T19:52:39.240073] [INFO ] [REMOTE ] MAA: Full fetch complete (61106 records). [2025-09-19T19:52:39.240222] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-19T19:52:39.619724] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-19T19:52:39.619810] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-19T19:52:39.620665] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-19T19:52:39.620726] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-19T19:52:39.622349] [DEBUG] [LOCAL ] MAA: Trimmed 61106 records to 43601 (keeping 200 days of data) [2025-09-19T19:52:39.851041] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-19T19:52:39.914376] [DEBUG] [LOCAL ] MAA: Primary data saved (43601 records). [2025-09-19T19:52:39.914517] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-19T19:52:39.914667] [INFO ] [MAIN ] Update Progress: 1299/2372 symbols completed. MAA took 27.7s. Estimated remaining: 2h 22m 34s. Rate: 7.5 symbols/min [2025-09-19T19:52:40.085710] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:40.125846] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T19:52:40.160058] [DEBUG] [LOCAL ] MAGN: Loaded 35283 existing records from primary storage. [2025-09-19T19:52:40.160199] [INFO ] [MAIN ] MAGN: Loaded 35283 existing records. [2025-09-19T19:52:40.335464] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:40.335753] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-19T19:52:40.335809] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-19T19:52:40.336793] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-19T19:52:40.336854] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-19T19:52:40.646768] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-19T19:52:40.689899] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:40.767482] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T19:52:40.778992] [INFO ] [REMOTE ] M: Full fetch complete (77484 records). [2025-09-19T19:52:40.779144] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-19T19:52:41.167242] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-19T19:52:41.167339] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-19T19:52:41.168376] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-19T19:52:41.168443] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-19T19:52:41.170013] [DEBUG] [LOCAL ] M: Trimmed 77484 records to 54315 (keeping 200 days of data) [2025-09-19T19:52:41.466970] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-19T19:52:41.522991] [DEBUG] [LOCAL ] M: Primary data saved (54315 records). [2025-09-19T19:52:41.523197] [INFO ] [MAIN ] M: Full history saved. [2025-09-19T19:52:41.523382] [INFO ] [MAIN ] Update Progress: 1300/2372 symbols completed. M took 41.7s. Estimated remaining: 2h 22m 21s. Rate: 7.5 symbols/min [2025-09-19T19:52:41.710306] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:41.745696] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T19:52:41.800592] [DEBUG] [LOCAL ] MAIN: Loaded 41760 existing records from primary storage. [2025-09-19T19:52:41.800776] [INFO ] [MAIN ] MAIN: Loaded 41760 existing records. [2025-09-19T19:52:41.978623] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:41.978947] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-19T19:52:41.979017] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-19T19:52:41.980184] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-19T19:52:41.980255] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-19T19:52:42.253124] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-19T19:52:42.336144] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:42.666274] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T19:52:42.805604] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T19:52:43.043271] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-19T19:52:43.843276] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-19T19:52:44.195577] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T19:52:44.205370] [INFO ] [REMOTE ] MAC: Full fetch complete (71517 records). [2025-09-19T19:52:44.205548] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-19T19:52:44.612523] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-19T19:52:44.612625] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-19T19:52:44.613630] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-19T19:52:44.613745] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-19T19:52:44.616189] [DEBUG] [LOCAL ] MAC: Trimmed 71517 records to 50480 (keeping 200 days of data) [2025-09-19T19:52:44.686961] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-19T19:52:44.887157] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T19:52:44.992247] [DEBUG] [LOCAL ] MAC: Primary data saved (50480 records). [2025-09-19T19:52:44.992411] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-19T19:52:44.992537] [INFO ] [MAIN ] Update Progress: 1301/2372 symbols completed. MAC took 27.6s. Estimated remaining: 2h 22m 9s. Rate: 7.5 symbols/min [2025-09-19T19:52:45.174064] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:45.223602] [DEBUG] [LOCAL ] MAN: Loaded 44000 existing records from primary storage. [2025-09-19T19:52:45.223787] [INFO ] [MAIN ] MAN: Loaded 44000 existing records. [2025-09-19T19:52:45.408628] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:45.409261] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-19T19:52:45.409339] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-19T19:52:45.421278] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-19T19:52:45.432470] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-19T19:52:45.455459] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-19T19:52:45.439423] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T19:52:45.799229] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:46.243284] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-19T19:52:46.892050] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-19T19:52:46.902014] [INFO ] [REMOTE ] MA: Full fetch complete (76270 records). [2025-09-19T19:52:46.902154] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-19T19:52:47.050171] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-19T19:52:47.312942] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-19T19:52:47.313055] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-19T19:52:47.314217] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-19T19:52:47.314285] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-19T19:52:47.316950] [DEBUG] [LOCAL ] MA: Trimmed 76270 records to 53357 (keeping 200 days of data) [2025-09-19T19:52:47.685757] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T19:52:47.718613] [DEBUG] [LOCAL ] MA: Primary data saved (53357 records). [2025-09-19T19:52:47.718812] [INFO ] [MAIN ] MA: Full history saved. [2025-09-19T19:52:47.719405] [INFO ] [MAIN ] Update Progress: 1302/2372 symbols completed. MA took 37.0s. Estimated remaining: 2h 21m 57s. Rate: 7.5 symbols/min [2025-09-19T19:52:47.857149] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-19T19:52:47.889755] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:52:47.922331] [DEBUG] [LOCAL ] MANU: Loaded 27429 existing records from primary storage. [2025-09-19T19:52:47.922484] [INFO ] [MAIN ] MANU: Loaded 27429 existing records. [2025-09-19T19:52:48.116579] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:52:48.138430] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-19T19:52:48.138540] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-19T19:52:48.140161] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-19T19:52:48.140096] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T19:52:48.140356] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-19T19:52:48.545575] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T19:52:48.559813] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:52:48.643232] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-19T19:52:49.443275] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-19T19:52:49.662781] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:52:50.243275] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-19T19:52:50.409774] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T19:52:51.043273] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-19T19:52:51.351626] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T19:52:51.637955] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T19:52:51.843268] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-19T19:52:52.600498] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T19:52:52.643218] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-19T19:52:53.443267] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-19T19:52:53.510394] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T19:52:54.243264] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-19T19:52:54.591432] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T19:52:55.043277] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-19T19:52:55.376630] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T19:52:55.842732] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T19:52:55.847372] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-19T19:52:56.565961] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T19:52:56.643244] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-19T19:52:57.443283] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-19T19:52:57.842700] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T19:52:58.243384] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-19T19:52:58.325909] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T19:52:58.435815] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T19:52:59.043376] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-19T19:52:59.843295] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-19T19:53:00.225499] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T19:53:00.557559] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T19:53:00.643356] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-19T19:53:01.117215] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T19:53:01.443331] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-19T19:53:01.999390] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T19:53:02.243318] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-19T19:53:03.043304] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-19T19:53:03.317071] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T19:53:03.843336] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-19T19:53:04.077753] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T19:53:04.247637] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:53:04.643256] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-19T19:53:05.157192] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T19:53:05.443267] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-19T19:53:06.197526] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T19:53:06.203236] [INFO ] [REMOTE ] MAGN: Full fetch complete (51288 records). [2025-09-19T19:53:06.203355] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-19T19:53:06.248765] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-19T19:53:06.609942] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-19T19:53:06.610398] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-19T19:53:06.611310] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-19T19:53:06.611375] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-19T19:53:06.612466] [DEBUG] [LOCAL ] MAGN: Trimmed 51288 records to 35554 (keeping 200 days of data) [2025-09-19T19:53:06.828737] [DEBUG] [LOCAL ] MAGN: Primary data saved (35554 records). [2025-09-19T19:53:06.828877] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-19T19:53:06.829012] [INFO ] [MAIN ] Update Progress: 1303/2372 symbols completed. MAGN took 26.9s. Estimated remaining: 2h 21m 58s. Rate: 7.5 symbols/min [2025-09-19T19:53:07.014246] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:53:07.034847] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T19:53:07.043203] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-19T19:53:07.094092] [DEBUG] [LOCAL ] MAS: Loaded 52753 existing records from primary storage. [2025-09-19T19:53:07.094246] [INFO ] [MAIN ] MAS: Loaded 52753 existing records. [2025-09-19T19:53:07.279311] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:53:07.279581] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-19T19:53:07.279638] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-19T19:53:07.281020] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-19T19:53:07.281079] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-19T19:53:07.660535] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:53:07.843272] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-19T19:53:08.182901] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T19:53:08.281056] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T19:53:08.643335] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-19T19:53:09.443290] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-19T19:53:09.799540] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T19:53:09.875481] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T19:53:10.243282] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-19T19:53:11.043249] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-19T19:53:11.132557] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T19:53:11.843271] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-19T19:53:12.000971] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T19:53:12.006792] [INFO ] [REMOTE ] MANU: Full fetch complete (38167 records). [2025-09-19T19:53:12.006935] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-19T19:53:12.381960] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-19T19:53:12.382065] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-19T19:53:12.382754] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-19T19:53:12.382814] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-19T19:53:12.383677] [DEBUG] [LOCAL ] MANU: Trimmed 38167 records to 27676 (keeping 200 days of data) [2025-09-19T19:53:12.547054] [DEBUG] [LOCAL ] MANU: Primary data saved (27676 records). [2025-09-19T19:53:12.547326] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-19T19:53:12.547475] [INFO ] [MAIN ] Update Progress: 1304/2372 symbols completed. MANU took 24.8s. Estimated remaining: 2h 21m 48s. Rate: 7.5 symbols/min [2025-09-19T19:53:12.659790] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-19T19:53:12.752810] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:53:12.755962] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T19:53:12.805876] [DEBUG] [LOCAL ] MATV: Loaded 38185 existing records from primary storage. [2025-09-19T19:53:12.806031] [INFO ] [MAIN ] MATV: Loaded 38185 existing records. [2025-09-19T19:53:12.983364] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:53:12.983613] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-19T19:53:12.983691] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-19T19:53:12.984609] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-19T19:53:12.984709] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-19T19:53:13.351808] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:53:13.443217] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-19T19:53:13.795304] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T19:53:14.243318] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-19T19:53:14.390703] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T19:53:14.955233] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T19:53:15.043288] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-19T19:53:15.843274] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-19T19:53:16.239136] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T19:53:16.643310] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-19T19:53:16.834479] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T19:53:16.927751] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T19:53:17.443266] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-19T19:53:18.243295] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-19T19:53:18.582244] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T19:53:18.588636] [INFO ] [REMOTE ] MAIN: Full fetch complete (59586 records). [2025-09-19T19:53:18.588778] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-19T19:53:18.977122] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-19T19:53:18.977349] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-19T19:53:18.978497] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-19T19:53:18.978666] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-19T19:53:18.980674] [DEBUG] [LOCAL ] MAIN: Trimmed 59586 records to 42093 (keeping 200 days of data) [2025-09-19T19:53:19.049717] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-19T19:53:19.099192] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T19:53:19.275205] [DEBUG] [LOCAL ] MAIN: Primary data saved (42093 records). [2025-09-19T19:53:19.275337] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-19T19:53:19.275433] [INFO ] [MAIN ] Update Progress: 1305/2372 symbols completed. MAIN took 37.8s. Estimated remaining: 2h 21m 39s. Rate: 7.5 symbols/min [2025-09-19T19:53:19.447463] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:53:19.486984] [DEBUG] [LOCAL ] MATX: Loaded 31817 existing records from primary storage. [2025-09-19T19:53:19.487156] [INFO ] [MAIN ] MATX: Loaded 31817 existing records. [2025-09-19T19:53:19.664414] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:53:19.664698] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-19T19:53:19.664754] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-19T19:53:19.666238] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-19T19:53:19.666299] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-19T19:53:19.874158] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-19T19:53:20.025896] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:53:20.056664] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:53:20.643350] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-19T19:53:21.385871] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-19T19:53:21.443284] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-19T19:53:21.689895] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T19:53:22.243269] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-19T19:53:22.488128] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T19:53:22.494842] [INFO ] [REMOTE ] MAN: Full fetch complete (61670 records). [2025-09-19T19:53:22.494960] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-19T19:53:22.884255] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-19T19:53:22.884373] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-19T19:53:22.885337] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-19T19:53:22.885412] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-19T19:53:22.886805] [DEBUG] [LOCAL ] MAN: Trimmed 61670 records to 44330 (keeping 200 days of data) [2025-09-19T19:53:23.071922] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-19T19:53:23.172432] [DEBUG] [LOCAL ] MAN: Primary data saved (44330 records). [2025-09-19T19:53:23.172580] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-19T19:53:23.172690] [INFO ] [MAIN ] Update Progress: 1306/2372 symbols completed. MAN took 38.2s. Estimated remaining: 2h 21m 28s. Rate: 7.5 symbols/min [2025-09-19T19:53:23.349981] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:53:23.386089] [DEBUG] [LOCAL ] MAX: Loaded 31388 existing records from primary storage. [2025-09-19T19:53:23.386287] [INFO ] [MAIN ] MAX: Loaded 31388 existing records. [2025-09-19T19:53:23.581395] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:53:23.581926] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-19T19:53:23.582132] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-19T19:53:23.582945] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-19T19:53:23.583057] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-19T19:53:23.719507] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T19:53:23.873124] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-19T19:53:24.030321] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:53:24.106785] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T19:53:24.201317] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T19:53:24.643276] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-19T19:53:25.443315] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-19T19:53:25.860120] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T19:53:26.168323] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T19:53:26.243233] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-19T19:53:27.048884] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-19T19:53:27.059613] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T19:53:27.705291] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T19:53:27.843271] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-19T19:53:28.643284] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-19T19:53:29.047576] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T19:53:29.343849] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T19:53:29.443264] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-19T19:53:29.632502] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T19:53:30.243259] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-19T19:53:31.043286] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-19T19:53:31.174952] [DEBUG] [REMOTE ] MATV: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-19T19:53:31.175325] [WARN ] [REMOTE ] MATV: No data returned for month 2025-05 [2025-09-19T19:53:31.487443] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:53:31.517261] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:53:31.843290] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-19T19:53:32.643271] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-19T19:53:33.443269] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-19T19:53:33.832111] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T19:53:34.148389] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T19:53:34.243284] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-19T19:53:35.021046] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T19:53:35.043290] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-19T19:53:35.825838] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T19:53:35.843215] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-19T19:53:36.301074] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T19:53:36.643269] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-19T19:53:37.443298] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-19T19:53:37.493889] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T19:53:38.243285] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-19T19:53:38.542688] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T19:53:38.550356] [INFO ] [REMOTE ] MAS: Full fetch complete (74701 records). [2025-09-19T19:53:38.550526] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-19T19:53:38.957541] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-19T19:53:38.957691] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-19T19:53:38.958845] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-19T19:53:38.958911] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-19T19:53:38.960544] [DEBUG] [LOCAL ] MAS: Trimmed 74701 records to 53128 (keeping 200 days of data) [2025-09-19T19:53:39.050689] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-19T19:53:39.206586] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:53:39.337464] [DEBUG] [LOCAL ] MAS: Primary data saved (53128 records). [2025-09-19T19:53:39.337628] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-19T19:53:39.337764] [INFO ] [MAIN ] Update Progress: 1307/2372 symbols completed. MAS took 32.5s. Estimated remaining: 2h 21m 27s. Rate: 7.5 symbols/min [2025-09-19T19:53:39.515488] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:53:39.560079] [DEBUG] [LOCAL ] MBC: Loaded 43429 existing records from primary storage. [2025-09-19T19:53:39.560251] [INFO ] [MAIN ] MBC: Loaded 43429 existing records. [2025-09-19T19:53:39.764361] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:53:39.764853] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-19T19:53:39.764928] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-19T19:53:39.771207] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-19T19:53:39.777482] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-19T19:53:39.783752] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T19:53:39.854837] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-19T19:53:39.868345] [INFO ] [REMOTE ] MATV: Full fetch complete (47011 records). [2025-09-19T19:53:39.896460] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-19T19:53:40.330864] [WARN ] [VALIDATOR ] MATV: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-19T19:53:40.366452] [FATAL] [MAIN ] MATV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:53:40.372131] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:53:40.372428] [WARN ] [MAIN ] MATV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:53:40.372503] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-19T19:53:40.372567] [DEBUG] [LOCAL ] MATV: No primary data file found to delete. [2025-09-19T19:53:40.372604] [INFO ] [LOCAL ] MATV: Starting deletion of derivative data. [2025-09-19T19:53:40.373100] [DEBUG] [LOCAL ] MATV: Deleted derivative data file. [2025-09-19T19:53:40.373760] [INFO ] [MAIN ] Update Progress: 1308/2372 symbols completed. MATV took 27.8s. Estimated remaining: 2h 21m 13s. Rate: 7.5 symbols/min [2025-09-19T19:53:40.539638] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:53:40.561241] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T19:53:40.588721] [DEBUG] [LOCAL ] MBI: Loaded 25241 existing records from primary storage. [2025-09-19T19:53:40.588870] [INFO ] [MAIN ] MBI: Loaded 25241 existing records. [2025-09-19T19:53:40.650347] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-19T19:53:40.771787] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:53:40.772076] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-19T19:53:40.772131] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-19T19:53:40.772740] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-19T19:53:40.772801] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-19T19:53:41.123795] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:53:41.361534] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T19:53:41.443262] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-19T19:53:42.243266] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-19T19:53:42.547360] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T19:53:42.973325] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T19:53:43.043261] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-19T19:53:43.744924] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T19:53:43.843232] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-19T19:53:44.564476] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T19:53:44.643264] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-19T19:53:45.114869] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T19:53:45.443277] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-19T19:53:46.154066] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T19:53:46.249691] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-19T19:53:46.254092] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T19:53:47.043325] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-19T19:53:47.843244] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-19T19:53:47.928803] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T19:53:48.436466] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T19:53:48.643238] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-19T19:53:49.222410] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T19:53:49.443410] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-19T19:53:50.243628] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-19T19:53:50.247991] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T19:53:51.043269] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-19T19:53:51.334792] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T19:53:51.734832] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T19:53:51.843278] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-19T19:53:52.217118] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T19:53:52.221692] [INFO ] [REMOTE ] MATX: Full fetch complete (42501 records). [2025-09-19T19:53:52.221839] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-19T19:53:52.601623] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-19T19:53:52.601734] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-19T19:53:52.602447] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-19T19:53:52.602488] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-19T19:53:52.604089] [DEBUG] [LOCAL ] MATX: Trimmed 42501 records to 32049 (keeping 200 days of data) [2025-09-19T19:53:52.662845] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-19T19:53:52.808968] [DEBUG] [LOCAL ] MATX: Primary data saved (32049 records). [2025-09-19T19:53:52.809174] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-19T19:53:52.809299] [INFO ] [MAIN ] Update Progress: 1309/2372 symbols completed. MATX took 33.5s. Estimated remaining: 2h 21m 9s. Rate: 7.5 symbols/min [2025-09-19T19:53:52.986934] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:53:53.029540] [DEBUG] [LOCAL ] MC: Loaded 44790 existing records from primary storage. [2025-09-19T19:53:53.029723] [INFO ] [MAIN ] MC: Loaded 44790 existing records. [2025-09-19T19:53:53.213465] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:53:53.214143] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-19T19:53:53.214247] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-19T19:53:53.228673] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-19T19:53:53.228590] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T19:53:53.228850] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-19T19:53:53.448560] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-19T19:53:53.608303] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:53:54.243257] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-19T19:53:54.398099] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T19:53:54.404404] [INFO ] [REMOTE ] MAX: Full fetch complete (45743 records). [2025-09-19T19:53:54.404516] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-19T19:53:54.784163] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-19T19:53:54.784242] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-19T19:53:54.785067] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-19T19:53:54.785130] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-19T19:53:54.786426] [DEBUG] [LOCAL ] MAX: Trimmed 45743 records to 31616 (keeping 200 days of data) [2025-09-19T19:53:54.969543] [DEBUG] [LOCAL ] MAX: Primary data saved (31616 records). [2025-09-19T19:53:54.969774] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-19T19:53:54.970026] [INFO ] [MAIN ] Update Progress: 1310/2372 symbols completed. MAX took 31.8s. Estimated remaining: 2h 20m 56s. Rate: 7.5 symbols/min [2025-09-19T19:53:55.048365] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-19T19:53:55.150861] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:53:55.164159] [DEBUG] [LOCAL ] MCB: Loaded 11902 existing records from primary storage. [2025-09-19T19:53:55.164284] [INFO ] [MAIN ] MCB: Loaded 11902 existing records. [2025-09-19T19:53:55.328682] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T19:53:55.413463] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:53:55.413798] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-19T19:53:55.413852] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-19T19:53:55.414264] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-19T19:53:55.414324] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-19T19:53:55.775250] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:53:55.843285] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-19T19:53:56.123180] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T19:53:56.261830] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T19:53:56.643304] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-19T19:53:56.868029] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T19:53:57.443275] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-19T19:53:58.243245] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-19T19:53:58.343425] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T19:53:58.664514] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T19:53:58.889538] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T19:53:59.043314] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-19T19:53:59.843269] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-19T19:54:00.643316] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-19T19:54:00.786080] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T19:54:00.808589] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T19:54:01.443274] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-19T19:54:02.243277] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-19T19:54:02.704582] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T19:54:03.043278] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-19T19:54:03.844370] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-19T19:54:03.844464] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-19T19:54:03.864068] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T19:54:04.643314] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-19T19:54:05.321349] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T19:54:05.325458] [INFO ] [REMOTE ] MBI: Full fetch complete (36887 records). [2025-09-19T19:54:05.325551] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-19T19:54:05.448570] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-19T19:54:05.756499] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-19T19:54:05.756608] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-19T19:54:05.757360] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-19T19:54:05.757436] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-19T19:54:05.758344] [DEBUG] [LOCAL ] MBI: Trimmed 36887 records to 25442 (keeping 200 days of data) [2025-09-19T19:54:05.865595] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-19T19:54:05.941871] [DEBUG] [LOCAL ] MBI: Primary data saved (25442 records). [2025-09-19T19:54:05.942054] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-19T19:54:05.942190] [INFO ] [MAIN ] Update Progress: 1311/2372 symbols completed. MBI took 25.6s. Estimated remaining: 2h 20m 51s. Rate: 7.5 symbols/min [2025-09-19T19:54:06.149326] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:54:06.175095] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T19:54:06.244820] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-19T19:54:06.246958] [DEBUG] [LOCAL ] MCD: Loaded 53857 existing records from primary storage. [2025-09-19T19:54:06.247254] [INFO ] [MAIN ] MCD: Loaded 53857 existing records. [2025-09-19T19:54:06.436042] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:54:06.436322] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-19T19:54:06.436372] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-19T19:54:06.437789] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-19T19:54:06.437853] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-19T19:54:06.807561] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:54:06.820005] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T19:54:07.043332] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-19T19:54:07.843299] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-19T19:54:07.972161] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T19:54:08.250716] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T19:54:08.643275] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-19T19:54:09.443311] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-19T19:54:09.814352] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T19:54:10.177108] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T19:54:10.243222] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-19T19:54:11.043314] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-19T19:54:11.161270] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T19:54:11.843329] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-19T19:54:12.555962] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T19:54:12.643300] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-19T19:54:13.182008] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T19:54:13.443227] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-19T19:54:13.595864] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T19:54:13.758858] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T19:54:14.243279] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-19T19:54:15.043317] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-19T19:54:15.312752] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T19:54:15.843291] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-19T19:54:16.157207] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T19:54:16.164733] [INFO ] [REMOTE ] MBC: Full fetch complete (62386 records). [2025-09-19T19:54:16.164896] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-19T19:54:16.579319] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-19T19:54:16.579473] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-19T19:54:16.580456] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-19T19:54:16.580523] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-19T19:54:16.582113] [DEBUG] [LOCAL ] MBC: Trimmed 62386 records to 43804 (keeping 200 days of data) [2025-09-19T19:54:16.665832] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-19T19:54:16.855357] [DEBUG] [LOCAL ] MBC: Primary data saved (43804 records). [2025-09-19T19:54:16.855517] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-19T19:54:16.855613] [INFO ] [MAIN ] Update Progress: 1312/2372 symbols completed. MBC took 37.5s. Estimated remaining: 2h 20m 45s. Rate: 7.5 symbols/min [2025-09-19T19:54:17.035811] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:54:17.046148] [DEBUG] [LOCAL ] MCI: Loaded 6363 existing records from primary storage. [2025-09-19T19:54:17.046395] [INFO ] [MAIN ] MCI: Loaded 6363 existing records. [2025-09-19T19:54:17.251074] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:54:17.252014] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-19T19:54:17.252189] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-19T19:54:17.259056] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-19T19:54:17.262391] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T19:54:17.261844] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-19T19:54:17.445072] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-19T19:54:17.682303] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:54:17.685495] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-19T19:54:17.731547] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T19:54:18.243281] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-19T19:54:18.516635] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T19:54:18.519029] [INFO ] [REMOTE ] MCB: Full fetch complete (16356 records). [2025-09-19T19:54:18.519109] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-19T19:54:18.883283] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-19T19:54:18.883376] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-19T19:54:18.883767] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-19T19:54:18.883828] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-19T19:54:18.884357] [DEBUG] [LOCAL ] MCB: Trimmed 16356 records to 11984 (keeping 200 days of data) [2025-09-19T19:54:18.957307] [DEBUG] [LOCAL ] MCB: Primary data saved (11984 records). [2025-09-19T19:54:18.957438] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-19T19:54:18.957525] [INFO ] [MAIN ] Update Progress: 1313/2372 symbols completed. MCB took 24.0s. Estimated remaining: 2h 20m 32s. Rate: 7.5 symbols/min [2025-09-19T19:54:19.048461] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-19T19:54:19.126581] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:54:19.167933] [DEBUG] [LOCAL ] MCK: Loaded 39841 existing records from primary storage. [2025-09-19T19:54:19.168072] [INFO ] [MAIN ] MCK: Loaded 39841 existing records. [2025-09-19T19:54:19.344205] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:54:19.344492] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-19T19:54:19.344543] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-19T19:54:19.345882] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-19T19:54:19.345945] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-19T19:54:19.490043] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T19:54:19.707746] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:54:19.843247] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-19T19:54:20.643271] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-19T19:54:21.443272] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-19T19:54:21.497847] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T19:54:21.972171] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-09-19T19:54:22.243274] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-19T19:54:22.542533] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-19T19:54:23.043243] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-19T19:54:23.167533] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T19:54:23.220775] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T19:54:23.843274] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-19T19:54:24.356177] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T19:54:24.643274] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-19T19:54:25.443328] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-19T19:54:25.607945] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T19:54:26.243326] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-19T19:54:26.285971] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T19:54:26.439325] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T19:54:27.043278] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-19T19:54:27.843268] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-19T19:54:27.909154] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T19:54:28.260812] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T19:54:28.643290] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-19T19:54:28.752006] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T19:54:28.757821] [INFO ] [REMOTE ] MC: Full fetch complete (62072 records). [2025-09-19T19:54:28.757931] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-19T19:54:29.137668] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-19T19:54:29.137773] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-19T19:54:29.138687] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-19T19:54:29.138752] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-19T19:54:29.140089] [DEBUG] [LOCAL ] MC: Trimmed 62072 records to 45069 (keeping 200 days of data) [2025-09-19T19:54:29.412091] [DEBUG] [LOCAL ] MC: Primary data saved (45069 records). [2025-09-19T19:54:29.412227] [INFO ] [MAIN ] MC: Full history saved. [2025-09-19T19:54:29.412313] [INFO ] [MAIN ] Update Progress: 1314/2372 symbols completed. MC took 36.6s. Estimated remaining: 2h 20m 26s. Rate: 7.5 symbols/min [2025-09-19T19:54:29.444177] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-19T19:54:29.593638] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:54:29.603329] [DEBUG] [LOCAL ] MCN: Loaded 8248 existing records from primary storage. [2025-09-19T19:54:29.603445] [INFO ] [MAIN ] MCN: Loaded 8248 existing records. [2025-09-19T19:54:29.783058] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:54:29.783393] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-19T19:54:29.783456] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-19T19:54:29.783810] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-19T19:54:29.783879] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-19T19:54:30.147209] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:54:30.243296] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-19T19:54:31.044862] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T19:54:31.043385] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-19T19:54:31.099961] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T19:54:31.259377] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T19:54:31.843275] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-19T19:54:31.996942] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T19:54:32.643259] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-19T19:54:32.897709] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T19:54:33.443273] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-19T19:54:33.559258] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T19:54:34.243285] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-19T19:54:34.369682] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:54:34.950961] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T19:54:35.043289] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-19T19:54:35.840512] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-19T19:54:35.843203] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-19T19:54:36.643264] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-19T19:54:36.741263] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T19:54:36.742855] [INFO ] [REMOTE ] MCI: Full fetch complete (9792 records). [2025-09-19T19:54:36.742953] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-19T19:54:37.126896] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-19T19:54:37.126978] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-19T19:54:37.127298] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-19T19:54:37.127363] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-19T19:54:37.127854] [DEBUG] [LOCAL ] MCI: Trimmed 9792 records to 6425 (keeping 200 days of data) [2025-09-19T19:54:37.169904] [DEBUG] [LOCAL ] MCI: Primary data saved (6425 records). [2025-09-19T19:54:37.170034] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-19T19:54:37.170140] [INFO ] [MAIN ] Update Progress: 1315/2372 symbols completed. MCI took 20.3s. Estimated remaining: 2h 20m 18s. Rate: 7.5 symbols/min [2025-09-19T19:54:37.338116] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:54:37.377526] [DEBUG] [LOCAL ] MCO: Loaded 39958 existing records from primary storage. [2025-09-19T19:54:37.377711] [INFO ] [MAIN ] MCO: Loaded 39958 existing records. [2025-09-19T19:54:37.451009] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-19T19:54:37.564129] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:54:37.564402] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T19:54:37.564776] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-19T19:54:37.567164] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-19T19:54:37.568672] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-19T19:54:37.568733] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-19T19:54:37.924522] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:54:38.243319] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-19T19:54:39.043257] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-19T19:54:39.843788] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-19T19:54:39.859212] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-19T19:54:39.868319] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-19T19:54:40.234415] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T19:54:40.643273] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-19T19:54:41.443298] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-19T19:54:41.527695] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T19:54:41.542409] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T19:54:42.243296] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-19T19:54:43.043285] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-19T19:54:43.261476] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T19:54:43.843269] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-19T19:54:43.947680] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T19:54:44.056145] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T19:54:44.643279] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-19T19:54:45.443280] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-19T19:54:45.503707] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T19:54:45.557567] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T19:54:46.243290] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-19T19:54:47.043277] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-19T19:54:47.256783] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:54:47.371571] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T19:54:47.843286] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-19T19:54:47.877122] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T19:54:48.643279] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-19T19:54:49.443304] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-19T19:54:49.461296] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-19T19:54:49.464085] [INFO ] [REMOTE ] MCN: Full fetch complete (11502 records). [2025-09-19T19:54:49.464193] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-19T19:54:49.837502] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-19T19:54:49.837607] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-19T19:54:49.837951] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-19T19:54:49.838006] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-19T19:54:49.838775] [DEBUG] [LOCAL ] MCN: Trimmed 11502 records to 8284 (keeping 200 days of data) [2025-09-19T19:54:49.891151] [DEBUG] [LOCAL ] MCN: Primary data saved (8284 records). [2025-09-19T19:54:49.891291] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-19T19:54:49.891431] [INFO ] [MAIN ] Update Progress: 1316/2372 symbols completed. MCN took 20.5s. Estimated remaining: 2h 20m 14s. Rate: 7.5 symbols/min [2025-09-19T19:54:50.069052] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:54:50.083265] [DEBUG] [LOCAL ] MCR: Loaded 9016 existing records from primary storage. [2025-09-19T19:54:50.083417] [INFO ] [MAIN ] MCR: Loaded 9016 existing records. [2025-09-19T19:54:50.244802] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-19T19:54:50.282440] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:54:50.283384] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-19T19:54:50.283476] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-19T19:54:50.284012] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-19T19:54:50.284109] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-19T19:54:50.466964] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-19T19:54:50.826894] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:54:51.043270] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-19T19:54:51.499519] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T19:54:51.843269] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-19T19:54:52.058396] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T19:54:52.189904] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T19:54:52.643291] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-19T19:54:53.443276] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-19T19:54:54.243323] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-19T19:54:54.385934] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-19T19:54:54.617142] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:54:55.043262] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-19T19:54:55.128176] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T19:54:55.136205] [INFO ] [REMOTE ] MCK: Full fetch complete (57465 records). [2025-09-19T19:54:55.136384] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-19T19:54:55.508247] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T19:54:55.530868] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-19T19:54:55.530977] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-19T19:54:55.532051] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-19T19:54:55.532138] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-19T19:54:55.533541] [DEBUG] [LOCAL ] MCK: Trimmed 57465 records to 40064 (keeping 200 days of data) [2025-09-19T19:54:55.820081] [DEBUG] [LOCAL ] MCK: Primary data saved (40064 records). [2025-09-19T19:54:55.820348] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-19T19:54:55.820634] [INFO ] [MAIN ] Update Progress: 1317/2372 symbols completed. MCK took 36.9s. Estimated remaining: 2h 20m 4s. Rate: 7.5 symbols/min [2025-09-19T19:54:55.843246] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-19T19:54:56.643294] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-19T19:54:56.777718] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T19:54:56.805509] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:54:57.443311] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-19T19:54:58.243382] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-19T19:54:58.374131] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T19:54:58.730920] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T19:54:59.043359] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-19T19:54:59.477623] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T19:54:59.843294] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-19T19:55:00.643294] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-19T19:55:00.855222] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T19:55:01.443285] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-19T19:55:01.514312] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-19T19:55:01.523717] [INFO ] [REMOTE ] MCD: Full fetch complete (77025 records). [2025-09-19T19:55:01.523869] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-19T19:55:01.774098] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T19:55:01.775015] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:55:01.775095] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:55:01.775171] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-19T19:55:01.775259] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-19T19:55:01.775319] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-19T19:55:01.775754] [DEBUG] [LOCAL ] MCD: Deleted derivative data file. [2025-09-19T19:55:01.776750] [INFO ] [MAIN ] Update Progress: 1318/2372 symbols completed. MCD took 55.8s. Estimated remaining: 2h 19m 55s. Rate: 7.5 symbols/min [2025-09-19T19:55:02.438768] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T19:55:02.441829] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-19T19:55:02.644442] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T19:55:03.043414] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-19T19:55:03.327697] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T19:55:03.843381] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-19T19:55:04.744055] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:55:04.753276] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-19T19:55:04.844807] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T19:55:05.443316] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-19T19:55:06.514890] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T19:55:06.518233] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-19T19:55:06.563862] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T19:55:06.571564] [INFO ] [REMOTE ] MCO: Full fetch complete (56341 records). [2025-09-19T19:55:06.571770] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-19T19:55:06.977586] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-19T19:55:06.977741] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-19T19:55:06.979039] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-19T19:55:06.979166] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-19T19:55:06.983053] [DEBUG] [LOCAL ] MCO: Trimmed 56341 records to 40292 (keeping 200 days of data) [2025-09-19T19:55:07.260879] [DEBUG] [LOCAL ] MCO: Primary data saved (40292 records). [2025-09-19T19:55:07.261011] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-19T19:55:07.261128] [INFO ] [MAIN ] Update Progress: 1319/2372 symbols completed. MCO took 30.1s. Estimated remaining: 2h 19m 45s. Rate: 7.5 symbols/min [2025-09-19T19:55:07.396223] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:55:07.397983] [INFO ] [REMOTE ] MCR: Full fetch complete (14222 records). [2025-09-19T19:55:07.398065] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-19T19:55:07.772890] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-19T19:55:07.773001] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-19T19:55:07.773355] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-19T19:55:07.773394] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-19T19:55:07.773913] [DEBUG] [LOCAL ] MCR: Trimmed 14222 records to 9047 (keeping 200 days of data) [2025-09-19T19:55:07.830958] [DEBUG] [LOCAL ] MCR: Primary data saved (9047 records). [2025-09-19T19:55:07.831096] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-19T19:55:07.831206] [INFO ] [MAIN ] Update Progress: 1320/2372 symbols completed. MCR took 17.9s. Estimated remaining: 2h 19m 31s. Rate: 7.5 symbols/min [2025-09-19T19:55:08.487821] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:08.461353] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:08.511575] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:08.545057] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:08.561626] [DEBUG] [LOCAL ] MDST: Loaded 5493 existing records from primary storage. [2025-09-19T19:55:08.561911] [INFO ] [MAIN ] MDST: Loaded 5493 existing records. [2025-09-19T19:55:08.762229] [DEBUG] [LOCAL ] MCS: Loaded 21651 existing records from primary storage. [2025-09-19T19:55:08.822252] [INFO ] [MAIN ] MCS: Loaded 21651 existing records. [2025-09-19T19:55:08.807094] [DEBUG] [LOCAL ] MCY: Loaded 25816 existing records from primary storage. [2025-09-19T19:55:08.825685] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:08.846432] [INFO ] [MAIN ] MCY: Loaded 25816 existing records. [2025-09-19T19:55:08.869931] [DEBUG] [LOCAL ] MD: Loaded 39088 existing records from primary storage. [2025-09-19T19:55:08.885912] [INFO ] [MAIN ] MD: Loaded 39088 existing records. [2025-09-19T19:55:08.951495] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-19T19:55:08.964083] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-19T19:55:08.969412] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-19T19:55:09.003445] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-19T19:55:09.527350] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:09.545088] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:09.567351] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:09.572906] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-19T19:55:09.572631] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-19T19:55:09.573434] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-19T19:55:09.573482] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-19T19:55:09.573364] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-19T19:55:09.573769] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-19T19:55:09.574702] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-19T19:55:09.574854] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-19T19:55:09.574660] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-19T19:55:09.575007] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-19T19:55:09.585540] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-19T19:55:09.575054] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-19T19:55:10.487539] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:10.566777] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-19T19:55:10.838085] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:10.933913] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-19T19:55:10.974076] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:10.978064] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:10.978710] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-19T19:55:10.978427] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-19T19:55:11.629974] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T19:55:11.632543] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-19T19:55:12.207187] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T19:55:12.211693] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-19T19:55:12.295852] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T19:55:12.297950] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-19T19:55:12.448576] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T19:55:12.654757] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-19T19:55:12.657329] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T19:55:12.732807] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-19T19:55:13.111459] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T19:55:13.443281] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-19T19:55:14.243268] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-19T19:55:14.467448] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T19:55:15.002764] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T19:55:15.043251] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-19T19:55:15.535540] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-19T19:55:15.549551] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T19:55:15.843271] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-19T19:55:16.234942] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-19T19:55:16.643293] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-19T19:55:17.353255] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T19:55:17.443240] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-19T19:55:18.243284] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-19T19:55:19.025365] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T19:55:19.043292] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-19T19:55:19.609506] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T19:55:19.843283] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-19T19:55:20.029991] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T19:55:20.643264] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-19T19:55:21.065120] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T19:55:21.443328] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-19T19:55:22.243299] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-19T19:55:22.382394] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T19:55:22.521367] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T19:55:23.043274] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-19T19:55:23.843269] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-19T19:55:23.888964] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:55:24.643252] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-19T19:55:24.813053] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T19:55:24.908455] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T19:55:25.443291] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-19T19:55:26.243243] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-19T19:55:26.375255] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T19:55:26.698314] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T19:55:27.043264] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-19T19:55:27.128749] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T19:55:27.130528] [INFO ] [REMOTE ] MDST: Full fetch complete (8377 records). [2025-09-19T19:55:27.130603] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-19T19:55:27.491676] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-19T19:55:27.491767] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-19T19:55:27.492002] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-19T19:55:27.492041] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-19T19:55:27.492449] [DEBUG] [LOCAL ] MDST: Trimmed 8377 records to 5577 (keeping 200 days of data) [2025-09-19T19:55:27.526250] [DEBUG] [LOCAL ] MDST: Primary data saved (5577 records). [2025-09-19T19:55:27.526350] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-19T19:55:27.526444] [INFO ] [MAIN ] Update Progress: 1321/2372 symbols completed. MDST took 19.7s. Estimated remaining: 2h 19m 32s. Rate: 7.5 symbols/min [2025-09-19T19:55:27.694936] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:27.761341] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-09-19T19:55:27.761533] [INFO ] [MAIN ] MDT: Loaded 54068 existing records. [2025-09-19T19:55:27.851349] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-19T19:55:27.942293] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:27.942566] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-19T19:55:27.942621] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-19T19:55:27.944232] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-19T19:55:27.944306] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-19T19:55:28.309451] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:28.643290] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-19T19:55:28.807834] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T19:55:28.895814] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T19:55:29.443312] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-19T19:55:30.243294] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-19T19:55:30.281101] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T19:55:30.514725] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-19T19:55:31.043247] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-19T19:55:31.519238] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T19:55:31.843309] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-19T19:55:32.643275] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-19T19:55:32.698271] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T19:55:33.416736] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T19:55:33.443209] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-19T19:55:34.123469] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T19:55:34.243289] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-19T19:55:35.043302] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-19T19:55:35.491457] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T19:55:35.570685] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T19:55:35.574354] [INFO ] [REMOTE ] MCS: Full fetch complete (30280 records). [2025-09-19T19:55:35.574447] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-19T19:55:35.852325] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-19T19:55:35.969904] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-19T19:55:35.970001] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-19T19:55:35.970757] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-19T19:55:35.970819] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-19T19:55:35.972312] [DEBUG] [LOCAL ] MCS: Trimmed 30280 records to 21782 (keeping 200 days of data) [2025-09-19T19:55:36.111171] [DEBUG] [LOCAL ] MCS: Primary data saved (21782 records). [2025-09-19T19:55:36.111311] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-19T19:55:36.111402] [INFO ] [MAIN ] Update Progress: 1322/2372 symbols completed. MCS took 28.3s. Estimated remaining: 2h 19m 25s. Rate: 7.5 symbols/min [2025-09-19T19:55:36.290504] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:36.348039] [DEBUG] [LOCAL ] MDU: Loaded 48211 existing records from primary storage. [2025-09-19T19:55:36.348237] [INFO ] [MAIN ] MDU: Loaded 48211 existing records. [2025-09-19T19:55:36.552474] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:36.553235] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-19T19:55:36.553436] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-19T19:55:36.555085] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-19T19:55:36.555148] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-19T19:55:36.653795] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-19T19:55:36.722584] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T19:55:36.975710] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:37.443295] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-19T19:55:37.549545] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T19:55:38.255761] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-19T19:55:38.261605] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T19:55:38.801731] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-19T19:55:39.043280] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-19T19:55:39.720697] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T19:55:39.843234] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-19T19:55:40.643236] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-19T19:55:41.064734] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T19:55:41.164955] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T19:55:41.443287] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-19T19:55:42.243286] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-19T19:55:42.396279] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T19:55:42.402401] [INFO ] [REMOTE ] MD: Full fetch complete (55307 records). [2025-09-19T19:55:42.402526] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-19T19:55:42.823875] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-19T19:55:42.823996] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-19T19:55:42.824944] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-19T19:55:42.825020] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-19T19:55:42.826328] [DEBUG] [LOCAL ] MD: Trimmed 55307 records to 39347 (keeping 200 days of data) [2025-09-19T19:55:43.043312] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-19T19:55:43.060989] [DEBUG] [LOCAL ] MD: Primary data saved (39347 records). [2025-09-19T19:55:43.061199] [INFO ] [MAIN ] MD: Full history saved. [2025-09-19T19:55:43.061291] [INFO ] [MAIN ] Update Progress: 1323/2372 symbols completed. MD took 35.2s. Estimated remaining: 2h 19m 16s. Rate: 7.5 symbols/min [2025-09-19T19:55:43.237058] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:43.247574] [DEBUG] [LOCAL ] MDV: Loaded 8882 existing records from primary storage. [2025-09-19T19:55:43.247754] [INFO ] [MAIN ] MDV: Loaded 8882 existing records. [2025-09-19T19:55:43.450684] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:43.451317] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-19T19:55:43.451412] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-19T19:55:43.451991] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-19T19:55:43.452137] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-19T19:55:43.628373] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T19:55:43.848954] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-19T19:55:43.854494] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:44.298054] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T19:55:44.434621] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T19:55:44.643270] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-19T19:55:45.443270] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-19T19:55:45.466159] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T19:55:45.725254] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T19:55:46.243249] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-19T19:55:46.746099] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T19:55:47.043274] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-19T19:55:47.843263] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-19T19:55:48.255123] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T19:55:48.589638] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T19:55:48.643270] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-19T19:55:48.833102] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T19:55:49.443270] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-19T19:55:50.243265] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-19T19:55:50.890166] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T19:55:51.043231] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-19T19:55:51.292543] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T19:55:51.553928] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T19:55:51.558722] [INFO ] [REMOTE ] MCY: Full fetch complete (41745 records). [2025-09-19T19:55:51.558823] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-19T19:55:51.848375] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-19T19:55:51.973385] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-19T19:55:51.973520] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-19T19:55:51.974487] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-19T19:55:51.974558] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-19T19:55:51.975714] [DEBUG] [LOCAL ] MCY: Trimmed 41745 records to 25942 (keeping 200 days of data) [2025-09-19T19:55:52.149041] [DEBUG] [LOCAL ] MCY: Primary data saved (25942 records). [2025-09-19T19:55:52.149180] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-19T19:55:52.149282] [INFO ] [MAIN ] Update Progress: 1324/2372 symbols completed. MCY took 44.3s. Estimated remaining: 2h 19m 9s. Rate: 7.5 symbols/min [2025-09-19T19:55:52.320426] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:52.338699] [DEBUG] [LOCAL ] MEC: Loaded 16794 existing records from primary storage. [2025-09-19T19:55:52.338834] [INFO ] [MAIN ] MEC: Loaded 16794 existing records. [2025-09-19T19:55:52.522297] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:52.522566] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-19T19:55:52.522615] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-19T19:55:52.523304] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-19T19:55:52.523369] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-19T19:55:52.648364] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-19T19:55:52.821325] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T19:55:52.937048] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:53.112601] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T19:55:53.443264] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-19T19:55:54.243289] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-19T19:55:54.547422] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T19:55:54.761198] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T19:55:55.043274] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-19T19:55:55.468534] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T19:55:55.843300] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-19T19:55:56.643243] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-19T19:55:56.854844] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T19:55:57.181485] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T19:55:57.191688] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-19T19:55:57.191869] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-19T19:55:57.452451] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-19T19:55:57.618012] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-19T19:55:57.618094] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-19T19:55:57.619093] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-19T19:55:57.619157] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-19T19:55:57.620594] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 54458 (keeping 200 days of data) [2025-09-19T19:55:57.962926] [DEBUG] [LOCAL ] MDT: Primary data saved (54458 records). [2025-09-19T19:55:57.963135] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-19T19:55:57.963241] [INFO ] [MAIN ] Update Progress: 1325/2372 symbols completed. MDT took 30.4s. Estimated remaining: 2h 18m 59s. Rate: 7.5 symbols/min [2025-09-19T19:55:58.134385] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:55:58.167840] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T19:55:58.194208] [DEBUG] [LOCAL ] MED: Loaded 22087 existing records from primary storage. [2025-09-19T19:55:58.194347] [INFO ] [MAIN ] MED: Loaded 22087 existing records. [2025-09-19T19:55:58.248374] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-19T19:55:58.376269] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:55:58.376519] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-19T19:55:58.376578] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-19T19:55:58.377351] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-19T19:55:58.377412] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-19T19:55:58.670678] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T19:55:58.750221] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:55:59.043267] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-19T19:55:59.234491] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T19:55:59.843271] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-19T19:56:00.643287] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-19T19:56:00.886480] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T19:56:01.066701] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T19:56:01.443294] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-19T19:56:02.041453] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T19:56:02.243242] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-19T19:56:02.405890] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T19:56:03.043302] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-19T19:56:03.651759] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T19:56:03.843276] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-19T19:56:04.471974] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T19:56:04.643309] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-19T19:56:05.443281] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-19T19:56:05.682397] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T19:56:06.085167] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T19:56:06.176050] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T19:56:06.243254] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-19T19:56:07.043307] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-19T19:56:07.210667] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T19:56:07.843253] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-19T19:56:08.175833] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T19:56:08.643308] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-19T19:56:09.443336] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-19T19:56:09.782852] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T19:56:09.813800] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T19:56:09.824844] [INFO ] [REMOTE ] MDU: Full fetch complete (70243 records). [2025-09-19T19:56:09.825026] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-19T19:56:10.238263] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-19T19:56:10.238354] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-19T19:56:10.239303] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-19T19:56:10.239367] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-19T19:56:10.240869] [DEBUG] [LOCAL ] MDU: Trimmed 70243 records to 48589 (keeping 200 days of data) [2025-09-19T19:56:10.243279] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-19T19:56:10.544963] [DEBUG] [LOCAL ] MDU: Primary data saved (48589 records). [2025-09-19T19:56:10.545108] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-19T19:56:10.545207] [INFO ] [MAIN ] Update Progress: 1326/2372 symbols completed. MDU took 34.4s. Estimated remaining: 2h 18m 55s. Rate: 7.5 symbols/min [2025-09-19T19:56:10.694047] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T19:56:10.729393] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:56:10.763346] [DEBUG] [LOCAL ] MEG: Loaded 32409 existing records from primary storage. [2025-09-19T19:56:10.763530] [INFO ] [MAIN ] MEG: Loaded 32409 existing records. [2025-09-19T19:56:10.940533] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:56:10.940830] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-19T19:56:10.940883] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-19T19:56:10.941856] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-19T19:56:10.941920] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-19T19:56:11.048525] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-19T19:56:11.327522] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:56:11.444088] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T19:56:11.843266] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-19T19:56:11.909847] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:56:11.911268] [INFO ] [REMOTE ] MDV: Full fetch complete (11652 records). [2025-09-19T19:56:11.911339] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-19T19:56:12.272767] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-19T19:56:12.272846] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-19T19:56:12.273119] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-19T19:56:12.273178] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-19T19:56:12.273737] [DEBUG] [LOCAL ] MDV: Trimmed 11652 records to 8942 (keeping 200 days of data) [2025-09-19T19:56:12.327323] [DEBUG] [LOCAL ] MDV: Primary data saved (8942 records). [2025-09-19T19:56:12.327434] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-19T19:56:12.327541] [INFO ] [MAIN ] Update Progress: 1327/2372 symbols completed. MDV took 29.3s. Estimated remaining: 2h 18m 42s. Rate: 7.5 symbols/min [2025-09-19T19:56:12.494806] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:56:12.515940] [DEBUG] [LOCAL ] MEGI: Loaded 20737 existing records from primary storage. [2025-09-19T19:56:12.516060] [INFO ] [MAIN ] MEGI: Loaded 20737 existing records. [2025-09-19T19:56:12.653927] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-19T19:56:12.695959] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:56:12.696230] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-19T19:56:12.696281] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-19T19:56:12.696961] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-19T19:56:12.697050] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-19T19:56:13.054634] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:56:13.357114] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T19:56:13.443315] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-19T19:56:14.243263] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-19T19:56:14.392782] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T19:56:14.968321] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T19:56:15.043251] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-19T19:56:15.840171] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T19:56:15.847568] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-19T19:56:16.376179] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T19:56:16.643283] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-19T19:56:17.042966] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:56:17.443304] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-19T19:56:18.243313] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-19T19:56:18.386311] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T19:56:18.897075] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T19:56:18.899758] [INFO ] [REMOTE ] MEC: Full fetch complete (22623 records). [2025-09-19T19:56:18.899833] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-19T19:56:19.052910] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-19T19:56:19.312351] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-19T19:56:19.312462] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-19T19:56:19.313214] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-19T19:56:19.313281] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-19T19:56:19.313970] [DEBUG] [LOCAL ] MEC: Trimmed 22623 records to 16915 (keeping 200 days of data) [2025-09-19T19:56:19.426247] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T19:56:19.428211] [DEBUG] [LOCAL ] MEC: Primary data saved (16915 records). [2025-09-19T19:56:19.432122] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-19T19:56:19.432380] [INFO ] [MAIN ] Update Progress: 1328/2372 symbols completed. MEC took 27.3s. Estimated remaining: 2h 18m 34s. Rate: 7.5 symbols/min [2025-09-19T19:56:19.603091] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:56:19.644926] [DEBUG] [LOCAL ] MEI: Loaded 32951 existing records from primary storage. [2025-09-19T19:56:19.645096] [INFO ] [MAIN ] MEI: Loaded 32951 existing records. [2025-09-19T19:56:19.826073] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:56:19.826342] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-19T19:56:19.826393] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-19T19:56:19.827326] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-19T19:56:19.827389] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-19T19:56:19.848367] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-19T19:56:20.202168] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:56:20.643233] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-19T19:56:20.689346] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T19:56:21.152848] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T19:56:21.443259] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-19T19:56:21.863027] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T19:56:22.243315] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-19T19:56:23.043337] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-19T19:56:23.089388] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T19:56:23.806475] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T19:56:23.843215] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-19T19:56:24.356560] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T19:56:24.643261] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-19T19:56:25.317737] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T19:56:25.443273] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-19T19:56:26.243317] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-19T19:56:26.279362] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T19:56:26.655128] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T19:56:27.043286] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-19T19:56:27.426052] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T19:56:27.843229] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-19T19:56:28.375254] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T19:56:28.643260] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-19T19:56:29.317817] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T19:56:29.443276] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-19T19:56:29.781930] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T19:56:30.243228] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-19T19:56:30.361329] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T19:56:31.043270] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-19T19:56:31.720425] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T19:56:31.843227] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-19T19:56:32.277308] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T19:56:32.280368] [INFO ] [REMOTE ] MED: Full fetch complete (33133 records). [2025-09-19T19:56:32.280448] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-19T19:56:32.651026] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-19T19:56:32.666379] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-19T19:56:32.666935] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-19T19:56:32.667750] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-19T19:56:32.667821] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-19T19:56:32.669136] [DEBUG] [LOCAL ] MED: Trimmed 33133 records to 22191 (keeping 200 days of data) [2025-09-19T19:56:32.806055] [DEBUG] [LOCAL ] MED: Primary data saved (22191 records). [2025-09-19T19:56:32.806215] [INFO ] [MAIN ] MED: Full history saved. [2025-09-19T19:56:32.806319] [INFO ] [MAIN ] Update Progress: 1329/2372 symbols completed. MED took 34.8s. Estimated remaining: 2h 18m 30s. Rate: 7.5 symbols/min [2025-09-19T19:56:32.990091] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:56:33.043569] [DEBUG] [LOCAL ] MET: Loaded 53702 existing records from primary storage. [2025-09-19T19:56:33.043782] [INFO ] [MAIN ] MET: Loaded 53702 existing records. [2025-09-19T19:56:33.237896] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:56:33.238163] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-19T19:56:33.238211] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-19T19:56:33.239388] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-19T19:56:33.239447] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-19T19:56:33.448785] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-19T19:56:33.578442] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T19:56:33.661678] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:56:34.243273] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-19T19:56:34.364030] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T19:56:34.447439] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T19:56:35.043266] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-19T19:56:35.843277] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-19T19:56:36.330607] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T19:56:36.643919] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-19T19:56:36.646610] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T19:56:37.443317] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-19T19:56:37.551996] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T19:56:38.243312] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-19T19:56:38.343314] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T19:56:38.735685] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T19:56:39.043279] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-19T19:56:39.797024] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T19:56:39.802838] [INFO ] [REMOTE ] MEG: Full fetch complete (48327 records). [2025-09-19T19:56:39.803030] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-19T19:56:39.848406] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-19T19:56:40.211575] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-19T19:56:40.211742] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-19T19:56:40.213125] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-19T19:56:40.213198] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-19T19:56:40.214986] [DEBUG] [LOCAL ] MEG: Trimmed 48327 records to 32614 (keeping 200 days of data) [2025-09-19T19:56:40.443991] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T19:56:40.456218] [DEBUG] [LOCAL ] MEG: Primary data saved (32614 records). [2025-09-19T19:56:40.456462] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-19T19:56:40.456637] [INFO ] [MAIN ] Update Progress: 1330/2372 symbols completed. MEG took 29.9s. Estimated remaining: 2h 18m 22s. Rate: 7.5 symbols/min [2025-09-19T19:56:40.638018] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:56:40.643286] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-19T19:56:40.687135] [DEBUG] [LOCAL ] MFA: Loaded 45505 existing records from primary storage. [2025-09-19T19:56:40.687299] [INFO ] [MAIN ] MFA: Loaded 45505 existing records. [2025-09-19T19:56:40.883129] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:56:40.883534] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-19T19:56:40.883588] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-19T19:56:40.884915] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-19T19:56:40.884980] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-19T19:56:41.283121] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:56:41.299743] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T19:56:41.443267] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-19T19:56:42.243330] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-19T19:56:42.367911] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T19:56:42.860868] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T19:56:43.043323] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-19T19:56:43.843288] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-19T19:56:44.055714] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T19:56:44.266575] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T19:56:44.269970] [INFO ] [REMOTE ] MEGI: Full fetch complete (30715 records). [2025-09-19T19:56:44.270065] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-19T19:56:44.639409] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-19T19:56:44.639496] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-19T19:56:44.640132] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-19T19:56:44.640194] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-19T19:56:44.640970] [DEBUG] [LOCAL ] MEGI: Trimmed 30715 records to 20847 (keeping 200 days of data) [2025-09-19T19:56:44.691763] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-19T19:56:44.772449] [DEBUG] [LOCAL ] MEGI: Primary data saved (20847 records). [2025-09-19T19:56:44.772577] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-19T19:56:44.772690] [INFO ] [MAIN ] Update Progress: 1331/2372 symbols completed. MEGI took 32.4s. Estimated remaining: 2h 18m 11s. Rate: 7.5 symbols/min [2025-09-19T19:56:44.978158] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:56:44.985075] [DEBUG] [LOCAL ] MFAN: Loaded 4318 existing records from primary storage. [2025-09-19T19:56:44.985199] [INFO ] [MAIN ] MFAN: Loaded 4318 existing records. [2025-09-19T19:56:45.163300] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:56:45.163629] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-19T19:56:45.163715] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-19T19:56:45.164072] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-19T19:56:45.164139] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-19T19:56:45.448350] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-19T19:56:45.524200] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:56:45.564449] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T19:56:46.243302] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-19T19:56:46.286998] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T19:56:46.775735] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T19:56:47.043264] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-19T19:56:47.218060] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-19T19:56:47.843263] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-19T19:56:47.987420] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T19:56:48.643270] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-19T19:56:49.443324] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-19T19:56:49.698072] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T19:56:50.056855] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T19:56:50.243268] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-19T19:56:50.629758] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T19:56:51.043284] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-19T19:56:51.843268] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-19T19:56:52.074781] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T19:56:52.574105] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:56:52.579954] [INFO ] [REMOTE ] MEI: Full fetch complete (45775 records). [2025-09-19T19:56:52.580110] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-19T19:56:52.649080] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-19T19:56:52.981744] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-19T19:56:52.981832] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-19T19:56:52.982597] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-19T19:56:52.982638] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-19T19:56:52.983690] [DEBUG] [LOCAL ] MEI: Trimmed 45775 records to 33152 (keeping 200 days of data) [2025-09-19T19:56:53.185018] [DEBUG] [LOCAL ] MEI: Primary data saved (33152 records). [2025-09-19T19:56:53.185167] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-19T19:56:53.185255] [INFO ] [MAIN ] Update Progress: 1332/2372 symbols completed. MEI took 33.8s. Estimated remaining: 2h 18m 3s. Rate: 7.5 symbols/min [2025-09-19T19:56:53.364508] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:56:53.371104] [DEBUG] [LOCAL ] MFAO: Loaded 3859 existing records from primary storage. [2025-09-19T19:56:53.371246] [INFO ] [MAIN ] MFAO: Loaded 3859 existing records. [2025-09-19T19:56:53.451756] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-19T19:56:53.570534] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:56:53.571419] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-19T19:56:53.571536] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-19T19:56:53.572095] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-19T19:56:53.572366] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-19T19:56:54.027329] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T19:56:54.031180] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:56:54.180152] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T19:56:54.243303] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-19T19:56:54.612377] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T19:56:55.043296] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-19T19:56:55.575616] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T19:56:55.843329] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-19T19:56:56.265319] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T19:56:56.643269] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-19T19:56:56.653267] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T19:56:57.443332] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-19T19:56:58.243246] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-19T19:56:58.851405] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-19T19:56:58.979786] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T19:56:59.043267] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-19T19:56:59.279847] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T19:56:59.727853] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T19:56:59.843263] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-19T19:57:00.596165] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T19:57:00.643285] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-19T19:57:01.323491] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T19:57:01.443306] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-19T19:57:02.243299] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-19T19:57:02.308098] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T19:57:03.043313] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-19T19:57:03.843306] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-19T19:57:04.643283] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-19T19:57:04.725938] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T19:57:04.727358] [INFO ] [REMOTE ] MFAN: Full fetch complete (5530 records). [2025-09-19T19:57:04.727449] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-19T19:57:05.107152] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-19T19:57:05.107239] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-19T19:57:05.107440] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-19T19:57:05.107478] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-19T19:57:05.107988] [DEBUG] [LOCAL ] MFAN: Trimmed 5530 records to 4335 (keeping 200 days of data) [2025-09-19T19:57:05.138598] [DEBUG] [LOCAL ] MFAN: Primary data saved (4335 records). [2025-09-19T19:57:05.138719] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-19T19:57:05.138850] [INFO ] [MAIN ] Update Progress: 1333/2372 symbols completed. MFAN took 20.4s. Estimated remaining: 2h 17m 58s. Rate: 7.5 symbols/min [2025-09-19T19:57:05.313563] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:57:05.378437] [DEBUG] [LOCAL ] MFC: Loaded 51764 existing records from primary storage. [2025-09-19T19:57:05.378628] [INFO ] [MAIN ] MFC: Loaded 51764 existing records. [2025-09-19T19:57:05.565150] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:57:05.565460] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-19T19:57:05.565583] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-19T19:57:05.567389] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-19T19:57:05.567456] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-19T19:57:05.676039] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T19:57:05.703739] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-19T19:57:05.773110] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-09-19T19:57:06.005350] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:57:06.041708] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (3.80 seconds). [2025-09-19T19:57:06.243325] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-19T19:57:06.376630] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T19:57:07.043348] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-19T19:57:07.778837] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T19:57:07.843270] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-19T19:57:08.201721] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T19:57:08.550598] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T19:57:08.643269] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-19T19:57:09.300247] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T19:57:09.443271] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-19T19:57:10.243288] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-19T19:57:11.043291] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-19T19:57:11.072364] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T19:57:11.742608] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:57:11.843284] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-19T19:57:12.376486] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T19:57:12.643276] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-19T19:57:13.215845] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T19:57:13.443305] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-19T19:57:13.693803] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T19:57:14.243292] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-19T19:57:15.043271] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-19T19:57:15.261059] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T19:57:15.843280] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-19T19:57:16.231385] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T19:57:16.239490] [INFO ] [REMOTE ] MET: Full fetch complete (77098 records). [2025-09-19T19:57:16.239708] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-19T19:57:16.659311] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-19T19:57:16.655449] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-19T19:57:16.659595] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-19T19:57:16.660735] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-19T19:57:16.660846] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-19T19:57:16.672481] [DEBUG] [LOCAL ] MET: Trimmed 77098 records to 54092 (keeping 200 days of data) [2025-09-19T19:57:17.025980] [DEBUG] [LOCAL ] MET: Primary data saved (54092 records). [2025-09-19T19:57:17.026121] [INFO ] [MAIN ] MET: Full history saved. [2025-09-19T19:57:17.026276] [INFO ] [MAIN ] Update Progress: 1334/2372 symbols completed. MET took 44.2s. Estimated remaining: 2h 17m 53s. Rate: 7.5 symbols/min [2025-09-19T19:57:17.238567] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:57:17.246615] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-19T19:57:17.302790] [DEBUG] [LOCAL ] MFG: Loaded 49327 existing records from primary storage. [2025-09-19T19:57:17.302938] [INFO ] [MAIN ] MFG: Loaded 49327 existing records. [2025-09-19T19:57:17.448505] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-19T19:57:17.494664] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:57:17.495262] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-19T19:57:17.495626] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-19T19:57:17.515193] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-19T19:57:17.516213] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-19T19:57:17.523274] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T19:57:17.587475] [INFO ] [REMOTE ] MFA: Full fetch complete (64587 records). [2025-09-19T19:57:17.573823] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T19:57:17.597844] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-19T19:57:17.598147] [INFO ] [REMOTE ] MFAO: Full fetch complete (5264 records). [2025-09-19T19:57:17.610627] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-19T19:57:18.540632] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:57:18.552347] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-19T19:57:18.736595] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-19T19:57:18.763781] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-19T19:57:18.763924] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-19T19:57:18.763883] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-19T19:57:18.764091] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-19T19:57:18.764167] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-19T19:57:18.765218] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-19T19:57:18.765332] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-19T19:57:18.766351] [DEBUG] [LOCAL ] MFAO: Trimmed 5264 records to 3866 (keeping 200 days of data) [2025-09-19T19:57:18.777515] [DEBUG] [LOCAL ] MFA: Trimmed 64587 records to 45843 (keeping 200 days of data) [2025-09-19T19:57:18.792863] [DEBUG] [LOCAL ] MFAO: Primary data saved (3866 records). [2025-09-19T19:57:18.793015] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-19T19:57:18.793150] [INFO ] [MAIN ] Update Progress: 1335/2372 symbols completed. MFAO took 25.6s. Estimated remaining: 2h 17m 41s. Rate: 7.5 symbols/min [2025-09-19T19:57:19.070138] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:57:19.095913] [DEBUG] [LOCAL ] MFM: Loaded 14511 existing records from primary storage. [2025-09-19T19:57:19.096614] [INFO ] [MAIN ] MFM: Loaded 14511 existing records. [2025-09-19T19:57:19.295180] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:57:19.296676] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-19T19:57:19.297832] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-19T19:57:19.299835] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-19T19:57:19.299940] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-19T19:57:19.783982] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:57:19.785287] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-19T19:57:19.856264] [DEBUG] [LOCAL ] MFA: Primary data saved (45843 records). [2025-09-19T19:57:19.856447] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-19T19:57:19.856591] [INFO ] [MAIN ] Update Progress: 1336/2372 symbols completed. MFA took 39.4s. Estimated remaining: 2h 17m 27s. Rate: 7.5 symbols/min [2025-09-19T19:57:20.026320] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:57:20.026549] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-19T19:57:20.026600] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-19T19:57:20.026792] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-19T19:57:20.026835] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-19T19:57:20.026873] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-19T19:57:20.026904] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-19T19:57:20.407224] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:57:20.407616] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-19T19:57:20.442312] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-09-19T19:57:20.499942] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T19:57:20.643274] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-19T19:57:20.707016] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-19T19:57:20.833167] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T19:57:21.443292] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-19T19:57:21.821455] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T19:57:22.243323] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-19T19:57:22.362631] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T19:57:22.858890] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-19T19:57:23.043277] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-19T19:57:23.843274] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-19T19:57:24.643337] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-19T19:57:24.803721] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T19:57:25.443305] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-19T19:57:25.522464] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T19:57:25.811280] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T19:57:25.809732] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-19T19:57:26.243267] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-19T19:57:27.043283] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-19T19:57:27.843264] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-19T19:57:28.050689] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T19:57:28.643329] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-19T19:57:28.792098] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T19:57:28.971273] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T19:57:29.013190] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-19T19:57:29.443327] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-19T19:57:30.243228] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-19T19:57:30.679778] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T19:57:31.043262] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-19T19:57:31.843274] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-19T19:57:32.217188] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T19:57:32.340202] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T19:57:32.643264] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-19T19:57:33.448457] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-19T19:57:33.467475] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T19:57:33.726063] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-19T19:57:34.243275] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-19T19:57:34.626948] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T19:57:35.043263] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-19T19:57:35.843263] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-19T19:57:36.242220] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T19:57:36.308836] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T19:57:36.643277] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-19T19:57:37.020382] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T19:57:37.275659] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-19T19:57:37.443239] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-19T19:57:38.128506] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T19:57:38.243259] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-19T19:57:39.043339] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-19T19:57:39.843329] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-19T19:57:40.003459] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T19:57:40.180626] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T19:57:40.521197] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T19:57:40.522668] [INFO ] [REMOTE ] MFSB: Full fetch complete (1507 records). [2025-09-19T19:57:40.522744] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-19T19:57:40.648358] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-19T19:57:40.723957] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-19T19:57:40.724559] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:57:40.724666] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:57:40.724742] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-19T19:57:40.724824] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-19T19:57:40.724892] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-19T19:57:40.724973] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-19T19:57:40.725083] [INFO ] [MAIN ] Update Progress: 1337/2372 symbols completed. MFSB took 20.9s. Estimated remaining: 2h 17m 29s. Rate: 7.5 symbols/min [2025-09-19T19:57:40.905230] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:57:40.905465] [DEBUG] [LOCAL ] MFSG: No existing data file found in primary storage. [2025-09-19T19:57:40.905531] [WARN ] [MAIN ] MFSG: No existing data found, performing full refresh instead. [2025-09-19T19:57:40.905715] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-19T19:57:40.905768] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-19T19:57:40.905811] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-19T19:57:40.905900] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-19T19:57:41.291989] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:57:41.443332] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-19T19:57:41.835580] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T19:57:42.243351] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-19T19:57:43.043268] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-19T19:57:43.341151] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T19:57:43.566777] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-19T19:57:43.770397] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T19:57:43.777913] [INFO ] [REMOTE ] MFC: Full fetch complete (74293 records). [2025-09-19T19:57:43.778034] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-19T19:57:43.848425] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-19T19:57:44.193105] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-19T19:57:44.193239] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-19T19:57:44.194778] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-19T19:57:44.194866] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-19T19:57:44.196888] [DEBUG] [LOCAL ] MFC: Trimmed 74293 records to 52127 (keeping 200 days of data) [2025-09-19T19:57:44.563722] [DEBUG] [LOCAL ] MFC: Primary data saved (52127 records). [2025-09-19T19:57:44.563883] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-19T19:57:44.563997] [INFO ] [MAIN ] Update Progress: 1338/2372 symbols completed. MFC took 39.4s. Estimated remaining: 2h 17m 18s. Rate: 7.5 symbols/min [2025-09-19T19:57:44.648444] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-19T19:57:44.750923] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:57:44.751118] [DEBUG] [LOCAL ] MFSI: No existing data file found in primary storage. [2025-09-19T19:57:44.751177] [WARN ] [MAIN ] MFSI: No existing data found, performing full refresh instead. [2025-09-19T19:57:44.751335] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-19T19:57:44.751379] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-19T19:57:44.751420] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-19T19:57:44.751451] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-19T19:57:45.106738] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:57:45.443247] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-19T19:57:45.831127] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:57:45.831454] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-19T19:57:45.876163] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T19:57:46.243294] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-19T19:57:46.750304] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T19:57:47.043284] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-19T19:57:47.843273] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-19T19:57:47.989000] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T19:57:48.643320] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-19T19:57:49.443313] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-19T19:57:49.730970] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T19:57:49.733507] [INFO ] [REMOTE ] MFM: Full fetch complete (19135 records). [2025-09-19T19:57:49.733580] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-19T19:57:50.147564] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-19T19:57:50.192564] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T19:57:50.192390] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-19T19:57:50.194177] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-19T19:57:50.194734] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-19T19:57:50.196550] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-19T19:57:50.187288] [INFO ] [REMOTE ] MFG: Full fetch complete (68518 records). [2025-09-19T19:57:50.197340] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-19T19:57:50.197748] [DEBUG] [LOCAL ] MFM: Trimmed 19135 records to 14537 (keeping 200 days of data) [2025-09-19T19:57:50.255189] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-19T19:57:50.712130] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-19T19:57:50.712890] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-19T19:57:50.714543] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-19T19:57:50.714635] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-19T19:57:50.719282] [DEBUG] [LOCAL ] MFG: Trimmed 68518 records to 49670 (keeping 200 days of data) [2025-09-19T19:57:50.727177] [DEBUG] [LOCAL ] MFM: Primary data saved (14537 records). [2025-09-19T19:57:50.788323] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-19T19:57:50.788625] [INFO ] [MAIN ] Update Progress: 1339/2372 symbols completed. MFM took 32.0s. Estimated remaining: 2h 17m 9s. Rate: 7.5 symbols/min [2025-09-19T19:57:50.905029] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T19:57:51.039334] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:57:51.040409] [DEBUG] [LOCAL ] MFSV: No existing data file found in primary storage. [2025-09-19T19:57:51.040769] [WARN ] [MAIN ] MFSV: No existing data found, performing full refresh instead. [2025-09-19T19:57:51.041568] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-19T19:57:51.041920] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-19T19:57:51.042024] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-19T19:57:51.042381] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-19T19:57:51.048182] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-19T19:57:51.540180] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:57:51.659424] [DEBUG] [LOCAL ] MFG: Primary data saved (49670 records). [2025-09-19T19:57:51.659572] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-19T19:57:51.659682] [INFO ] [MAIN ] Update Progress: 1340/2372 symbols completed. MFG took 34.6s. Estimated remaining: 2h 16m 55s. Rate: 7.5 symbols/min [2025-09-19T19:57:51.774807] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T19:57:51.842957] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:57:51.843907] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-19T19:57:51.863940] [DEBUG] [LOCAL ] MG: Loaded 17012 existing records from primary storage. [2025-09-19T19:57:51.864083] [INFO ] [MAIN ] MG: Loaded 17012 existing records. [2025-09-19T19:57:52.046555] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:57:52.046908] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-19T19:57:52.046994] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-19T19:57:52.047731] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-19T19:57:52.047797] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-19T19:57:52.430846] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:57:52.643275] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-19T19:57:52.659322] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T19:57:53.062435] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-19T19:57:53.443271] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-19T19:57:53.946755] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-19T19:57:54.243334] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-19T19:57:54.645545] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-19T19:57:55.043319] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-19T19:57:55.804246] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T19:57:55.843329] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-19T19:57:56.520092] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T19:57:56.643312] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-19T19:57:57.381966] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T19:57:57.443286] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-19T19:57:58.148229] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T19:57:58.243327] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-19T19:57:59.043343] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-19T19:57:59.500468] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T19:57:59.825875] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-19T19:57:59.843245] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-19T19:58:00.643368] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-19T19:58:00.774381] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T19:58:00.776384] [INFO ] [REMOTE ] MFSG: Full fetch complete (5651 records). [2025-09-19T19:58:00.776467] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-19T19:58:00.968909] [WARN ] [VALIDATOR ] MFSG: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-19T19:58:00.969203] [FATAL] [MAIN ] MFSG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:58:00.969273] [WARN ] [MAIN ] MFSG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:58:00.969359] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-19T19:58:00.969468] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-19T19:58:00.969527] [INFO ] [LOCAL ] MFSG: Starting deletion of derivative data. [2025-09-19T19:58:00.969573] [DEBUG] [LOCAL ] MFSG: No derivative data file found to delete. [2025-09-19T19:58:00.969665] [INFO ] [MAIN ] Update Progress: 1341/2372 symbols completed. MFSG took 20.2s. Estimated remaining: 2h 16m 49s. Rate: 7.5 symbols/min [2025-09-19T19:58:01.150159] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:58:01.214237] [DEBUG] [LOCAL ] MGA: Loaded 51050 existing records from primary storage. [2025-09-19T19:58:01.214532] [INFO ] [MAIN ] MGA: Loaded 51050 existing records. [2025-09-19T19:58:01.433441] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:58:01.433940] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-19T19:58:01.434019] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-19T19:58:01.441848] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-19T19:58:01.443375] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-19T19:58:01.442936] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-19T19:58:01.443672] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-19T19:58:01.835309] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:58:02.243368] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-19T19:58:02.742587] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T19:58:03.043305] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-19T19:58:03.220039] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T19:58:03.843303] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-19T19:58:04.266152] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-19T19:58:04.643286] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-19T19:58:05.174061] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T19:58:05.226265] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T19:58:05.443272] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-19T19:58:06.243318] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-19T19:58:06.778226] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T19:58:07.043275] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-19T19:58:07.370498] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T19:58:07.655223] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-19T19:58:07.843293] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-19T19:58:08.643301] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-19T19:58:09.443282] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-19T19:58:09.593999] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T19:58:09.656709] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T19:58:10.243300] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-19T19:58:10.351378] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T19:58:11.043295] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-19T19:58:11.495371] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-19T19:58:11.516635] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T19:58:11.843299] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-19T19:58:12.643275] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-19T19:58:13.022055] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T19:58:13.439413] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T19:58:13.443240] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-19T19:58:14.152703] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-19T19:58:14.243313] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-19T19:58:15.043312] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-19T19:58:15.613563] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T19:58:15.843288] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-19T19:58:16.643279] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-19T19:58:16.849389] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T19:58:17.212803] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T19:58:17.443265] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-19T19:58:18.079021] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T19:58:18.243255] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-19T19:58:19.043333] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-19T19:58:19.414004] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T19:58:19.555352] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T19:58:19.843250] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-19T19:58:20.238561] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T19:58:20.643334] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-19T19:58:20.905469] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T19:58:21.443302] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-19T19:58:21.842766] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T19:58:21.845808] [INFO ] [REMOTE ] MFSI: Full fetch complete (12870 records). [2025-09-19T19:58:21.845895] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-19T19:58:22.028168] [WARN ] [VALIDATOR ] MFSI: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-19T19:58:22.028569] [FATAL] [MAIN ] MFSI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:58:22.028683] [WARN ] [MAIN ] MFSI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:58:22.028762] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-19T19:58:22.028856] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-19T19:58:22.028929] [INFO ] [LOCAL ] MFSI: Starting deletion of derivative data. [2025-09-19T19:58:22.029023] [DEBUG] [LOCAL ] MFSI: No derivative data file found to delete. [2025-09-19T19:58:22.029142] [INFO ] [MAIN ] Update Progress: 1342/2372 symbols completed. MFSI took 37.5s. Estimated remaining: 2h 16m 51s. Rate: 7.5 symbols/min [2025-09-19T19:58:22.198158] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:58:22.204912] [DEBUG] [LOCAL ] MGF: Loaded 4177 existing records from primary storage. [2025-09-19T19:58:22.205016] [INFO ] [MAIN ] MGF: Loaded 4177 existing records. [2025-09-19T19:58:22.248420] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-19T19:58:22.387268] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:58:22.387543] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-19T19:58:22.387610] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-19T19:58:22.388025] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-19T19:58:22.388086] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-19T19:58:22.740328] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:58:23.043336] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-19T19:58:23.181121] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T19:58:23.182918] [INFO ] [REMOTE ] MFSV: Full fetch complete (2888 records). [2025-09-19T19:58:23.183040] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-19T19:58:23.387230] [WARN ] [VALIDATOR ] MFSV: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-19T19:58:23.387578] [FATAL] [MAIN ] MFSV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:58:23.387932] [WARN ] [MAIN ] MFSV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:58:23.388013] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-19T19:58:23.388220] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-19T19:58:23.388291] [INFO ] [LOCAL ] MFSV: Starting deletion of derivative data. [2025-09-19T19:58:23.388377] [DEBUG] [LOCAL ] MFSV: No derivative data file found to delete. [2025-09-19T19:58:23.388506] [INFO ] [MAIN ] Update Progress: 1343/2372 symbols completed. MFSV took 32.6s. Estimated remaining: 2h 16m 38s. Rate: 7.5 symbols/min [2025-09-19T19:58:23.560755] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:58:23.560986] [DEBUG] [LOCAL ] MGM: No existing data file found in primary storage. [2025-09-19T19:58:23.561049] [WARN ] [MAIN ] MGM: No existing data found, performing full refresh instead. [2025-09-19T19:58:23.561322] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-19T19:58:23.561387] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-19T19:58:23.561536] [DEBUG] [LOCAL ] MGM: No primary data file found to delete. [2025-09-19T19:58:23.561604] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-19T19:58:23.705513] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T19:58:23.849235] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-19T19:58:23.975791] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:58:23.982040] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T19:58:23.984362] [INFO ] [REMOTE ] MG: Full fetch complete (24055 records). [2025-09-19T19:58:23.984437] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-19T19:58:24.342519] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-19T19:58:24.342605] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-19T19:58:24.343120] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-19T19:58:24.343183] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-19T19:58:24.343881] [DEBUG] [LOCAL ] MG: Trimmed 24055 records to 17120 (keeping 200 days of data) [2025-09-19T19:58:24.442393] [DEBUG] [LOCAL ] MG: Primary data saved (17120 records). [2025-09-19T19:58:24.442554] [INFO ] [MAIN ] MG: Full history saved. [2025-09-19T19:58:24.442716] [INFO ] [MAIN ] Update Progress: 1344/2372 symbols completed. MG took 32.8s. Estimated remaining: 2h 16m 24s. Rate: 7.5 symbols/min [2025-09-19T19:58:24.612283] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:58:24.619734] [DEBUG] [LOCAL ] MGR: Loaded 5715 existing records from primary storage. [2025-09-19T19:58:24.619857] [INFO ] [MAIN ] MGR: Loaded 5715 existing records. [2025-09-19T19:58:24.650318] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-19T19:58:24.799321] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:58:24.799571] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-19T19:58:24.799631] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-19T19:58:24.799995] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-19T19:58:24.800053] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-19T19:58:25.152074] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:58:25.422563] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T19:58:25.443215] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-19T19:58:25.693930] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T19:58:26.243343] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-19T19:58:26.301554] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T19:58:26.919000] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T19:58:27.043224] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-19T19:58:27.631445] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-19T19:58:27.843256] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-19T19:58:28.541769] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T19:58:28.643266] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-19T19:58:29.216833] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T19:58:29.443273] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-19T19:58:30.155282] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T19:58:30.243236] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-19T19:58:30.973857] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T19:58:31.043283] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-19T19:58:31.843311] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-19T19:58:31.935122] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T19:58:32.548975] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T19:58:32.643274] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-19T19:58:33.383603] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T19:58:33.443288] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-19T19:58:34.130608] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T19:58:34.243290] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-19T19:58:35.043280] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-19T19:58:35.805435] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T19:58:35.843283] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-19T19:58:36.400679] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T19:58:36.525575] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T19:58:36.643259] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-19T19:58:37.443296] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-19T19:58:38.243257] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-19T19:58:38.683369] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T19:58:38.949774] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T19:58:39.043248] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-19T19:58:39.594177] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T19:58:39.615839] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T19:58:39.843299] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-19T19:58:40.643332] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-19T19:58:41.443291] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-19T19:58:41.829342] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T19:58:41.827504] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T19:58:42.243302] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-19T19:58:42.902273] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T19:58:43.043268] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-19T19:58:43.729521] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T19:58:43.843270] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-19T19:58:44.535213] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-19T19:58:44.543381] [INFO ] [REMOTE ] MGA: Full fetch complete (73697 records). [2025-09-19T19:58:44.543568] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-19T19:58:44.650688] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-19T19:58:44.980598] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-19T19:58:44.980720] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-19T19:58:44.981814] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-19T19:58:44.981881] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-19T19:58:44.983588] [DEBUG] [LOCAL ] MGA: Trimmed 73697 records to 51426 (keeping 200 days of data) [2025-09-19T19:58:45.314481] [DEBUG] [LOCAL ] MGA: Primary data saved (51426 records). [2025-09-19T19:58:45.314731] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-19T19:58:45.315021] [INFO ] [MAIN ] Update Progress: 1345/2372 symbols completed. MGA took 44.3s. Estimated remaining: 2h 16m 26s. Rate: 7.5 symbols/min [2025-09-19T19:58:45.457818] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-19T19:58:45.497289] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:58:45.505426] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T19:58:45.508488] [INFO ] [REMOTE ] MGR: Full fetch complete (8478 records). [2025-09-19T19:58:45.511735] [DEBUG] [LOCAL ] MGRB: Loaded 4131 existing records from primary storage. [2025-09-19T19:58:45.512046] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-19T19:58:45.512131] [INFO ] [MAIN ] MGRB: Loaded 4131 existing records. [2025-09-19T19:58:45.939146] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:58:45.985752] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-19T19:58:45.990994] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-19T19:58:46.010109] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-19T19:58:46.012970] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-19T19:58:46.209540] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-19T19:58:46.209758] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-19T19:58:46.210561] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-19T19:58:46.215992] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-19T19:58:46.276349] [DEBUG] [LOCAL ] MGR: Trimmed 8478 records to 5756 (keeping 200 days of data) [2025-09-19T19:58:46.314528] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T19:58:46.336769] [INFO ] [REMOTE ] MGF: Full fetch complete (5941 records). [2025-09-19T19:58:46.337269] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-19T19:58:46.556906] [DEBUG] [LOCAL ] MGR: Primary data saved (5756 records). [2025-09-19T19:58:46.662778] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:58:46.648906] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-19T19:58:46.691824] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-19T19:58:46.691966] [INFO ] [MAIN ] Update Progress: 1346/2372 symbols completed. MGR took 22.2s. Estimated remaining: 2h 16m 13s. Rate: 7.5 symbols/min [2025-09-19T19:58:46.938829] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (3.10 seconds). [2025-09-19T19:58:47.044376] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-19T19:58:47.161713] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:58:47.162859] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-19T19:58:47.163212] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-19T19:58:47.163434] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-19T19:58:47.163709] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-19T19:58:47.164495] [DEBUG] [LOCAL ] MGF: Trimmed 5941 records to 4190 (keeping 200 days of data) [2025-09-19T19:58:47.168277] [DEBUG] [LOCAL ] MGRD: Loaded 2262 existing records from primary storage. [2025-09-19T19:58:47.185887] [INFO ] [MAIN ] MGRD: Loaded 2262 existing records. [2025-09-19T19:58:47.296292] [DEBUG] [LOCAL ] MGF: Primary data saved (4190 records). [2025-09-19T19:58:47.302112] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-19T19:58:47.307366] [INFO ] [MAIN ] Update Progress: 1347/2372 symbols completed. MGF took 25.3s. Estimated remaining: 2h 15m 60s. Rate: 7.5 symbols/min [2025-09-19T19:58:47.456027] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:58:47.481333] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-19T19:58:47.484142] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-19T19:58:47.484420] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-19T19:58:47.489875] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-19T19:58:47.660905] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:58:47.746372] [DEBUG] [LOCAL ] MGRE: Loaded 6622 existing records from primary storage. [2025-09-19T19:58:47.787255] [INFO ] [MAIN ] MGRE: Loaded 6622 existing records. [2025-09-19T19:58:47.904455] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T19:58:47.958957] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-19T19:58:48.111016] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:58:48.142314] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:58:48.142585] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-19T19:58:48.142680] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-19T19:58:48.143086] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-19T19:58:48.143146] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-19T19:58:48.513299] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:58:48.643240] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-19T19:58:48.684590] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T19:58:49.383446] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T19:58:49.443229] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-19T19:58:49.452476] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-19T19:58:50.243315] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-19T19:58:51.013403] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T19:58:51.043222] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-19T19:58:51.493888] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T19:58:51.667293] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T19:58:51.843342] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-19T19:58:52.643479] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-19T19:58:52.823198] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T19:58:53.307249] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T19:58:53.443345] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-19T19:58:54.195535] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T19:58:54.243349] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-19T19:58:54.826052] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T19:58:55.043296] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-19T19:58:55.594299] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T19:58:55.843335] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-19T19:58:56.394963] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T19:58:56.643299] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-19T19:58:57.409290] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T19:58:57.443251] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-19T19:58:58.179814] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T19:58:58.243234] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-19T19:58:59.043274] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-19T19:58:59.843325] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-19T19:58:59.883437] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T19:59:00.216983] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T19:59:00.482094] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T19:59:00.643276] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-19T19:59:01.182676] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T19:59:01.443271] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-19T19:59:02.243279] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-19T19:59:02.783552] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T19:59:03.043268] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-19T19:59:03.540318] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-19T19:59:03.572982] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T19:59:03.843316] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-19T19:59:04.363406] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T19:59:04.643307] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-19T19:59:05.443329] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-19T19:59:06.244344] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-19T19:59:06.244698] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T19:59:06.587601] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T19:59:06.756444] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-19T19:59:06.757362] [INFO ] [REMOTE ] MGRD: Full fetch complete (3494 records). [2025-09-19T19:59:06.757437] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-19T19:59:07.048451] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-19T19:59:07.139342] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-19T19:59:07.139423] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-19T19:59:07.139541] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-19T19:59:07.139578] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-19T19:59:07.139959] [DEBUG] [LOCAL ] MGRD: Trimmed 3494 records to 2267 (keeping 200 days of data) [2025-09-19T19:59:07.157686] [DEBUG] [LOCAL ] MGRD: Primary data saved (2267 records). [2025-09-19T19:59:07.157839] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-19T19:59:07.157944] [INFO ] [MAIN ] Update Progress: 1348/2372 symbols completed. MGRD took 20.5s. Estimated remaining: 2h 16m 1s. Rate: 7.5 symbols/min [2025-09-19T19:59:07.329489] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:59:07.379896] [DEBUG] [LOCAL ] MGY: Loaded 52836 existing records from primary storage. [2025-09-19T19:59:07.380065] [INFO ] [MAIN ] MGY: Loaded 52836 existing records. [2025-09-19T19:59:07.569191] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:59:07.569486] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-19T19:59:07.569544] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-19T19:59:07.571252] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-19T19:59:07.571324] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-19T19:59:07.843761] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-19T19:59:07.926524] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:59:08.385244] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T19:59:08.643273] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-19T19:59:08.873858] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T19:59:08.881756] [INFO ] [REMOTE ] MGM: Full fetch complete (77596 records). [2025-09-19T19:59:08.881899] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-19T19:59:09.272889] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-19T19:59:09.272977] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-19T19:59:09.274119] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-19T19:59:09.274187] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-19T19:59:09.275708] [DEBUG] [LOCAL ] MGM: Trimmed 77596 records to 54387 (keeping 200 days of data) [2025-09-19T19:59:09.451259] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-19T19:59:09.503945] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T19:59:09.616948] [DEBUG] [LOCAL ] MGM: Primary data saved (54387 records). [2025-09-19T19:59:09.617109] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-19T19:59:09.617206] [INFO ] [MAIN ] Update Progress: 1349/2372 symbols completed. MGM took 46.2s. Estimated remaining: 2h 15m 49s. Rate: 7.5 symbols/min [2025-09-19T19:59:09.783927] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:59:09.784175] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-19T19:59:09.784229] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-19T19:59:09.784369] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-19T19:59:09.784411] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-19T19:59:09.784452] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-19T19:59:09.784484] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-19T19:59:10.135444] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:59:10.179471] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T19:59:10.243229] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-19T19:59:10.465969] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:59:10.466358] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-19T19:59:11.043313] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-19T19:59:11.731299] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T19:59:11.843282] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-19T19:59:12.564861] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T19:59:12.643293] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-19T19:59:13.340120] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T19:59:13.341107] [INFO ] [REMOTE ] MGRB: Full fetch complete (6364 records). [2025-09-19T19:59:13.341182] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-19T19:59:13.445955] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-19T19:59:13.713223] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-19T19:59:13.713309] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-19T19:59:13.713500] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-19T19:59:13.713538] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-19T19:59:13.713962] [DEBUG] [LOCAL ] MGRB: Trimmed 6364 records to 4147 (keeping 200 days of data) [2025-09-19T19:59:13.738555] [DEBUG] [LOCAL ] MGRB: Primary data saved (4147 records). [2025-09-19T19:59:13.738623] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-19T19:59:13.738728] [INFO ] [MAIN ] Update Progress: 1350/2372 symbols completed. MGRB took 28.4s. Estimated remaining: 2h 15m 38s. Rate: 7.5 symbols/min [2025-09-19T19:59:13.908139] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:59:13.921614] [DEBUG] [LOCAL ] MHD: Loaded 12367 existing records from primary storage. [2025-09-19T19:59:13.921785] [INFO ] [MAIN ] MHD: Loaded 12367 existing records. [2025-09-19T19:59:14.104778] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:59:14.105095] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-19T19:59:14.105146] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-19T19:59:14.105678] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-19T19:59:14.105737] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-19T19:59:14.251030] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-19T19:59:14.435044] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T19:59:14.495338] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:59:15.043268] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-19T19:59:15.843276] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-19T19:59:15.990352] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T19:59:16.105391] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:59:16.105766] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-19T19:59:16.270033] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T19:59:16.643284] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-19T19:59:17.443248] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-19T19:59:17.541918] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T19:59:17.543586] [INFO ] [REMOTE ] MGRE: Full fetch complete (9413 records). [2025-09-19T19:59:17.543681] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-19T19:59:17.899433] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-19T19:59:17.899514] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-19T19:59:17.899809] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-19T19:59:17.899885] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-19T19:59:17.900353] [DEBUG] [LOCAL ] MGRE: Trimmed 9413 records to 6651 (keeping 200 days of data) [2025-09-19T19:59:17.943578] [DEBUG] [LOCAL ] MGRE: Primary data saved (6651 records). [2025-09-19T19:59:17.943750] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-19T19:59:17.943866] [INFO ] [MAIN ] Update Progress: 1351/2372 symbols completed. MGRE took 30.6s. Estimated remaining: 2h 15m 27s. Rate: 7.5 symbols/min [2025-09-19T19:59:18.112040] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:59:18.121521] [DEBUG] [LOCAL ] MHF: Loaded 8630 existing records from primary storage. [2025-09-19T19:59:18.121623] [INFO ] [MAIN ] MHF: Loaded 8630 existing records. [2025-09-19T19:59:18.248348] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-19T19:59:18.302612] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:59:18.302918] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-19T19:59:18.302965] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-19T19:59:18.303363] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-19T19:59:18.303421] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-19T19:59:18.660292] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:59:19.031617] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T19:59:19.043203] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-19T19:59:19.579097] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T19:59:19.843259] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-19T19:59:20.071030] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:59:20.071408] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-19T19:59:20.643270] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-19T19:59:20.848033] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T19:59:20.880133] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:59:20.880395] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-19T19:59:21.443254] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-19T19:59:21.670008] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:59:21.670359] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-19T19:59:22.243254] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-19T19:59:23.043289] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-19T19:59:23.843289] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-19T19:59:24.125309] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:59:24.125917] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-19T19:59:24.136356] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T19:59:24.172924] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T19:59:24.643286] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-19T19:59:25.443311] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-19T19:59:25.677970] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T19:59:25.678456] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-19T19:59:25.915552] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T19:59:26.243312] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-19T19:59:27.043273] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-19T19:59:27.293014] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T19:59:27.843288] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-19T19:59:28.643295] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-19T19:59:29.061751] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T19:59:29.062137] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T19:59:29.176198] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T19:59:29.443273] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-19T19:59:30.243277] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-19T19:59:31.043268] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-19T19:59:31.342995] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T19:59:31.843278] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-19T19:59:31.911998] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T19:59:32.168232] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T19:59:32.643298] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-19T19:59:33.445131] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-19T19:59:33.447315] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T19:59:33.452935] [INFO ] [REMOTE ] MH: Full fetch complete (11559 records). [2025-09-19T19:59:33.453057] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-19T19:59:33.650821] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 41 unique days, need 200 days [2025-09-19T19:59:33.657694] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-19T19:59:33.658628] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T19:59:33.658347] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-19T19:59:33.661776] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-19T19:59:33.661880] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-19T19:59:33.661937] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-19T19:59:33.661999] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-19T19:59:33.662108] [INFO ] [MAIN ] Update Progress: 1352/2372 symbols completed. MH took 24.0s. Estimated remaining: 2h 15m 25s. Rate: 7.5 symbols/min [2025-09-19T19:59:33.838933] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:59:33.889550] [DEBUG] [LOCAL ] MHK: Loaded 42873 existing records from primary storage. [2025-09-19T19:59:33.889736] [INFO ] [MAIN ] MHK: Loaded 42873 existing records. [2025-09-19T19:59:34.083828] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:59:34.084217] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-19T19:59:34.084292] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-19T19:59:34.085490] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-19T19:59:34.085573] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-19T19:59:34.251246] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-19T19:59:34.497266] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:59:35.043286] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-19T19:59:35.167502] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T19:59:35.476608] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T19:59:35.843273] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-19T19:59:36.643274] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-19T19:59:36.776196] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T19:59:37.169320] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T19:59:37.443265] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-19T19:59:38.243281] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-19T19:59:38.421968] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T19:59:38.517008] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T19:59:39.043289] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-19T19:59:39.843260] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-19T19:59:39.924726] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T19:59:40.048391] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T19:59:40.643283] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-19T19:59:41.443281] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-19T19:59:41.806352] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T19:59:42.244616] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-19T19:59:42.247415] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T19:59:42.616121] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T19:59:43.043325] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-19T19:59:43.283491] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T19:59:43.843321] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-19T19:59:43.970626] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T19:59:44.643262] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-19T19:59:45.443259] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-19T19:59:45.539430] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T19:59:45.770225] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T19:59:45.780803] [INFO ] [REMOTE ] MGY: Full fetch complete (75503 records). [2025-09-19T19:59:45.781009] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-19T19:59:46.244690] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-19T19:59:46.326076] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-19T19:59:46.326193] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-19T19:59:46.328102] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-19T19:59:46.328227] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-19T19:59:46.330715] [DEBUG] [LOCAL ] MGY: Trimmed 75503 records to 53216 (keeping 200 days of data) [2025-09-19T19:59:46.498543] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T19:59:46.788161] [DEBUG] [LOCAL ] MGY: Primary data saved (53216 records). [2025-09-19T19:59:46.788528] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-19T19:59:46.788908] [INFO ] [MAIN ] Update Progress: 1353/2372 symbols completed. MGY took 39.6s. Estimated remaining: 2h 15m 21s. Rate: 7.5 symbols/min [2025-09-19T19:59:46.984689] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:59:46.984923] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-19T19:59:46.984981] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-19T19:59:46.985192] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-19T19:59:46.985248] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-19T19:59:46.985295] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-19T19:59:46.985349] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-19T19:59:47.048478] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-19T19:59:47.440606] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:59:47.843314] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-19T19:59:48.083788] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T19:59:48.119244] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T19:59:48.643264] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-19T19:59:48.968516] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T19:59:49.030946] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-19T19:59:49.443314] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-19T19:59:49.887163] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-19T19:59:50.243345] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-19T19:59:51.043273] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-19T19:59:51.275683] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T19:59:51.278568] [INFO ] [REMOTE ] MHF: Full fetch complete (12878 records). [2025-09-19T19:59:51.278771] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-19T19:59:51.482046] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-19T19:59:51.688152] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-19T19:59:51.688235] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-19T19:59:51.688561] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-19T19:59:51.688623] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-19T19:59:51.689685] [DEBUG] [LOCAL ] MHF: Trimmed 12878 records to 8671 (keeping 200 days of data) [2025-09-19T19:59:51.741872] [DEBUG] [LOCAL ] MHF: Primary data saved (8671 records). [2025-09-19T19:59:51.742011] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-19T19:59:51.742123] [INFO ] [MAIN ] Update Progress: 1354/2372 symbols completed. MHF took 33.8s. Estimated remaining: 2h 15m 11s. Rate: 7.5 symbols/min [2025-09-19T19:59:51.848447] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-19T19:59:51.913453] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:59:51.924579] [DEBUG] [LOCAL ] MHN: Loaded 7862 existing records from primary storage. [2025-09-19T19:59:51.924712] [INFO ] [MAIN ] MHN: Loaded 7862 existing records. [2025-09-19T19:59:52.102694] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:59:52.102958] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-19T19:59:52.103005] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-19T19:59:52.103377] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-19T19:59:52.103440] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-19T19:59:52.319086] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-19T19:59:52.466285] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:59:52.643269] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-19T19:59:53.443268] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-19T19:59:53.547907] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T19:59:54.243282] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-19T19:59:54.516239] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T19:59:54.519313] [INFO ] [REMOTE ] MHD: Full fetch complete (18817 records). [2025-09-19T19:59:54.519406] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-19T19:59:54.924071] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-19T19:59:54.924208] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-19T19:59:54.924619] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-19T19:59:54.924691] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-19T19:59:54.926030] [DEBUG] [LOCAL ] MHD: Trimmed 18817 records to 12423 (keeping 200 days of data) [2025-09-19T19:59:55.014813] [DEBUG] [LOCAL ] MHD: Primary data saved (12423 records). [2025-09-19T19:59:55.014959] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-19T19:59:55.015150] [INFO ] [MAIN ] Update Progress: 1355/2372 symbols completed. MHD took 41.3s. Estimated remaining: 2h 14m 59s. Rate: 7.5 symbols/min [2025-09-19T19:59:55.048451] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-19T19:59:55.198810] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T19:59:55.226752] [DEBUG] [LOCAL ] MHO: Loaded 24676 existing records from primary storage. [2025-09-19T19:59:55.226922] [INFO ] [MAIN ] MHO: Loaded 24676 existing records. [2025-09-19T19:59:55.428489] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T19:59:55.429021] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-19T19:59:55.429081] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-19T19:59:55.429943] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-19T19:59:55.430005] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-19T19:59:55.799094] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T19:59:55.843240] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-19T19:59:56.022727] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T19:59:56.103456] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T19:59:56.643270] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-19T19:59:57.086581] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T19:59:57.443311] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-19T19:59:57.961052] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-19T19:59:58.243267] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-19T19:59:58.390116] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T19:59:58.791850] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T19:59:59.043297] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-19T19:59:59.843285] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-19T20:00:00.552218] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T20:00:00.575932] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T20:00:00.643301] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-19T20:00:01.443275] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-19T20:00:02.243293] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-19T20:00:02.753746] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T20:00:03.043331] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-19T20:00:03.203613] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T20:00:03.843311] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-19T20:00:04.643470] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-19T20:00:05.645565] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-09-19T20:00:05.648173] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-19T20:00:06.370204] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T20:00:06.371138] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-19T20:00:06.508390] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-19T20:00:06.685341] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T20:00:06.795545] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (3.75 seconds). [2025-09-19T20:00:06.936066] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-19T20:00:06.936907] [INFO ] [REMOTE ] MHLA: Full fetch complete (1548 records). [2025-09-19T20:00:06.936975] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-19T20:00:07.048473] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-19T20:00:07.125161] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-19T20:00:07.125358] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:00:07.125428] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:00:07.125499] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-19T20:00:07.125565] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-19T20:00:07.125625] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-19T20:00:07.125719] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-19T20:00:07.125787] [INFO ] [MAIN ] Update Progress: 1356/2372 symbols completed. MHLA took 20.3s. Estimated remaining: 2h 14m 54s. Rate: 7.5 symbols/min [2025-09-19T20:00:07.304343] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:00:07.304577] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-19T20:00:07.304634] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-19T20:00:07.304804] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-19T20:00:07.304846] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-19T20:00:07.304888] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-19T20:00:07.304920] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-19T20:00:07.693665] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:00:07.843262] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-19T20:00:08.095297] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:00:08.095628] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-19T20:00:08.643269] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-19T20:00:08.887515] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:00:08.887966] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-19T20:00:08.983837] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T20:00:09.443323] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-19T20:00:10.243271] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-19T20:00:10.390949] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T20:00:11.043279] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-19T20:00:11.298585] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:00:11.298983] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-19T20:00:11.843262] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-19T20:00:12.643283] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-19T20:00:13.258741] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T20:00:13.443292] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-19T20:00:13.514290] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (3.27 seconds). [2025-09-19T20:00:13.525971] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-19T20:00:13.526088] [INFO ] [REMOTE ] MHK: Full fetch complete (61004 records). [2025-09-19T20:00:13.526264] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-19T20:00:13.925004] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-19T20:00:13.925325] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-19T20:00:13.926269] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-19T20:00:13.926333] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-19T20:00:13.927626] [DEBUG] [LOCAL ] MHK: Trimmed 61004 records to 43183 (keeping 200 days of data) [2025-09-19T20:00:14.233280] [DEBUG] [LOCAL ] MHK: Primary data saved (43183 records). [2025-09-19T20:00:14.233457] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-19T20:00:14.234776] [INFO ] [MAIN ] Update Progress: 1357/2372 symbols completed. MHK took 40.6s. Estimated remaining: 2h 14m 46s. Rate: 7.5 symbols/min [2025-09-19T20:00:14.243310] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-19T20:00:15.043346] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-19T20:00:15.315362] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T20:00:15.519699] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:00:15.520055] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-19T20:00:15.843303] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-19T20:00:16.075454] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:00:16.075836] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-19T20:00:16.148363] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T20:00:16.643271] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-19T20:00:17.036187] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:00:17.036727] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-19T20:00:17.443284] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-19T20:00:18.243233] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-19T20:00:18.476443] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:00:18.476797] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-19T20:00:18.511982] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T20:00:19.043286] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-19T20:00:19.843245] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-19T20:00:20.148585] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:00:20.148967] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-19T20:00:20.167531] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T20:00:20.643288] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-19T20:00:21.443273] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-19T20:00:21.946319] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T20:00:22.243253] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-19T20:00:22.428735] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T20:00:23.043281] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-19T20:00:23.624367] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T20:00:23.843282] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-19T20:00:23.921452] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T20:00:24.643272] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-19T20:00:25.118032] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T20:00:25.122333] [INFO ] [REMOTE ] MHO: Full fetch complete (37491 records). [2025-09-19T20:00:25.122481] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-19T20:00:25.448406] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-19T20:00:25.536718] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-19T20:00:25.536816] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-19T20:00:25.537750] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-19T20:00:25.537820] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-19T20:00:25.539009] [DEBUG] [LOCAL ] MHO: Trimmed 37491 records to 24873 (keeping 200 days of data) [2025-09-19T20:00:25.726906] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T20:00:25.739914] [DEBUG] [LOCAL ] MHO: Primary data saved (24873 records). [2025-09-19T20:00:25.740000] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-19T20:00:25.740093] [INFO ] [MAIN ] Update Progress: 1358/2372 symbols completed. MHO took 30.7s. Estimated remaining: 2h 14m 40s. Rate: 7.5 symbols/min [2025-09-19T20:00:26.243299] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-19T20:00:26.601284] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T20:00:26.603244] [INFO ] [REMOTE ] MHN: Full fetch complete (12004 records). [2025-09-19T20:00:26.603465] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-19T20:00:27.029136] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-19T20:00:27.029255] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-19T20:00:27.029571] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-19T20:00:27.029612] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-19T20:00:27.030259] [DEBUG] [LOCAL ] MHN: Trimmed 12004 records to 7887 (keeping 200 days of data) [2025-09-19T20:00:27.081374] [DEBUG] [LOCAL ] MHN: Primary data saved (7887 records). [2025-09-19T20:00:27.081526] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-19T20:00:27.081616] [INFO ] [MAIN ] Update Progress: 1359/2372 symbols completed. MHN took 35.3s. Estimated remaining: 2h 14m 27s. Rate: 7.5 symbols/min [2025-09-19T20:00:27.983242] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T20:00:27.988959] [INFO ] [REMOTE ] MIAX: Full fetch complete (7874 records). [2025-09-19T20:00:27.989053] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-19T20:00:28.175773] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 26 unique days, need 200 days [2025-09-19T20:00:28.176050] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:00:28.176129] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:00:28.176274] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-19T20:00:28.176356] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-19T20:00:28.176394] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-19T20:00:28.176436] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-19T20:00:28.176515] [INFO ] [MAIN ] Update Progress: 1360/2372 symbols completed. MIAX took 21.1s. Estimated remaining: 2h 14m 14s. Rate: 7.5 symbols/min [2025-09-19T20:00:28.863357] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:00:28.912198] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:00:28.908544] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:00:28.916617] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:00:28.917598] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-19T20:00:28.917775] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-19T20:00:28.917918] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-19T20:00:28.917972] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-19T20:00:28.918040] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-19T20:00:28.918076] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-19T20:00:29.001935] [DEBUG] [LOCAL ] MITP: Loaded 2399 existing records from primary storage. [2025-09-19T20:00:29.052633] [INFO ] [MAIN ] MITP: Loaded 2399 existing records. [2025-09-19T20:00:29.063482] [DEBUG] [LOCAL ] MIN: Loaded 13246 existing records from primary storage. [2025-09-19T20:00:29.114754] [INFO ] [MAIN ] MIN: Loaded 13246 existing records. [2025-09-19T20:00:29.596998] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:00:29.648445] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-19T20:00:29.630119] [DEBUG] [LOCAL ] MIR: Loaded 51163 existing records from primary storage. [2025-09-19T20:00:29.672973] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-19T20:00:29.673910] [INFO ] [MAIN ] MIR: Loaded 51163 existing records. [2025-09-19T20:00:29.689555] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-19T20:00:29.777106] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-19T20:00:29.935743] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:00:29.980116] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-19T20:00:29.973782] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:00:30.001781] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-19T20:00:30.068674] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-19T20:00:30.132205] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:00:30.159412] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-19T20:00:30.165548] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-19T20:00:30.159614] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-19T20:00:30.190500] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-19T20:00:30.223069] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-19T20:00:30.249721] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-19T20:00:30.435904] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-19T20:00:30.533438] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-19T20:00:30.977489] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:00:31.043267] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-19T20:00:31.336237] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T20:00:31.362424] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-19T20:00:31.377916] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:00:31.416221] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-19T20:00:31.415638] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:00:31.417618] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-19T20:00:31.672208] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-19T20:00:31.695661] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-19T20:00:31.843265] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-19T20:00:32.332334] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T20:00:32.382091] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T20:00:32.643225] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-19T20:00:33.297203] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T20:00:33.301014] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T20:00:33.443266] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-19T20:00:34.243300] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-19T20:00:34.684786] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-19T20:00:35.043276] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-19T20:00:35.113680] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T20:00:35.843272] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-19T20:00:35.984624] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T20:00:36.643285] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-19T20:00:37.334230] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-19T20:00:37.443275] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-19T20:00:37.751970] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T20:00:38.121356] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-19T20:00:38.243254] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-19T20:00:39.043310] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-19T20:00:39.736001] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T20:00:39.843316] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-19T20:00:40.184111] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T20:00:40.558530] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T20:00:40.643270] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-19T20:00:41.443265] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-19T20:00:41.587034] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T20:00:42.243273] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-19T20:00:43.043264] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-19T20:00:43.251197] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T20:00:43.325086] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T20:00:43.425674] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-19T20:00:43.843266] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-19T20:00:44.252623] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T20:00:44.643258] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-19T20:00:45.175771] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-19T20:00:45.443286] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-19T20:00:45.986204] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T20:00:46.243255] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-19T20:00:47.043286] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-19T20:00:47.247894] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T20:00:47.358356] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-19T20:00:47.843265] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-19T20:00:48.643262] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-19T20:00:48.855707] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T20:00:49.443312] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-19T20:00:49.961543] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-19T20:00:49.962413] [INFO ] [REMOTE ] MITP: Full fetch complete (3328 records). [2025-09-19T20:00:49.962483] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-19T20:00:50.251797] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-19T20:00:50.337762] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-19T20:00:50.337855] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-19T20:00:50.337986] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-19T20:00:50.338025] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-19T20:00:50.338391] [DEBUG] [LOCAL ] MITP: Trimmed 3328 records to 2434 (keeping 200 days of data) [2025-09-19T20:00:50.353128] [DEBUG] [LOCAL ] MITP: Primary data saved (2434 records). [2025-09-19T20:00:50.353202] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-19T20:00:50.353277] [INFO ] [MAIN ] Update Progress: 1361/2372 symbols completed. MITP took 22.2s. Estimated remaining: 2h 14m 17s. Rate: 7.5 symbols/min [2025-09-19T20:00:50.531114] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:00:50.561010] [DEBUG] [LOCAL ] MITT: Loaded 23196 existing records from primary storage. [2025-09-19T20:00:50.561181] [INFO ] [MAIN ] MITT: Loaded 23196 existing records. [2025-09-19T20:00:50.784110] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:00:50.789195] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T20:00:50.787954] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-19T20:00:50.799757] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-19T20:00:50.800924] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-19T20:00:50.800991] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-19T20:00:51.050063] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-19T20:00:51.181905] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:00:51.377477] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T20:00:51.843273] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-19T20:00:52.643301] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-19T20:00:52.860971] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T20:00:53.333360] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T20:00:53.443251] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-19T20:00:53.929088] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T20:00:54.243310] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-19T20:00:54.908753] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T20:00:54.925631] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-19T20:00:55.043262] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-19T20:00:55.843315] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-19T20:00:56.367112] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T20:00:56.643272] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-19T20:00:57.443270] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-19T20:00:57.776594] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T20:00:58.040820] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T20:00:58.064373] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T20:00:58.243249] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-19T20:00:59.043271] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-19T20:00:59.546258] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T20:00:59.843310] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-19T20:01:00.170069] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T20:01:00.643293] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-19T20:01:01.443233] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-19T20:01:01.546118] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T20:01:01.861529] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T20:01:01.863731] [INFO ] [REMOTE ] MIN: Full fetch complete (17871 records). [2025-09-19T20:01:01.863805] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-19T20:01:02.043290] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-19T20:01:02.132367] [INFO ] [REMOTE ] MITN: Full fetch complete (2293 records). [2025-09-19T20:01:02.154373] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-19T20:01:02.247009] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-19T20:01:02.421011] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-19T20:01:02.426943] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-19T20:01:02.432713] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-19T20:01:02.437940] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-19T20:01:02.483241] [DEBUG] [LOCAL ] MIN: Trimmed 17871 records to 13288 (keeping 200 days of data) [2025-09-19T20:01:02.506487] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T20:01:02.506774] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:01:02.507095] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:01:02.507175] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-19T20:01:02.507237] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-19T20:01:02.507274] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-19T20:01:02.507311] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-19T20:01:02.507372] [INFO ] [MAIN ] Update Progress: 1362/2372 symbols completed. MITN took 34.3s. Estimated remaining: 2h 14m 12s. Rate: 7.5 symbols/min [2025-09-19T20:01:02.757743] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:02.765479] [DEBUG] [LOCAL ] MIN: Primary data saved (13288 records). [2025-09-19T20:01:02.765660] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-19T20:01:02.765768] [INFO ] [MAIN ] Update Progress: 1363/2372 symbols completed. MIN took 34.6s. Estimated remaining: 2h 13m 58s. Rate: 7.5 symbols/min [2025-09-19T20:01:02.874772] [DEBUG] [LOCAL ] MIY: Loaded 6085 existing records from primary storage. [2025-09-19T20:01:02.888389] [INFO ] [MAIN ] MIY: Loaded 6085 existing records. [2025-09-19T20:01:03.054608] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:03.045409] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-19T20:01:03.171357] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:01:03.171678] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-19T20:01:03.171742] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-19T20:01:03.172091] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-19T20:01:03.172165] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-19T20:01:03.501969] [DEBUG] [LOCAL ] MKC: Loaded 52837 existing records from primary storage. [2025-09-19T20:01:03.513233] [INFO ] [MAIN ] MKC: Loaded 52837 existing records. [2025-09-19T20:01:03.671865] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:03.778985] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:01:03.796434] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-19T20:01:03.796784] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-19T20:01:03.797873] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T20:01:03.804710] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-19T20:01:03.805247] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-19T20:01:03.851532] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-19T20:01:04.193735] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:04.643262] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-19T20:01:05.193976] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T20:01:05.205361] [INFO ] [REMOTE ] MIR: Full fetch complete (73415 records). [2025-09-19T20:01:05.205536] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-19T20:01:05.448448] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-19T20:01:05.565248] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T20:01:05.649164] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-19T20:01:05.649274] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-19T20:01:05.651509] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-19T20:01:05.651594] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-19T20:01:05.659758] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T20:01:05.663156] [DEBUG] [LOCAL ] MIR: Trimmed 73415 records to 51550 (keeping 200 days of data) [2025-09-19T20:01:05.971030] [DEBUG] [LOCAL ] MIR: Primary data saved (51550 records). [2025-09-19T20:01:05.971178] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-19T20:01:05.971285] [INFO ] [MAIN ] Update Progress: 1364/2372 symbols completed. MIR took 37.8s. Estimated remaining: 2h 13m 47s. Rate: 7.5 symbols/min [2025-09-19T20:01:06.145441] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:06.145665] [DEBUG] [LOCAL ] MKL: No existing data file found in primary storage. [2025-09-19T20:01:06.145723] [WARN ] [MAIN ] MKL: No existing data found, performing full refresh instead. [2025-09-19T20:01:06.145889] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-19T20:01:06.145943] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-19T20:01:06.146010] [DEBUG] [LOCAL ] MKL: No primary data file found to delete. [2025-09-19T20:01:06.146044] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-19T20:01:06.245997] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-19T20:01:06.513888] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:07.043236] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-19T20:01:07.535813] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T20:01:07.560366] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T20:01:07.827053] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-19T20:01:07.843201] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-19T20:01:08.565731] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T20:01:08.643281] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-19T20:01:09.443257] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-19T20:01:09.911918] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T20:01:10.243294] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-19T20:01:10.948857] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T20:01:11.043283] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-19T20:01:11.843268] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-19T20:01:12.190412] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T20:01:12.626587] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T20:01:12.643212] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-19T20:01:12.701928] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T20:01:13.127361] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-19T20:01:13.443303] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-19T20:01:14.243320] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-19T20:01:15.022758] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T20:01:15.043225] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-19T20:01:15.066865] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T20:01:15.843283] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-19T20:01:16.010253] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T20:01:16.643278] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-19T20:01:17.138358] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T20:01:17.443293] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-19T20:01:17.598268] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T20:01:18.243259] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-19T20:01:18.965160] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T20:01:19.043269] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-19T20:01:19.180856] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T20:01:19.843309] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-19T20:01:19.992918] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T20:01:19.994992] [INFO ] [REMOTE ] MIY: Full fetch complete (9128 records). [2025-09-19T20:01:19.995140] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-19T20:01:20.392692] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-19T20:01:20.392796] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-19T20:01:20.393119] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-19T20:01:20.393179] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-19T20:01:20.393627] [DEBUG] [LOCAL ] MIY: Trimmed 9128 records to 6122 (keeping 200 days of data) [2025-09-19T20:01:20.431284] [DEBUG] [LOCAL ] MIY: Primary data saved (6122 records). [2025-09-19T20:01:20.431480] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-19T20:01:20.431579] [INFO ] [MAIN ] Update Progress: 1365/2372 symbols completed. MIY took 17.9s. Estimated remaining: 2h 13m 44s. Rate: 7.5 symbols/min [2025-09-19T20:01:20.600006] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:20.643540] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-19T20:01:20.658757] [DEBUG] [LOCAL ] MLI: Loaded 44291 existing records from primary storage. [2025-09-19T20:01:20.658926] [INFO ] [MAIN ] MLI: Loaded 44291 existing records. [2025-09-19T20:01:20.850912] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:01:20.851199] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-19T20:01:20.851247] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-19T20:01:20.852465] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-19T20:01:20.852526] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-19T20:01:21.215540] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:21.443298] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-19T20:01:21.849118] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T20:01:21.930707] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T20:01:21.934004] [INFO ] [REMOTE ] MITT: Full fetch complete (34858 records). [2025-09-19T20:01:21.934108] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-19T20:01:22.248688] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-19T20:01:22.321574] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-19T20:01:22.321705] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-19T20:01:22.322665] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-19T20:01:22.322729] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-19T20:01:22.323687] [DEBUG] [LOCAL ] MITT: Trimmed 34858 records to 23333 (keeping 200 days of data) [2025-09-19T20:01:22.468989] [DEBUG] [LOCAL ] MITT: Primary data saved (23333 records). [2025-09-19T20:01:22.469142] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-19T20:01:22.469365] [INFO ] [MAIN ] Update Progress: 1366/2372 symbols completed. MITT took 32.1s. Estimated remaining: 2h 13m 31s. Rate: 7.5 symbols/min [2025-09-19T20:01:22.640046] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:22.679136] [DEBUG] [LOCAL ] MLM: Loaded 31723 existing records from primary storage. [2025-09-19T20:01:22.679305] [INFO ] [MAIN ] MLM: Loaded 31723 existing records. [2025-09-19T20:01:22.863275] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:01:22.863825] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-19T20:01:22.864010] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-19T20:01:22.865085] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-19T20:01:22.865149] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-19T20:01:23.046835] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-19T20:01:23.263168] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:23.265891] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T20:01:23.843267] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-19T20:01:24.333437] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T20:01:24.643279] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-19T20:01:24.890085] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T20:01:25.018961] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T20:01:25.443273] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-19T20:01:26.233344] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T20:01:26.243924] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-19T20:01:27.043273] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-19T20:01:27.130960] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T20:01:27.843348] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-19T20:01:27.959917] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T20:01:28.596908] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T20:01:28.643222] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-19T20:01:29.443284] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-19T20:01:29.834917] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T20:01:30.196072] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T20:01:30.243260] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-19T20:01:30.436990] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T20:01:31.043269] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-19T20:01:31.468332] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T20:01:31.843335] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-19T20:01:32.643347] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-19T20:01:32.933886] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T20:01:33.443281] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-19T20:01:33.757886] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T20:01:34.243264] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-19T20:01:34.595971] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T20:01:35.043317] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-19T20:01:35.313155] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T20:01:35.843274] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-19T20:01:36.167960] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T20:01:36.643266] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-19T20:01:37.107770] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T20:01:37.443279] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-19T20:01:37.506357] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T20:01:37.863020] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T20:01:38.243274] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-19T20:01:39.043263] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-19T20:01:39.118362] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T20:01:39.123485] [INFO ] [REMOTE ] MKL: Full fetch complete (49821 records). [2025-09-19T20:01:39.123595] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-19T20:01:39.536295] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-19T20:01:39.536394] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-19T20:01:39.537279] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-19T20:01:39.537348] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-19T20:01:39.538703] [DEBUG] [LOCAL ] MKL: Trimmed 49821 records to 34735 (keeping 200 days of data) [2025-09-19T20:01:39.766135] [DEBUG] [LOCAL ] MKL: Primary data saved (34735 records). [2025-09-19T20:01:39.766290] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-19T20:01:39.766369] [INFO ] [MAIN ] Update Progress: 1367/2372 symbols completed. MKL took 33.8s. Estimated remaining: 2h 13m 30s. Rate: 7.5 symbols/min [2025-09-19T20:01:39.848346] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-19T20:01:39.968064] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:39.996940] [DEBUG] [LOCAL ] MLNK: Loaded 25971 existing records from primary storage. [2025-09-19T20:01:39.997115] [INFO ] [MAIN ] MLNK: Loaded 25971 existing records. [2025-09-19T20:01:40.200051] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:01:40.200362] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-19T20:01:40.200415] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-19T20:01:40.201290] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-19T20:01:40.201356] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-19T20:01:40.343317] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T20:01:40.640897] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:40.643205] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-19T20:01:40.764859] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T20:01:41.433327] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T20:01:41.443787] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-19T20:01:41.917883] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T20:01:42.243265] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-19T20:01:42.389480] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T20:01:43.043293] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-19T20:01:43.235130] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T20:01:43.843279] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-19T20:01:44.643289] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-19T20:01:44.937573] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T20:01:45.443275] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-19T20:01:45.930791] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T20:01:45.939582] [INFO ] [REMOTE ] MKC: Full fetch complete (75501 records). [2025-09-19T20:01:45.939851] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-19T20:01:46.244845] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-19T20:01:46.384466] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-19T20:01:46.384741] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-19T20:01:46.386097] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-19T20:01:46.386199] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-19T20:01:46.407568] [DEBUG] [LOCAL ] MKC: Trimmed 75501 records to 53211 (keeping 200 days of data) [2025-09-19T20:01:46.409696] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T20:01:46.657889] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T20:01:46.767546] [DEBUG] [LOCAL ] MKC: Primary data saved (53211 records). [2025-09-19T20:01:46.767710] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-19T20:01:46.767823] [INFO ] [MAIN ] Update Progress: 1368/2372 symbols completed. MKC took 44.0s. Estimated remaining: 2h 13m 22s. Rate: 7.5 symbols/min [2025-09-19T20:01:46.951129] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:46.956273] [DEBUG] [LOCAL ] MLP: Loaded 3044 existing records from primary storage. [2025-09-19T20:01:46.956360] [INFO ] [MAIN ] MLP: Loaded 3044 existing records. [2025-09-19T20:01:47.053158] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-19T20:01:47.137893] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:01:47.138145] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-19T20:01:47.138193] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-19T20:01:47.138449] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-19T20:01:47.138511] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-19T20:01:47.508564] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:47.843293] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-19T20:01:48.068829] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T20:01:48.569353] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-19T20:01:48.590174] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T20:01:48.643312] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-19T20:01:49.443315] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-19T20:01:50.111790] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T20:01:50.116393] [INFO ] [REMOTE ] MLM: Full fetch complete (45838 records). [2025-09-19T20:01:50.116549] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-19T20:01:50.248399] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-19T20:01:50.516922] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-19T20:01:50.517004] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-19T20:01:50.517796] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-19T20:01:50.517869] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-19T20:01:50.521342] [DEBUG] [LOCAL ] MLM: Trimmed 45838 records to 31890 (keeping 200 days of data) [2025-09-19T20:01:50.734500] [DEBUG] [LOCAL ] MLM: Primary data saved (31890 records). [2025-09-19T20:01:50.734677] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-19T20:01:50.734789] [INFO ] [MAIN ] Update Progress: 1369/2372 symbols completed. MLM took 28.3s. Estimated remaining: 2h 13m 11s. Rate: 7.5 symbols/min [2025-09-19T20:01:50.951491] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:50.967067] [DEBUG] [LOCAL ] MLR: Loaded 13256 existing records from primary storage. [2025-09-19T20:01:50.967299] [INFO ] [MAIN ] MLR: Loaded 13256 existing records. [2025-09-19T20:01:51.051092] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-19T20:01:51.167254] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:01:51.167542] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-19T20:01:51.167590] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-19T20:01:51.168139] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-19T20:01:51.168198] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-19T20:01:51.293526] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T20:01:51.557875] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T20:01:51.579164] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:51.587060] [INFO ] [REMOTE ] MLI: Full fetch complete (63741 records). [2025-09-19T20:01:51.587248] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-19T20:01:51.854363] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-19T20:01:51.987850] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-19T20:01:51.987938] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-19T20:01:51.988864] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-19T20:01:51.988926] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-19T20:01:51.990198] [DEBUG] [LOCAL ] MLI: Trimmed 63741 records to 44630 (keeping 200 days of data) [2025-09-19T20:01:52.271379] [DEBUG] [LOCAL ] MLI: Primary data saved (44630 records). [2025-09-19T20:01:52.271519] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-19T20:01:52.271615] [INFO ] [MAIN ] Update Progress: 1370/2372 symbols completed. MLI took 31.8s. Estimated remaining: 2h 12m 58s. Rate: 7.5 symbols/min [2025-09-19T20:01:52.446348] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:01:52.446570] [DEBUG] [LOCAL ] MMC: No existing data file found in primary storage. [2025-09-19T20:01:52.446691] [WARN ] [MAIN ] MMC: No existing data found, performing full refresh instead. [2025-09-19T20:01:52.446885] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-19T20:01:52.447154] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-19T20:01:52.447236] [DEBUG] [LOCAL ] MMC: No primary data file found to delete. [2025-09-19T20:01:52.447291] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-19T20:01:52.561427] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T20:01:52.651390] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-19T20:01:52.830172] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:01:52.873862] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T20:01:53.443301] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-19T20:01:54.154875] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-19T20:01:54.243258] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-19T20:01:55.043273] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-19T20:01:55.436204] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T20:01:55.461596] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T20:01:55.843253] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-19T20:01:56.110597] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T20:01:56.245097] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-19T20:01:56.643265] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-19T20:01:57.443284] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-19T20:01:58.002008] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T20:01:58.021450] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T20:01:58.243253] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-19T20:01:59.043267] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-19T20:01:59.764304] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T20:01:59.843299] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-19T20:02:00.643236] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-19T20:02:00.798131] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T20:02:01.403503] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T20:02:01.420312] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T20:02:01.443259] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-19T20:02:02.243254] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-19T20:02:02.860986] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T20:02:02.866114] [INFO ] [REMOTE ] MLNK: Full fetch complete (35828 records). [2025-09-19T20:02:02.866199] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-19T20:02:03.049366] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-19T20:02:03.265513] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-19T20:02:03.265617] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-19T20:02:03.266850] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-19T20:02:03.266930] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-19T20:02:03.269466] [DEBUG] [LOCAL ] MLNK: Trimmed 35828 records to 26172 (keeping 200 days of data) [2025-09-19T20:02:03.423739] [DEBUG] [LOCAL ] MLNK: Primary data saved (26172 records). [2025-09-19T20:02:03.423875] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-19T20:02:03.424032] [INFO ] [MAIN ] Update Progress: 1371/2372 symbols completed. MLNK took 23.7s. Estimated remaining: 2h 12m 52s. Rate: 7.5 symbols/min [2025-09-19T20:02:03.600073] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:02:03.613746] [DEBUG] [LOCAL ] MMD: Loaded 11198 existing records from primary storage. [2025-09-19T20:02:03.613863] [INFO ] [MAIN ] MMD: Loaded 11198 existing records. [2025-09-19T20:02:03.795519] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:02:03.795794] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-19T20:02:03.795848] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-19T20:02:03.796293] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-19T20:02:03.796355] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-19T20:02:03.855058] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-19T20:02:03.933171] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T20:02:04.201827] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:02:04.409696] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T20:02:04.643305] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-19T20:02:05.162548] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T20:02:05.443275] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-19T20:02:05.993869] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T20:02:06.132153] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-19T20:02:06.243270] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-19T20:02:07.043279] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-19T20:02:07.312844] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T20:02:07.843300] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-19T20:02:07.943411] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T20:02:08.643268] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-19T20:02:09.443302] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-19T20:02:09.561866] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T20:02:09.807015] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T20:02:10.243255] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-19T20:02:10.436046] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T20:02:11.043283] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-19T20:02:11.843280] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-19T20:02:12.129761] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-19T20:02:12.403748] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T20:02:12.463841] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T20:02:12.643279] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-19T20:02:13.443282] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-19T20:02:14.006828] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T20:02:14.243328] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-19T20:02:14.623694] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T20:02:15.043297] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-19T20:02:15.286286] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T20:02:15.843286] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-19T20:02:16.072452] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T20:02:16.073747] [INFO ] [REMOTE ] MLP: Full fetch complete (4696 records). [2025-09-19T20:02:16.073827] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-19T20:02:16.486142] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-19T20:02:16.486266] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-19T20:02:16.486475] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-19T20:02:16.486572] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-19T20:02:16.487204] [DEBUG] [LOCAL ] MLP: Trimmed 4696 records to 3069 (keeping 200 days of data) [2025-09-19T20:02:16.508201] [DEBUG] [LOCAL ] MLP: Primary data saved (3069 records). [2025-09-19T20:02:16.508342] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-19T20:02:16.508460] [INFO ] [MAIN ] Update Progress: 1372/2372 symbols completed. MLP took 29.7s. Estimated remaining: 2h 12m 48s. Rate: 7.5 symbols/min [2025-09-19T20:02:16.648398] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-19T20:02:16.704164] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:02:16.724709] [DEBUG] [LOCAL ] MMI: Loaded 15493 existing records from primary storage. [2025-09-19T20:02:16.724858] [INFO ] [MAIN ] MMI: Loaded 15493 existing records. [2025-09-19T20:02:16.893598] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T20:02:16.936488] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:02:16.937035] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-19T20:02:16.937085] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-19T20:02:16.937639] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-19T20:02:16.937753] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-19T20:02:17.319461] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:02:17.398017] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T20:02:17.443227] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-19T20:02:18.243268] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-19T20:02:18.316382] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T20:02:19.043284] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-19T20:02:19.843280] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-19T20:02:19.986007] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T20:02:20.298094] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T20:02:20.643270] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-19T20:02:20.751836] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T20:02:21.443275] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-19T20:02:21.589510] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T20:02:22.243253] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-19T20:02:22.407738] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T20:02:23.043291] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-19T20:02:23.448580] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T20:02:23.843276] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-19T20:02:24.003819] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T20:02:24.643451] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-19T20:02:25.443274] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-19T20:02:25.766911] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T20:02:25.882808] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T20:02:26.243261] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-19T20:02:26.699688] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T20:02:27.043298] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-19T20:02:27.410307] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T20:02:27.843279] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-19T20:02:28.240475] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T20:02:28.243376] [INFO ] [REMOTE ] MLR: Full fetch complete (18508 records). [2025-09-19T20:02:28.243497] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-19T20:02:28.644743] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-19T20:02:28.644453] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-19T20:02:28.645891] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-19T20:02:28.646392] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-19T20:02:28.646471] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-19T20:02:28.647220] [DEBUG] [LOCAL ] MLR: Trimmed 18508 records to 13403 (keeping 200 days of data) [2025-09-19T20:02:28.747756] [DEBUG] [LOCAL ] MLR: Primary data saved (13403 records). [2025-09-19T20:02:28.747923] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-19T20:02:28.748060] [INFO ] [MAIN ] Update Progress: 1373/2372 symbols completed. MLR took 38.0s. Estimated remaining: 2h 12m 43s. Rate: 7.5 symbols/min [2025-09-19T20:02:28.927157] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:02:28.932897] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-19T20:02:28.935730] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-19T20:02:28.938387] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T20:02:28.938592] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-19T20:02:28.941974] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-19T20:02:28.942239] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-19T20:02:28.942338] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-19T20:02:29.334830] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:02:29.443267] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-19T20:02:30.243263] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-19T20:02:30.493748] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T20:02:30.496399] [INFO ] [REMOTE ] MMD: Full fetch complete (18022 records). [2025-09-19T20:02:30.496592] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-19T20:02:30.880574] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-19T20:02:30.880696] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-19T20:02:30.881176] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-19T20:02:30.881264] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-19T20:02:30.882691] [DEBUG] [LOCAL ] MMD: Trimmed 18022 records to 11278 (keeping 200 days of data) [2025-09-19T20:02:30.918124] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-19T20:02:30.999914] [DEBUG] [LOCAL ] MMD: Primary data saved (11278 records). [2025-09-19T20:02:31.000068] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-19T20:02:31.000183] [INFO ] [MAIN ] Update Progress: 1374/2372 symbols completed. MMD took 27.6s. Estimated remaining: 2h 12m 31s. Rate: 7.5 symbols/min [2025-09-19T20:02:31.054167] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-19T20:02:31.173770] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:02:31.174017] [DEBUG] [LOCAL ] MMM: No existing data file found in primary storage. [2025-09-19T20:02:31.174092] [WARN ] [MAIN ] MMM: No existing data found, performing full refresh instead. [2025-09-19T20:02:31.174472] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-19T20:02:31.174612] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-19T20:02:31.174725] [DEBUG] [LOCAL ] MMM: No primary data file found to delete. [2025-09-19T20:02:31.174769] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-19T20:02:31.307853] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T20:02:31.550563] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:02:31.843287] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-19T20:02:32.346424] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-19T20:02:32.643276] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-19T20:02:32.930944] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T20:02:32.938624] [INFO ] [REMOTE ] MMC: Full fetch complete (74660 records). [2025-09-19T20:02:32.938804] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-19T20:02:33.241364] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T20:02:33.369852] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-19T20:02:33.369949] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-19T20:02:33.370940] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-19T20:02:33.371004] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-19T20:02:33.375395] [DEBUG] [LOCAL ] MMC: Trimmed 74660 records to 52568 (keeping 200 days of data) [2025-09-19T20:02:33.447288] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-19T20:02:33.730544] [DEBUG] [LOCAL ] MMC: Primary data saved (52568 records). [2025-09-19T20:02:33.730726] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-19T20:02:33.730815] [INFO ] [MAIN ] Update Progress: 1375/2372 symbols completed. MMC took 41.5s. Estimated remaining: 2h 12m 19s. Rate: 7.5 symbols/min [2025-09-19T20:02:33.919196] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:02:33.959405] [DEBUG] [LOCAL ] MMS: Loaded 34432 existing records from primary storage. [2025-09-19T20:02:33.959544] [INFO ] [MAIN ] MMS: Loaded 34432 existing records. [2025-09-19T20:02:34.136573] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:02:34.136890] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-19T20:02:34.136938] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-19T20:02:34.138851] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-19T20:02:34.138966] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-19T20:02:34.243590] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-19T20:02:34.502386] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:02:35.043304] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-19T20:02:35.179390] [DEBUG] [REMOTE ] MMKT: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-19T20:02:35.179756] [WARN ] [REMOTE ] MMKT: No data returned for month 2025-02 [2025-09-19T20:02:35.515912] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T20:02:35.657248] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T20:02:35.843286] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-19T20:02:36.643274] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-19T20:02:37.380581] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T20:02:37.443301] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-19T20:02:38.164801] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-19T20:02:38.243257] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-19T20:02:39.043274] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-19T20:02:39.252213] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T20:02:39.843318] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-19T20:02:39.996795] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T20:02:40.324082] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T20:02:40.643276] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-19T20:02:41.443246] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-19T20:02:41.558718] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T20:02:42.009346] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T20:02:42.243301] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-19T20:02:42.700579] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T20:02:43.043302] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-19T20:02:43.578097] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T20:02:43.843335] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-19T20:02:44.009757] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T20:02:44.643286] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-19T20:02:45.152095] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-19T20:02:45.443243] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-19T20:02:46.086172] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T20:02:46.243254] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-19T20:02:47.043331] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-19T20:02:47.165127] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T20:02:47.843247] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-19T20:02:48.137941] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T20:02:48.140612] [INFO ] [REMOTE ] MMI: Full fetch complete (20866 records). [2025-09-19T20:02:48.140734] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-19T20:02:48.572383] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-19T20:02:48.572539] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-19T20:02:48.573094] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-19T20:02:48.573172] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-19T20:02:48.574137] [DEBUG] [LOCAL ] MMI: Trimmed 20866 records to 15608 (keeping 200 days of data) [2025-09-19T20:02:48.655196] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-19T20:02:48.683143] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T20:02:48.723755] [DEBUG] [LOCAL ] MMI: Primary data saved (15608 records). [2025-09-19T20:02:48.723923] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-19T20:02:48.724019] [INFO ] [MAIN ] Update Progress: 1376/2372 symbols completed. MMI took 32.2s. Estimated remaining: 2h 12m 16s. Rate: 7.5 symbols/min [2025-09-19T20:02:48.905422] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:02:48.918303] [DEBUG] [LOCAL ] MMT: Loaded 11565 existing records from primary storage. [2025-09-19T20:02:48.918430] [INFO ] [MAIN ] MMT: Loaded 11565 existing records. [2025-09-19T20:02:49.103579] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:02:49.103905] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-19T20:02:49.103979] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-19T20:02:49.104559] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-19T20:02:49.104618] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-19T20:02:49.444077] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-19T20:02:49.462180] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T20:02:49.487097] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:02:49.511664] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T20:02:50.243261] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-19T20:02:51.043270] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-19T20:02:51.462808] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-19T20:02:51.469328] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T20:02:51.540167] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T20:02:51.843273] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-19T20:02:52.643262] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-19T20:02:53.443299] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-19T20:02:53.959429] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T20:02:54.143282] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T20:02:54.170944] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T20:02:54.243220] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-19T20:02:55.043264] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-19T20:02:55.843247] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-19T20:02:55.900176] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T20:02:56.643279] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-19T20:02:56.782417] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T20:02:57.138626] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T20:02:57.443272] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-19T20:02:58.243257] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-19T20:02:58.463348] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T20:02:59.043269] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-19T20:02:59.207443] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T20:02:59.498295] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-19T20:02:59.499430] [INFO ] [REMOTE ] MMKT: Full fetch complete (1896 records). [2025-09-19T20:02:59.500047] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-19T20:02:59.501024] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T20:02:59.616474] [INFO ] [REMOTE ] MMM: Full fetch complete (77163 records). [2025-09-19T20:02:59.617048] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-19T20:02:59.801280] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-19T20:02:59.812489] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:02:59.818419] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:02:59.828869] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-19T20:02:59.834127] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-19T20:02:59.839314] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-19T20:02:59.853795] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-19T20:02:59.864150] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-19T20:02:59.871990] [INFO ] [MAIN ] Update Progress: 1377/2372 symbols completed. MMKT took 31.1s. Estimated remaining: 2h 12m 11s. Rate: 7.5 symbols/min [2025-09-19T20:03:00.270014] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:03:00.312417] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-19T20:03:00.312716] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-19T20:03:00.313889] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-19T20:03:00.313975] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-19T20:03:00.315854] [DEBUG] [LOCAL ] MMM: Trimmed 77163 records to 54039 (keeping 200 days of data) [2025-09-19T20:03:00.439936] [DEBUG] [LOCAL ] MMU: Loaded 17176 existing records from primary storage. [2025-09-19T20:03:00.444956] [INFO ] [MAIN ] MMU: Loaded 17176 existing records. [2025-09-19T20:03:00.643627] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-19T20:03:00.651726] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:03:00.653350] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-19T20:03:00.653507] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-19T20:03:00.654531] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-19T20:03:00.655306] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-19T20:03:01.158734] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:03:01.282685] [DEBUG] [LOCAL ] MMM: Primary data saved (54039 records). [2025-09-19T20:03:01.282845] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-19T20:03:01.285273] [INFO ] [MAIN ] Update Progress: 1378/2372 symbols completed. MMM took 30.3s. Estimated remaining: 2h 11m 58s. Rate: 7.5 symbols/min [2025-09-19T20:03:01.447465] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-19T20:03:01.466969] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:03:01.500783] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T20:03:01.515124] [INFO ] [REMOTE ] MMS: Full fetch complete (52396 records). [2025-09-19T20:03:01.515365] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-19T20:03:01.638216] [DEBUG] [LOCAL ] MNR: Loaded 25053 existing records from primary storage. [2025-09-19T20:03:01.649946] [INFO ] [MAIN ] MNR: Loaded 25053 existing records. [2025-09-19T20:03:01.936757] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T20:03:02.100981] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:03:02.148621] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-19T20:03:02.171221] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-19T20:03:02.184159] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-19T20:03:02.184249] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-19T20:03:02.185227] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-19T20:03:02.185348] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-19T20:03:02.186477] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-19T20:03:02.186556] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-19T20:03:02.191777] [DEBUG] [LOCAL ] MMS: Trimmed 52396 records to 34667 (keeping 200 days of data) [2025-09-19T20:03:02.248740] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-19T20:03:02.705114] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:03:02.814900] [DEBUG] [LOCAL ] MMS: Primary data saved (34667 records). [2025-09-19T20:03:02.815057] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-19T20:03:02.815162] [INFO ] [MAIN ] Update Progress: 1379/2372 symbols completed. MMS took 29.1s. Estimated remaining: 2h 11m 46s. Rate: 7.5 symbols/min [2025-09-19T20:03:02.986326] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:03:03.029616] [DEBUG] [LOCAL ] MNSO: Loaded 44793 existing records from primary storage. [2025-09-19T20:03:03.029812] [INFO ] [MAIN ] MNSO: Loaded 44793 existing records. [2025-09-19T20:03:03.064377] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-19T20:03:03.221894] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:03:03.222134] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-19T20:03:03.222182] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-19T20:03:03.223602] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-19T20:03:03.223690] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-19T20:03:03.582251] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:03:03.843331] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-19T20:03:04.337221] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T20:03:04.371380] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-09-19T20:03:04.643305] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-19T20:03:04.857560] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T20:03:05.188773] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-19T20:03:05.401927] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T20:03:05.443212] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-19T20:03:06.243253] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-19T20:03:07.043286] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-19T20:03:07.186889] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T20:03:07.485953] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T20:03:07.843319] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-19T20:03:08.202469] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T20:03:08.643295] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-19T20:03:09.237188] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-19T20:03:09.264480] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T20:03:09.443296] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-19T20:03:10.243248] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-19T20:03:10.669300] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T20:03:11.043282] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-19T20:03:11.843328] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-19T20:03:11.950131] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T20:03:12.052589] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T20:03:12.637029] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T20:03:12.643220] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-19T20:03:13.443270] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-19T20:03:13.832845] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T20:03:14.243293] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-19T20:03:15.043350] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-19T20:03:15.437100] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T20:03:15.529170] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T20:03:15.619349] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T20:03:15.843311] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-19T20:03:16.643241] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-19T20:03:17.151990] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T20:03:17.443264] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-19T20:03:18.243276] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-19T20:03:18.618702] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T20:03:19.043331] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-19T20:03:19.473223] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T20:03:19.843258] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-19T20:03:20.056471] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T20:03:20.648000] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-19T20:03:20.651000] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-19T20:03:20.919739] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T20:03:21.443263] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-19T20:03:21.521562] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T20:03:21.523572] [INFO ] [REMOTE ] MMT: Full fetch complete (16500 records). [2025-09-19T20:03:21.523676] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-19T20:03:21.898687] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-19T20:03:21.898794] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-19T20:03:21.899160] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-19T20:03:21.899198] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-19T20:03:21.899805] [DEBUG] [LOCAL ] MMT: Trimmed 16500 records to 11600 (keeping 200 days of data) [2025-09-19T20:03:21.968007] [DEBUG] [LOCAL ] MMT: Primary data saved (11600 records). [2025-09-19T20:03:21.968148] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-19T20:03:21.968233] [INFO ] [MAIN ] Update Progress: 1380/2372 symbols completed. MMT took 33.2s. Estimated remaining: 2h 11m 46s. Rate: 7.5 symbols/min [2025-09-19T20:03:22.135195] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:03:22.135398] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-19T20:03:22.135456] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-19T20:03:22.135627] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-19T20:03:22.135703] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-19T20:03:22.135758] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-19T20:03:22.135791] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-19T20:03:22.248378] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-19T20:03:22.490851] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:03:22.633741] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T20:03:23.043276] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-19T20:03:23.292308] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:03:23.292675] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-19T20:03:23.843276] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-19T20:03:24.444225] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T20:03:24.643341] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-19T20:03:24.867120] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:03:24.867508] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-19T20:03:25.381748] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T20:03:25.443312] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-19T20:03:25.674150] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:03:25.674592] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-19T20:03:26.243272] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-19T20:03:27.043267] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-19T20:03:27.843282] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-19T20:03:27.995164] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T20:03:28.068991] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:03:28.069433] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-19T20:03:28.551845] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T20:03:28.643277] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-19T20:03:29.443299] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-19T20:03:30.243265] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-19T20:03:30.437973] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T20:03:30.484338] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:03:30.484789] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-19T20:03:30.694034] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T20:03:30.697729] [INFO ] [REMOTE ] MMU: Full fetch complete (25840 records). [2025-09-19T20:03:30.697875] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-19T20:03:31.045209] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-19T20:03:31.073881] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-19T20:03:31.073948] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-19T20:03:31.074464] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-19T20:03:31.074501] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-19T20:03:31.076083] [DEBUG] [LOCAL ] MMU: Trimmed 25840 records to 17308 (keeping 200 days of data) [2025-09-19T20:03:31.181397] [DEBUG] [LOCAL ] MMU: Primary data saved (17308 records). [2025-09-19T20:03:31.181532] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-19T20:03:31.181627] [INFO ] [MAIN ] Update Progress: 1381/2372 symbols completed. MMU took 31.3s. Estimated remaining: 2h 11m 39s. Rate: 7.5 symbols/min [2025-09-19T20:03:31.349559] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:03:31.349770] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-19T20:03:31.349849] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-19T20:03:31.350010] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-19T20:03:31.350063] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-19T20:03:31.350130] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-19T20:03:31.350164] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-19T20:03:31.714147] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:03:31.843237] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-19T20:03:32.145225] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T20:03:32.643264] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-19T20:03:33.443264] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-19T20:03:34.227624] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T20:03:34.243229] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-19T20:03:34.440873] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-19T20:03:35.043280] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-19T20:03:35.242375] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T20:03:35.843253] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-19T20:03:35.869287] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-19T20:03:36.049294] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T20:03:36.643304] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-19T20:03:37.443283] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-19T20:03:38.243256] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-19T20:03:38.343930] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T20:03:38.400694] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-19T20:03:39.016468] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T20:03:39.043221] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-19T20:03:39.843306] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-19T20:03:40.271596] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T20:03:40.279230] [INFO ] [REMOTE ] MNSO: Full fetch complete (64382 records). [2025-09-19T20:03:40.279371] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-19T20:03:40.551971] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T20:03:40.603689] [INFO ] [REMOTE ] MNR: Full fetch complete (37172 records). [2025-09-19T20:03:40.614109] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-19T20:03:40.666904] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-19T20:03:40.888752] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-19T20:03:40.889220] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-19T20:03:40.905891] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-19T20:03:40.905990] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-19T20:03:41.001890] [DEBUG] [LOCAL ] MNSO: Trimmed 64382 records to 45102 (keeping 200 days of data) [2025-09-19T20:03:41.208525] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-19T20:03:41.209724] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-19T20:03:41.210828] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-19T20:03:41.210913] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-19T20:03:41.217017] [DEBUG] [LOCAL ] MNR: Trimmed 37172 records to 25261 (keeping 200 days of data) [2025-09-19T20:03:41.402116] [DEBUG] [LOCAL ] MNR: Primary data saved (25261 records). [2025-09-19T20:03:41.402799] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-19T20:03:41.405901] [INFO ] [MAIN ] Update Progress: 1382/2372 symbols completed. MNR took 40.1s. Estimated remaining: 2h 11m 32s. Rate: 7.5 symbols/min [2025-09-19T20:03:41.685046] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:03:41.686971] [DEBUG] [LOCAL ] MOD: No existing data file found in primary storage. [2025-09-19T20:03:41.687615] [WARN ] [MAIN ] MOD: No existing data found, performing full refresh instead. [2025-09-19T20:03:41.689481] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-19T20:03:41.689946] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-19T20:03:41.691363] [DEBUG] [LOCAL ] MOD: No primary data file found to delete. [2025-09-19T20:03:41.691689] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-19T20:03:42.079219] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:03:42.081094] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-19T20:03:42.147069] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-19T20:03:42.159856] [DEBUG] [LOCAL ] MNSO: Primary data saved (45102 records). [2025-09-19T20:03:42.160319] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-19T20:03:42.160469] [INFO ] [MAIN ] Update Progress: 1383/2372 symbols completed. MNSO took 39.3s. Estimated remaining: 2h 11m 19s. Rate: 7.5 symbols/min [2025-09-19T20:03:42.251281] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-19T20:03:42.332692] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:03:42.382019] [DEBUG] [LOCAL ] MODG: Loaded 52004 existing records from primary storage. [2025-09-19T20:03:42.382195] [INFO ] [MAIN ] MODG: Loaded 52004 existing records. [2025-09-19T20:03:42.570354] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:03:42.570838] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-19T20:03:42.570979] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-19T20:03:42.577420] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-19T20:03:42.587226] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-19T20:03:42.669960] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T20:03:42.705919] [INFO ] [REMOTE ] MNTN: Full fetch complete (24092 records). [2025-09-19T20:03:42.706143] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-19T20:03:43.124016] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 83 unique days, need 200 days [2025-09-19T20:03:43.149747] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:03:43.159695] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:03:43.160825] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-19T20:03:43.179285] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-19T20:03:43.179417] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-19T20:03:43.183405] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:03:43.183530] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-19T20:03:43.183912] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-19T20:03:43.184246] [INFO ] [MAIN ] Update Progress: 1384/2372 symbols completed. MNTN took 21.2s. Estimated remaining: 2h 11m 6s. Rate: 7.5 symbols/min [2025-09-19T20:03:43.355099] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:03:43.408484] [DEBUG] [LOCAL ] MOH: Loaded 42076 existing records from primary storage. [2025-09-19T20:03:43.408677] [INFO ] [MAIN ] MOH: Loaded 42076 existing records. [2025-09-19T20:03:43.603614] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:03:43.632275] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-19T20:03:43.632463] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-19T20:03:43.634148] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-19T20:03:43.637118] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-19T20:03:43.637014] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T20:03:43.863322] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-19T20:03:44.017472] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:03:44.172815] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T20:03:44.643285] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-19T20:03:45.146816] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T20:03:45.443292] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-19T20:03:45.935429] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T20:03:46.243316] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-19T20:03:46.904186] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T20:03:47.043285] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-19T20:03:47.071559] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T20:03:47.843300] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-19T20:03:48.246419] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T20:03:48.643302] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-19T20:03:49.443342] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-19T20:03:49.568892] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T20:03:49.758398] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T20:03:50.158125] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T20:03:50.243266] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-19T20:03:50.996858] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T20:03:51.043233] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-19T20:03:51.843289] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-19T20:03:52.511724] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-19T20:03:52.643232] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-19T20:03:52.867431] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T20:03:53.443285] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-19T20:03:53.786546] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T20:03:54.069207] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T20:03:54.243295] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-19T20:03:55.043268] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-19T20:03:55.845154] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-19T20:03:55.851798] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-19T20:03:56.208042] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-19T20:03:56.324369] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T20:03:56.643355] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-19T20:03:57.443365] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-19T20:03:57.821371] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T20:03:58.243291] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-19T20:03:58.362822] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T20:03:59.043282] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-19T20:03:59.215524] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T20:03:59.843296] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-19T20:04:00.330365] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T20:04:00.643321] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-19T20:04:00.921855] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T20:04:01.443267] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-19T20:04:01.560116] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T20:04:02.243294] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-19T20:04:02.968212] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T20:04:03.043303] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-19T20:04:03.330364] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T20:04:03.851055] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-19T20:04:03.875688] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T20:04:04.643322] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-19T20:04:05.443311] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-19T20:04:05.543709] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-19T20:04:05.807094] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T20:04:06.243292] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-19T20:04:06.766579] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T20:04:06.773585] [INFO ] [REMOTE ] MOD: Full fetch complete (66180 records). [2025-09-19T20:04:06.773752] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-19T20:04:07.054106] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-19T20:04:07.211585] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-19T20:04:07.211695] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-19T20:04:07.212677] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-19T20:04:07.212758] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-19T20:04:07.214345] [DEBUG] [LOCAL ] MOD: Trimmed 66180 records to 46432 (keeping 200 days of data) [2025-09-19T20:04:07.528885] [DEBUG] [LOCAL ] MOD: Primary data saved (46432 records). [2025-09-19T20:04:07.547274] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-19T20:04:07.547403] [INFO ] [MAIN ] Update Progress: 1385/2372 symbols completed. MOD took 26.1s. Estimated remaining: 2h 11m 10s. Rate: 7.5 symbols/min [2025-09-19T20:04:07.613875] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T20:04:07.732125] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:04:07.784574] [DEBUG] [LOCAL ] MOS: Loaded 53909 existing records from primary storage. [2025-09-19T20:04:07.784771] [INFO ] [MAIN ] MOS: Loaded 53909 existing records. [2025-09-19T20:04:07.851058] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-19T20:04:07.969671] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:04:07.969992] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-19T20:04:07.970048] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-19T20:04:07.971853] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-19T20:04:07.971915] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-19T20:04:08.339861] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:04:08.643301] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-19T20:04:08.784029] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-19T20:04:08.795677] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-19T20:04:08.795880] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-19T20:04:09.033730] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T20:04:09.034630] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:04:09.034854] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:04:09.035068] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-19T20:04:09.035269] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-19T20:04:09.035372] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-19T20:04:09.035629] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-19T20:04:09.035860] [INFO ] [MAIN ] Update Progress: 1386/2372 symbols completed. MO took 37.9s. Estimated remaining: 2h 10m 57s. Rate: 7.5 symbols/min [2025-09-19T20:04:09.208146] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:04:09.248365] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T20:04:09.288938] [DEBUG] [LOCAL ] MOV: Loaded 22496 existing records from primary storage. [2025-09-19T20:04:09.289163] [INFO ] [MAIN ] MOV: Loaded 22496 existing records. [2025-09-19T20:04:09.446475] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-19T20:04:09.487996] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:04:09.488304] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-19T20:04:09.488360] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-19T20:04:09.489534] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-19T20:04:09.489697] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-19T20:04:09.847080] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:04:09.928515] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T20:04:10.102163] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T20:04:10.243260] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-19T20:04:11.043284] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-19T20:04:11.402282] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T20:04:11.843294] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-19T20:04:12.007756] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T20:04:12.329997] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T20:04:12.643283] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-19T20:04:13.443247] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-19T20:04:13.674480] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T20:04:13.682147] [INFO ] [REMOTE ] MODG: Full fetch complete (74748 records). [2025-09-19T20:04:13.682283] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-19T20:04:14.081382] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T20:04:14.108429] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-19T20:04:14.108811] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-19T20:04:14.109808] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-19T20:04:14.109870] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-19T20:04:14.111167] [DEBUG] [LOCAL ] MODG: Trimmed 74748 records to 52376 (keeping 200 days of data) [2025-09-19T20:04:14.268044] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-19T20:04:14.412410] [DEBUG] [LOCAL ] MODG: Primary data saved (52376 records). [2025-09-19T20:04:14.412593] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-19T20:04:14.412720] [INFO ] [MAIN ] Update Progress: 1387/2372 symbols completed. MODG took 32.3s. Estimated remaining: 2h 10m 47s. Rate: 7.5 symbols/min [2025-09-19T20:04:14.581041] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:04:14.581276] [DEBUG] [LOCAL ] MP: No existing data file found in primary storage. [2025-09-19T20:04:14.581320] [WARN ] [MAIN ] MP: No existing data found, performing full refresh instead. [2025-09-19T20:04:14.581463] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-19T20:04:14.581505] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-19T20:04:14.581546] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-09-19T20:04:14.581579] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-19T20:04:14.933917] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:04:15.043240] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-19T20:04:15.344421] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T20:04:15.583422] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T20:04:15.843270] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-19T20:04:16.643270] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-19T20:04:16.809379] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T20:04:17.443235] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-19T20:04:17.947515] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T20:04:17.984788] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T20:04:17.992307] [INFO ] [REMOTE ] MOH: Full fetch complete (58047 records). [2025-09-19T20:04:17.992468] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-19T20:04:18.253085] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-19T20:04:18.403476] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-19T20:04:18.403576] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-19T20:04:18.404578] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-19T20:04:18.404671] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-19T20:04:18.406346] [DEBUG] [LOCAL ] MOH: Trimmed 58047 records to 42381 (keeping 200 days of data) [2025-09-19T20:04:18.687078] [DEBUG] [LOCAL ] MOH: Primary data saved (42381 records). [2025-09-19T20:04:18.687240] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-19T20:04:18.689165] [INFO ] [MAIN ] Update Progress: 1388/2372 symbols completed. MOH took 35.5s. Estimated remaining: 2h 10m 37s. Rate: 7.5 symbols/min [2025-09-19T20:04:18.873226] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:04:18.888017] [DEBUG] [LOCAL ] MPA: Loaded 5277 existing records from primary storage. [2025-09-19T20:04:18.888148] [INFO ] [MAIN ] MPA: Loaded 5277 existing records. [2025-09-19T20:04:19.048366] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-19T20:04:19.077922] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:04:19.078148] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-19T20:04:19.078197] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-19T20:04:19.078532] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-19T20:04:19.078601] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-19T20:04:19.440342] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:04:19.780036] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T20:04:19.843223] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-19T20:04:19.921385] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T20:04:20.643251] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-19T20:04:20.761615] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T20:04:21.443239] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-19T20:04:21.905416] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-19T20:04:21.964239] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T20:04:22.243300] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-19T20:04:22.945066] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T20:04:23.043260] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-19T20:04:23.555825] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T20:04:23.559149] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T20:04:23.843271] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-19T20:04:24.643315] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-19T20:04:25.443287] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-19T20:04:25.917898] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T20:04:26.175307] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-19T20:04:26.187573] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T20:04:26.243235] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-19T20:04:27.043328] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-19T20:04:27.843270] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-19T20:04:28.282173] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T20:04:28.643284] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-19T20:04:29.021726] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-19T20:04:29.443322] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-19T20:04:29.904601] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T20:04:29.961843] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T20:04:30.243352] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-19T20:04:30.636536] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-19T20:04:31.043304] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-19T20:04:31.477792] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T20:04:31.496422] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-19T20:04:31.843296] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-19T20:04:32.562934] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T20:04:32.643264] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-19T20:04:33.229629] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-19T20:04:33.443262] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-19T20:04:34.101935] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-19T20:04:34.243285] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-19T20:04:35.043266] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-19T20:04:35.577354] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T20:04:35.581027] [INFO ] [REMOTE ] MOV: Full fetch complete (30726 records). [2025-09-19T20:04:35.581131] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-19T20:04:35.769817] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T20:04:35.848169] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-19T20:04:35.974627] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-19T20:04:35.974743] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-19T20:04:35.975372] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-19T20:04:35.975414] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-19T20:04:35.976319] [DEBUG] [LOCAL ] MOV: Trimmed 30726 records to 22639 (keeping 200 days of data) [2025-09-19T20:04:36.121345] [DEBUG] [LOCAL ] MOV: Primary data saved (22639 records). [2025-09-19T20:04:36.121476] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-19T20:04:36.121592] [INFO ] [MAIN ] Update Progress: 1389/2372 symbols completed. MOV took 27.1s. Estimated remaining: 2h 10m 36s. Rate: 7.5 symbols/min [2025-09-19T20:04:36.300327] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:04:36.368122] [DEBUG] [LOCAL ] MPC: Loaded 52530 existing records from primary storage. [2025-09-19T20:04:36.368311] [INFO ] [MAIN ] MPC: Loaded 52530 existing records. [2025-09-19T20:04:36.552468] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:04:36.552799] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-19T20:04:36.552869] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-19T20:04:36.554573] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-19T20:04:36.554668] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-19T20:04:36.652071] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-19T20:04:36.912721] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:04:37.343395] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-19T20:04:37.345308] [INFO ] [REMOTE ] MPA: Full fetch complete (7108 records). [2025-09-19T20:04:37.345408] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-19T20:04:37.445391] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-19T20:04:37.705923] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-19T20:04:37.706037] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-19T20:04:37.706248] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-19T20:04:37.706465] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-19T20:04:37.707047] [DEBUG] [LOCAL ] MPA: Trimmed 7108 records to 5298 (keeping 200 days of data) [2025-09-19T20:04:37.740419] [DEBUG] [LOCAL ] MPA: Primary data saved (5298 records). [2025-09-19T20:04:37.740503] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-19T20:04:37.740603] [INFO ] [MAIN ] Update Progress: 1390/2372 symbols completed. MPA took 19.1s. Estimated remaining: 2h 10m 23s. Rate: 7.5 symbols/min [2025-09-19T20:04:37.923119] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:04:37.959480] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T20:04:38.042401] [DEBUG] [LOCAL ] MPLX: Loaded 51168 existing records from primary storage. [2025-09-19T20:04:38.042595] [INFO ] [MAIN ] MPLX: Loaded 51168 existing records. [2025-09-19T20:04:38.231541] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:04:38.231955] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-19T20:04:38.232027] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-19T20:04:38.233549] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-19T20:04:38.233622] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-19T20:04:38.248453] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-19T20:04:38.616246] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:04:39.043278] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-19T20:04:39.843327] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-19T20:04:40.176480] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.73 seconds). [2025-09-19T20:04:40.311248] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T20:04:40.643304] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-19T20:04:40.965443] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T20:04:41.443287] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-19T20:04:41.937411] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T20:04:42.243268] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-19T20:04:43.043290] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-19T20:04:43.517023] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T20:04:43.561096] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-09-19T20:04:43.843266] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-19T20:04:44.264028] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T20:04:44.643257] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-19T20:04:44.909824] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T20:04:45.443270] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-19T20:04:45.740529] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T20:04:46.243270] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-19T20:04:46.440258] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T20:04:46.450196] [INFO ] [REMOTE ] MOS: Full fetch complete (77454 records). [2025-09-19T20:04:46.450365] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-19T20:04:46.864344] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-19T20:04:46.864432] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-19T20:04:46.865577] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-19T20:04:46.865680] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-19T20:04:46.867334] [DEBUG] [LOCAL ] MOS: Trimmed 77454 records to 54292 (keeping 200 days of data) [2025-09-19T20:04:47.063527] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-19T20:04:47.237090] [DEBUG] [LOCAL ] MOS: Primary data saved (54292 records). [2025-09-19T20:04:47.237383] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-19T20:04:47.237513] [INFO ] [MAIN ] Update Progress: 1391/2372 symbols completed. MOS took 39.7s. Estimated remaining: 2h 10m 16s. Rate: 7.5 symbols/min [2025-09-19T20:04:47.405980] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:04:47.414682] [DEBUG] [LOCAL ] MPV: Loaded 5223 existing records from primary storage. [2025-09-19T20:04:47.414791] [INFO ] [MAIN ] MPV: Loaded 5223 existing records. [2025-09-19T20:04:47.594358] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:04:47.594710] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-19T20:04:47.594770] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-19T20:04:47.595242] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-19T20:04:47.595304] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-19T20:04:47.978160] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:04:47.978959] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-19T20:04:48.026033] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-19T20:04:48.112880] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T20:04:48.531128] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T20:04:48.643280] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-19T20:04:48.751400] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T20:04:49.443282] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-19T20:04:50.243300] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-19T20:04:50.719804] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T20:04:51.043316] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-19T20:04:51.073370] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T20:04:51.843261] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-19T20:04:52.010342] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-19T20:04:52.020699] [INFO ] [REMOTE ] MP: Full fetch complete (77293 records). [2025-09-19T20:04:52.020932] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-19T20:04:52.428302] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-19T20:04:52.428445] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-19T20:04:52.429626] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-19T20:04:52.429731] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-19T20:04:52.433471] [DEBUG] [LOCAL ] MP: Trimmed 77293 records to 54436 (keeping 200 days of data) [2025-09-19T20:04:52.660540] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-19T20:04:52.693391] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T20:04:52.806810] [DEBUG] [LOCAL ] MP: Primary data saved (54436 records). [2025-09-19T20:04:52.806965] [INFO ] [MAIN ] MP: Full history saved. [2025-09-19T20:04:52.807061] [INFO ] [MAIN ] Update Progress: 1392/2372 symbols completed. MP took 38.4s. Estimated remaining: 2h 10m 7s. Rate: 7.5 symbols/min [2025-09-19T20:04:52.983574] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:04:53.045501] [DEBUG] [LOCAL ] MPW: Loaded 53890 existing records from primary storage. [2025-09-19T20:04:53.045690] [INFO ] [MAIN ] MPW: Loaded 53890 existing records. [2025-09-19T20:04:53.236043] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:04:53.237313] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-19T20:04:53.253234] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-19T20:04:53.267868] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-19T20:04:53.267822] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T20:04:53.268085] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-19T20:04:53.457584] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-19T20:04:53.702832] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:04:54.243269] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-19T20:04:54.512517] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T20:04:54.683865] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T20:04:55.043259] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-19T20:04:55.843283] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-19T20:04:56.609438] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T20:04:56.643258] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-19T20:04:57.143412] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T20:04:57.443323] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-19T20:04:57.775194] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T20:04:58.175346] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T20:04:58.236406] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T20:04:58.246523] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-19T20:04:59.043312] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-19T20:04:59.843276] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-19T20:05:00.302506] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T20:05:00.640969] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T20:05:00.643345] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-19T20:05:01.115214] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T20:05:01.443316] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-19T20:05:02.098163] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-19T20:05:02.243300] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-19T20:05:02.706019] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T20:05:03.043277] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-19T20:05:03.749442] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T20:05:03.843295] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-19T20:05:04.198999] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T20:05:04.643270] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-19T20:05:05.443279] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-19T20:05:05.880083] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T20:05:06.243294] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-19T20:05:06.782341] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T20:05:07.043249] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-19T20:05:07.124676] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T20:05:07.843275] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-19T20:05:08.291043] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T20:05:08.298990] [INFO ] [REMOTE ] MPLX: Full fetch complete (73971 records). [2025-09-19T20:05:08.299206] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-19T20:05:08.648418] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-19T20:05:08.705801] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-19T20:05:08.705913] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-19T20:05:08.706961] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-19T20:05:08.707030] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-19T20:05:08.708720] [DEBUG] [LOCAL ] MPLX: Trimmed 73971 records to 51533 (keeping 200 days of data) [2025-09-19T20:05:09.045470] [DEBUG] [LOCAL ] MPLX: Primary data saved (51533 records). [2025-09-19T20:05:09.045788] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-19T20:05:09.046192] [INFO ] [MAIN ] Update Progress: 1393/2372 symbols completed. MPLX took 31.3s. Estimated remaining: 2h 10m 4s. Rate: 7.5 symbols/min [2025-09-19T20:05:09.157312] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T20:05:09.260527] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:05:09.272257] [DEBUG] [LOCAL ] MPX: Loaded 4318 existing records from primary storage. [2025-09-19T20:05:09.272410] [INFO ] [MAIN ] MPX: Loaded 4318 existing records. [2025-09-19T20:05:09.378042] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T20:05:09.455683] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-19T20:05:09.476385] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:05:09.490982] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-19T20:05:09.492865] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T20:05:09.491550] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-19T20:05:09.503749] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-19T20:05:09.504478] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-19T20:05:09.856726] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:05:10.243301] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-19T20:05:10.992384] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-19T20:05:11.043224] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-19T20:05:11.470152] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-19T20:05:11.652221] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T20:05:11.843265] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-19T20:05:12.560150] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T20:05:12.561436] [INFO ] [REMOTE ] MPV: Full fetch complete (8071 records). [2025-09-19T20:05:12.561519] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-19T20:05:12.648363] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-19T20:05:12.931883] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-19T20:05:12.931962] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-19T20:05:12.932176] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-19T20:05:12.932227] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-19T20:05:12.932681] [DEBUG] [LOCAL ] MPV: Trimmed 8071 records to 5262 (keeping 200 days of data) [2025-09-19T20:05:12.964353] [DEBUG] [LOCAL ] MPV: Primary data saved (5262 records). [2025-09-19T20:05:12.964434] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-19T20:05:12.964523] [INFO ] [MAIN ] Update Progress: 1394/2372 symbols completed. MPV took 25.7s. Estimated remaining: 2h 9m 54s. Rate: 7.5 symbols/min [2025-09-19T20:05:13.134801] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:05:13.144469] [DEBUG] [LOCAL ] MQT: Loaded 8507 existing records from primary storage. [2025-09-19T20:05:13.144579] [INFO ] [MAIN ] MQT: Loaded 8507 existing records. [2025-09-19T20:05:13.319627] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:05:13.319898] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-19T20:05:13.319945] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-19T20:05:13.320313] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-19T20:05:13.320373] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-19T20:05:13.456742] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-19T20:05:13.674664] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:05:14.243272] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-19T20:05:14.903205] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T20:05:14.910978] [INFO ] [REMOTE ] MPC: Full fetch complete (75899 records). [2025-09-19T20:05:14.911115] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-19T20:05:15.021550] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T20:05:15.057802] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-19T20:05:15.333405] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-19T20:05:15.333491] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-19T20:05:15.334480] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-19T20:05:15.334547] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-19T20:05:15.336050] [DEBUG] [LOCAL ] MPC: Trimmed 75899 records to 52917 (keeping 200 days of data) [2025-09-19T20:05:15.714429] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T20:05:15.734921] [DEBUG] [LOCAL ] MPC: Primary data saved (52917 records). [2025-09-19T20:05:15.735053] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-19T20:05:15.735158] [INFO ] [MAIN ] Update Progress: 1395/2372 symbols completed. MPC took 39.6s. Estimated remaining: 2h 9m 42s. Rate: 7.5 symbols/min [2025-09-19T20:05:15.847094] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-19T20:05:15.899165] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T20:05:15.918035] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:05:15.940487] [DEBUG] [LOCAL ] MQY: Loaded 16962 existing records from primary storage. [2025-09-19T20:05:15.940638] [INFO ] [MAIN ] MQY: Loaded 16962 existing records. [2025-09-19T20:05:16.120748] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:05:16.120983] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-19T20:05:16.121043] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-19T20:05:16.121532] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-19T20:05:16.121593] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-19T20:05:16.487405] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:05:16.620477] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T20:05:16.643213] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-19T20:05:17.443288] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-19T20:05:17.605759] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T20:05:18.243282] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-19T20:05:18.953336] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T20:05:19.043308] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-19T20:05:19.621417] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T20:05:19.714593] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-19T20:05:19.843273] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-19T20:05:20.552486] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T20:05:20.643264] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-19T20:05:21.366795] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T20:05:21.443260] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-19T20:05:22.119215] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T20:05:22.120442] [INFO ] [REMOTE ] MPX: Full fetch complete (6849 records). [2025-09-19T20:05:22.120520] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-19T20:05:22.248569] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-19T20:05:22.660498] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-19T20:05:22.660618] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-19T20:05:22.661010] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-19T20:05:22.661078] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-19T20:05:22.661833] [DEBUG] [LOCAL ] MPX: Trimmed 6849 records to 4326 (keeping 200 days of data) [2025-09-19T20:05:22.701453] [DEBUG] [LOCAL ] MPX: Primary data saved (4326 records). [2025-09-19T20:05:22.701685] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-19T20:05:22.701836] [INFO ] [MAIN ] Update Progress: 1396/2372 symbols completed. MPX took 13.7s. Estimated remaining: 2h 9m 33s. Rate: 7.5 symbols/min [2025-09-19T20:05:22.947556] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:05:23.031722] [DEBUG] [LOCAL ] MRC: Loaded 37863 existing records from primary storage. [2025-09-19T20:05:23.032024] [INFO ] [MAIN ] MRC: Loaded 37863 existing records. [2025-09-19T20:05:23.048547] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-19T20:05:23.320292] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:05:23.320679] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-19T20:05:23.320761] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-19T20:05:23.321632] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-19T20:05:23.321741] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-19T20:05:23.770039] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:05:23.781584] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T20:05:23.843264] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-19T20:05:24.643243] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-19T20:05:25.100685] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T20:05:25.291400] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T20:05:25.443264] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-19T20:05:25.672855] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T20:05:26.243276] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-19T20:05:26.619973] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T20:05:27.043261] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-19T20:05:27.843266] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-19T20:05:28.093552] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T20:05:28.102091] [INFO ] [REMOTE ] MPW: Full fetch complete (77529 records). [2025-09-19T20:05:28.102243] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-19T20:05:28.461450] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T20:05:28.556167] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-19T20:05:28.556253] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-19T20:05:28.557390] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-19T20:05:28.557481] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-19T20:05:28.559147] [DEBUG] [LOCAL ] MPW: Trimmed 77529 records to 54280 (keeping 200 days of data) [2025-09-19T20:05:28.649007] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-19T20:05:28.783450] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T20:05:28.905471] [DEBUG] [LOCAL ] MPW: Primary data saved (54280 records). [2025-09-19T20:05:28.905619] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-19T20:05:28.905737] [INFO ] [MAIN ] Update Progress: 1397/2372 symbols completed. MPW took 36.1s. Estimated remaining: 2h 9m 24s. Rate: 7.5 symbols/min [2025-09-19T20:05:29.443263] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-19T20:05:30.192533] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T20:05:30.201499] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T20:05:30.243255] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-19T20:05:31.043267] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-19T20:05:31.800500] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T20:05:31.843255] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-19T20:05:32.241561] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T20:05:32.643277] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-19T20:05:33.443249] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-19T20:05:33.513853] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T20:05:33.821535] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T20:05:34.243276] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-19T20:05:34.613746] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T20:05:34.964208] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T20:05:35.043241] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-19T20:05:35.843270] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-19T20:05:35.876007] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T20:05:36.643294] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-19T20:05:37.443366] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-19T20:05:37.485963] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T20:05:37.750733] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T20:05:38.243288] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-19T20:05:38.292542] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-19T20:05:39.043280] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-19T20:05:39.433954] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T20:05:39.843347] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-19T20:05:39.884296] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-19T20:05:40.643323] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-19T20:05:41.443271] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-19T20:05:41.549240] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T20:05:41.551547] [INFO ] [REMOTE ] MQT: Full fetch complete (13314 records). [2025-09-19T20:05:41.551715] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-19T20:05:41.681853] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T20:05:41.977827] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-19T20:05:41.977908] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-19T20:05:41.978211] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-19T20:05:41.978248] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-19T20:05:41.978774] [DEBUG] [LOCAL ] MQT: Trimmed 13314 records to 8527 (keeping 200 days of data) [2025-09-19T20:05:42.030330] [DEBUG] [LOCAL ] MQT: Primary data saved (8527 records). [2025-09-19T20:05:42.030470] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-19T20:05:42.030556] [INFO ] [MAIN ] Update Progress: 1398/2372 symbols completed. MQT took 29.1s. Estimated remaining: 2h 9m 20s. Rate: 7.5 symbols/min [2025-09-19T20:05:42.243285] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-19T20:05:42.668762] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T20:05:43.043312] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-19T20:05:43.849365] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T20:05:43.853244] [INFO ] [REMOTE ] MQY: Full fetch complete (27268 records). [2025-09-19T20:05:43.853432] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-19T20:05:44.146639] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T20:05:44.196240] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-19T20:05:44.287123] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-19T20:05:44.287214] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-19T20:05:44.287789] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-19T20:05:44.287852] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-19T20:05:44.289071] [DEBUG] [LOCAL ] MQY: Trimmed 27268 records to 17048 (keeping 200 days of data) [2025-09-19T20:05:44.395606] [DEBUG] [LOCAL ] MQY: Primary data saved (17048 records). [2025-09-19T20:05:44.395781] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-19T20:05:44.395876] [INFO ] [MAIN ] Update Progress: 1399/2372 symbols completed. MQY took 28.7s. Estimated remaining: 2h 9m 8s. Rate: 7.5 symbols/min [2025-09-19T20:05:45.721226] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T20:05:45.728853] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-19T20:05:47.531628] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T20:05:47.541063] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-19T20:05:49.150750] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T20:05:49.159253] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-19T20:05:50.789669] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T20:05:50.795294] [INFO ] [REMOTE ] MRC: Full fetch complete (54238 records). [2025-09-19T20:05:50.795406] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-19T20:05:51.217240] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-19T20:05:51.217356] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-19T20:05:51.218381] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-19T20:05:51.218448] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-19T20:05:51.219955] [DEBUG] [LOCAL ] MRC: Trimmed 54238 records to 38199 (keeping 200 days of data) [2025-09-19T20:05:51.453456] [DEBUG] [LOCAL ] MRC: Primary data saved (38199 records). [2025-09-19T20:05:51.453597] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-19T20:05:51.453954] [INFO ] [MAIN ] Update Progress: 1400/2372 symbols completed. MRC took 28.8s. Estimated remaining: 2h 8m 59s. Rate: 7.5 symbols/min [2025-09-19T20:05:52.068541] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:05:52.120455] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:05:52.209283] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:05:52.208343] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-19T20:05:52.227250] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:05:52.227946] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-09-19T20:05:52.221229] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-19T20:05:52.229077] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-09-19T20:05:52.229575] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-19T20:05:52.229722] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-19T20:05:52.230026] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-19T20:05:52.230084] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-19T20:05:52.230215] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-19T20:05:52.230349] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-19T20:05:52.242445] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-09-19T20:05:52.253937] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-19T20:05:52.425226] [DEBUG] [LOCAL ] MSA: Loaded 18855 existing records from primary storage. [2025-09-19T20:05:52.436082] [INFO ] [MAIN ] MSA: Loaded 18855 existing records. [2025-09-19T20:05:52.858454] [DEBUG] [LOCAL ] MS: Loaded 54082 existing records from primary storage. [2025-09-19T20:05:52.954470] [INFO ] [MAIN ] MS: Loaded 54082 existing records. [2025-09-19T20:05:53.124497] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:05:53.211614] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-19T20:05:53.236499] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-19T20:05:53.277896] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-19T20:05:53.278013] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-19T20:05:53.308368] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:05:53.383458] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-19T20:05:53.386793] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:05:53.401229] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-19T20:05:53.582956] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:05:53.602624] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-19T20:05:53.602758] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-19T20:05:53.617751] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-19T20:05:53.617853] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-19T20:05:53.763639] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:05:53.814032] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-19T20:05:53.823849] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-19T20:05:54.130926] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:05:54.145778] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:05:54.150140] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-19T20:05:54.149785] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-19T20:05:54.161482] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-19T20:05:54.239473] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:05:54.239829] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-19T20:05:55.403678] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T20:05:55.407735] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-19T20:05:55.835239] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-19T20:05:55.850290] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-19T20:05:55.928836] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T20:05:55.937205] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-19T20:05:56.062632] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T20:05:56.066271] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-19T20:05:56.496455] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T20:05:56.507803] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-19T20:05:57.265913] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T20:05:57.269610] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-19T20:05:57.855133] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T20:05:57.866678] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-19T20:05:57.918755] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T20:05:57.934305] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-19T20:05:58.716761] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T20:05:58.720685] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-19T20:05:58.884330] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-19T20:05:59.043342] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-19T20:06:00.028448] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T20:06:00.038973] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-19T20:06:00.202772] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T20:06:00.397674] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-19T20:06:00.643305] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-19T20:06:00.884192] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T20:06:01.203411] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T20:06:01.443315] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-19T20:06:02.243293] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-19T20:06:03.043339] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-19T20:06:03.755518] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-19T20:06:03.843243] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-19T20:06:04.471190] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-09-19T20:06:04.643594] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-19T20:06:05.179852] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T20:06:05.443371] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-19T20:06:05.661615] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (3.42 seconds). [2025-09-19T20:06:06.243234] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-19T20:06:06.675054] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T20:06:06.719776] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T20:06:07.043261] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-19T20:06:07.109068] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (3.27 seconds). [2025-09-19T20:06:07.703550] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T20:06:07.843218] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-19T20:06:08.246631] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T20:06:08.643283] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-19T20:06:09.296094] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T20:06:09.443231] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-19T20:06:09.832264] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T20:06:10.243265] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-19T20:06:11.043249] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-19T20:06:11.368460] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T20:06:11.371870] [INFO ] [REMOTE ] MSA: Full fetch complete (25645 records). [2025-09-19T20:06:11.371960] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-19T20:06:11.706540] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T20:06:11.752256] [INFO ] [REMOTE ] MRP: Full fetch complete (53541 records). [2025-09-19T20:06:11.759452] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-19T20:06:11.856489] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-19T20:06:11.897946] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-19T20:06:11.904487] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-19T20:06:11.916439] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-19T20:06:11.916532] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-19T20:06:11.944242] [DEBUG] [LOCAL ] MSA: Trimmed 25645 records to 19039 (keeping 200 days of data) [2025-09-19T20:06:12.011456] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 155 unique days, need 200 days [2025-09-19T20:06:12.012125] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:06:12.012204] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:06:12.012259] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-19T20:06:12.012325] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-19T20:06:12.012360] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-19T20:06:12.012414] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-19T20:06:12.012507] [INFO ] [MAIN ] Update Progress: 1401/2372 symbols completed. MRP took 20.6s. Estimated remaining: 2h 9m 0s. Rate: 7.5 symbols/min [2025-09-19T20:06:12.304863] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:06:12.324016] [DEBUG] [LOCAL ] MSB: Loaded 7972 existing records from primary storage. [2025-09-19T20:06:12.324680] [INFO ] [MAIN ] MSB: Loaded 7972 existing records. [2025-09-19T20:06:12.433849] [DEBUG] [LOCAL ] MSA: Primary data saved (19039 records). [2025-09-19T20:06:12.439807] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-19T20:06:12.445032] [INFO ] [MAIN ] Update Progress: 1402/2372 symbols completed. MSA took 21.0s. Estimated remaining: 2h 8m 47s. Rate: 7.5 symbols/min [2025-09-19T20:06:12.615277] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:06:12.615569] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-19T20:06:12.615851] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-19T20:06:12.631887] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-19T20:06:12.637065] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-19T20:06:12.786835] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:06:12.802545] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-19T20:06:12.807729] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-19T20:06:12.825523] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-19T20:06:12.844157] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-19T20:06:12.862322] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-19T20:06:12.896613] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-19T20:06:13.195115] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:06:13.220747] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-19T20:06:13.413132] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:06:13.443246] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-19T20:06:13.489239] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-19T20:06:13.860263] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-19T20:06:14.086112] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T20:06:14.141628] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-19T20:06:14.243215] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-19T20:06:15.043318] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-19T20:06:15.843241] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-19T20:06:16.270368] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T20:06:16.460614] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T20:06:16.643264] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-19T20:06:16.991214] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-19T20:06:17.443269] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-19T20:06:18.243286] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-19T20:06:19.043311] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-19T20:06:19.336814] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (3.49 seconds). [2025-09-19T20:06:19.395517] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T20:06:19.843296] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-19T20:06:20.046459] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T20:06:20.104169] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-19T20:06:20.643262] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-19T20:06:21.443260] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-19T20:06:22.246725] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-19T20:06:22.248243] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T20:06:22.492833] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-19T20:06:22.781496] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T20:06:22.954259] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-19T20:06:23.043265] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-19T20:06:23.439672] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-19T20:06:23.843275] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-19T20:06:24.643271] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-19T20:06:25.039829] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T20:06:25.443245] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-19T20:06:25.841587] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T20:06:25.920673] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T20:06:25.928916] [INFO ] [REMOTE ] MS: Full fetch complete (77719 records). [2025-09-19T20:06:25.929088] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-19T20:06:26.248424] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-19T20:06:26.364583] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-19T20:06:26.364700] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-19T20:06:26.365850] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-19T20:06:26.365927] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-19T20:06:26.367497] [DEBUG] [LOCAL ] MS: Trimmed 77719 records to 54474 (keeping 200 days of data) [2025-09-19T20:06:26.724024] [DEBUG] [LOCAL ] MS: Primary data saved (54474 records). [2025-09-19T20:06:26.724171] [INFO ] [MAIN ] MS: Full history saved. [2025-09-19T20:06:26.724284] [INFO ] [MAIN ] Update Progress: 1403/2372 symbols completed. MS took 35.3s. Estimated remaining: 2h 8m 43s. Rate: 7.5 symbols/min [2025-09-19T20:06:26.898368] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:06:26.935274] [DEBUG] [LOCAL ] MSCI: Loaded 35155 existing records from primary storage. [2025-09-19T20:06:26.935418] [INFO ] [MAIN ] MSCI: Loaded 35155 existing records. [2025-09-19T20:06:27.048541] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-19T20:06:27.119694] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:06:27.119957] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-19T20:06:27.120010] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-19T20:06:27.121226] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-19T20:06:27.121295] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-19T20:06:27.306391] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T20:06:27.500812] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:06:27.649548] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T20:06:27.843333] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-19T20:06:28.643279] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-19T20:06:29.418818] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T20:06:29.443220] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-19T20:06:30.243292] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-19T20:06:30.775746] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-19T20:06:31.043305] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-19T20:06:31.511537] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-19T20:06:31.541900] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T20:06:31.697811] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-19T20:06:31.698936] [INFO ] [REMOTE ] MSC: Full fetch complete (2501 records). [2025-09-19T20:06:31.699006] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-19T20:06:31.853267] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-19T20:06:31.886152] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-19T20:06:31.886409] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:06:31.886510] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:06:31.886605] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-19T20:06:31.886764] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-19T20:06:31.886823] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-19T20:06:31.886896] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-19T20:06:31.887007] [INFO ] [MAIN ] Update Progress: 1404/2372 symbols completed. MSC took 19.4s. Estimated remaining: 2h 8m 33s. Rate: 7.5 symbols/min [2025-09-19T20:06:32.057300] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:06:32.074071] [DEBUG] [LOCAL ] MSD: Loaded 15767 existing records from primary storage. [2025-09-19T20:06:32.074230] [INFO ] [MAIN ] MSD: Loaded 15767 existing records. [2025-09-19T20:06:32.252047] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:06:32.252318] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-19T20:06:32.252375] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-19T20:06:32.253093] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-19T20:06:32.253157] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-19T20:06:32.610324] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:06:32.643249] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-19T20:06:33.443286] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-19T20:06:33.647888] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T20:06:34.243353] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-19T20:06:34.351437] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T20:06:34.512125] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-19T20:06:34.522377] [INFO ] [REMOTE ] MRK: Full fetch complete (77856 records). [2025-09-19T20:06:34.522579] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-19T20:06:34.992492] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-19T20:06:34.992597] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-19T20:06:34.993904] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-19T20:06:34.993975] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-19T20:06:34.995629] [DEBUG] [LOCAL ] MRK: Trimmed 77856 records to 54569 (keeping 200 days of data) [2025-09-19T20:06:35.055710] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-19T20:06:35.362703] [DEBUG] [LOCAL ] MRK: Primary data saved (54569 records). [2025-09-19T20:06:35.362899] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-19T20:06:35.363054] [INFO ] [MAIN ] Update Progress: 1405/2372 symbols completed. MRK took 43.9s. Estimated remaining: 2h 8m 22s. Rate: 7.5 symbols/min [2025-09-19T20:06:35.540121] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:06:35.583366] [DEBUG] [LOCAL ] MSDL: Loaded 38441 existing records from primary storage. [2025-09-19T20:06:35.583519] [INFO ] [MAIN ] MSDL: Loaded 38441 existing records. [2025-09-19T20:06:35.758936] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:06:35.759169] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-19T20:06:35.759217] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-19T20:06:35.760471] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-19T20:06:35.760532] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-19T20:06:35.851466] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-19T20:06:36.058733] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T20:06:36.143869] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:06:36.169116] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T20:06:36.643306] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-19T20:06:36.875477] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T20:06:37.443314] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-19T20:06:38.243291] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-19T20:06:38.440923] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T20:06:38.499998] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T20:06:39.043276] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-19T20:06:39.251311] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T20:06:39.843308] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-19T20:06:40.643242] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-19T20:06:40.888049] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T20:06:41.063544] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T20:06:41.443317] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-19T20:06:41.857427] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T20:06:42.017897] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T20:06:42.243281] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-19T20:06:42.807264] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T20:06:43.043309] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-19T20:06:43.843330] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-19T20:06:43.895304] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T20:06:43.897582] [INFO ] [REMOTE ] MSB: Full fetch complete (12877 records). [2025-09-19T20:06:43.897689] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-19T20:06:44.279691] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-19T20:06:44.279799] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-19T20:06:44.280145] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-19T20:06:44.280187] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-19T20:06:44.280855] [DEBUG] [LOCAL ] MSB: Trimmed 12877 records to 8043 (keeping 200 days of data) [2025-09-19T20:06:44.343154] [DEBUG] [LOCAL ] MSB: Primary data saved (8043 records). [2025-09-19T20:06:44.343422] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-19T20:06:44.343585] [INFO ] [MAIN ] Update Progress: 1406/2372 symbols completed. MSB took 32.3s. Estimated remaining: 2h 8m 15s. Rate: 7.5 symbols/min [2025-09-19T20:06:44.517349] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:06:44.549835] [DEBUG] [LOCAL ] MSGE: Loaded 27326 existing records from primary storage. [2025-09-19T20:06:44.550001] [INFO ] [MAIN ] MSGE: Loaded 27326 existing records. [2025-09-19T20:06:44.649461] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-19T20:06:44.733744] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:06:44.734254] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-19T20:06:44.734411] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-19T20:06:44.735624] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-19T20:06:44.735816] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-19T20:06:44.979067] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T20:06:45.148211] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:06:45.443335] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-19T20:06:45.697269] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T20:06:46.243246] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-19T20:06:46.373814] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T20:06:47.043275] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-19T20:06:47.798737] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T20:06:47.843246] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-19T20:06:48.536702] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T20:06:48.643249] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-19T20:06:49.443274] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-19T20:06:49.675837] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T20:06:50.046837] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T20:06:50.243302] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-19T20:06:50.466793] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T20:06:51.043287] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-19T20:06:51.539989] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-19T20:06:51.843236] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-19T20:06:52.469192] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T20:06:52.643279] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-19T20:06:53.350969] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T20:06:53.443255] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-19T20:06:54.243299] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-19T20:06:54.587197] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T20:06:54.620794] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T20:06:55.043318] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-19T20:06:55.852081] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-19T20:06:55.854949] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T20:06:56.332216] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T20:06:56.643251] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-19T20:06:57.062750] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T20:06:57.443324] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-19T20:06:58.243329] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-19T20:06:58.278469] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T20:06:59.043306] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-19T20:06:59.519938] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T20:06:59.557549] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T20:06:59.564612] [INFO ] [REMOTE ] MSCI: Full fetch complete (50125 records). [2025-09-19T20:06:59.564906] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-19T20:06:59.848399] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-19T20:06:59.959103] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-19T20:06:59.959297] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-19T20:06:59.960483] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-19T20:06:59.960562] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-19T20:06:59.961733] [DEBUG] [LOCAL ] MSCI: Trimmed 50125 records to 35459 (keeping 200 days of data) [2025-09-19T20:07:00.213727] [DEBUG] [LOCAL ] MSCI: Primary data saved (35459 records). [2025-09-19T20:07:00.213887] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-19T20:07:00.214054] [INFO ] [MAIN ] Update Progress: 1407/2372 symbols completed. MSCI took 33.5s. Estimated remaining: 2h 8m 13s. Rate: 7.5 symbols/min [2025-09-19T20:07:00.441881] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:07:00.462684] [DEBUG] [LOCAL ] MSGS: Loaded 16933 existing records from primary storage. [2025-09-19T20:07:00.462837] [INFO ] [MAIN ] MSGS: Loaded 16933 existing records. [2025-09-19T20:07:00.622627] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T20:07:00.649574] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-19T20:07:00.688875] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:07:00.689110] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-19T20:07:00.689184] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-19T20:07:00.690405] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-19T20:07:00.690725] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-19T20:07:01.100602] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:07:01.110979] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T20:07:01.114616] [INFO ] [REMOTE ] MSD: Full fetch complete (21992 records). [2025-09-19T20:07:01.114814] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-19T20:07:01.452420] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-19T20:07:01.508513] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-19T20:07:01.508709] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-19T20:07:01.509696] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-19T20:07:01.509787] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-19T20:07:01.511226] [DEBUG] [LOCAL ] MSD: Trimmed 21992 records to 15868 (keeping 200 days of data) [2025-09-19T20:07:01.620744] [DEBUG] [LOCAL ] MSD: Primary data saved (15868 records). [2025-09-19T20:07:01.620915] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-19T20:07:01.621028] [INFO ] [MAIN ] Update Progress: 1408/2372 symbols completed. MSD took 29.7s. Estimated remaining: 2h 8m 0s. Rate: 7.5 symbols/min [2025-09-19T20:07:01.791912] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:07:01.856564] [DEBUG] [LOCAL ] MSI: Loaded 40955 existing records from primary storage. [2025-09-19T20:07:01.856749] [INFO ] [MAIN ] MSI: Loaded 40955 existing records. [2025-09-19T20:07:02.062002] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:07:02.062735] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-19T20:07:02.062796] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-19T20:07:02.064324] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-19T20:07:02.064390] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-19T20:07:02.248691] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-19T20:07:02.438366] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:07:02.474064] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T20:07:02.492130] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T20:07:03.043277] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-19T20:07:03.741380] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T20:07:03.843289] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-19T20:07:04.022186] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T20:07:04.643269] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-19T20:07:05.272729] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T20:07:05.443269] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-19T20:07:05.670461] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T20:07:06.243292] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-19T20:07:07.043313] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-19T20:07:07.214424] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-19T20:07:07.412707] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T20:07:07.419523] [INFO ] [REMOTE ] MSDL: Full fetch complete (54081 records). [2025-09-19T20:07:07.419661] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-19T20:07:07.819241] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-19T20:07:07.819323] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-19T20:07:07.820166] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-19T20:07:07.820229] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-19T20:07:07.821409] [DEBUG] [LOCAL ] MSDL: Trimmed 54081 records to 38691 (keeping 200 days of data) [2025-09-19T20:07:07.885810] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-19T20:07:08.065396] [DEBUG] [LOCAL ] MSDL: Primary data saved (38691 records). [2025-09-19T20:07:08.065548] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-19T20:07:08.065635] [INFO ] [MAIN ] Update Progress: 1409/2372 symbols completed. MSDL took 32.7s. Estimated remaining: 2h 7m 51s. Rate: 7.5 symbols/min [2025-09-19T20:07:08.240907] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:07:08.241365] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-19T20:07:08.241422] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-19T20:07:08.241670] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-19T20:07:08.241728] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-19T20:07:08.241774] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-19T20:07:08.241807] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-19T20:07:08.615860] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:07:08.618128] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T20:07:08.643218] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-19T20:07:09.443232] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-19T20:07:09.608470] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T20:07:10.019621] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T20:07:10.243258] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-19T20:07:10.695073] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T20:07:11.043266] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-19T20:07:11.843244] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-19T20:07:11.911109] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T20:07:11.930318] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T20:07:12.643235] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-19T20:07:12.866037] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:07:12.866405] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-19T20:07:13.184312] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T20:07:13.443285] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-19T20:07:14.054398] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T20:07:14.243284] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-19T20:07:15.043285] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-19T20:07:15.843344] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-19T20:07:15.999723] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T20:07:16.348712] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T20:07:16.643275] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-19T20:07:17.073690] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T20:07:17.443267] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-19T20:07:17.567295] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T20:07:18.243226] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-19T20:07:18.792064] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T20:07:19.043288] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-19T20:07:19.600203] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T20:07:19.843269] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-19T20:07:20.174780] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T20:07:20.643280] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-19T20:07:21.443423] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-19T20:07:21.538424] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T20:07:21.673699] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T20:07:22.243300] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-19T20:07:22.882035] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-19T20:07:22.902401] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T20:07:22.907444] [INFO ] [REMOTE ] MSGE: Full fetch complete (40200 records). [2025-09-19T20:07:22.907556] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-19T20:07:23.049037] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-19T20:07:23.341184] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-19T20:07:23.341337] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-19T20:07:23.342585] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-19T20:07:23.342679] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-19T20:07:23.344406] [DEBUG] [LOCAL ] MSGE: Trimmed 40200 records to 27557 (keeping 200 days of data) [2025-09-19T20:07:23.525069] [DEBUG] [LOCAL ] MSGE: Primary data saved (27557 records). [2025-09-19T20:07:23.525272] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-19T20:07:23.525413] [INFO ] [MAIN ] Update Progress: 1410/2372 symbols completed. MSGE took 39.2s. Estimated remaining: 2h 7m 48s. Rate: 7.5 symbols/min [2025-09-19T20:07:23.700953] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:07:23.746163] [DEBUG] [LOCAL ] MSM: Loaded 35589 existing records from primary storage. [2025-09-19T20:07:23.746366] [INFO ] [MAIN ] MSM: Loaded 35589 existing records. [2025-09-19T20:07:23.850024] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-19T20:07:23.942479] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:07:23.942889] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-19T20:07:23.943003] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-19T20:07:23.944683] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-19T20:07:23.944747] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-19T20:07:24.318413] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:07:24.643289] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-19T20:07:24.782335] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T20:07:24.804153] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T20:07:25.443335] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-19T20:07:25.793581] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T20:07:26.243342] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-19T20:07:27.043402] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-19T20:07:27.119377] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T20:07:27.843302] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-19T20:07:28.067178] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-19T20:07:28.163988] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T20:07:28.643289] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-19T20:07:29.231608] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T20:07:29.235127] [INFO ] [REMOTE ] MSGS: Full fetch complete (22124 records). [2025-09-19T20:07:29.235207] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-19T20:07:29.453435] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-19T20:07:29.629672] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-19T20:07:29.629767] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-19T20:07:29.630286] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-19T20:07:29.630327] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-19T20:07:29.631125] [DEBUG] [LOCAL ] MSGS: Trimmed 22124 records to 17066 (keeping 200 days of data) [2025-09-19T20:07:29.734978] [DEBUG] [LOCAL ] MSGS: Primary data saved (17066 records). [2025-09-19T20:07:29.735134] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-19T20:07:29.735245] [INFO ] [MAIN ] Update Progress: 1411/2372 symbols completed. MSGS took 29.5s. Estimated remaining: 2h 7m 39s. Rate: 7.5 symbols/min [2025-09-19T20:07:29.910159] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:07:29.968966] [DEBUG] [LOCAL ] MT: Loaded 51235 existing records from primary storage. [2025-09-19T20:07:29.969113] [INFO ] [MAIN ] MT: Loaded 51235 existing records. [2025-09-19T20:07:30.151676] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:07:30.151946] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-19T20:07:30.152009] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-19T20:07:30.153630] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-19T20:07:30.153725] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-19T20:07:30.251101] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-19T20:07:30.518342] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:07:30.546699] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T20:07:30.836013] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T20:07:31.043311] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-19T20:07:31.625058] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T20:07:31.843315] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-19T20:07:32.517807] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-19T20:07:32.643279] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-19T20:07:33.443308] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-19T20:07:33.591587] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T20:07:33.598915] [INFO ] [REMOTE ] MSI: Full fetch complete (58511 records). [2025-09-19T20:07:33.599065] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-19T20:07:34.025603] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-19T20:07:34.025773] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-19T20:07:34.027123] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-19T20:07:34.027210] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-19T20:07:34.029152] [DEBUG] [LOCAL ] MSI: Trimmed 58511 records to 41240 (keeping 200 days of data) [2025-09-19T20:07:34.249064] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-19T20:07:34.338966] [DEBUG] [LOCAL ] MSI: Primary data saved (41240 records). [2025-09-19T20:07:34.339167] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-19T20:07:34.340135] [INFO ] [MAIN ] Update Progress: 1412/2372 symbols completed. MSI took 32.7s. Estimated remaining: 2h 7m 29s. Rate: 7.5 symbols/min [2025-09-19T20:07:34.536495] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:07:34.586023] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T20:07:34.632238] [DEBUG] [LOCAL ] MTAL: Loaded 36390 existing records from primary storage. [2025-09-19T20:07:34.632448] [INFO ] [MAIN ] MTAL: Loaded 36390 existing records. [2025-09-19T20:07:34.823638] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:07:34.824016] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-19T20:07:34.824068] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-19T20:07:34.825215] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-19T20:07:34.825279] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-19T20:07:35.087237] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-19T20:07:35.135495] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T20:07:35.267845] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:07:35.600300] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T20:07:35.603730] [INFO ] [REMOTE ] MSIF: Full fetch complete (15810 records). [2025-09-19T20:07:35.603808] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-19T20:07:35.788766] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 161 unique days, need 200 days [2025-09-19T20:07:35.789123] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:07:35.789195] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:07:35.789282] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-19T20:07:35.789384] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-19T20:07:35.789441] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-19T20:07:35.789568] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-19T20:07:35.789680] [INFO ] [MAIN ] Update Progress: 1413/2372 symbols completed. MSIF took 27.7s. Estimated remaining: 2h 7m 16s. Rate: 7.5 symbols/min [2025-09-19T20:07:35.855774] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-19T20:07:35.986397] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:07:36.037140] [DEBUG] [LOCAL ] MTB: Loaded 47605 existing records from primary storage. [2025-09-19T20:07:36.037322] [INFO ] [MAIN ] MTB: Loaded 47605 existing records. [2025-09-19T20:07:36.217808] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:07:36.218099] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-19T20:07:36.218151] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-19T20:07:36.219405] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-19T20:07:36.219465] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-19T20:07:36.573564] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:07:36.643304] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-19T20:07:37.052267] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T20:07:37.443245] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-19T20:07:37.581556] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T20:07:38.243293] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-19T20:07:38.564889] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T20:07:39.043330] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-19T20:07:39.507211] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T20:07:39.749434] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T20:07:39.848319] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-19T20:07:39.863445] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T20:07:40.643300] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-19T20:07:41.443254] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-19T20:07:41.806135] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T20:07:42.243229] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-19T20:07:42.476979] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T20:07:42.931147] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T20:07:43.043266] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-19T20:07:43.560181] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T20:07:43.843236] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-19T20:07:44.643285] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-19T20:07:44.847401] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T20:07:45.055636] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T20:07:45.443313] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-19T20:07:46.243385] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-19T20:07:46.509581] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T20:07:46.944037] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T20:07:47.043284] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-19T20:07:47.843290] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-19T20:07:48.615966] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-19T20:07:48.643218] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-19T20:07:48.939103] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T20:07:49.359734] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T20:07:49.443216] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-19T20:07:50.243266] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-19T20:07:50.886140] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T20:07:51.043278] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-19T20:07:51.209288] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T20:07:51.843291] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-19T20:07:52.241523] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T20:07:52.643277] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-19T20:07:53.126801] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T20:07:53.443298] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-19T20:07:54.243350] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-19T20:07:54.625517] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T20:07:55.043322] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-19T20:07:55.235191] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T20:07:55.843301] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-19T20:07:56.132606] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T20:07:56.643376] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-19T20:07:56.899667] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (5.06 seconds). [2025-09-19T20:07:57.002581] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T20:07:57.009958] [INFO ] [REMOTE ] MT: Full fetch complete (73415 records). [2025-09-19T20:07:57.010078] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-19T20:07:57.405180] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-19T20:07:57.405370] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-19T20:07:57.406496] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-19T20:07:57.406620] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-19T20:07:57.408872] [DEBUG] [LOCAL ] MT: Trimmed 73415 records to 51525 (keeping 200 days of data) [2025-09-19T20:07:57.471344] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-19T20:07:57.527038] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T20:07:57.752352] [DEBUG] [LOCAL ] MT: Primary data saved (51525 records). [2025-09-19T20:07:57.752512] [INFO ] [MAIN ] MT: Full history saved. [2025-09-19T20:07:57.752614] [INFO ] [MAIN ] Update Progress: 1414/2372 symbols completed. MT took 28.0s. Estimated remaining: 2h 7m 18s. Rate: 7.5 symbols/min [2025-09-19T20:07:57.920702] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:07:57.938868] [DEBUG] [LOCAL ] MTD: Loaded 15446 existing records from primary storage. [2025-09-19T20:07:57.939020] [INFO ] [MAIN ] MTD: Loaded 15446 existing records. [2025-09-19T20:07:58.132718] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:07:58.133040] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-19T20:07:58.133144] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-19T20:07:58.133778] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-19T20:07:58.133838] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-19T20:07:58.248514] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-19T20:07:58.498232] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:07:58.627430] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T20:07:58.710851] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T20:07:59.043319] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-19T20:07:59.843313] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-19T20:07:59.975210] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T20:08:00.026991] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T20:08:00.643328] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-19T20:08:01.443339] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-19T20:08:01.651569] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T20:08:01.681367] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T20:08:02.243307] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-19T20:08:03.043355] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-19T20:08:03.084018] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T20:08:03.089801] [INFO ] [REMOTE ] MSM: Full fetch complete (51972 records). [2025-09-19T20:08:03.089933] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-19T20:08:03.473792] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-19T20:08:03.473872] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-19T20:08:03.474632] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-19T20:08:03.474717] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-19T20:08:03.475790] [DEBUG] [LOCAL ] MSM: Trimmed 51972 records to 35948 (keeping 200 days of data) [2025-09-19T20:08:03.702960] [DEBUG] [LOCAL ] MSM: Primary data saved (35948 records). [2025-09-19T20:08:03.703153] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-19T20:08:03.703263] [INFO ] [MAIN ] Update Progress: 1415/2372 symbols completed. MSM took 40.2s. Estimated remaining: 2h 7m 9s. Rate: 7.5 symbols/min [2025-09-19T20:08:03.850041] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-19T20:08:03.884442] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:03.896262] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T20:08:03.951312] [DEBUG] [LOCAL ] MTDR: Loaded 51956 existing records from primary storage. [2025-09-19T20:08:03.951459] [INFO ] [MAIN ] MTDR: Loaded 51956 existing records. [2025-09-19T20:08:04.129769] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:08:04.130050] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-19T20:08:04.130099] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-19T20:08:04.131404] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-19T20:08:04.131465] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-19T20:08:04.535627] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:04.643270] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-19T20:08:05.242305] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T20:08:05.249511] [INFO ] [REMOTE ] MTB: Full fetch complete (68488 records). [2025-09-19T20:08:05.249711] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-19T20:08:05.451606] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-19T20:08:05.667059] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-19T20:08:05.667190] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-19T20:08:05.668195] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-19T20:08:05.668277] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-19T20:08:05.684761] [DEBUG] [LOCAL ] MTB: Trimmed 68488 records to 47970 (keeping 200 days of data) [2025-09-19T20:08:05.697718] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T20:08:05.916808] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T20:08:06.031427] [DEBUG] [LOCAL ] MTB: Primary data saved (47970 records). [2025-09-19T20:08:06.031580] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-19T20:08:06.031692] [INFO ] [MAIN ] Update Progress: 1416/2372 symbols completed. MTB took 30.2s. Estimated remaining: 2h 6m 57s. Rate: 7.5 symbols/min [2025-09-19T20:08:06.202730] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:06.254690] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-19T20:08:06.257861] [DEBUG] [LOCAL ] MTG: Loaded 51744 existing records from primary storage. [2025-09-19T20:08:06.258051] [INFO ] [MAIN ] MTG: Loaded 51744 existing records. [2025-09-19T20:08:06.447228] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:08:06.447597] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-19T20:08:06.447681] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-19T20:08:06.449018] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-19T20:08:06.449080] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-19T20:08:06.851477] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:07.043228] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-19T20:08:07.250318] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T20:08:07.795689] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T20:08:07.843256] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-19T20:08:08.586113] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T20:08:08.643315] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-19T20:08:09.227500] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T20:08:09.443340] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-19T20:08:10.062545] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T20:08:10.243267] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-19T20:08:11.043311] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-19T20:08:11.435705] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T20:08:11.441427] [INFO ] [REMOTE ] MTAL: Full fetch complete (46519 records). [2025-09-19T20:08:11.441523] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-19T20:08:11.853370] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-19T20:08:11.853971] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-19T20:08:11.854803] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-19T20:08:11.855634] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-19T20:08:11.855834] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-19T20:08:11.856897] [DEBUG] [LOCAL ] MTAL: Trimmed 46519 records to 36734 (keeping 200 days of data) [2025-09-19T20:08:12.082318] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T20:08:12.115749] [DEBUG] [LOCAL ] MTAL: Primary data saved (36734 records). [2025-09-19T20:08:12.115951] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-19T20:08:12.116465] [INFO ] [MAIN ] Update Progress: 1417/2372 symbols completed. MTAL took 37.8s. Estimated remaining: 2h 6m 48s. Rate: 7.5 symbols/min [2025-09-19T20:08:12.301753] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:12.317094] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T20:08:12.362259] [DEBUG] [LOCAL ] MTH: Loaded 44331 existing records from primary storage. [2025-09-19T20:08:12.362431] [INFO ] [MAIN ] MTH: Loaded 44331 existing records. [2025-09-19T20:08:12.538140] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:08:12.538398] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-19T20:08:12.538446] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-19T20:08:12.539410] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-19T20:08:12.539470] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-19T20:08:12.648464] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-19T20:08:12.911385] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:13.443288] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-19T20:08:13.788406] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T20:08:14.221815] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T20:08:14.243231] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-19T20:08:14.628257] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T20:08:15.043318] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-19T20:08:15.344184] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T20:08:15.843273] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-19T20:08:16.643283] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-19T20:08:16.765377] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T20:08:17.443270] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-19T20:08:17.835750] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T20:08:17.944700] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T20:08:18.243239] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-19T20:08:18.556604] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T20:08:18.558880] [INFO ] [REMOTE ] MTD: Full fetch complete (21036 records). [2025-09-19T20:08:18.558962] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-19T20:08:18.951432] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-19T20:08:18.951514] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-19T20:08:18.951964] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-19T20:08:18.952046] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-19T20:08:18.952690] [DEBUG] [LOCAL ] MTD: Trimmed 21036 records to 15506 (keeping 200 days of data) [2025-09-19T20:08:19.044259] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-19T20:08:19.052567] [DEBUG] [LOCAL ] MTD: Primary data saved (15506 records). [2025-09-19T20:08:19.052794] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-19T20:08:19.052905] [INFO ] [MAIN ] Update Progress: 1418/2372 symbols completed. MTD took 21.3s. Estimated remaining: 2h 6m 39s. Rate: 7.5 symbols/min [2025-09-19T20:08:19.220427] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:19.262173] [DEBUG] [LOCAL ] MTN: Loaded 39301 existing records from primary storage. [2025-09-19T20:08:19.262324] [INFO ] [MAIN ] MTN: Loaded 39301 existing records. [2025-09-19T20:08:19.442091] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:08:19.442557] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-19T20:08:19.442614] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-19T20:08:19.443615] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-19T20:08:19.443701] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-19T20:08:19.814556] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:19.843278] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-19T20:08:20.279768] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T20:08:20.643318] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-19T20:08:20.914124] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T20:08:21.443304] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-19T20:08:21.715474] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T20:08:22.243360] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-19T20:08:22.304803] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T20:08:22.773632] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T20:08:23.043247] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-19T20:08:23.843261] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-19T20:08:23.987143] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T20:08:24.643265] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-19T20:08:25.045889] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T20:08:25.443269] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-19T20:08:25.796310] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T20:08:26.243271] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-19T20:08:26.425148] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T20:08:27.043283] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-19T20:08:27.190941] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T20:08:27.695808] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T20:08:27.843280] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-19T20:08:28.643274] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-19T20:08:28.858941] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T20:08:29.137090] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T20:08:29.443278] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-19T20:08:30.243278] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-19T20:08:30.285459] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T20:08:31.037583] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T20:08:31.047027] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-19T20:08:31.843206] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-19T20:08:32.237924] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T20:08:32.245790] [INFO ] [REMOTE ] MTG: Full fetch complete (73925 records). [2025-09-19T20:08:32.245961] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-19T20:08:32.659074] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-19T20:08:32.683610] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-19T20:08:32.683764] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-19T20:08:32.684993] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-19T20:08:32.685289] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-19T20:08:32.687227] [DEBUG] [LOCAL ] MTG: Trimmed 73925 records to 52129 (keeping 200 days of data) [2025-09-19T20:08:32.813325] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T20:08:33.058968] [DEBUG] [LOCAL ] MTG: Primary data saved (52129 records). [2025-09-19T20:08:33.059115] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-19T20:08:33.059272] [INFO ] [MAIN ] Update Progress: 1419/2372 symbols completed. MTG took 27.0s. Estimated remaining: 2h 6m 35s. Rate: 7.5 symbols/min [2025-09-19T20:08:33.225927] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:33.226147] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-19T20:08:33.226189] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-19T20:08:33.226327] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-19T20:08:33.226369] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-19T20:08:33.226408] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-19T20:08:33.226440] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-19T20:08:33.455292] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-19T20:08:33.591901] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:33.619317] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T20:08:34.243297] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-19T20:08:34.503736] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T20:08:34.904444] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T20:08:34.906022] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T20:08:35.043310] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-19T20:08:35.843269] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-19T20:08:36.643236] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-19T20:08:36.690492] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T20:08:37.209337] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T20:08:37.217320] [INFO ] [REMOTE ] MTDR: Full fetch complete (73347 records). [2025-09-19T20:08:37.217453] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-19T20:08:37.448595] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-19T20:08:37.612270] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-19T20:08:37.612354] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-19T20:08:37.613447] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-19T20:08:37.613524] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-19T20:08:37.614986] [DEBUG] [LOCAL ] MTDR: Trimmed 73347 records to 52334 (keeping 200 days of data) [2025-09-19T20:08:37.925614] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T20:08:37.951555] [DEBUG] [LOCAL ] MTDR: Primary data saved (52334 records). [2025-09-19T20:08:37.951746] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-19T20:08:37.951879] [INFO ] [MAIN ] Update Progress: 1420/2372 symbols completed. MTDR took 34.2s. Estimated remaining: 2h 6m 25s. Rate: 7.5 symbols/min [2025-09-19T20:08:38.120362] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:38.138633] [DEBUG] [LOCAL ] MTRN: Loaded 18110 existing records from primary storage. [2025-09-19T20:08:38.138781] [INFO ] [MAIN ] MTRN: Loaded 18110 existing records. [2025-09-19T20:08:38.246114] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-19T20:08:38.323732] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:08:38.324313] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-19T20:08:38.324487] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-19T20:08:38.325193] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-19T20:08:38.325264] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-19T20:08:38.526630] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T20:08:38.717598] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:39.043325] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-19T20:08:39.843319] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-19T20:08:40.029021] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T20:08:40.160760] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T20:08:40.643327] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-19T20:08:41.289479] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T20:08:41.443254] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-19T20:08:41.790446] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T20:08:42.243273] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-19T20:08:43.043309] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-19T20:08:43.211368] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T20:08:43.389392] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T20:08:43.679771] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-19T20:08:43.843261] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-19T20:08:44.280669] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-19T20:08:44.643316] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-19T20:08:45.443296] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-19T20:08:46.243295] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-19T20:08:46.367410] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T20:08:46.500833] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T20:08:47.043282] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-19T20:08:47.623137] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T20:08:47.629771] [INFO ] [REMOTE ] MTH: Full fetch complete (62387 records). [2025-09-19T20:08:47.629884] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-19T20:08:47.853792] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-19T20:08:48.028423] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-19T20:08:48.028513] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-19T20:08:48.029976] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-19T20:08:48.030054] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-19T20:08:48.034192] [DEBUG] [LOCAL ] MTH: Trimmed 62387 records to 44670 (keeping 200 days of data) [2025-09-19T20:08:48.176881] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T20:08:48.356751] [DEBUG] [LOCAL ] MTH: Primary data saved (44670 records). [2025-09-19T20:08:48.356892] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-19T20:08:48.357983] [INFO ] [MAIN ] Update Progress: 1421/2372 symbols completed. MTH took 36.2s. Estimated remaining: 2h 6m 19s. Rate: 7.5 symbols/min [2025-09-19T20:08:48.535985] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:48.569036] [DEBUG] [LOCAL ] MTUS: Loaded 29230 existing records from primary storage. [2025-09-19T20:08:48.569175] [INFO ] [MAIN ] MTUS: Loaded 29230 existing records. [2025-09-19T20:08:48.648392] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-19T20:08:48.757893] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:08:48.758162] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-19T20:08:48.758210] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-19T20:08:48.758979] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-19T20:08:48.759039] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-19T20:08:49.121520] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T20:08:49.156970] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-19T20:08:49.180817] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:49.443266] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-19T20:08:50.243234] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-19T20:08:50.667092] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T20:08:51.043300] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-19T20:08:51.129515] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T20:08:51.843266] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-19T20:08:52.017382] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T20:08:52.400132] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T20:08:52.643297] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-19T20:08:53.443273] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-19T20:08:54.243268] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-19T20:08:54.469877] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T20:08:54.479177] [INFO ] [REMOTE ] MTN: Full fetch complete (56254 records). [2025-09-19T20:08:54.479400] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-19T20:08:54.597406] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T20:08:54.892579] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-19T20:08:54.892695] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-19T20:08:54.893629] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-19T20:08:54.893745] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-19T20:08:54.895256] [DEBUG] [LOCAL ] MTN: Trimmed 56254 records to 39558 (keeping 200 days of data) [2025-09-19T20:08:55.088685] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-19T20:08:55.161786] [DEBUG] [LOCAL ] MTN: Primary data saved (39558 records). [2025-09-19T20:08:55.161923] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-19T20:08:55.162073] [INFO ] [MAIN ] Update Progress: 1422/2372 symbols completed. MTN took 36.1s. Estimated remaining: 2h 6m 10s. Rate: 7.5 symbols/min [2025-09-19T20:08:55.338443] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:55.368257] [DEBUG] [LOCAL ] MTW: Loaded 26862 existing records from primary storage. [2025-09-19T20:08:55.368392] [INFO ] [MAIN ] MTW: Loaded 26862 existing records. [2025-09-19T20:08:55.531664] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-19T20:08:55.553827] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:08:55.554420] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-19T20:08:55.554500] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-19T20:08:55.556199] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-19T20:08:55.556295] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-19T20:08:55.848429] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-19T20:08:55.912794] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:55.938300] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T20:08:56.643251] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-19T20:08:57.079899] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T20:08:57.443271] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-19T20:08:57.612434] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T20:08:57.980212] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-19T20:08:57.981033] [INFO ] [REMOTE ] MTR: Full fetch complete (2600 records). [2025-09-19T20:08:57.981105] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-19T20:08:58.161861] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T20:08:58.162055] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:08:58.162134] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:08:58.162197] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-19T20:08:58.162275] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-19T20:08:58.162331] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-19T20:08:58.162411] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-19T20:08:58.162482] [INFO ] [MAIN ] Update Progress: 1423/2372 symbols completed. MTR took 25.1s. Estimated remaining: 2h 5m 59s. Rate: 7.5 symbols/min [2025-09-19T20:08:58.248484] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-19T20:08:58.333817] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:08:58.361120] [DEBUG] [LOCAL ] MTX: Loaded 23011 existing records from primary storage. [2025-09-19T20:08:58.361243] [INFO ] [MAIN ] MTX: Loaded 23011 existing records. [2025-09-19T20:08:58.539095] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:08:58.539348] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-19T20:08:58.539395] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-19T20:08:58.540090] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-19T20:08:58.540149] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-19T20:08:58.897794] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:08:59.043213] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-19T20:08:59.660577] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T20:08:59.843264] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-19T20:09:00.643367] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-19T20:09:01.140738] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T20:09:01.443296] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-19T20:09:02.103528] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T20:09:02.243282] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-19T20:09:03.043308] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-19T20:09:03.316615] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T20:09:03.843328] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-19T20:09:04.405034] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (5.36 seconds). [2025-09-19T20:09:04.643232] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-19T20:09:05.195452] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (2.95 seconds). [2025-09-19T20:09:05.344970] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T20:09:05.443274] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-19T20:09:05.866877] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T20:09:06.243292] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-19T20:09:06.260230] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (3.22 seconds). [2025-09-19T20:09:06.263125] [INFO ] [REMOTE ] MTRN: Full fetch complete (23181 records). [2025-09-19T20:09:06.263201] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-19T20:09:06.636353] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-19T20:09:06.636495] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-19T20:09:06.637074] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-19T20:09:06.637135] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-19T20:09:06.637835] [DEBUG] [LOCAL ] MTRN: Trimmed 23181 records to 18229 (keeping 200 days of data) [2025-09-19T20:09:06.779669] [DEBUG] [LOCAL ] MTRN: Primary data saved (18229 records). [2025-09-19T20:09:06.779935] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-19T20:09:06.780061] [INFO ] [MAIN ] Update Progress: 1424/2372 symbols completed. MTRN took 28.8s. Estimated remaining: 2h 5m 51s. Rate: 7.5 symbols/min [2025-09-19T20:09:06.920246] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T20:09:06.977713] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:09:07.025485] [DEBUG] [LOCAL ] MTZ: Loaded 43951 existing records from primary storage. [2025-09-19T20:09:07.025683] [INFO ] [MAIN ] MTZ: Loaded 43951 existing records. [2025-09-19T20:09:07.048520] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-19T20:09:07.217034] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:09:07.217468] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-19T20:09:07.217527] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-19T20:09:07.218773] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-19T20:09:07.218833] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-19T20:09:07.569091] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:09:07.775822] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T20:09:07.843268] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-19T20:09:08.419710] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T20:09:08.643276] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-19T20:09:09.443278] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-19T20:09:09.685859] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T20:09:10.095780] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T20:09:10.243330] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-19T20:09:11.021996] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T20:09:11.043223] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-19T20:09:11.523196] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T20:09:11.843278] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-19T20:09:12.520270] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T20:09:12.643264] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-19T20:09:13.184184] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T20:09:13.443348] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-19T20:09:14.163760] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T20:09:14.243317] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-19T20:09:14.944231] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T20:09:15.043261] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-19T20:09:15.549451] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:09:15.843270] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-19T20:09:16.643306] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-19T20:09:17.316889] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-19T20:09:17.443218] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-19T20:09:17.772370] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T20:09:18.139401] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T20:09:18.243284] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-19T20:09:19.043268] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-19T20:09:19.277725] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T20:09:19.694364] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T20:09:19.843268] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-19T20:09:20.557372] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T20:09:20.643283] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-19T20:09:21.443252] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-19T20:09:21.835615] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T20:09:21.855607] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T20:09:21.859374] [INFO ] [REMOTE ] MTW: Full fetch complete (38453 records). [2025-09-19T20:09:21.859454] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-19T20:09:22.229294] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-19T20:09:22.229380] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-19T20:09:22.230068] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-19T20:09:22.230127] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-19T20:09:22.231064] [DEBUG] [LOCAL ] MTW: Trimmed 38453 records to 27033 (keeping 200 days of data) [2025-09-19T20:09:22.276997] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-19T20:09:22.384911] [DEBUG] [LOCAL ] MTW: Primary data saved (27033 records). [2025-09-19T20:09:22.385053] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-19T20:09:22.385155] [INFO ] [MAIN ] Update Progress: 1425/2372 symbols completed. MTW took 27.2s. Estimated remaining: 2h 5m 48s. Rate: 7.5 symbols/min [2025-09-19T20:09:22.558686] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:09:22.573985] [DEBUG] [LOCAL ] MUA: Loaded 12502 existing records from primary storage. [2025-09-19T20:09:22.574110] [INFO ] [MAIN ] MUA: Loaded 12502 existing records. [2025-09-19T20:09:22.751893] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:09:22.752296] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-19T20:09:22.752390] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-19T20:09:22.753488] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-19T20:09:22.753551] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-19T20:09:22.928890] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T20:09:23.052524] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-19T20:09:23.134190] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:09:23.843300] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-19T20:09:24.110956] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T20:09:24.476802] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T20:09:24.643260] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-19T20:09:25.309807] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T20:09:25.443261] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-19T20:09:26.190416] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T20:09:26.243282] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-19T20:09:26.783454] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T20:09:26.787073] [INFO ] [REMOTE ] MTX: Full fetch complete (31023 records). [2025-09-19T20:09:26.787173] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-19T20:09:27.048777] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-19T20:09:27.168073] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-19T20:09:27.168153] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-19T20:09:27.168811] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-19T20:09:27.168872] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-19T20:09:27.169590] [DEBUG] [LOCAL ] MTX: Trimmed 31023 records to 23151 (keeping 200 days of data) [2025-09-19T20:09:27.324531] [DEBUG] [LOCAL ] MTX: Primary data saved (23151 records). [2025-09-19T20:09:27.324685] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-19T20:09:27.324783] [INFO ] [MAIN ] Update Progress: 1426/2372 symbols completed. MTX took 29.2s. Estimated remaining: 2h 5m 38s. Rate: 7.5 symbols/min [2025-09-19T20:09:27.492670] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:09:27.513183] [DEBUG] [LOCAL ] MUC: Loaded 20267 existing records from primary storage. [2025-09-19T20:09:27.513325] [INFO ] [MAIN ] MUC: Loaded 20267 existing records. [2025-09-19T20:09:27.702562] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:09:27.703189] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-19T20:09:27.703356] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-19T20:09:27.709380] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-19T20:09:27.716584] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-19T20:09:27.723536] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T20:09:27.827731] [INFO ] [REMOTE ] MTUS: Full fetch complete (42936 records). [2025-09-19T20:09:27.830232] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-19T20:09:27.848885] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-19T20:09:28.375263] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:09:28.472276] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-19T20:09:28.472365] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-19T20:09:28.473056] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-19T20:09:28.473140] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-19T20:09:28.474159] [DEBUG] [LOCAL ] MTUS: Trimmed 42936 records to 29399 (keeping 200 days of data) [2025-09-19T20:09:28.644467] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-19T20:09:28.655886] [DEBUG] [LOCAL ] MTUS: Primary data saved (29399 records). [2025-09-19T20:09:28.655974] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-19T20:09:28.656070] [INFO ] [MAIN ] Update Progress: 1427/2372 symbols completed. MTUS took 40.3s. Estimated remaining: 2h 5m 26s. Rate: 7.5 symbols/min [2025-09-19T20:09:28.827415] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:09:28.840560] [DEBUG] [LOCAL ] MUE: Loaded 12020 existing records from primary storage. [2025-09-19T20:09:28.840707] [INFO ] [MAIN ] MUE: Loaded 12020 existing records. [2025-09-19T20:09:29.044112] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T20:09:29.042883] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:09:29.048082] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-19T20:09:29.048279] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-19T20:09:29.058263] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-19T20:09:29.070746] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-19T20:09:29.080378] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-19T20:09:29.443229] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-19T20:09:29.465070] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:09:30.243290] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-19T20:09:30.268179] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T20:09:30.489284] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T20:09:31.043302] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-19T20:09:31.397712] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T20:09:31.712330] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T20:09:31.843319] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-19T20:09:32.643309] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-19T20:09:33.443312] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-19T20:09:33.506321] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T20:09:33.587187] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T20:09:34.243276] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-19T20:09:34.306592] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T20:09:35.043268] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-19T20:09:35.057430] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T20:09:35.843269] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-19T20:09:36.192859] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T20:09:36.643297] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-19T20:09:37.029479] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T20:09:37.443340] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-19T20:09:38.243310] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-19T20:09:38.584342] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T20:09:38.658919] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T20:09:38.994403] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T20:09:39.043221] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-19T20:09:39.843271] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-19T20:09:39.920921] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-19T20:09:40.643268] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-19T20:09:40.777334] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T20:09:41.443310] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-19T20:09:41.554104] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T20:09:42.243310] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-19T20:09:42.452743] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T20:09:43.043305] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-19T20:09:43.576443] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T20:09:43.843260] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-19T20:09:44.001742] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T20:09:44.643268] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-19T20:09:45.443281] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-19T20:09:45.740204] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T20:09:45.817281] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T20:09:46.243256] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-19T20:09:46.585593] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T20:09:47.043311] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-19T20:09:47.331215] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T20:09:47.843263] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-19T20:09:47.954983] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T20:09:48.643276] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-19T20:09:48.658947] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T20:09:49.443267] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-19T20:09:49.477771] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T20:09:50.243273] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-19T20:09:51.043328] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-19T20:09:51.353852] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T20:09:51.356251] [INFO ] [REMOTE ] MUE: Full fetch complete (16322 records). [2025-09-19T20:09:51.356325] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-19T20:09:51.503052] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T20:09:51.643515] [INFO ] [REMOTE ] MTZ: Full fetch complete (63432 records). [2025-09-19T20:09:51.660476] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-19T20:09:51.848376] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-19T20:09:51.905603] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-19T20:09:51.918518] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-19T20:09:51.919192] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-19T20:09:51.919693] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-19T20:09:51.990367] [DEBUG] [LOCAL ] MUE: Trimmed 16322 records to 12087 (keeping 200 days of data) [2025-09-19T20:09:52.040192] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-19T20:09:52.322885] [DEBUG] [LOCAL ] MUE: Primary data saved (12087 records). [2025-09-19T20:09:52.323128] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-19T20:09:52.323228] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-19T20:09:52.323363] [INFO ] [MAIN ] Update Progress: 1428/2372 symbols completed. MUE took 23.7s. Estimated remaining: 2h 5m 28s. Rate: 7.5 symbols/min [2025-09-19T20:09:52.323762] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-19T20:09:52.370826] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-19T20:09:52.398211] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-19T20:09:52.479703] [DEBUG] [LOCAL ] MTZ: Trimmed 63432 records to 44264 (keeping 200 days of data) [2025-09-19T20:09:52.512029] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:09:52.643592] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-19T20:09:52.704934] [DEBUG] [LOCAL ] MUFG: Loaded 53032 existing records from primary storage. [2025-09-19T20:09:52.759759] [INFO ] [MAIN ] MUFG: Loaded 53032 existing records. [2025-09-19T20:09:52.958971] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T20:09:53.029103] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:09:53.042154] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-19T20:09:53.044522] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-19T20:09:53.046596] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-19T20:09:53.047809] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-19T20:09:53.447030] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-19T20:09:53.478890] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:09:53.481850] [DEBUG] [LOCAL ] MTZ: Primary data saved (44264 records). [2025-09-19T20:09:53.481955] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-19T20:09:53.482050] [INFO ] [MAIN ] Update Progress: 1429/2372 symbols completed. MTZ took 46.7s. Estimated remaining: 2h 5m 16s. Rate: 7.5 symbols/min [2025-09-19T20:09:53.656616] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:09:53.667772] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T20:09:53.671600] [INFO ] [REMOTE ] MUC: Full fetch complete (30059 records). [2025-09-19T20:09:53.671763] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-19T20:09:53.793980] [DEBUG] [LOCAL ] MUJ: Loaded 13307 existing records from primary storage. [2025-09-19T20:09:53.804385] [INFO ] [MAIN ] MUJ: Loaded 13307 existing records. [2025-09-19T20:09:54.201828] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:09:54.260708] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-19T20:09:54.260887] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-19T20:09:54.261265] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-19T20:09:54.293029] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-19T20:09:54.293296] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-19T20:09:54.294337] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-19T20:09:54.294435] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-19T20:09:54.294522] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-19T20:09:54.294996] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-19T20:09:54.329572] [DEBUG] [LOCAL ] MUC: Trimmed 30059 records to 20455 (keeping 200 days of data) [2025-09-19T20:09:54.697211] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T20:09:54.823275] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:09:54.836767] [DEBUG] [LOCAL ] MUC: Primary data saved (20455 records). [2025-09-19T20:09:54.836913] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-19T20:09:54.837001] [INFO ] [MAIN ] Update Progress: 1430/2372 symbols completed. MUC took 27.5s. Estimated remaining: 2h 5m 3s. Rate: 7.5 symbols/min [2025-09-19T20:09:55.008745] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:09:55.048945] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-19T20:09:55.072214] [DEBUG] [LOCAL ] MUR: Loaded 53332 existing records from primary storage. [2025-09-19T20:09:55.072361] [INFO ] [MAIN ] MUR: Loaded 53332 existing records. [2025-09-19T20:09:55.254010] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:09:55.254315] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-19T20:09:55.254368] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-19T20:09:55.255684] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-19T20:09:55.255748] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-19T20:09:55.624615] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:09:55.843287] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-19T20:09:56.152032] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T20:09:56.154337] [INFO ] [REMOTE ] MUA: Full fetch complete (18688 records). [2025-09-19T20:09:56.154413] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-19T20:09:56.498499] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T20:09:56.596804] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-19T20:09:56.596892] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-19T20:09:56.597372] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-19T20:09:56.597413] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-19T20:09:56.598052] [DEBUG] [LOCAL ] MUA: Trimmed 18688 records to 12547 (keeping 200 days of data) [2025-09-19T20:09:56.653073] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-19T20:09:56.680160] [DEBUG] [LOCAL ] MUA: Primary data saved (12547 records). [2025-09-19T20:09:56.680321] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-19T20:09:56.680431] [INFO ] [MAIN ] Update Progress: 1431/2372 symbols completed. MUA took 34.3s. Estimated remaining: 2h 4m 51s. Rate: 7.5 symbols/min [2025-09-19T20:09:56.857022] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:09:56.883748] [DEBUG] [LOCAL ] MUSA: Loaded 25316 existing records from primary storage. [2025-09-19T20:09:56.883890] [INFO ] [MAIN ] MUSA: Loaded 25316 existing records. [2025-09-19T20:09:57.077132] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:09:57.077428] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-19T20:09:57.077478] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-19T20:09:57.078345] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-19T20:09:57.078411] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-19T20:09:57.442094] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:09:57.443214] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-19T20:09:57.648596] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T20:09:57.966491] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T20:09:58.243258] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-19T20:09:58.694541] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T20:09:59.043285] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-19T20:09:59.543936] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T20:09:59.843242] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-19T20:10:00.341130] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T20:10:00.623915] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-19T20:10:00.643255] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-19T20:10:01.443272] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-19T20:10:01.575558] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T20:10:02.243347] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-19T20:10:03.043309] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-19T20:10:03.165173] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T20:10:03.382816] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T20:10:03.843318] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-19T20:10:04.612286] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T20:10:04.643236] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-19T20:10:05.443297] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-19T20:10:05.889064] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T20:10:06.008838] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T20:10:06.243295] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-19T20:10:07.043287] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-19T20:10:07.362549] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T20:10:07.463944] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T20:10:07.843270] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-19T20:10:08.643290] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-19T20:10:09.134321] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T20:10:09.224744] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T20:10:09.443229] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-19T20:10:10.028440] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T20:10:10.243292] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-19T20:10:11.040883] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T20:10:11.046738] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-19T20:10:11.843230] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-19T20:10:12.643251] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-19T20:10:12.717910] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T20:10:13.227602] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T20:10:13.290577] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T20:10:13.443232] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-19T20:10:13.870685] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T20:10:14.243263] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-19T20:10:15.043258] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-19T20:10:15.552084] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T20:10:15.843260] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-19T20:10:16.175505] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T20:10:16.216783] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T20:10:16.643287] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-19T20:10:17.443297] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-19T20:10:17.832756] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T20:10:17.900329] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T20:10:18.243234] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-19T20:10:18.767734] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T20:10:19.043276] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-19T20:10:19.420458] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T20:10:19.843241] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-19T20:10:20.406150] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T20:10:20.643262] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-19T20:10:21.019423] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T20:10:21.023589] [INFO ] [REMOTE ] MUJ: Full fetch complete (20432 records). [2025-09-19T20:10:21.023729] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-19T20:10:21.409098] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-19T20:10:21.409182] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-19T20:10:21.409609] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-19T20:10:21.409670] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-19T20:10:21.410308] [DEBUG] [LOCAL ] MUJ: Trimmed 20432 records to 13376 (keeping 200 days of data) [2025-09-19T20:10:21.450684] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-19T20:10:21.495478] [DEBUG] [LOCAL ] MUJ: Primary data saved (13376 records). [2025-09-19T20:10:21.495625] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-19T20:10:21.495750] [INFO ] [MAIN ] Update Progress: 1432/2372 symbols completed. MUJ took 28.0s. Estimated remaining: 2h 4m 55s. Rate: 7.5 symbols/min [2025-09-19T20:10:21.676835] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:10:21.677042] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-19T20:10:21.677098] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-19T20:10:21.677260] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-19T20:10:21.677308] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-19T20:10:21.677350] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-19T20:10:21.677381] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-19T20:10:22.046958] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:10:22.058054] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T20:10:22.062085] [INFO ] [REMOTE ] MUSA: Full fetch complete (35006 records). [2025-09-19T20:10:22.062167] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-19T20:10:22.248367] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-19T20:10:22.437397] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-19T20:10:22.437486] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-19T20:10:22.438251] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-19T20:10:22.438315] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-19T20:10:22.439317] [DEBUG] [LOCAL ] MUSA: Trimmed 35006 records to 25473 (keeping 200 days of data) [2025-09-19T20:10:22.596863] [DEBUG] [LOCAL ] MUSA: Primary data saved (25473 records). [2025-09-19T20:10:22.597008] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-19T20:10:22.597097] [INFO ] [MAIN ] Update Progress: 1433/2372 symbols completed. MUSA took 25.9s. Estimated remaining: 2h 4m 42s. Rate: 7.5 symbols/min [2025-09-19T20:10:22.772731] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:10:22.822518] [DEBUG] [LOCAL ] MUX: Loaded 42565 existing records from primary storage. [2025-09-19T20:10:22.822704] [INFO ] [MAIN ] MUX: Loaded 42565 existing records. [2025-09-19T20:10:23.002877] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:10:23.003168] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-19T20:10:23.003234] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-19T20:10:23.004284] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-19T20:10:23.004350] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-19T20:10:23.066818] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-19T20:10:23.361251] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:10:23.399498] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-19T20:10:23.497843] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T20:10:23.843286] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-19T20:10:24.092855] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:10:24.093235] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-19T20:10:24.455841] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T20:10:24.643301] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-19T20:10:25.443282] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-19T20:10:26.243574] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-19T20:10:26.251289] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T20:10:27.043282] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-19T20:10:27.122677] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T20:10:27.843279] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-19T20:10:28.093434] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:10:28.093867] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-19T20:10:28.393943] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T20:10:28.551934] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T20:10:28.643233] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-19T20:10:29.443264] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-19T20:10:30.243252] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-19T20:10:30.306557] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T20:10:31.043251] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-19T20:10:31.466677] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T20:10:31.843329] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-19T20:10:32.229730] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T20:10:32.237602] [INFO ] [REMOTE ] MUFG: Full fetch complete (75420 records). [2025-09-19T20:10:32.237810] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-19T20:10:32.643808] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-19T20:10:32.662801] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-19T20:10:32.662884] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-19T20:10:32.663938] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-19T20:10:32.664102] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-19T20:10:32.665769] [DEBUG] [LOCAL ] MUFG: Trimmed 75420 records to 53408 (keeping 200 days of data) [2025-09-19T20:10:32.929983] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T20:10:32.993001] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-19T20:10:33.035216] [DEBUG] [LOCAL ] MUFG: Primary data saved (53408 records). [2025-09-19T20:10:33.035328] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-19T20:10:33.035705] [INFO ] [MAIN ] Update Progress: 1434/2372 symbols completed. MUFG took 40.7s. Estimated remaining: 2h 4m 36s. Rate: 7.5 symbols/min [2025-09-19T20:10:33.210260] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:10:33.226632] [DEBUG] [LOCAL ] MVF: Loaded 13036 existing records from primary storage. [2025-09-19T20:10:33.226793] [INFO ] [MAIN ] MVF: Loaded 13036 existing records. [2025-09-19T20:10:33.421555] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:10:33.421905] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-19T20:10:33.421981] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-19T20:10:33.422517] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-19T20:10:33.422582] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-19T20:10:33.455587] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-19T20:10:33.799803] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:10:33.821692] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T20:10:33.830089] [INFO ] [REMOTE ] MUR: Full fetch complete (76310 records). [2025-09-19T20:10:33.830270] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-19T20:10:34.225234] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-19T20:10:34.225330] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-19T20:10:34.226371] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-19T20:10:34.226437] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-19T20:10:34.228038] [DEBUG] [LOCAL ] MUR: Trimmed 76310 records to 53713 (keeping 200 days of data) [2025-09-19T20:10:34.282225] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-19T20:10:34.571052] [DEBUG] [LOCAL ] MUR: Primary data saved (53713 records). [2025-09-19T20:10:34.571222] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-19T20:10:34.571330] [INFO ] [MAIN ] Update Progress: 1435/2372 symbols completed. MUR took 39.7s. Estimated remaining: 2h 4m 24s. Rate: 7.5 symbols/min [2025-09-19T20:10:34.651774] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-19T20:10:34.753833] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:10:34.765534] [DEBUG] [LOCAL ] MVO: Loaded 9152 existing records from primary storage. [2025-09-19T20:10:34.765676] [INFO ] [MAIN ] MVO: Loaded 9152 existing records. [2025-09-19T20:10:34.946043] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:10:34.946349] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-19T20:10:34.946405] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-19T20:10:34.946779] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-19T20:10:34.946853] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-19T20:10:35.049466] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-19T20:10:35.318080] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:10:35.342351] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T20:10:35.353455] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-19T20:10:35.843266] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-19T20:10:36.643284] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-19T20:10:36.824867] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T20:10:37.443233] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-19T20:10:37.859055] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T20:10:38.243262] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-19T20:10:38.375555] [DEBUG] [REMOTE ] MVO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-19T20:10:38.375891] [WARN ] [REMOTE ] MVO: No data returned for month 2025-01 [2025-09-19T20:10:38.910343] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T20:10:39.043257] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-19T20:10:39.843280] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-19T20:10:40.020289] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T20:10:40.643308] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-19T20:10:40.859495] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T20:10:41.443292] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-19T20:10:41.689793] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-19T20:10:42.207755] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T20:10:42.243297] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-19T20:10:43.043302] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-19T20:10:43.173203] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T20:10:43.312704] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-19T20:10:43.843286] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-19T20:10:44.643271] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-19T20:10:44.771015] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T20:10:44.891190] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-19T20:10:45.443296] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-19T20:10:46.243271] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-19T20:10:46.360463] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T20:10:47.043273] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-19T20:10:47.172262] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T20:10:47.843286] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-19T20:10:47.964069] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T20:10:48.643288] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-19T20:10:49.099604] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:10:49.100081] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-19T20:10:49.100191] [INFO ] [REMOTE ] MUSE: Full fetch complete (104 records). [2025-09-19T20:10:49.100281] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-19T20:10:49.101051] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:10:49.101141] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:10:49.101226] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:10:49.101316] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-19T20:10:49.101432] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-19T20:10:49.101492] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-19T20:10:49.101560] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-19T20:10:49.101675] [INFO ] [MAIN ] Update Progress: 1436/2372 symbols completed. MUSE took 27.6s. Estimated remaining: 2h 4m 20s. Rate: 7.5 symbols/min [2025-09-19T20:10:49.315234] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:10:49.329190] [DEBUG] [LOCAL ] MVT: Loaded 10161 existing records from primary storage. [2025-09-19T20:10:49.329314] [INFO ] [MAIN ] MVT: Loaded 10161 existing records. [2025-09-19T20:10:49.448344] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-19T20:10:49.518522] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:10:49.519142] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-19T20:10:49.519337] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-19T20:10:49.520134] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-19T20:10:49.520252] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-19T20:10:49.850305] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T20:10:49.944107] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:10:50.243281] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-19T20:10:50.447888] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T20:10:50.909313] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T20:10:51.043295] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-19T20:10:51.843270] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-19T20:10:52.161296] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T20:10:52.643269] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-19T20:10:53.245353] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T20:10:53.443285] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-19T20:10:53.572848] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T20:10:54.243318] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-19T20:10:55.043268] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-19T20:10:55.172777] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T20:10:55.405992] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T20:10:55.413455] [INFO ] [REMOTE ] MUX: Full fetch complete (58523 records). [2025-09-19T20:10:55.413587] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-19T20:10:55.792830] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-19T20:10:55.792963] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-19T20:10:55.793841] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-19T20:10:55.793904] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-19T20:10:55.795153] [DEBUG] [LOCAL ] MUX: Trimmed 58523 records to 42940 (keeping 200 days of data) [2025-09-19T20:10:55.849820] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-19T20:10:55.906308] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T20:10:56.058832] [DEBUG] [LOCAL ] MUX: Primary data saved (42940 records). [2025-09-19T20:10:56.058970] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-19T20:10:56.059108] [INFO ] [MAIN ] Update Progress: 1437/2372 symbols completed. MUX took 33.5s. Estimated remaining: 2h 4m 11s. Rate: 7.5 symbols/min [2025-09-19T20:10:56.643237] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-19T20:10:57.033625] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T20:10:57.443239] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-19T20:10:57.602217] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T20:10:57.603979] [INFO ] [REMOTE ] MVO: Full fetch complete (12262 records). [2025-09-19T20:10:57.604051] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-19T20:10:57.782404] [WARN ] [VALIDATOR ] MVO: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T20:10:57.782758] [FATAL] [MAIN ] MVO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:10:57.782848] [WARN ] [MAIN ] MVO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:10:57.782943] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-19T20:10:57.783042] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-09-19T20:10:57.783100] [INFO ] [LOCAL ] MVO: Starting deletion of derivative data. [2025-09-19T20:10:57.783616] [DEBUG] [LOCAL ] MVO: Deleted derivative data file. [2025-09-19T20:10:57.783788] [INFO ] [MAIN ] Update Progress: 1438/2372 symbols completed. MVO took 23.2s. Estimated remaining: 2h 3m 59s. Rate: 7.5 symbols/min [2025-09-19T20:10:58.243262] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-19T20:10:58.389236] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T20:10:59.043285] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-19T20:10:59.420020] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T20:10:59.792494] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T20:10:59.843253] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-19T20:11:00.643289] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-19T20:11:00.905798] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T20:11:01.284277] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-19T20:11:01.443318] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-19T20:11:02.243334] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-19T20:11:02.552726] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T20:11:02.555689] [INFO ] [REMOTE ] MVF: Full fetch complete (19199 records). [2025-09-19T20:11:02.555766] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-19T20:11:02.945109] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-19T20:11:02.945190] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-19T20:11:02.945626] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-19T20:11:02.945722] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-19T20:11:02.946415] [DEBUG] [LOCAL ] MVF: Trimmed 19199 records to 13078 (keeping 200 days of data) [2025-09-19T20:11:03.026172] [DEBUG] [LOCAL ] MVF: Primary data saved (13078 records). [2025-09-19T20:11:03.026307] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-19T20:11:03.026406] [INFO ] [MAIN ] Update Progress: 1439/2372 symbols completed. MVF took 30.0s. Estimated remaining: 2h 3m 49s. Rate: 7.5 symbols/min [2025-09-19T20:11:03.264480] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T20:11:03.267802] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-19T20:11:04.172306] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T20:11:04.175191] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-19T20:11:05.149348] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T20:11:05.152843] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-19T20:11:06.097068] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T20:11:06.099541] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-19T20:11:07.018457] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T20:11:07.021359] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-19T20:11:08.059678] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T20:11:08.062616] [INFO ] [REMOTE ] MVT: Full fetch complete (14586 records). [2025-09-19T20:11:08.062717] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-19T20:11:08.423174] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-19T20:11:08.423257] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-19T20:11:08.423573] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-19T20:11:08.423611] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-19T20:11:08.424113] [DEBUG] [LOCAL ] MVT: Trimmed 14586 records to 10194 (keeping 200 days of data) [2025-09-19T20:11:08.486065] [DEBUG] [LOCAL ] MVT: Primary data saved (10194 records). [2025-09-19T20:11:08.486196] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-19T20:11:08.486301] [INFO ] [MAIN ] Update Progress: 1440/2372 symbols completed. MVT took 19.4s. Estimated remaining: 2h 3m 40s. Rate: 7.5 symbols/min [2025-09-19T20:11:09.117492] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:09.206374] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-19T20:11:09.210276] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:09.204838] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:09.206254] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:09.210457] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-19T20:11:09.212226] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-19T20:11:09.212297] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-19T20:11:09.212548] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-19T20:11:09.212612] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-19T20:11:09.331607] [DEBUG] [LOCAL ] MXF: Loaded 6134 existing records from primary storage. [2025-09-19T20:11:09.348808] [INFO ] [MAIN ] MXF: Loaded 6134 existing records. [2025-09-19T20:11:09.422081] [DEBUG] [LOCAL ] MX: Loaded 23141 existing records from primary storage. [2025-09-19T20:11:09.466720] [INFO ] [MAIN ] MX: Loaded 23141 existing records. [2025-09-19T20:11:09.808821] [DEBUG] [LOCAL ] MWA: Loaded 47595 existing records from primary storage. [2025-09-19T20:11:09.871967] [INFO ] [MAIN ] MWA: Loaded 47595 existing records. [2025-09-19T20:11:09.981883] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:10.033093] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:11:10.044066] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-19T20:11:10.096314] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-19T20:11:10.122037] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-19T20:11:10.114492] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:11:10.137137] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-19T20:11:10.137252] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-19T20:11:10.137064] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-19T20:11:10.208036] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-19T20:11:10.314981] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-19T20:11:10.321736] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-19T20:11:10.329716] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:11:10.408900] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-19T20:11:10.465980] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-19T20:11:10.527204] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-19T20:11:10.544428] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-19T20:11:10.917997] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T20:11:11.037671] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-19T20:11:11.108269] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:11.138098] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-19T20:11:11.259012] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:11.277582] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-19T20:11:11.381915] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:11.382251] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-19T20:11:11.645244] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-19T20:11:11.646740] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-19T20:11:12.122519] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-19T20:11:12.124035] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-19T20:11:12.133747] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T20:11:12.571274] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-19T20:11:12.596076] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T20:11:12.643232] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-19T20:11:13.150792] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T20:11:13.443269] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-19T20:11:13.854512] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T20:11:14.243315] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-19T20:11:15.043307] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-19T20:11:15.125355] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T20:11:15.512551] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T20:11:15.843265] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-19T20:11:16.102757] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T20:11:16.643269] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-19T20:11:17.373527] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T20:11:17.427484] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T20:11:17.443278] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-19T20:11:18.243373] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-19T20:11:18.330739] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T20:11:19.043280] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-19T20:11:19.843241] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-19T20:11:20.153621] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T20:11:20.236810] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T20:11:20.368299] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T20:11:20.643266] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-19T20:11:21.199119] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T20:11:21.443276] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-19T20:11:21.958435] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T20:11:22.243281] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-19T20:11:23.043262] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-19T20:11:23.491191] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T20:11:23.684613] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T20:11:23.843264] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-19T20:11:24.643269] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-19T20:11:25.443262] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-19T20:11:25.775115] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T20:11:25.950551] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T20:11:26.243284] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-19T20:11:26.372727] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T20:11:26.846745] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T20:11:27.043270] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-19T20:11:27.754591] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T20:11:27.843269] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-19T20:11:28.364571] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T20:11:28.643271] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-19T20:11:29.443246] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-19T20:11:29.887257] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T20:11:30.181492] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T20:11:30.182566] [INFO ] [REMOTE ] MXE: Full fetch complete (2686 records). [2025-09-19T20:11:30.182635] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-19T20:11:30.248419] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-19T20:11:30.363755] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T20:11:30.363959] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:11:30.364040] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:11:30.364114] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-19T20:11:30.364193] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-19T20:11:30.364248] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-19T20:11:30.364350] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-19T20:11:30.364435] [INFO ] [MAIN ] Update Progress: 1441/2372 symbols completed. MXE took 21.9s. Estimated remaining: 2h 3m 41s. Rate: 7.5 symbols/min [2025-09-19T20:11:30.584062] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:30.605384] [DEBUG] [LOCAL ] MYD: Loaded 13935 existing records from primary storage. [2025-09-19T20:11:30.605521] [INFO ] [MAIN ] MYD: Loaded 13935 existing records. [2025-09-19T20:11:30.791928] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:11:30.792241] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-19T20:11:30.792333] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-19T20:11:30.792792] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-19T20:11:30.792875] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-19T20:11:31.051300] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-19T20:11:31.206167] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:31.578170] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T20:11:31.843281] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-19T20:11:32.643272] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-19T20:11:32.932212] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T20:11:33.419140] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T20:11:33.443215] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-19T20:11:33.909627] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T20:11:34.243322] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-19T20:11:34.605396] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T20:11:34.609703] [INFO ] [REMOTE ] MX: Full fetch complete (31726 records). [2025-09-19T20:11:34.609821] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-19T20:11:34.976894] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-19T20:11:34.976985] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-19T20:11:34.977609] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-19T20:11:34.977691] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-19T20:11:34.978702] [DEBUG] [LOCAL ] MX: Trimmed 31726 records to 23271 (keeping 200 days of data) [2025-09-19T20:11:35.064369] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-19T20:11:35.120371] [DEBUG] [LOCAL ] MX: Primary data saved (23271 records). [2025-09-19T20:11:35.120501] [INFO ] [MAIN ] MX: Full history saved. [2025-09-19T20:11:35.120596] [INFO ] [MAIN ] Update Progress: 1442/2372 symbols completed. MX took 26.6s. Estimated remaining: 2h 3m 31s. Rate: 7.5 symbols/min [2025-09-19T20:11:35.301804] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:35.334215] [DEBUG] [LOCAL ] MYE: Loaded 25748 existing records from primary storage. [2025-09-19T20:11:35.334427] [INFO ] [MAIN ] MYE: Loaded 25748 existing records. [2025-09-19T20:11:35.513718] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:11:35.514043] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-19T20:11:35.514114] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-19T20:11:35.515072] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-19T20:11:35.515142] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-19T20:11:35.846456] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-19T20:11:35.878810] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:35.987837] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T20:11:36.039873] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T20:11:36.643278] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-19T20:11:36.660516] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T20:11:37.443291] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-19T20:11:38.243333] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-19T20:11:38.451339] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T20:11:38.810018] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T20:11:39.043274] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-19T20:11:39.843316] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-19T20:11:40.063268] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T20:11:40.169287] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T20:11:40.482240] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-19T20:11:40.643288] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-19T20:11:41.443293] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-19T20:11:42.059241] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T20:11:42.060571] [INFO ] [REMOTE ] MXF: Full fetch complete (10561 records). [2025-09-19T20:11:42.060687] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-19T20:11:42.246011] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-19T20:11:42.408109] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T20:11:42.506859] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-19T20:11:42.506965] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-19T20:11:42.507350] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-19T20:11:42.507393] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-19T20:11:42.508016] [DEBUG] [LOCAL ] MXF: Trimmed 10561 records to 6145 (keeping 200 days of data) [2025-09-19T20:11:42.552546] [DEBUG] [LOCAL ] MXF: Primary data saved (6145 records). [2025-09-19T20:11:42.552736] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-19T20:11:42.552903] [INFO ] [MAIN ] Update Progress: 1443/2372 symbols completed. MXF took 34.1s. Estimated remaining: 2h 3m 23s. Rate: 7.5 symbols/min [2025-09-19T20:11:42.725935] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:42.753990] [DEBUG] [LOCAL ] MYI: Loaded 19575 existing records from primary storage. [2025-09-19T20:11:42.754141] [INFO ] [MAIN ] MYI: Loaded 19575 existing records. [2025-09-19T20:11:42.933698] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:11:42.933976] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-19T20:11:42.934027] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-19T20:11:42.934838] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-19T20:11:42.934901] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-19T20:11:43.048496] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-19T20:11:43.294754] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:43.511757] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T20:11:43.843318] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-19T20:11:44.643308] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-19T20:11:44.810450] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T20:11:44.889150] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T20:11:45.374043] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T20:11:45.443243] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-19T20:11:46.243328] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-19T20:11:46.932865] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T20:11:47.043286] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-19T20:11:47.289037] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T20:11:47.843301] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-19T20:11:48.643286] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-19T20:11:48.806967] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T20:11:48.813862] [INFO ] [REMOTE ] MWA: Full fetch complete (67850 records). [2025-09-19T20:11:48.813978] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-19T20:11:49.005515] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T20:11:49.229225] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-19T20:11:49.229322] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-19T20:11:49.230312] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-19T20:11:49.230379] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-19T20:11:49.231791] [DEBUG] [LOCAL ] MWA: Trimmed 67850 records to 47924 (keeping 200 days of data) [2025-09-19T20:11:49.453507] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-19T20:11:49.546303] [DEBUG] [LOCAL ] MWA: Primary data saved (47924 records). [2025-09-19T20:11:49.546451] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-19T20:11:49.546580] [INFO ] [MAIN ] Update Progress: 1444/2372 symbols completed. MWA took 41.1s. Estimated remaining: 2h 3m 14s. Rate: 7.5 symbols/min [2025-09-19T20:11:49.758381] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:49.773591] [DEBUG] [LOCAL ] MYN: Loaded 10499 existing records from primary storage. [2025-09-19T20:11:49.773752] [INFO ] [MAIN ] MYN: Loaded 10499 existing records. [2025-09-19T20:11:49.953693] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:11:49.954201] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-19T20:11:49.954260] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-19T20:11:49.954802] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-19T20:11:49.954861] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-19T20:11:50.243791] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-19T20:11:50.322565] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:50.341045] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T20:11:50.425970] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T20:11:51.043279] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-19T20:11:51.657076] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T20:11:51.843293] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-19T20:11:52.332227] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T20:11:52.643274] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-19T20:11:52.661924] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-19T20:11:52.664441] [INFO ] [REMOTE ] MYD: Full fetch complete (20964 records). [2025-09-19T20:11:52.664514] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-19T20:11:53.029912] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-19T20:11:53.030001] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-19T20:11:53.030444] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-19T20:11:53.030482] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-19T20:11:53.031090] [DEBUG] [LOCAL ] MYD: Trimmed 20964 records to 13981 (keeping 200 days of data) [2025-09-19T20:11:53.121506] [DEBUG] [LOCAL ] MYD: Primary data saved (13981 records). [2025-09-19T20:11:53.121661] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-19T20:11:53.121798] [INFO ] [MAIN ] Update Progress: 1445/2372 symbols completed. MYD took 22.8s. Estimated remaining: 2h 3m 3s. Rate: 7.5 symbols/min [2025-09-19T20:11:53.299542] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:11:53.351936] [DEBUG] [LOCAL ] NABL: Loaded 40697 existing records from primary storage. [2025-09-19T20:11:53.352098] [INFO ] [MAIN ] NABL: Loaded 40697 existing records. [2025-09-19T20:11:53.448409] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-19T20:11:53.533973] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:11:53.534280] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-19T20:11:53.534348] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-19T20:11:53.535516] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-19T20:11:53.535581] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-19T20:11:53.664851] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T20:11:53.943623] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:11:54.243311] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-19T20:11:54.640813] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T20:11:55.043302] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-19T20:11:55.776911] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T20:11:55.843283] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-19T20:11:56.001398] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T20:11:56.643332] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-19T20:11:57.108334] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T20:11:57.443263] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-19T20:11:57.574813] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T20:11:58.243279] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-19T20:11:58.709333] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T20:11:59.043262] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-19T20:11:59.393332] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T20:11:59.843240] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-19T20:12:00.259966] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T20:12:00.643280] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-19T20:12:01.225489] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T20:12:01.443272] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-19T20:12:01.741900] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T20:12:02.243279] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-19T20:12:03.043319] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-19T20:12:03.843241] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-19T20:12:04.482785] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-19T20:12:04.643261] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-19T20:12:05.223501] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T20:12:05.339339] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (3.10 seconds). [2025-09-19T20:12:05.343081] [INFO ] [REMOTE ] MYE: Full fetch complete (37109 records). [2025-09-19T20:12:05.343197] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-19T20:12:05.443864] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-19T20:12:05.751608] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T20:12:05.751806] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-19T20:12:05.756441] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-19T20:12:05.757461] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-19T20:12:05.757521] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-19T20:12:05.758447] [DEBUG] [LOCAL ] MYE: Trimmed 37109 records to 25917 (keeping 200 days of data) [2025-09-19T20:12:05.926376] [DEBUG] [LOCAL ] MYE: Primary data saved (25917 records). [2025-09-19T20:12:05.926518] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-19T20:12:05.926605] [INFO ] [MAIN ] Update Progress: 1446/2372 symbols completed. MYE took 30.8s. Estimated remaining: 2h 2m 58s. Rate: 7.5 symbols/min [2025-09-19T20:12:06.096341] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:12:06.120893] [DEBUG] [LOCAL ] NAC: Loaded 25000 existing records from primary storage. [2025-09-19T20:12:06.121039] [INFO ] [MAIN ] NAC: Loaded 25000 existing records. [2025-09-19T20:12:06.248385] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-19T20:12:06.304163] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:12:06.304475] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-19T20:12:06.304584] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-19T20:12:06.305512] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-19T20:12:06.305575] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-19T20:12:06.628511] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T20:12:06.686123] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T20:12:06.717283] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:12:07.043295] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-19T20:12:07.588926] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T20:12:07.843268] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-19T20:12:08.592236] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T20:12:08.606813] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T20:12:08.643228] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-19T20:12:09.443287] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-19T20:12:09.888398] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T20:12:10.243324] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-19T20:12:10.723764] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T20:12:11.043309] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-19T20:12:11.170976] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T20:12:11.843319] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-19T20:12:12.643291] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-19T20:12:12.820899] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T20:12:13.104440] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T20:12:13.258881] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-19T20:12:13.443278] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-19T20:12:14.243321] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-19T20:12:15.020993] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T20:12:15.043222] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-19T20:12:15.746559] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T20:12:15.843240] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-19T20:12:16.643279] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-19T20:12:17.141629] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T20:12:17.443278] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-19T20:12:18.239807] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T20:12:18.254486] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T20:12:18.247007] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-19T20:12:18.802196] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T20:12:19.043288] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-19T20:12:19.804848] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T20:12:19.843212] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-19T20:12:20.466226] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T20:12:20.643267] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-19T20:12:21.406410] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T20:12:21.412313] [INFO ] [REMOTE ] NABL: Full fetch complete (56753 records). [2025-09-19T20:12:21.412417] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-19T20:12:21.448406] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-19T20:12:21.742978] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T20:12:21.778619] [INFO ] [REMOTE ] MYN: Full fetch complete (15584 records). [2025-09-19T20:12:21.794479] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-19T20:12:21.814472] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-19T20:12:21.819998] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-19T20:12:21.844567] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-19T20:12:21.853696] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-19T20:12:21.936229] [DEBUG] [LOCAL ] NABL: Trimmed 56753 records to 40942 (keeping 200 days of data) [2025-09-19T20:12:22.247250] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-19T20:12:22.342496] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-19T20:12:22.344487] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-19T20:12:22.346564] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-19T20:12:22.347277] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-19T20:12:22.366508] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T20:12:22.365831] [DEBUG] [LOCAL ] MYN: Trimmed 15584 records to 10530 (keeping 200 days of data) [2025-09-19T20:12:22.525888] [DEBUG] [LOCAL ] MYN: Primary data saved (10530 records). [2025-09-19T20:12:22.526865] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-19T20:12:22.527283] [INFO ] [MAIN ] Update Progress: 1447/2372 symbols completed. MYN took 33.0s. Estimated remaining: 2h 2m 56s. Rate: 7.5 symbols/min [2025-09-19T20:12:22.712061] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:12:22.748576] [DEBUG] [LOCAL ] NABL: Primary data saved (40942 records). [2025-09-19T20:12:22.748821] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-19T20:12:22.749790] [INFO ] [MAIN ] Update Progress: 1448/2372 symbols completed. NABL took 29.6s. Estimated remaining: 2h 2m 43s. Rate: 7.5 symbols/min [2025-09-19T20:12:22.866538] [DEBUG] [LOCAL ] NAD: Loaded 34426 existing records from primary storage. [2025-09-19T20:12:22.877249] [INFO ] [MAIN ] NAD: Loaded 34426 existing records. [2025-09-19T20:12:23.050597] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:12:23.056883] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-19T20:12:23.154000] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:12:23.154403] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-19T20:12:23.158956] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-19T20:12:23.159268] [DEBUG] [LOCAL ] NAN: Loaded 9175 existing records from primary storage. [2025-09-19T20:12:23.159510] [INFO ] [MAIN ] NAN: Loaded 9175 existing records. [2025-09-19T20:12:23.193141] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-19T20:12:23.228334] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-19T20:12:23.583072] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:12:23.650013] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-19T20:12:23.666328] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-19T20:12:23.682782] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-19T20:12:23.695507] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-19T20:12:23.713077] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T20:12:23.835431] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:12:23.848351] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-19T20:12:24.164337] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:12:24.528565] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T20:12:24.643274] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-19T20:12:25.390048] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T20:12:25.394069] [INFO ] [REMOTE ] MYI: Full fetch complete (29620 records). [2025-09-19T20:12:25.394154] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-19T20:12:25.453936] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-19T20:12:25.801429] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-19T20:12:25.801531] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-19T20:12:25.802174] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-19T20:12:25.802235] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-19T20:12:25.803004] [DEBUG] [LOCAL ] MYI: Trimmed 29620 records to 19663 (keeping 200 days of data) [2025-09-19T20:12:25.932252] [DEBUG] [LOCAL ] MYI: Primary data saved (19663 records). [2025-09-19T20:12:25.932410] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-19T20:12:25.932512] [INFO ] [MAIN ] Update Progress: 1449/2372 symbols completed. MYI took 43.4s. Estimated remaining: 2h 2m 32s. Rate: 7.5 symbols/min [2025-09-19T20:12:26.105678] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:12:26.156252] [DEBUG] [LOCAL ] NAT: Loaded 49532 existing records from primary storage. [2025-09-19T20:12:26.156403] [INFO ] [MAIN ] NAT: Loaded 49532 existing records. [2025-09-19T20:12:26.248423] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-19T20:12:26.343515] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:12:26.344066] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-19T20:12:26.344178] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-19T20:12:26.353683] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-19T20:12:26.368775] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-19T20:12:26.441154] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T20:12:26.688288] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T20:12:26.771487] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:12:27.043272] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-19T20:12:27.117367] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T20:12:27.843272] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-19T20:12:28.572215] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T20:12:28.643280] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-19T20:12:29.443273] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-19T20:12:29.634814] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T20:12:30.243237] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-19T20:12:30.359905] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T20:12:30.829627] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T20:12:31.043248] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-19T20:12:31.749744] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T20:12:31.754414] [INFO ] [REMOTE ] NAC: Full fetch complete (36336 records). [2025-09-19T20:12:31.754518] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-19T20:12:31.853100] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-19T20:12:32.131010] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-19T20:12:32.131125] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-19T20:12:32.131831] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-19T20:12:32.131892] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-19T20:12:32.132886] [DEBUG] [LOCAL ] NAC: Trimmed 36336 records to 25128 (keeping 200 days of data) [2025-09-19T20:12:32.283918] [DEBUG] [LOCAL ] NAC: Primary data saved (25128 records). [2025-09-19T20:12:32.284058] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-19T20:12:32.284159] [INFO ] [MAIN ] Update Progress: 1450/2372 symbols completed. NAC took 26.4s. Estimated remaining: 2h 2m 23s. Rate: 7.5 symbols/min [2025-09-19T20:12:32.452749] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:12:32.486981] [DEBUG] [LOCAL ] NATL: Loaded 33165 existing records from primary storage. [2025-09-19T20:12:32.487119] [INFO ] [MAIN ] NATL: Loaded 33165 existing records. [2025-09-19T20:12:32.649923] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-19T20:12:32.683595] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:12:32.683916] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-19T20:12:32.683990] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-19T20:12:32.684779] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-19T20:12:32.684842] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-19T20:12:33.070051] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:12:33.152294] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T20:12:33.301259] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T20:12:33.443271] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-19T20:12:33.656235] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T20:12:34.243311] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-19T20:12:34.611818] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T20:12:35.043288] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-19T20:12:35.199983] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-19T20:12:35.843237] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-19T20:12:36.000559] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T20:12:36.643267] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-19T20:12:36.805369] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T20:12:37.443271] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-19T20:12:37.582703] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T20:12:38.243274] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-19T20:12:38.424391] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T20:12:39.043295] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-19T20:12:39.746008] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T20:12:39.843248] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-19T20:12:40.361590] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T20:12:40.643270] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-19T20:12:41.259017] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T20:12:41.417122] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T20:12:41.443212] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-19T20:12:42.243277] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-19T20:12:43.043279] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-19T20:12:43.108839] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T20:12:43.843275] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-19T20:12:43.937878] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T20:12:44.560325] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T20:12:44.575969] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T20:12:44.643259] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-19T20:12:45.443291] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-19T20:12:46.240679] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T20:12:46.248136] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-19T20:12:46.321125] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T20:12:47.043269] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-19T20:12:47.843284] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-19T20:12:48.291119] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T20:12:48.567547] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T20:12:48.643263] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-19T20:12:49.304915] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T20:12:49.443309] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-19T20:12:49.777996] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T20:12:50.227447] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T20:12:50.230459] [INFO ] [REMOTE ] NAN: Full fetch complete (14222 records). [2025-09-19T20:12:50.230568] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-19T20:12:50.252127] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-19T20:12:50.646527] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-19T20:12:50.646634] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-19T20:12:50.646997] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-19T20:12:50.647101] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-19T20:12:50.647808] [DEBUG] [LOCAL ] NAN: Trimmed 14222 records to 9197 (keeping 200 days of data) [2025-09-19T20:12:50.705986] [DEBUG] [LOCAL ] NAN: Primary data saved (9197 records). [2025-09-19T20:12:50.706137] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-19T20:12:50.706253] [INFO ] [MAIN ] Update Progress: 1451/2372 symbols completed. NAN took 28.0s. Estimated remaining: 2h 2m 22s. Rate: 7.5 symbols/min [2025-09-19T20:12:50.879896] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:12:50.885226] [DEBUG] [LOCAL ] NAZ: Loaded 2749 existing records from primary storage. [2025-09-19T20:12:50.885354] [INFO ] [MAIN ] NAZ: Loaded 2749 existing records. [2025-09-19T20:12:51.049175] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-19T20:12:51.072458] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:12:51.072867] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-19T20:12:51.072936] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-19T20:12:51.073279] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-19T20:12:51.073341] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-19T20:12:51.438392] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:12:51.843290] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-19T20:12:51.948686] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T20:12:52.491913] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T20:12:52.643275] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-19T20:12:53.443308] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-19T20:12:53.890874] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T20:12:54.188793] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-19T20:12:54.236630] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T20:12:54.244335] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-19T20:12:55.043275] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-19T20:12:55.843280] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-19T20:12:56.186566] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T20:12:56.305580] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T20:12:56.643265] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-19T20:12:57.436775] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T20:12:57.442000] [INFO ] [REMOTE ] NAD: Full fetch complete (50313 records). [2025-09-19T20:12:57.442088] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-19T20:12:57.454101] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-19T20:12:57.821438] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-19T20:12:57.821519] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-19T20:12:57.822331] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-19T20:12:57.822393] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-19T20:12:57.823447] [DEBUG] [LOCAL ] NAD: Trimmed 50313 records to 34609 (keeping 200 days of data) [2025-09-19T20:12:58.038251] [DEBUG] [LOCAL ] NAD: Primary data saved (34609 records). [2025-09-19T20:12:58.038427] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-19T20:12:58.038563] [INFO ] [MAIN ] Update Progress: 1452/2372 symbols completed. NAD took 35.5s. Estimated remaining: 2h 2m 13s. Rate: 7.5 symbols/min [2025-09-19T20:12:58.189734] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T20:12:58.217292] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:12:58.232944] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T20:12:58.240582] [INFO ] [REMOTE ] NATL: Full fetch complete (45547 records). [2025-09-19T20:12:58.240758] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-19T20:12:58.244621] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-19T20:12:58.244948] [DEBUG] [LOCAL ] NBB: Loaded 8992 existing records from primary storage. [2025-09-19T20:12:58.266721] [INFO ] [MAIN ] NBB: Loaded 8992 existing records. [2025-09-19T20:12:58.725735] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:12:58.763194] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-19T20:12:58.773925] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-19T20:12:58.789782] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-19T20:12:58.811888] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-19T20:12:58.959030] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-19T20:12:58.963194] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T20:12:58.963387] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-19T20:12:58.966343] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-19T20:12:58.971926] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-19T20:12:59.052297] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-19T20:12:59.052465] [DEBUG] [LOCAL ] NATL: Trimmed 45547 records to 33354 (keeping 200 days of data) [2025-09-19T20:12:59.359678] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:12:59.461381] [DEBUG] [LOCAL ] NATL: Primary data saved (33354 records). [2025-09-19T20:12:59.461565] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-19T20:12:59.461757] [INFO ] [MAIN ] Update Progress: 1453/2372 symbols completed. NATL took 27.2s. Estimated remaining: 2h 2m 1s. Rate: 7.5 symbols/min [2025-09-19T20:12:59.631767] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:12:59.654087] [DEBUG] [LOCAL ] NBHC: Loaded 23207 existing records from primary storage. [2025-09-19T20:12:59.654215] [INFO ] [MAIN ] NBHC: Loaded 23207 existing records. [2025-09-19T20:12:59.830635] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:12:59.830912] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-19T20:12:59.830968] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-19T20:12:59.831788] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-19T20:12:59.831848] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-19T20:12:59.852265] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-19T20:12:59.940280] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T20:13:00.197367] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:13:00.643338] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-19T20:13:01.006397] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T20:13:01.443304] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-19T20:13:02.058586] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-19T20:13:02.243353] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-19T20:13:02.591898] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T20:13:02.816127] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T20:13:03.043346] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-19T20:13:03.612808] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T20:13:03.843269] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-19T20:13:04.567945] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T20:13:04.643304] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-19T20:13:05.443333] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-19T20:13:06.243293] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-19T20:13:06.428441] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T20:13:06.534245] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T20:13:06.809126] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T20:13:07.043311] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-19T20:13:07.706709] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T20:13:07.708177] [INFO ] [REMOTE ] NAZ: Full fetch complete (4421 records). [2025-09-19T20:13:07.708248] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-19T20:13:07.848363] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-19T20:13:08.078633] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-19T20:13:08.078756] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-19T20:13:08.078929] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-19T20:13:08.078968] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-19T20:13:08.079334] [DEBUG] [LOCAL ] NAZ: Trimmed 4421 records to 2766 (keeping 200 days of data) [2025-09-19T20:13:08.097085] [DEBUG] [LOCAL ] NAZ: Primary data saved (2766 records). [2025-09-19T20:13:08.097156] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-19T20:13:08.097228] [INFO ] [MAIN ] Update Progress: 1454/2372 symbols completed. NAZ took 17.4s. Estimated remaining: 2h 1m 54s. Rate: 7.5 symbols/min [2025-09-19T20:13:08.264035] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:13:08.303850] [DEBUG] [LOCAL ] NBR: Loaded 35282 existing records from primary storage. [2025-09-19T20:13:08.303992] [INFO ] [MAIN ] NBR: Loaded 35282 existing records. [2025-09-19T20:13:08.481191] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:13:08.481427] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-19T20:13:08.481476] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-19T20:13:08.482429] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-19T20:13:08.482491] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-19T20:13:08.647725] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-19T20:13:08.848517] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:13:08.854303] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T20:13:09.443289] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-19T20:13:10.243277] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-19T20:13:10.585002] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T20:13:10.835188] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T20:13:10.842890] [INFO ] [REMOTE ] NAT: Full fetch complete (72209 records). [2025-09-19T20:13:10.843049] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-19T20:13:11.051453] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-19T20:13:11.235527] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-19T20:13:11.235697] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-19T20:13:11.236805] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-19T20:13:11.236933] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-19T20:13:11.238764] [DEBUG] [LOCAL ] NAT: Trimmed 72209 records to 49893 (keeping 200 days of data) [2025-09-19T20:13:11.354124] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T20:13:11.569435] [DEBUG] [LOCAL ] NAT: Primary data saved (49893 records). [2025-09-19T20:13:11.569598] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-19T20:13:11.569712] [INFO ] [MAIN ] Update Progress: 1455/2372 symbols completed. NAT took 45.6s. Estimated remaining: 2h 1m 43s. Rate: 7.5 symbols/min [2025-09-19T20:13:11.741087] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:13:11.765086] [DEBUG] [LOCAL ] NBXG: Loaded 23058 existing records from primary storage. [2025-09-19T20:13:11.765225] [INFO ] [MAIN ] NBXG: Loaded 23058 existing records. [2025-09-19T20:13:11.848500] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-19T20:13:11.953791] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:13:11.954117] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-19T20:13:11.954175] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-19T20:13:11.955058] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-19T20:13:11.955121] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-19T20:13:12.319855] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:13:12.436398] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T20:13:12.523833] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T20:13:12.643284] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-19T20:13:13.443265] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-19T20:13:13.547803] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T20:13:14.243271] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-19T20:13:14.632370] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T20:13:15.043281] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-19T20:13:15.332455] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-19T20:13:15.843269] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-19T20:13:16.648415] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-19T20:13:16.659371] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T20:13:16.762584] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T20:13:17.443336] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-19T20:13:17.849633] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T20:13:18.243334] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-19T20:13:19.048889] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-19T20:13:19.063159] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T20:13:19.479903] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T20:13:19.843283] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-19T20:13:19.884563] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T20:13:20.643239] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-19T20:13:21.077592] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T20:13:21.443310] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-19T20:13:22.087271] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T20:13:22.243328] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-19T20:13:22.850355] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T20:13:22.869678] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-19T20:13:23.043320] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-19T20:13:23.843294] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-19T20:13:24.643319] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-19T20:13:24.853955] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T20:13:25.443257] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-19T20:13:25.627897] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T20:13:25.876813] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T20:13:26.243231] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-19T20:13:27.051341] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-19T20:13:27.054483] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T20:13:27.529522] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T20:13:27.843309] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-19T20:13:28.076233] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T20:13:28.643271] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-19T20:13:29.076139] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T20:13:29.443278] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-19T20:13:29.822989] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T20:13:30.243300] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-19T20:13:31.043255] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-19T20:13:31.117940] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T20:13:31.209520] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T20:13:31.843278] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-19T20:13:32.089832] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T20:13:32.091709] [INFO ] [REMOTE ] NBB: Full fetch complete (13950 records). [2025-09-19T20:13:32.091810] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-19T20:13:32.450864] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-19T20:13:32.450950] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-19T20:13:32.451260] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-19T20:13:32.451300] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-19T20:13:32.451928] [DEBUG] [LOCAL ] NBB: Trimmed 13950 records to 9027 (keeping 200 days of data) [2025-09-19T20:13:32.509505] [DEBUG] [LOCAL ] NBB: Primary data saved (9027 records). [2025-09-19T20:13:32.509702] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-19T20:13:32.509803] [INFO ] [MAIN ] Update Progress: 1456/2372 symbols completed. NBB took 34.5s. Estimated remaining: 2h 1m 43s. Rate: 7.5 symbols/min [2025-09-19T20:13:32.652704] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-19T20:13:32.688662] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:13:32.693544] [DEBUG] [LOCAL ] NC: Loaded 1936 existing records from primary storage. [2025-09-19T20:13:32.693675] [INFO ] [MAIN ] NC: Loaded 1936 existing records. [2025-09-19T20:13:32.873439] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:13:32.873791] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-19T20:13:32.873846] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-19T20:13:32.874075] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-19T20:13:32.874135] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-19T20:13:33.228568] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:13:33.244289] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T20:13:33.443278] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-19T20:13:34.243285] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-19T20:13:34.249063] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-19T20:13:34.272573] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T20:13:35.043283] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-19T20:13:35.598544] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T20:13:35.843319] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-19T20:13:36.280019] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T20:13:36.643289] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-19T20:13:37.240524] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T20:13:37.271731] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T20:13:37.276065] [INFO ] [REMOTE ] NBHC: Full fetch complete (31694 records). [2025-09-19T20:13:37.276210] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-19T20:13:37.453891] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-19T20:13:37.655384] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-19T20:13:37.655490] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-19T20:13:37.656253] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-19T20:13:37.656317] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-19T20:13:37.657990] [DEBUG] [LOCAL ] NBHC: Trimmed 31694 records to 23438 (keeping 200 days of data) [2025-09-19T20:13:37.802238] [DEBUG] [LOCAL ] NBHC: Primary data saved (23438 records). [2025-09-19T20:13:37.802370] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-19T20:13:37.802466] [INFO ] [MAIN ] Update Progress: 1457/2372 symbols completed. NBHC took 38.3s. Estimated remaining: 2h 1m 33s. Rate: 7.5 symbols/min [2025-09-19T20:13:37.972216] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:13:37.983850] [DEBUG] [LOCAL ] NCA: Loaded 10087 existing records from primary storage. [2025-09-19T20:13:37.983955] [INFO ] [MAIN ] NCA: Loaded 10087 existing records. [2025-09-19T20:13:38.164344] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:13:38.164691] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-19T20:13:38.164776] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-19T20:13:38.165184] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-19T20:13:38.165252] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-19T20:13:38.248465] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-19T20:13:38.543585] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:13:38.739301] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T20:13:38.742638] [INFO ] [REMOTE ] NBXG: Full fetch complete (33242 records). [2025-09-19T20:13:38.742750] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-19T20:13:39.048354] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-19T20:13:39.115919] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-19T20:13:39.116177] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-19T20:13:39.116948] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-19T20:13:39.117010] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-19T20:13:39.117915] [DEBUG] [LOCAL ] NBXG: Trimmed 33242 records to 23153 (keeping 200 days of data) [2025-09-19T20:13:39.258246] [DEBUG] [LOCAL ] NBXG: Primary data saved (23153 records). [2025-09-19T20:13:39.258384] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-19T20:13:39.258468] [INFO ] [MAIN ] Update Progress: 1458/2372 symbols completed. NBXG took 27.7s. Estimated remaining: 2h 1m 21s. Rate: 7.5 symbols/min [2025-09-19T20:13:39.429367] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:13:39.457515] [DEBUG] [LOCAL ] NCDL: Loaded 22014 existing records from primary storage. [2025-09-19T20:13:39.457683] [INFO ] [MAIN ] NCDL: Loaded 22014 existing records. [2025-09-19T20:13:39.640878] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:13:39.643934] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T20:13:39.645558] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-19T20:13:39.645674] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-19T20:13:39.646490] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-19T20:13:39.646555] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-19T20:13:39.843280] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-19T20:13:39.837872] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T20:13:40.066412] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:13:40.521755] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T20:13:40.643285] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-19T20:13:41.443268] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-19T20:13:42.243287] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-19T20:13:42.304390] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-19T20:13:42.328945] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T20:13:43.043276] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-19T20:13:43.800793] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T20:13:43.843422] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-19T20:13:44.388598] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T20:13:44.643272] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-19T20:13:44.676325] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T20:13:44.682039] [INFO ] [REMOTE ] NBR: Full fetch complete (49266 records). [2025-09-19T20:13:44.682195] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-19T20:13:45.087618] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-19T20:13:45.087728] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-19T20:13:45.088521] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-19T20:13:45.088562] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-19T20:13:45.089639] [DEBUG] [LOCAL ] NBR: Trimmed 49266 records to 35512 (keeping 200 days of data) [2025-09-19T20:13:45.296522] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-19T20:13:45.326149] [DEBUG] [LOCAL ] NBR: Primary data saved (35512 records). [2025-09-19T20:13:45.326312] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-19T20:13:45.326510] [INFO ] [MAIN ] Update Progress: 1459/2372 symbols completed. NBR took 37.2s. Estimated remaining: 2h 1m 12s. Rate: 7.5 symbols/min [2025-09-19T20:13:45.448349] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-19T20:13:45.520559] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:13:45.520820] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-09-19T20:13:45.520876] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-09-19T20:13:45.521015] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-19T20:13:45.521057] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-19T20:13:45.521106] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-09-19T20:13:45.521137] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-19T20:13:45.919162] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:13:46.243285] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-19T20:13:46.774034] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T20:13:46.889279] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T20:13:47.043270] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-19T20:13:47.843301] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-19T20:13:48.643284] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-19T20:13:49.012713] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T20:13:49.206352] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T20:13:49.250887] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T20:13:49.443357] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-19T20:13:50.243289] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-19T20:13:50.627348] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T20:13:51.043291] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-19T20:13:51.173952] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T20:13:51.843341] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-19T20:13:52.643302] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-19T20:13:52.778796] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T20:13:53.281861] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T20:13:53.443269] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-19T20:13:54.031166] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T20:13:54.243272] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-19T20:13:55.043242] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-19T20:13:55.467444] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T20:13:55.700620] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-19T20:13:55.843271] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-19T20:13:56.061280] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T20:13:56.643296] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-19T20:13:57.443315] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-19T20:13:58.001406] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-19T20:13:58.002398] [INFO ] [REMOTE ] NC: Full fetch complete (2704 records). [2025-09-19T20:13:58.002469] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-19T20:13:58.256039] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-19T20:13:58.391444] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-19T20:13:58.391635] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-19T20:13:58.392072] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-19T20:13:58.392169] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-19T20:13:58.400886] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T20:13:58.401439] [DEBUG] [LOCAL ] NC: Trimmed 2704 records to 1945 (keeping 200 days of data) [2025-09-19T20:13:58.457019] [DEBUG] [LOCAL ] NC: Primary data saved (1945 records). [2025-09-19T20:13:58.457874] [INFO ] [MAIN ] NC: Full history saved. [2025-09-19T20:13:58.459150] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-19T20:13:58.459521] [INFO ] [MAIN ] Update Progress: 1460/2372 symbols completed. NC took 25.9s. Estimated remaining: 2h 1m 7s. Rate: 7.5 symbols/min [2025-09-19T20:13:58.649941] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:13:58.672738] [DEBUG] [LOCAL ] NCV: Loaded 13525 existing records from primary storage. [2025-09-19T20:13:58.672876] [INFO ] [MAIN ] NCV: Loaded 13525 existing records. [2025-09-19T20:13:58.857301] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:13:58.857603] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-19T20:13:58.857681] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-19T20:13:58.858197] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-19T20:13:58.858276] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-19T20:13:59.049908] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-19T20:13:59.235857] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:13:59.244187] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T20:13:59.843288] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-19T20:14:00.643261] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-19T20:14:00.907954] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T20:14:01.443328] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-19T20:14:01.767140] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-19T20:14:01.916224] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T20:14:02.187294] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T20:14:02.243297] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-19T20:14:03.043303] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-19T20:14:03.843265] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-19T20:14:04.248629] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T20:14:04.488610] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-19T20:14:04.643313] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-19T20:14:05.197616] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T20:14:05.443276] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-19T20:14:05.874708] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T20:14:05.877996] [INFO ] [REMOTE ] NCDL: Full fetch complete (33589 records). [2025-09-19T20:14:05.878123] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-19T20:14:06.248551] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-19T20:14:06.250323] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-19T20:14:06.250434] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-19T20:14:06.251215] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-19T20:14:06.251296] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-19T20:14:06.253580] [DEBUG] [LOCAL ] NCDL: Trimmed 33589 records to 22141 (keeping 200 days of data) [2025-09-19T20:14:06.400348] [DEBUG] [LOCAL ] NCDL: Primary data saved (22141 records). [2025-09-19T20:14:06.400482] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-19T20:14:06.400632] [INFO ] [MAIN ] Update Progress: 1461/2372 symbols completed. NCDL took 27.1s. Estimated remaining: 2h 0m 59s. Rate: 7.5 symbols/min [2025-09-19T20:14:06.577138] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:14:06.595398] [DEBUG] [LOCAL ] NCZ: Loaded 11855 existing records from primary storage. [2025-09-19T20:14:06.595547] [INFO ] [MAIN ] NCZ: Loaded 11855 existing records. [2025-09-19T20:14:06.774034] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:14:06.774322] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-19T20:14:06.774420] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-19T20:14:06.774955] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-19T20:14:06.775026] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-19T20:14:07.049736] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-19T20:14:07.129960] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:14:07.139561] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T20:14:07.648686] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-19T20:14:07.843242] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-19T20:14:08.244006] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T20:14:08.643276] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-19T20:14:08.834989] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T20:14:09.338808] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T20:14:09.443262] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-19T20:14:10.243270] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-19T20:14:10.380313] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T20:14:11.043276] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-19T20:14:11.511355] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T20:14:11.843290] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-19T20:14:11.964859] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T20:14:12.643262] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-19T20:14:13.261112] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T20:14:13.443256] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-19T20:14:14.128736] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T20:14:14.243271] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-19T20:14:14.575674] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T20:14:15.043297] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-19T20:14:15.199443] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T20:14:15.202841] [INFO ] [REMOTE ] NCA: Full fetch complete (15927 records). [2025-09-19T20:14:15.203013] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-19T20:14:15.820613] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-19T20:14:15.820758] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-19T20:14:15.821343] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-19T20:14:15.821410] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-19T20:14:15.823190] [DEBUG] [LOCAL ] NCA: Trimmed 15927 records to 10214 (keeping 200 days of data) [2025-09-19T20:14:15.857772] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-19T20:14:15.924546] [DEBUG] [LOCAL ] NCA: Primary data saved (10214 records). [2025-09-19T20:14:15.924760] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-19T20:14:15.924919] [INFO ] [MAIN ] Update Progress: 1462/2372 symbols completed. NCA took 38.1s. Estimated remaining: 2h 0m 52s. Rate: 7.5 symbols/min [2025-09-19T20:14:16.174742] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:14:16.203868] [DEBUG] [LOCAL ] NDMO: Loaded 16619 existing records from primary storage. [2025-09-19T20:14:16.204027] [INFO ] [MAIN ] NDMO: Loaded 16619 existing records. [2025-09-19T20:14:16.410350] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:14:16.410713] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-19T20:14:16.410773] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-19T20:14:16.411490] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-19T20:14:16.411552] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-19T20:14:16.656726] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-19T20:14:16.808190] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:14:16.912870] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T20:14:17.443232] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-19T20:14:17.531060] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-19T20:14:17.975301] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T20:14:18.243263] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-19T20:14:18.539971] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T20:14:19.043269] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-19T20:14:19.843271] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-19T20:14:20.497575] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T20:14:20.643253] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-19T20:14:20.737415] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-19T20:14:20.794290] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T20:14:21.443248] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-19T20:14:21.544956] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T20:14:22.243304] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-19T20:14:23.043283] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-19T20:14:23.320219] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T20:14:23.519225] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-19T20:14:23.806211] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-19T20:14:23.814306] [INFO ] [REMOTE ] NCLH: Full fetch complete (77808 records). [2025-09-19T20:14:23.814482] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-19T20:14:23.848345] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-19T20:14:24.223865] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-19T20:14:24.223964] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-19T20:14:24.225130] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-19T20:14:24.225224] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-19T20:14:24.226783] [DEBUG] [LOCAL ] NCLH: Trimmed 77808 records to 54533 (keeping 200 days of data) [2025-09-19T20:14:24.576995] [DEBUG] [LOCAL ] NCLH: Primary data saved (54533 records). [2025-09-19T20:14:24.577149] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-19T20:14:24.577295] [INFO ] [MAIN ] Update Progress: 1463/2372 symbols completed. NCLH took 39.3s. Estimated remaining: 2h 0m 45s. Rate: 7.5 symbols/min [2025-09-19T20:14:24.652494] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-19T20:14:24.759117] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:14:24.822405] [DEBUG] [LOCAL ] NE: Loaded 52783 existing records from primary storage. [2025-09-19T20:14:24.822555] [INFO ] [MAIN ] NE: Loaded 52783 existing records. [2025-09-19T20:14:25.001098] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:14:25.001436] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-19T20:14:25.001494] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-19T20:14:25.003443] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-19T20:14:25.003506] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-19T20:14:25.363265] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T20:14:25.376091] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:14:25.443212] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-19T20:14:25.879703] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T20:14:26.243285] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-19T20:14:26.379738] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T20:14:27.043279] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-19T20:14:27.843285] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-19T20:14:28.200735] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T20:14:28.390183] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T20:14:28.643273] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-19T20:14:28.926273] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T20:14:28.928583] [INFO ] [REMOTE ] NCZ: Full fetch complete (21531 records). [2025-09-19T20:14:28.928714] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-19T20:14:29.293430] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-19T20:14:29.293516] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-19T20:14:29.294089] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-19T20:14:29.294154] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-19T20:14:29.294762] [DEBUG] [LOCAL ] NCZ: Trimmed 21531 records to 11979 (keeping 200 days of data) [2025-09-19T20:14:29.369586] [DEBUG] [LOCAL ] NCZ: Primary data saved (11979 records). [2025-09-19T20:14:29.369754] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-19T20:14:29.369848] [INFO ] [MAIN ] Update Progress: 1464/2372 symbols completed. NCZ took 23.0s. Estimated remaining: 2h 0m 35s. Rate: 7.5 symbols/min [2025-09-19T20:14:29.448372] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-19T20:14:29.547808] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:14:29.586775] [DEBUG] [LOCAL ] NEA: Loaded 35699 existing records from primary storage. [2025-09-19T20:14:29.586929] [INFO ] [MAIN ] NEA: Loaded 35699 existing records. [2025-09-19T20:14:29.765278] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:14:29.765552] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-19T20:14:29.765602] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-19T20:14:29.767190] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-19T20:14:29.767255] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-19T20:14:30.130915] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:14:30.243264] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-19T20:14:30.518907] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T20:14:30.683680] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T20:14:31.043284] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-19T20:14:31.843265] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-19T20:14:32.000357] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T20:14:32.140298] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T20:14:32.643282] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-19T20:14:32.960800] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T20:14:32.963280] [INFO ] [REMOTE ] NCV: Full fetch complete (23183 records). [2025-09-19T20:14:32.963353] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-19T20:14:33.328506] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-19T20:14:33.328621] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-19T20:14:33.329159] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-19T20:14:33.329215] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-19T20:14:33.330023] [DEBUG] [LOCAL ] NCV: Trimmed 23183 records to 13619 (keeping 200 days of data) [2025-09-19T20:14:33.418110] [DEBUG] [LOCAL ] NCV: Primary data saved (13619 records). [2025-09-19T20:14:33.418248] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-19T20:14:33.418358] [INFO ] [MAIN ] Update Progress: 1465/2372 symbols completed. NCV took 34.9s. Estimated remaining: 2h 0m 25s. Rate: 7.5 symbols/min [2025-09-19T20:14:33.448564] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-19T20:14:33.592103] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:14:33.592318] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-09-19T20:14:33.592373] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-09-19T20:14:33.592519] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-19T20:14:33.592562] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-19T20:14:33.592602] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-09-19T20:14:33.592633] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-19T20:14:33.950382] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:14:34.243256] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-19T20:14:34.682549] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T20:14:35.043280] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-19T20:14:35.843253] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-19T20:14:36.145813] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T20:14:36.481054] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T20:14:36.643265] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-19T20:14:37.141063] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (4.50 seconds). [2025-09-19T20:14:37.443307] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-19T20:14:37.782137] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T20:14:38.243224] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-19T20:14:38.374811] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T20:14:38.849545] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T20:14:39.043277] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-19T20:14:39.843342] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-19T20:14:40.139679] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T20:14:40.643319] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-19T20:14:40.758328] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T20:14:41.374035] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T20:14:41.443226] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-19T20:14:42.169827] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T20:14:42.243278] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-19T20:14:43.043282] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-19T20:14:43.377278] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T20:14:43.708276] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-19T20:14:43.843337] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-19T20:14:44.377547] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T20:14:44.643310] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-19T20:14:45.443325] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-19T20:14:45.790864] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T20:14:45.830446] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T20:14:46.243278] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-19T20:14:46.848443] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T20:14:47.043320] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-19T20:14:47.843297] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-19T20:14:47.871532] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T20:14:48.643295] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-19T20:14:48.998291] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T20:14:49.443266] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-19T20:14:50.224504] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T20:14:50.248357] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-19T20:14:50.259392] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T20:14:51.043307] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-19T20:14:51.322414] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T20:14:51.843340] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-19T20:14:52.649160] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-19T20:14:52.654348] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-19T20:14:52.696080] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T20:14:53.443275] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-19T20:14:53.865802] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T20:14:53.956508] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T20:14:54.243288] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-19T20:14:54.494279] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T20:14:54.499939] [INFO ] [REMOTE ] NEA: Full fetch complete (52426 records). [2025-09-19T20:14:54.500053] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-19T20:14:54.926947] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-19T20:14:54.927049] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-19T20:14:54.927886] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-19T20:14:54.927949] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-19T20:14:54.929034] [DEBUG] [LOCAL ] NEA: Trimmed 52426 records to 35876 (keeping 200 days of data) [2025-09-19T20:14:55.043591] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-19T20:14:55.161627] [DEBUG] [LOCAL ] NEA: Primary data saved (35876 records). [2025-09-19T20:14:55.161825] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-19T20:14:55.161935] [INFO ] [MAIN ] Update Progress: 1466/2372 symbols completed. NEA took 25.8s. Estimated remaining: 2h 0m 25s. Rate: 7.5 symbols/min [2025-09-19T20:14:55.344590] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:14:55.344845] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-09-19T20:14:55.344892] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-09-19T20:14:55.345086] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-19T20:14:55.345151] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-19T20:14:55.345267] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-09-19T20:14:55.345318] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-19T20:14:55.468779] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T20:14:55.506245] [INFO ] [REMOTE ] NDMO: Full fetch complete (25153 records). [2025-09-19T20:14:55.520119] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-19T20:14:55.861869] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-19T20:14:55.909160] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:14:56.111286] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-19T20:14:56.111383] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-19T20:14:56.112252] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-19T20:14:56.112314] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-19T20:14:56.113008] [DEBUG] [LOCAL ] NDMO: Trimmed 25153 records to 16709 (keeping 200 days of data) [2025-09-19T20:14:56.229339] [DEBUG] [LOCAL ] NDMO: Primary data saved (16709 records). [2025-09-19T20:14:56.229520] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-19T20:14:56.229623] [INFO ] [MAIN ] Update Progress: 1467/2372 symbols completed. NDMO took 40.3s. Estimated remaining: 2h 0m 13s. Rate: 7.5 symbols/min [2025-09-19T20:14:56.401749] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:14:56.466736] [DEBUG] [LOCAL ] NET: Loaded 53481 existing records from primary storage. [2025-09-19T20:14:56.466931] [INFO ] [MAIN ] NET: Loaded 53481 existing records. [2025-09-19T20:14:56.645504] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-19T20:14:56.661142] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:14:56.661411] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-19T20:14:56.661465] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-19T20:14:56.662932] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-19T20:14:56.662997] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-19T20:14:57.060716] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:14:57.093478] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T20:14:57.443319] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-19T20:14:58.243294] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-19T20:14:58.374945] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-19T20:14:58.929941] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T20:14:59.043236] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-19T20:14:59.093588] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T20:14:59.843371] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-19T20:15:00.242269] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T20:15:00.250407] [INFO ] [REMOTE ] NE: Full fetch complete (75345 records). [2025-09-19T20:15:00.250571] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-19T20:15:00.658592] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-19T20:15:00.654986] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-19T20:15:00.659593] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-19T20:15:00.660669] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-19T20:15:00.660780] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-19T20:15:00.662368] [DEBUG] [LOCAL ] NE: Trimmed 75345 records to 53173 (keeping 200 days of data) [2025-09-19T20:15:00.920434] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T20:15:01.044811] [DEBUG] [LOCAL ] NE: Primary data saved (53173 records). [2025-09-19T20:15:01.044964] [INFO ] [MAIN ] NE: Full history saved. [2025-09-19T20:15:01.045762] [INFO ] [MAIN ] Update Progress: 1468/2372 symbols completed. NE took 36.5s. Estimated remaining: 2h 0m 3s. Rate: 7.5 symbols/min [2025-09-19T20:15:01.215831] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:15:01.227283] [DEBUG] [LOCAL ] NEU: Loaded 8172 existing records from primary storage. [2025-09-19T20:15:01.227409] [INFO ] [MAIN ] NEU: Loaded 8172 existing records. [2025-09-19T20:15:01.412032] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:15:01.412462] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-19T20:15:01.412534] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-19T20:15:01.413064] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-19T20:15:01.413138] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-19T20:15:01.456439] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-19T20:15:01.841708] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:15:02.243274] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-19T20:15:02.384573] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-19T20:15:03.043274] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-19T20:15:03.791402] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (3.14 seconds). [2025-09-19T20:15:03.843221] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-19T20:15:05.102532] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-19T20:15:05.104692] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-19T20:15:05.725637] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (4.27 seconds). [2025-09-19T20:15:05.733632] [INFO ] [REMOTE ] NEE: Full fetch complete (77758 records). [2025-09-19T20:15:05.733819] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-19T20:15:05.946483] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T20:15:05.968455] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-19T20:15:06.155270] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-19T20:15:06.155439] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-19T20:15:06.156611] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-19T20:15:06.156705] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-19T20:15:06.173623] [DEBUG] [LOCAL ] NEE: Trimmed 77758 records to 54487 (keeping 200 days of data) [2025-09-19T20:15:06.187591] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (3.14 seconds). [2025-09-19T20:15:06.257392] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-19T20:15:06.478586] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-19T20:15:06.583578] [DEBUG] [LOCAL ] NEE: Primary data saved (54487 records). [2025-09-19T20:15:06.583747] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-19T20:15:06.583832] [INFO ] [MAIN ] Update Progress: 1469/2372 symbols completed. NEE took 33.2s. Estimated remaining: 1h 59m 53s. Rate: 7.5 symbols/min [2025-09-19T20:15:06.751598] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:15:06.755576] [DEBUG] [LOCAL ] NEUE: Loaded 2262 existing records from primary storage. [2025-09-19T20:15:06.755685] [INFO ] [MAIN ] NEUE: Loaded 2262 existing records. [2025-09-19T20:15:06.934322] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:15:06.934713] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-19T20:15:06.934887] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-19T20:15:06.937785] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-19T20:15:06.940404] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-19T20:15:07.004987] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T20:15:07.043855] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-19T20:15:07.299772] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:15:07.836708] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T20:15:07.843224] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-19T20:15:08.643341] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-19T20:15:08.702539] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-19T20:15:08.722751] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T20:15:09.222058] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T20:15:09.443435] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-19T20:15:10.243293] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-19T20:15:11.043239] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-19T20:15:11.765264] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T20:15:11.823955] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T20:15:11.843240] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-19T20:15:12.301275] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T20:15:12.643275] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-19T20:15:13.343558] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T20:15:13.443239] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-19T20:15:14.226362] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T20:15:14.243207] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-19T20:15:15.043270] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-19T20:15:15.843235] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-19T20:15:16.110688] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-19T20:15:16.374023] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T20:15:16.407672] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T20:15:16.451152] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-19T20:15:16.643300] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-19T20:15:17.443271] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-19T20:15:18.243269] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-19T20:15:18.635476] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T20:15:18.734520] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T20:15:19.043319] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-19T20:15:19.843272] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-19T20:15:20.409365] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T20:15:20.643253] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-19T20:15:20.719579] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-19T20:15:21.164684] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T20:15:21.421946] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T20:15:21.443225] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-19T20:15:22.243268] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-19T20:15:23.043264] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-19T20:15:23.245308] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-19T20:15:23.701964] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T20:15:23.843285] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-19T20:15:24.643305] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-19T20:15:25.077703] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T20:15:25.079730] [INFO ] [REMOTE ] NEU: Full fetch complete (10161 records). [2025-09-19T20:15:25.079810] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-19T20:15:25.465212] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-19T20:15:25.455579] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-19T20:15:25.466473] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-19T20:15:25.466910] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-19T20:15:25.467078] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-19T20:15:25.468021] [DEBUG] [LOCAL ] NEU: Trimmed 10161 records to 8234 (keeping 200 days of data) [2025-09-19T20:15:25.525484] [DEBUG] [LOCAL ] NEU: Primary data saved (8234 records). [2025-09-19T20:15:25.525758] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-19T20:15:25.525930] [INFO ] [MAIN ] Update Progress: 1470/2372 symbols completed. NEU took 24.5s. Estimated remaining: 1h 59m 52s. Rate: 7.5 symbols/min [2025-09-19T20:15:25.736613] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:15:25.765077] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-19T20:15:25.785926] [DEBUG] [LOCAL ] NEXA: Loaded 4023 existing records from primary storage. [2025-09-19T20:15:25.786307] [INFO ] [MAIN ] NEXA: Loaded 4023 existing records. [2025-09-19T20:15:25.965028] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:15:25.965295] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-19T20:15:25.965342] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-19T20:15:25.965600] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-19T20:15:25.965688] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-19T20:15:26.069255] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T20:15:26.249199] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-19T20:15:26.351887] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:15:26.631141] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-19T20:15:26.731775] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T20:15:27.043280] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-19T20:15:27.843275] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-19T20:15:28.643319] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-19T20:15:28.815742] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T20:15:29.228602] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T20:15:29.237411] [INFO ] [REMOTE ] NET: Full fetch complete (76889 records). [2025-09-19T20:15:29.237564] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-19T20:15:29.403865] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T20:15:29.456884] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-19T20:15:29.662878] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-19T20:15:29.662993] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-19T20:15:29.664149] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-19T20:15:29.664255] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-19T20:15:29.666311] [DEBUG] [LOCAL ] NET: Trimmed 76889 records to 53854 (keeping 200 days of data) [2025-09-19T20:15:30.000094] [DEBUG] [LOCAL ] NET: Primary data saved (53854 records). [2025-09-19T20:15:30.000259] [INFO ] [MAIN ] NET: Full history saved. [2025-09-19T20:15:30.000454] [INFO ] [MAIN ] Update Progress: 1471/2372 symbols completed. NET took 33.8s. Estimated remaining: 1h 59m 42s. Rate: 7.5 symbols/min [2025-09-19T20:15:30.104118] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-19T20:15:30.120854] [INFO ] [REMOTE ] NEUE: Full fetch complete (4003 records). [2025-09-19T20:15:30.126079] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-19T20:15:30.256107] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-19T20:15:30.266223] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:15:30.580279] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-19T20:15:30.580362] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-19T20:15:30.580509] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-19T20:15:30.580613] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-19T20:15:30.581970] [DEBUG] [LOCAL ] NFG: Loaded 39072 existing records from primary storage. [2025-09-19T20:15:30.582390] [DEBUG] [LOCAL ] NEUE: Trimmed 4003 records to 2278 (keeping 200 days of data) [2025-09-19T20:15:30.582505] [INFO ] [MAIN ] NFG: Loaded 39072 existing records. [2025-09-19T20:15:30.717332] [DEBUG] [LOCAL ] NEUE: Primary data saved (2278 records). [2025-09-19T20:15:30.723709] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-19T20:15:30.729002] [INFO ] [MAIN ] Update Progress: 1472/2372 symbols completed. NEUE took 24.1s. Estimated remaining: 1h 59m 30s. Rate: 7.5 symbols/min [2025-09-19T20:15:30.923595] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:15:30.939248] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-19T20:15:30.958724] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-19T20:15:30.983565] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:15:30.980466] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-19T20:15:30.984063] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-19T20:15:31.047411] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-19T20:15:31.212990] [DEBUG] [LOCAL ] NFJ: Loaded 20587 existing records from primary storage. [2025-09-19T20:15:31.245411] [INFO ] [MAIN ] NFJ: Loaded 20587 existing records. [2025-09-19T20:15:31.526855] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:15:31.557136] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:15:31.557381] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-19T20:15:31.557439] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-19T20:15:31.558104] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-19T20:15:31.558164] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-19T20:15:31.737424] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-19T20:15:31.851207] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-19T20:15:31.941851] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:15:32.643326] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-19T20:15:32.787809] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T20:15:32.934935] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-19T20:15:33.443279] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-19T20:15:33.983119] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T20:15:34.243273] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-19T20:15:34.785687] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T20:15:35.043302] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-19T20:15:35.749357] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T20:15:35.843287] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-19T20:15:35.984012] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T20:15:36.624056] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T20:15:36.643212] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-19T20:15:37.396583] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T20:15:37.443283] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-19T20:15:38.152837] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T20:15:38.243247] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-19T20:15:39.043306] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-19T20:15:39.168215] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T20:15:39.843280] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-19T20:15:40.181708] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T20:15:40.643282] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-19T20:15:41.151844] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-19T20:15:41.167601] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T20:15:41.443275] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-19T20:15:42.243272] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-19T20:15:42.711562] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T20:15:43.043267] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-19T20:15:43.136385] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T20:15:43.137992] [INFO ] [REMOTE ] NEXA: Full fetch complete (7537 records). [2025-09-19T20:15:43.138120] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-19T20:15:43.550768] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-19T20:15:43.550855] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-19T20:15:43.551105] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-19T20:15:43.551156] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-19T20:15:43.551595] [DEBUG] [LOCAL ] NEXA: Trimmed 7537 records to 4087 (keeping 200 days of data) [2025-09-19T20:15:43.576011] [DEBUG] [LOCAL ] NEXA: Primary data saved (4087 records). [2025-09-19T20:15:43.576123] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-19T20:15:43.576208] [INFO ] [MAIN ] Update Progress: 1473/2372 symbols completed. NEXA took 18.1s. Estimated remaining: 1h 59m 25s. Rate: 7.5 symbols/min [2025-09-19T20:15:43.755693] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:15:43.803199] [DEBUG] [LOCAL ] NGG: Loaded 46495 existing records from primary storage. [2025-09-19T20:15:43.803373] [INFO ] [MAIN ] NGG: Loaded 46495 existing records. [2025-09-19T20:15:43.848388] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-19T20:15:43.996483] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:15:43.996883] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-19T20:15:43.996939] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-19T20:15:43.998175] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-19T20:15:43.998236] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-19T20:15:44.372736] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:15:44.388220] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T20:15:44.643269] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-19T20:15:45.443295] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-19T20:15:46.243248] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-19T20:15:46.369959] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T20:15:46.612543] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-19T20:15:46.620604] [INFO ] [REMOTE ] NEM: Full fetch complete (77749 records). [2025-09-19T20:15:46.620780] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-19T20:15:47.046610] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-19T20:15:47.066022] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-19T20:15:47.066364] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-19T20:15:47.068393] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-19T20:15:47.068617] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-19T20:15:47.070397] [DEBUG] [LOCAL ] NEM: Trimmed 77749 records to 54488 (keeping 200 days of data) [2025-09-19T20:15:47.181930] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T20:15:47.350236] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T20:15:47.483715] [DEBUG] [LOCAL ] NEM: Primary data saved (54488 records). [2025-09-19T20:15:47.483895] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-19T20:15:47.483984] [INFO ] [MAIN ] Update Progress: 1474/2372 symbols completed. NEM took 52.3s. Estimated remaining: 1h 59m 14s. Rate: 7.5 symbols/min [2025-09-19T20:15:47.652912] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:15:47.684718] [DEBUG] [LOCAL ] NGL: Loaded 30690 existing records from primary storage. [2025-09-19T20:15:47.684947] [INFO ] [MAIN ] NGL: Loaded 30690 existing records. [2025-09-19T20:15:47.849713] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-19T20:15:47.872187] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:15:47.872470] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-19T20:15:47.872519] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-19T20:15:47.873262] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-19T20:15:47.873323] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-19T20:15:48.246989] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:15:48.643272] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-19T20:15:48.970554] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T20:15:49.443249] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-19T20:15:49.833501] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T20:15:49.868114] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T20:15:50.243282] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-19T20:15:50.589560] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T20:15:51.043282] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-19T20:15:51.626155] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T20:15:51.843241] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-19T20:15:52.261954] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T20:15:52.643271] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-19T20:15:53.443260] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-19T20:15:53.485846] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T20:15:53.907827] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T20:15:54.243271] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-19T20:15:54.777407] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T20:15:55.043282] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-19T20:15:55.498408] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T20:15:55.843266] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-19T20:15:56.253952] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T20:15:56.643281] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-19T20:15:57.443305] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-19T20:15:57.710459] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T20:15:57.806504] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T20:15:58.243266] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-19T20:15:58.611319] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T20:15:58.614971] [INFO ] [REMOTE ] NFJ: Full fetch complete (30511 records). [2025-09-19T20:15:58.615142] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-19T20:15:59.004071] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-19T20:15:59.004167] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-19T20:15:59.004891] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-19T20:15:59.004968] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-19T20:15:59.005935] [DEBUG] [LOCAL ] NFJ: Trimmed 30511 records to 20729 (keeping 200 days of data) [2025-09-19T20:15:59.063179] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-19T20:15:59.145157] [DEBUG] [LOCAL ] NFJ: Primary data saved (20729 records). [2025-09-19T20:15:59.145295] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-19T20:15:59.145383] [INFO ] [MAIN ] Update Progress: 1475/2372 symbols completed. NFJ took 28.4s. Estimated remaining: 1h 59m 9s. Rate: 7.5 symbols/min [2025-09-19T20:15:59.320407] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:15:59.333802] [DEBUG] [LOCAL ] NGS: Loaded 11842 existing records from primary storage. [2025-09-19T20:15:59.333940] [INFO ] [MAIN ] NGS: Loaded 11842 existing records. [2025-09-19T20:15:59.517354] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:15:59.517625] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-19T20:15:59.517705] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-19T20:15:59.518152] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-19T20:15:59.518221] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-19T20:15:59.884637] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:15:59.861687] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-19T20:15:59.907883] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T20:15:59.932886] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-19T20:16:00.643273] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-19T20:16:01.443348] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-19T20:16:01.830041] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T20:16:01.920345] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T20:16:02.243367] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-19T20:16:03.043289] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-19T20:16:03.404829] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T20:16:03.876871] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-19T20:16:03.885878] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T20:16:04.643282] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-19T20:16:05.067884] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T20:16:05.443306] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-19T20:16:05.640703] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T20:16:06.243312] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-19T20:16:06.641867] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T20:16:06.754793] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T20:16:07.043311] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-19T20:16:07.840085] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T20:16:07.845539] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-19T20:16:07.846970] [INFO ] [REMOTE ] NFG: Full fetch complete (56481 records). [2025-09-19T20:16:07.847069] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-19T20:16:08.255050] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-19T20:16:08.255134] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-19T20:16:08.256081] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-19T20:16:08.256144] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-19T20:16:08.257325] [DEBUG] [LOCAL ] NFG: Trimmed 56481 records to 39313 (keeping 200 days of data) [2025-09-19T20:16:08.517100] [DEBUG] [LOCAL ] NFG: Primary data saved (39313 records). [2025-09-19T20:16:08.517348] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-19T20:16:08.517518] [INFO ] [MAIN ] Update Progress: 1476/2372 symbols completed. NFG took 38.5s. Estimated remaining: 1h 59m 1s. Rate: 7.5 symbols/min [2025-09-19T20:16:08.646759] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-19T20:16:08.726395] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:16:08.749860] [DEBUG] [LOCAL ] NGVC: Loaded 22615 existing records from primary storage. [2025-09-19T20:16:08.750032] [INFO ] [MAIN ] NGVC: Loaded 22615 existing records. [2025-09-19T20:16:08.945291] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:16:08.945841] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-19T20:16:08.945924] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-19T20:16:08.946945] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-19T20:16:08.947045] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-19T20:16:09.088843] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T20:16:09.370614] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:16:09.443274] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-19T20:16:09.955886] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T20:16:10.105493] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T20:16:10.243279] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-19T20:16:11.043300] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-19T20:16:11.180485] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T20:16:11.601933] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T20:16:11.843270] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-19T20:16:12.643320] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-19T20:16:12.889796] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T20:16:12.994611] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T20:16:13.443322] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-19T20:16:14.243285] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-19T20:16:14.268161] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T20:16:14.758435] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T20:16:15.043246] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-19T20:16:15.535303] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T20:16:15.843287] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-19T20:16:16.572094] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T20:16:16.580777] [INFO ] [REMOTE ] NGL: Full fetch complete (40731 records). [2025-09-19T20:16:16.581009] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-19T20:16:16.656369] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-19T20:16:16.996408] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-19T20:16:16.996559] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-19T20:16:16.997416] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-19T20:16:16.997501] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-19T20:16:17.001524] [DEBUG] [LOCAL ] NGL: Trimmed 40731 records to 30987 (keeping 200 days of data) [2025-09-19T20:16:17.197497] [DEBUG] [LOCAL ] NGL: Primary data saved (30987 records). [2025-09-19T20:16:17.197666] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-19T20:16:17.197842] [INFO ] [MAIN ] Update Progress: 1477/2372 symbols completed. NGL took 29.7s. Estimated remaining: 1h 58m 54s. Rate: 7.5 symbols/min [2025-09-19T20:16:17.443294] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-19T20:16:17.706196] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T20:16:17.715449] [INFO ] [REMOTE ] NGG: Full fetch complete (66235 records). [2025-09-19T20:16:17.715590] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-19T20:16:18.152986] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-19T20:16:18.154111] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T20:16:18.153709] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-19T20:16:18.159400] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-19T20:16:18.159475] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-19T20:16:18.160743] [DEBUG] [LOCAL ] NGG: Trimmed 66235 records to 46764 (keeping 200 days of data) [2025-09-19T20:16:18.267116] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-19T20:16:18.470636] [DEBUG] [LOCAL ] NGG: Primary data saved (46764 records). [2025-09-19T20:16:18.470818] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-19T20:16:18.471777] [INFO ] [MAIN ] Update Progress: 1478/2372 symbols completed. NGG took 34.9s. Estimated remaining: 1h 58m 42s. Rate: 7.5 symbols/min [2025-09-19T20:16:18.551356] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-19T20:16:19.043237] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-19T20:16:19.453081] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T20:16:19.669013] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-19T20:16:19.843266] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-19T20:16:20.643275] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-19T20:16:20.771685] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T20:16:20.773803] [INFO ] [REMOTE ] NGS: Full fetch complete (17180 records). [2025-09-19T20:16:20.773895] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-19T20:16:21.185283] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-19T20:16:21.185371] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-19T20:16:21.185765] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-19T20:16:21.185826] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-19T20:16:21.186413] [DEBUG] [LOCAL ] NGS: Trimmed 17180 records to 11953 (keeping 200 days of data) [2025-09-19T20:16:21.269348] [DEBUG] [LOCAL ] NGS: Primary data saved (11953 records). [2025-09-19T20:16:21.269627] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-19T20:16:21.269789] [INFO ] [MAIN ] Update Progress: 1479/2372 symbols completed. NGS took 22.1s. Estimated remaining: 1h 58m 31s. Rate: 7.5 symbols/min [2025-09-19T20:16:21.960591] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T20:16:21.968429] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-19T20:16:23.622997] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T20:16:23.630087] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-19T20:16:25.012849] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T20:16:25.017902] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-19T20:16:26.495045] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T20:16:26.500933] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-19T20:16:27.907825] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T20:16:27.913486] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-19T20:16:29.394307] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T20:16:29.400276] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-19T20:16:30.802916] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T20:16:30.809406] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-19T20:16:32.095534] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T20:16:32.099459] [INFO ] [REMOTE ] NGVC: Full fetch complete (30254 records). [2025-09-19T20:16:32.099591] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-19T20:16:32.512616] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-19T20:16:32.512820] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-19T20:16:32.513489] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-19T20:16:32.513551] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-19T20:16:32.514408] [DEBUG] [LOCAL ] NGVC: Trimmed 30254 records to 22756 (keeping 200 days of data) [2025-09-19T20:16:32.669237] [DEBUG] [LOCAL ] NGVC: Primary data saved (22756 records). [2025-09-19T20:16:32.669385] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-19T20:16:32.669541] [INFO ] [MAIN ] Update Progress: 1480/2372 symbols completed. NGVC took 24.2s. Estimated remaining: 1h 58m 25s. Rate: 7.5 symbols/min [2025-09-19T20:16:33.288624] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:16:33.326133] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:16:33.378720] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:16:33.395963] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-09-19T20:16:33.412403] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-09-19T20:16:33.418293] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:16:33.418715] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-19T20:16:33.419115] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-19T20:16:33.419225] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-19T20:16:33.419323] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-19T20:16:33.545002] [DEBUG] [LOCAL ] NHI: Loaded 22340 existing records from primary storage. [2025-09-19T20:16:33.548703] [INFO ] [MAIN ] NHI: Loaded 22340 existing records. [2025-09-19T20:16:33.561821] [DEBUG] [LOCAL ] NIC: Loaded 9008 existing records from primary storage. [2025-09-19T20:16:33.582121] [INFO ] [MAIN ] NIC: Loaded 9008 existing records. [2025-09-19T20:16:33.592698] [DEBUG] [LOCAL ] NGVT: Loaded 24732 existing records from primary storage. [2025-09-19T20:16:33.663218] [INFO ] [MAIN ] NGVT: Loaded 24732 existing records. [2025-09-19T20:16:34.235756] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:16:34.347471] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-19T20:16:34.382218] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:16:34.403526] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-19T20:16:34.422320] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-19T20:16:34.421184] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-19T20:16:34.454254] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:16:34.456752] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-19T20:16:34.478784] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:16:34.511164] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-19T20:16:34.534879] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-19T20:16:34.557102] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-19T20:16:34.535058] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-19T20:16:34.581809] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-19T20:16:34.590704] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-19T20:16:34.626991] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-19T20:16:34.636084] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-19T20:16:35.439242] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:16:35.495408] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-19T20:16:35.586506] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:16:35.610386] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-19T20:16:35.640520] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:16:35.640939] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-19T20:16:36.594495] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T20:16:36.606263] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-19T20:16:36.614828] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T20:16:36.618533] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-19T20:16:36.777480] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T20:16:36.782684] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-19T20:16:36.898819] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T20:16:36.904061] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-19T20:16:37.850065] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T20:16:37.854366] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-19T20:16:38.154199] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T20:16:38.158896] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-19T20:16:38.304619] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T20:16:38.309362] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-19T20:16:38.465269] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T20:16:38.467584] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-19T20:16:38.542664] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T20:16:38.553805] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-19T20:16:39.259672] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T20:16:39.264175] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-19T20:16:39.494760] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T20:16:39.497514] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-19T20:16:39.558198] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T20:16:39.563197] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-19T20:16:40.168442] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T20:16:40.178875] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-19T20:16:40.275497] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T20:16:40.289734] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T20:16:40.370562] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T20:16:40.643281] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-19T20:16:41.443295] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-19T20:16:42.094250] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T20:16:42.121142] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T20:16:42.243293] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-19T20:16:42.360131] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T20:16:43.043315] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-19T20:16:43.211243] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T20:16:43.843342] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-19T20:16:44.629597] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T20:16:44.643248] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-19T20:16:45.443240] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-19T20:16:45.958059] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:16:46.158214] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T20:16:46.176011] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T20:16:46.243306] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-19T20:16:47.043315] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-19T20:16:47.626491] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T20:16:47.843281] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-19T20:16:48.643260] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-19T20:16:48.817150] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T20:16:49.433907] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T20:16:49.444596] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-19T20:16:49.953381] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:16:50.243305] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-19T20:16:50.474941] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T20:16:51.043324] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-19T20:16:51.843276] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-19T20:16:52.273850] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T20:16:52.359800] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T20:16:52.363594] [INFO ] [REMOTE ] NGVT: Full fetch complete (34553 records). [2025-09-19T20:16:52.363750] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-19T20:16:52.652297] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-19T20:16:52.746909] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-19T20:16:52.747007] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-19T20:16:52.747794] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-19T20:16:52.747866] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-19T20:16:52.748904] [DEBUG] [LOCAL ] NGVT: Trimmed 34553 records to 24863 (keeping 200 days of data) [2025-09-19T20:16:52.895871] [DEBUG] [LOCAL ] NGVT: Primary data saved (24863 records). [2025-09-19T20:16:52.896025] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-19T20:16:52.896118] [INFO ] [MAIN ] Update Progress: 1481/2372 symbols completed. NGVT took 20.2s. Estimated remaining: 1h 58m 24s. Rate: 7.5 symbols/min [2025-09-19T20:16:53.065739] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:16:53.079118] [DEBUG] [LOCAL ] NIE: Loaded 11760 existing records from primary storage. [2025-09-19T20:16:53.079260] [INFO ] [MAIN ] NIE: Loaded 11760 existing records. [2025-09-19T20:16:53.263437] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:16:53.264044] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-19T20:16:53.264120] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-19T20:16:53.264687] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-19T20:16:53.264780] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-19T20:16:53.377630] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T20:16:53.450392] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-19T20:16:53.691964] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:16:54.243334] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-19T20:16:54.695916] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T20:16:54.960743] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T20:16:55.043542] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T20:16:55.043719] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-19T20:16:55.843284] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-19T20:16:56.643248] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-19T20:16:57.087125] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T20:16:57.107157] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T20:16:57.110557] [INFO ] [REMOTE ] NHI: Full fetch complete (31657 records). [2025-09-19T20:16:57.110662] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-19T20:16:57.470343] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-19T20:16:57.483864] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-19T20:16:57.483940] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-19T20:16:57.484730] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-19T20:16:57.484796] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-19T20:16:57.485922] [DEBUG] [LOCAL ] NHI: Trimmed 31657 records to 22458 (keeping 200 days of data) [2025-09-19T20:16:57.623482] [DEBUG] [LOCAL ] NHI: Primary data saved (22458 records). [2025-09-19T20:16:57.623660] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-19T20:16:57.623767] [INFO ] [MAIN ] Update Progress: 1482/2372 symbols completed. NHI took 24.9s. Estimated remaining: 1h 58m 14s. Rate: 7.5 symbols/min [2025-09-19T20:16:57.798744] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:16:57.804935] [DEBUG] [LOCAL ] NIM: Loaded 4167 existing records from primary storage. [2025-09-19T20:16:57.805039] [INFO ] [MAIN ] NIM: Loaded 4167 existing records. [2025-09-19T20:16:57.993004] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:16:58.005040] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T20:16:58.004635] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-19T20:16:58.005224] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-19T20:16:58.008914] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-19T20:16:58.008976] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-19T20:16:58.251094] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-19T20:16:58.393149] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:16:58.516575] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T20:16:59.043324] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-19T20:16:59.371415] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T20:16:59.379074] [INFO ] [REMOTE ] NI: Full fetch complete (76873 records). [2025-09-19T20:16:59.379213] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-19T20:16:59.380133] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:16:59.380229] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:16:59.380291] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:16:59.380374] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-19T20:16:59.380459] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-19T20:16:59.380537] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-09-19T20:16:59.380636] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-09-19T20:16:59.380773] [INFO ] [MAIN ] Update Progress: 1483/2372 symbols completed. NI took 26.7s. Estimated remaining: 1h 58m 3s. Rate: 7.5 symbols/min [2025-09-19T20:16:59.574438] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:16:59.606934] [DEBUG] [LOCAL ] NINE: Loaded 29234 existing records from primary storage. [2025-09-19T20:16:59.607101] [INFO ] [MAIN ] NINE: Loaded 29234 existing records. [2025-09-19T20:16:59.800988] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:16:59.801249] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-19T20:16:59.801303] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-19T20:16:59.802265] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-19T20:16:59.802328] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-19T20:16:59.848404] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-19T20:17:00.170698] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:17:00.171417] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T20:17:00.643321] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-19T20:17:00.835209] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T20:17:01.443295] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-19T20:17:02.243326] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-19T20:17:02.251925] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-19T20:17:02.480759] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T20:17:03.043298] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-19T20:17:03.088479] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T20:17:03.090312] [INFO ] [REMOTE ] NIC: Full fetch complete (12093 records). [2025-09-19T20:17:03.090395] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-19T20:17:03.463915] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-19T20:17:03.464002] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-19T20:17:03.464275] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-19T20:17:03.464312] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-19T20:17:03.464802] [DEBUG] [LOCAL ] NIC: Trimmed 12093 records to 9062 (keeping 200 days of data) [2025-09-19T20:17:03.526319] [DEBUG] [LOCAL ] NIC: Primary data saved (9062 records). [2025-09-19T20:17:03.526461] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-19T20:17:03.526547] [INFO ] [MAIN ] Update Progress: 1484/2372 symbols completed. NIC took 30.9s. Estimated remaining: 1h 57m 52s. Rate: 7.5 symbols/min [2025-09-19T20:17:03.703955] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:17:03.704164] [DEBUG] [LOCAL ] NIO: No existing data file found in primary storage. [2025-09-19T20:17:03.704203] [WARN ] [MAIN ] NIO: No existing data found, performing full refresh instead. [2025-09-19T20:17:03.704368] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-19T20:17:03.704412] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-19T20:17:03.704453] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-09-19T20:17:03.704486] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-19T20:17:03.845665] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-19T20:17:03.866679] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-19T20:17:04.089153] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:17:04.643323] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-19T20:17:05.443251] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-19T20:17:05.786684] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T20:17:06.108996] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T20:17:06.243285] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-19T20:17:06.259832] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-19T20:17:07.043350] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-19T20:17:07.843326] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-19T20:17:07.921085] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T20:17:08.253497] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T20:17:08.643274] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-19T20:17:09.443264] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-19T20:17:09.671032] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T20:17:10.243301] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-19T20:17:10.501729] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T20:17:10.582064] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-19T20:17:11.043319] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-19T20:17:11.340775] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T20:17:11.843288] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-19T20:17:12.628796] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T20:17:12.643287] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-19T20:17:12.672993] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T20:17:13.443280] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-19T20:17:13.879017] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T20:17:14.242830] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T20:17:14.244115] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-19T20:17:15.043280] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-19T20:17:15.843277] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-19T20:17:15.972997] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T20:17:16.138843] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T20:17:16.643280] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-19T20:17:16.658262] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T20:17:17.443281] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-19T20:17:17.544008] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T20:17:17.545902] [INFO ] [REMOTE ] NIE: Full fetch complete (16354 records). [2025-09-19T20:17:17.545976] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-19T20:17:17.917075] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-19T20:17:17.917162] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-19T20:17:17.917559] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-19T20:17:17.917601] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-19T20:17:17.918196] [DEBUG] [LOCAL ] NIE: Trimmed 16354 records to 11831 (keeping 200 days of data) [2025-09-19T20:17:17.991036] [DEBUG] [LOCAL ] NIE: Primary data saved (11831 records). [2025-09-19T20:17:17.991181] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-19T20:17:17.991270] [INFO ] [MAIN ] Update Progress: 1485/2372 symbols completed. NIE took 25.1s. Estimated remaining: 1h 57m 48s. Rate: 7.5 symbols/min [2025-09-19T20:17:18.171582] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:17:18.171852] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-19T20:17:18.171908] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-19T20:17:18.172088] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-19T20:17:18.172151] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-19T20:17:18.172221] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-19T20:17:18.172258] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-19T20:17:18.250758] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-19T20:17:18.537233] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:17:19.043278] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-19T20:17:19.104890] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-19T20:17:19.354131] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:17:19.354464] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-19T20:17:19.843331] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-19T20:17:20.128400] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:17:20.128770] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-19T20:17:20.220124] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-19T20:17:20.643282] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-19T20:17:21.443258] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-19T20:17:22.243307] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-19T20:17:22.286851] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T20:17:22.571091] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:17:22.571436] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-19T20:17:23.043303] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-19T20:17:23.693805] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T20:17:23.843287] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-19T20:17:24.138814] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-19T20:17:24.643528] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-19T20:17:24.995320] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:17:24.995697] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-19T20:17:25.443275] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-19T20:17:25.747333] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:17:25.747742] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-19T20:17:25.961036] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T20:17:26.243306] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-19T20:17:27.043288] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-19T20:17:27.545409] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:17:27.546017] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-19T20:17:27.843314] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-19T20:17:28.643314] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-19T20:17:28.954271] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:17:28.954638] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-19T20:17:29.235690] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-09-19T20:17:29.443263] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-19T20:17:29.595552] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T20:17:29.886968] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T20:17:29.889077] [INFO ] [REMOTE ] NIM: Full fetch complete (6864 records). [2025-09-19T20:17:29.889303] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-19T20:17:30.246882] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-19T20:17:30.253288] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-19T20:17:30.254913] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-19T20:17:30.255224] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-19T20:17:30.255267] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-19T20:17:30.255750] [DEBUG] [LOCAL ] NIM: Trimmed 6864 records to 4178 (keeping 200 days of data) [2025-09-19T20:17:30.282418] [DEBUG] [LOCAL ] NIM: Primary data saved (4178 records). [2025-09-19T20:17:30.282766] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-19T20:17:30.282946] [INFO ] [MAIN ] Update Progress: 1486/2372 symbols completed. NIM took 32.7s. Estimated remaining: 1h 57m 43s. Rate: 7.5 symbols/min [2025-09-19T20:17:30.462524] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:17:30.501715] [DEBUG] [LOCAL ] NJR: Loaded 38276 existing records from primary storage. [2025-09-19T20:17:30.501885] [INFO ] [MAIN ] NJR: Loaded 38276 existing records. [2025-09-19T20:17:30.684460] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:17:30.684779] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-19T20:17:30.684832] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-19T20:17:30.686200] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-19T20:17:30.686260] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-19T20:17:31.038211] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:17:31.043238] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-19T20:17:31.773699] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T20:17:31.843299] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-19T20:17:32.643304] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-19T20:17:32.700239] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T20:17:32.715868] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T20:17:32.719302] [INFO ] [REMOTE ] NINE: Full fetch complete (44561 records). [2025-09-19T20:17:32.719389] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-19T20:17:33.102097] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-19T20:17:33.102185] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-19T20:17:33.103064] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-19T20:17:33.103128] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-19T20:17:33.104271] [DEBUG] [LOCAL ] NINE: Trimmed 44561 records to 29387 (keeping 200 days of data) [2025-09-19T20:17:33.289978] [DEBUG] [LOCAL ] NINE: Primary data saved (29387 records). [2025-09-19T20:17:33.290146] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-19T20:17:33.290254] [INFO ] [MAIN ] Update Progress: 1487/2372 symbols completed. NINE took 33.9s. Estimated remaining: 1h 57m 32s. Rate: 7.5 symbols/min [2025-09-19T20:17:33.458042] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-19T20:17:33.462172] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:17:33.463234] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-19T20:17:33.463309] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-19T20:17:33.463471] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-19T20:17:33.463519] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-19T20:17:33.463565] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-19T20:17:33.463600] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-19T20:17:33.836749] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:17:33.863255] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T20:17:34.243296] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-19T20:17:35.043304] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-19T20:17:35.843286] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-19T20:17:36.288303] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-09-19T20:17:36.441604] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T20:17:36.643271] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-19T20:17:36.802736] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T20:17:37.443315] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-19T20:17:37.944077] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T20:17:37.950544] [INFO ] [REMOTE ] NIQ: Full fetch complete (14332 records). [2025-09-19T20:17:37.950639] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-19T20:17:38.146995] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 42 unique days, need 200 days [2025-09-19T20:17:38.147358] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:17:38.147451] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:17:38.147531] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-19T20:17:38.147615] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-19T20:17:38.147713] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-19T20:17:38.147818] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-19T20:17:38.147937] [INFO ] [MAIN ] Update Progress: 1488/2372 symbols completed. NIQ took 20.2s. Estimated remaining: 1h 57m 22s. Rate: 7.5 symbols/min [2025-09-19T20:17:38.254153] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-19T20:17:38.331198] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:17:38.348381] [DEBUG] [LOCAL ] NKX: Loaded 13718 existing records from primary storage. [2025-09-19T20:17:38.348526] [INFO ] [MAIN ] NKX: Loaded 13718 existing records. [2025-09-19T20:17:38.557221] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:17:38.557547] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-19T20:17:38.557605] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-19T20:17:38.558282] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-19T20:17:38.558349] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-19T20:17:39.000414] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:17:39.034275] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-19T20:17:39.045067] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-19T20:17:39.122356] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T20:17:39.744209] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T20:17:39.843259] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-19T20:17:40.643312] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-19T20:17:40.848630] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T20:17:41.031099] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-19T20:17:41.443275] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-19T20:17:42.080893] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-19T20:17:42.243277] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-19T20:17:42.380013] [DEBUG] [REMOTE ] NKX: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-19T20:17:42.380390] [WARN ] [REMOTE ] NKX: No data returned for month 2025-03 [2025-09-19T20:17:43.043257] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-19T20:17:43.755135] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (3.11 seconds). [2025-09-19T20:17:43.843302] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-19T20:17:44.643300] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-19T20:17:44.849947] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T20:17:45.443274] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-19T20:17:45.708696] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-19T20:17:46.243315] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-19T20:17:46.873470] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (3.03 seconds). [2025-09-19T20:17:47.043357] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-19T20:17:47.339418] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T20:17:47.843291] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-19T20:17:48.073756] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-19T20:17:48.643250] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-19T20:17:48.772146] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T20:17:49.104251] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T20:17:49.443307] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-19T20:17:50.243317] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-19T20:17:51.043335] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-19T20:17:51.298313] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T20:17:51.509043] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-19T20:17:51.719171] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-19T20:17:51.843288] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-19T20:17:52.645510] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-19T20:17:52.660008] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-19T20:17:53.443284] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-19T20:17:53.752812] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T20:17:54.243269] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-19T20:17:54.536900] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-19T20:17:55.043305] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-19T20:17:55.472958] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T20:17:55.843266] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-19T20:17:56.296264] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-09-19T20:17:56.643277] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-19T20:17:56.888877] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T20:17:56.891451] [INFO ] [REMOTE ] NKX: Full fetch complete (17511 records). [2025-09-19T20:17:56.891534] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-19T20:17:57.091493] [WARN ] [VALIDATOR ] NKX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-19T20:17:57.091859] [FATAL] [MAIN ] NKX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:17:57.091933] [WARN ] [MAIN ] NKX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:17:57.092006] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-19T20:17:57.092072] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-09-19T20:17:57.092112] [INFO ] [LOCAL ] NKX: Starting deletion of derivative data. [2025-09-19T20:17:57.092604] [DEBUG] [LOCAL ] NKX: Deleted derivative data file. [2025-09-19T20:17:57.092759] [INFO ] [MAIN ] Update Progress: 1489/2372 symbols completed. NKX took 18.9s. Estimated remaining: 1h 57m 21s. Rate: 7.5 symbols/min [2025-09-19T20:17:57.268788] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:17:57.269007] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-19T20:17:57.269064] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-19T20:17:57.269209] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-19T20:17:57.269255] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-19T20:17:57.269298] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-19T20:17:57.269333] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-19T20:17:57.448429] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-19T20:17:57.687703] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:17:58.032005] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-09-19T20:17:58.243286] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-19T20:17:59.043310] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-19T20:17:59.251890] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T20:17:59.413687] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-19T20:17:59.422493] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-09-19T20:17:59.422700] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-19T20:17:59.706125] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T20:17:59.833560] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-19T20:17:59.833677] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-19T20:17:59.834714] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-19T20:17:59.834778] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-19T20:17:59.839288] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 54582 (keeping 200 days of data) [2025-09-19T20:17:59.887822] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-19T20:18:00.167076] [DEBUG] [LOCAL ] NIO: Primary data saved (54582 records). [2025-09-19T20:18:00.167251] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-19T20:18:00.167350] [INFO ] [MAIN ] Update Progress: 1490/2372 symbols completed. NIO took 56.6s. Estimated remaining: 1h 57m 10s. Rate: 7.5 symbols/min [2025-09-19T20:18:00.338547] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:00.350932] [DEBUG] [LOCAL ] NLOP: Loaded 11885 existing records from primary storage. [2025-09-19T20:18:00.351037] [INFO ] [MAIN ] NLOP: Loaded 11885 existing records. [2025-09-19T20:18:00.529044] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:18:00.529290] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-19T20:18:00.529338] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-19T20:18:00.529760] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-19T20:18:00.529822] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-19T20:18:00.650673] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-19T20:18:00.827250] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T20:18:00.913194] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:00.945597] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-19T20:18:01.443312] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-19T20:18:02.243334] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-19T20:18:02.730141] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T20:18:03.043307] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-19T20:18:03.681270] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-19T20:18:03.843296] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-19T20:18:04.643346] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-19T20:18:04.761285] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-19T20:18:04.987441] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T20:18:05.443335] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-19T20:18:06.242962] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T20:18:06.248600] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-19T20:18:06.250100] [INFO ] [REMOTE ] NJR: Full fetch complete (54167 records). [2025-09-19T20:18:06.250281] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-19T20:18:06.557536] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T20:18:06.866700] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-19T20:18:06.867004] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-19T20:18:06.868576] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-19T20:18:06.868712] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-19T20:18:06.871057] [DEBUG] [LOCAL ] NJR: Trimmed 54167 records to 38528 (keeping 200 days of data) [2025-09-19T20:18:07.054932] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-19T20:18:07.058952] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (4.02 seconds). [2025-09-19T20:18:07.236257] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T20:18:07.277599] [DEBUG] [LOCAL ] NJR: Primary data saved (38528 records). [2025-09-19T20:18:07.277848] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-19T20:18:07.278355] [INFO ] [MAIN ] Update Progress: 1491/2372 symbols completed. NJR took 37.0s. Estimated remaining: 1h 57m 1s. Rate: 7.5 symbols/min [2025-09-19T20:18:07.462525] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:07.521537] [DEBUG] [LOCAL ] NLY: Loaded 53971 existing records from primary storage. [2025-09-19T20:18:07.521822] [INFO ] [MAIN ] NLY: Loaded 53971 existing records. [2025-09-19T20:18:07.702229] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:18:07.702540] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-19T20:18:07.702591] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-19T20:18:07.704632] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-19T20:18:07.704739] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-19T20:18:07.848382] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-19T20:18:08.076678] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:08.149356] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T20:18:08.643311] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-19T20:18:09.443277] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-19T20:18:10.243296] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-19T20:18:10.502695] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T20:18:10.703440] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-19T20:18:10.819262] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T20:18:10.937690] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T20:18:11.043281] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-19T20:18:11.843300] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-19T20:18:12.643240] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-19T20:18:13.082720] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T20:18:13.131594] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-19T20:18:13.253697] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T20:18:13.443243] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-19T20:18:14.243283] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-19T20:18:15.043270] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-19T20:18:15.843325] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-19T20:18:16.231128] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-19T20:18:16.297414] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T20:18:16.643276] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-19T20:18:16.959242] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T20:18:17.443268] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-19T20:18:17.672192] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (3.43 seconds). [2025-09-19T20:18:17.681069] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-19T20:18:17.681278] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-19T20:18:17.886250] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T20:18:17.887216] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:18:17.887306] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:18:17.887392] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-19T20:18:17.887493] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-19T20:18:17.887550] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-19T20:18:17.887610] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-19T20:18:17.887734] [INFO ] [MAIN ] Update Progress: 1492/2372 symbols completed. NKE took 44.6s. Estimated remaining: 1h 56m 55s. Rate: 7.5 symbols/min [2025-09-19T20:18:18.063710] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:18.081315] [DEBUG] [LOCAL ] NMAI: Loaded 13349 existing records from primary storage. [2025-09-19T20:18:18.081479] [INFO ] [MAIN ] NMAI: Loaded 13349 existing records. [2025-09-19T20:18:18.249105] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-19T20:18:18.274871] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:18:18.275153] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-19T20:18:18.275204] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-19T20:18:18.275806] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-19T20:18:18.275878] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-19T20:18:18.654324] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:18.662611] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T20:18:19.010884] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-19T20:18:19.043227] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-19T20:18:19.094757] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T20:18:19.843284] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-19T20:18:20.500065] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T20:18:20.501313] [INFO ] [REMOTE ] NL: Full fetch complete (6969 records). [2025-09-19T20:18:20.501385] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-19T20:18:20.655296] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-19T20:18:20.700696] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T20:18:20.701443] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:18:20.701519] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:18:20.701590] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-19T20:18:20.701714] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-19T20:18:20.701770] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-19T20:18:20.701816] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-19T20:18:20.701906] [INFO ] [MAIN ] Update Progress: 1493/2372 symbols completed. NL took 23.6s. Estimated remaining: 1h 56m 44s. Rate: 7.5 symbols/min [2025-09-19T20:18:20.881671] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:20.881862] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-19T20:18:20.881901] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-19T20:18:20.882049] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-19T20:18:20.882186] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-19T20:18:20.882251] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-19T20:18:20.882285] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-19T20:18:21.264956] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:21.437156] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T20:18:21.449106] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-19T20:18:21.730775] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T20:18:21.740234] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:18:21.740451] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-19T20:18:22.243365] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-19T20:18:23.043391] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-19T20:18:23.843344] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-19T20:18:24.186055] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-19T20:18:24.496939] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:18:24.510608] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-19T20:18:24.513126] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T20:18:24.643274] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-19T20:18:25.443276] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-19T20:18:25.747538] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T20:18:25.750251] [INFO ] [REMOTE ] NLOP: Full fetch complete (17618 records). [2025-09-19T20:18:25.750335] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-19T20:18:26.124233] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-19T20:18:26.124325] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-19T20:18:26.124779] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-19T20:18:26.124840] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-19T20:18:26.125425] [DEBUG] [LOCAL ] NLOP: Trimmed 17618 records to 12008 (keeping 200 days of data) [2025-09-19T20:18:26.208419] [DEBUG] [LOCAL ] NLOP: Primary data saved (12008 records). [2025-09-19T20:18:26.208586] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-19T20:18:26.208845] [INFO ] [MAIN ] Update Progress: 1494/2372 symbols completed. NLOP took 26.0s. Estimated remaining: 1h 56m 35s. Rate: 7.5 symbols/min [2025-09-19T20:18:26.252047] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-19T20:18:26.385059] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:26.404386] [DEBUG] [LOCAL ] NMCO: Loaded 16585 existing records from primary storage. [2025-09-19T20:18:26.404572] [INFO ] [MAIN ] NMCO: Loaded 16585 existing records. [2025-09-19T20:18:26.589302] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:18:26.589575] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-19T20:18:26.589625] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-19T20:18:26.590174] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-19T20:18:26.590247] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-19T20:18:26.623035] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:18:26.656860] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-19T20:18:26.751613] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T20:18:26.985530] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:27.043263] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-19T20:18:27.843296] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-19T20:18:28.486693] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T20:18:28.643351] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-19T20:18:29.443299] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-19T20:18:29.819629] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T20:18:30.046535] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T20:18:30.048480] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-19T20:18:30.243325] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-19T20:18:31.043296] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-19T20:18:31.843330] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-19T20:18:32.305614] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T20:18:32.573994] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-19T20:18:32.643291] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-19T20:18:33.240586] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T20:18:33.443275] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-19T20:18:34.243312] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-19T20:18:34.447608] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T20:18:34.824259] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T20:18:35.043295] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-19T20:18:35.843300] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-19T20:18:36.302941] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T20:18:36.518996] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T20:18:36.643339] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-19T20:18:36.919440] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-19T20:18:37.443284] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-19T20:18:38.243298] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-19T20:18:38.722913] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T20:18:38.808876] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T20:18:38.818563] [INFO ] [REMOTE ] NLY: Full fetch complete (77555 records). [2025-09-19T20:18:38.818784] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-19T20:18:39.048610] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-19T20:18:39.266923] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-19T20:18:39.267050] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-19T20:18:39.268743] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-19T20:18:39.268894] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-19T20:18:39.271563] [DEBUG] [LOCAL ] NLY: Trimmed 77555 records to 54361 (keeping 200 days of data) [2025-09-19T20:18:39.630400] [DEBUG] [LOCAL ] NLY: Primary data saved (54361 records). [2025-09-19T20:18:39.630551] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-19T20:18:39.631245] [INFO ] [MAIN ] Update Progress: 1495/2372 symbols completed. NLY took 32.4s. Estimated remaining: 1h 56m 30s. Rate: 7.5 symbols/min [2025-09-19T20:18:39.816516] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:39.830552] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T20:18:39.841291] [DEBUG] [LOCAL ] NMG: Loaded 7492 existing records from primary storage. [2025-09-19T20:18:39.841428] [INFO ] [MAIN ] NMG: Loaded 7492 existing records. [2025-09-19T20:18:39.853306] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-19T20:18:40.054608] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:18:40.054917] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-19T20:18:40.054988] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-19T20:18:40.055357] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-19T20:18:40.055462] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-19T20:18:40.416370] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:40.481671] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T20:18:40.629823] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T20:18:40.643234] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-19T20:18:41.443275] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-19T20:18:42.243305] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-19T20:18:42.640977] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-19T20:18:42.867351] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-19T20:18:43.043269] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-19T20:18:43.443607] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T20:18:43.843298] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-19T20:18:44.643247] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-19T20:18:44.679152] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T20:18:44.758564] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T20:18:45.443318] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-19T20:18:45.844875] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T20:18:46.107009] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-19T20:18:46.243289] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-19T20:18:47.043315] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-19T20:18:47.639891] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T20:18:47.843255] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-19T20:18:48.199534] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T20:18:48.202250] [INFO ] [REMOTE ] NMAI: Full fetch complete (20031 records). [2025-09-19T20:18:48.202322] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-19T20:18:48.570152] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-19T20:18:48.570291] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-19T20:18:48.570751] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-19T20:18:48.570810] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-19T20:18:48.571381] [DEBUG] [LOCAL ] NMAI: Trimmed 20031 records to 13451 (keeping 200 days of data) [2025-09-19T20:18:48.643386] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-19T20:18:48.672713] [DEBUG] [LOCAL ] NMAI: Primary data saved (13451 records). [2025-09-19T20:18:48.672869] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-19T20:18:48.672983] [INFO ] [MAIN ] Update Progress: 1496/2372 symbols completed. NMAI took 30.8s. Estimated remaining: 1h 56m 22s. Rate: 7.5 symbols/min [2025-09-19T20:18:48.847741] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:48.854684] [DEBUG] [LOCAL ] NMI: Loaded 4138 existing records from primary storage. [2025-09-19T20:18:48.854796] [INFO ] [MAIN ] NMI: Loaded 4138 existing records. [2025-09-19T20:18:49.029241] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:18:49.029454] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-19T20:18:49.029501] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-19T20:18:49.029820] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-19T20:18:49.029880] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-19T20:18:49.222143] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T20:18:49.427040] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:49.443278] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-19T20:18:50.243363] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-19T20:18:50.367603] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T20:18:50.685513] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T20:18:51.043345] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-19T20:18:51.180890] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T20:18:51.843331] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-19T20:18:52.076677] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T20:18:52.643283] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-19T20:18:53.130941] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T20:18:53.443300] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-19T20:18:53.503971] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-19T20:18:54.243247] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-19T20:18:54.577701] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T20:18:54.582138] [INFO ] [REMOTE ] NMCO: Full fetch complete (24569 records). [2025-09-19T20:18:54.582245] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-19T20:18:54.973771] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-19T20:18:54.973974] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-19T20:18:54.974589] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-19T20:18:54.974630] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-19T20:18:54.975340] [DEBUG] [LOCAL ] NMCO: Trimmed 24569 records to 16688 (keeping 200 days of data) [2025-09-19T20:18:55.062750] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-19T20:18:55.097545] [DEBUG] [LOCAL ] NMCO: Primary data saved (16688 records). [2025-09-19T20:18:55.097728] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-19T20:18:55.097865] [INFO ] [MAIN ] Update Progress: 1497/2372 symbols completed. NMCO took 28.9s. Estimated remaining: 1h 56m 14s. Rate: 7.5 symbols/min [2025-09-19T20:18:55.258831] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T20:18:55.288608] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:55.306192] [DEBUG] [LOCAL ] NMM: Loaded 14426 existing records from primary storage. [2025-09-19T20:18:55.306398] [INFO ] [MAIN ] NMM: Loaded 14426 existing records. [2025-09-19T20:18:55.493275] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:18:55.493539] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-19T20:18:55.493590] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-19T20:18:55.494178] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-19T20:18:55.494240] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-19T20:18:55.836095] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T20:18:55.845165] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-19T20:18:55.876601] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:56.643265] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-19T20:18:56.773345] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T20:18:57.443273] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-19T20:18:58.243288] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-19T20:18:58.375532] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T20:18:58.494756] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T20:18:58.501300] [INFO ] [REMOTE ] NMAX: Full fetch complete (39389 records). [2025-09-19T20:18:58.501434] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-19T20:18:58.693477] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 120 unique days, need 200 days [2025-09-19T20:18:58.695176] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:18:58.695249] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:18:58.695299] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-19T20:18:58.695369] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-19T20:18:58.695444] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-19T20:18:58.695513] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-19T20:18:58.695593] [INFO ] [MAIN ] Update Progress: 1498/2372 symbols completed. NMAX took 38.0s. Estimated remaining: 1h 56m 3s. Rate: 7.5 symbols/min [2025-09-19T20:18:58.807153] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T20:18:58.872126] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:18:58.913686] [DEBUG] [LOCAL ] NMR: Loaded 35528 existing records from primary storage. [2025-09-19T20:18:58.913859] [INFO ] [MAIN ] NMR: Loaded 35528 existing records. [2025-09-19T20:18:59.054350] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-19T20:18:59.096684] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:18:59.097014] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-19T20:18:59.097087] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-19T20:18:59.098286] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-19T20:18:59.098349] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-19T20:18:59.460724] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:18:59.843295] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-19T20:18:59.866804] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-19T20:19:00.643342] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-19T20:19:01.255242] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T20:19:01.443359] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-19T20:19:01.473033] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T20:19:02.243329] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-19T20:19:02.974637] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T20:19:03.014055] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T20:19:03.043257] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-19T20:19:03.728172] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T20:19:03.843271] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-19T20:19:04.643290] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-19T20:19:05.452036] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-19T20:19:05.456972] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T20:19:05.855345] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T20:19:06.243258] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-19T20:19:06.345349] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T20:19:07.043288] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-19T20:19:07.052335] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T20:19:07.843299] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-19T20:19:08.095692] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T20:19:08.537495] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T20:19:08.643341] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-19T20:19:09.443301] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-19T20:19:09.899288] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T20:19:10.243306] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-19T20:19:10.372858] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T20:19:10.374661] [INFO ] [REMOTE ] NMG: Full fetch complete (12943 records). [2025-09-19T20:19:10.374755] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-19T20:19:10.735330] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-19T20:19:10.735415] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-19T20:19:10.735772] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-19T20:19:10.735835] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-19T20:19:10.736318] [DEBUG] [LOCAL ] NMG: Trimmed 12943 records to 7572 (keeping 200 days of data) [2025-09-19T20:19:10.780115] [DEBUG] [LOCAL ] NMG: Primary data saved (7572 records). [2025-09-19T20:19:10.780263] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-19T20:19:10.780382] [INFO ] [MAIN ] Update Progress: 1499/2372 symbols completed. NMG took 31.1s. Estimated remaining: 1h 55m 58s. Rate: 7.5 symbols/min [2025-09-19T20:19:11.004846] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:19:11.010908] [DEBUG] [LOCAL ] NMS: Loaded 2887 existing records from primary storage. [2025-09-19T20:19:11.011002] [INFO ] [MAIN ] NMS: Loaded 2887 existing records. [2025-09-19T20:19:11.044086] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-19T20:19:11.217262] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:19:11.217515] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-19T20:19:11.217563] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-19T20:19:11.217935] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-19T20:19:11.217994] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-19T20:19:11.436729] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T20:19:11.601306] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:19:11.843295] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-19T20:19:12.643275] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-19T20:19:12.784686] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T20:19:12.807887] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T20:19:13.443269] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-19T20:19:13.456771] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T20:19:13.458104] [INFO ] [REMOTE ] NMI: Full fetch complete (6302 records). [2025-09-19T20:19:13.458174] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-19T20:19:13.838122] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-19T20:19:13.838201] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-19T20:19:13.838367] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-19T20:19:13.838404] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-19T20:19:13.838821] [DEBUG] [LOCAL ] NMI: Trimmed 6302 records to 4156 (keeping 200 days of data) [2025-09-19T20:19:13.867386] [DEBUG] [LOCAL ] NMI: Primary data saved (4156 records). [2025-09-19T20:19:13.867474] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-19T20:19:13.867567] [INFO ] [MAIN ] Update Progress: 1500/2372 symbols completed. NMI took 25.2s. Estimated remaining: 1h 55m 47s. Rate: 7.5 symbols/min [2025-09-19T20:19:14.040683] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:19:14.045273] [DEBUG] [LOCAL ] NMT: Loaded 2839 existing records from primary storage. [2025-09-19T20:19:14.045365] [INFO ] [MAIN ] NMT: Loaded 2839 existing records. [2025-09-19T20:19:14.227870] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-19T20:19:14.233336] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:19:14.236478] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-19T20:19:14.236546] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-19T20:19:14.236806] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-19T20:19:14.236865] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-19T20:19:14.248501] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-19T20:19:14.612752] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:19:14.948537] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T20:19:15.043280] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-19T20:19:15.843307] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-19T20:19:16.108772] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-19T20:19:16.301320] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-19T20:19:16.643281] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-19T20:19:17.443257] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-19T20:19:17.840127] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T20:19:18.243282] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-19T20:19:18.307112] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T20:19:19.043287] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-19T20:19:19.325689] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T20:19:19.843336] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-19T20:19:20.524396] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T20:19:20.643307] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-19T20:19:20.806484] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T20:19:21.282126] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-19T20:19:21.443308] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-19T20:19:22.048862] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T20:19:22.243358] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-19T20:19:22.795788] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T20:19:23.043264] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-19T20:19:23.843293] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-19T20:19:24.643319] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-19T20:19:24.759338] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-19T20:19:24.783129] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T20:19:25.310425] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T20:19:25.443291] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-19T20:19:26.114289] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T20:19:26.243276] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-19T20:19:27.026597] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-19T20:19:27.043352] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-19T20:19:27.843352] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-19T20:19:28.557966] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T20:19:28.643327] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-19T20:19:29.443280] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-19T20:19:29.693952] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T20:19:29.695329] [INFO ] [REMOTE ] NMS: Full fetch complete (4024 records). [2025-09-19T20:19:29.695549] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-19T20:19:30.000846] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T20:19:30.122907] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-19T20:19:30.123023] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-19T20:19:30.123186] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-19T20:19:30.123282] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-19T20:19:30.123748] [DEBUG] [LOCAL ] NMS: Trimmed 4024 records to 2899 (keeping 200 days of data) [2025-09-19T20:19:30.142363] [DEBUG] [LOCAL ] NMS: Primary data saved (2899 records). [2025-09-19T20:19:30.142490] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-19T20:19:30.142636] [INFO ] [MAIN ] Update Progress: 1501/2372 symbols completed. NMS took 19.4s. Estimated remaining: 1h 55m 44s. Rate: 7.5 symbols/min [2025-09-19T20:19:30.245983] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-19T20:19:30.256923] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T20:19:30.322271] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:19:30.344094] [DEBUG] [LOCAL ] NMZ: Loaded 21608 existing records from primary storage. [2025-09-19T20:19:30.344233] [INFO ] [MAIN ] NMZ: Loaded 21608 existing records. [2025-09-19T20:19:30.526680] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:19:30.526979] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-19T20:19:30.527053] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-19T20:19:30.528116] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-19T20:19:30.528177] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-19T20:19:30.894532] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:19:31.043298] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-19T20:19:31.843283] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-19T20:19:31.878825] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T20:19:32.138794] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T20:19:32.141243] [INFO ] [REMOTE ] NMM: Full fetch complete (22483 records). [2025-09-19T20:19:32.141316] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-19T20:19:32.539867] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-19T20:19:32.539946] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-19T20:19:32.540408] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-19T20:19:32.540446] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-19T20:19:32.541045] [DEBUG] [LOCAL ] NMM: Trimmed 22483 records to 14541 (keeping 200 days of data) [2025-09-19T20:19:32.631351] [DEBUG] [LOCAL ] NMM: Primary data saved (14541 records). [2025-09-19T20:19:32.631511] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-19T20:19:32.631604] [INFO ] [MAIN ] Update Progress: 1502/2372 symbols completed. NMM took 37.5s. Estimated remaining: 1h 55m 32s. Rate: 7.5 symbols/min [2025-09-19T20:19:32.652274] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-19T20:19:32.810094] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:19:32.821404] [DEBUG] [LOCAL ] NNI: Loaded 9909 existing records from primary storage. [2025-09-19T20:19:32.821509] [INFO ] [MAIN ] NNI: Loaded 9909 existing records. [2025-09-19T20:19:33.005403] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:19:33.005768] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-19T20:19:33.005827] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-19T20:19:33.006353] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-19T20:19:33.006413] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-19T20:19:33.390771] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:19:33.405749] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T20:19:33.443225] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-19T20:19:34.195953] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T20:19:34.243332] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-19T20:19:34.334708] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T20:19:35.043325] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-19T20:19:35.196865] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T20:19:35.843346] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-19T20:19:36.643291] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-19T20:19:37.045707] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T20:19:37.193314] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T20:19:37.443315] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-19T20:19:37.539221] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T20:19:37.995493] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-19T20:19:38.243332] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-19T20:19:39.043304] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-19T20:19:39.512960] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T20:19:39.742838] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T20:19:39.843295] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-19T20:19:40.643313] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-19T20:19:41.142629] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T20:19:41.443274] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-19T20:19:42.243291] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-19T20:19:42.318673] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T20:19:42.342435] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T20:19:43.043337] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-19T20:19:43.175798] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T20:19:43.843290] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-19T20:19:44.448794] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T20:19:44.454053] [INFO ] [REMOTE ] NMR: Full fetch complete (50234 records). [2025-09-19T20:19:44.454150] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-19T20:19:44.649636] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-19T20:19:44.823014] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T20:19:44.860881] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-19T20:19:44.860969] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-19T20:19:44.861994] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-19T20:19:44.862056] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-19T20:19:44.863456] [DEBUG] [LOCAL ] NMR: Trimmed 50234 records to 35725 (keeping 200 days of data) [2025-09-19T20:19:45.115099] [DEBUG] [LOCAL ] NMR: Primary data saved (35725 records). [2025-09-19T20:19:45.115295] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-19T20:19:45.115399] [INFO ] [MAIN ] Update Progress: 1503/2372 symbols completed. NMR took 46.4s. Estimated remaining: 1h 55m 27s. Rate: 7.5 symbols/min [2025-09-19T20:19:45.288679] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:19:45.337166] [DEBUG] [LOCAL ] NNN: Loaded 48812 existing records from primary storage. [2025-09-19T20:19:45.337313] [INFO ] [MAIN ] NNN: Loaded 48812 existing records. [2025-09-19T20:19:45.442514] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T20:19:45.448043] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-19T20:19:45.484351] [INFO ] [REMOTE ] NMT: Full fetch complete (4306 records). [2025-09-19T20:19:45.520958] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-19T20:19:45.558594] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:19:45.609393] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-19T20:19:45.620137] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-19T20:19:45.637716] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-19T20:19:45.648048] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-19T20:19:46.206566] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-19T20:19:46.207036] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-19T20:19:46.212752] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-19T20:19:46.223189] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-19T20:19:46.229296] [DEBUG] [LOCAL ] NMT: Trimmed 4306 records to 2857 (keeping 200 days of data) [2025-09-19T20:19:46.259952] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-19T20:19:46.311485] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:19:46.315462] [DEBUG] [LOCAL ] NMT: Primary data saved (2857 records). [2025-09-19T20:19:46.315675] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-19T20:19:46.315863] [INFO ] [MAIN ] Update Progress: 1504/2372 symbols completed. NMT took 32.4s. Estimated remaining: 1h 55m 15s. Rate: 7.5 symbols/min [2025-09-19T20:19:46.490910] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:19:46.498703] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T20:19:46.506552] [DEBUG] [LOCAL ] NNY: Loaded 5753 existing records from primary storage. [2025-09-19T20:19:46.506709] [INFO ] [MAIN ] NNY: Loaded 5753 existing records. [2025-09-19T20:19:46.685293] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:19:46.685611] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-19T20:19:46.685703] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-19T20:19:46.686082] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-19T20:19:46.686145] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-19T20:19:47.048387] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-19T20:19:47.048286] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:19:47.843292] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-19T20:19:47.926316] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T20:19:48.370120] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T20:19:48.643282] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-19T20:19:48.939723] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T20:19:49.443246] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-19T20:19:49.862739] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T20:19:50.085067] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-19T20:19:50.243306] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-19T20:19:51.043291] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-19T20:19:51.637397] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T20:19:51.843292] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-19T20:19:52.643295] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-19T20:19:52.666784] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T20:19:53.040737] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T20:19:53.298833] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T20:19:53.443289] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-19T20:19:54.243325] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-19T20:19:55.008301] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T20:19:55.043240] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-19T20:19:55.069574] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T20:19:55.843291] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-19T20:19:56.294038] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T20:19:56.643275] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-19T20:19:57.443328] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-19T20:19:57.802480] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T20:19:57.879147] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T20:19:58.243301] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-19T20:19:58.821071] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T20:19:58.825069] [INFO ] [REMOTE ] NMZ: Full fetch complete (31856 records). [2025-09-19T20:19:58.825208] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-19T20:19:59.048366] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-19T20:19:59.212583] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-19T20:19:59.212697] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-19T20:19:59.213394] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-19T20:19:59.213454] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-19T20:19:59.214255] [DEBUG] [LOCAL ] NMZ: Trimmed 31856 records to 21695 (keeping 200 days of data) [2025-09-19T20:19:59.346912] [DEBUG] [LOCAL ] NMZ: Primary data saved (21695 records). [2025-09-19T20:19:59.347053] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-19T20:19:59.347141] [INFO ] [MAIN ] Update Progress: 1505/2372 symbols completed. NMZ took 29.2s. Estimated remaining: 1h 55m 10s. Rate: 7.5 symbols/min [2025-09-19T20:19:59.525915] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:19:59.545950] [DEBUG] [LOCAL ] NOA: Loaded 16596 existing records from primary storage. [2025-09-19T20:19:59.546083] [INFO ] [MAIN ] NOA: Loaded 16596 existing records. [2025-09-19T20:19:59.727041] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:19:59.727328] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-19T20:19:59.727420] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-19T20:19:59.728140] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-19T20:19:59.728201] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-19T20:19:59.848378] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-19T20:20:00.040905] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T20:20:00.140838] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:20:00.239769] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T20:20:00.643307] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-19T20:20:00.929460] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T20:20:01.443274] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-19T20:20:02.243319] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-19T20:20:03.043338] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-19T20:20:05.128101] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (4.48 seconds). [2025-09-19T20:20:05.130270] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-19T20:20:05.819592] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (4.38 seconds). [2025-09-19T20:20:05.823360] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-19T20:20:05.921035] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (3.68 seconds). [2025-09-19T20:20:05.923618] [INFO ] [REMOTE ] NNI: Full fetch complete (12508 records). [2025-09-19T20:20:05.923728] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-19T20:20:06.308899] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-19T20:20:06.308977] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-19T20:20:06.309278] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-19T20:20:06.309316] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-19T20:20:06.309851] [DEBUG] [LOCAL ] NNI: Trimmed 12508 records to 9997 (keeping 200 days of data) [2025-09-19T20:20:06.378945] [DEBUG] [LOCAL ] NNI: Primary data saved (9997 records). [2025-09-19T20:20:06.379106] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-19T20:20:06.379199] [INFO ] [MAIN ] Update Progress: 1506/2372 symbols completed. NNI took 33.7s. Estimated remaining: 1h 55m 2s. Rate: 7.5 symbols/min [2025-09-19T20:20:06.488714] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T20:20:06.506823] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-19T20:20:06.569458] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:20:06.580858] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T20:20:06.589796] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-19T20:20:06.610183] [DEBUG] [LOCAL ] NOAH: Loaded 20179 existing records from primary storage. [2025-09-19T20:20:06.610383] [INFO ] [MAIN ] NOAH: Loaded 20179 existing records. [2025-09-19T20:20:06.821794] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:20:06.822536] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-19T20:20:06.822604] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-19T20:20:06.833388] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-19T20:20:06.850639] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-19T20:20:06.936739] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (3.89 seconds). [2025-09-19T20:20:07.045619] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-19T20:20:07.234169] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:20:07.447973] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T20:20:07.627528] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T20:20:07.843289] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-19T20:20:08.643295] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-19T20:20:08.789197] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T20:20:09.131513] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T20:20:09.443266] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-19T20:20:10.244393] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-19T20:20:10.256344] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T20:20:10.268073] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-19T20:20:11.043287] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-19T20:20:11.843290] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-19T20:20:12.191793] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T20:20:12.398611] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T20:20:12.643240] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-19T20:20:13.194419] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T20:20:13.443282] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-19T20:20:14.243296] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-19T20:20:14.729291] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T20:20:14.785026] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-19T20:20:14.786771] [INFO ] [REMOTE ] NNY: Full fetch complete (9016 records). [2025-09-19T20:20:14.786843] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-19T20:20:15.048506] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-19T20:20:15.147590] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T20:20:15.197170] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-19T20:20:15.197253] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-19T20:20:15.197496] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-19T20:20:15.197535] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-19T20:20:15.197998] [DEBUG] [LOCAL ] NNY: Trimmed 9016 records to 5772 (keeping 200 days of data) [2025-09-19T20:20:15.233136] [DEBUG] [LOCAL ] NNY: Primary data saved (5772 records). [2025-09-19T20:20:15.233312] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-19T20:20:15.233432] [INFO ] [MAIN ] Update Progress: 1507/2372 symbols completed. NNY took 28.9s. Estimated remaining: 1h 54m 54s. Rate: 7.5 symbols/min [2025-09-19T20:20:15.415458] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:20:15.464027] [DEBUG] [LOCAL ] NOC: Loaded 43208 existing records from primary storage. [2025-09-19T20:20:15.464241] [INFO ] [MAIN ] NOC: Loaded 43208 existing records. [2025-09-19T20:20:15.699394] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:20:15.699740] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-19T20:20:15.699796] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-19T20:20:15.701067] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-19T20:20:15.701127] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-19T20:20:15.848342] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-19T20:20:16.072916] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:20:16.643282] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-19T20:20:17.265672] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T20:20:17.286163] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T20:20:17.443263] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-19T20:20:17.887189] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T20:20:18.243279] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-19T20:20:19.043308] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-19T20:20:19.327275] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T20:20:19.334496] [INFO ] [REMOTE ] NNN: Full fetch complete (70131 records). [2025-09-19T20:20:19.334625] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-19T20:20:19.723242] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T20:20:19.750445] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-19T20:20:19.750845] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-19T20:20:19.751830] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-19T20:20:19.751893] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-19T20:20:19.753146] [DEBUG] [LOCAL ] NNN: Trimmed 70131 records to 49131 (keeping 200 days of data) [2025-09-19T20:20:19.850328] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-19T20:20:20.070730] [DEBUG] [LOCAL ] NNN: Primary data saved (49131 records). [2025-09-19T20:20:20.070896] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-19T20:20:20.070987] [INFO ] [MAIN ] Update Progress: 1508/2372 symbols completed. NNN took 35.0s. Estimated remaining: 1h 54m 44s. Rate: 7.5 symbols/min [2025-09-19T20:20:20.255350] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:20:20.263862] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T20:20:20.315571] [DEBUG] [LOCAL ] NOG: Loaded 51549 existing records from primary storage. [2025-09-19T20:20:20.315741] [INFO ] [MAIN ] NOG: Loaded 51549 existing records. [2025-09-19T20:20:20.504231] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:20:20.504512] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-19T20:20:20.504572] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-19T20:20:20.505714] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-19T20:20:20.505778] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-19T20:20:20.649616] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-19T20:20:20.864895] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:20:21.408201] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T20:20:21.443241] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-19T20:20:22.089487] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T20:20:22.147517] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T20:20:22.243323] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-19T20:20:23.043294] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-19T20:20:23.843284] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-19T20:20:24.195785] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T20:20:24.511530] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T20:20:24.643300] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-19T20:20:25.443292] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-19T20:20:25.826847] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T20:20:26.067268] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T20:20:26.243293] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-19T20:20:26.423068] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T20:20:27.043339] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-19T20:20:27.843277] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-19T20:20:28.166868] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T20:20:28.170005] [INFO ] [REMOTE ] NOA: Full fetch complete (21725 records). [2025-09-19T20:20:28.170125] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-19T20:20:28.571865] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-19T20:20:28.572052] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-19T20:20:28.572696] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-19T20:20:28.572780] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-19T20:20:28.573957] [DEBUG] [LOCAL ] NOA: Trimmed 21725 records to 16673 (keeping 200 days of data) [2025-09-19T20:20:28.647855] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-19T20:20:28.681379] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-19T20:20:28.718459] [DEBUG] [LOCAL ] NOA: Primary data saved (16673 records). [2025-09-19T20:20:28.718613] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-19T20:20:28.718744] [INFO ] [MAIN ] Update Progress: 1509/2372 symbols completed. NOA took 29.4s. Estimated remaining: 1h 54m 37s. Rate: 7.5 symbols/min [2025-09-19T20:20:28.895470] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:20:28.948925] [DEBUG] [LOCAL ] NOK: Loaded 54011 existing records from primary storage. [2025-09-19T20:20:28.949076] [INFO ] [MAIN ] NOK: Loaded 54011 existing records. [2025-09-19T20:20:29.129897] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:20:29.130445] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-19T20:20:29.130551] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-19T20:20:29.140548] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-19T20:20:29.140720] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-19T20:20:29.146951] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T20:20:29.448363] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-19T20:20:29.524387] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:20:30.243285] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-19T20:20:30.677033] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T20:20:30.755054] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T20:20:31.043308] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-19T20:20:31.843286] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-19T20:20:32.191554] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T20:20:32.643267] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-19T20:20:33.196624] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T20:20:33.308775] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T20:20:33.443248] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-19T20:20:33.962724] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T20:20:33.966937] [INFO ] [REMOTE ] NOAH: Full fetch complete (28885 records). [2025-09-19T20:20:33.967025] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-19T20:20:34.248511] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-19T20:20:34.367413] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-19T20:20:34.367505] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-19T20:20:34.368181] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-19T20:20:34.368245] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-19T20:20:34.369158] [DEBUG] [LOCAL ] NOAH: Trimmed 28885 records to 20306 (keeping 200 days of data) [2025-09-19T20:20:34.498230] [DEBUG] [LOCAL ] NOAH: Primary data saved (20306 records). [2025-09-19T20:20:34.498380] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-19T20:20:34.498470] [INFO ] [MAIN ] Update Progress: 1510/2372 symbols completed. NOAH took 28.1s. Estimated remaining: 1h 54m 28s. Rate: 7.5 symbols/min [2025-09-19T20:20:34.672408] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:20:34.672577] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-19T20:20:34.672613] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-19T20:20:34.672776] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-19T20:20:34.672818] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-19T20:20:34.672858] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-19T20:20:34.672889] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-19T20:20:35.027231] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:20:35.043250] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-19T20:20:35.347310] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T20:20:35.843269] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-19T20:20:35.963874] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T20:20:36.282862] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T20:20:36.643319] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-19T20:20:37.443363] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-19T20:20:38.243277] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-19T20:20:38.322192] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T20:20:38.714807] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-19T20:20:38.959701] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-19T20:20:39.043284] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-19T20:20:39.463135] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T20:20:39.754258] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T20:20:39.843296] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-19T20:20:40.643324] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-19T20:20:41.170126] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T20:20:41.443338] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-19T20:20:42.066749] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-19T20:20:42.070332] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T20:20:42.243288] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-19T20:20:43.043310] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-19T20:20:43.843326] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-19T20:20:44.317154] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-19T20:20:44.329743] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-19T20:20:44.643284] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-19T20:20:45.139045] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-19T20:20:45.443292] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-19T20:20:45.892013] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-19T20:20:46.050373] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T20:20:46.243340] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-19T20:20:47.043379] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-19T20:20:47.843354] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-19T20:20:48.333028] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T20:20:48.463068] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-19T20:20:48.643335] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-19T20:20:49.443339] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-19T20:20:49.771985] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-19T20:20:50.243289] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-19T20:20:50.663341] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T20:20:51.043331] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-19T20:20:51.523875] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-19T20:20:51.524817] [INFO ] [REMOTE ] NOM: Full fetch complete (1719 records). [2025-09-19T20:20:51.524887] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-19T20:20:51.716156] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-19T20:20:51.716838] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:20:51.716925] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:20:51.732533] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-19T20:20:51.744110] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-19T20:20:51.744364] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-19T20:20:51.744952] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-19T20:20:51.746381] [INFO ] [MAIN ] Update Progress: 1511/2372 symbols completed. NOM took 17.2s. Estimated remaining: 1h 54m 25s. Rate: 7.5 symbols/min [2025-09-19T20:20:51.746195] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T20:20:51.850487] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-19T20:20:51.951249] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:20:52.005707] [DEBUG] [LOCAL ] NOMD: Loaded 41837 existing records from primary storage. [2025-09-19T20:20:52.005872] [INFO ] [MAIN ] NOMD: Loaded 41837 existing records. [2025-09-19T20:20:52.195801] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:20:52.196254] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-19T20:20:52.196365] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-19T20:20:52.197616] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-19T20:20:52.197731] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-19T20:20:52.394101] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T20:20:52.611162] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:20:52.643235] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-19T20:20:53.443267] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-19T20:20:54.054342] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T20:20:54.243292] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-19T20:20:54.409637] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T20:20:55.043338] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-19T20:20:55.618868] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T20:20:55.843338] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-19T20:20:56.138235] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T20:20:56.446399] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T20:20:56.643307] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-19T20:20:57.443326] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-19T20:20:58.243344] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-19T20:20:58.324110] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-19T20:20:58.448061] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T20:20:59.043291] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-19T20:20:59.343079] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T20:20:59.353859] [INFO ] [REMOTE ] NOG: Full fetch complete (73520 records). [2025-09-19T20:20:59.354063] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-19T20:20:59.780867] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-19T20:20:59.781008] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-19T20:20:59.782932] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-19T20:20:59.783047] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-19T20:20:59.785571] [DEBUG] [LOCAL ] NOG: Trimmed 73520 records to 51936 (keeping 200 days of data) [2025-09-19T20:20:59.850762] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-19T20:21:00.152769] [DEBUG] [LOCAL ] NOG: Primary data saved (51936 records). [2025-09-19T20:21:00.152950] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-19T20:21:00.153137] [INFO ] [MAIN ] Update Progress: 1512/2372 symbols completed. NOG took 40.1s. Estimated remaining: 1h 54m 17s. Rate: 7.5 symbols/min [2025-09-19T20:21:00.337284] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:00.378804] [DEBUG] [LOCAL ] NOTE: Loaded 43675 existing records from primary storage. [2025-09-19T20:21:00.378951] [INFO ] [MAIN ] NOTE: Loaded 43675 existing records. [2025-09-19T20:21:00.572065] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:21:00.572749] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-19T20:21:00.572825] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-19T20:21:00.573830] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-19T20:21:00.573917] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-19T20:21:00.680701] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-19T20:21:00.730956] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-19T20:21:01.000379] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:01.026688] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T20:21:01.443304] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-19T20:21:02.243313] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-19T20:21:02.712939] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-19T20:21:02.778220] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T20:21:02.787276] [INFO ] [REMOTE ] NOC: Full fetch complete (62203 records). [2025-09-19T20:21:02.787458] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-19T20:21:03.054091] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-19T20:21:03.227931] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-19T20:21:03.228025] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-19T20:21:03.228930] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-19T20:21:03.228998] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-19T20:21:03.230331] [DEBUG] [LOCAL ] NOC: Trimmed 62203 records to 43509 (keeping 200 days of data) [2025-09-19T20:21:03.528533] [DEBUG] [LOCAL ] NOC: Primary data saved (43509 records). [2025-09-19T20:21:03.528701] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-19T20:21:03.528832] [INFO ] [MAIN ] Update Progress: 1513/2372 symbols completed. NOC took 48.3s. Estimated remaining: 1h 54m 7s. Rate: 7.5 symbols/min [2025-09-19T20:21:03.719965] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:03.781098] [DEBUG] [LOCAL ] NOV: Loaded 53579 existing records from primary storage. [2025-09-19T20:21:03.781254] [INFO ] [MAIN ] NOV: Loaded 53579 existing records. [2025-09-19T20:21:03.986087] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:21:03.986439] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-19T20:21:03.986497] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-19T20:21:03.988037] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-19T20:21:03.988144] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-19T20:21:04.349176] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:04.349533] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-19T20:21:05.368965] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (3.93 seconds). [2025-09-19T20:21:05.379598] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-19T20:21:05.668634] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-19T20:21:05.679352] [INFO ] [REMOTE ] NOK: Full fetch complete (77632 records). [2025-09-19T20:21:05.679543] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-19T20:21:06.103977] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-19T20:21:06.119714] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-19T20:21:06.120958] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-19T20:21:06.121105] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-19T20:21:06.130287] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (3.89 seconds). [2025-09-19T20:21:06.141143] [DEBUG] [LOCAL ] NOK: Trimmed 77632 records to 54401 (keeping 200 days of data) [2025-09-19T20:21:06.142056] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-19T20:21:06.265538] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T20:21:06.278194] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-19T20:21:06.515131] [DEBUG] [LOCAL ] NOK: Primary data saved (54401 records). [2025-09-19T20:21:06.515307] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-19T20:21:06.516620] [INFO ] [MAIN ] Update Progress: 1514/2372 symbols completed. NOK took 37.8s. Estimated remaining: 1h 53m 56s. Rate: 7.5 symbols/min [2025-09-19T20:21:06.695486] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:06.695715] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-09-19T20:21:06.695767] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-19T20:21:06.695937] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-19T20:21:06.695980] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-19T20:21:06.696021] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-19T20:21:06.696053] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-19T20:21:07.054797] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:07.055142] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-19T20:21:07.349342] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T20:21:07.814138] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T20:21:07.843296] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-19T20:21:08.555211] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-19T20:21:08.643279] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-19T20:21:09.400053] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T20:21:09.443248] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-19T20:21:09.511372] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T20:21:10.243271] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-19T20:21:10.320213] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T20:21:11.043309] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-19T20:21:11.744425] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-19T20:21:11.843296] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-19T20:21:12.550323] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T20:21:12.630362] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-19T20:21:12.643232] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-19T20:21:13.443280] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-19T20:21:13.660270] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T20:21:14.227996] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T20:21:14.243296] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-19T20:21:15.043297] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-19T20:21:15.782533] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-19T20:21:15.843245] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-19T20:21:15.899049] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T20:21:16.643306] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-19T20:21:17.443327] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-19T20:21:18.073796] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-09-19T20:21:18.243288] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-19T20:21:18.742324] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-09-19T20:21:19.043267] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-19T20:21:19.316885] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T20:21:19.657425] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-09-19T20:21:19.843251] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-19T20:21:20.471984] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T20:21:20.643300] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-19T20:21:21.443270] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-19T20:21:21.562295] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T20:21:21.569844] [INFO ] [REMOTE ] NOMD: Full fetch complete (58817 records). [2025-09-19T20:21:21.570134] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-19T20:21:21.808705] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-19T20:21:22.017881] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-19T20:21:22.017977] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-19T20:21:22.018866] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-19T20:21:22.018934] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-19T20:21:22.022676] [DEBUG] [LOCAL ] NOMD: Trimmed 58817 records to 42179 (keeping 200 days of data) [2025-09-19T20:21:22.247499] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-19T20:21:22.296036] [DEBUG] [LOCAL ] NOMD: Primary data saved (42179 records). [2025-09-19T20:21:22.296217] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-19T20:21:22.296304] [INFO ] [MAIN ] Update Progress: 1515/2372 symbols completed. NOMD took 30.5s. Estimated remaining: 1h 53m 52s. Rate: 7.5 symbols/min [2025-09-19T20:21:22.465919] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:22.466094] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-19T20:21:22.466133] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-19T20:21:22.466276] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-19T20:21:22.466323] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-19T20:21:22.466366] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-19T20:21:22.466398] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-19T20:21:22.841466] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:22.888569] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T20:21:22.915938] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-19T20:21:23.043252] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-19T20:21:23.378036] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:21:23.378403] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-19T20:21:23.843340] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-19T20:21:24.177109] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:21:24.177510] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-19T20:21:24.643316] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-19T20:21:24.711812] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-19T20:21:25.443284] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-19T20:21:26.243336] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-19T20:21:26.815910] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T20:21:27.043382] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-19T20:21:27.649980] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-19T20:21:27.843351] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-19T20:21:28.041503] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T20:21:28.202082] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T20:21:28.643342] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-19T20:21:29.443288] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-19T20:21:30.243271] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-19T20:21:30.588090] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-19T20:21:30.595883] [INFO ] [REMOTE ] NOV: Full fetch complete (76980 records). [2025-09-19T20:21:30.596022] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-19T20:21:31.059384] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-19T20:21:31.059526] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-19T20:21:31.060833] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-19T20:21:31.060917] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-19T20:21:31.062836] [DEBUG] [LOCAL ] NOV: Trimmed 76980 records to 53967 (keeping 200 days of data) [2025-09-19T20:21:31.183271] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-19T20:21:31.196631] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-19T20:21:31.446545] [DEBUG] [LOCAL ] NOV: Primary data saved (53967 records). [2025-09-19T20:21:31.446733] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-19T20:21:31.446834] [INFO ] [MAIN ] Update Progress: 1516/2372 symbols completed. NOV took 27.9s. Estimated remaining: 1h 53m 45s. Rate: 7.5 symbols/min [2025-09-19T20:21:31.625290] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:31.637454] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T20:21:31.658969] [DEBUG] [LOCAL ] NPCT: Loaded 17118 existing records from primary storage. [2025-09-19T20:21:31.659152] [INFO ] [MAIN ] NPCT: Loaded 17118 existing records. [2025-09-19T20:21:31.851095] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-19T20:21:31.859396] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:21:31.860850] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-19T20:21:31.860941] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-19T20:21:31.861640] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-19T20:21:31.861751] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-19T20:21:32.186725] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-19T20:21:32.278380] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:32.643282] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-19T20:21:33.071088] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T20:21:33.443283] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-19T20:21:33.588794] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-19T20:21:34.243299] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-19T20:21:34.431968] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T20:21:34.785869] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T20:21:35.043290] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-19T20:21:35.843279] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-19T20:21:35.897915] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T20:21:35.902454] [INFO ] [REMOTE ] NOTE: Full fetch complete (64842 records). [2025-09-19T20:21:35.902567] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-19T20:21:36.289839] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-19T20:21:36.289928] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-19T20:21:36.290865] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-19T20:21:36.290930] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-19T20:21:36.292256] [DEBUG] [LOCAL ] NOTE: Trimmed 64842 records to 43867 (keeping 200 days of data) [2025-09-19T20:21:36.425604] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T20:21:36.576024] [DEBUG] [LOCAL ] NOTE: Primary data saved (43867 records). [2025-09-19T20:21:36.576166] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-19T20:21:36.576281] [INFO ] [MAIN ] Update Progress: 1517/2372 symbols completed. NOTE took 36.4s. Estimated remaining: 1h 53m 35s. Rate: 7.5 symbols/min [2025-09-19T20:21:36.643247] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-19T20:21:36.922089] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T20:21:36.928985] [INFO ] [REMOTE ] NOW: Full fetch complete (70489 records). [2025-09-19T20:21:36.929113] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-19T20:21:36.929993] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:21:36.930084] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:21:36.930128] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:21:36.930180] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-19T20:21:36.930274] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-19T20:21:36.930331] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-09-19T20:21:36.930376] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-09-19T20:21:36.930474] [INFO ] [MAIN ] Update Progress: 1518/2372 symbols completed. NOW took 30.4s. Estimated remaining: 1h 53m 23s. Rate: 7.5 symbols/min [2025-09-19T20:21:37.443258] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-19T20:21:37.949970] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T20:21:38.243246] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-19T20:21:38.332891] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T20:21:39.043298] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-19T20:21:39.483173] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T20:21:39.843350] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-19T20:21:40.428284] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T20:21:40.643353] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-19T20:21:41.026700] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T20:21:41.029706] [INFO ] [REMOTE ] NPB: Full fetch complete (15820 records). [2025-09-19T20:21:41.029781] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-19T20:21:41.214410] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 150 unique days, need 200 days [2025-09-19T20:21:41.214722] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:21:41.214791] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:21:41.214858] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-19T20:21:41.214921] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-19T20:21:41.214956] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-19T20:21:41.214994] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-19T20:21:41.215052] [INFO ] [MAIN ] Update Progress: 1519/2372 symbols completed. NPB took 18.9s. Estimated remaining: 1h 53m 13s. Rate: 7.5 symbols/min [2025-09-19T20:21:41.756057] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T20:21:41.759424] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-19T20:21:42.964994] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T20:21:42.968819] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-19T20:21:44.236768] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T20:21:44.241019] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-19T20:21:45.624941] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T20:21:45.630050] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-19T20:21:46.937202] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:21:46.942776] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-19T20:21:48.283358] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T20:21:48.288004] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-19T20:21:49.415535] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T20:21:49.419314] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-19T20:21:50.487986] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T20:21:50.491340] [INFO ] [REMOTE ] NPCT: Full fetch complete (25182 records). [2025-09-19T20:21:50.491430] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-19T20:21:50.878903] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-19T20:21:50.879024] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-19T20:21:50.879569] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-19T20:21:50.879611] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-19T20:21:50.880435] [DEBUG] [LOCAL ] NPCT: Trimmed 25182 records to 17187 (keeping 200 days of data) [2025-09-19T20:21:50.989061] [DEBUG] [LOCAL ] NPCT: Primary data saved (17187 records). [2025-09-19T20:21:50.989283] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-19T20:21:50.989408] [INFO ] [MAIN ] Update Progress: 1520/2372 symbols completed. NPCT took 19.5s. Estimated remaining: 1h 53m 6s. Rate: 7.5 symbols/min [2025-09-19T20:21:51.703874] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:51.723514] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:51.733263] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:51.776874] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:21:51.777307] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-19T20:21:51.777364] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-19T20:21:51.777939] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-19T20:21:51.782125] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-19T20:21:51.781958] [DEBUG] [LOCAL ] NPK: Loaded 8234 existing records from primary storage. [2025-09-19T20:21:51.782545] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-19T20:21:51.782740] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-19T20:21:51.782362] [INFO ] [MAIN ] NPK: Loaded 8234 existing records. [2025-09-19T20:21:51.854525] [DEBUG] [LOCAL ] NPFD: Loaded 9855 existing records from primary storage. [2025-09-19T20:21:51.892275] [INFO ] [MAIN ] NPFD: Loaded 9855 existing records. [2025-09-19T20:21:52.010028] [DEBUG] [LOCAL ] NPO: Loaded 12975 existing records from primary storage. [2025-09-19T20:21:52.062820] [INFO ] [MAIN ] NPO: Loaded 12975 existing records. [2025-09-19T20:21:52.310577] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:21:52.362636] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-19T20:21:52.415404] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-19T20:21:52.506107] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:21:52.519251] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-19T20:21:52.532969] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-19T20:21:52.641142] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-19T20:21:52.658687] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-19T20:21:52.663941] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:21:52.704021] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-19T20:21:52.709254] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-19T20:21:52.742304] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-19T20:21:52.723299] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-19T20:21:52.806173] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-19T20:21:52.840607] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-19T20:21:53.073785] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:53.168184] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-19T20:21:53.717362] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:53.753282] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-19T20:21:53.907734] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:53.929339] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-19T20:21:53.929105] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:21:53.930321] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-19T20:21:54.430965] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T20:21:54.434106] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-19T20:21:54.767634] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T20:21:54.771306] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-19T20:21:54.778968] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T20:21:54.781589] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-19T20:21:54.970423] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T20:21:54.973905] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-19T20:21:55.446559] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T20:21:55.453055] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-19T20:21:55.649266] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T20:21:55.651294] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-19T20:21:55.853340] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T20:21:55.856110] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-19T20:21:56.087696] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T20:21:56.090345] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-19T20:21:56.263619] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T20:21:56.643328] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-19T20:21:56.859740] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T20:21:56.971535] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T20:21:57.149862] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T20:21:57.200494] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T20:21:57.443338] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-19T20:21:58.243313] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-19T20:21:58.465272] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T20:21:59.043346] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-19T20:21:59.843369] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-19T20:22:00.041093] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T20:22:00.081240] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T20:22:00.643262] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-19T20:22:00.925328] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T20:22:01.443284] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-19T20:22:01.732151] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T20:22:02.243285] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-19T20:22:03.043302] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-19T20:22:03.067318] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T20:22:03.258840] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T20:22:03.843316] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-19T20:22:04.319210] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T20:22:04.451781] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T20:22:04.643340] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-19T20:22:05.443289] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-19T20:22:06.243347] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-19T20:22:06.497188] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T20:22:06.694355] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T20:22:07.043288] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-19T20:22:07.170403] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T20:22:07.843314] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-19T20:22:08.648422] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-19T20:22:08.660368] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T20:22:08.990611] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T20:22:09.443291] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-19T20:22:10.190107] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T20:22:10.243299] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-19T20:22:10.499890] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T20:22:11.043278] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-19T20:22:11.246127] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T20:22:11.843317] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-19T20:22:12.017017] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T20:22:12.643284] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-19T20:22:13.443293] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-19T20:22:13.477661] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T20:22:13.480731] [INFO ] [REMOTE ] NPK: Full fetch complete (11060 records). [2025-09-19T20:22:13.481027] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-19T20:22:13.888070] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-19T20:22:13.898982] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-19T20:22:13.899450] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-19T20:22:13.899806] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-19T20:22:13.901792] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T20:22:13.912346] [DEBUG] [LOCAL ] NPK: Trimmed 11060 records to 8278 (keeping 200 days of data) [2025-09-19T20:22:13.968145] [DEBUG] [LOCAL ] NPK: Primary data saved (8278 records). [2025-09-19T20:22:13.968349] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-19T20:22:13.968467] [INFO ] [MAIN ] Update Progress: 1521/2372 symbols completed. NPK took 23.0s. Estimated remaining: 1h 53m 7s. Rate: 7.5 symbols/min [2025-09-19T20:22:14.145135] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:22:14.152297] [DEBUG] [LOCAL ] NPV: Loaded 4999 existing records from primary storage. [2025-09-19T20:22:14.152410] [INFO ] [MAIN ] NPV: Loaded 4999 existing records. [2025-09-19T20:22:14.251371] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-19T20:22:14.336191] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:22:14.336474] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-19T20:22:14.336537] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-19T20:22:14.336930] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-19T20:22:14.336989] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-19T20:22:14.696585] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:22:14.706756] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T20:22:15.043294] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-19T20:22:15.807787] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T20:22:15.843241] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-19T20:22:15.866251] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T20:22:16.643280] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-19T20:22:17.366727] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T20:22:17.372209] [INFO ] [REMOTE ] NPKI: Full fetch complete (52348 records). [2025-09-19T20:22:17.372334] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-19T20:22:17.449323] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-19T20:22:17.510249] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T20:22:17.584422] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-19T20:22:17.585000] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:22:17.585071] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:22:17.585142] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-19T20:22:17.585207] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-19T20:22:17.585243] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-19T20:22:17.585281] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-19T20:22:17.585390] [INFO ] [MAIN ] Update Progress: 1522/2372 symbols completed. NPKI took 26.6s. Estimated remaining: 1h 52m 56s. Rate: 7.5 symbols/min [2025-09-19T20:22:17.760969] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:22:17.804482] [DEBUG] [LOCAL ] NPWR: Loaded 43291 existing records from primary storage. [2025-09-19T20:22:17.804625] [INFO ] [MAIN ] NPWR: Loaded 43291 existing records. [2025-09-19T20:22:17.984162] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:22:17.984399] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-19T20:22:17.984449] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-19T20:22:17.985806] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-19T20:22:17.985868] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-19T20:22:18.248371] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-19T20:22:18.350045] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:22:18.621304] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T20:22:18.623459] [INFO ] [REMOTE ] NPO: Full fetch complete (18199 records). [2025-09-19T20:22:18.623533] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-19T20:22:18.998739] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-19T20:22:18.998831] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-19T20:22:18.999260] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-19T20:22:18.999300] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-19T20:22:18.999936] [DEBUG] [LOCAL ] NPO: Trimmed 18199 records to 13074 (keeping 200 days of data) [2025-09-19T20:22:19.059772] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-19T20:22:19.088685] [DEBUG] [LOCAL ] NPO: Primary data saved (13074 records). [2025-09-19T20:22:19.088831] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-19T20:22:19.088929] [INFO ] [MAIN ] Update Progress: 1523/2372 symbols completed. NPO took 28.1s. Estimated remaining: 1h 52m 45s. Rate: 7.5 symbols/min [2025-09-19T20:22:19.205912] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T20:22:19.268956] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:22:19.280191] [DEBUG] [LOCAL ] NQP: Loaded 9232 existing records from primary storage. [2025-09-19T20:22:19.280312] [INFO ] [MAIN ] NQP: Loaded 9232 existing records. [2025-09-19T20:22:19.456051] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:22:19.456514] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-19T20:22:19.456562] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-19T20:22:19.457046] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-19T20:22:19.457107] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-19T20:22:19.814265] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:22:19.843241] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-19T20:22:20.643308] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-19T20:22:20.814437] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T20:22:20.894770] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T20:22:21.381372] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T20:22:21.443244] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-19T20:22:22.243296] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-19T20:22:22.417578] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T20:22:23.043306] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-19T20:22:23.796222] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T20:22:23.843260] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-19T20:22:23.872066] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T20:22:24.643265] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-19T20:22:24.813428] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T20:22:25.443301] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-19T20:22:25.625328] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T20:22:26.243281] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-19T20:22:26.484485] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T20:22:27.043336] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-19T20:22:27.264592] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T20:22:27.843295] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-19T20:22:28.643297] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-19T20:22:28.673639] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T20:22:28.722300] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T20:22:29.443304] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-19T20:22:29.640318] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T20:22:29.642499] [INFO ] [REMOTE ] NPFD: Full fetch complete (14842 records). [2025-09-19T20:22:29.642572] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-19T20:22:30.014837] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-19T20:22:30.014929] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-19T20:22:30.015290] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-19T20:22:30.015350] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-19T20:22:30.017078] [DEBUG] [LOCAL ] NPFD: Trimmed 14842 records to 9943 (keeping 200 days of data) [2025-09-19T20:22:30.078043] [DEBUG] [LOCAL ] NPFD: Primary data saved (9943 records). [2025-09-19T20:22:30.078173] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-19T20:22:30.078268] [INFO ] [MAIN ] Update Progress: 1524/2372 symbols completed. NPFD took 39.1s. Estimated remaining: 1h 52m 38s. Rate: 7.5 symbols/min [2025-09-19T20:22:30.246023] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-19T20:22:30.245945] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:22:30.284494] [DEBUG] [LOCAL ] NRDY: Loaded 33506 existing records from primary storage. [2025-09-19T20:22:30.284634] [INFO ] [MAIN ] NRDY: Loaded 33506 existing records. [2025-09-19T20:22:30.460314] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:22:30.460605] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-19T20:22:30.460679] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-19T20:22:30.461701] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-19T20:22:30.461759] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-19T20:22:30.629398] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T20:22:30.854939] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:22:31.043377] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-19T20:22:31.843327] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-19T20:22:32.076536] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T20:22:32.303903] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T20:22:32.643332] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-19T20:22:33.443291] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-19T20:22:33.986762] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T20:22:33.996461] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T20:22:34.243301] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-19T20:22:35.043377] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-19T20:22:35.521072] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T20:22:35.843332] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-19T20:22:35.867622] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T20:22:36.099696] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T20:22:36.643310] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-19T20:22:37.389572] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T20:22:37.443310] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-19T20:22:37.705403] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T20:22:38.243297] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-19T20:22:39.043260] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-19T20:22:39.304471] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T20:22:39.486377] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T20:22:39.843294] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-19T20:22:40.088969] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T20:22:40.643311] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-19T20:22:41.443295] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-19T20:22:41.510234] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T20:22:41.607482] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T20:22:42.243273] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-19T20:22:42.244841] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T20:22:42.246633] [INFO ] [REMOTE ] NPV: Full fetch complete (6761 records). [2025-09-19T20:22:42.246729] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-19T20:22:42.628893] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-19T20:22:42.629024] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-19T20:22:42.629222] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-19T20:22:42.629262] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-19T20:22:42.629903] [DEBUG] [LOCAL ] NPV: Trimmed 6761 records to 5021 (keeping 200 days of data) [2025-09-19T20:22:42.661329] [DEBUG] [LOCAL ] NPV: Primary data saved (5021 records). [2025-09-19T20:22:42.661480] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-19T20:22:42.661591] [INFO ] [MAIN ] Update Progress: 1525/2372 symbols completed. NPV took 28.7s. Estimated remaining: 1h 52m 33s. Rate: 7.5 symbols/min [2025-09-19T20:22:42.835360] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:22:42.845876] [DEBUG] [LOCAL ] NREF: Loaded 7841 existing records from primary storage. [2025-09-19T20:22:42.845995] [INFO ] [MAIN ] NREF: Loaded 7841 existing records. [2025-09-19T20:22:43.022637] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:22:43.022918] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-19T20:22:43.022965] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-19T20:22:43.023403] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-19T20:22:43.023463] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-19T20:22:43.053554] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-19T20:22:43.378207] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:22:43.843282] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-19T20:22:44.459605] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T20:22:44.643291] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-19T20:22:44.779451] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T20:22:44.781372] [INFO ] [REMOTE ] NQP: Full fetch complete (13417 records). [2025-09-19T20:22:44.781444] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-19T20:22:45.194261] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-19T20:22:45.194668] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-19T20:22:45.195353] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-19T20:22:45.196397] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-19T20:22:45.196309] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T20:22:45.205693] [DEBUG] [LOCAL ] NQP: Trimmed 13417 records to 9289 (keeping 200 days of data) [2025-09-19T20:22:45.265203] [DEBUG] [LOCAL ] NQP: Primary data saved (9289 records). [2025-09-19T20:22:45.265359] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-19T20:22:45.265446] [INFO ] [MAIN ] Update Progress: 1526/2372 symbols completed. NQP took 26.2s. Estimated remaining: 1h 52m 22s. Rate: 7.5 symbols/min [2025-09-19T20:22:45.439318] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:22:45.439517] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-19T20:22:45.439555] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-19T20:22:45.439732] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-19T20:22:45.439783] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-19T20:22:45.439825] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-19T20:22:45.439856] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-19T20:22:45.451440] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-19T20:22:45.804499] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:22:46.243323] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-19T20:22:46.619611] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T20:22:46.637474] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T20:22:47.043344] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-19T20:22:47.843309] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-19T20:22:47.872455] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T20:22:48.102483] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T20:22:48.643319] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-19T20:22:49.443339] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-19T20:22:49.540212] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T20:22:49.546253] [INFO ] [REMOTE ] NPWR: Full fetch complete (58917 records). [2025-09-19T20:22:49.546407] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-19T20:22:49.955371] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-19T20:22:49.955476] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-19T20:22:49.956708] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-19T20:22:49.956819] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-19T20:22:49.964073] [DEBUG] [LOCAL ] NPWR: Trimmed 58917 records to 43617 (keeping 200 days of data) [2025-09-19T20:22:50.228733] [DEBUG] [LOCAL ] NPWR: Primary data saved (43617 records). [2025-09-19T20:22:50.228871] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-19T20:22:50.228957] [INFO ] [MAIN ] Update Progress: 1527/2372 symbols completed. NPWR took 32.6s. Estimated remaining: 1h 52m 12s. Rate: 7.5 symbols/min [2025-09-19T20:22:50.250417] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-19T20:22:50.338812] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T20:22:50.459531] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:22:50.462320] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T20:22:50.514185] [DEBUG] [LOCAL ] NRGV: Loaded 43067 existing records from primary storage. [2025-09-19T20:22:50.514351] [INFO ] [MAIN ] NRGV: Loaded 43067 existing records. [2025-09-19T20:22:50.711835] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:22:50.712303] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-19T20:22:50.712352] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-19T20:22:50.713762] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-19T20:22:50.713824] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-19T20:22:51.050771] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-19T20:22:51.102598] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:22:51.843372] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-19T20:22:52.210626] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-19T20:22:52.643370] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-19T20:22:53.283852] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T20:22:53.443322] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-19T20:22:53.610272] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T20:22:53.803860] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T20:22:54.243295] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-19T20:22:55.043331] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-19T20:22:55.248958] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T20:22:55.843367] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-19T20:22:55.916750] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-19T20:22:56.643298] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-19T20:22:56.790403] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T20:22:56.818794] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T20:22:57.443333] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-19T20:22:58.243295] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-19T20:22:58.445474] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T20:22:58.880924] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T20:22:59.043337] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-19T20:22:59.843300] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-19T20:23:00.002607] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T20:23:00.643300] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-19T20:23:01.443305] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-19T20:23:03.131092] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-19T20:23:03.142798] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-19T20:23:03.326075] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (5.08 seconds). [2025-09-19T20:23:03.333365] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-19T20:23:05.233609] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T20:23:05.245022] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-19T20:23:05.734024] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (4.29 seconds). [2025-09-19T20:23:05.736351] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-19T20:23:05.967972] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (6.12 seconds). [2025-09-19T20:23:05.975892] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-19T20:23:06.158786] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-19T20:23:06.243299] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-19T20:23:06.652455] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T20:23:06.654723] [INFO ] [REMOTE ] NREF: Full fetch complete (10831 records). [2025-09-19T20:23:06.654812] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-19T20:23:07.043467] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-19T20:23:07.043831] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-19T20:23:07.044174] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-19T20:23:07.044321] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-19T20:23:07.045133] [DEBUG] [LOCAL ] NREF: Trimmed 10831 records to 7913 (keeping 200 days of data) [2025-09-19T20:23:07.098051] [DEBUG] [LOCAL ] NREF: Primary data saved (7913 records). [2025-09-19T20:23:07.098229] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-19T20:23:07.098351] [INFO ] [MAIN ] Update Progress: 1528/2372 symbols completed. NREF took 24.4s. Estimated remaining: 1h 52m 9s. Rate: 7.5 symbols/min [2025-09-19T20:23:07.327301] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:23:07.331303] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T20:23:07.345270] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-19T20:23:07.364797] [DEBUG] [LOCAL ] NRK: Loaded 19672 existing records from primary storage. [2025-09-19T20:23:07.364961] [INFO ] [MAIN ] NRK: Loaded 19672 existing records. [2025-09-19T20:23:07.569335] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:23:07.569598] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-19T20:23:07.569672] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-19T20:23:07.570515] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-19T20:23:07.570578] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-19T20:23:07.907620] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T20:23:07.971545] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-19T20:23:07.992269] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:23:08.145489] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T20:23:08.643308] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-19T20:23:09.289071] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T20:23:09.443286] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-19T20:23:09.770553] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T20:23:09.988401] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T20:23:10.243294] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-19T20:23:11.043223] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-19T20:23:11.591261] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T20:23:11.662792] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T20:23:11.843283] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-19T20:23:12.636424] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T20:23:12.644981] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-19T20:23:13.051735] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T20:23:13.443296] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-19T20:23:13.752941] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T20:23:13.763509] [INFO ] [REMOTE ] NRG: Full fetch complete (76172 records). [2025-09-19T20:23:13.763769] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-19T20:23:13.764844] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:23:13.764965] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:23:13.765030] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:23:13.765108] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-19T20:23:13.765190] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-19T20:23:13.765234] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-19T20:23:13.765311] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-09-19T20:23:13.765421] [INFO ] [MAIN ] Update Progress: 1529/2372 symbols completed. NRG took 28.5s. Estimated remaining: 1h 52m 1s. Rate: 7.5 symbols/min [2025-09-19T20:23:13.960975] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:23:13.967347] [DEBUG] [LOCAL ] NRP: Loaded 4191 existing records from primary storage. [2025-09-19T20:23:13.967453] [INFO ] [MAIN ] NRP: Loaded 4191 existing records. [2025-09-19T20:23:14.166843] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:23:14.167132] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-19T20:23:14.167224] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-19T20:23:14.167599] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-19T20:23:14.167691] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-19T20:23:14.248489] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-19T20:23:14.571899] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:23:15.043284] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-19T20:23:15.097340] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T20:23:15.590112] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T20:23:15.599047] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T20:23:15.843310] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-19T20:23:16.643253] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-19T20:23:17.092686] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T20:23:17.443298] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-19T20:23:18.035582] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T20:23:18.040388] [INFO ] [REMOTE ] NRDY: Full fetch complete (52526 records). [2025-09-19T20:23:18.040489] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-19T20:23:18.248731] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-19T20:23:18.462498] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-19T20:23:18.462590] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-19T20:23:18.463869] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-19T20:23:18.463947] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-19T20:23:18.465112] [DEBUG] [LOCAL ] NRDY: Trimmed 52526 records to 33746 (keeping 200 days of data) [2025-09-19T20:23:18.676347] [DEBUG] [LOCAL ] NRDY: Primary data saved (33746 records). [2025-09-19T20:23:18.676506] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-19T20:23:18.676662] [INFO ] [MAIN ] Update Progress: 1530/2372 symbols completed. NRDY took 48.6s. Estimated remaining: 1h 51m 51s. Rate: 7.5 symbols/min [2025-09-19T20:23:18.848275] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:23:18.855721] [DEBUG] [LOCAL ] NRT: Loaded 4960 existing records from primary storage. [2025-09-19T20:23:18.855834] [INFO ] [MAIN ] NRT: Loaded 4960 existing records. [2025-09-19T20:23:19.041133] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:23:19.041419] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-19T20:23:19.041487] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-19T20:23:19.041892] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-19T20:23:19.041975] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-19T20:23:19.075091] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-19T20:23:19.294385] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T20:23:19.458596] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:23:19.474605] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T20:23:19.843327] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-19T20:23:20.080265] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T20:23:20.643304] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-19T20:23:20.794455] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T20:23:21.443334] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-19T20:23:21.994581] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T20:23:22.243325] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-19T20:23:23.043351] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-19T20:23:23.064401] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-19T20:23:23.317301] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T20:23:23.843308] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-19T20:23:24.421973] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T20:23:24.559870] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-19T20:23:24.643325] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-19T20:23:25.443295] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-19T20:23:25.742069] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T20:23:26.243299] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-19T20:23:27.043333] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-19T20:23:27.075665] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T20:23:27.434798] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T20:23:27.442040] [INFO ] [REMOTE ] NRGV: Full fetch complete (61645 records). [2025-09-19T20:23:27.442148] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-19T20:23:27.844033] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-19T20:23:27.864432] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-19T20:23:27.864561] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-19T20:23:27.865628] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-19T20:23:27.865739] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-19T20:23:27.867978] [DEBUG] [LOCAL ] NRGV: Trimmed 61645 records to 43456 (keeping 200 days of data) [2025-09-19T20:23:28.131590] [DEBUG] [LOCAL ] NRGV: Primary data saved (43456 records). [2025-09-19T20:23:28.131754] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-19T20:23:28.131857] [INFO ] [MAIN ] Update Progress: 1531/2372 symbols completed. NRGV took 37.9s. Estimated remaining: 1h 51m 44s. Rate: 7.5 symbols/min [2025-09-19T20:23:28.301435] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:23:28.307035] [DEBUG] [LOCAL ] NRUC: Loaded 3157 existing records from primary storage. [2025-09-19T20:23:28.307131] [INFO ] [MAIN ] NRUC: Loaded 3157 existing records. [2025-09-19T20:23:28.490290] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:23:28.490722] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-19T20:23:28.490839] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-19T20:23:28.499739] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-19T20:23:28.505129] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-19T20:23:28.575372] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T20:23:28.648350] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-19T20:23:28.829043] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T20:23:28.908478] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:23:29.443345] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-19T20:23:30.026625] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T20:23:30.030350] [INFO ] [REMOTE ] NRK: Full fetch complete (27753 records). [2025-09-19T20:23:30.030446] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-19T20:23:30.248533] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-19T20:23:30.302209] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-19T20:23:30.415274] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-19T20:23:30.415358] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-19T20:23:30.415953] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-19T20:23:30.416051] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-19T20:23:30.416756] [DEBUG] [LOCAL ] NRK: Trimmed 27753 records to 19774 (keeping 200 days of data) [2025-09-19T20:23:30.557593] [DEBUG] [LOCAL ] NRK: Primary data saved (19774 records). [2025-09-19T20:23:30.557904] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-19T20:23:30.558373] [INFO ] [MAIN ] Update Progress: 1532/2372 symbols completed. NRK took 23.5s. Estimated remaining: 1h 51m 33s. Rate: 7.5 symbols/min [2025-09-19T20:23:30.736003] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:23:30.794615] [DEBUG] [LOCAL ] NSA: Loaded 45170 existing records from primary storage. [2025-09-19T20:23:30.794818] [INFO ] [MAIN ] NSA: Loaded 45170 existing records. [2025-09-19T20:23:30.975491] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:23:30.975798] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-19T20:23:30.975855] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-19T20:23:30.977137] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-19T20:23:30.977223] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-19T20:23:31.048381] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-19T20:23:31.324486] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T20:23:31.406362] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:23:31.757597] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T20:23:31.843311] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-19T20:23:32.643344] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-19T20:23:33.443371] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-19T20:23:33.536223] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T20:23:33.678416] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T20:23:33.989437] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T20:23:34.243311] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-19T20:23:35.043346] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-19T20:23:35.181182] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T20:23:35.843294] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-19T20:23:35.864794] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-19T20:23:36.643305] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-19T20:23:37.370087] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T20:23:37.443338] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-19T20:23:37.510350] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T20:23:38.243303] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-19T20:23:38.255837] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T20:23:39.043325] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-19T20:23:39.814847] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T20:23:39.843211] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-19T20:23:40.097946] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T20:23:40.575804] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T20:23:40.643230] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-19T20:23:41.389916] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T20:23:41.443270] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-19T20:23:42.243296] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-19T20:23:43.043284] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-19T20:23:43.098493] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T20:23:43.358863] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T20:23:43.843300] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-19T20:23:43.950334] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T20:23:44.227235] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-19T20:23:44.643363] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-19T20:23:45.443360] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-19T20:23:45.693022] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T20:23:46.243302] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-19T20:23:46.987447] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T20:23:46.988732] [INFO ] [REMOTE ] NRT: Full fetch complete (8094 records). [2025-09-19T20:23:46.988803] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-19T20:23:47.051927] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-19T20:23:47.350801] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-19T20:23:47.350915] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-19T20:23:47.351279] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-19T20:23:47.351413] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-19T20:23:47.352165] [DEBUG] [LOCAL ] NRT: Trimmed 8094 records to 4976 (keeping 200 days of data) [2025-09-19T20:23:47.411981] [DEBUG] [LOCAL ] NRT: Primary data saved (4976 records). [2025-09-19T20:23:47.412763] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-19T20:23:47.414051] [INFO ] [MAIN ] Update Progress: 1533/2372 symbols completed. NRT took 28.7s. Estimated remaining: 1h 51m 30s. Rate: 7.5 symbols/min [2025-09-19T20:23:47.413884] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T20:23:47.592288] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:23:47.592480] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-19T20:23:47.592535] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-19T20:23:47.592711] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-19T20:23:47.592793] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-19T20:23:47.592840] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-19T20:23:47.592872] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-19T20:23:47.848445] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-19T20:23:47.945493] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:23:48.038055] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T20:23:48.643297] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-19T20:23:48.738419] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T20:23:49.443293] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-19T20:23:50.056976] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T20:23:50.243298] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-19T20:23:50.781846] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T20:23:50.963008] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T20:23:50.964850] [INFO ] [REMOTE ] NRP: Full fetch complete (6508 records). [2025-09-19T20:23:50.965000] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-19T20:23:51.048444] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-19T20:23:51.333275] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-19T20:23:51.333362] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-19T20:23:51.333497] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-19T20:23:51.333533] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-19T20:23:51.333941] [DEBUG] [LOCAL ] NRP: Trimmed 6508 records to 4219 (keeping 200 days of data) [2025-09-19T20:23:51.365885] [DEBUG] [LOCAL ] NRP: Primary data saved (4219 records). [2025-09-19T20:23:51.365961] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-19T20:23:51.366065] [INFO ] [MAIN ] Update Progress: 1534/2372 symbols completed. NRP took 37.6s. Estimated remaining: 1h 51m 19s. Rate: 7.5 symbols/min [2025-09-19T20:23:51.535965] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:23:51.593364] [DEBUG] [LOCAL ] NSP: Loaded 35194 existing records from primary storage. [2025-09-19T20:23:51.593740] [INFO ] [MAIN ] NSP: Loaded 35194 existing records. [2025-09-19T20:23:51.779339] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:23:51.779928] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-19T20:23:51.779984] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-19T20:23:51.781386] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-19T20:23:51.781447] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-19T20:23:51.853774] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-19T20:23:51.881724] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T20:23:51.894984] [INFO ] [REMOTE ] NRUC: Full fetch complete (5574 records). [2025-09-19T20:23:51.895065] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-19T20:23:52.417098] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:23:52.547096] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-19T20:23:52.547161] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-19T20:23:52.547297] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-19T20:23:52.547334] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-19T20:23:52.547907] [DEBUG] [LOCAL ] NRUC: Trimmed 5574 records to 3191 (keeping 200 days of data) [2025-09-19T20:23:52.570541] [DEBUG] [LOCAL ] NRUC: Primary data saved (3191 records). [2025-09-19T20:23:52.570607] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-19T20:23:52.570740] [INFO ] [MAIN ] Update Progress: 1535/2372 symbols completed. NRUC took 24.4s. Estimated remaining: 1h 51m 8s. Rate: 7.5 symbols/min [2025-09-19T20:23:52.648365] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-19T20:23:52.754221] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:23:52.781307] [DEBUG] [LOCAL ] NTB: Loaded 21077 existing records from primary storage. [2025-09-19T20:23:52.781432] [INFO ] [MAIN ] NTB: Loaded 21077 existing records. [2025-09-19T20:23:52.964339] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:23:52.964720] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-19T20:23:52.964785] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-19T20:23:52.965670] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-19T20:23:52.965739] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-19T20:23:53.351013] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:23:53.443220] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-19T20:23:53.695016] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T20:23:54.243364] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-19T20:23:54.747754] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T20:23:54.850480] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T20:23:55.043288] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-19T20:23:55.843281] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-19T20:23:56.172673] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T20:23:56.473102] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T20:23:56.643283] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-19T20:23:57.443231] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-19T20:23:57.700088] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T20:23:57.960981] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T20:23:58.243323] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-19T20:23:59.043517] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-19T20:23:59.044121] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T20:23:59.843293] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-19T20:24:00.317913] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T20:24:00.643369] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-19T20:24:01.075416] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T20:24:01.386731] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T20:24:01.443300] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-19T20:24:02.045004] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-19T20:24:02.243347] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-19T20:24:03.043303] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-19T20:24:03.843301] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-19T20:24:04.035532] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-19T20:24:04.042698] [INFO ] [REMOTE ] NSA: Full fetch complete (61595 records). [2025-09-19T20:24:04.042821] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-19T20:24:04.433449] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-19T20:24:04.433559] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-19T20:24:04.434515] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-19T20:24:04.434579] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-19T20:24:04.436028] [DEBUG] [LOCAL ] NSA: Trimmed 61595 records to 45492 (keeping 200 days of data) [2025-09-19T20:24:04.582559] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T20:24:04.648078] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-19T20:24:04.756928] [DEBUG] [LOCAL ] NSA: Primary data saved (45492 records). [2025-09-19T20:24:04.757073] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-19T20:24:04.757903] [INFO ] [MAIN ] Update Progress: 1536/2372 symbols completed. NSA took 34.2s. Estimated remaining: 1h 51m 2s. Rate: 7.5 symbols/min [2025-09-19T20:24:04.927257] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:24:04.927479] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-19T20:24:04.927535] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-19T20:24:04.927738] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-19T20:24:04.927790] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-19T20:24:04.927832] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-19T20:24:04.927863] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-19T20:24:05.299052] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:24:05.326215] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (3.08 seconds). [2025-09-19T20:24:05.451882] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-19T20:24:05.453046] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T20:24:05.631466] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T20:24:06.243278] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-19T20:24:07.043297] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-19T20:24:07.504193] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T20:24:07.596185] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-19T20:24:07.674288] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T20:24:07.843295] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-19T20:24:08.643277] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-19T20:24:09.443276] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-19T20:24:09.501502] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T20:24:09.528460] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T20:24:10.243287] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-19T20:24:11.043295] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-19T20:24:11.843315] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-19T20:24:11.986353] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T20:24:12.036745] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-19T20:24:12.342534] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T20:24:12.643338] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-19T20:24:12.750091] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T20:24:13.443307] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-19T20:24:14.243396] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-19T20:24:14.553366] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T20:24:15.043333] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-19T20:24:15.596581] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-19T20:24:15.749117] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-09-19T20:24:15.843235] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-19T20:24:15.925923] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T20:24:16.643284] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-19T20:24:17.443303] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-19T20:24:17.787670] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T20:24:17.861872] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T20:24:18.155359] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T20:24:18.158842] [INFO ] [REMOTE ] NTB: Full fetch complete (30964 records). [2025-09-19T20:24:18.158955] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-19T20:24:18.248372] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-19T20:24:18.543551] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-19T20:24:18.543678] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-19T20:24:18.544310] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-19T20:24:18.544351] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-19T20:24:18.545131] [DEBUG] [LOCAL ] NTB: Trimmed 30964 records to 21194 (keeping 200 days of data) [2025-09-19T20:24:18.682368] [DEBUG] [LOCAL ] NTB: Primary data saved (21194 records). [2025-09-19T20:24:18.682495] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-19T20:24:18.682575] [INFO ] [MAIN ] Update Progress: 1537/2372 symbols completed. NTB took 26.1s. Estimated remaining: 1h 50m 57s. Rate: 7.5 symbols/min [2025-09-19T20:24:18.851750] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:24:18.912897] [DEBUG] [LOCAL ] NTR: Loaded 53012 existing records from primary storage. [2025-09-19T20:24:18.913138] [INFO ] [MAIN ] NTR: Loaded 53012 existing records. [2025-09-19T20:24:19.056332] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-19T20:24:19.106868] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:24:19.107167] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-19T20:24:19.107247] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-19T20:24:19.108767] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-19T20:24:19.108830] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-19T20:24:19.475836] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:24:19.781983] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T20:24:19.843278] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-19T20:24:20.417306] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T20:24:20.643262] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-19T20:24:20.654212] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T20:24:21.443297] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-19T20:24:22.243293] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-19T20:24:22.718323] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T20:24:22.845673] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T20:24:23.041629] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T20:24:23.051676] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-19T20:24:23.843277] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-19T20:24:24.643289] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-19T20:24:25.443237] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-19T20:24:25.580708] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-19T20:24:25.938796] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T20:24:26.005732] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-19T20:24:26.006505] [INFO ] [REMOTE ] NTEST: Full fetch complete (1986 records). [2025-09-19T20:24:26.006579] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-19T20:24:26.202185] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-19T20:24:26.202420] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:24:26.202491] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:24:26.202564] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-19T20:24:26.202633] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-19T20:24:26.202712] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-19T20:24:26.202765] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-19T20:24:26.202848] [INFO ] [MAIN ] Update Progress: 1538/2372 symbols completed. NTEST took 21.4s. Estimated remaining: 1h 50m 49s. Rate: 7.5 symbols/min [2025-09-19T20:24:26.250556] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-19T20:24:26.397231] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:24:26.445691] [DEBUG] [LOCAL ] NTST: Loaded 43718 existing records from primary storage. [2025-09-19T20:24:26.445956] [INFO ] [MAIN ] NTST: Loaded 43718 existing records. [2025-09-19T20:24:26.597081] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T20:24:26.667045] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:24:26.667299] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-19T20:24:26.667349] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-19T20:24:26.668695] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-19T20:24:26.668760] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-19T20:24:27.050821] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-19T20:24:27.058847] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:24:27.340367] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T20:24:27.347747] [INFO ] [REMOTE ] NSC: Full fetch complete (70520 records). [2025-09-19T20:24:27.347931] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-19T20:24:27.348968] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:24:27.349063] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:24:27.349107] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:24:27.349175] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-19T20:24:27.349243] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-19T20:24:27.349280] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-19T20:24:27.349350] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-09-19T20:24:27.349482] [INFO ] [MAIN ] Update Progress: 1539/2372 symbols completed. NSC took 39.9s. Estimated remaining: 1h 50m 38s. Rate: 7.5 symbols/min [2025-09-19T20:24:27.540804] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:24:27.606614] [DEBUG] [LOCAL ] NU: Loaded 54136 existing records from primary storage. [2025-09-19T20:24:27.606821] [INFO ] [MAIN ] NU: Loaded 54136 existing records. [2025-09-19T20:24:27.800819] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:24:27.801111] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-19T20:24:27.801190] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-19T20:24:27.802909] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-19T20:24:27.802970] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-19T20:24:27.849618] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-19T20:24:28.183316] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:24:28.643291] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-19T20:24:28.930202] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T20:24:29.043886] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T20:24:29.443290] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-19T20:24:30.243290] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-19T20:24:30.642379] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T20:24:31.043319] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-19T20:24:31.434153] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T20:24:31.843295] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-19T20:24:32.643298] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-19T20:24:32.970542] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-19T20:24:33.050683] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T20:24:33.144621] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T20:24:33.443295] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-19T20:24:34.243235] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-19T20:24:34.350135] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T20:24:34.356754] [INFO ] [REMOTE ] NSP: Full fetch complete (49355 records). [2025-09-19T20:24:34.356865] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-19T20:24:34.749452] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-19T20:24:34.749562] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-19T20:24:34.750399] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-19T20:24:34.750476] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-19T20:24:34.751635] [DEBUG] [LOCAL ] NSP: Trimmed 49355 records to 35435 (keeping 200 days of data) [2025-09-19T20:24:34.984299] [DEBUG] [LOCAL ] NSP: Primary data saved (35435 records). [2025-09-19T20:24:34.984474] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-19T20:24:34.984585] [INFO ] [MAIN ] Update Progress: 1540/2372 symbols completed. NSP took 43.6s. Estimated remaining: 1h 50m 29s. Rate: 7.5 symbols/min [2025-09-19T20:24:35.053510] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-19T20:24:35.157052] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:24:35.157263] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-19T20:24:35.157350] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-19T20:24:35.157503] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-19T20:24:35.157547] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-19T20:24:35.157588] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-19T20:24:35.157619] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-19T20:24:35.524272] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:24:35.584209] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T20:24:35.848400] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-19T20:24:35.863464] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T20:24:36.643295] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-19T20:24:37.443296] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-19T20:24:37.682400] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-19T20:24:37.794937] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T20:24:38.243339] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-19T20:24:38.977508] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T20:24:39.043370] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-19T20:24:39.338281] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T20:24:39.484473] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T20:24:39.843344] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-19T20:24:40.643307] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-19T20:24:41.267503] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T20:24:41.443315] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-19T20:24:41.902010] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T20:24:42.243363] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-19T20:24:43.043300] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-19T20:24:43.227927] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-19T20:24:43.729091] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-19T20:24:43.843224] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-19T20:24:44.322616] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T20:24:44.643304] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-19T20:24:44.769370] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T20:24:45.443294] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-19T20:24:46.184584] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-19T20:24:46.243286] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-19T20:24:46.971195] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-19T20:24:47.043316] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-19T20:24:47.505331] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T20:24:47.843339] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-19T20:24:48.631440] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T20:24:48.643226] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-19T20:24:48.962520] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T20:24:48.970612] [INFO ] [REMOTE ] NTR: Full fetch complete (76292 records). [2025-09-19T20:24:48.970816] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-19T20:24:49.368357] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-19T20:24:49.368444] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-19T20:24:49.369460] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-19T20:24:49.369525] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-19T20:24:49.371043] [DEBUG] [LOCAL ] NTR: Trimmed 76292 records to 53385 (keeping 200 days of data) [2025-09-19T20:24:49.457937] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-19T20:24:49.692171] [DEBUG] [LOCAL ] NTR: Primary data saved (53385 records). [2025-09-19T20:24:49.692320] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-19T20:24:49.692405] [INFO ] [MAIN ] Update Progress: 1541/2372 symbols completed. NTR took 31.0s. Estimated remaining: 1h 50m 25s. Rate: 7.5 symbols/min [2025-09-19T20:24:49.862563] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:24:49.897559] [DEBUG] [LOCAL ] NUS: Loaded 36678 existing records from primary storage. [2025-09-19T20:24:49.897747] [INFO ] [MAIN ] NUS: Loaded 36678 existing records. [2025-09-19T20:24:50.077540] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:24:50.077875] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-19T20:24:50.077941] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-19T20:24:50.079103] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-19T20:24:50.079165] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-19T20:24:50.455268] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:24:50.455779] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-19T20:24:50.489134] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-19T20:24:50.564298] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T20:24:51.043287] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-19T20:24:51.604990] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T20:24:51.843284] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-19T20:24:52.173118] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T20:24:52.643327] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-19T20:24:53.443285] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-19T20:24:53.650526] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-19T20:24:53.696800] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T20:24:54.243322] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-19T20:24:54.582817] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T20:24:55.043367] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-19T20:24:55.112103] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T20:24:55.843300] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-19T20:24:56.625139] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-19T20:24:56.643220] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-19T20:24:57.305346] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T20:24:57.334913] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T20:24:57.341889] [INFO ] [REMOTE ] NTST: Full fetch complete (60668 records). [2025-09-19T20:24:57.341999] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-19T20:24:57.443216] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-19T20:24:57.729248] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-19T20:24:57.729356] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-19T20:24:57.731082] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-19T20:24:57.731144] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-19T20:24:57.732342] [DEBUG] [LOCAL ] NTST: Trimmed 60668 records to 44080 (keeping 200 days of data) [2025-09-19T20:24:57.998014] [DEBUG] [LOCAL ] NTST: Primary data saved (44080 records). [2025-09-19T20:24:57.998140] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-19T20:24:57.998527] [INFO ] [MAIN ] Update Progress: 1542/2372 symbols completed. NTST took 31.8s. Estimated remaining: 1h 50m 17s. Rate: 7.5 symbols/min [2025-09-19T20:24:58.165393] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:24:58.189712] [DEBUG] [LOCAL ] NUV: Loaded 23212 existing records from primary storage. [2025-09-19T20:24:58.189838] [INFO ] [MAIN ] NUV: Loaded 23212 existing records. [2025-09-19T20:24:58.252851] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-19T20:24:58.369174] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:24:58.369434] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-19T20:24:58.369481] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-19T20:24:58.370156] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-19T20:24:58.370215] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-19T20:24:58.732808] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:24:59.043282] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-19T20:24:59.273111] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-19T20:24:59.694904] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T20:24:59.843299] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-19T20:25:00.102889] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T20:25:00.636849] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T20:25:00.643600] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-19T20:25:00.857062] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T20:25:00.863725] [INFO ] [REMOTE ] NUE: Full fetch complete (74542 records). [2025-09-19T20:25:00.863842] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-19T20:25:00.864586] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:25:00.864743] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:25:00.864786] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:25:00.864848] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-19T20:25:00.864917] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-19T20:25:00.864953] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-19T20:25:00.864991] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-19T20:25:00.865095] [INFO ] [MAIN ] Update Progress: 1543/2372 symbols completed. NUE took 25.9s. Estimated remaining: 1h 50m 7s. Rate: 7.5 symbols/min [2025-09-19T20:25:01.032252] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:25:01.081715] [DEBUG] [LOCAL ] NUVB: Loaded 51568 existing records from primary storage. [2025-09-19T20:25:01.081859] [INFO ] [MAIN ] NUVB: Loaded 51568 existing records. [2025-09-19T20:25:01.266277] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:25:01.266568] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-19T20:25:01.266619] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-19T20:25:01.267804] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-19T20:25:01.267864] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-19T20:25:01.458468] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-19T20:25:01.658079] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:25:02.191733] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T20:25:02.243279] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-19T20:25:02.899825] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T20:25:03.043317] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-19T20:25:03.843369] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-19T20:25:04.057744] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T20:25:04.618985] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T20:25:04.643215] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-19T20:25:05.443290] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-19T20:25:05.672114] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-19T20:25:05.697013] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T20:25:06.243324] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-19T20:25:07.043333] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-19T20:25:07.312157] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T20:25:07.843230] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-19T20:25:07.863350] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T20:25:08.643302] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-19T20:25:09.193588] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T20:25:09.202602] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-19T20:25:09.202769] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-19T20:25:09.470114] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-19T20:25:09.494341] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T20:25:09.653902] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-19T20:25:09.653986] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-19T20:25:09.655128] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-19T20:25:09.655196] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-19T20:25:09.657130] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 54526 (keeping 200 days of data) [2025-09-19T20:25:09.995869] [DEBUG] [LOCAL ] NU: Primary data saved (54526 records). [2025-09-19T20:25:09.996012] [INFO ] [MAIN ] NU: Full history saved. [2025-09-19T20:25:09.996099] [INFO ] [MAIN ] Update Progress: 1544/2372 symbols completed. NU took 42.6s. Estimated remaining: 1h 49m 59s. Rate: 7.5 symbols/min [2025-09-19T20:25:10.173687] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:25:10.189965] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T20:25:10.202683] [DEBUG] [LOCAL ] NUW: Loaded 7549 existing records from primary storage. [2025-09-19T20:25:10.202835] [INFO ] [MAIN ] NUW: Loaded 7549 existing records. [2025-09-19T20:25:10.248363] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-19T20:25:10.397544] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:25:10.397901] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-19T20:25:10.397961] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-19T20:25:10.398426] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-19T20:25:10.398487] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-19T20:25:10.761813] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:25:11.043285] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-19T20:25:11.388297] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T20:25:11.843320] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-19T20:25:11.996880] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T20:25:12.086841] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T20:25:12.643294] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-19T20:25:13.443284] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-19T20:25:13.481223] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T20:25:14.243292] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-19T20:25:14.696712] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T20:25:14.783434] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T20:25:15.043328] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-19T20:25:15.843308] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-19T20:25:16.256530] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T20:25:16.435511] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T20:25:16.643292] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-19T20:25:17.443303] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-19T20:25:17.639754] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T20:25:18.200283] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T20:25:18.243216] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-19T20:25:18.749346] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T20:25:19.043289] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-19T20:25:19.843291] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-19T20:25:20.303186] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T20:25:20.643349] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-19T20:25:20.830738] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T20:25:20.835707] [INFO ] [REMOTE ] NUS: Full fetch complete (53802 records). [2025-09-19T20:25:20.835804] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-19T20:25:21.223101] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-19T20:25:21.223205] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-19T20:25:21.224100] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-19T20:25:21.224162] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-19T20:25:21.225276] [DEBUG] [LOCAL ] NUS: Trimmed 53802 records to 36901 (keeping 200 days of data) [2025-09-19T20:25:21.430926] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T20:25:21.435750] [INFO ] [REMOTE ] NUV: Full fetch complete (34307 records). [2025-09-19T20:25:21.436156] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-19T20:25:21.448486] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-19T20:25:21.758988] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T20:25:21.857311] [DEBUG] [LOCAL ] NUS: Primary data saved (36901 records). [2025-09-19T20:25:21.857426] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-19T20:25:21.857572] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-19T20:25:21.857503] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-19T20:25:21.858340] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-19T20:25:21.858418] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-19T20:25:21.858696] [INFO ] [MAIN ] Update Progress: 1545/2372 symbols completed. NUS took 32.2s. Estimated remaining: 1h 49m 53s. Rate: 7.5 symbols/min [2025-09-19T20:25:21.923774] [DEBUG] [LOCAL ] NUV: Trimmed 34307 records to 23361 (keeping 200 days of data) [2025-09-19T20:25:22.123503] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:25:22.161593] [DEBUG] [LOCAL ] NVG: Loaded 27443 existing records from primary storage. [2025-09-19T20:25:22.162265] [INFO ] [MAIN ] NVG: Loaded 27443 existing records. [2025-09-19T20:25:22.244806] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-19T20:25:22.361148] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:25:22.362470] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-19T20:25:22.362536] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-19T20:25:22.363839] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-19T20:25:22.364669] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-19T20:25:22.596681] [DEBUG] [LOCAL ] NUV: Primary data saved (23361 records). [2025-09-19T20:25:22.607451] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-19T20:25:22.607597] [INFO ] [MAIN ] Update Progress: 1546/2372 symbols completed. NUV took 24.6s. Estimated remaining: 1h 49m 41s. Rate: 7.5 symbols/min [2025-09-19T20:25:22.972285] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:25:22.992448] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:25:23.026473] [DEBUG] [LOCAL ] NVGS: Loaded 31523 existing records from primary storage. [2025-09-19T20:25:23.026617] [INFO ] [MAIN ] NVGS: Loaded 31523 existing records. [2025-09-19T20:25:23.057792] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-19T20:25:23.215429] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:25:23.215748] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-19T20:25:23.215808] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-19T20:25:23.216632] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-19T20:25:23.216773] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-19T20:25:23.592719] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T20:25:23.672725] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:25:23.707969] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T20:25:23.843317] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-19T20:25:24.643306] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-19T20:25:24.842854] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T20:25:25.443382] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-19T20:25:25.622366] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T20:25:25.863040] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T20:25:26.243283] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-19T20:25:27.043373] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-19T20:25:27.234204] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T20:25:27.641147] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T20:25:27.741944] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T20:25:27.843298] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-19T20:25:28.643346] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-19T20:25:29.226947] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T20:25:29.443307] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-19T20:25:30.243290] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-19T20:25:30.762415] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T20:25:31.043313] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-19T20:25:31.099547] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T20:25:31.261963] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T20:25:31.843299] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-19T20:25:32.643335] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-19T20:25:32.828217] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T20:25:33.270358] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T20:25:33.278734] [INFO ] [REMOTE ] NUVB: Full fetch complete (72441 records). [2025-09-19T20:25:33.278897] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-19T20:25:33.454572] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-19T20:25:33.677515] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-19T20:25:33.677666] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-19T20:25:33.678777] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-19T20:25:33.678844] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-19T20:25:33.680347] [DEBUG] [LOCAL ] NUVB: Trimmed 72441 records to 51955 (keeping 200 days of data) [2025-09-19T20:25:33.977833] [DEBUG] [LOCAL ] NUVB: Primary data saved (51955 records). [2025-09-19T20:25:33.978032] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-19T20:25:33.978146] [INFO ] [MAIN ] Update Progress: 1547/2372 symbols completed. NUVB took 33.1s. Estimated remaining: 1h 49m 35s. Rate: 7.5 symbols/min [2025-09-19T20:25:34.154982] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:25:34.171735] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T20:25:34.234490] [DEBUG] [LOCAL ] NVO: Loaded 54174 existing records from primary storage. [2025-09-19T20:25:34.234709] [INFO ] [MAIN ] NVO: Loaded 54174 existing records. [2025-09-19T20:25:34.248355] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-19T20:25:34.425403] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:25:34.425735] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-19T20:25:34.425791] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-19T20:25:34.427709] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-19T20:25:34.427772] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-19T20:25:34.782420] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:25:35.043240] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-19T20:25:35.078057] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T20:25:35.199622] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T20:25:35.843286] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-19T20:25:36.643351] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-19T20:25:37.443337] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-19T20:25:37.494411] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T20:25:37.527708] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T20:25:37.886949] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-19T20:25:38.243318] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-19T20:25:38.865444] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T20:25:39.043299] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-19T20:25:39.843293] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-19T20:25:40.643390] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-19T20:25:40.773538] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T20:25:41.098349] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T20:25:41.130677] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.89 seconds). [2025-09-19T20:25:41.443293] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-19T20:25:42.243332] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-19T20:25:42.282585] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T20:25:42.284248] [INFO ] [REMOTE ] NUW: Full fetch complete (11844 records). [2025-09-19T20:25:42.284322] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-19T20:25:42.625596] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T20:25:42.700468] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-19T20:25:42.700558] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-19T20:25:42.700908] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-19T20:25:42.700969] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-19T20:25:42.701417] [DEBUG] [LOCAL ] NUW: Trimmed 11844 records to 7591 (keeping 200 days of data) [2025-09-19T20:25:42.748873] [DEBUG] [LOCAL ] NUW: Primary data saved (7591 records). [2025-09-19T20:25:42.749019] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-19T20:25:42.749111] [INFO ] [MAIN ] Update Progress: 1548/2372 symbols completed. NUW took 32.8s. Estimated remaining: 1h 49m 28s. Rate: 7.5 symbols/min [2025-09-19T20:25:42.921438] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:25:42.942875] [DEBUG] [LOCAL ] NVR: Loaded 19706 existing records from primary storage. [2025-09-19T20:25:42.943047] [INFO ] [MAIN ] NVR: Loaded 19706 existing records. [2025-09-19T20:25:43.048481] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-19T20:25:43.127036] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:25:43.127302] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-19T20:25:43.127354] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-19T20:25:43.128054] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-19T20:25:43.128130] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-19T20:25:43.552125] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:25:43.843355] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-19T20:25:44.643390] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-19T20:25:44.848567] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T20:25:44.934879] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-09-19T20:25:45.218255] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T20:25:45.443296] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-19T20:25:46.243310] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-19T20:25:46.274013] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T20:25:46.916891] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T20:25:47.043309] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-19T20:25:47.176184] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-19T20:25:47.843305] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-19T20:25:48.577060] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T20:25:48.643241] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-19T20:25:49.443304] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-19T20:25:50.171898] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T20:25:50.177627] [INFO ] [REMOTE ] NVG: Full fetch complete (40675 records). [2025-09-19T20:25:50.177836] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-19T20:25:50.251256] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-19T20:25:50.753985] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-19T20:25:50.754192] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-19T20:25:50.756166] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-19T20:25:50.756278] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-19T20:25:50.758219] [DEBUG] [LOCAL ] NVG: Trimmed 40675 records to 27624 (keeping 200 days of data) [2025-09-19T20:25:50.936068] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (3.09 seconds). [2025-09-19T20:25:51.048047] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-19T20:25:51.072398] [DEBUG] [LOCAL ] NVG: Primary data saved (27624 records). [2025-09-19T20:25:51.072555] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-19T20:25:51.072678] [INFO ] [MAIN ] Update Progress: 1549/2372 symbols completed. NVG took 29.2s. Estimated remaining: 1h 49m 20s. Rate: 7.5 symbols/min [2025-09-19T20:25:51.302676] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:25:51.334882] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T20:25:51.364296] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T20:25:51.395341] [DEBUG] [LOCAL ] NVRI: Loaded 39272 existing records from primary storage. [2025-09-19T20:25:51.395500] [INFO ] [MAIN ] NVRI: Loaded 39272 existing records. [2025-09-19T20:25:51.584253] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:25:51.584540] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-19T20:25:51.584604] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-19T20:25:51.585375] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-19T20:25:51.585445] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-19T20:25:51.848356] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-19T20:25:51.966357] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:25:52.643305] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-19T20:25:53.277170] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T20:25:53.420637] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T20:25:53.443212] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-19T20:25:54.207953] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T20:25:54.243236] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-19T20:25:55.043363] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-19T20:25:55.683361] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T20:25:55.843348] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-19T20:25:56.240374] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-19T20:25:56.643390] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-19T20:25:56.787671] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T20:25:57.230191] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T20:25:57.234143] [INFO ] [REMOTE ] NVGS: Full fetch complete (41492 records). [2025-09-19T20:25:57.234278] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-19T20:25:57.452780] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-19T20:25:57.642900] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-19T20:25:57.642990] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-19T20:25:57.644042] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-19T20:25:57.644106] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-19T20:25:57.645615] [DEBUG] [LOCAL ] NVGS: Trimmed 41492 records to 31645 (keeping 200 days of data) [2025-09-19T20:25:57.854508] [DEBUG] [LOCAL ] NVGS: Primary data saved (31645 records). [2025-09-19T20:25:57.854687] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-19T20:25:57.854810] [INFO ] [MAIN ] Update Progress: 1550/2372 symbols completed. NVGS took 35.2s. Estimated remaining: 1h 49m 11s. Rate: 7.5 symbols/min [2025-09-19T20:25:58.052041] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:25:58.113669] [DEBUG] [LOCAL ] NVS: Loaded 52098 existing records from primary storage. [2025-09-19T20:25:58.113833] [INFO ] [MAIN ] NVS: Loaded 52098 existing records. [2025-09-19T20:25:58.253098] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-19T20:25:58.297368] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:25:58.297628] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-19T20:25:58.297713] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-19T20:25:58.298932] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-19T20:25:58.298994] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-19T20:25:58.674994] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:25:59.043354] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-19T20:25:59.225033] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-19T20:25:59.592617] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.95 seconds). [2025-09-19T20:25:59.626975] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T20:25:59.843347] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-19T20:26:00.643347] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-19T20:26:01.175767] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T20:26:01.443289] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-19T20:26:01.511732] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T20:26:02.243296] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-19T20:26:03.043301] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-19T20:26:03.483463] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T20:26:03.613041] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T20:26:03.756695] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (3.11 seconds). [2025-09-19T20:26:03.843226] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-19T20:26:04.487039] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T20:26:04.643271] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-19T20:26:04.776590] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T20:26:05.443287] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-19T20:26:06.243322] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-19T20:26:06.731181] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T20:26:06.824365] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-19T20:26:07.043307] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-19T20:26:07.843298] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-19T20:26:08.643338] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-19T20:26:08.837602] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T20:26:08.983858] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-19T20:26:09.348725] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-19T20:26:09.443225] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-19T20:26:10.243238] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-19T20:26:10.392627] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-19T20:26:10.725317] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T20:26:10.729248] [INFO ] [REMOTE ] NVR: Full fetch complete (29866 records). [2025-09-19T20:26:10.729433] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-19T20:26:11.048351] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-19T20:26:11.120311] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-19T20:26:11.120396] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-19T20:26:11.121045] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-19T20:26:11.121145] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-19T20:26:11.121927] [DEBUG] [LOCAL ] NVR: Trimmed 29866 records to 19838 (keeping 200 days of data) [2025-09-19T20:26:11.261623] [DEBUG] [LOCAL ] NVR: Primary data saved (19838 records). [2025-09-19T20:26:11.261928] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-19T20:26:11.262197] [INFO ] [MAIN ] Update Progress: 1551/2372 symbols completed. NVR took 28.5s. Estimated remaining: 1h 49m 6s. Rate: 7.5 symbols/min [2025-09-19T20:26:11.436309] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:26:11.492508] [DEBUG] [LOCAL ] NVST: Loaded 52081 existing records from primary storage. [2025-09-19T20:26:11.492696] [INFO ] [MAIN ] NVST: Loaded 52081 existing records. [2025-09-19T20:26:11.677003] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:26:11.677409] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-19T20:26:11.677594] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-19T20:26:11.684924] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-19T20:26:11.695972] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-19T20:26:11.764421] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T20:26:11.849462] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-19T20:26:12.082501] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:26:12.643365] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-19T20:26:13.443310] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-19T20:26:13.677887] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T20:26:13.917877] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-09-19T20:26:13.927220] [INFO ] [REMOTE ] NVO: Full fetch complete (77954 records). [2025-09-19T20:26:13.927374] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-19T20:26:14.248319] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-19T20:26:14.357700] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-19T20:26:14.357789] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-19T20:26:14.358823] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-19T20:26:14.358887] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-19T20:26:14.360352] [DEBUG] [LOCAL ] NVO: Trimmed 77954 records to 54564 (keeping 200 days of data) [2025-09-19T20:26:14.719130] [DEBUG] [LOCAL ] NVO: Primary data saved (54564 records). [2025-09-19T20:26:14.719306] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-19T20:26:14.719444] [INFO ] [MAIN ] Update Progress: 1552/2372 symbols completed. NVO took 40.7s. Estimated remaining: 1h 48m 56s. Rate: 7.5 symbols/min [2025-09-19T20:26:14.897157] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:26:14.952859] [DEBUG] [LOCAL ] NVT: Loaded 52007 existing records from primary storage. [2025-09-19T20:26:14.953033] [INFO ] [MAIN ] NVT: Loaded 52007 existing records. [2025-09-19T20:26:15.146272] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:26:15.146953] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-19T20:26:15.147092] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-19T20:26:15.148325] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-19T20:26:15.148389] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-19T20:26:15.492239] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-19T20:26:15.560051] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:26:15.560805] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-19T20:26:15.598672] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T20:26:15.843367] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-19T20:26:16.068275] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T20:26:16.643299] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-19T20:26:17.443317] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-19T20:26:17.548103] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T20:26:18.034178] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T20:26:18.243294] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-19T20:26:18.484139] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T20:26:18.743439] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T20:26:18.750548] [INFO ] [REMOTE ] NVRI: Full fetch complete (55879 records). [2025-09-19T20:26:18.750687] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-19T20:26:19.048455] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-19T20:26:19.133491] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-19T20:26:19.133573] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-19T20:26:19.134445] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-19T20:26:19.134508] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-19T20:26:19.135793] [DEBUG] [LOCAL ] NVRI: Trimmed 55879 records to 39584 (keeping 200 days of data) [2025-09-19T20:26:19.375771] [DEBUG] [LOCAL ] NVRI: Primary data saved (39584 records). [2025-09-19T20:26:19.376311] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-19T20:26:19.376538] [INFO ] [MAIN ] Update Progress: 1553/2372 symbols completed. NVRI took 28.3s. Estimated remaining: 1h 48m 46s. Rate: 7.5 symbols/min [2025-09-19T20:26:19.547779] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:26:19.610092] [DEBUG] [LOCAL ] NWG: Loaded 52059 existing records from primary storage. [2025-09-19T20:26:19.610242] [INFO ] [MAIN ] NWG: Loaded 52059 existing records. [2025-09-19T20:26:19.788357] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:26:19.788598] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-19T20:26:19.788666] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-19T20:26:19.789893] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-19T20:26:19.789954] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-19T20:26:19.852608] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-19T20:26:20.172612] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:26:20.200396] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T20:26:20.643307] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-19T20:26:21.055687] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T20:26:21.443305] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-19T20:26:21.568421] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T20:26:22.243287] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-19T20:26:22.602247] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T20:26:23.043350] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-19T20:26:23.328536] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T20:26:23.843309] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-19T20:26:24.643257] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-19T20:26:24.697688] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T20:26:25.208454] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T20:26:25.443279] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-19T20:26:26.246736] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-19T20:26:26.248629] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-19T20:26:26.641620] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T20:26:27.043303] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-19T20:26:27.361767] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T20:26:27.843401] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-19T20:26:28.480584] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T20:26:28.643334] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-19T20:26:28.691460] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T20:26:29.299869] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T20:26:29.443280] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-19T20:26:30.243304] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-19T20:26:31.021706] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-19T20:26:31.029501] [INFO ] [REMOTE ] NVS: Full fetch complete (74826 records). [2025-09-19T20:26:31.029683] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-19T20:26:31.065197] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-19T20:26:31.446799] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-19T20:26:31.447158] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-19T20:26:31.448345] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-19T20:26:31.448425] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-19T20:26:31.477870] [DEBUG] [LOCAL ] NVS: Trimmed 74826 records to 52474 (keeping 200 days of data) [2025-09-19T20:26:31.478909] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T20:26:31.831636] [DEBUG] [LOCAL ] NVS: Primary data saved (52474 records). [2025-09-19T20:26:31.831810] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-19T20:26:31.833066] [INFO ] [MAIN ] Update Progress: 1554/2372 symbols completed. NVS took 34.0s. Estimated remaining: 1h 48m 41s. Rate: 7.5 symbols/min [2025-09-19T20:26:31.848616] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-19T20:26:32.006469] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:26:32.044566] [DEBUG] [LOCAL ] NWN: Loaded 27211 existing records from primary storage. [2025-09-19T20:26:32.044775] [INFO ] [MAIN ] NWN: Loaded 27211 existing records. [2025-09-19T20:26:32.225287] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:26:32.225755] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-19T20:26:32.225943] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-19T20:26:32.227037] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-19T20:26:32.227103] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-19T20:26:32.610185] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:26:32.626216] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T20:26:32.650388] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-19T20:26:32.672044] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T20:26:33.443248] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-19T20:26:33.833435] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T20:26:34.243338] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-19T20:26:34.735036] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T20:26:35.043250] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-19T20:26:35.608990] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T20:26:35.843323] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-19T20:26:35.887760] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T20:26:36.415314] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T20:26:36.643275] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-19T20:26:37.443287] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-19T20:26:38.023482] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T20:26:38.243306] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-19T20:26:38.593773] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T20:26:39.002495] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T20:26:39.043214] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-19T20:26:39.843255] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-19T20:26:40.262094] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T20:26:40.643318] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-19T20:26:41.160356] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T20:26:41.443300] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-19T20:26:41.639439] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T20:26:41.647778] [INFO ] [REMOTE ] NVST: Full fetch complete (74089 records). [2025-09-19T20:26:41.647934] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-19T20:26:42.069788] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-19T20:26:42.069882] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-19T20:26:42.070890] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-19T20:26:42.070970] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-19T20:26:42.072478] [DEBUG] [LOCAL ] NVST: Trimmed 74089 records to 52463 (keeping 200 days of data) [2025-09-19T20:26:42.251064] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-19T20:26:42.402918] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T20:26:42.430667] [DEBUG] [LOCAL ] NVST: Primary data saved (52463 records). [2025-09-19T20:26:42.430799] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-19T20:26:42.430896] [INFO ] [MAIN ] Update Progress: 1555/2372 symbols completed. NVST took 31.2s. Estimated remaining: 1h 48m 34s. Rate: 7.5 symbols/min [2025-09-19T20:26:42.612887] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:26:42.649765] [DEBUG] [LOCAL ] NX: Loaded 33687 existing records from primary storage. [2025-09-19T20:26:42.649918] [INFO ] [MAIN ] NX: Loaded 33687 existing records. [2025-09-19T20:26:42.827455] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:26:42.827721] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-19T20:26:42.827800] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-19T20:26:42.828534] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-19T20:26:42.828595] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-19T20:26:43.066373] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-19T20:26:43.186112] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:26:43.259457] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T20:26:43.287037] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T20:26:43.294551] [INFO ] [REMOTE ] NVT: Full fetch complete (74475 records). [2025-09-19T20:26:43.294706] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-19T20:26:43.685662] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-19T20:26:43.685797] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-19T20:26:43.686974] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-19T20:26:43.687046] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-19T20:26:43.688714] [DEBUG] [LOCAL ] NVT: Trimmed 74475 records to 52384 (keeping 200 days of data) [2025-09-19T20:26:43.875721] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-19T20:26:44.054488] [DEBUG] [LOCAL ] NVT: Primary data saved (52384 records). [2025-09-19T20:26:44.054911] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-19T20:26:44.055041] [INFO ] [MAIN ] Update Progress: 1556/2372 symbols completed. NVT took 29.3s. Estimated remaining: 1h 48m 23s. Rate: 7.5 symbols/min [2025-09-19T20:26:44.341853] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:26:44.351385] [DEBUG] [LOCAL ] NXC: Loaded 4197 existing records from primary storage. [2025-09-19T20:26:44.351562] [INFO ] [MAIN ] NXC: Loaded 4197 existing records. [2025-09-19T20:26:44.643112] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:26:44.643418] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-19T20:26:44.644281] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-19T20:26:44.645356] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-19T20:26:44.645782] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-19T20:26:44.645852] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-19T20:26:45.105950] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:26:45.139140] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T20:26:45.261692] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T20:26:45.443291] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-19T20:26:46.243288] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-19T20:26:46.263778] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T20:26:46.405872] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T20:26:47.043300] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-19T20:26:47.681725] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-19T20:26:47.698622] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T20:26:47.843309] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-19T20:26:48.643303] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-19T20:26:48.883213] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T20:26:49.443363] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-19T20:26:50.222825] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T20:26:50.243217] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-19T20:26:50.911046] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-19T20:26:50.918522] [INFO ] [REMOTE ] NWG: Full fetch complete (73019 records). [2025-09-19T20:26:50.918674] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-19T20:26:51.048363] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-19T20:26:51.163496] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T20:26:51.328758] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-19T20:26:51.328857] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-19T20:26:51.330015] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-19T20:26:51.330083] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-19T20:26:51.331559] [DEBUG] [LOCAL ] NWG: Trimmed 73019 records to 52434 (keeping 200 days of data) [2025-09-19T20:26:51.656617] [DEBUG] [LOCAL ] NWG: Primary data saved (52434 records). [2025-09-19T20:26:51.656815] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-19T20:26:51.656931] [INFO ] [MAIN ] Update Progress: 1557/2372 symbols completed. NWG took 32.3s. Estimated remaining: 1h 48m 15s. Rate: 7.5 symbols/min [2025-09-19T20:26:51.843261] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-19T20:26:52.643354] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-19T20:26:52.725899] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T20:26:53.443296] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-19T20:26:53.462542] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T20:26:53.647616] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T20:26:54.243344] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-19T20:26:55.031870] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T20:26:55.041667] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T20:26:55.043262] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-19T20:26:55.843362] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-19T20:26:56.622269] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-19T20:26:56.643222] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-19T20:26:56.687956] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T20:26:57.345871] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T20:26:57.443303] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-19T20:26:58.243365] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-19T20:26:58.255326] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T20:26:58.256689] [INFO ] [REMOTE ] NXC: Full fetch complete (5985 records). [2025-09-19T20:26:58.256768] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-19T20:26:58.631251] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-19T20:26:58.631402] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-19T20:26:58.631604] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-19T20:26:58.631703] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-19T20:26:58.632290] [DEBUG] [LOCAL ] NXC: Trimmed 5985 records to 4230 (keeping 200 days of data) [2025-09-19T20:26:58.662637] [DEBUG] [LOCAL ] NXC: Primary data saved (4230 records). [2025-09-19T20:26:58.662764] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-19T20:26:58.662871] [INFO ] [MAIN ] Update Progress: 1558/2372 symbols completed. NXC took 14.6s. Estimated remaining: 1h 48m 6s. Rate: 7.5 symbols/min [2025-09-19T20:26:59.043318] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-19T20:26:59.919553] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T20:26:59.927497] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-19T20:27:00.925236] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T20:27:00.931861] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-19T20:27:02.378597] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T20:27:02.386034] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-19T20:27:05.389565] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-19T20:27:05.396223] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-19T20:27:07.083947] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T20:27:07.091386] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-19T20:27:08.771349] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T20:27:08.782876] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-19T20:27:10.359994] [DEBUG] [REMOTE ] NWN: Error fetching primary data for 2025-07: Server request status code is 503. [2025-09-19T20:27:10.360413] [WARN ] [REMOTE ] NWN: No data returned for month 2025-07 [2025-09-19T20:27:10.361058] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-19T20:27:10.420550] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T20:27:10.427492] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-19T20:27:11.856472] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T20:27:11.862586] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-19T20:27:11.982691] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T20:27:11.989512] [INFO ] [REMOTE ] NX: Full fetch complete (48069 records). [2025-09-19T20:27:11.989699] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-19T20:27:12.388224] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-19T20:27:12.388305] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-19T20:27:12.389107] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-19T20:27:12.389168] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-19T20:27:12.390221] [DEBUG] [LOCAL ] NX: Trimmed 48069 records to 33956 (keeping 200 days of data) [2025-09-19T20:27:12.607486] [DEBUG] [LOCAL ] NX: Primary data saved (33956 records). [2025-09-19T20:27:12.607675] [INFO ] [MAIN ] NX: Full history saved. [2025-09-19T20:27:12.607812] [INFO ] [MAIN ] Update Progress: 1559/2372 symbols completed. NX took 30.2s. Estimated remaining: 1h 48m 1s. Rate: 7.5 symbols/min [2025-09-19T20:27:13.256795] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T20:27:13.260810] [INFO ] [REMOTE ] NWN: Full fetch complete (32456 records). [2025-09-19T20:27:13.260894] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-19T20:27:13.459899] [WARN ] [VALIDATOR ] NWN: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T20:27:13.460340] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:27:13.460412] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:27:13.460499] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-19T20:27:13.460590] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-09-19T20:27:13.460666] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-09-19T20:27:13.461142] [DEBUG] [LOCAL ] NWN: Deleted derivative data file. [2025-09-19T20:27:13.461241] [INFO ] [MAIN ] Update Progress: 1560/2372 symbols completed. NWN took 41.6s. Estimated remaining: 1h 47m 50s. Rate: 7.5 symbols/min [2025-09-19T20:27:14.046018] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:14.115512] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-19T20:27:14.167497] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:14.166674] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:14.172877] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-19T20:27:14.197464] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-19T20:27:14.197073] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:14.197836] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-19T20:27:14.198307] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-19T20:27:14.198367] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-19T20:27:14.342495] [DEBUG] [LOCAL ] NXDT: Loaded 16690 existing records from primary storage. [2025-09-19T20:27:14.371034] [DEBUG] [LOCAL ] NXG: Loaded 10679 existing records from primary storage. [2025-09-19T20:27:14.377094] [INFO ] [MAIN ] NXG: Loaded 10679 existing records. [2025-09-19T20:27:14.376967] [INFO ] [MAIN ] NXDT: Loaded 16690 existing records. [2025-09-19T20:27:14.794473] [DEBUG] [LOCAL ] NXE: Loaded 53370 existing records from primary storage. [2025-09-19T20:27:14.806216] [INFO ] [MAIN ] NXE: Loaded 53370 existing records. [2025-09-19T20:27:15.087792] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:27:15.136002] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:27:15.139807] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:15.166504] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-19T20:27:15.166154] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-19T20:27:15.183114] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-19T20:27:15.183216] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-19T20:27:15.183350] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-19T20:27:15.189251] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-19T20:27:15.189137] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-19T20:27:15.194546] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-19T20:27:15.194912] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-19T20:27:15.394817] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:27:15.482056] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-19T20:27:15.493454] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-19T20:27:15.578822] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:27:15.549614] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-19T20:27:15.620894] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-19T20:27:15.653362] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-19T20:27:15.742703] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-19T20:27:16.202374] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:27:16.287525] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:16.312543] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-19T20:27:16.340010] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-19T20:27:16.340326] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-19T20:27:16.339288] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:16.359608] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-19T20:27:16.445559] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:16.446197] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-19T20:27:16.725701] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:27:16.726070] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-19T20:27:16.726526] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-19T20:27:17.038908] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:27:17.039356] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-19T20:27:17.039974] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-19T20:27:17.348274] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:27:17.348630] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-19T20:27:17.349124] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-19T20:27:17.508594] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T20:27:17.511489] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-19T20:27:17.647074] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:27:17.647439] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-19T20:27:17.647961] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-19T20:27:17.904761] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T20:27:17.909983] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-19T20:27:17.970127] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:27:17.970436] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-19T20:27:17.970925] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-19T20:27:18.557047] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T20:27:18.568051] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-19T20:27:18.574962] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T20:27:18.577539] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-19T20:27:18.891357] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T20:27:19.043353] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-19T20:27:19.164180] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T20:27:19.424739] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T20:27:19.843298] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-19T20:27:20.546886] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T20:27:20.643230] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-19T20:27:21.111007] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T20:27:21.170872] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T20:27:21.443347] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-19T20:27:22.243313] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-19T20:27:22.698060] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T20:27:22.912086] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-19T20:27:23.043285] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-19T20:27:23.208822] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T20:27:23.215831] [INFO ] [REMOTE ] NXDR: Full fetch complete (15886 records). [2025-09-19T20:27:23.215911] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-19T20:27:23.398688] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 44 unique days, need 200 days [2025-09-19T20:27:23.398996] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:27:23.399066] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:27:23.399116] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-19T20:27:23.399173] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-19T20:27:23.399218] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-19T20:27:23.399258] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-19T20:27:23.399321] [INFO ] [MAIN ] Update Progress: 1561/2372 symbols completed. NXDR took 9.9s. Estimated remaining: 1h 47m 43s. Rate: 7.5 symbols/min [2025-09-19T20:27:23.621425] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:23.638212] [DEBUG] [LOCAL ] NXJ: Loaded 15048 existing records from primary storage. [2025-09-19T20:27:23.638338] [INFO ] [MAIN ] NXJ: Loaded 15048 existing records. [2025-09-19T20:27:23.824557] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:27:23.824960] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-19T20:27:23.825023] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-19T20:27:23.825688] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-19T20:27:23.825770] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-19T20:27:23.848454] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-19T20:27:24.202533] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:24.325274] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T20:27:24.643294] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-19T20:27:25.443309] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-19T20:27:25.720019] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T20:27:26.130451] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T20:27:26.227024] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-19T20:27:26.243214] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-19T20:27:27.043301] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-19T20:27:27.214528] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T20:27:27.843317] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-19T20:27:28.643319] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-19T20:27:28.858466] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T20:27:29.443251] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-19T20:27:29.518814] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T20:27:29.914909] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T20:27:30.243252] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-19T20:27:30.487614] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T20:27:31.043347] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-19T20:27:31.262456] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-19T20:27:31.843291] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-19T20:27:32.526787] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T20:27:32.643341] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-19T20:27:32.998890] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T20:27:33.432169] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T20:27:33.443203] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-19T20:27:34.243234] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-19T20:27:34.732574] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T20:27:35.043287] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-19T20:27:35.843312] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-19T20:27:36.119125] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T20:27:36.121323] [INFO ] [REMOTE ] NXG: Full fetch complete (14448 records). [2025-09-19T20:27:36.121395] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-19T20:27:36.495676] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-19T20:27:36.495877] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-19T20:27:36.496349] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-19T20:27:36.496435] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-19T20:27:36.497505] [DEBUG] [LOCAL ] NXG: Trimmed 14448 records to 10734 (keeping 200 days of data) [2025-09-19T20:27:36.602924] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T20:27:36.621158] [DEBUG] [LOCAL ] NXG: Primary data saved (10734 records). [2025-09-19T20:27:36.621292] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-19T20:27:36.621390] [INFO ] [MAIN ] Update Progress: 1562/2372 symbols completed. NXG took 23.2s. Estimated remaining: 1h 47m 37s. Rate: 7.5 symbols/min [2025-09-19T20:27:36.654360] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-19T20:27:36.865844] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T20:27:36.914240] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:36.919829] [DEBUG] [LOCAL ] NXN: Loaded 2344 existing records from primary storage. [2025-09-19T20:27:36.919985] [INFO ] [MAIN ] NXN: Loaded 2344 existing records. [2025-09-19T20:27:37.187138] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:27:37.187523] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-19T20:27:37.187604] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-19T20:27:37.187959] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-19T20:27:37.188040] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-19T20:27:37.451287] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-19T20:27:37.660333] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:37.786209] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T20:27:37.789110] [INFO ] [REMOTE ] NXDT: Full fetch complete (25811 records). [2025-09-19T20:27:37.789227] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-19T20:27:38.194669] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-19T20:27:38.194795] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-19T20:27:38.195406] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-19T20:27:38.195447] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-19T20:27:38.196173] [DEBUG] [LOCAL ] NXDT: Trimmed 25811 records to 16764 (keeping 200 days of data) [2025-09-19T20:27:38.264276] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-19T20:27:38.295315] [DEBUG] [LOCAL ] NXDT: Primary data saved (16764 records). [2025-09-19T20:27:38.295476] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-19T20:27:38.295583] [INFO ] [MAIN ] Update Progress: 1563/2372 symbols completed. NXDT took 24.8s. Estimated remaining: 1h 47m 26s. Rate: 7.5 symbols/min [2025-09-19T20:27:38.462207] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:38.475996] [DEBUG] [LOCAL ] NXP: Loaded 12338 existing records from primary storage. [2025-09-19T20:27:38.476124] [INFO ] [MAIN ] NXP: Loaded 12338 existing records. [2025-09-19T20:27:38.660549] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T20:27:38.664669] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:27:38.667781] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-19T20:27:38.668639] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-19T20:27:38.669256] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-19T20:27:38.669317] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-19T20:27:39.049526] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:39.045320] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-19T20:27:39.848391] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-19T20:27:39.862177] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T20:27:40.120511] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T20:27:40.593028] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-19T20:27:40.643239] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-19T20:27:41.387100] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T20:27:41.443251] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-19T20:27:42.197011] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T20:27:42.243224] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-19T20:27:42.883531] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-19T20:27:43.043263] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-19T20:27:43.843247] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-19T20:27:44.235466] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T20:27:44.643268] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-19T20:27:44.975636] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T20:27:45.330257] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T20:27:45.443319] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-19T20:27:46.243269] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-19T20:27:46.519985] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T20:27:47.043303] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-19T20:27:47.702270] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T20:27:47.843292] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-19T20:27:48.031158] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T20:27:48.643311] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-19T20:27:49.318893] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T20:27:49.443310] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-19T20:27:50.107617] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T20:27:50.243243] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-19T20:27:50.472473] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T20:27:51.043351] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-19T20:27:51.843309] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-19T20:27:51.887777] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T20:27:52.439194] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T20:27:52.643290] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-19T20:27:52.786988] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T20:27:53.252399] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T20:27:53.443299] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-19T20:27:54.243364] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-19T20:27:54.858138] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T20:27:55.043302] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-19T20:27:55.775922] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T20:27:55.843267] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-19T20:27:56.288494] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T20:27:56.296397] [INFO ] [REMOTE ] NXE: Full fetch complete (76628 records). [2025-09-19T20:27:56.296527] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-19T20:27:56.662290] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-19T20:27:56.686183] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-19T20:27:56.687378] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-19T20:27:56.688630] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-19T20:27:56.688838] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-19T20:27:56.690396] [DEBUG] [LOCAL ] NXE: Trimmed 76628 records to 53760 (keeping 200 days of data) [2025-09-19T20:27:57.023216] [DEBUG] [LOCAL ] NXE: Primary data saved (53760 records). [2025-09-19T20:27:57.023396] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-19T20:27:57.026360] [INFO ] [MAIN ] Update Progress: 1564/2372 symbols completed. NXE took 43.6s. Estimated remaining: 1h 47m 24s. Rate: 7.5 symbols/min [2025-09-19T20:27:57.195585] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:57.218283] [DEBUG] [LOCAL ] NXRT: Loaded 19066 existing records from primary storage. [2025-09-19T20:27:57.218463] [INFO ] [MAIN ] NXRT: Loaded 19066 existing records. [2025-09-19T20:27:57.423319] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:27:57.423847] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-19T20:27:57.433732] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-19T20:27:57.435028] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T20:27:57.436471] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-19T20:27:57.439183] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-19T20:27:57.450812] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-19T20:27:57.813489] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:57.842849] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-19T20:27:58.030523] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T20:27:58.031570] [INFO ] [REMOTE ] NXN: Full fetch complete (3680 records). [2025-09-19T20:27:58.031683] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-19T20:27:58.250140] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-19T20:27:58.425547] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-19T20:27:58.425637] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-19T20:27:58.425883] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-19T20:27:58.425949] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-19T20:27:58.426450] [DEBUG] [LOCAL ] NXN: Trimmed 3680 records to 2363 (keeping 200 days of data) [2025-09-19T20:27:58.441778] [DEBUG] [LOCAL ] NXN: Primary data saved (2363 records). [2025-09-19T20:27:58.441845] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-19T20:27:58.441922] [INFO ] [MAIN ] Update Progress: 1565/2372 symbols completed. NXN took 21.8s. Estimated remaining: 1h 47m 12s. Rate: 7.5 symbols/min [2025-09-19T20:27:58.637017] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:27:58.637227] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-19T20:27:58.637271] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-19T20:27:58.637416] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-19T20:27:58.637459] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-19T20:27:58.637501] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-19T20:27:58.637533] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-19T20:27:59.034999] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:27:59.043219] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-19T20:27:59.174627] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T20:27:59.633540] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-19T20:27:59.843307] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-19T20:28:00.490394] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T20:28:00.643254] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-19T20:28:01.379995] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-19T20:28:01.443262] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-19T20:28:02.025452] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T20:28:02.243255] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-19T20:28:03.043250] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-19T20:28:03.312546] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T20:28:03.654660] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T20:28:03.843272] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-19T20:28:04.643334] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-19T20:28:04.931782] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T20:28:05.132246] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-19T20:28:05.443264] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-19T20:28:06.056779] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T20:28:06.243323] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-19T20:28:06.783542] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T20:28:07.043268] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-19T20:28:07.843254] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-19T20:28:08.094236] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T20:28:08.643252] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-19T20:28:09.010183] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T20:28:09.443237] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-19T20:28:09.860789] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T20:28:10.243233] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-19T20:28:10.753743] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T20:28:11.043259] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-19T20:28:11.411903] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T20:28:11.843310] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-19T20:28:12.272508] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-19T20:28:12.432776] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T20:28:12.643243] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-19T20:28:13.443242] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-19T20:28:13.945469] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T20:28:14.243307] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-19T20:28:14.486322] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T20:28:14.488895] [INFO ] [REMOTE ] NXP: Full fetch complete (16801 records). [2025-09-19T20:28:14.488985] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-19T20:28:14.866786] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-19T20:28:14.866864] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-19T20:28:14.867235] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-19T20:28:14.867273] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-19T20:28:14.867828] [DEBUG] [LOCAL ] NXP: Trimmed 16801 records to 12392 (keeping 200 days of data) [2025-09-19T20:28:14.947894] [DEBUG] [LOCAL ] NXP: Primary data saved (12392 records). [2025-09-19T20:28:14.948022] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-19T20:28:14.948171] [INFO ] [MAIN ] Update Progress: 1566/2372 symbols completed. NXP took 36.7s. Estimated remaining: 1h 47m 9s. Rate: 7.5 symbols/min [2025-09-19T20:28:15.051677] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-19T20:28:15.129873] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:28:15.184173] [DEBUG] [LOCAL ] NYT: Loaded 50408 existing records from primary storage. [2025-09-19T20:28:15.184332] [INFO ] [MAIN ] NYT: Loaded 50408 existing records. [2025-09-19T20:28:15.362176] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:28:15.362494] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-19T20:28:15.362562] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-19T20:28:15.364330] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-19T20:28:15.364410] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-19T20:28:15.728119] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T20:28:15.755845] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:28:15.743058] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-19T20:28:15.764005] [INFO ] [REMOTE ] NYC: Full fetch complete (1910 records). [2025-09-19T20:28:15.764148] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-19T20:28:15.848449] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-19T20:28:15.953237] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-19T20:28:15.953506] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:28:15.953613] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:28:15.953736] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-19T20:28:15.953833] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-19T20:28:15.953907] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-19T20:28:15.954010] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-19T20:28:15.954152] [INFO ] [MAIN ] Update Progress: 1567/2372 symbols completed. NYC took 17.5s. Estimated remaining: 1h 46m 57s. Rate: 7.5 symbols/min [2025-09-19T20:28:16.125471] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:28:16.180925] [DEBUG] [LOCAL ] NZF: Loaded 29501 existing records from primary storage. [2025-09-19T20:28:16.181122] [INFO ] [MAIN ] NZF: Loaded 29501 existing records. [2025-09-19T20:28:16.363316] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:28:16.363564] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-19T20:28:16.363614] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-19T20:28:16.364813] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-19T20:28:16.364879] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-19T20:28:16.644528] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-19T20:28:16.726939] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:28:17.211295] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T20:28:17.443243] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-19T20:28:18.243444] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-19T20:28:18.631493] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T20:28:18.716013] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T20:28:19.043328] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-19T20:28:19.843351] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-19T20:28:20.094099] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T20:28:20.421443] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T20:28:20.425422] [INFO ] [REMOTE ] NXJ: Full fetch complete (21410 records). [2025-09-19T20:28:20.425525] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-19T20:28:20.648585] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-19T20:28:20.799496] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-19T20:28:20.799592] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-19T20:28:20.800096] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-19T20:28:20.800175] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-19T20:28:20.801169] [DEBUG] [LOCAL ] NXJ: Trimmed 21410 records to 15097 (keeping 200 days of data) [2025-09-19T20:28:20.909403] [DEBUG] [LOCAL ] NXJ: Primary data saved (15097 records). [2025-09-19T20:28:20.909603] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-19T20:28:20.909854] [INFO ] [MAIN ] Update Progress: 1568/2372 symbols completed. NXJ took 57.5s. Estimated remaining: 1h 46m 48s. Rate: 7.5 symbols/min [2025-09-19T20:28:21.099730] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:28:21.111464] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T20:28:21.111103] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-19T20:28:21.114980] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-19T20:28:21.115241] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-19T20:28:21.115291] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-19T20:28:21.115339] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-19T20:28:21.115423] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-19T20:28:21.161283] [INFO ] [REMOTE ] NXRT: Full fetch complete (24954 records). [2025-09-19T20:28:21.183003] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-19T20:28:21.454535] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-19T20:28:21.870325] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:28:21.898408] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-19T20:28:21.898495] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-19T20:28:21.899126] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-19T20:28:21.899189] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-19T20:28:21.899936] [DEBUG] [LOCAL ] NXRT: Trimmed 24954 records to 19184 (keeping 200 days of data) [2025-09-19T20:28:22.042807] [DEBUG] [LOCAL ] NXRT: Primary data saved (19184 records). [2025-09-19T20:28:22.043007] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-19T20:28:22.043170] [INFO ] [MAIN ] Update Progress: 1569/2372 symbols completed. NXRT took 25.0s. Estimated remaining: 1h 46m 36s. Rate: 7.5 symbols/min [2025-09-19T20:28:22.211628] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:28:22.253191] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-19T20:28:22.277404] [DEBUG] [LOCAL ] OBDC: Loaded 52021 existing records from primary storage. [2025-09-19T20:28:22.277545] [INFO ] [MAIN ] OBDC: Loaded 52021 existing records. [2025-09-19T20:28:22.456438] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:28:22.456730] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-19T20:28:22.456786] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-19T20:28:22.458333] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-19T20:28:22.458396] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-19T20:28:22.832224] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:28:22.859330] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T20:28:23.043265] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-19T20:28:23.155560] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T20:28:23.843313] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-19T20:28:24.643349] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-19T20:28:25.294783] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-19T20:28:25.367814] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T20:28:25.412449] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (3.16 seconds). [2025-09-19T20:28:25.443209] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-19T20:28:26.243271] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-19T20:28:26.428744] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T20:28:27.043346] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-19T20:28:27.843339] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-19T20:28:28.353190] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-09-19T20:28:28.408597] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T20:28:28.643356] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-19T20:28:29.180941] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T20:28:29.374446] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T20:28:29.443321] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-19T20:28:30.243412] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-19T20:28:31.043359] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-19T20:28:31.171245] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T20:28:31.391288] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-19T20:28:31.843395] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-19T20:28:32.197608] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T20:28:32.643250] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-19T20:28:33.045418] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T20:28:33.208798] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T20:28:33.443308] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-19T20:28:34.243306] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-19T20:28:34.421903] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T20:28:35.043307] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-19T20:28:35.843275] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-19T20:28:36.291593] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T20:28:36.346994] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-09-19T20:28:36.643321] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-19T20:28:37.380380] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T20:28:37.436306] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T20:28:37.443207] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-19T20:28:38.243315] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-19T20:28:38.979539] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T20:28:39.043323] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-19T20:28:39.464284] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-19T20:28:39.843257] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-19T20:28:40.379006] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T20:28:40.597794] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T20:28:40.643269] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-19T20:28:41.443276] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-19T20:28:42.243318] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-19T20:28:42.616416] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T20:28:42.876956] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T20:28:42.882453] [INFO ] [REMOTE ] NZF: Full fetch complete (43778 records). [2025-09-19T20:28:42.882543] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-19T20:28:43.064004] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-19T20:28:43.139553] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (3.30 seconds). [2025-09-19T20:28:43.321076] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-19T20:28:43.321178] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-19T20:28:43.321952] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-19T20:28:43.322014] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-19T20:28:43.323103] [DEBUG] [LOCAL ] NZF: Trimmed 43778 records to 29676 (keeping 200 days of data) [2025-09-19T20:28:43.514170] [DEBUG] [LOCAL ] NZF: Primary data saved (29676 records). [2025-09-19T20:28:43.514322] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-19T20:28:43.514429] [INFO ] [MAIN ] Update Progress: 1570/2372 symbols completed. NZF took 27.6s. Estimated remaining: 1h 46m 35s. Rate: 7.5 symbols/min [2025-09-19T20:28:43.693385] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:28:43.711077] [DEBUG] [LOCAL ] OBK: Loaded 16369 existing records from primary storage. [2025-09-19T20:28:43.711209] [INFO ] [MAIN ] OBK: Loaded 16369 existing records. [2025-09-19T20:28:43.852306] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-19T20:28:43.893620] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:28:43.893880] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-19T20:28:43.893928] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-19T20:28:43.894762] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-19T20:28:43.894822] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-19T20:28:44.249827] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:28:44.365594] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T20:28:44.643279] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-19T20:28:45.175597] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T20:28:45.443270] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-19T20:28:46.010295] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T20:28:46.243260] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-19T20:28:46.765453] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.91 seconds). [2025-09-19T20:28:47.043325] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-19T20:28:47.402498] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T20:28:47.509038] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T20:28:47.843309] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-19T20:28:48.643251] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-19T20:28:49.443262] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-19T20:28:49.941719] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-19T20:28:50.212197] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T20:28:50.243224] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-19T20:28:50.464597] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T20:28:50.532018] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T20:28:50.539452] [INFO ] [REMOTE ] NYT: Full fetch complete (72115 records). [2025-09-19T20:28:50.539574] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-19T20:28:50.951892] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-19T20:28:50.952037] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-19T20:28:50.953329] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-19T20:28:50.953411] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-19T20:28:50.955031] [DEBUG] [LOCAL ] NYT: Trimmed 72115 records to 50763 (keeping 200 days of data) [2025-09-19T20:28:51.045381] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-19T20:28:51.288903] [DEBUG] [LOCAL ] NYT: Primary data saved (50763 records). [2025-09-19T20:28:51.289060] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-19T20:28:51.289167] [INFO ] [MAIN ] Update Progress: 1571/2372 symbols completed. NYT took 36.3s. Estimated remaining: 1h 46m 27s. Rate: 7.5 symbols/min [2025-09-19T20:28:51.467612] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:28:51.521395] [DEBUG] [LOCAL ] OC: Loaded 45202 existing records from primary storage. [2025-09-19T20:28:51.521551] [INFO ] [MAIN ] OC: Loaded 45202 existing records. [2025-09-19T20:28:51.702604] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:28:51.702891] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-19T20:28:51.702939] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-19T20:28:51.704354] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-19T20:28:51.704416] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-19T20:28:51.848527] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-19T20:28:52.071244] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:28:52.346012] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T20:28:52.643273] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-19T20:28:53.039394] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-19T20:28:53.443316] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-19T20:28:53.967489] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T20:28:53.995052] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T20:28:54.243318] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-19T20:28:55.043267] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-19T20:28:55.843281] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-19T20:28:55.942314] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-19T20:28:55.951335] [INFO ] [REMOTE ] O: Full fetch complete (77557 records). [2025-09-19T20:28:55.951598] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-19T20:28:56.170764] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T20:28:56.171940] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:28:56.172102] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:28:56.172498] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-19T20:28:56.172578] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-19T20:28:56.172616] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-19T20:28:56.172711] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-19T20:28:56.172816] [INFO ] [MAIN ] Update Progress: 1572/2372 symbols completed. O took 35.3s. Estimated remaining: 1h 46m 18s. Rate: 7.5 symbols/min [2025-09-19T20:28:56.283373] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T20:28:56.392972] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:28:56.403809] [DEBUG] [LOCAL ] OCFT: Loaded 9485 existing records from primary storage. [2025-09-19T20:28:56.403933] [INFO ] [MAIN ] OCFT: Loaded 9485 existing records. [2025-09-19T20:28:56.603619] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:28:56.610060] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T20:28:56.609712] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-19T20:28:56.610330] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-19T20:28:56.613819] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-19T20:28:56.614371] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-19T20:28:56.648401] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-19T20:28:56.977845] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:28:57.380887] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T20:28:57.390712] [INFO ] [REMOTE ] OBDC: Full fetch complete (74820 records). [2025-09-19T20:28:57.390886] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-19T20:28:57.448393] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-19T20:28:57.799928] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-19T20:28:57.800034] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-19T20:28:57.801069] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-19T20:28:57.801135] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-19T20:28:57.802726] [DEBUG] [LOCAL ] OBDC: Trimmed 74820 records to 52406 (keeping 200 days of data) [2025-09-19T20:28:58.146942] [DEBUG] [LOCAL ] OBDC: Primary data saved (52406 records). [2025-09-19T20:28:58.147107] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-19T20:28:58.147200] [INFO ] [MAIN ] Update Progress: 1573/2372 symbols completed. OBDC took 36.1s. Estimated remaining: 1h 46m 7s. Rate: 7.5 symbols/min [2025-09-19T20:28:58.248150] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-19T20:28:58.332053] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:28:58.338206] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T20:28:58.348799] [DEBUG] [LOCAL ] ODC: Loaded 8577 existing records from primary storage. [2025-09-19T20:28:58.348943] [INFO ] [MAIN ] ODC: Loaded 8577 existing records. [2025-09-19T20:28:58.537391] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:28:58.537985] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-19T20:28:58.538078] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-19T20:28:58.538509] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-19T20:28:58.538573] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-19T20:28:58.741970] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T20:28:58.928197] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:28:59.043244] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-19T20:28:59.560637] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:28:59.762568] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T20:28:59.843241] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-19T20:29:00.643266] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-19T20:29:00.831054] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T20:29:01.301691] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-19T20:29:01.443261] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-19T20:29:02.243259] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-19T20:29:02.729435] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T20:29:03.043266] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-19T20:29:03.533047] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T20:29:03.843261] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-19T20:29:04.042698] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T20:29:04.643261] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-19T20:29:05.412281] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T20:29:05.440537] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T20:29:05.448633] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-19T20:29:06.243263] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-19T20:29:06.362140] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T20:29:07.043329] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-19T20:29:07.843272] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-19T20:29:08.210082] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T20:29:08.276763] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T20:29:08.643273] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-19T20:29:09.145119] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T20:29:09.443265] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-19T20:29:09.630069] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T20:29:10.243277] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-19T20:29:11.043359] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-19T20:29:11.121756] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T20:29:11.123163] [INFO ] [REMOTE ] OCFT: Full fetch complete (11714 records). [2025-09-19T20:29:11.123239] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-19T20:29:11.535902] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-19T20:29:11.536160] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-19T20:29:11.536537] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-19T20:29:11.536617] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-19T20:29:11.537710] [DEBUG] [LOCAL ] OCFT: Trimmed 11714 records to 9497 (keeping 200 days of data) [2025-09-19T20:29:11.629153] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T20:29:11.644885] [DEBUG] [LOCAL ] OCFT: Primary data saved (9497 records). [2025-09-19T20:29:11.645374] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-19T20:29:11.645484] [INFO ] [MAIN ] Update Progress: 1574/2372 symbols completed. OCFT took 15.5s. Estimated remaining: 1h 46m 1s. Rate: 7.5 symbols/min [2025-09-19T20:29:11.826906] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:29:11.843318] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-19T20:29:11.852576] [DEBUG] [LOCAL ] ODV: Loaded 25045 existing records from primary storage. [2025-09-19T20:29:11.852735] [INFO ] [MAIN ] ODV: Loaded 25045 existing records. [2025-09-19T20:29:12.001061] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T20:29:12.064223] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:29:12.064556] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-19T20:29:12.064626] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-19T20:29:12.065556] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-19T20:29:12.065634] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-19T20:29:12.432335] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:29:12.643276] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-19T20:29:13.436356] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-19T20:29:13.443210] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-19T20:29:13.914535] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T20:29:14.243409] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-19T20:29:14.454399] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T20:29:15.043352] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-19T20:29:15.843284] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-19T20:29:16.152125] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T20:29:16.227873] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T20:29:16.542628] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T20:29:16.545948] [INFO ] [REMOTE ] OBK: Full fetch complete (24095 records). [2025-09-19T20:29:16.546031] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-19T20:29:16.648516] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-19T20:29:16.947258] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-19T20:29:16.947349] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-19T20:29:16.947979] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-19T20:29:16.948048] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-19T20:29:16.948788] [DEBUG] [LOCAL ] OBK: Trimmed 24095 records to 16504 (keeping 200 days of data) [2025-09-19T20:29:17.048716] [DEBUG] [LOCAL ] OBK: Primary data saved (16504 records). [2025-09-19T20:29:17.048869] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-19T20:29:17.048956] [INFO ] [MAIN ] Update Progress: 1575/2372 symbols completed. OBK took 33.5s. Estimated remaining: 1h 45m 52s. Rate: 7.5 symbols/min [2025-09-19T20:29:17.222959] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:29:17.223188] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-09-19T20:29:17.223238] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-09-19T20:29:17.223487] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-19T20:29:17.223543] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-19T20:29:17.223617] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-09-19T20:29:17.223697] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-19T20:29:17.448389] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-19T20:29:17.606014] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:29:18.243270] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-19T20:29:18.572487] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T20:29:18.818735] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T20:29:18.837277] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-19T20:29:19.043279] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-19T20:29:19.843269] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-19T20:29:20.046741] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T20:29:20.643262] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-19T20:29:21.443334] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-19T20:29:21.509736] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T20:29:21.737956] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T20:29:22.243332] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-19T20:29:23.043284] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-19T20:29:23.099153] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T20:29:23.179962] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T20:29:23.843246] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-19T20:29:24.388344] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T20:29:24.643344] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-19T20:29:25.443324] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-19T20:29:25.605743] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T20:29:25.612850] [INFO ] [REMOTE ] OC: Full fetch complete (64023 records). [2025-09-19T20:29:25.613000] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-19T20:29:26.036872] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-19T20:29:26.036965] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-19T20:29:26.037957] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-19T20:29:26.038020] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-19T20:29:26.039253] [DEBUG] [LOCAL ] OC: Trimmed 64023 records to 45549 (keeping 200 days of data) [2025-09-19T20:29:26.257343] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-19T20:29:26.330879] [DEBUG] [LOCAL ] OC: Primary data saved (45549 records). [2025-09-19T20:29:26.331128] [INFO ] [MAIN ] OC: Full history saved. [2025-09-19T20:29:26.331260] [INFO ] [MAIN ] Update Progress: 1576/2372 symbols completed. OC took 35.0s. Estimated remaining: 1h 45m 45s. Rate: 7.5 symbols/min [2025-09-19T20:29:26.452590] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T20:29:26.534597] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:29:26.557397] [DEBUG] [LOCAL ] OFG: Loaded 22555 existing records from primary storage. [2025-09-19T20:29:26.557573] [INFO ] [MAIN ] OFG: Loaded 22555 existing records. [2025-09-19T20:29:26.736611] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:29:26.737132] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-19T20:29:26.737210] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-19T20:29:26.743144] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-19T20:29:26.751095] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-19T20:29:26.751553] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T20:29:27.055386] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-19T20:29:27.105973] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T20:29:27.134856] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:29:27.843308] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-19T20:29:28.643279] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-19T20:29:28.789866] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T20:29:28.879733] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T20:29:29.443384] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-19T20:29:29.994906] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T20:29:30.243359] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-19T20:29:30.401608] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T20:29:31.043360] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-19T20:29:31.508401] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T20:29:31.843280] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-19T20:29:32.643278] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-19T20:29:32.778105] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T20:29:32.888747] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T20:29:33.443322] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-19T20:29:34.150637] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T20:29:34.243247] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-19T20:29:34.482852] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T20:29:35.043327] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-19T20:29:35.759147] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T20:29:35.843283] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-19T20:29:35.904084] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T20:29:35.906216] [INFO ] [REMOTE ] ODC: Full fetch complete (10859 records). [2025-09-19T20:29:35.906289] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-19T20:29:36.275104] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-19T20:29:36.275183] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-19T20:29:36.275437] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-19T20:29:36.275475] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-19T20:29:36.276000] [DEBUG] [LOCAL ] ODC: Trimmed 10859 records to 8633 (keeping 200 days of data) [2025-09-19T20:29:36.330581] [DEBUG] [LOCAL ] ODC: Primary data saved (8633 records). [2025-09-19T20:29:36.330740] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-19T20:29:36.330852] [INFO ] [MAIN ] Update Progress: 1577/2372 symbols completed. ODC took 38.2s. Estimated remaining: 1h 45m 38s. Rate: 7.5 symbols/min [2025-09-19T20:29:36.505124] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:29:36.549544] [DEBUG] [LOCAL ] OGE: Loaded 47015 existing records from primary storage. [2025-09-19T20:29:36.549735] [INFO ] [MAIN ] OGE: Loaded 47015 existing records. [2025-09-19T20:29:36.648541] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-19T20:29:36.734966] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:29:36.735235] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-19T20:29:36.735285] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-19T20:29:36.736668] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-19T20:29:36.736736] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-19T20:29:37.092603] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:29:37.420165] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T20:29:37.426151] [INFO ] [REMOTE ] ODV: Full fetch complete (31368 records). [2025-09-19T20:29:37.426236] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-19T20:29:37.448449] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-19T20:29:37.811351] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-19T20:29:37.811449] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-19T20:29:37.812169] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-19T20:29:37.812241] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-19T20:29:37.813359] [DEBUG] [LOCAL ] ODV: Trimmed 31368 records to 25338 (keeping 200 days of data) [2025-09-19T20:29:37.882103] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T20:29:37.978972] [DEBUG] [LOCAL ] ODV: Primary data saved (25338 records). [2025-09-19T20:29:37.979118] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-19T20:29:37.979205] [INFO ] [MAIN ] Update Progress: 1578/2372 symbols completed. ODV took 26.3s. Estimated remaining: 1h 45m 27s. Rate: 7.5 symbols/min [2025-09-19T20:29:38.156528] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:29:38.216757] [DEBUG] [LOCAL ] OGN: Loaded 53519 existing records from primary storage. [2025-09-19T20:29:38.216935] [INFO ] [MAIN ] OGN: Loaded 53519 existing records. [2025-09-19T20:29:38.248595] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-19T20:29:38.400070] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:29:38.400344] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-19T20:29:38.400391] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-19T20:29:38.401876] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-19T20:29:38.401936] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-19T20:29:38.777611] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:29:39.043302] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-19T20:29:39.343083] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T20:29:39.566291] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T20:29:39.843265] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-19T20:29:40.643243] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-19T20:29:40.858378] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T20:29:41.168561] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T20:29:41.443281] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-19T20:29:42.243323] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-19T20:29:42.446147] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T20:29:43.043359] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-19T20:29:43.288051] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T20:29:43.843271] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-19T20:29:44.374370] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T20:29:44.643382] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-19T20:29:44.929601] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T20:29:45.443372] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-19T20:29:45.530611] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T20:29:46.243277] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-19T20:29:46.755367] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T20:29:46.865925] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T20:29:47.043278] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-19T20:29:47.825719] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T20:29:47.843212] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-19T20:29:48.643353] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-19T20:29:48.834155] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T20:29:49.150562] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T20:29:49.443333] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-19T20:29:50.243289] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-19T20:29:50.817962] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T20:29:51.043340] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-19T20:29:51.581580] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T20:29:51.602864] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T20:29:51.843267] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-19T20:29:52.643284] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-19T20:29:52.875548] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T20:29:53.033118] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T20:29:53.037517] [INFO ] [REMOTE ] OFG: Full fetch complete (34579 records). [2025-09-19T20:29:53.037685] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-19T20:29:53.421541] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-19T20:29:53.421633] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-19T20:29:53.422394] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-19T20:29:53.422450] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-19T20:29:53.423502] [DEBUG] [LOCAL ] OFG: Trimmed 34579 records to 22682 (keeping 200 days of data) [2025-09-19T20:29:53.475022] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-19T20:29:53.563553] [DEBUG] [LOCAL ] OFG: Primary data saved (22682 records). [2025-09-19T20:29:53.563724] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-19T20:29:53.563828] [INFO ] [MAIN ] Update Progress: 1579/2372 symbols completed. OFG took 27.2s. Estimated remaining: 1h 45m 23s. Rate: 7.5 symbols/min [2025-09-19T20:29:53.741200] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:29:53.780521] [DEBUG] [LOCAL ] OGS: Loaded 34167 existing records from primary storage. [2025-09-19T20:29:53.780711] [INFO ] [MAIN ] OGS: Loaded 34167 existing records. [2025-09-19T20:29:53.977757] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:29:53.978022] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-19T20:29:53.978076] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-19T20:29:53.979176] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-19T20:29:53.979294] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-19T20:29:54.248365] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-19T20:29:54.356509] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:29:54.410145] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T20:29:55.043272] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-19T20:29:55.169967] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T20:29:55.843273] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-19T20:29:56.242762] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T20:29:56.343751] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T20:29:56.643252] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-19T20:29:57.443258] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-19T20:29:57.945962] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T20:29:58.243266] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-19T20:29:58.704845] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T20:29:59.043267] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-19T20:29:59.065580] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T20:29:59.843265] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-19T20:30:00.100579] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T20:30:00.643267] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-19T20:30:00.832919] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T20:30:00.917328] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T20:30:00.922726] [INFO ] [REMOTE ] OEC: Full fetch complete (52644 records). [2025-09-19T20:30:00.922865] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-19T20:30:01.347491] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-19T20:30:01.347666] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-19T20:30:01.348726] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-19T20:30:01.348800] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-19T20:30:01.350264] [DEBUG] [LOCAL ] OEC: Trimmed 52644 records to 37971 (keeping 200 days of data) [2025-09-19T20:30:01.456938] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-19T20:30:01.631267] [DEBUG] [LOCAL ] OEC: Primary data saved (37971 records). [2025-09-19T20:30:01.631431] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-19T20:30:01.631512] [INFO ] [MAIN ] Update Progress: 1580/2372 symbols completed. OEC took 44.6s. Estimated remaining: 1h 45m 15s. Rate: 7.5 symbols/min [2025-09-19T20:30:01.828290] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:30:01.894215] [DEBUG] [LOCAL ] OHI: Loaded 52527 existing records from primary storage. [2025-09-19T20:30:01.894413] [INFO ] [MAIN ] OHI: Loaded 52527 existing records. [2025-09-19T20:30:02.076836] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:30:02.077079] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-19T20:30:02.077128] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-19T20:30:02.078544] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-19T20:30:02.078606] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-19T20:30:02.246785] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-19T20:30:02.449798] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:30:03.043255] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-19T20:30:03.322326] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-19T20:30:03.843537] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-19T20:30:04.862467] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (3.41 seconds). [2025-09-19T20:30:04.869477] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-19T20:30:05.407335] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (3.16 seconds). [2025-09-19T20:30:05.414331] [INFO ] [REMOTE ] OGE: Full fetch complete (66752 records). [2025-09-19T20:30:05.414478] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-19T20:30:05.804597] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-19T20:30:05.804700] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-19T20:30:05.805661] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-19T20:30:05.805731] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-19T20:30:05.807043] [DEBUG] [LOCAL ] OGE: Trimmed 66752 records to 47295 (keeping 200 days of data) [2025-09-19T20:30:06.093217] [DEBUG] [LOCAL ] OGE: Primary data saved (47295 records). [2025-09-19T20:30:06.093461] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-19T20:30:06.093556] [INFO ] [MAIN ] Update Progress: 1581/2372 symbols completed. OGE took 29.8s. Estimated remaining: 1h 45m 5s. Rate: 7.5 symbols/min [2025-09-19T20:30:06.271510] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:30:06.305799] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-19T20:30:06.333879] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-19T20:30:06.339616] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T20:30:06.348198] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-19T20:30:06.392812] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (3.35 seconds). [2025-09-19T20:30:06.419332] [DEBUG] [LOCAL ] OI: Loaded 47781 existing records from primary storage. [2025-09-19T20:30:06.419483] [INFO ] [MAIN ] OI: Loaded 47781 existing records. [2025-09-19T20:30:06.597742] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:30:06.598027] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-19T20:30:06.598078] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-19T20:30:06.599163] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-19T20:30:06.599226] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-19T20:30:06.956302] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:30:07.043358] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-19T20:30:07.843287] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-19T20:30:08.138390] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T20:30:08.541569] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T20:30:08.643265] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-19T20:30:08.934220] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T20:30:09.443329] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-19T20:30:09.965029] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T20:30:10.070943] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T20:30:10.078723] [INFO ] [REMOTE ] OGN: Full fetch complete (76810 records). [2025-09-19T20:30:10.078850] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-19T20:30:10.251612] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-19T20:30:10.476300] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-19T20:30:10.476384] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-19T20:30:10.477507] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-19T20:30:10.477573] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-19T20:30:10.479223] [DEBUG] [LOCAL ] OGN: Trimmed 76810 records to 53908 (keeping 200 days of data) [2025-09-19T20:30:10.805043] [DEBUG] [LOCAL ] OGN: Primary data saved (53908 records). [2025-09-19T20:30:10.805186] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-19T20:30:10.805274] [INFO ] [MAIN ] Update Progress: 1582/2372 symbols completed. OGN took 32.8s. Estimated remaining: 1h 44m 55s. Rate: 7.5 symbols/min [2025-09-19T20:30:10.980057] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:30:10.994591] [DEBUG] [LOCAL ] OIA: Loaded 13868 existing records from primary storage. [2025-09-19T20:30:10.994728] [INFO ] [MAIN ] OIA: Loaded 13868 existing records. [2025-09-19T20:30:11.058469] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-19T20:30:11.179610] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:30:11.180137] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-19T20:30:11.180216] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-19T20:30:11.180824] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-19T20:30:11.180894] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-19T20:30:11.513766] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T20:30:11.583361] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:30:11.843232] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-19T20:30:12.406035] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T20:30:12.643279] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-19T20:30:12.927561] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T20:30:13.085974] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T20:30:13.443272] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-19T20:30:14.243268] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-19T20:30:15.043324] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-19T20:30:15.291885] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T20:30:15.628020] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-09-19T20:30:15.843235] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-19T20:30:16.123162] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-19T20:30:16.402069] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T20:30:16.643287] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-19T20:30:17.443339] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-19T20:30:17.578564] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T20:30:17.736020] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T20:30:18.243368] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-19T20:30:19.043385] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-19T20:30:19.196365] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T20:30:19.788763] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T20:30:19.843210] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-19T20:30:20.387502] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T20:30:20.643249] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-19T20:30:21.047719] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T20:30:21.443344] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-19T20:30:22.243277] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-19T20:30:22.509696] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T20:30:22.526628] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T20:30:23.043355] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-19T20:30:23.843267] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-19T20:30:24.643333] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-19T20:30:24.898009] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T20:30:25.004785] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T20:30:25.371217] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T20:30:25.443260] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-19T20:30:26.051729] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T20:30:26.243263] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-19T20:30:26.456465] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T20:30:27.043293] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-19T20:30:27.843267] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-19T20:30:28.077253] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T20:30:28.401757] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T20:30:28.643336] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-19T20:30:29.443239] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-19T20:30:29.718390] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T20:30:29.721283] [INFO ] [REMOTE ] OIA: Full fetch complete (20924 records). [2025-09-19T20:30:29.721363] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-19T20:30:30.116957] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-19T20:30:30.117104] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-19T20:30:30.117622] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-19T20:30:30.117851] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-19T20:30:30.118821] [DEBUG] [LOCAL ] OIA: Trimmed 20924 records to 13944 (keeping 200 days of data) [2025-09-19T20:30:30.231684] [DEBUG] [LOCAL ] OIA: Primary data saved (13944 records). [2025-09-19T20:30:30.233092] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-19T20:30:30.233162] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-19T20:30:30.243785] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-19T20:30:30.245324] [INFO ] [MAIN ] Update Progress: 1583/2372 symbols completed. OIA took 19.4s. Estimated remaining: 1h 44m 53s. Rate: 7.5 symbols/min [2025-09-19T20:30:30.423875] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:30:30.468775] [DEBUG] [LOCAL ] OII: Loaded 43473 existing records from primary storage. [2025-09-19T20:30:30.468939] [INFO ] [MAIN ] OII: Loaded 43473 existing records. [2025-09-19T20:30:30.668063] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:30:30.668323] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-19T20:30:30.668373] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-19T20:30:30.669742] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-19T20:30:30.669816] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-19T20:30:31.058975] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:30:31.046965] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-19T20:30:31.072139] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T20:30:31.077893] [INFO ] [REMOTE ] OGS: Full fetch complete (47797 records). [2025-09-19T20:30:31.078014] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-19T20:30:31.473845] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-19T20:30:31.473935] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-19T20:30:31.474915] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-19T20:30:31.474980] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-19T20:30:31.476144] [DEBUG] [LOCAL ] OGS: Trimmed 47797 records to 34357 (keeping 200 days of data) [2025-09-19T20:30:31.695683] [DEBUG] [LOCAL ] OGS: Primary data saved (34357 records). [2025-09-19T20:30:31.695878] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-19T20:30:31.696088] [INFO ] [MAIN ] Update Progress: 1584/2372 symbols completed. OGS took 38.1s. Estimated remaining: 1h 44m 42s. Rate: 7.5 symbols/min [2025-09-19T20:30:31.855003] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-19T20:30:31.890147] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:30:31.934086] [DEBUG] [LOCAL ] OIS: Loaded 41276 existing records from primary storage. [2025-09-19T20:30:31.934230] [INFO ] [MAIN ] OIS: Loaded 41276 existing records. [2025-09-19T20:30:32.111721] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:30:32.111984] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-19T20:30:32.112032] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-19T20:30:32.112901] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-19T20:30:32.112961] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-19T20:30:32.523362] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:30:32.527603] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-19T20:30:32.643327] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-19T20:30:32.862339] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T20:30:33.443268] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-19T20:30:33.754914] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T20:30:34.243279] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-19T20:30:34.684320] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T20:30:35.043355] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-19T20:30:35.172355] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T20:30:35.609682] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T20:30:35.619863] [INFO ] [REMOTE ] OHI: Full fetch complete (75093 records). [2025-09-19T20:30:35.620126] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-19T20:30:35.863761] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-19T20:30:36.296411] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-19T20:30:36.296553] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-19T20:30:36.298969] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-19T20:30:36.299106] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-19T20:30:36.303142] [DEBUG] [LOCAL ] OHI: Trimmed 75093 records to 52885 (keeping 200 days of data) [2025-09-19T20:30:36.643950] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-19T20:30:36.771668] [DEBUG] [LOCAL ] OHI: Primary data saved (52885 records). [2025-09-19T20:30:36.771848] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-19T20:30:36.773293] [INFO ] [MAIN ] Update Progress: 1585/2372 symbols completed. OHI took 35.1s. Estimated remaining: 1h 44m 32s. Rate: 7.5 symbols/min [2025-09-19T20:30:36.977320] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:30:37.016447] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T20:30:37.056984] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T20:30:37.106401] [DEBUG] [LOCAL ] OKE: Loaded 53926 existing records from primary storage. [2025-09-19T20:30:37.106553] [INFO ] [MAIN ] OKE: Loaded 53926 existing records. [2025-09-19T20:30:37.283383] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:30:37.283719] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-19T20:30:37.283778] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-19T20:30:37.284974] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-19T20:30:37.285063] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-19T20:30:37.455912] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-19T20:30:37.700331] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:30:38.243277] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-19T20:30:38.575705] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T20:30:39.043272] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-19T20:30:39.483416] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T20:30:39.843280] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-19T20:30:40.289050] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T20:30:40.371677] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T20:30:40.379344] [INFO ] [REMOTE ] OI: Full fetch complete (68276 records). [2025-09-19T20:30:40.379510] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-19T20:30:40.648980] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-19T20:30:40.782384] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-19T20:30:40.782493] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-19T20:30:40.783525] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-19T20:30:40.783594] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-19T20:30:40.786468] [DEBUG] [LOCAL ] OI: Trimmed 68276 records to 48123 (keeping 200 days of data) [2025-09-19T20:30:41.094356] [DEBUG] [LOCAL ] OI: Primary data saved (48123 records). [2025-09-19T20:30:41.094567] [INFO ] [MAIN ] OI: Full history saved. [2025-09-19T20:30:41.094777] [INFO ] [MAIN ] Update Progress: 1586/2372 symbols completed. OI took 35.0s. Estimated remaining: 1h 44m 23s. Rate: 7.5 symbols/min [2025-09-19T20:30:41.285385] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:30:41.285871] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-09-19T20:30:41.285976] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-09-19T20:30:41.286176] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-19T20:30:41.286322] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-19T20:30:41.286449] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-19T20:30:41.286516] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-19T20:30:41.454120] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-19T20:30:41.618055] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T20:30:41.709721] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:30:42.243284] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-19T20:30:42.814790] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T20:30:43.043357] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-19T20:30:43.306976] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T20:30:43.843287] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-19T20:30:44.643294] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-19T20:30:44.926421] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-19T20:30:44.988597] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T20:30:45.097190] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T20:30:45.443291] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-19T20:30:46.243299] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-19T20:30:46.334421] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T20:30:47.043336] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-19T20:30:47.416745] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T20:30:47.843335] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-19T20:30:48.643299] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-19T20:30:49.081767] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.84 seconds). [2025-09-19T20:30:49.188672] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T20:30:49.443235] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-19T20:30:49.511673] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T20:30:50.243273] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-19T20:30:50.380253] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T20:30:51.043280] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-19T20:30:51.843266] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-19T20:30:52.240236] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-19T20:30:52.284813] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T20:30:52.643286] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-19T20:30:52.859156] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T20:30:53.443283] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-19T20:30:54.143492] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T20:30:54.243249] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-19T20:30:55.043251] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-19T20:30:55.344475] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T20:30:55.734376] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (3.09 seconds). [2025-09-19T20:30:55.843247] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-19T20:30:56.125361] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T20:30:56.643273] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-19T20:30:57.094523] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T20:30:57.443289] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-19T20:30:58.243338] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-19T20:30:58.392225] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T20:30:58.973252] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (3.13 seconds). [2025-09-19T20:30:59.043241] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-19T20:30:59.562722] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T20:30:59.843263] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-19T20:31:00.298230] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T20:31:00.643364] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-19T20:31:01.443250] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-19T20:31:02.146380] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (3.10 seconds). [2025-09-19T20:31:02.195135] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-19T20:31:02.221035] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T20:31:02.226196] [INFO ] [REMOTE ] OIS: Full fetch complete (56915 records). [2025-09-19T20:31:02.226329] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-19T20:31:02.249440] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-19T20:31:02.632878] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-19T20:31:02.633089] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-19T20:31:02.634146] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-19T20:31:02.634213] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-19T20:31:02.635553] [DEBUG] [LOCAL ] OIS: Trimmed 56915 records to 41515 (keeping 200 days of data) [2025-09-19T20:31:02.869530] [DEBUG] [LOCAL ] OIS: Primary data saved (41515 records). [2025-09-19T20:31:02.869687] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-19T20:31:02.869808] [INFO ] [MAIN ] Update Progress: 1587/2372 symbols completed. OIS took 31.2s. Estimated remaining: 1h 44m 22s. Rate: 7.5 symbols/min [2025-09-19T20:31:03.048926] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-19T20:31:03.051420] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:03.109141] [DEBUG] [LOCAL ] OLN: Loaded 52099 existing records from primary storage. [2025-09-19T20:31:03.109309] [INFO ] [MAIN ] OLN: Loaded 52099 existing records. [2025-09-19T20:31:03.297154] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:03.297578] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-19T20:31:03.297741] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-19T20:31:03.305930] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-19T20:31:03.315620] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-19T20:31:03.383222] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T20:31:03.439378] [INFO ] [REMOTE ] OII: Full fetch complete (62245 records). [2025-09-19T20:31:03.455022] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-19T20:31:03.911234] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:03.970709] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-19T20:31:04.132528] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-19T20:31:04.132623] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-19T20:31:04.133720] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-19T20:31:04.133786] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-19T20:31:04.135147] [DEBUG] [LOCAL ] OII: Trimmed 62245 records to 43796 (keeping 200 days of data) [2025-09-19T20:31:04.421259] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T20:31:04.462214] [DEBUG] [LOCAL ] OII: Primary data saved (43796 records). [2025-09-19T20:31:04.462360] [INFO ] [MAIN ] OII: Full history saved. [2025-09-19T20:31:04.462482] [INFO ] [MAIN ] Update Progress: 1588/2372 symbols completed. OII took 34.2s. Estimated remaining: 1h 44m 10s. Rate: 7.5 symbols/min [2025-09-19T20:31:04.639571] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:04.645576] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-19T20:31:04.651863] [DEBUG] [LOCAL ] OLP: Loaded 9715 existing records from primary storage. [2025-09-19T20:31:04.651994] [INFO ] [MAIN ] OLP: Loaded 9715 existing records. [2025-09-19T20:31:04.844243] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:04.844564] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-19T20:31:04.844615] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-19T20:31:04.845307] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-19T20:31:04.845370] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-19T20:31:05.209922] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:05.443262] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-19T20:31:06.193338] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (3.14 seconds). [2025-09-19T20:31:06.243243] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-19T20:31:06.319247] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T20:31:06.339101] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T20:31:06.870707] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T20:31:06.887024] [INFO ] [REMOTE ] OKE: Full fetch complete (77480 records). [2025-09-19T20:31:06.887249] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-19T20:31:07.051600] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-19T20:31:07.293119] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-19T20:31:07.293202] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-19T20:31:07.294285] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-19T20:31:07.294350] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-19T20:31:07.295926] [DEBUG] [LOCAL ] OKE: Trimmed 77480 records to 54316 (keeping 200 days of data) [2025-09-19T20:31:07.631050] [DEBUG] [LOCAL ] OKE: Primary data saved (54316 records). [2025-09-19T20:31:07.631189] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-19T20:31:07.631729] [INFO ] [MAIN ] Update Progress: 1589/2372 symbols completed. OKE took 30.9s. Estimated remaining: 1h 44m 0s. Rate: 7.5 symbols/min [2025-09-19T20:31:07.806406] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:07.843278] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-19T20:31:07.863250] [DEBUG] [LOCAL ] OMC: Loaded 53682 existing records from primary storage. [2025-09-19T20:31:07.863432] [INFO ] [MAIN ] OMC: Loaded 53682 existing records. [2025-09-19T20:31:08.043008] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:08.043362] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-19T20:31:08.043432] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-19T20:31:08.044770] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-19T20:31:08.044833] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-19T20:31:08.398532] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:08.643240] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-19T20:31:08.929474] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T20:31:09.123834] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T20:31:09.443272] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-19T20:31:09.516306] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (3.27 seconds). [2025-09-19T20:31:09.963033] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-19T20:31:10.243282] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-19T20:31:10.726001] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T20:31:11.043277] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-19T20:31:11.303879] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T20:31:11.843288] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-19T20:31:12.643335] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-19T20:31:13.133246] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T20:31:13.443354] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-19T20:31:14.243292] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-19T20:31:14.477033] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T20:31:14.778496] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-09-19T20:31:14.943870] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T20:31:15.043243] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-19T20:31:15.352279] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T20:31:15.843284] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-19T20:31:16.643299] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-19T20:31:16.674209] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T20:31:16.681706] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-09-19T20:31:16.681837] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-19T20:31:16.682763] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:31:16.682914] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:31:16.682968] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:31:16.683028] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-19T20:31:16.683127] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-19T20:31:16.683183] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-19T20:31:16.683240] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-09-19T20:31:16.683350] [INFO ] [MAIN ] Update Progress: 1590/2372 symbols completed. OKLO took 35.6s. Estimated remaining: 1h 43m 53s. Rate: 7.5 symbols/min [2025-09-19T20:31:16.849673] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:16.894280] [DEBUG] [LOCAL ] OMF: Loaded 46657 existing records from primary storage. [2025-09-19T20:31:16.894446] [INFO ] [MAIN ] OMF: Loaded 46657 existing records. [2025-09-19T20:31:17.092232] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:17.092864] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-19T20:31:17.092995] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-19T20:31:17.094409] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-19T20:31:17.094473] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-19T20:31:17.416278] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-19T20:31:17.448400] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-19T20:31:17.530635] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:18.243283] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-19T20:31:18.401083] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T20:31:18.507937] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T20:31:19.043271] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-19T20:31:19.843278] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-19T20:31:20.032094] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T20:31:20.248502] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T20:31:20.643279] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-19T20:31:21.443300] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-19T20:31:21.999445] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T20:31:22.243277] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-19T20:31:22.839875] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T20:31:23.043275] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-19T20:31:23.205574] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T20:31:23.843362] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-19T20:31:24.071632] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T20:31:24.423832] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T20:31:24.643240] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-19T20:31:25.443295] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-19T20:31:26.130369] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-19T20:31:26.243215] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-19T20:31:26.539105] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T20:31:26.885104] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T20:31:27.043266] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-19T20:31:27.843286] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-19T20:31:28.494279] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T20:31:28.643502] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-19T20:31:28.921092] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T20:31:29.269044] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T20:31:29.443399] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-19T20:31:30.243394] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-19T20:31:30.395333] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T20:31:30.397357] [INFO ] [REMOTE ] OLP: Full fetch complete (13870 records). [2025-09-19T20:31:30.397428] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-19T20:31:30.761757] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-19T20:31:30.761941] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-19T20:31:30.762358] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-19T20:31:30.762446] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-19T20:31:30.763178] [DEBUG] [LOCAL ] OLP: Trimmed 13870 records to 9774 (keeping 200 days of data) [2025-09-19T20:31:30.851931] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-19T20:31:30.865635] [DEBUG] [LOCAL ] OLP: Primary data saved (9774 records). [2025-09-19T20:31:30.865758] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-19T20:31:30.865836] [INFO ] [MAIN ] Update Progress: 1591/2372 symbols completed. OLP took 26.4s. Estimated remaining: 1h 43m 48s. Rate: 7.5 symbols/min [2025-09-19T20:31:31.037217] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:31.043301] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-19T20:31:31.084793] [DEBUG] [LOCAL ] OMI: Loaded 46242 existing records from primary storage. [2025-09-19T20:31:31.084970] [INFO ] [MAIN ] OMI: Loaded 46242 existing records. [2025-09-19T20:31:31.263346] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:31.263609] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-19T20:31:31.263682] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-19T20:31:31.264514] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-19T20:31:31.264577] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-19T20:31:31.620152] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:31.843257] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-19T20:31:32.410376] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T20:31:32.534906] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T20:31:32.643266] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-19T20:31:33.443279] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-19T20:31:33.565023] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T20:31:34.243294] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-19T20:31:34.653581] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T20:31:34.661416] [INFO ] [REMOTE ] OMC: Full fetch complete (76757 records). [2025-09-19T20:31:34.661547] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-19T20:31:35.055984] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-19T20:31:35.059837] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-19T20:31:35.060998] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-19T20:31:35.062082] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-19T20:31:35.062238] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-19T20:31:35.063852] [DEBUG] [LOCAL ] OMC: Trimmed 76757 records to 54071 (keeping 200 days of data) [2025-09-19T20:31:35.419832] [DEBUG] [LOCAL ] OMC: Primary data saved (54071 records). [2025-09-19T20:31:35.429773] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-19T20:31:35.430489] [INFO ] [MAIN ] Update Progress: 1592/2372 symbols completed. OMC took 27.8s. Estimated remaining: 1h 43m 38s. Rate: 7.5 symbols/min [2025-09-19T20:31:35.463985] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T20:31:35.619732] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:35.630890] [DEBUG] [LOCAL ] ONIT: Loaded 7870 existing records from primary storage. [2025-09-19T20:31:35.631019] [INFO ] [MAIN ] ONIT: Loaded 7870 existing records. [2025-09-19T20:31:35.812783] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:35.813243] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-19T20:31:35.813435] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-19T20:31:35.813935] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-19T20:31:35.813999] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-19T20:31:35.845595] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-19T20:31:35.966331] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T20:31:36.023785] [INFO ] [REMOTE ] OLN: Full fetch complete (74402 records). [2025-09-19T20:31:36.026104] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-19T20:31:36.509332] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:36.655417] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-19T20:31:36.655537] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-19T20:31:36.657232] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-19T20:31:36.657311] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-19T20:31:36.651797] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-19T20:31:36.660304] [DEBUG] [LOCAL ] OLN: Trimmed 74402 records to 52484 (keeping 200 days of data) [2025-09-19T20:31:36.812061] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T20:31:37.027204] [DEBUG] [LOCAL ] OLN: Primary data saved (52484 records). [2025-09-19T20:31:37.027386] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-19T20:31:37.027484] [INFO ] [MAIN ] Update Progress: 1593/2372 symbols completed. OLN took 34.2s. Estimated remaining: 1h 43m 27s. Rate: 7.5 symbols/min [2025-09-19T20:31:37.210415] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:37.247052] [DEBUG] [LOCAL ] ONL: Loaded 32442 existing records from primary storage. [2025-09-19T20:31:37.247288] [INFO ] [MAIN ] ONL: Loaded 32442 existing records. [2025-09-19T20:31:37.426962] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:37.427306] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-19T20:31:37.427377] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-19T20:31:37.428062] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-19T20:31:37.428124] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-19T20:31:37.459181] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-19T20:31:37.783138] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T20:31:37.826882] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:37.861566] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T20:31:38.243294] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-19T20:31:39.043271] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-19T20:31:39.477850] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T20:31:39.843293] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-19T20:31:39.906825] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T20:31:40.638699] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T20:31:40.648260] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-19T20:31:41.443274] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-19T20:31:41.636436] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T20:31:41.773056] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T20:31:42.243290] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-19T20:31:43.043378] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-19T20:31:43.218700] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T20:31:43.744101] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T20:31:43.843277] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-19T20:31:44.643279] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-19T20:31:44.722463] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T20:31:44.812379] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T20:31:45.443264] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-19T20:31:46.243248] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-19T20:31:46.453189] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T20:31:46.956415] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T20:31:47.043225] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-19T20:31:47.647230] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T20:31:47.843296] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-19T20:31:48.643348] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-19T20:31:48.963954] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T20:31:49.443299] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-19T20:31:49.702725] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T20:31:49.960426] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T20:31:50.243264] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-19T20:31:51.043333] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-19T20:31:51.281067] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T20:31:51.287601] [INFO ] [REMOTE ] OMF: Full fetch complete (66590 records). [2025-09-19T20:31:51.287752] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-19T20:31:51.691832] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-19T20:31:51.692037] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-19T20:31:51.693210] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-19T20:31:51.693363] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-19T20:31:51.714398] [DEBUG] [LOCAL ] OMF: Trimmed 66590 records to 46967 (keeping 200 days of data) [2025-09-19T20:31:51.719290] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T20:31:51.843361] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-19T20:31:52.017712] [DEBUG] [LOCAL ] OMF: Primary data saved (46967 records). [2025-09-19T20:31:52.017852] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-19T20:31:52.017937] [INFO ] [MAIN ] Update Progress: 1594/2372 symbols completed. OMF took 35.3s. Estimated remaining: 1h 43m 22s. Rate: 7.5 symbols/min [2025-09-19T20:31:52.139003] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T20:31:52.206151] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:52.263200] [DEBUG] [LOCAL ] ONON: Loaded 54003 existing records from primary storage. [2025-09-19T20:31:52.263456] [INFO ] [MAIN ] ONON: Loaded 54003 existing records. [2025-09-19T20:31:52.451698] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:52.452014] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-19T20:31:52.452070] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-19T20:31:52.453170] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-19T20:31:52.453231] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-19T20:31:52.651817] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-19T20:31:52.830610] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:53.443340] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-19T20:31:53.700021] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T20:31:54.015062] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T20:31:54.243272] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-19T20:31:54.727123] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T20:31:55.043274] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-19T20:31:55.843284] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-19T20:31:56.218612] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T20:31:56.643290] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-19T20:31:56.876401] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T20:31:56.881427] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T20:31:57.443346] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-19T20:31:58.056582] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T20:31:58.064237] [INFO ] [REMOTE ] OMI: Full fetch complete (63548 records). [2025-09-19T20:31:58.064361] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-19T20:31:58.262735] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-19T20:31:58.470432] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-19T20:31:58.470607] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-19T20:31:58.471595] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-19T20:31:58.471701] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-19T20:31:58.480438] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T20:31:58.483751] [DEBUG] [LOCAL ] OMI: Trimmed 63548 records to 46620 (keeping 200 days of data) [2025-09-19T20:31:58.765084] [DEBUG] [LOCAL ] OMI: Primary data saved (46620 records). [2025-09-19T20:31:58.765265] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-19T20:31:58.765390] [INFO ] [MAIN ] Update Progress: 1595/2372 symbols completed. OMI took 27.9s. Estimated remaining: 1h 43m 14s. Rate: 7.5 symbols/min [2025-09-19T20:31:58.941511] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:31:58.964095] [DEBUG] [LOCAL ] ONTF: Loaded 23257 existing records from primary storage. [2025-09-19T20:31:58.964229] [INFO ] [MAIN ] ONTF: Loaded 23257 existing records. [2025-09-19T20:31:59.048341] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-19T20:31:59.148073] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:31:59.148334] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-19T20:31:59.148383] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-19T20:31:59.148927] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-19T20:31:59.148986] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-19T20:31:59.516054] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:31:59.843279] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-19T20:32:00.653047] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-19T20:32:00.659800] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-19T20:32:00.697493] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T20:32:01.128626] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T20:32:01.443240] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-19T20:32:01.635274] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T20:32:01.637245] [INFO ] [REMOTE ] ONIT: Full fetch complete (11233 records). [2025-09-19T20:32:01.637361] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-19T20:32:02.022675] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-19T20:32:02.022766] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-19T20:32:02.023032] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-19T20:32:02.023070] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-19T20:32:02.023551] [DEBUG] [LOCAL ] ONIT: Trimmed 11233 records to 7906 (keeping 200 days of data) [2025-09-19T20:32:02.072296] [DEBUG] [LOCAL ] ONIT: Primary data saved (7906 records). [2025-09-19T20:32:02.072454] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-19T20:32:02.072595] [INFO ] [MAIN ] Update Progress: 1596/2372 symbols completed. ONIT took 26.6s. Estimated remaining: 1h 43m 4s. Rate: 7.5 symbols/min [2025-09-19T20:32:02.246929] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-19T20:32:02.269523] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:32:02.321933] [DEBUG] [LOCAL ] ONTO: Loaded 46859 existing records from primary storage. [2025-09-19T20:32:02.322089] [INFO ] [MAIN ] ONTO: Loaded 46859 existing records. [2025-09-19T20:32:02.542280] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T20:32:02.553033] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:32:02.553674] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-19T20:32:02.553749] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-19T20:32:02.554837] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-19T20:32:02.554900] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-19T20:32:02.976245] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:32:03.043267] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-19T20:32:03.843279] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-19T20:32:04.292711] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T20:32:04.640238] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-19T20:32:04.650320] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-19T20:32:05.443266] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-19T20:32:05.687292] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T20:32:05.831450] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T20:32:06.243282] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-19T20:32:07.043407] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-19T20:32:07.120439] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T20:32:07.843284] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-19T20:32:08.496535] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-19T20:32:08.643235] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-19T20:32:09.025905] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T20:32:09.047799] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T20:32:09.443351] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-19T20:32:10.243301] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-19T20:32:10.854717] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T20:32:11.043362] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-19T20:32:11.348794] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T20:32:11.751365] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T20:32:11.843253] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-19T20:32:12.643301] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-19T20:32:13.443284] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-19T20:32:13.485738] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T20:32:13.512491] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T20:32:13.980702] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T20:32:14.246721] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-19T20:32:15.023239] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T20:32:15.043243] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-19T20:32:15.843277] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-19T20:32:16.296335] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T20:32:16.450272] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T20:32:16.643240] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-19T20:32:16.744111] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T20:32:17.443275] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-19T20:32:18.243277] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-19T20:32:18.832638] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T20:32:18.871042] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T20:32:19.043276] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-19T20:32:19.574090] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T20:32:19.578442] [INFO ] [REMOTE ] ONL: Full fetch complete (43847 records). [2025-09-19T20:32:19.578560] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-19T20:32:19.853175] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-19T20:32:20.028152] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-19T20:32:20.028832] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-19T20:32:20.029275] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T20:32:20.030216] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-19T20:32:20.030362] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-19T20:32:20.034990] [INFO ] [REMOTE ] ONTF: Full fetch complete (31912 records). [2025-09-19T20:32:20.035318] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-19T20:32:20.035789] [DEBUG] [LOCAL ] ONL: Trimmed 43847 records to 32574 (keeping 200 days of data) [2025-09-19T20:32:20.548322] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-19T20:32:20.548992] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-19T20:32:20.550028] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-19T20:32:20.550111] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-19T20:32:20.553504] [DEBUG] [LOCAL ] ONTF: Trimmed 31912 records to 23403 (keeping 200 days of data) [2025-09-19T20:32:20.643684] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-19T20:32:20.753471] [DEBUG] [LOCAL ] ONTF: Primary data saved (23403 records). [2025-09-19T20:32:20.754482] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-19T20:32:20.754614] [INFO ] [MAIN ] Update Progress: 1597/2372 symbols completed. ONTF took 22.0s. Estimated remaining: 1h 43m 1s. Rate: 7.5 symbols/min [2025-09-19T20:32:20.770928] [DEBUG] [LOCAL ] ONL: Primary data saved (32574 records). [2025-09-19T20:32:20.771004] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-19T20:32:20.771087] [INFO ] [MAIN ] Update Progress: 1598/2372 symbols completed. ONL took 43.7s. Estimated remaining: 1h 42m 49s. Rate: 7.5 symbols/min [2025-09-19T20:32:22.285112] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-19T20:32:22.303298] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-19T20:32:22.690169] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T20:32:22.701144] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-19T20:32:24.528353] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T20:32:24.539580] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-19T20:32:24.679702] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-19T20:32:24.692284] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-19T20:32:26.562495] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T20:32:26.574371] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-19T20:32:27.129514] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-19T20:32:27.141818] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-19T20:32:28.573719] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T20:32:28.584632] [INFO ] [REMOTE ] ONTO: Full fetch complete (65414 records). [2025-09-19T20:32:28.584850] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-19T20:32:29.000483] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-19T20:32:29.000810] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-19T20:32:29.002053] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-19T20:32:29.002131] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-19T20:32:29.003780] [DEBUG] [LOCAL ] ONTO: Trimmed 65414 records to 47235 (keeping 200 days of data) [2025-09-19T20:32:29.308082] [DEBUG] [LOCAL ] ONTO: Primary data saved (47235 records). [2025-09-19T20:32:29.308236] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-19T20:32:29.309368] [INFO ] [MAIN ] Update Progress: 1599/2372 symbols completed. ONTO took 27.2s. Estimated remaining: 1h 42m 41s. Rate: 7.5 symbols/min [2025-09-19T20:32:29.479623] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T20:32:29.494580] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-19T20:32:31.713875] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T20:32:31.722334] [INFO ] [REMOTE ] ONON: Full fetch complete (77559 records). [2025-09-19T20:32:31.722497] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-19T20:32:32.155508] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-19T20:32:32.155684] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-19T20:32:32.157927] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-19T20:32:32.158124] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-19T20:32:32.160096] [DEBUG] [LOCAL ] ONON: Trimmed 77559 records to 54393 (keeping 200 days of data) [2025-09-19T20:32:32.521491] [DEBUG] [LOCAL ] ONON: Primary data saved (54393 records). [2025-09-19T20:32:32.521696] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-19T20:32:32.521860] [INFO ] [MAIN ] Update Progress: 1600/2372 symbols completed. ONON took 40.5s. Estimated remaining: 1h 42m 31s. Rate: 7.5 symbols/min [2025-09-19T20:32:33.166613] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:32:33.211551] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:32:33.271685] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:32:33.291273] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:32:33.303512] [DEBUG] [LOCAL ] OPP: Loaded 11864 existing records from primary storage. [2025-09-19T20:32:33.303682] [INFO ] [MAIN ] OPP: Loaded 11864 existing records. [2025-09-19T20:32:33.420619] [DEBUG] [LOCAL ] OOMA: Loaded 19339 existing records from primary storage. [2025-09-19T20:32:33.441075] [INFO ] [MAIN ] OOMA: Loaded 19339 existing records. [2025-09-19T20:32:33.457949] [DEBUG] [LOCAL ] OPAD: Loaded 19002 existing records from primary storage. [2025-09-19T20:32:33.600218] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:32:33.605887] [INFO ] [MAIN ] OPAD: Loaded 19002 existing records. [2025-09-19T20:32:33.668503] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-19T20:32:33.713496] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-19T20:32:33.697907] [DEBUG] [LOCAL ] OPFI: Loaded 47184 existing records from primary storage. [2025-09-19T20:32:33.737077] [INFO ] [MAIN ] OPFI: Loaded 47184 existing records. [2025-09-19T20:32:33.778260] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-19T20:32:33.804926] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-19T20:32:33.967809] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:32:34.065434] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-19T20:32:34.093210] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-19T20:32:34.299593] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-19T20:32:34.311204] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:32:34.428863] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-19T20:32:34.429002] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:32:34.449086] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-19T20:32:34.505541] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-19T20:32:34.577986] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-19T20:32:34.583385] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-19T20:32:34.578132] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-19T20:32:34.618282] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-19T20:32:34.718897] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-19T20:32:34.739737] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-19T20:32:35.043307] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:32:35.091935] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-19T20:32:35.520944] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:32:35.552457] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-19T20:32:35.662855] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:32:35.668790] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-19T20:32:35.743566] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:32:35.743878] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-19T20:32:36.615918] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T20:32:36.620170] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-19T20:32:36.694425] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T20:32:36.696874] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-19T20:32:37.082925] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T20:32:37.089103] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-19T20:32:37.192227] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T20:32:37.201750] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-19T20:32:37.511398] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-19T20:32:37.513797] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-19T20:32:37.694620] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T20:32:37.697836] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-19T20:32:38.322112] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T20:32:38.324485] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-19T20:32:38.541283] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-19T20:32:38.544667] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-19T20:32:38.803712] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T20:32:38.808036] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-19T20:32:39.472233] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-19T20:32:39.483018] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-19T20:32:39.527612] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T20:32:39.529717] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-19T20:32:39.540598] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T20:32:39.544495] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-19T20:32:39.919797] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T20:32:39.922834] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-19T20:32:40.492923] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T20:32:40.643266] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-19T20:32:40.720040] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T20:32:40.734962] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T20:32:41.442542] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T20:32:41.444124] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-19T20:32:41.611586] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T20:32:42.243295] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-19T20:32:42.737095] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T20:32:42.833226] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-19T20:32:43.043279] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-19T20:32:43.843278] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-19T20:32:44.643274] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-19T20:32:45.159887] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T20:32:45.375335] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T20:32:45.443298] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-19T20:32:45.587367] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T20:32:46.243263] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-19T20:32:47.043269] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-19T20:32:47.095902] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T20:32:47.557106] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:32:47.843270] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-19T20:32:48.100337] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T20:32:48.643261] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-19T20:32:49.394250] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T20:32:49.443254] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-19T20:32:49.701296] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T20:32:50.243268] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-19T20:32:50.810989] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T20:32:51.043268] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-19T20:32:51.843236] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-19T20:32:52.389798] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T20:32:52.398425] [INFO ] [REMOTE ] OOMA: Full fetch complete (26453 records). [2025-09-19T20:32:52.398711] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-19T20:32:52.647026] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-19T20:32:52.815964] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-19T20:32:52.816167] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-19T20:32:52.816920] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-19T20:32:52.817328] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-19T20:32:52.819065] [DEBUG] [LOCAL ] OOMA: Trimmed 26453 records to 19448 (keeping 200 days of data) [2025-09-19T20:32:52.842185] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-19T20:32:52.960161] [DEBUG] [LOCAL ] OOMA: Primary data saved (19448 records). [2025-09-19T20:32:52.960308] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-19T20:32:52.960465] [INFO ] [MAIN ] Update Progress: 1601/2372 symbols completed. OOMA took 20.4s. Estimated remaining: 1h 42m 29s. Rate: 7.5 symbols/min [2025-09-19T20:32:53.128888] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:32:53.129069] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-19T20:32:53.129128] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-19T20:32:53.129287] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-19T20:32:53.129332] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-19T20:32:53.129376] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-19T20:32:53.129430] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-19T20:32:53.268495] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T20:32:53.448464] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-19T20:32:53.512505] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:32:54.243293] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-19T20:32:54.498390] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-19T20:32:54.701828] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T20:32:55.043360] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-19T20:32:55.133525] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T20:32:55.843278] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-19T20:32:56.644437] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-19T20:32:56.644793] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T20:32:56.957686] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T20:32:57.443352] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-19T20:32:58.245421] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-19T20:32:58.248354] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T20:32:59.043369] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-19T20:32:59.168861] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-19T20:32:59.176501] [INFO ] [REMOTE ] OPAD: Full fetch complete (22185 records). [2025-09-19T20:32:59.176617] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-19T20:32:59.558678] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-19T20:32:59.558769] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-19T20:32:59.559264] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-19T20:32:59.559340] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-19T20:32:59.560899] [DEBUG] [LOCAL ] OPAD: Trimmed 22185 records to 19367 (keeping 200 days of data) [2025-09-19T20:32:59.681667] [DEBUG] [LOCAL ] OPAD: Primary data saved (19367 records). [2025-09-19T20:32:59.681825] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-19T20:32:59.682028] [INFO ] [MAIN ] Update Progress: 1602/2372 symbols completed. OPAD took 27.2s. Estimated remaining: 1h 42m 20s. Rate: 7.5 symbols/min [2025-09-19T20:32:59.858406] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-19T20:32:59.862231] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:32:59.916949] [DEBUG] [LOCAL ] OR: Loaded 46253 existing records from primary storage. [2025-09-19T20:32:59.917115] [INFO ] [MAIN ] OR: Loaded 46253 existing records. [2025-09-19T20:33:00.099589] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T20:33:00.115585] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:33:00.117065] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-19T20:33:00.117178] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-19T20:33:00.119392] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-19T20:33:00.119472] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-19T20:33:00.500240] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:33:00.630581] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-19T20:33:00.643215] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-19T20:33:00.863416] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T20:33:00.866959] [INFO ] [REMOTE ] OPP: Full fetch complete (17943 records). [2025-09-19T20:33:00.867040] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-19T20:33:01.227660] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-19T20:33:01.227749] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-19T20:33:01.228131] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-19T20:33:01.228170] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-19T20:33:01.229433] [DEBUG] [LOCAL ] OPP: Trimmed 17943 records to 11926 (keeping 200 days of data) [2025-09-19T20:33:01.311238] [DEBUG] [LOCAL ] OPP: Primary data saved (11926 records). [2025-09-19T20:33:01.311369] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-19T20:33:01.311474] [INFO ] [MAIN ] Update Progress: 1603/2372 symbols completed. OPP took 28.8s. Estimated remaining: 1h 42m 9s. Rate: 7.5 symbols/min [2025-09-19T20:33:01.450638] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-19T20:33:01.484483] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:33:01.484831] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-09-19T20:33:01.484911] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-09-19T20:33:01.485064] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-19T20:33:01.485109] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-19T20:33:01.485151] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-09-19T20:33:01.485183] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-19T20:33:01.842481] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:33:02.243302] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-19T20:33:03.043380] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-19T20:33:03.288587] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-19T20:33:03.843302] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-19T20:33:04.700106] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (3.25 seconds). [2025-09-19T20:33:04.708909] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-19T20:33:04.716330] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T20:33:05.279987] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T20:33:05.289128] [INFO ] [REMOTE ] OPFI: Full fetch complete (67348 records). [2025-09-19T20:33:05.289325] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-19T20:33:05.449016] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-19T20:33:05.726927] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-19T20:33:05.727056] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-19T20:33:05.728985] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-19T20:33:05.729063] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-19T20:33:05.730975] [DEBUG] [LOCAL ] OPFI: Trimmed 67348 records to 47512 (keeping 200 days of data) [2025-09-19T20:33:06.100399] [DEBUG] [LOCAL ] OPFI: Primary data saved (47512 records). [2025-09-19T20:33:06.103968] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-19T20:33:06.104587] [INFO ] [MAIN ] Update Progress: 1604/2372 symbols completed. OPFI took 33.6s. Estimated remaining: 1h 41m 60s. Rate: 7.5 symbols/min [2025-09-19T20:33:06.103818] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (3.06 seconds). [2025-09-19T20:33:06.248439] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-19T20:33:06.301575] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:33:06.369826] [DEBUG] [LOCAL ] ORC: Loaded 52643 existing records from primary storage. [2025-09-19T20:33:06.370051] [INFO ] [MAIN ] ORC: Loaded 52643 existing records. [2025-09-19T20:33:06.561926] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:33:06.563104] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-19T20:33:06.563526] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-19T20:33:06.571810] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T20:33:06.574219] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-19T20:33:06.574956] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-19T20:33:06.715336] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T20:33:07.045945] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-19T20:33:07.045803] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:33:07.843281] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-19T20:33:08.052672] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T20:33:08.189705] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T20:33:08.643265] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-19T20:33:09.443287] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-19T20:33:10.001960] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T20:33:10.243380] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-19T20:33:10.369787] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T20:33:10.442582] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T20:33:11.043385] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-19T20:33:11.843317] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-19T20:33:12.204184] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T20:33:12.643288] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-19T20:33:13.053190] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T20:33:13.066371] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T20:33:13.443279] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-19T20:33:14.243298] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-19T20:33:14.970886] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T20:33:14.973606] [INFO ] [REMOTE ] OPY: Full fetch complete (10195 records). [2025-09-19T20:33:14.973716] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-19T20:33:15.049025] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-19T20:33:15.158702] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T20:33:15.158969] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:33:15.159017] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:33:15.159056] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-19T20:33:15.159110] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-19T20:33:15.159167] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-19T20:33:15.159236] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-19T20:33:15.159297] [INFO ] [MAIN ] Update Progress: 1605/2372 symbols completed. OPY took 22.2s. Estimated remaining: 1h 41m 53s. Rate: 7.5 symbols/min [2025-09-19T20:33:15.340162] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:33:15.341085] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-19T20:33:15.341140] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-19T20:33:15.341358] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-19T20:33:15.341409] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-19T20:33:15.341451] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-19T20:33:15.341482] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-19T20:33:15.695730] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:33:15.843224] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-19T20:33:16.046107] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (3.40 seconds). [2025-09-19T20:33:16.296632] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T20:33:16.643266] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-19T20:33:16.907257] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T20:33:17.443362] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-19T20:33:18.243280] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-19T20:33:18.493776] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-19T20:33:18.525870] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T20:33:18.688734] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T20:33:19.043265] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-19T20:33:19.843284] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-19T20:33:20.209624] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T20:33:20.643252] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-19T20:33:21.011774] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T20:33:21.443351] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-19T20:33:21.776361] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-19T20:33:22.251296] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-19T20:33:22.256306] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T20:33:23.043268] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-19T20:33:23.195389] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T20:33:23.843268] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-19T20:33:24.643271] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-19T20:33:25.041895] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-19T20:33:25.352330] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-19T20:33:25.443226] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-19T20:33:26.108919] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-19T20:33:26.243265] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-19T20:33:26.365863] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-19T20:33:26.954105] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T20:33:27.043395] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-19T20:33:27.843276] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-19T20:33:28.212613] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T20:33:28.643255] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-19T20:33:29.350257] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T20:33:29.356043] [INFO ] [REMOTE ] ORA: Full fetch complete (49356 records). [2025-09-19T20:33:29.356168] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-19T20:33:29.448362] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-19T20:33:29.787576] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-19T20:33:29.787818] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-19T20:33:29.788860] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-19T20:33:29.788968] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-19T20:33:29.790269] [DEBUG] [LOCAL ] ORA: Trimmed 49356 records to 33165 (keeping 200 days of data) [2025-09-19T20:33:29.935131] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-09-19T20:33:30.069514] [DEBUG] [LOCAL ] ORA: Primary data saved (33165 records). [2025-09-19T20:33:30.069704] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-19T20:33:30.069816] [INFO ] [MAIN ] Update Progress: 1606/2372 symbols completed. ORA took 28.8s. Estimated remaining: 1h 41m 48s. Rate: 7.5 symbols/min [2025-09-19T20:33:30.239100] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:33:30.239319] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-19T20:33:30.239373] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-19T20:33:30.239516] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-19T20:33:30.239559] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-19T20:33:30.239600] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-19T20:33:30.239632] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-19T20:33:30.274455] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-19T20:33:30.596245] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:33:30.660618] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T20:33:31.043302] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-19T20:33:31.795134] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-19T20:33:31.843271] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-19T20:33:32.301397] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T20:33:32.308977] [INFO ] [REMOTE ] OR: Full fetch complete (64806 records). [2025-09-19T20:33:32.309121] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-19T20:33:32.650598] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-19T20:33:32.708798] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-19T20:33:32.708890] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-19T20:33:32.709847] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-19T20:33:32.709922] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-19T20:33:32.711435] [DEBUG] [LOCAL ] OR: Trimmed 64806 records to 46633 (keeping 200 days of data) [2025-09-19T20:33:32.999420] [DEBUG] [LOCAL ] OR: Primary data saved (46633 records). [2025-09-19T20:33:32.999573] [INFO ] [MAIN ] OR: Full history saved. [2025-09-19T20:33:32.999683] [INFO ] [MAIN ] Update Progress: 1607/2372 symbols completed. OR took 33.3s. Estimated remaining: 1h 41m 38s. Rate: 7.5 symbols/min [2025-09-19T20:33:33.177101] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:33:33.209321] [DEBUG] [LOCAL ] ORN: Loaded 32121 existing records from primary storage. [2025-09-19T20:33:33.209477] [INFO ] [MAIN ] ORN: Loaded 32121 existing records. [2025-09-19T20:33:33.418901] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (3.14 seconds). [2025-09-19T20:33:33.453367] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:33:33.453636] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-19T20:33:33.453764] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-19T20:33:33.454174] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-19T20:33:33.455779] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-19T20:33:33.455861] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-19T20:33:33.891339] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:33:33.927824] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T20:33:34.091090] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T20:33:34.243320] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-19T20:33:35.043358] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-19T20:33:35.843316] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-19T20:33:36.053939] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-19T20:33:36.643276] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-19T20:33:36.681057] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T20:33:36.745680] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-19T20:33:37.443306] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-19T20:33:37.504438] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T20:33:38.243283] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-19T20:33:39.043300] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-19T20:33:39.450048] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-19T20:33:39.852395] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-19T20:33:39.875364] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-19T20:33:40.355432] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T20:33:40.643314] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-19T20:33:40.730002] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T20:33:41.443266] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-19T20:33:42.243354] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-19T20:33:42.633184] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T20:33:42.858183] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T20:33:43.044969] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-19T20:33:43.050727] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.20 seconds). [2025-09-19T20:33:43.843273] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-19T20:33:43.979804] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T20:33:43.987719] [INFO ] [REMOTE ] ORC: Full fetch complete (75109 records). [2025-09-19T20:33:43.987858] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-19T20:33:44.382802] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-19T20:33:44.382904] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-19T20:33:44.384182] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-19T20:33:44.384267] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-19T20:33:44.386098] [DEBUG] [LOCAL ] ORC: Trimmed 75109 records to 53032 (keeping 200 days of data) [2025-09-19T20:33:44.663526] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-19T20:33:44.714927] [DEBUG] [LOCAL ] ORC: Primary data saved (53032 records). [2025-09-19T20:33:44.715087] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-19T20:33:44.715526] [INFO ] [MAIN ] Update Progress: 1608/2372 symbols completed. ORC took 38.6s. Estimated remaining: 1h 41m 31s. Rate: 7.5 symbols/min [2025-09-19T20:33:44.897904] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:33:44.920372] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T20:33:44.983262] [DEBUG] [LOCAL ] OSCR: Loaded 54085 existing records from primary storage. [2025-09-19T20:33:44.983486] [INFO ] [MAIN ] OSCR: Loaded 54085 existing records. [2025-09-19T20:33:45.171670] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:33:45.171944] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-19T20:33:45.172009] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-19T20:33:45.173510] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-19T20:33:45.173574] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-19T20:33:45.448454] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-19T20:33:45.551847] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:33:46.243268] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-19T20:33:46.992802] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T20:33:47.043241] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-19T20:33:47.286362] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T20:33:47.384167] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (3.54 seconds). [2025-09-19T20:33:47.843237] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-19T20:33:48.582924] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T20:33:48.643277] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-19T20:33:48.912430] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T20:33:48.919803] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-09-19T20:33:48.919946] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-19T20:33:48.920717] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:33:48.920812] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:33:48.920854] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:33:48.920893] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-19T20:33:48.920951] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-19T20:33:48.920986] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-19T20:33:48.921029] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-19T20:33:48.921088] [INFO ] [MAIN ] Update Progress: 1609/2372 symbols completed. ORCL took 33.8s. Estimated remaining: 1h 41m 22s. Rate: 7.5 symbols/min [2025-09-19T20:33:49.112813] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:33:49.113185] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-19T20:33:49.113361] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-19T20:33:49.113674] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-19T20:33:49.113888] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-19T20:33:49.114085] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-19T20:33:49.114167] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-19T20:33:49.349546] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T20:33:49.448346] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-19T20:33:49.565627] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:33:50.243355] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-19T20:33:50.812733] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T20:33:51.010991] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T20:33:51.043227] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-19T20:33:51.498561] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T20:33:51.843306] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-19T20:33:52.643255] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-19T20:33:53.062467] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T20:33:53.150699] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:33:53.443282] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-19T20:33:54.243266] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-19T20:33:54.524016] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T20:33:55.043367] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-19T20:33:55.130195] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T20:33:55.843262] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-19T20:33:56.217789] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T20:33:56.643284] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-19T20:33:57.339398] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T20:33:57.443271] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-19T20:33:57.542175] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T20:33:58.243313] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-19T20:33:58.630462] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T20:33:59.043213] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-19T20:33:59.170524] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T20:33:59.175426] [INFO ] [REMOTE ] ORN: Full fetch complete (45695 records). [2025-09-19T20:33:59.175533] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-19T20:33:59.569722] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-19T20:33:59.569901] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-19T20:33:59.570770] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-19T20:33:59.570851] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-19T20:33:59.572320] [DEBUG] [LOCAL ] ORN: Trimmed 45695 records to 32390 (keeping 200 days of data) [2025-09-19T20:33:59.687198] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T20:33:59.800403] [DEBUG] [LOCAL ] ORN: Primary data saved (32390 records). [2025-09-19T20:33:59.800546] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-19T20:33:59.800794] [INFO ] [MAIN ] Update Progress: 1610/2372 symbols completed. ORN took 26.8s. Estimated remaining: 1h 41m 15s. Rate: 7.5 symbols/min [2025-09-19T20:33:59.848373] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-19T20:33:59.989773] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:33:59.990019] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-19T20:33:59.990078] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-19T20:33:59.990228] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-19T20:33:59.990273] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-19T20:33:59.990319] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-19T20:33:59.990431] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-19T20:34:00.367982] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:00.643270] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-19T20:34:00.944240] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:34:00.944565] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-19T20:34:00.982322] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T20:34:01.105897] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T20:34:01.113522] [INFO ] [REMOTE ] ORI: Full fetch complete (70026 records). [2025-09-19T20:34:01.113728] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-19T20:34:01.311186] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T20:34:01.311953] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:34:01.312027] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:34:01.312099] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-19T20:34:01.312170] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-19T20:34:01.312206] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-19T20:34:01.312244] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-19T20:34:01.312313] [INFO ] [MAIN ] Update Progress: 1611/2372 symbols completed. ORI took 31.2s. Estimated remaining: 1h 41m 4s. Rate: 7.5 symbols/min [2025-09-19T20:34:01.455006] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-19T20:34:01.489629] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:34:01.545555] [DEBUG] [LOCAL ] OTIS: Loaded 53104 existing records from primary storage. [2025-09-19T20:34:01.545768] [INFO ] [MAIN ] OTIS: Loaded 53104 existing records. [2025-09-19T20:34:01.731940] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:34:01.732250] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-19T20:34:01.732318] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-19T20:34:01.733950] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-19T20:34:01.734011] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-19T20:34:02.114027] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:02.243218] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-19T20:34:03.043256] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-19T20:34:03.344412] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T20:34:03.843276] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-19T20:34:04.459778] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T20:34:04.643286] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-19T20:34:05.443256] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-19T20:34:05.487277] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T20:34:05.822235] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:34:05.822608] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-19T20:34:05.858056] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T20:34:06.243271] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-19T20:34:06.546550] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:34:06.546940] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-19T20:34:07.014093] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-19T20:34:07.043285] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-19T20:34:07.843278] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-19T20:34:08.643277] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-19T20:34:08.927997] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:34:08.928433] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-19T20:34:09.443280] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-19T20:34:09.733058] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:34:09.733399] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-19T20:34:10.059322] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-09-19T20:34:10.132831] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T20:34:10.243280] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-19T20:34:11.043370] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-19T20:34:11.359020] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:34:11.359351] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-19T20:34:11.843272] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-19T20:34:12.146351] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T20:34:12.643288] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-19T20:34:13.443309] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-19T20:34:13.788962] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T20:34:14.243272] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-19T20:34:15.043262] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-19T20:34:15.460375] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T20:34:15.843238] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-19T20:34:15.894703] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T20:34:15.928718] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.29 seconds). [2025-09-19T20:34:16.043279] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T20:34:16.643257] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-19T20:34:17.443314] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-19T20:34:17.756461] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T20:34:18.243279] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-19T20:34:19.043235] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-19T20:34:19.421573] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T20:34:19.576268] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-09-19T20:34:19.699264] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T20:34:19.843256] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-19T20:34:20.643261] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-19T20:34:21.017847] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T20:34:21.315385] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-19T20:34:21.443267] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-19T20:34:21.865924] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T20:34:22.243324] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-19T20:34:23.043283] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-19T20:34:23.570128] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T20:34:23.576388] [INFO ] [REMOTE ] OTF: Full fetch complete (7696 records). [2025-09-19T20:34:23.576515] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-19T20:34:23.790302] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-19T20:34:23.790573] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:34:23.790663] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:34:23.790737] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-19T20:34:23.790803] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-19T20:34:23.790839] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-19T20:34:23.790877] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-19T20:34:23.790935] [INFO ] [MAIN ] Update Progress: 1612/2372 symbols completed. OTF took 24.0s. Estimated remaining: 1h 41m 3s. Rate: 7.5 symbols/min [2025-09-19T20:34:23.854259] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-19T20:34:23.962575] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:34:24.010633] [DEBUG] [LOCAL ] OUT: Loaded 48633 existing records from primary storage. [2025-09-19T20:34:24.010848] [INFO ] [MAIN ] OUT: Loaded 48633 existing records. [2025-09-19T20:34:24.201861] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:34:24.202446] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-19T20:34:24.202619] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-19T20:34:24.204544] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-19T20:34:24.204608] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-19T20:34:24.388937] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-19T20:34:24.417123] [INFO ] [REMOTE ] OSCR: Full fetch complete (77474 records). [2025-09-19T20:34:24.425096] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-19T20:34:24.847252] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:24.876162] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-19T20:34:25.067340] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-19T20:34:25.077598] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-19T20:34:25.093741] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-19T20:34:25.096759] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-19T20:34:25.099290] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T20:34:25.111128] [DEBUG] [LOCAL ] OSCR: Trimmed 77474 records to 54475 (keeping 200 days of data) [2025-09-19T20:34:25.461925] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-19T20:34:25.500009] [DEBUG] [LOCAL ] OSCR: Primary data saved (54475 records). [2025-09-19T20:34:25.500262] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-19T20:34:25.501119] [INFO ] [MAIN ] Update Progress: 1613/2372 symbols completed. OSCR took 40.8s. Estimated remaining: 1h 40m 52s. Rate: 7.5 symbols/min [2025-09-19T20:34:25.707891] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:34:25.726839] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T20:34:25.733942] [INFO ] [REMOTE ] OSK: Full fetch complete (61561 records). [2025-09-19T20:34:25.734076] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-19T20:34:25.949112] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T20:34:25.949824] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:34:25.949898] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:34:25.949970] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-19T20:34:25.950035] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-19T20:34:25.950071] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-19T20:34:25.950181] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-19T20:34:25.950266] [INFO ] [MAIN ] Update Progress: 1614/2372 symbols completed. OSK took 37.0s. Estimated remaining: 1h 40m 40s. Rate: 7.5 symbols/min [2025-09-19T20:34:26.070004] [DEBUG] [LOCAL ] OVV: Loaded 53906 existing records from primary storage. [2025-09-19T20:34:26.080748] [INFO ] [MAIN ] OVV: Loaded 53906 existing records. [2025-09-19T20:34:26.251843] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:34:26.335616] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:34:26.335900] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-19T20:34:26.335958] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-19T20:34:26.338411] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-19T20:34:26.338496] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-19T20:34:26.666463] [DEBUG] [LOCAL ] OWL: Loaded 53946 existing records from primary storage. [2025-09-19T20:34:26.672336] [INFO ] [MAIN ] OWL: Loaded 53946 existing records. [2025-09-19T20:34:26.869485] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:26.940146] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:34:26.940865] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-19T20:34:26.942391] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-19T20:34:26.942501] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-19T20:34:26.945232] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-19T20:34:26.945331] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-19T20:34:27.216414] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T20:34:27.290337] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-19T20:34:27.404810] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:27.731125] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-19T20:34:27.843322] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-19T20:34:28.643361] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-19T20:34:29.248986] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T20:34:29.294027] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T20:34:29.443398] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-19T20:34:30.005591] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T20:34:30.243304] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-19T20:34:30.830020] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-19T20:34:31.043282] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-19T20:34:31.469315] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T20:34:31.843289] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-19T20:34:32.471619] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T20:34:32.643262] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-19T20:34:33.006780] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T20:34:33.014639] [INFO ] [REMOTE ] OTIS: Full fetch complete (75726 records). [2025-09-19T20:34:33.014799] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-19T20:34:33.420130] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-19T20:34:33.420223] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-19T20:34:33.421271] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-19T20:34:33.421336] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-19T20:34:33.423180] [DEBUG] [LOCAL ] OTIS: Trimmed 75726 records to 53491 (keeping 200 days of data) [2025-09-19T20:34:33.485228] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-19T20:34:33.770001] [DEBUG] [LOCAL ] OTIS: Primary data saved (53491 records). [2025-09-19T20:34:33.770166] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-19T20:34:33.770287] [INFO ] [MAIN ] Update Progress: 1615/2372 symbols completed. OTIS took 32.5s. Estimated remaining: 1h 40m 32s. Rate: 7.5 symbols/min [2025-09-19T20:34:33.956937] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:34:33.968413] [DEBUG] [LOCAL ] OWLT: Loaded 8877 existing records from primary storage. [2025-09-19T20:34:33.968561] [INFO ] [MAIN ] OWLT: Loaded 8877 existing records. [2025-09-19T20:34:34.197978] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:34:34.202634] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-19T20:34:34.202977] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-19T20:34:34.212895] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-19T20:34:34.214063] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-19T20:34:34.214130] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-19T20:34:34.256984] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-19T20:34:34.582261] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:34.660301] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T20:34:35.043274] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-19T20:34:35.489057] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T20:34:35.843273] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-19T20:34:36.116635] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T20:34:36.276321] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T20:34:36.643273] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-19T20:34:37.443272] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-19T20:34:37.768094] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T20:34:38.243371] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-19T20:34:38.792623] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T20:34:39.043272] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-19T20:34:39.380579] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T20:34:39.843260] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-19T20:34:40.077569] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T20:34:40.455247] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T20:34:40.643265] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-19T20:34:41.443260] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-19T20:34:42.042771] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T20:34:42.243240] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-19T20:34:42.782447] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T20:34:43.043227] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-19T20:34:43.793130] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T20:34:43.843220] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-19T20:34:44.199072] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T20:34:44.643313] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-19T20:34:45.443278] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-19T20:34:45.459049] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-19T20:34:45.492964] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-19T20:34:46.056388] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-19T20:34:46.243246] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-19T20:34:47.043319] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-19T20:34:47.439195] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T20:34:47.843313] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-19T20:34:48.251518] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T20:34:48.643301] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-19T20:34:48.779299] [DEBUG] [REMOTE ] OVV: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-19T20:34:48.779567] [WARN ] [REMOTE ] OVV: No data returned for month 2025-07 [2025-09-19T20:34:49.035802] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T20:34:49.099270] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T20:34:49.443333] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-19T20:34:50.243271] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-19T20:34:50.267759] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-19T20:34:51.043264] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-19T20:34:51.843280] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-19T20:34:51.853480] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-19T20:34:52.349868] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T20:34:52.643257] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-19T20:34:53.443264] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-19T20:34:54.064165] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T20:34:54.243266] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-19T20:34:54.409003] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T20:34:54.416114] [INFO ] [REMOTE ] OUT: Full fetch complete (69115 records). [2025-09-19T20:34:54.416250] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-19T20:34:54.810417] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-19T20:34:54.810503] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-19T20:34:54.811481] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-19T20:34:54.811545] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-19T20:34:54.812943] [DEBUG] [LOCAL ] OUT: Trimmed 69115 records to 48911 (keeping 200 days of data) [2025-09-19T20:34:55.043335] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-19T20:34:55.118668] [DEBUG] [LOCAL ] OUT: Primary data saved (48911 records). [2025-09-19T20:34:55.118805] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-19T20:34:55.118894] [INFO ] [MAIN ] Update Progress: 1616/2372 symbols completed. OUT took 31.3s. Estimated remaining: 1h 40m 31s. Rate: 7.5 symbols/min [2025-09-19T20:34:55.288472] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:34:55.321337] [DEBUG] [LOCAL ] OXM: Loaded 33885 existing records from primary storage. [2025-09-19T20:34:55.321471] [INFO ] [MAIN ] OXM: Loaded 33885 existing records. [2025-09-19T20:34:55.502539] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:34:55.503027] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-19T20:34:55.503084] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-19T20:34:55.504295] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-19T20:34:55.504355] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-19T20:34:55.716318] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-19T20:34:55.846681] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-19T20:34:55.847384] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T20:34:55.953177] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:55.974962] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T20:34:55.982818] [INFO ] [REMOTE ] OVV: Full fetch complete (68900 records). [2025-09-19T20:34:55.982932] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-19T20:34:56.186310] [WARN ] [VALIDATOR ] OVV: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T20:34:56.187108] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:34:56.187186] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:34:56.187295] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-19T20:34:56.187397] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-09-19T20:34:56.187454] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-09-19T20:34:56.187984] [DEBUG] [LOCAL ] OVV: Deleted derivative data file. [2025-09-19T20:34:56.189423] [INFO ] [MAIN ] Update Progress: 1617/2372 symbols completed. OVV took 30.7s. Estimated remaining: 1h 40m 19s. Rate: 7.5 symbols/min [2025-09-19T20:34:56.370558] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:34:56.370790] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-19T20:34:56.370835] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-19T20:34:56.371014] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-19T20:34:56.371081] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-19T20:34:56.371139] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-19T20:34:56.371209] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-19T20:34:56.648384] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-19T20:34:56.746635] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:57.443271] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-19T20:34:57.869343] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T20:34:57.879342] [INFO ] [REMOTE ] OWL: Full fetch complete (77520 records). [2025-09-19T20:34:57.879501] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-19T20:34:58.245230] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-19T20:34:58.286518] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-19T20:34:58.286601] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-19T20:34:58.287750] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-19T20:34:58.287815] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-19T20:34:58.289430] [DEBUG] [LOCAL ] OWL: Trimmed 77520 records to 54336 (keeping 200 days of data) [2025-09-19T20:34:58.655509] [DEBUG] [LOCAL ] OWL: Primary data saved (54336 records). [2025-09-19T20:34:58.656260] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T20:34:58.656457] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-19T20:34:58.663249] [INFO ] [MAIN ] Update Progress: 1618/2372 symbols completed. OWL took 32.7s. Estimated remaining: 1h 40m 9s. Rate: 7.5 symbols/min [2025-09-19T20:34:58.843067] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:34:58.851267] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T20:34:58.907169] [DEBUG] [LOCAL ] PAAS: Loaded 53993 existing records from primary storage. [2025-09-19T20:34:58.907324] [INFO ] [MAIN ] PAAS: Loaded 53993 existing records. [2025-09-19T20:34:59.049706] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-19T20:34:59.091290] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:34:59.091521] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-19T20:34:59.091569] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-19T20:34:59.093799] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-19T20:34:59.093860] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-19T20:34:59.448941] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:34:59.843282] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-19T20:35:00.046458] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T20:35:00.643311] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-19T20:35:01.443279] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-19T20:35:01.896800] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (3.65 seconds). [2025-09-19T20:35:02.243267] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-19T20:35:02.437397] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T20:35:02.510326] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-19T20:35:02.566501] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T20:35:03.043291] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-19T20:35:03.843302] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-19T20:35:04.140716] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T20:35:04.142759] [INFO ] [REMOTE ] OWLT: Full fetch complete (11630 records). [2025-09-19T20:35:04.142835] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-19T20:35:04.532919] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-19T20:35:04.532998] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-19T20:35:04.533295] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-19T20:35:04.533383] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-19T20:35:04.533943] [DEBUG] [LOCAL ] OWLT: Trimmed 11630 records to 8963 (keeping 200 days of data) [2025-09-19T20:35:04.583384] [DEBUG] [LOCAL ] OWLT: Primary data saved (8963 records). [2025-09-19T20:35:04.583513] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-19T20:35:04.583618] [INFO ] [MAIN ] Update Progress: 1619/2372 symbols completed. OWLT took 30.8s. Estimated remaining: 1h 39m 60s. Rate: 7.5 symbols/min [2025-09-19T20:35:04.652371] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-19T20:35:04.762453] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:35:04.777025] [DEBUG] [LOCAL ] PAC: Loaded 11748 existing records from primary storage. [2025-09-19T20:35:04.777154] [INFO ] [MAIN ] PAC: Loaded 11748 existing records. [2025-09-19T20:35:04.974855] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:35:04.975141] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-19T20:35:04.975203] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-19T20:35:04.975735] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-19T20:35:04.975796] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-19T20:35:05.383174] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:35:05.414891] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (3.17 seconds). [2025-09-19T20:35:05.443247] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-19T20:35:06.068762] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T20:35:06.243290] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-19T20:35:06.485307] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T20:35:06.812680] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T20:35:07.043280] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-19T20:35:07.843291] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-19T20:35:08.064332] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T20:35:08.610270] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-19T20:35:08.643220] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-19T20:35:09.443629] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T20:35:09.443757] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-19T20:35:10.243276] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-19T20:35:10.589148] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T20:35:11.023715] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T20:35:11.043210] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-19T20:35:11.843254] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-19T20:35:12.644790] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-19T20:35:12.643313] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-19T20:35:13.091846] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T20:35:13.377393] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T20:35:13.443253] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-19T20:35:14.006618] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-19T20:35:14.243317] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-19T20:35:14.519247] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-19T20:35:15.043272] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-19T20:35:15.843317] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-19T20:35:16.652733] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-19T20:35:16.674530] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-19T20:35:16.940528] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T20:35:17.443291] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-19T20:35:18.197477] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (3.15 seconds). [2025-09-19T20:35:18.243263] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-19T20:35:18.376321] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T20:35:19.043261] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-19T20:35:19.439838] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T20:35:19.843245] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-19T20:35:19.917583] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-19T20:35:20.643337] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-19T20:35:21.312183] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-19T20:35:21.449298] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-19T20:35:21.603165] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T20:35:22.078801] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T20:35:22.243285] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-19T20:35:22.765936] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T20:35:23.043279] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-19T20:35:23.843281] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-19T20:35:24.197633] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-19T20:35:24.643284] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-19T20:35:25.041963] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-19T20:35:25.443273] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-19T20:35:25.710415] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T20:35:26.243273] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-19T20:35:26.422399] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T20:35:26.466244] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T20:35:26.468229] [INFO ] [REMOTE ] PAC: Full fetch complete (16504 records). [2025-09-19T20:35:26.468311] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-19T20:35:26.846738] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-19T20:35:26.846853] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-19T20:35:26.847525] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-19T20:35:26.847609] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-19T20:35:26.848488] [DEBUG] [LOCAL ] PAC: Trimmed 16504 records to 11793 (keeping 200 days of data) [2025-09-19T20:35:26.932019] [DEBUG] [LOCAL ] PAC: Primary data saved (11793 records). [2025-09-19T20:35:26.932206] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-19T20:35:26.932357] [INFO ] [MAIN ] Update Progress: 1620/2372 symbols completed. PAC took 22.3s. Estimated remaining: 1h 39m 59s. Rate: 7.5 symbols/min [2025-09-19T20:35:27.048474] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-19T20:35:27.152739] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:35:27.198914] [DEBUG] [LOCAL ] PACK: Loaded 32286 existing records from primary storage. [2025-09-19T20:35:27.199085] [INFO ] [MAIN ] PACK: Loaded 32286 existing records. [2025-09-19T20:35:27.384994] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:35:27.385307] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-19T20:35:27.385379] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-19T20:35:27.386390] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-19T20:35:27.386473] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-19T20:35:27.747376] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:35:27.843304] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-19T20:35:28.643319] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-19T20:35:28.690359] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-19T20:35:29.378230] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T20:35:29.443249] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-19T20:35:29.913170] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-19T20:35:30.214587] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T20:35:30.243235] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-19T20:35:30.925395] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T20:35:31.043299] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-19T20:35:31.843369] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-19T20:35:32.031015] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T20:35:32.037157] [INFO ] [REMOTE ] OXM: Full fetch complete (46218 records). [2025-09-19T20:35:32.037276] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-19T20:35:32.428860] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-19T20:35:32.428992] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-19T20:35:32.430186] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-19T20:35:32.430289] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-19T20:35:32.434608] [DEBUG] [LOCAL ] OXM: Trimmed 46218 records to 34131 (keeping 200 days of data) [2025-09-19T20:35:32.622351] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T20:35:32.654535] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-19T20:35:32.681116] [DEBUG] [LOCAL ] OXM: Primary data saved (34131 records). [2025-09-19T20:35:32.681234] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-19T20:35:32.681424] [INFO ] [MAIN ] Update Progress: 1621/2372 symbols completed. OXM took 37.6s. Estimated remaining: 1h 39m 50s. Rate: 7.5 symbols/min [2025-09-19T20:35:32.848794] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:35:32.887843] [DEBUG] [LOCAL ] PACS: Loaded 34096 existing records from primary storage. [2025-09-19T20:35:32.887993] [INFO ] [MAIN ] PACS: Loaded 34096 existing records. [2025-09-19T20:35:33.120835] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:35:33.121089] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-19T20:35:33.121140] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-19T20:35:33.122040] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-19T20:35:33.122100] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-19T20:35:33.449466] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-19T20:35:33.496697] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:35:33.811836] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T20:35:33.831549] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-19T20:35:33.831883] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-19T20:35:34.061897] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T20:35:34.062846] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:35:34.062933] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:35:34.063012] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-19T20:35:34.063197] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-19T20:35:34.063313] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-19T20:35:34.063519] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-19T20:35:34.063732] [INFO ] [MAIN ] Update Progress: 1622/2372 symbols completed. OXY took 37.9s. Estimated remaining: 1h 39m 39s. Rate: 7.5 symbols/min [2025-09-19T20:35:34.199157] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T20:35:34.247782] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-19T20:35:34.284944] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:35:34.310847] [DEBUG] [LOCAL ] PAG: Loaded 22228 existing records from primary storage. [2025-09-19T20:35:34.310986] [INFO ] [MAIN ] PAG: Loaded 22228 existing records. [2025-09-19T20:35:34.491324] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:35:34.491688] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-19T20:35:34.491750] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-19T20:35:34.492529] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-19T20:35:34.492598] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-19T20:35:34.853867] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:35:35.043276] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-19T20:35:35.680569] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-19T20:35:35.694069] [INFO ] [REMOTE ] PAAS: Full fetch complete (77367 records). [2025-09-19T20:35:35.694233] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-19T20:35:35.867685] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-19T20:35:36.147707] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-19T20:35:36.147856] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-19T20:35:36.148909] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-19T20:35:36.149130] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-19T20:35:36.151342] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T20:35:36.162337] [DEBUG] [LOCAL ] PAAS: Trimmed 77367 records to 54383 (keeping 200 days of data) [2025-09-19T20:35:36.515130] [DEBUG] [LOCAL ] PAAS: Primary data saved (54383 records). [2025-09-19T20:35:36.515696] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-19T20:35:36.515928] [INFO ] [MAIN ] Update Progress: 1623/2372 symbols completed. PAAS took 37.9s. Estimated remaining: 1h 39m 28s. Rate: 7.5 symbols/min [2025-09-19T20:35:36.647556] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-19T20:35:36.713970] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:35:36.715205] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T20:35:36.774115] [DEBUG] [LOCAL ] PAGS: Loaded 53067 existing records from primary storage. [2025-09-19T20:35:36.774275] [INFO ] [MAIN ] PAGS: Loaded 53067 existing records. [2025-09-19T20:35:36.961484] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:35:36.961803] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-19T20:35:36.961857] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-19T20:35:36.963449] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-19T20:35:36.963513] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-19T20:35:37.339252] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:35:37.443287] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-19T20:35:37.710173] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T20:35:38.243282] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-19T20:35:38.444014] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T20:35:39.043250] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-19T20:35:39.458440] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T20:35:39.644881] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-19T20:35:39.843279] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-19T20:35:40.403485] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T20:35:40.644126] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-19T20:35:40.645342] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T20:35:41.443284] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-19T20:35:42.243265] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-19T20:35:42.682543] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T20:35:42.768776] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T20:35:43.043274] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-19T20:35:43.199257] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-19T20:35:43.843314] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-19T20:35:44.624146] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T20:35:44.643215] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-19T20:35:45.386996] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T20:35:45.443223] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-19T20:35:46.243335] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-19T20:35:46.401808] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T20:35:46.489780] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T20:35:47.043304] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-19T20:35:47.843272] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-19T20:35:48.323089] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T20:35:48.412809] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T20:35:48.643258] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-19T20:35:48.904673] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T20:35:49.443261] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-19T20:35:50.164022] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T20:35:50.169384] [INFO ] [REMOTE ] PACK: Full fetch complete (43081 records). [2025-09-19T20:35:50.169479] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-19T20:35:50.249763] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-19T20:35:50.257543] [DEBUG] [REMOTE ] PAG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-19T20:35:50.281324] [WARN ] [REMOTE ] PAG: No data returned for month 2025-07 [2025-09-19T20:35:50.566865] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-19T20:35:50.566956] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-19T20:35:50.568114] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-19T20:35:50.568177] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-19T20:35:50.569979] [DEBUG] [LOCAL ] PACK: Trimmed 43081 records to 32597 (keeping 200 days of data) [2025-09-19T20:35:50.766254] [DEBUG] [LOCAL ] PACK: Primary data saved (32597 records). [2025-09-19T20:35:50.766710] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-19T20:35:50.766828] [INFO ] [MAIN ] Update Progress: 1624/2372 symbols completed. PACK took 23.8s. Estimated remaining: 1h 39m 23s. Rate: 7.5 symbols/min [2025-09-19T20:35:50.951773] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:35:50.957113] [DEBUG] [LOCAL ] PAI: Loaded 2759 existing records from primary storage. [2025-09-19T20:35:50.957205] [INFO ] [MAIN ] PAI: Loaded 2759 existing records. [2025-09-19T20:35:51.048492] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-19T20:35:51.150883] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:35:51.151195] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-19T20:35:51.151243] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-19T20:35:51.151861] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-19T20:35:51.151920] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-19T20:35:51.506889] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:35:51.843313] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-19T20:35:52.491559] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T20:35:52.524892] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T20:35:52.643255] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-19T20:35:52.799690] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T20:35:53.443236] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-19T20:35:53.760486] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T20:35:53.763409] [INFO ] [REMOTE ] PAG: Full fetch complete (26396 records). [2025-09-19T20:35:53.763492] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-19T20:35:53.950145] [WARN ] [VALIDATOR ] PAG: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-19T20:35:53.950529] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:35:53.950599] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:35:53.950666] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-19T20:35:53.950747] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-09-19T20:35:53.950792] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-09-19T20:35:53.951156] [DEBUG] [LOCAL ] PAG: Deleted derivative data file. [2025-09-19T20:35:53.951266] [INFO ] [MAIN ] Update Progress: 1625/2372 symbols completed. PAG took 19.9s. Estimated remaining: 1h 39m 13s. Rate: 7.5 symbols/min [2025-09-19T20:35:54.135992] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:35:54.136287] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-19T20:35:54.136404] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-19T20:35:54.136563] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-19T20:35:54.136607] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-19T20:35:54.136676] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-19T20:35:54.136730] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-19T20:35:54.248435] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-19T20:35:54.497628] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:35:55.043271] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-19T20:35:55.443125] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T20:35:55.756573] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T20:35:55.843219] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-19T20:35:55.863861] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T20:35:56.643268] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-19T20:35:57.278280] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-19T20:35:57.443271] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-19T20:35:57.868083] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T20:35:58.056684] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-19T20:35:58.243280] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-19T20:35:58.577443] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:35:58.577836] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-19T20:35:59.043267] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-19T20:35:59.362530] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:35:59.362896] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-19T20:35:59.843261] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-19T20:36:00.164029] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:36:00.164350] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-19T20:36:00.643256] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-19T20:36:01.443313] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-19T20:36:02.243267] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-19T20:36:03.043320] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-19T20:36:03.139775] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:36:03.140095] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-19T20:36:03.273707] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-19T20:36:03.843268] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-19T20:36:04.643267] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-19T20:36:04.931093] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-19T20:36:05.015448] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:36:05.015831] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-19T20:36:05.443306] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-19T20:36:05.783636] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:36:05.784058] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-19T20:36:05.893615] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-19T20:36:06.243276] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-19T20:36:06.570932] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:36:06.571319] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-19T20:36:07.043280] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-19T20:36:07.193813] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-19T20:36:07.356805] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:36:07.357143] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-19T20:36:07.843277] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-19T20:36:08.172683] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:36:08.173015] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-19T20:36:08.643258] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-19T20:36:09.443288] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-19T20:36:09.961434] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-19T20:36:09.962142] [INFO ] [REMOTE ] PAII: Full fetch complete (77 records). [2025-09-19T20:36:09.962209] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-19T20:36:10.145500] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 8 unique days, need 200 days [2025-09-19T20:36:10.145718] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:36:10.145808] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:36:10.145902] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-19T20:36:10.145998] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-19T20:36:10.146042] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-19T20:36:10.146098] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-19T20:36:10.146203] [INFO ] [MAIN ] Update Progress: 1626/2372 symbols completed. PAII took 16.2s. Estimated remaining: 1h 39m 9s. Rate: 7.5 symbols/min [2025-09-19T20:36:10.245817] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-19T20:36:10.326227] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:36:10.366701] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T20:36:10.384126] [DEBUG] [LOCAL ] PAM: Loaded 27742 existing records from primary storage. [2025-09-19T20:36:10.384275] [INFO ] [MAIN ] PAM: Loaded 27742 existing records. [2025-09-19T20:36:10.567307] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:36:10.567549] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-19T20:36:10.567596] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-19T20:36:10.569072] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-19T20:36:10.569134] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-19T20:36:10.926413] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:36:10.929407] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T20:36:11.043500] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-19T20:36:11.763252] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T20:36:11.843286] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-19T20:36:12.489465] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-19T20:36:12.643263] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-19T20:36:13.443320] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-19T20:36:14.243616] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-19T20:36:14.372491] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T20:36:14.418712] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T20:36:15.043310] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-19T20:36:15.843330] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-19T20:36:16.643289] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-19T20:36:17.061359] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T20:36:17.063027] [INFO ] [REMOTE ] PAI: Full fetch complete (4133 records). [2025-09-19T20:36:17.063115] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-19T20:36:17.276577] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-09-19T20:36:17.450833] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-19T20:36:17.474327] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-19T20:36:17.474418] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-19T20:36:17.474582] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-19T20:36:17.474629] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-19T20:36:17.475049] [DEBUG] [LOCAL ] PAI: Trimmed 4133 records to 2767 (keeping 200 days of data) [2025-09-19T20:36:17.493304] [DEBUG] [LOCAL ] PAI: Primary data saved (2767 records). [2025-09-19T20:36:17.493527] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-19T20:36:17.493622] [INFO ] [MAIN ] Update Progress: 1627/2372 symbols completed. PAI took 26.7s. Estimated remaining: 1h 39m 0s. Rate: 7.5 symbols/min [2025-09-19T20:36:17.663660] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:36:17.698512] [DEBUG] [LOCAL ] PAR: Loaded 32810 existing records from primary storage. [2025-09-19T20:36:17.698761] [INFO ] [MAIN ] PAR: Loaded 32810 existing records. [2025-09-19T20:36:17.888812] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:36:17.889310] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-19T20:36:17.889376] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-19T20:36:17.896131] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-19T20:36:17.907135] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-19T20:36:17.953451] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-19T20:36:18.253066] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-19T20:36:18.283821] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:36:18.754174] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T20:36:19.043326] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-19T20:36:19.174088] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T20:36:19.843331] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-19T20:36:19.898996] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T20:36:19.905088] [INFO ] [REMOTE ] PACS: Full fetch complete (50823 records). [2025-09-19T20:36:19.905180] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-19T20:36:20.281338] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-19T20:36:20.281418] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-19T20:36:20.282254] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-19T20:36:20.282361] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-19T20:36:20.283428] [DEBUG] [LOCAL ] PACS: Trimmed 50823 records to 34403 (keeping 200 days of data) [2025-09-19T20:36:20.486673] [DEBUG] [LOCAL ] PACS: Primary data saved (34403 records). [2025-09-19T20:36:20.486872] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-19T20:36:20.486992] [INFO ] [MAIN ] Update Progress: 1628/2372 symbols completed. PACS took 47.8s. Estimated remaining: 1h 38m 50s. Rate: 7.5 symbols/min [2025-09-19T20:36:20.657369] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:36:20.654213] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-19T20:36:20.702987] [DEBUG] [LOCAL ] PARR: Loaded 48806 existing records from primary storage. [2025-09-19T20:36:20.703135] [INFO ] [MAIN ] PARR: Loaded 48806 existing records. [2025-09-19T20:36:20.880476] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:36:20.880768] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-19T20:36:20.880837] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-19T20:36:20.881894] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-19T20:36:20.881957] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-19T20:36:21.264707] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:36:21.320486] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-19T20:36:21.359945] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T20:36:21.443257] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-19T20:36:21.898701] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T20:36:22.243336] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-19T20:36:22.930174] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T20:36:23.043254] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-19T20:36:23.818098] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T20:36:23.843233] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-19T20:36:24.643261] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-19T20:36:25.045238] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T20:36:25.053782] [INFO ] [REMOTE ] PAGS: Full fetch complete (76330 records). [2025-09-19T20:36:25.053939] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-19T20:36:25.447776] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-19T20:36:25.480300] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-19T20:36:25.480393] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-19T20:36:25.481716] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-19T20:36:25.481962] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-19T20:36:25.510466] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T20:36:25.509291] [DEBUG] [LOCAL ] PAGS: Trimmed 76330 records to 53457 (keeping 200 days of data) [2025-09-19T20:36:25.845946] [DEBUG] [LOCAL ] PAGS: Primary data saved (53457 records). [2025-09-19T20:36:25.846089] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-19T20:36:25.846190] [INFO ] [MAIN ] Update Progress: 1629/2372 symbols completed. PAGS took 49.3s. Estimated remaining: 1h 38m 41s. Rate: 7.5 symbols/min [2025-09-19T20:36:26.022257] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:36:26.080667] [DEBUG] [LOCAL ] PATH: Loaded 54068 existing records from primary storage. [2025-09-19T20:36:26.080837] [INFO ] [MAIN ] PATH: Loaded 54068 existing records. [2025-09-19T20:36:26.255923] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-19T20:36:26.260823] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:36:26.261976] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-19T20:36:26.262052] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-19T20:36:26.263270] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-19T20:36:26.263334] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-19T20:36:26.629093] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:36:26.652351] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T20:36:27.043314] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-19T20:36:27.672692] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T20:36:27.777550] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T20:36:27.843260] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-19T20:36:28.643299] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-19T20:36:28.810753] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T20:36:29.219108] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T20:36:29.443270] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-19T20:36:30.243286] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-19T20:36:30.388313] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T20:36:30.486014] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T20:36:31.043267] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-19T20:36:31.843252] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-19T20:36:31.956681] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T20:36:32.643254] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-19T20:36:33.443348] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-19T20:36:33.758746] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T20:36:34.025354] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.98 seconds). [2025-09-19T20:36:34.243324] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-19T20:36:34.571046] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T20:36:35.030748] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T20:36:35.043214] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-19T20:36:35.843285] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-19T20:36:36.643314] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-19T20:36:36.703950] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T20:36:36.709609] [INFO ] [REMOTE ] PAM: Full fetch complete (41860 records). [2025-09-19T20:36:36.709729] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-19T20:36:37.087895] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-19T20:36:37.088035] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-19T20:36:37.088884] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-19T20:36:37.088997] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-19T20:36:37.090067] [DEBUG] [LOCAL ] PAM: Trimmed 41860 records to 28046 (keeping 200 days of data) [2025-09-19T20:36:37.184571] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.94 seconds). [2025-09-19T20:36:37.260687] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T20:36:37.335078] [DEBUG] [LOCAL ] PAM: Primary data saved (28046 records). [2025-09-19T20:36:37.335222] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-19T20:36:37.335312] [INFO ] [MAIN ] Update Progress: 1630/2372 symbols completed. PAM took 27.2s. Estimated remaining: 1h 38m 35s. Rate: 7.5 symbols/min [2025-09-19T20:36:37.448393] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-19T20:36:37.508471] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:36:37.530084] [DEBUG] [LOCAL ] PAXS: Loaded 21314 existing records from primary storage. [2025-09-19T20:36:37.530216] [INFO ] [MAIN ] PAXS: Loaded 21314 existing records. [2025-09-19T20:36:37.707382] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:36:37.707617] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-19T20:36:37.707704] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-19T20:36:37.708301] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-19T20:36:37.708360] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-19T20:36:38.072886] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:36:38.108779] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T20:36:38.243266] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-19T20:36:39.043296] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-19T20:36:39.620695] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T20:36:39.843302] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-19T20:36:39.913565] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-19T20:36:40.643341] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-19T20:36:41.094748] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T20:36:41.443305] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-19T20:36:41.529197] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T20:36:42.243272] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-19T20:36:42.537480] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T20:36:42.850685] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T20:36:43.043300] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-19T20:36:43.612632] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T20:36:43.843268] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-19T20:36:44.643260] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-19T20:36:44.932553] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T20:36:45.018222] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T20:36:45.443268] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-19T20:36:46.243252] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-19T20:36:46.763476] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T20:36:47.043296] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-19T20:36:47.431937] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-19T20:36:47.503739] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T20:36:47.513149] [INFO ] [REMOTE ] PAR: Full fetch complete (46929 records). [2025-09-19T20:36:47.513268] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-19T20:36:47.848722] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-19T20:36:47.901983] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-19T20:36:47.902084] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-19T20:36:47.903004] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-19T20:36:47.903068] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-19T20:36:47.904273] [DEBUG] [LOCAL ] PAR: Trimmed 46929 records to 33100 (keeping 200 days of data) [2025-09-19T20:36:48.096408] [DEBUG] [LOCAL ] PAR: Primary data saved (33100 records). [2025-09-19T20:36:48.096547] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-19T20:36:48.096632] [INFO ] [MAIN ] Update Progress: 1631/2372 symbols completed. PAR took 30.6s. Estimated remaining: 1h 38m 28s. Rate: 7.5 symbols/min [2025-09-19T20:36:48.268545] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:36:48.305797] [DEBUG] [LOCAL ] PAY: Loaded 38465 existing records from primary storage. [2025-09-19T20:36:48.305939] [INFO ] [MAIN ] PAY: Loaded 38465 existing records. [2025-09-19T20:36:48.492846] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:36:48.493145] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-19T20:36:48.493201] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-19T20:36:48.494166] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-19T20:36:48.494244] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-19T20:36:48.647580] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-19T20:36:48.866135] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:36:48.894899] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T20:36:49.443272] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-19T20:36:50.040028] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T20:36:50.243251] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-19T20:36:50.732813] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-09-19T20:36:50.986855] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T20:36:51.043228] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-19T20:36:51.843261] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-19T20:36:51.991846] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T20:36:52.643258] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-19T20:36:53.443286] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-19T20:36:53.614105] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-19T20:36:53.868568] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T20:36:53.876184] [INFO ] [REMOTE ] PARR: Full fetch complete (68434 records). [2025-09-19T20:36:53.876354] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-19T20:36:54.253250] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-19T20:36:54.310711] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-19T20:36:54.319518] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-19T20:36:54.320588] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-19T20:36:54.322446] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T20:36:54.321842] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-19T20:36:54.329944] [DEBUG] [LOCAL ] PARR: Trimmed 68434 records to 49140 (keeping 200 days of data) [2025-09-19T20:36:54.619851] [DEBUG] [LOCAL ] PARR: Primary data saved (49140 records). [2025-09-19T20:36:54.619994] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-19T20:36:54.620078] [INFO ] [MAIN ] Update Progress: 1632/2372 symbols completed. PARR took 34.1s. Estimated remaining: 1h 38m 19s. Rate: 7.5 symbols/min [2025-09-19T20:36:54.791884] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:36:54.816945] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T20:36:54.856994] [DEBUG] [LOCAL ] PAYC: Loaded 36694 existing records from primary storage. [2025-09-19T20:36:54.857134] [INFO ] [MAIN ] PAYC: Loaded 36694 existing records. [2025-09-19T20:36:55.043403] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-19T20:36:55.043289] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:36:55.045088] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-19T20:36:55.045166] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-19T20:36:55.046069] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-19T20:36:55.046132] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-19T20:36:55.442112] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:36:55.843270] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-19T20:36:56.386319] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T20:36:56.550566] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-19T20:36:56.643217] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-19T20:36:56.829701] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T20:36:57.443264] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-19T20:36:58.243323] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-19T20:36:58.975412] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-19T20:36:59.043222] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-19T20:36:59.215983] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T20:36:59.843276] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-19T20:37:00.052195] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T20:37:00.643255] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-19T20:37:01.301335] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T20:37:01.443229] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-19T20:37:01.543819] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-19T20:37:02.243328] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-19T20:37:02.433740] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T20:37:02.785876] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T20:37:03.043275] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-19T20:37:03.843288] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-19T20:37:04.629850] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T20:37:04.638269] [INFO ] [REMOTE ] PATH: Full fetch complete (77763 records). [2025-09-19T20:37:04.638438] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-19T20:37:04.663672] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-19T20:37:05.072685] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-19T20:37:05.072942] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-19T20:37:05.074122] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-19T20:37:05.074203] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-19T20:37:05.100786] [DEBUG] [LOCAL ] PATH: Trimmed 77763 records to 54458 (keeping 200 days of data) [2025-09-19T20:37:05.102296] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-19T20:37:05.332783] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T20:37:05.341502] [INFO ] [REMOTE ] PAXS: Full fetch complete (31547 records). [2025-09-19T20:37:05.342254] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-19T20:37:05.443336] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-19T20:37:05.819109] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-19T20:37:05.819780] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-19T20:37:05.820379] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-19T20:37:05.821259] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-19T20:37:05.826235] [DEBUG] [LOCAL ] PAXS: Trimmed 31547 records to 21415 (keeping 200 days of data) [2025-09-19T20:37:05.946054] [DEBUG] [LOCAL ] PATH: Primary data saved (54458 records). [2025-09-19T20:37:05.946688] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-19T20:37:05.947967] [INFO ] [MAIN ] Update Progress: 1633/2372 symbols completed. PATH took 40.1s. Estimated remaining: 1h 38m 13s. Rate: 7.5 symbols/min [2025-09-19T20:37:06.132549] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:37:06.152509] [DEBUG] [LOCAL ] PAXS: Primary data saved (21415 records). [2025-09-19T20:37:06.152694] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-19T20:37:06.152822] [INFO ] [MAIN ] Update Progress: 1634/2372 symbols completed. PAXS took 28.8s. Estimated remaining: 1h 38m 1s. Rate: 7.5 symbols/min [2025-09-19T20:37:06.353454] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:37:06.354891] [DEBUG] [LOCAL ] PB: Loaded 41696 existing records from primary storage. [2025-09-19T20:37:06.355076] [INFO ] [MAIN ] PB: Loaded 41696 existing records. [2025-09-19T20:37:06.579533] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:37:06.580092] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-19T20:37:06.580295] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-19T20:37:06.596233] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-19T20:37:06.598686] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-19T20:37:06.612368] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T20:37:06.715313] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-19T20:37:06.741792] [DEBUG] [LOCAL ] PBA: Loaded 49392 existing records from primary storage. [2025-09-19T20:37:06.746849] [INFO ] [MAIN ] PBA: Loaded 49392 existing records. [2025-09-19T20:37:07.110046] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:37:07.126142] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-19T20:37:07.131338] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-19T20:37:07.167872] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-19T20:37:07.189603] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:37:07.189707] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-19T20:37:07.195088] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-19T20:37:07.608842] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:37:07.635791] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T20:37:07.843222] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-19T20:37:07.984848] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T20:37:08.643251] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-19T20:37:08.874333] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T20:37:09.443236] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-19T20:37:09.556079] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T20:37:09.873445] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T20:37:10.243258] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-19T20:37:11.043276] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-19T20:37:11.203447] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T20:37:11.843284] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-19T20:37:12.210256] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T20:37:12.643254] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-19T20:37:12.892510] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T20:37:13.001221] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T20:37:13.443337] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-19T20:37:14.243299] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-19T20:37:14.348214] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T20:37:15.043288] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-19T20:37:15.202379] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T20:37:15.843291] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-19T20:37:16.092256] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T20:37:16.643323] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-19T20:37:17.134796] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T20:37:17.443258] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-19T20:37:17.509687] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T20:37:18.243280] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-19T20:37:18.424808] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-19T20:37:19.043328] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-19T20:37:19.384462] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T20:37:19.843260] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-19T20:37:20.249433] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T20:37:20.643294] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-19T20:37:20.826001] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T20:37:20.832310] [INFO ] [REMOTE ] PAY: Full fetch complete (53139 records). [2025-09-19T20:37:20.832411] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-19T20:37:21.210997] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-19T20:37:21.211085] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-19T20:37:21.211937] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-19T20:37:21.211999] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-19T20:37:21.213091] [DEBUG] [LOCAL ] PAY: Trimmed 53139 records to 38809 (keeping 200 days of data) [2025-09-19T20:37:21.441195] [DEBUG] [LOCAL ] PAY: Primary data saved (38809 records). [2025-09-19T20:37:21.441340] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-19T20:37:21.441439] [INFO ] [MAIN ] Update Progress: 1635/2372 symbols completed. PAY took 33.3s. Estimated remaining: 1h 37m 57s. Rate: 7.5 symbols/min [2025-09-19T20:37:21.473281] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-19T20:37:21.614842] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:37:21.667978] [DEBUG] [LOCAL ] PBF: Loaded 53482 existing records from primary storage. [2025-09-19T20:37:21.668126] [INFO ] [MAIN ] PBF: Loaded 53482 existing records. [2025-09-19T20:37:21.850515] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:37:21.850917] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-19T20:37:21.851065] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-19T20:37:21.861902] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-19T20:37:21.861987] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-19T20:37:21.973974] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T20:37:22.245544] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:37:22.245687] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-19T20:37:22.411766] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T20:37:23.043258] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-19T20:37:23.277934] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T20:37:23.843294] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-19T20:37:24.262313] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T20:37:24.643253] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-19T20:37:24.929252] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T20:37:25.443320] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-19T20:37:25.693067] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T20:37:26.243323] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-19T20:37:26.886969] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T20:37:27.043313] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-19T20:37:27.288774] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T20:37:27.843287] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-19T20:37:28.041333] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T20:37:28.643288] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-19T20:37:29.078709] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T20:37:29.443273] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-19T20:37:29.831726] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T20:37:30.243262] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-19T20:37:30.318278] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T20:37:30.324199] [INFO ] [REMOTE ] PAYC: Full fetch complete (52744 records). [2025-09-19T20:37:30.324361] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-19T20:37:30.736199] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-19T20:37:30.736281] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-19T20:37:30.737131] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-19T20:37:30.737194] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-19T20:37:30.738269] [DEBUG] [LOCAL ] PAYC: Trimmed 52744 records to 36966 (keeping 200 days of data) [2025-09-19T20:37:30.991603] [DEBUG] [LOCAL ] PAYC: Primary data saved (36966 records). [2025-09-19T20:37:30.991808] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-19T20:37:30.991932] [INFO ] [MAIN ] Update Progress: 1636/2372 symbols completed. PAYC took 36.4s. Estimated remaining: 1h 37m 49s. Rate: 7.5 symbols/min [2025-09-19T20:37:31.053151] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-19T20:37:31.176259] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:37:31.213790] [DEBUG] [LOCAL ] PBH: Loaded 31667 existing records from primary storage. [2025-09-19T20:37:31.213962] [INFO ] [MAIN ] PBH: Loaded 31667 existing records. [2025-09-19T20:37:31.391920] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:37:31.392464] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-19T20:37:31.392634] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-19T20:37:31.393685] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-19T20:37:31.393760] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-19T20:37:31.782070] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-19T20:37:31.803752] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:37:31.843274] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-19T20:37:32.338351] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T20:37:32.643285] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-19T20:37:32.915138] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T20:37:32.922198] [INFO ] [REMOTE ] PB: Full fetch complete (57637 records). [2025-09-19T20:37:32.922363] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-19T20:37:33.312585] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-19T20:37:33.312750] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-19T20:37:33.313743] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-19T20:37:33.313808] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-19T20:37:33.315186] [DEBUG] [LOCAL ] PB: Trimmed 57637 records to 41998 (keeping 200 days of data) [2025-09-19T20:37:33.443385] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-19T20:37:33.617037] [DEBUG] [LOCAL ] PB: Primary data saved (41998 records). [2025-09-19T20:37:33.617172] [INFO ] [MAIN ] PB: Full history saved. [2025-09-19T20:37:33.617349] [INFO ] [MAIN ] Update Progress: 1637/2372 symbols completed. PB took 27.7s. Estimated remaining: 1h 37m 39s. Rate: 7.5 symbols/min [2025-09-19T20:37:34.188190] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-19T20:37:34.243343] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-19T20:37:34.510093] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T20:37:34.572804] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T20:37:35.043274] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-19T20:37:35.843279] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-19T20:37:36.370545] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T20:37:36.566400] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T20:37:36.643331] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-19T20:37:37.443327] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-19T20:37:37.601503] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T20:37:37.609215] [INFO ] [REMOTE ] PBA: Full fetch complete (71541 records). [2025-09-19T20:37:37.609390] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-19T20:37:38.000615] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-19T20:37:38.000819] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-19T20:37:38.001842] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-19T20:37:38.001924] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-19T20:37:38.003529] [DEBUG] [LOCAL ] PBA: Trimmed 71541 records to 49752 (keeping 200 days of data) [2025-09-19T20:37:38.320547] [DEBUG] [LOCAL ] PBA: Primary data saved (49752 records). [2025-09-19T20:37:38.320783] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-19T20:37:38.321968] [INFO ] [MAIN ] Update Progress: 1638/2372 symbols completed. PBA took 32.2s. Estimated remaining: 1h 37m 30s. Rate: 7.5 symbols/min [2025-09-19T20:37:38.898283] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T20:37:38.904775] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-19T20:37:38.996600] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-19T20:37:39.043288] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-19T20:37:40.620509] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T20:37:40.626458] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-19T20:37:41.437581] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-19T20:37:41.448364] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-19T20:37:42.217746] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T20:37:42.224529] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-19T20:37:43.682929] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T20:37:43.695110] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-19T20:37:43.932762] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T20:37:43.940207] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-19T20:37:45.540438] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T20:37:45.546663] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-19T20:37:45.671251] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T20:37:45.682845] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-19T20:37:47.168272] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T20:37:47.175836] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-19T20:37:47.628265] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T20:37:47.637112] [INFO ] [REMOTE ] PBF: Full fetch complete (76549 records). [2025-09-19T20:37:47.637320] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-19T20:37:48.052528] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-19T20:37:48.052710] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-19T20:37:48.054417] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-19T20:37:48.054511] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-19T20:37:48.060493] [DEBUG] [LOCAL ] PBF: Trimmed 76549 records to 53870 (keeping 200 days of data) [2025-09-19T20:37:48.408755] [DEBUG] [LOCAL ] PBF: Primary data saved (53870 records). [2025-09-19T20:37:48.408897] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-19T20:37:48.409058] [INFO ] [MAIN ] Update Progress: 1639/2372 symbols completed. PBF took 27.0s. Estimated remaining: 1h 37m 23s. Rate: 7.5 symbols/min [2025-09-19T20:37:49.252858] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T20:37:49.262683] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-19T20:37:50.767883] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T20:37:50.776843] [INFO ] [REMOTE ] PBH: Full fetch complete (42622 records). [2025-09-19T20:37:50.777003] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-19T20:37:51.160998] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-19T20:37:51.161082] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-19T20:37:51.161870] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-19T20:37:51.161958] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-19T20:37:51.165002] [DEBUG] [LOCAL ] PBH: Trimmed 42622 records to 31950 (keeping 200 days of data) [2025-09-19T20:37:51.366868] [DEBUG] [LOCAL ] PBH: Primary data saved (31950 records). [2025-09-19T20:37:51.367003] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-19T20:37:51.367156] [INFO ] [MAIN ] Update Progress: 1640/2372 symbols completed. PBH took 20.4s. Estimated remaining: 1h 37m 12s. Rate: 7.5 symbols/min [2025-09-19T20:37:51.902028] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:37:52.002143] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:37:52.052256] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:37:52.087798] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:37:52.113602] [DEBUG] [LOCAL ] PCF: Loaded 8788 existing records from primary storage. [2025-09-19T20:37:52.113348] [DEBUG] [LOCAL ] PBT: Loaded 17706 existing records from primary storage. [2025-09-19T20:37:52.113893] [INFO ] [MAIN ] PBT: Loaded 17706 existing records. [2025-09-19T20:37:52.113973] [INFO ] [MAIN ] PCF: Loaded 8788 existing records. [2025-09-19T20:37:52.550883] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:37:52.551038] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:37:52.567200] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-19T20:37:52.568108] [DEBUG] [LOCAL ] PBR: Loaded 54104 existing records from primary storage. [2025-09-19T20:37:52.567310] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-19T20:37:52.568320] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-19T20:37:52.568451] [INFO ] [MAIN ] PBR: Loaded 54104 existing records. [2025-09-19T20:37:52.568515] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-19T20:37:52.569317] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-19T20:37:52.575509] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-19T20:37:52.569150] [DEBUG] [LOCAL ] PBI: Loaded 50493 existing records from primary storage. [2025-09-19T20:37:52.611531] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-19T20:37:52.611704] [INFO ] [MAIN ] PBI: Loaded 50493 existing records. [2025-09-19T20:37:52.655683] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-19T20:37:53.283601] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:37:53.328016] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:37:53.353356] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-19T20:37:53.369482] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-19T20:37:53.381067] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-19T20:37:53.399307] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-19T20:37:53.449663] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-19T20:37:53.490693] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-19T20:37:53.490612] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-19T20:37:53.508412] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-19T20:37:53.880996] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:37:53.944328] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-19T20:37:53.983089] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:37:54.004772] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-19T20:37:54.506831] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:37:54.526225] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-19T20:37:54.525972] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:37:54.527242] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-19T20:37:55.570801] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T20:37:55.574817] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-19T20:37:55.710435] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-19T20:37:55.717662] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-19T20:37:56.419285] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T20:37:56.430003] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-19T20:37:56.484546] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T20:37:56.490694] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-19T20:37:56.591630] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T20:37:56.594450] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-19T20:37:57.183216] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-19T20:37:57.194274] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-19T20:37:57.244903] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-19T20:37:57.248860] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-19T20:37:57.258255] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T20:37:57.261737] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-19T20:37:58.240225] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T20:37:58.242788] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-19T20:37:58.344089] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T20:37:58.353896] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-19T20:37:58.365881] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T20:37:58.370322] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-19T20:37:59.251081] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T20:37:59.253740] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-19T20:37:59.363267] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T20:37:59.584472] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-19T20:37:59.843252] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-19T20:37:59.911682] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-19T20:37:59.943489] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T20:38:00.643241] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-19T20:38:01.140955] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T20:38:01.443274] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-19T20:38:02.243270] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-19T20:38:02.483491] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T20:38:02.749008] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T20:38:03.043234] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-19T20:38:03.230859] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T20:38:03.843281] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-19T20:38:04.090755] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T20:38:04.643394] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-19T20:38:05.443325] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-19T20:38:06.164559] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T20:38:06.243210] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-19T20:38:06.431879] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T20:38:06.774696] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T20:38:07.043320] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-19T20:38:07.843252] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-19T20:38:08.327858] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T20:38:08.643260] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-19T20:38:08.892481] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T20:38:09.166847] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T20:38:09.284484] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-19T20:38:09.286853] [INFO ] [REMOTE ] PCF: Full fetch complete (14481 records). [2025-09-19T20:38:09.286928] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-19T20:38:09.452203] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-19T20:38:09.662259] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-19T20:38:09.662351] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-19T20:38:09.662703] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-19T20:38:09.662764] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-19T20:38:09.663269] [DEBUG] [LOCAL ] PCF: Trimmed 14481 records to 8854 (keeping 200 days of data) [2025-09-19T20:38:09.719857] [DEBUG] [LOCAL ] PCF: Primary data saved (8854 records). [2025-09-19T20:38:09.719991] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-19T20:38:09.720089] [INFO ] [MAIN ] Update Progress: 1641/2372 symbols completed. PCF took 18.3s. Estimated remaining: 1h 37m 9s. Rate: 7.5 symbols/min [2025-09-19T20:38:09.889699] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:38:09.890002] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-19T20:38:09.890056] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-19T20:38:09.890164] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-19T20:38:09.890202] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-19T20:38:09.890242] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-19T20:38:09.890273] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-19T20:38:10.249937] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:38:10.250163] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-19T20:38:10.939539] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T20:38:11.043267] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-19T20:38:11.843268] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-19T20:38:12.140622] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T20:38:12.643341] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-19T20:38:13.443268] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-19T20:38:13.530547] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T20:38:13.774963] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T20:38:13.778160] [INFO ] [REMOTE ] PBT: Full fetch complete (25331 records). [2025-09-19T20:38:13.778255] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-19T20:38:14.144951] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-19T20:38:14.145059] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-19T20:38:14.145771] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-19T20:38:14.145875] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-19T20:38:14.146994] [DEBUG] [LOCAL ] PBT: Trimmed 25331 records to 17804 (keeping 200 days of data) [2025-09-19T20:38:14.261411] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-19T20:38:14.269336] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-19T20:38:14.304185] [DEBUG] [LOCAL ] PBT: Primary data saved (17804 records). [2025-09-19T20:38:14.304300] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-19T20:38:14.304385] [INFO ] [MAIN ] Update Progress: 1642/2372 symbols completed. PBT took 22.9s. Estimated remaining: 1h 36m 60s. Rate: 7.5 symbols/min [2025-09-19T20:38:14.478595] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:38:14.487571] [DEBUG] [LOCAL ] PCM: Loaded 6869 existing records from primary storage. [2025-09-19T20:38:14.487700] [INFO ] [MAIN ] PCM: Loaded 6869 existing records. [2025-09-19T20:38:14.664715] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:38:14.665026] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-19T20:38:14.665081] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-19T20:38:14.665484] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-19T20:38:14.665548] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-19T20:38:15.021147] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:38:15.043255] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-19T20:38:15.352981] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T20:38:15.840416] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T20:38:15.843203] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-19T20:38:16.453167] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T20:38:16.643286] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-19T20:38:16.995553] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T20:38:17.443271] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-19T20:38:18.243282] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-19T20:38:18.601256] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T20:38:19.043314] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-19T20:38:19.212281] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T20:38:19.654197] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-19T20:38:19.843350] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-19T20:38:20.643278] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-19T20:38:21.022338] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T20:38:21.055630] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T20:38:21.066470] [INFO ] [REMOTE ] PBI: Full fetch complete (71926 records). [2025-09-19T20:38:21.066620] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-19T20:38:21.456238] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-19T20:38:21.452600] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-19T20:38:21.457255] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-19T20:38:21.458272] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-19T20:38:21.458443] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-19T20:38:21.459952] [DEBUG] [LOCAL ] PBI: Trimmed 71926 records to 50856 (keeping 200 days of data) [2025-09-19T20:38:21.779228] [DEBUG] [LOCAL ] PBI: Primary data saved (50856 records). [2025-09-19T20:38:21.779374] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-19T20:38:21.779463] [INFO ] [MAIN ] Update Progress: 1643/2372 symbols completed. PBI took 30.4s. Estimated remaining: 1h 36m 51s. Rate: 7.5 symbols/min [2025-09-19T20:38:21.950983] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:38:21.951230] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-09-19T20:38:21.951286] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-09-19T20:38:21.951432] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-19T20:38:21.951475] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-19T20:38:21.951515] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-09-19T20:38:21.951546] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-19T20:38:22.248359] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-19T20:38:22.306735] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:38:22.450101] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T20:38:23.043227] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-19T20:38:23.153249] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-19T20:38:23.843240] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-19T20:38:24.500541] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-19T20:38:24.582383] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T20:38:24.643307] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-19T20:38:25.443301] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-19T20:38:26.127389] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T20:38:26.243275] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-19T20:38:26.553447] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-09-19T20:38:27.043299] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-19T20:38:27.620165] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T20:38:27.649312] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T20:38:27.843263] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-19T20:38:28.643273] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-19T20:38:29.443303] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-19T20:38:29.575342] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T20:38:29.575073] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-19T20:38:30.021171] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T20:38:30.243246] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-19T20:38:30.317326] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-19T20:38:31.043242] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-19T20:38:31.419228] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T20:38:31.843278] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-19T20:38:32.643235] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-19T20:38:33.385676] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-19T20:38:33.414828] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T20:38:33.430041] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T20:38:33.443220] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-19T20:38:34.243277] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-19T20:38:34.418298] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T20:38:35.043318] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-19T20:38:35.613978] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T20:38:35.843270] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-19T20:38:36.058776] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T20:38:36.061087] [INFO ] [REMOTE ] PCM: Full fetch complete (10444 records). [2025-09-19T20:38:36.061174] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-19T20:38:36.449090] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-19T20:38:36.449177] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-19T20:38:36.449465] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-19T20:38:36.449528] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-19T20:38:36.450024] [DEBUG] [LOCAL ] PCM: Trimmed 10444 records to 6920 (keeping 200 days of data) [2025-09-19T20:38:36.490595] [DEBUG] [LOCAL ] PCM: Primary data saved (6920 records). [2025-09-19T20:38:36.490745] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-19T20:38:36.490839] [INFO ] [MAIN ] Update Progress: 1644/2372 symbols completed. PCM took 22.2s. Estimated remaining: 1h 36m 46s. Rate: 7.5 symbols/min [2025-09-19T20:38:36.646947] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-19T20:38:36.675235] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:38:36.721538] [DEBUG] [LOCAL ] PCOR: Loaded 48499 existing records from primary storage. [2025-09-19T20:38:36.721734] [INFO ] [MAIN ] PCOR: Loaded 48499 existing records. [2025-09-19T20:38:36.906607] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:38:36.906889] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-19T20:38:36.906949] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-19T20:38:36.908402] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-19T20:38:36.908464] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-19T20:38:37.273151] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:38:37.287811] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T20:38:37.443264] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-19T20:38:38.243240] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-19T20:38:38.949085] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T20:38:39.024119] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T20:38:39.043216] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-19T20:38:39.843271] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-19T20:38:40.643287] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-19T20:38:40.717594] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-19T20:38:41.279007] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T20:38:41.409263] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-19T20:38:41.443286] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-19T20:38:42.243265] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-19T20:38:42.371681] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T20:38:42.471637] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T20:38:42.476063] [INFO ] [REMOTE ] PCN: Full fetch complete (33770 records). [2025-09-19T20:38:42.476150] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-19T20:38:42.868386] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-19T20:38:42.868489] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-19T20:38:42.869388] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-19T20:38:42.869454] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-19T20:38:42.870548] [DEBUG] [LOCAL ] PCN: Trimmed 33770 records to 24489 (keeping 200 days of data) [2025-09-19T20:38:43.032344] [DEBUG] [LOCAL ] PCN: Primary data saved (24489 records). [2025-09-19T20:38:43.032489] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-19T20:38:43.032570] [INFO ] [MAIN ] Update Progress: 1645/2372 symbols completed. PCN took 21.3s. Estimated remaining: 1h 36m 38s. Rate: 7.5 symbols/min [2025-09-19T20:38:43.048405] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-19T20:38:43.216928] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:38:43.229499] [DEBUG] [LOCAL ] PCQ: Loaded 12179 existing records from primary storage. [2025-09-19T20:38:43.229612] [INFO ] [MAIN ] PCQ: Loaded 12179 existing records. [2025-09-19T20:38:43.423215] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:38:43.423603] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-19T20:38:43.423740] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-19T20:38:43.424330] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-19T20:38:43.424394] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-19T20:38:43.548021] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T20:38:43.595533] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-09-19T20:38:43.615634] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-19T20:38:43.634795] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:38:43.680102] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:38:43.700792] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:38:43.711999] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-19T20:38:43.717303] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-19T20:38:43.735766] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-19T20:38:43.738170] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-09-19T20:38:43.744040] [INFO ] [MAIN ] Update Progress: 1646/2372 symbols completed. PCG took 34.0s. Estimated remaining: 1h 36m 27s. Rate: 7.5 symbols/min [2025-09-19T20:38:43.858784] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-19T20:38:43.922178] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:38:44.030297] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:38:44.080786] [DEBUG] [LOCAL ] PD: Loaded 48098 existing records from primary storage. [2025-09-19T20:38:44.080976] [INFO ] [MAIN ] PD: Loaded 48098 existing records. [2025-09-19T20:38:44.256261] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:38:44.256545] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-19T20:38:44.256595] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-19T20:38:44.258048] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-19T20:38:44.258109] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-19T20:38:44.613462] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:38:44.643232] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-19T20:38:44.974501] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T20:38:45.443520] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-19T20:38:46.113238] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-19T20:38:46.122432] [INFO ] [REMOTE ] PBR: Full fetch complete (77777 records). [2025-09-19T20:38:46.122566] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-19T20:38:46.247406] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-19T20:38:46.556618] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-19T20:38:46.556779] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-19T20:38:46.557841] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-19T20:38:46.557917] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-19T20:38:46.585919] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T20:38:46.584409] [DEBUG] [LOCAL ] PBR: Trimmed 77777 records to 54493 (keeping 200 days of data) [2025-09-19T20:38:46.934958] [DEBUG] [LOCAL ] PBR: Primary data saved (54493 records). [2025-09-19T20:38:46.935151] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-19T20:38:46.935255] [INFO ] [MAIN ] Update Progress: 1647/2372 symbols completed. PBR took 55.5s. Estimated remaining: 1h 36m 17s. Rate: 7.5 symbols/min [2025-09-19T20:38:47.048435] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-19T20:38:47.125061] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:38:47.135276] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-19T20:38:47.135423] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-19T20:38:47.136425] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T20:38:47.136622] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-19T20:38:47.136868] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-19T20:38:47.141142] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-19T20:38:47.141196] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-19T20:38:47.537327] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:38:47.843270] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-19T20:38:48.186126] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T20:38:48.643253] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-19T20:38:48.884335] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T20:38:48.900381] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T20:38:49.443264] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-19T20:38:50.243273] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-19T20:38:50.724544] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T20:38:51.043268] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-19T20:38:51.132080] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T20:38:51.204215] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T20:38:51.439104] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-19T20:38:51.843274] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-19T20:38:52.643331] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-19T20:38:53.443264] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-19T20:38:53.760429] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-19T20:38:53.807227] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T20:38:53.876418] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T20:38:54.243291] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-19T20:38:55.043308] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-19T20:38:55.843259] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-19T20:38:56.080426] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T20:38:56.280352] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T20:38:56.643276] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-19T20:38:57.443299] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-19T20:38:57.615529] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T20:38:57.783991] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T20:38:58.243264] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-19T20:38:59.043279] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-19T20:38:59.257208] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T20:38:59.429421] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T20:38:59.843260] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-19T20:39:00.554102] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T20:39:00.643244] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-19T20:39:00.774690] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T20:39:01.443259] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-19T20:39:02.243274] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-19T20:39:02.726566] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T20:39:03.043300] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-19T20:39:03.843269] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-19T20:39:04.287924] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T20:39:04.609432] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (3.17 seconds). [2025-09-19T20:39:04.626950] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T20:39:04.643215] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-19T20:39:05.260237] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T20:39:05.262755] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T20:39:05.443279] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-19T20:39:06.025380] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T20:39:06.243262] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-19T20:39:07.043312] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-19T20:39:07.747691] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T20:39:07.843281] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-19T20:39:08.311465] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-19T20:39:08.346132] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T20:39:08.643284] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-19T20:39:09.133923] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-19T20:39:09.443276] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-19T20:39:10.243328] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-19T20:39:10.744198] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T20:39:11.043282] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-19T20:39:11.531902] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T20:39:11.843315] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-19T20:39:12.176088] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-19T20:39:12.177304] [INFO ] [REMOTE ] PDCC: Full fetch complete (1318 records). [2025-09-19T20:39:12.177745] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-19T20:39:12.243143] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T20:39:12.307845] [INFO ] [REMOTE ] PCQ: Full fetch complete (17507 records). [2025-09-19T20:39:12.320996] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-19T20:39:12.650689] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-19T20:39:12.680750] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-19T20:39:12.726937] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:39:12.727286] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:39:12.727387] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-19T20:39:12.744621] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-19T20:39:12.759488] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-19T20:39:12.838190] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-19T20:39:12.857828] [INFO ] [MAIN ] Update Progress: 1648/2372 symbols completed. PDCC took 25.9s. Estimated remaining: 1h 36m 16s. Rate: 7.5 symbols/min [2025-09-19T20:39:13.145971] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-19T20:39:13.168240] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-19T20:39:13.168722] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-19T20:39:13.168801] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-19T20:39:13.168180] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:39:13.169820] [DEBUG] [LOCAL ] PCQ: Trimmed 17507 records to 12264 (keeping 200 days of data) [2025-09-19T20:39:13.247638] [DEBUG] [LOCAL ] PCQ: Primary data saved (12264 records). [2025-09-19T20:39:13.247820] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-19T20:39:13.247922] [INFO ] [MAIN ] Update Progress: 1649/2372 symbols completed. PCQ took 30.2s. Estimated remaining: 1h 36m 5s. Rate: 7.5 symbols/min [2025-09-19T20:39:13.449938] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:39:13.446011] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-19T20:39:13.468013] [DEBUG] [LOCAL ] PDI: Loaded 50645 existing records from primary storage. [2025-09-19T20:39:13.468320] [INFO ] [MAIN ] PDI: Loaded 50645 existing records. [2025-09-19T20:39:13.679453] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:39:13.691170] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-19T20:39:13.691318] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-19T20:39:13.691988] [DEBUG] [LOCAL ] PDM: Loaded 40156 existing records from primary storage. [2025-09-19T20:39:13.692146] [INFO ] [MAIN ] PDM: Loaded 40156 existing records. [2025-09-19T20:39:13.723598] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-19T20:39:13.739698] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-19T20:39:14.039452] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:39:14.046116] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-19T20:39:14.047016] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-19T20:39:14.064500] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-19T20:39:14.066396] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-19T20:39:14.455977] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:39:14.496935] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-19T20:39:14.639389] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:39:14.659243] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T20:39:14.667434] [INFO ] [REMOTE ] PCOR: Full fetch complete (69726 records). [2025-09-19T20:39:14.667575] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-19T20:39:15.050909] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-19T20:39:15.051619] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-19T20:39:15.052568] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-19T20:39:15.053683] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-19T20:39:15.053852] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-19T20:39:15.055445] [DEBUG] [LOCAL ] PCOR: Trimmed 69726 records to 48854 (keeping 200 days of data) [2025-09-19T20:39:15.358059] [DEBUG] [LOCAL ] PCOR: Primary data saved (48854 records). [2025-09-19T20:39:15.358258] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-19T20:39:15.358395] [INFO ] [MAIN ] Update Progress: 1650/2372 symbols completed. PCOR took 38.9s. Estimated remaining: 1h 35m 55s. Rate: 7.5 symbols/min [2025-09-19T20:39:15.531782] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:39:15.569078] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-19T20:39:15.605994] [DEBUG] [LOCAL ] PDO: Loaded 32133 existing records from primary storage. [2025-09-19T20:39:15.606176] [INFO ] [MAIN ] PDO: Loaded 32133 existing records. [2025-09-19T20:39:15.784964] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:39:15.785220] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-19T20:39:15.785269] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-19T20:39:15.786079] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-19T20:39:15.786140] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-19T20:39:15.850962] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-19T20:39:16.166230] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:39:16.643291] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-19T20:39:17.685593] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-19T20:39:17.696207] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-19T20:39:17.906758] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T20:39:17.914766] [INFO ] [REMOTE ] PD: Full fetch complete (67460 records). [2025-09-19T20:39:17.914943] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-19T20:39:18.324388] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-19T20:39:18.324538] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-19T20:39:18.325545] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-19T20:39:18.325744] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-19T20:39:18.348122] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (3.30 seconds). [2025-09-19T20:39:18.356051] [DEBUG] [LOCAL ] PD: Trimmed 67460 records to 48486 (keeping 200 days of data) [2025-09-19T20:39:18.356761] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-19T20:39:18.656779] [DEBUG] [LOCAL ] PD: Primary data saved (48486 records). [2025-09-19T20:39:18.656957] [INFO ] [MAIN ] PD: Full history saved. [2025-09-19T20:39:18.657090] [INFO ] [MAIN ] Update Progress: 1651/2372 symbols completed. PD took 34.9s. Estimated remaining: 1h 35m 45s. Rate: 7.5 symbols/min [2025-09-19T20:39:18.864839] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T20:39:18.863457] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:39:18.892099] [DEBUG] [LOCAL ] PDS: Loaded 18817 existing records from primary storage. [2025-09-19T20:39:18.892246] [INFO ] [MAIN ] PDS: Loaded 18817 existing records. [2025-09-19T20:39:19.048834] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-19T20:39:19.071063] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:39:19.071247] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-19T20:39:19.071292] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-19T20:39:19.071922] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-19T20:39:19.071985] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-19T20:39:19.432128] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:39:19.467591] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-19T20:39:19.843287] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-19T20:39:20.197212] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T20:39:20.643287] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-19T20:39:20.868462] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T20:39:21.130225] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T20:39:21.443324] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-19T20:39:22.243282] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-19T20:39:22.452326] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T20:39:23.043294] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-19T20:39:23.399548] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T20:39:23.484786] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T20:39:23.843294] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-19T20:39:24.643287] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-19T20:39:24.746800] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T20:39:25.452571] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-19T20:39:25.458296] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T20:39:25.921461] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T20:39:26.243283] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-19T20:39:27.043286] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-19T20:39:27.171398] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T20:39:27.843307] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-19T20:39:28.230841] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T20:39:28.464083] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T20:39:28.643265] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-19T20:39:29.443263] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-19T20:39:29.624891] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T20:39:30.243276] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-19T20:39:30.415781] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-19T20:39:30.823551] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T20:39:31.043325] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-19T20:39:31.255792] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T20:39:31.843313] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-19T20:39:32.643341] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-19T20:39:32.797281] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T20:39:33.443275] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-19T20:39:34.231310] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T20:39:34.243218] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-19T20:39:34.459758] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-09-19T20:39:34.981477] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T20:39:35.043224] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-19T20:39:35.843312] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-19T20:39:35.900282] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T20:39:36.279720] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T20:39:36.643290] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-19T20:39:37.443256] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-19T20:39:37.986877] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T20:39:38.243271] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-19T20:39:38.414921] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T20:39:39.043238] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-19T20:39:39.064729] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T20:39:39.843283] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-19T20:39:40.221935] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T20:39:40.326392] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T20:39:40.643323] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-19T20:39:41.342797] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T20:39:41.348951] [INFO ] [REMOTE ] PDO: Full fetch complete (48296 records). [2025-09-19T20:39:41.349107] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-19T20:39:41.449263] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-19T20:39:41.734568] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-19T20:39:41.734702] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-19T20:39:41.735571] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-19T20:39:41.735621] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-19T20:39:41.736877] [DEBUG] [LOCAL ] PDO: Trimmed 48296 records to 32308 (keeping 200 days of data) [2025-09-19T20:39:41.942335] [DEBUG] [LOCAL ] PDO: Primary data saved (32308 records). [2025-09-19T20:39:41.942491] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-19T20:39:41.942598] [INFO ] [MAIN ] Update Progress: 1652/2372 symbols completed. PDO took 26.6s. Estimated remaining: 1h 35m 43s. Rate: 7.5 symbols/min [2025-09-19T20:39:42.119825] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:39:42.132993] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T20:39:42.153905] [DEBUG] [LOCAL ] PDT: Loaded 17689 existing records from primary storage. [2025-09-19T20:39:42.154034] [INFO ] [MAIN ] PDT: Loaded 17689 existing records. [2025-09-19T20:39:42.248381] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-19T20:39:42.340445] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:39:42.340779] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-19T20:39:42.340842] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-19T20:39:42.341458] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-19T20:39:42.341528] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-19T20:39:42.716613] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:39:43.043234] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-19T20:39:43.562786] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T20:39:43.843273] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-19T20:39:43.887531] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-19T20:39:44.616358] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T20:39:44.622258] [INFO ] [REMOTE ] PDM: Full fetch complete (57270 records). [2025-09-19T20:39:44.622380] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-19T20:39:44.653521] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-19T20:39:45.028960] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-19T20:39:45.029063] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-19T20:39:45.030102] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-19T20:39:45.030172] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-19T20:39:45.031584] [DEBUG] [LOCAL ] PDM: Trimmed 57270 records to 40500 (keeping 200 days of data) [2025-09-19T20:39:45.158722] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T20:39:45.283747] [DEBUG] [LOCAL ] PDM: Primary data saved (40500 records). [2025-09-19T20:39:45.283885] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-19T20:39:45.283970] [INFO ] [MAIN ] Update Progress: 1653/2372 symbols completed. PDM took 32.0s. Estimated remaining: 1h 35m 33s. Rate: 7.5 symbols/min [2025-09-19T20:39:45.446191] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-19T20:39:45.466366] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:39:45.483918] [DEBUG] [LOCAL ] PDX: Loaded 14620 existing records from primary storage. [2025-09-19T20:39:45.484047] [INFO ] [MAIN ] PDX: Loaded 14620 existing records. [2025-09-19T20:39:45.657745] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:39:45.658015] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-19T20:39:45.658066] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-19T20:39:45.658756] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-19T20:39:45.658818] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-19T20:39:45.945553] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T20:39:46.037923] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:39:46.243223] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-19T20:39:46.694113] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T20:39:47.043296] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-19T20:39:47.205520] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T20:39:47.843258] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-19T20:39:48.643300] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-19T20:39:49.302433] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T20:39:49.443234] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-19T20:39:49.520844] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T20:39:49.779717] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T20:39:49.782500] [INFO ] [REMOTE ] PDS: Full fetch complete (25703 records). [2025-09-19T20:39:49.782589] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-19T20:39:50.166065] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-19T20:39:50.166143] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-19T20:39:50.166671] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-19T20:39:50.166730] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-19T20:39:50.167372] [DEBUG] [LOCAL ] PDS: Trimmed 25703 records to 18902 (keeping 200 days of data) [2025-09-19T20:39:50.253331] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-19T20:39:50.286997] [DEBUG] [LOCAL ] PDS: Primary data saved (18902 records). [2025-09-19T20:39:50.287174] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-19T20:39:50.287350] [INFO ] [MAIN ] Update Progress: 1654/2372 symbols completed. PDS took 31.6s. Estimated remaining: 1h 35m 24s. Rate: 7.5 symbols/min [2025-09-19T20:39:50.507799] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:39:50.521718] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T20:39:50.576078] [DEBUG] [LOCAL ] PEB: Loaded 51110 existing records from primary storage. [2025-09-19T20:39:50.576246] [INFO ] [MAIN ] PEB: Loaded 51110 existing records. [2025-09-19T20:39:50.758216] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:39:50.758506] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-19T20:39:50.758559] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-19T20:39:50.759635] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-19T20:39:50.759733] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-19T20:39:51.046734] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-19T20:39:51.131496] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:39:51.843230] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-19T20:39:52.305571] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T20:39:52.330537] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T20:39:52.342040] [INFO ] [REMOTE ] PDI: Full fetch complete (73103 records). [2025-09-19T20:39:52.342178] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-19T20:39:52.647689] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-19T20:39:52.750486] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-19T20:39:52.750580] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-19T20:39:52.751660] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-19T20:39:52.751745] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-19T20:39:52.753855] [DEBUG] [LOCAL ] PDI: Trimmed 73103 records to 51004 (keeping 200 days of data) [2025-09-19T20:39:53.078448] [DEBUG] [LOCAL ] PDI: Primary data saved (51004 records). [2025-09-19T20:39:53.078585] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-19T20:39:53.079676] [INFO ] [MAIN ] Update Progress: 1655/2372 symbols completed. PDI took 40.2s. Estimated remaining: 1h 35m 14s. Rate: 7.5 symbols/min [2025-09-19T20:39:53.248149] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:39:53.248345] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-19T20:39:53.248399] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-19T20:39:53.248551] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-19T20:39:53.248593] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-19T20:39:53.248634] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-19T20:39:53.248725] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-19T20:39:53.471280] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-19T20:39:53.625485] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:39:54.013287] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T20:39:54.063706] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T20:39:54.215284] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T20:39:54.243217] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-19T20:39:55.043274] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-19T20:39:55.444730] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T20:39:55.843303] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-19T20:39:56.643234] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-19T20:39:57.063690] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T20:39:57.103919] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T20:39:57.443266] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-19T20:39:58.035027] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T20:39:58.243259] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-19T20:39:58.696806] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T20:39:59.043230] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-19T20:39:59.458723] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T20:39:59.843263] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-19T20:40:00.643278] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-19T20:40:00.856304] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T20:40:01.443278] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-19T20:40:01.717095] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T20:40:01.938134] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T20:40:02.243290] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-19T20:40:03.043303] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-19T20:40:03.556314] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T20:40:03.589783] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T20:40:03.843305] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-19T20:40:04.643318] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-19T20:40:05.038297] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T20:40:05.240798] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T20:40:05.443289] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-19T20:40:05.910068] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T20:40:06.243265] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-19T20:40:07.043253] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-19T20:40:07.366717] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T20:40:07.369336] [INFO ] [REMOTE ] PDX: Full fetch complete (24826 records). [2025-09-19T20:40:07.369456] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-19T20:40:07.750491] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-19T20:40:07.750661] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-19T20:40:07.751312] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-19T20:40:07.751470] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-19T20:40:07.753140] [DEBUG] [LOCAL ] PDX: Trimmed 24826 records to 14674 (keeping 200 days of data) [2025-09-19T20:40:07.863076] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-19T20:40:07.859197] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-19T20:40:07.902973] [DEBUG] [LOCAL ] PDX: Primary data saved (14674 records). [2025-09-19T20:40:07.903112] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-19T20:40:07.903265] [INFO ] [MAIN ] Update Progress: 1656/2372 symbols completed. PDX took 22.6s. Estimated remaining: 1h 35m 9s. Rate: 7.5 symbols/min [2025-09-19T20:40:08.072302] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:40:08.109906] [DEBUG] [LOCAL ] PEN: Loaded 30969 existing records from primary storage. [2025-09-19T20:40:08.110048] [INFO ] [MAIN ] PEN: Loaded 30969 existing records. [2025-09-19T20:40:08.286914] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:40:08.287186] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-19T20:40:08.287237] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-19T20:40:08.288061] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-19T20:40:08.288136] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-19T20:40:08.646399] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-19T20:40:08.669861] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:40:09.178583] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T20:40:09.217364] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T20:40:09.443276] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-19T20:40:10.243254] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-19T20:40:10.699774] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T20:40:10.797976] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-19T20:40:11.043284] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-19T20:40:11.843281] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-19T20:40:12.173925] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T20:40:12.235424] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T20:40:12.239610] [INFO ] [REMOTE ] PDT: Full fetch complete (25174 records). [2025-09-19T20:40:12.239779] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-19T20:40:12.622414] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-19T20:40:12.622555] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-19T20:40:12.623181] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-19T20:40:12.623258] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-19T20:40:12.624029] [DEBUG] [LOCAL ] PDT: Trimmed 25174 records to 17765 (keeping 200 days of data) [2025-09-19T20:40:12.684263] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-19T20:40:12.748818] [DEBUG] [LOCAL ] PDT: Primary data saved (17765 records). [2025-09-19T20:40:12.748948] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-19T20:40:12.749032] [INFO ] [MAIN ] Update Progress: 1657/2372 symbols completed. PDT took 30.8s. Estimated remaining: 1h 34m 60s. Rate: 7.5 symbols/min [2025-09-19T20:40:12.919716] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:40:12.931292] [DEBUG] [LOCAL ] PEO: Loaded 10954 existing records from primary storage. [2025-09-19T20:40:12.931403] [INFO ] [MAIN ] PEO: Loaded 10954 existing records. [2025-09-19T20:40:13.108482] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:40:13.108811] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-19T20:40:13.108863] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-19T20:40:13.109331] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-19T20:40:13.109392] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-19T20:40:13.452313] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-19T20:40:13.483356] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:40:14.057556] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-19T20:40:14.243272] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-19T20:40:14.768363] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T20:40:14.795712] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T20:40:15.043317] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-19T20:40:15.843260] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-19T20:40:16.270569] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T20:40:16.643253] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-19T20:40:16.712384] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T20:40:17.123804] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T20:40:17.443315] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-19T20:40:18.243299] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-19T20:40:18.431825] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T20:40:18.695864] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T20:40:19.043279] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-19T20:40:19.523780] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T20:40:19.843260] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-19T20:40:20.643236] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-19T20:40:20.793975] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T20:40:20.863368] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T20:40:21.443268] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-19T20:40:22.243350] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-19T20:40:22.371943] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T20:40:23.043304] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-19T20:40:23.509738] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T20:40:23.528619] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T20:40:23.843325] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-19T20:40:24.643278] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-19T20:40:24.671932] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T20:40:25.443271] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-19T20:40:25.733520] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T20:40:25.740916] [INFO ] [REMOTE ] PEB: Full fetch complete (72795 records). [2025-09-19T20:40:25.741036] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-19T20:40:25.954854] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T20:40:26.157243] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-19T20:40:26.157344] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-19T20:40:26.158331] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-19T20:40:26.158394] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-19T20:40:26.160830] [DEBUG] [LOCAL ] PEB: Trimmed 72795 records to 51497 (keeping 200 days of data) [2025-09-19T20:40:26.258608] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-19T20:40:26.484883] [DEBUG] [LOCAL ] PEB: Primary data saved (51497 records). [2025-09-19T20:40:26.485030] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-19T20:40:26.485148] [INFO ] [MAIN ] Update Progress: 1658/2372 symbols completed. PEB took 36.2s. Estimated remaining: 1h 34m 54s. Rate: 7.5 symbols/min [2025-09-19T20:40:26.657114] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:40:26.675993] [DEBUG] [LOCAL ] PERF: Loaded 14196 existing records from primary storage. [2025-09-19T20:40:26.676133] [INFO ] [MAIN ] PERF: Loaded 14196 existing records. [2025-09-19T20:40:26.857709] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:40:26.858018] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-19T20:40:26.858070] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-19T20:40:26.858756] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-19T20:40:26.858816] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-19T20:40:27.057749] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-19T20:40:27.220834] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:40:27.264392] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T20:40:27.264815] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T20:40:27.843264] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-19T20:40:28.643281] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-19T20:40:28.944016] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T20:40:29.159345] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T20:40:29.319187] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-19T20:40:29.443261] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-19T20:40:30.243317] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-19T20:40:30.575213] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T20:40:31.043272] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-19T20:40:31.250727] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T20:40:31.258915] [INFO ] [REMOTE ] PEG: Full fetch complete (76280 records). [2025-09-19T20:40:31.259115] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-19T20:40:31.260130] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:40:31.260245] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:40:31.260294] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:40:31.260337] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-19T20:40:31.260401] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-19T20:40:31.260452] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-19T20:40:31.260543] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-09-19T20:40:31.260663] [INFO ] [MAIN ] Update Progress: 1659/2372 symbols completed. PEG took 38.2s. Estimated remaining: 1h 34m 45s. Rate: 7.5 symbols/min [2025-09-19T20:40:31.442957] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:40:31.443172] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-19T20:40:31.443211] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-19T20:40:31.443437] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-19T20:40:31.443492] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-19T20:40:31.443537] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-19T20:40:31.443571] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-19T20:40:31.812985] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:40:31.843223] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-19T20:40:32.141558] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:40:32.141909] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-19T20:40:32.643255] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-19T20:40:32.889326] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T20:40:33.217544] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T20:40:33.443304] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-19T20:40:34.243261] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-19T20:40:34.480009] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T20:40:34.482105] [INFO ] [REMOTE ] PEO: Full fetch complete (16397 records). [2025-09-19T20:40:34.482180] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-19T20:40:34.561942] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:40:34.588148] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-19T20:40:34.869569] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-19T20:40:34.869696] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-19T20:40:34.870105] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-19T20:40:34.870163] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-19T20:40:34.870842] [DEBUG] [LOCAL ] PEO: Trimmed 16397 records to 11030 (keeping 200 days of data) [2025-09-19T20:40:34.939122] [DEBUG] [LOCAL ] PEO: Primary data saved (11030 records). [2025-09-19T20:40:34.939282] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-19T20:40:34.939387] [INFO ] [MAIN ] Update Progress: 1660/2372 symbols completed. PEO took 22.2s. Estimated remaining: 1h 34m 35s. Rate: 7.5 symbols/min [2025-09-19T20:40:35.043247] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-19T20:40:35.116078] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:40:35.123294] [DEBUG] [LOCAL ] PFD: Loaded 5191 existing records from primary storage. [2025-09-19T20:40:35.123436] [INFO ] [MAIN ] PFD: Loaded 5191 existing records. [2025-09-19T20:40:35.303275] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:40:35.303563] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-19T20:40:35.303616] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-19T20:40:35.303970] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-19T20:40:35.304029] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-19T20:40:35.671778] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:40:35.843272] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-19T20:40:36.643317] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-19T20:40:36.673062] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T20:40:37.202180] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:40:37.202520] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-19T20:40:37.246892] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T20:40:37.443266] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-19T20:40:38.243301] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-19T20:40:38.477036] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T20:40:39.043295] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-19T20:40:39.297314] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T20:40:39.362054] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:40:39.362607] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-19T20:40:39.843347] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-19T20:40:40.137456] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:40:40.137856] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-19T20:40:40.643246] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-19T20:40:41.443313] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-19T20:40:41.735874] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:40:41.736146] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-19T20:40:42.243307] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-19T20:40:42.285816] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T20:40:42.546426] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:40:42.546791] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-19T20:40:43.043312] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-19T20:40:43.843249] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-19T20:40:44.245818] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-19T20:40:44.643283] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-19T20:40:45.225854] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-19T20:40:45.443265] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-19T20:40:45.767145] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T20:40:46.243264] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-19T20:40:46.322267] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T20:40:47.043313] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-19T20:40:47.843225] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-19T20:40:47.848075] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T20:40:48.214052] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T20:40:48.643282] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-19T20:40:48.812188] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T20:40:49.443320] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-19T20:40:49.886049] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T20:40:49.890901] [INFO ] [REMOTE ] PEN: Full fetch complete (43991 records). [2025-09-19T20:40:49.891055] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-19T20:40:50.261887] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-19T20:40:50.279761] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-19T20:40:50.279854] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-19T20:40:50.280793] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-19T20:40:50.281018] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-19T20:40:50.282171] [DEBUG] [LOCAL ] PEN: Trimmed 43991 records to 31122 (keeping 200 days of data) [2025-09-19T20:40:50.498784] [DEBUG] [LOCAL ] PEN: Primary data saved (31122 records). [2025-09-19T20:40:50.498935] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-19T20:40:50.499025] [INFO ] [MAIN ] Update Progress: 1661/2372 symbols completed. PEN took 42.6s. Estimated remaining: 1h 34m 30s. Rate: 7.5 symbols/min [2025-09-19T20:40:50.681520] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:40:50.681765] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-19T20:40:50.681821] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-19T20:40:50.681962] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-19T20:40:50.682016] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-19T20:40:50.682083] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-19T20:40:50.682117] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-19T20:40:51.051638] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-19T20:40:51.077297] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:40:51.141684] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T20:40:51.153295] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T20:40:51.154101] [INFO ] [REMOTE ] PEW: Full fetch complete (14918 records). [2025-09-19T20:40:51.156509] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-19T20:40:51.339458] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 47 unique days, need 200 days [2025-09-19T20:40:51.339788] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:40:51.339861] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:40:51.339932] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-19T20:40:51.339996] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-19T20:40:51.340032] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-19T20:40:51.340071] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-19T20:40:51.340156] [INFO ] [MAIN ] Update Progress: 1662/2372 symbols completed. PEW took 20.1s. Estimated remaining: 1h 34m 19s. Rate: 7.5 symbols/min [2025-09-19T20:40:51.507789] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:40:51.562771] [DEBUG] [LOCAL ] PFGC: Loaded 47366 existing records from primary storage. [2025-09-19T20:40:51.562952] [INFO ] [MAIN ] PFGC: Loaded 47366 existing records. [2025-09-19T20:40:51.752828] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:40:51.753093] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-19T20:40:51.753151] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-19T20:40:51.754633] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-19T20:40:51.754719] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-19T20:40:51.851603] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-19T20:40:52.107921] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:40:52.172891] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T20:40:52.643266] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-19T20:40:53.395823] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T20:40:53.443229] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-19T20:40:54.243239] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-19T20:40:55.040360] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T20:40:55.044704] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-19T20:40:55.045123] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-19T20:40:55.103120] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T20:40:55.843235] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-19T20:40:56.252000] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T20:40:56.643275] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-19T20:40:57.443268] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-19T20:40:57.456009] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T20:40:58.243303] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-19T20:40:58.828403] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.99 seconds). [2025-09-19T20:40:59.043322] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-19T20:40:59.200723] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T20:40:59.202431] [INFO ] [REMOTE ] PFD: Full fetch complete (7383 records). [2025-09-19T20:40:59.202504] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-19T20:40:59.488791] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T20:40:59.603451] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-19T20:40:59.603543] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-19T20:40:59.603817] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-19T20:40:59.603878] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-19T20:40:59.604290] [DEBUG] [LOCAL ] PFD: Trimmed 7383 records to 5232 (keeping 200 days of data) [2025-09-19T20:40:59.635572] [DEBUG] [LOCAL ] PFD: Primary data saved (5232 records). [2025-09-19T20:40:59.635698] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-19T20:40:59.635793] [INFO ] [MAIN ] Update Progress: 1663/2372 symbols completed. PFD took 24.7s. Estimated remaining: 1h 34m 11s. Rate: 7.5 symbols/min [2025-09-19T20:40:59.805301] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:40:59.814388] [DEBUG] [LOCAL ] PFH: Loaded 6987 existing records from primary storage. [2025-09-19T20:40:59.814514] [INFO ] [MAIN ] PFH: Loaded 6987 existing records. [2025-09-19T20:40:59.848420] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-19T20:40:59.998298] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:40:59.998625] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-19T20:40:59.998709] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-19T20:40:59.999057] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-19T20:40:59.999116] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-19T20:41:00.349432] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:41:00.643259] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-19T20:41:01.443289] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-19T20:41:01.742083] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T20:41:01.788353] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-19T20:41:01.812159] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-19T20:41:02.243290] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-19T20:41:02.720315] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T20:41:03.043325] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-19T20:41:03.247540] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T20:41:03.843253] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-19T20:41:04.213556] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T20:41:04.643280] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-19T20:41:04.662077] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-19T20:41:05.443264] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-19T20:41:06.243304] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-19T20:41:06.823628] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T20:41:06.845135] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T20:41:07.043288] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-19T20:41:07.843268] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-19T20:41:08.009433] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T20:41:08.643302] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-19T20:41:09.244917] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T20:41:09.246871] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (3.00 seconds). [2025-09-19T20:41:09.260222] [INFO ] [REMOTE ] PERF: Full fetch complete (22006 records). [2025-09-19T20:41:09.260997] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-19T20:41:09.448345] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-19T20:41:09.637927] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-19T20:41:09.638027] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-19T20:41:09.638693] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-19T20:41:09.638755] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-19T20:41:09.639343] [DEBUG] [LOCAL ] PERF: Trimmed 22006 records to 14289 (keeping 200 days of data) [2025-09-19T20:41:09.720982] [DEBUG] [LOCAL ] PERF: Primary data saved (14289 records). [2025-09-19T20:41:09.721118] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-19T20:41:09.721207] [INFO ] [MAIN ] Update Progress: 1664/2372 symbols completed. PERF took 43.2s. Estimated remaining: 1h 34m 4s. Rate: 7.5 symbols/min [2025-09-19T20:41:09.889567] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:41:09.904186] [DEBUG] [LOCAL ] PFL: Loaded 13911 existing records from primary storage. [2025-09-19T20:41:09.904987] [INFO ] [MAIN ] PFL: Loaded 13911 existing records. [2025-09-19T20:41:10.081271] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:41:10.081545] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-19T20:41:10.081593] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-19T20:41:10.082132] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-19T20:41:10.082193] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-19T20:41:10.254399] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-19T20:41:10.452592] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:41:10.572441] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T20:41:10.718231] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T20:41:11.043317] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-19T20:41:11.843344] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-19T20:41:12.520912] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T20:41:12.643276] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-19T20:41:13.388867] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (3.13 seconds). [2025-09-19T20:41:13.443213] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-19T20:41:13.501845] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T20:41:13.679771] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T20:41:14.243291] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-19T20:41:15.043340] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-19T20:41:15.843289] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-19T20:41:15.963117] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T20:41:16.245926] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T20:41:16.558288] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-19T20:41:16.643339] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-19T20:41:16.826154] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T20:41:17.443331] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-19T20:41:18.243317] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-19T20:41:19.043308] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-19T20:41:19.424544] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T20:41:19.488419] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-09-19T20:41:19.531547] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T20:41:19.583792] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T20:41:19.843269] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-19T20:41:20.643296] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-19T20:41:20.773485] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T20:41:21.443285] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-19T20:41:22.243301] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-19T20:41:22.582565] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T20:41:22.691299] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-19T20:41:22.693337] [INFO ] [REMOTE ] PFH: Full fetch complete (10739 records). [2025-09-19T20:41:22.693566] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-19T20:41:23.058464] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-19T20:41:23.076369] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-19T20:41:23.076508] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-19T20:41:23.076922] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-19T20:41:23.076996] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-19T20:41:23.078726] [DEBUG] [LOCAL ] PFH: Trimmed 10739 records to 7016 (keeping 200 days of data) [2025-09-19T20:41:23.122094] [DEBUG] [LOCAL ] PFH: Primary data saved (7016 records). [2025-09-19T20:41:23.122231] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-19T20:41:23.122345] [INFO ] [MAIN ] Update Progress: 1665/2372 symbols completed. PFH took 23.5s. Estimated remaining: 1h 33m 59s. Rate: 7.5 symbols/min [2025-09-19T20:41:23.295022] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:41:23.340156] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-19T20:41:23.394906] [DEBUG] [LOCAL ] PFLT: Loaded 43987 existing records from primary storage. [2025-09-19T20:41:23.395061] [INFO ] [MAIN ] PFLT: Loaded 43987 existing records. [2025-09-19T20:41:23.568475] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:41:23.568765] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-19T20:41:23.568821] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-19T20:41:23.570196] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-19T20:41:23.570258] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-19T20:41:23.852072] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-19T20:41:23.939623] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:41:23.953109] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T20:41:24.643333] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-19T20:41:25.443270] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-19T20:41:25.827250] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T20:41:26.243280] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-19T20:41:26.451304] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T20:41:26.629215] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T20:41:27.043283] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-19T20:41:27.843298] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-19T20:41:28.643303] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-19T20:41:28.850121] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-19T20:41:29.126666] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T20:41:29.159280] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T20:41:29.166875] [INFO ] [REMOTE ] PFGC: Full fetch complete (67237 records). [2025-09-19T20:41:29.167058] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-19T20:41:29.361445] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T20:41:29.450509] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-19T20:41:29.591798] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-19T20:41:29.591896] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-19T20:41:29.593013] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-19T20:41:29.593087] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-19T20:41:29.594864] [DEBUG] [LOCAL ] PFGC: Trimmed 67237 records to 47747 (keeping 200 days of data) [2025-09-19T20:41:29.886847] [DEBUG] [LOCAL ] PFGC: Primary data saved (47747 records). [2025-09-19T20:41:29.886993] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-19T20:41:29.887501] [INFO ] [MAIN ] Update Progress: 1666/2372 symbols completed. PFGC took 38.5s. Estimated remaining: 1h 33m 50s. Rate: 7.5 symbols/min [2025-09-19T20:41:30.060078] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:41:30.083125] [DEBUG] [LOCAL ] PFN: Loaded 21879 existing records from primary storage. [2025-09-19T20:41:30.083293] [INFO ] [MAIN ] PFN: Loaded 21879 existing records. [2025-09-19T20:41:30.244270] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-19T20:41:30.284182] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:41:30.284481] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-19T20:41:30.284533] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-19T20:41:30.285341] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-19T20:41:30.285409] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-19T20:41:30.654308] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:41:30.678295] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T20:41:30.686230] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-09-19T20:41:30.686367] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-19T20:41:30.687173] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:41:30.687267] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:41:30.687311] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:41:30.687377] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-19T20:41:30.687445] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-19T20:41:30.687483] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-19T20:41:30.687567] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-09-19T20:41:30.687711] [INFO ] [MAIN ] Update Progress: 1667/2372 symbols completed. PFE took 40.2s. Estimated remaining: 1h 33m 39s. Rate: 7.5 symbols/min [2025-09-19T20:41:30.860028] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:41:30.867381] [DEBUG] [LOCAL ] PFO: Loaded 5887 existing records from primary storage. [2025-09-19T20:41:30.867496] [INFO ] [MAIN ] PFO: Loaded 5887 existing records. [2025-09-19T20:41:31.049563] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-19T20:41:31.049436] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:41:31.050975] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-19T20:41:31.051044] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-19T20:41:31.051403] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-19T20:41:31.051465] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-19T20:41:31.410028] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:41:31.843274] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-19T20:41:32.275987] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T20:41:32.643347] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-19T20:41:32.827448] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T20:41:32.924449] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T20:41:33.443318] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-19T20:41:34.243336] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-19T20:41:34.608180] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T20:41:34.627146] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T20:41:35.043281] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-19T20:41:35.674952] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T20:41:35.843273] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-19T20:41:36.643310] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-19T20:41:37.108314] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T20:41:37.173891] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T20:41:37.378330] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T20:41:37.443261] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-19T20:41:38.241276] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-19T20:41:38.243198] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-19T20:41:39.029528] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T20:41:39.043214] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-19T20:41:39.843290] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-19T20:41:39.909034] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-19T20:41:40.643316] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-19T20:41:41.443334] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-19T20:41:41.705917] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T20:41:41.741581] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T20:41:42.243268] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-19T20:41:42.277284] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-19T20:41:43.024183] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T20:41:43.043234] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-19T20:41:43.843270] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-19T20:41:44.460629] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T20:41:44.643314] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-19T20:41:44.788492] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T20:41:45.443329] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-19T20:41:46.243349] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-19T20:41:46.506357] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-19T20:41:46.572689] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T20:41:47.043380] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-19T20:41:47.500133] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T20:41:47.843308] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-19T20:41:48.643334] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-19T20:41:49.036942] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T20:41:49.040294] [INFO ] [REMOTE ] PFL: Full fetch complete (20163 records). [2025-09-19T20:41:49.040407] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-19T20:41:49.422193] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-19T20:41:49.422438] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-19T20:41:49.423154] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-19T20:41:49.423374] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-19T20:41:49.424409] [DEBUG] [LOCAL ] PFL: Trimmed 20163 records to 13980 (keeping 200 days of data) [2025-09-19T20:41:49.479903] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-19T20:41:49.533173] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-19T20:41:49.562505] [DEBUG] [LOCAL ] PFL: Primary data saved (13980 records). [2025-09-19T20:41:49.562758] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-19T20:41:49.562888] [INFO ] [MAIN ] Update Progress: 1668/2372 symbols completed. PFL took 39.8s. Estimated remaining: 1h 33m 36s. Rate: 7.5 symbols/min [2025-09-19T20:41:49.743893] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:41:49.788675] [DEBUG] [LOCAL ] PFS: Loaded 36094 existing records from primary storage. [2025-09-19T20:41:49.788922] [INFO ] [MAIN ] PFS: Loaded 36094 existing records. [2025-09-19T20:41:50.006310] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T20:41:50.012801] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:41:50.018189] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-19T20:41:50.018251] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-19T20:41:50.019572] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-19T20:41:50.019882] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-19T20:41:50.248374] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-19T20:41:50.389413] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:41:50.520994] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T20:41:50.523203] [INFO ] [REMOTE ] PFO: Full fetch complete (7815 records). [2025-09-19T20:41:50.523275] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-19T20:41:50.879591] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-19T20:41:50.879708] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-19T20:41:50.879994] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-19T20:41:50.880034] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-19T20:41:50.880439] [DEBUG] [LOCAL ] PFO: Trimmed 7815 records to 5940 (keeping 200 days of data) [2025-09-19T20:41:50.915710] [DEBUG] [LOCAL ] PFO: Primary data saved (5940 records). [2025-09-19T20:41:50.915848] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-19T20:41:50.915959] [INFO ] [MAIN ] Update Progress: 1669/2372 symbols completed. PFO took 20.2s. Estimated remaining: 1h 33m 25s. Rate: 7.5 symbols/min [2025-09-19T20:41:51.054328] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-19T20:41:51.086188] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:41:51.120723] [DEBUG] [LOCAL ] PFSI: Loaded 29042 existing records from primary storage. [2025-09-19T20:41:51.120876] [INFO ] [MAIN ] PFSI: Loaded 29042 existing records. [2025-09-19T20:41:51.294913] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:41:51.295213] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-19T20:41:51.295262] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-19T20:41:51.296106] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-19T20:41:51.296168] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-19T20:41:51.652982] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:41:51.665884] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T20:41:51.843271] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-19T20:41:52.329702] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T20:41:52.643312] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-19T20:41:53.182714] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T20:41:53.443284] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-19T20:41:54.243281] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-19T20:41:54.304082] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T20:41:55.043326] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-19T20:41:55.147310] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T20:41:55.254629] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T20:41:55.843274] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-19T20:41:56.504811] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T20:41:56.643309] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-19T20:41:57.443276] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-19T20:41:57.505698] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T20:41:58.243276] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-19T20:41:58.329078] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T20:41:58.493026] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T20:41:58.499888] [INFO ] [REMOTE ] PFLT: Full fetch complete (63187 records). [2025-09-19T20:41:58.500041] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-19T20:41:58.919235] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-19T20:41:58.919325] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-19T20:41:58.920272] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-19T20:41:58.920334] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-19T20:41:58.921598] [DEBUG] [LOCAL ] PFLT: Trimmed 63187 records to 44319 (keeping 200 days of data) [2025-09-19T20:41:59.043498] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-19T20:41:59.202356] [DEBUG] [LOCAL ] PFLT: Primary data saved (44319 records). [2025-09-19T20:41:59.202521] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-19T20:41:59.202685] [INFO ] [MAIN ] Update Progress: 1670/2372 symbols completed. PFLT took 36.1s. Estimated remaining: 1h 33m 17s. Rate: 7.5 symbols/min [2025-09-19T20:41:59.374383] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:41:59.374576] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-19T20:41:59.374630] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-19T20:41:59.374798] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-19T20:41:59.374840] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-19T20:41:59.374882] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-19T20:41:59.374925] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-19T20:41:59.753639] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:41:59.788579] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T20:41:59.843221] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-19T20:42:00.344140] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T20:42:00.348169] [INFO ] [REMOTE ] PFN: Full fetch complete (30652 records). [2025-09-19T20:42:00.348279] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-19T20:42:00.648333] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-19T20:42:00.725191] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-19T20:42:00.725266] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-19T20:42:00.725976] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-19T20:42:00.726039] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-19T20:42:00.726784] [DEBUG] [LOCAL ] PFN: Trimmed 30652 records to 22003 (keeping 200 days of data) [2025-09-19T20:42:00.857897] [DEBUG] [LOCAL ] PFN: Primary data saved (22003 records). [2025-09-19T20:42:00.858023] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-19T20:42:00.858103] [INFO ] [MAIN ] Update Progress: 1671/2372 symbols completed. PFN took 31.0s. Estimated remaining: 1h 33m 6s. Rate: 7.5 symbols/min [2025-09-19T20:42:01.029460] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:42:01.036478] [DEBUG] [LOCAL ] PGP: Loaded 5456 existing records from primary storage. [2025-09-19T20:42:01.036596] [INFO ] [MAIN ] PGP: Loaded 5456 existing records. [2025-09-19T20:42:01.215232] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:42:01.215533] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-19T20:42:01.215590] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-19T20:42:01.215970] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-19T20:42:01.216031] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-19T20:42:01.456451] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-19T20:42:01.575611] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:42:02.243253] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-19T20:42:02.921463] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (3.08 seconds). [2025-09-19T20:42:03.043277] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-19T20:42:03.401178] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-19T20:42:03.843266] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-19T20:42:04.639797] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-19T20:42:04.643438] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-19T20:42:05.053117] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (3.60 seconds). [2025-09-19T20:42:05.410012] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T20:42:05.443284] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-19T20:42:05.587579] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T20:42:06.243300] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-19T20:42:06.319439] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (3.28 seconds). [2025-09-19T20:42:06.869258] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T20:42:07.020346] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T20:42:07.043214] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-19T20:42:07.843281] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-19T20:42:07.852125] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T20:42:08.643273] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-19T20:42:09.443319] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-19T20:42:09.494426] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T20:42:09.604252] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T20:42:10.243341] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-19T20:42:11.043308] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-19T20:42:11.677784] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-19T20:42:11.843289] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-19T20:42:11.886843] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-19T20:42:11.946748] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T20:42:12.643267] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-19T20:42:13.443330] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-19T20:42:14.243287] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-19T20:42:15.415131] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-19T20:42:15.423077] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-19T20:42:15.481598] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T20:42:15.567343] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (3.72 seconds). [2025-09-19T20:42:15.843260] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-19T20:42:16.138329] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-19T20:42:16.643286] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-19T20:42:17.139295] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T20:42:17.144962] [INFO ] [REMOTE ] PFS: Full fetch complete (51482 records). [2025-09-19T20:42:17.145066] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-19T20:42:17.452149] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-19T20:42:17.550669] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T20:42:17.553667] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-19T20:42:17.556381] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-19T20:42:17.557404] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-19T20:42:17.557484] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-19T20:42:17.558615] [DEBUG] [LOCAL ] PFS: Trimmed 51482 records to 36345 (keeping 200 days of data) [2025-09-19T20:42:17.785491] [DEBUG] [LOCAL ] PFS: Primary data saved (36345 records). [2025-09-19T20:42:17.785626] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-19T20:42:17.785741] [INFO ] [MAIN ] Update Progress: 1672/2372 symbols completed. PFS took 28.2s. Estimated remaining: 1h 33m 2s. Rate: 7.5 symbols/min [2025-09-19T20:42:17.971321] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:42:17.971511] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-19T20:42:17.971564] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-19T20:42:17.971734] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-19T20:42:17.971785] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-19T20:42:17.971829] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-19T20:42:17.971861] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-19T20:42:18.251422] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-19T20:42:18.348972] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:42:18.385998] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-19T20:42:18.880989] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T20:42:19.043311] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-19T20:42:19.189442] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T20:42:19.843272] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-19T20:42:20.442268] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T20:42:20.643275] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-19T20:42:20.650909] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T20:42:20.652383] [INFO ] [REMOTE ] PGP: Full fetch complete (7936 records). [2025-09-19T20:42:20.652452] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-19T20:42:21.016984] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-19T20:42:21.017064] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-19T20:42:21.017282] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-19T20:42:21.017321] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-19T20:42:21.017766] [DEBUG] [LOCAL ] PGP: Trimmed 7936 records to 5490 (keeping 200 days of data) [2025-09-19T20:42:21.049904] [DEBUG] [LOCAL ] PGP: Primary data saved (5490 records). [2025-09-19T20:42:21.050002] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-19T20:42:21.050090] [INFO ] [MAIN ] Update Progress: 1673/2372 symbols completed. PGP took 20.2s. Estimated remaining: 1h 32m 52s. Rate: 7.5 symbols/min [2025-09-19T20:42:21.232794] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:42:21.286832] [DEBUG] [LOCAL ] PGRE: Loaded 46532 existing records from primary storage. [2025-09-19T20:42:21.286978] [INFO ] [MAIN ] PGRE: Loaded 46532 existing records. [2025-09-19T20:42:21.451548] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-19T20:42:21.475758] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:42:21.475975] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-19T20:42:21.476033] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-19T20:42:21.477231] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-19T20:42:21.477305] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-19T20:42:21.847738] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:42:22.243338] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-19T20:42:23.043284] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-19T20:42:23.177782] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T20:42:23.843271] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-19T20:42:23.989905] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-19T20:42:24.022440] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T20:42:24.643277] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-19T20:42:25.104361] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T20:42:25.443266] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-19T20:42:25.727380] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T20:42:26.243327] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-19T20:42:26.428538] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-19T20:42:27.043330] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-19T20:42:27.175367] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T20:42:27.843274] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-19T20:42:27.897514] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T20:42:28.643272] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-19T20:42:29.422802] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T20:42:29.443218] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-19T20:42:29.882318] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-19T20:42:30.243251] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-19T20:42:30.654912] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T20:42:30.771204] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T20:42:31.043272] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-19T20:42:31.851101] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-19T20:42:31.855496] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T20:42:31.861783] [INFO ] [REMOTE ] PFSI: Full fetch complete (40473 records). [2025-09-19T20:42:31.861934] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-19T20:42:32.267407] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-19T20:42:32.267551] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-19T20:42:32.268471] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-19T20:42:32.268566] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-19T20:42:32.270047] [DEBUG] [LOCAL ] PFSI: Trimmed 40473 records to 29233 (keeping 200 days of data) [2025-09-19T20:42:32.474264] [DEBUG] [LOCAL ] PFSI: Primary data saved (29233 records). [2025-09-19T20:42:32.474424] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-19T20:42:32.474590] [INFO ] [MAIN ] Update Progress: 1674/2372 symbols completed. PFSI took 41.6s. Estimated remaining: 1h 32m 46s. Rate: 7.5 symbols/min [2025-09-19T20:42:32.643206] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:42:32.643328] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-19T20:42:32.654611] [DEBUG] [LOCAL ] PGZ: Loaded 5462 existing records from primary storage. [2025-09-19T20:42:32.654757] [INFO ] [MAIN ] PGZ: Loaded 5462 existing records. [2025-09-19T20:42:32.843067] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:42:32.843361] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-19T20:42:32.843461] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-19T20:42:32.843782] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-19T20:42:32.843868] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-19T20:42:33.205877] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:42:33.443296] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-19T20:42:33.500044] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-19T20:42:33.890120] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T20:42:34.243264] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-19T20:42:34.771494] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T20:42:34.824542] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T20:42:35.043299] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-19T20:42:35.843272] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-19T20:42:35.985521] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T20:42:36.643268] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-19T20:42:36.850508] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T20:42:36.860303] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-09-19T20:42:36.860578] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-19T20:42:36.861911] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:42:36.862075] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:42:36.862312] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:42:36.862501] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-19T20:42:36.862802] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-19T20:42:36.862953] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-19T20:42:36.863036] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-09-19T20:42:36.863145] [INFO ] [MAIN ] Update Progress: 1675/2372 symbols completed. PG took 37.7s. Estimated remaining: 1h 32m 36s. Rate: 7.5 symbols/min [2025-09-19T20:42:37.051771] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-19T20:42:37.070809] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:42:37.132174] [DEBUG] [LOCAL ] PH: Loaded 39699 existing records from primary storage. [2025-09-19T20:42:37.132327] [INFO ] [MAIN ] PH: Loaded 39699 existing records. [2025-09-19T20:42:37.317264] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:42:37.317513] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-19T20:42:37.317564] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-19T20:42:37.319404] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-19T20:42:37.319470] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-19T20:42:37.448452] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-19T20:42:37.686044] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:42:38.103728] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T20:42:38.243258] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-19T20:42:39.043274] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-19T20:42:39.843294] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-19T20:42:40.073759] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T20:42:40.104057] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-19T20:42:40.145102] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T20:42:40.643314] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-19T20:42:41.443319] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-19T20:42:41.706985] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T20:42:42.243341] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-19T20:42:42.517521] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T20:42:43.043289] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-19T20:42:43.642536] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T20:42:43.826539] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T20:42:43.843249] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-19T20:42:44.227049] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T20:42:44.643317] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-19T20:42:45.443279] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-19T20:42:45.546517] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T20:42:46.160030] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T20:42:46.243262] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-19T20:42:47.043293] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-19T20:42:47.391554] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T20:42:47.843328] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-19T20:42:47.895353] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T20:42:48.385155] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T20:42:48.643279] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-19T20:42:49.443283] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-19T20:42:49.588045] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T20:42:50.246369] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-19T20:42:50.247236] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T20:42:50.788301] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T20:42:50.795406] [INFO ] [REMOTE ] PGRE: Full fetch complete (63098 records). [2025-09-19T20:42:50.795530] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-19T20:42:51.048611] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-19T20:42:51.203565] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-19T20:42:51.203683] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-19T20:42:51.204738] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-19T20:42:51.204802] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-19T20:42:51.206141] [DEBUG] [LOCAL ] PGRE: Trimmed 63098 records to 46920 (keeping 200 days of data) [2025-09-19T20:42:51.484669] [DEBUG] [LOCAL ] PGRE: Primary data saved (46920 records). [2025-09-19T20:42:51.484817] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-19T20:42:51.485516] [INFO ] [MAIN ] Update Progress: 1676/2372 symbols completed. PGRE took 30.4s. Estimated remaining: 1h 32m 31s. Rate: 7.5 symbols/min [2025-09-19T20:42:51.667148] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:42:51.686104] [DEBUG] [LOCAL ] PHD: Loaded 9688 existing records from primary storage. [2025-09-19T20:42:51.686245] [INFO ] [MAIN ] PHD: Loaded 9688 existing records. [2025-09-19T20:42:51.846170] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-19T20:42:51.868871] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:42:51.869199] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-19T20:42:51.869249] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-19T20:42:51.869683] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-19T20:42:51.869743] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-19T20:42:52.228714] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:42:52.256993] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T20:42:52.273872] [INFO ] [REMOTE ] PGR: Full fetch complete (76217 records). [2025-09-19T20:42:52.274179] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-19T20:42:52.280479] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:42:52.280677] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:42:52.280750] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:42:52.280829] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-19T20:42:52.280914] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-19T20:42:52.280981] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-19T20:42:52.281055] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-09-19T20:42:52.281154] [INFO ] [MAIN ] Update Progress: 1677/2372 symbols completed. PGR took 34.5s. Estimated remaining: 1h 32m 20s. Rate: 7.5 symbols/min [2025-09-19T20:42:52.396618] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T20:42:52.438573] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T20:42:52.643287] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-19T20:42:53.218269] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T20:42:53.443269] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-19T20:42:54.243243] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-19T20:42:54.294981] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T20:42:54.296916] [INFO ] [REMOTE ] PGZ: Full fetch complete (8988 records). [2025-09-19T20:42:54.296987] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-19T20:42:54.673259] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-19T20:42:54.673596] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-19T20:42:54.673878] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-19T20:42:54.673936] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-19T20:42:54.674394] [DEBUG] [LOCAL ] PGZ: Trimmed 8988 records to 5490 (keeping 200 days of data) [2025-09-19T20:42:54.709608] [DEBUG] [LOCAL ] PGZ: Primary data saved (5490 records). [2025-09-19T20:42:54.709714] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-19T20:42:54.709796] [INFO ] [MAIN ] Update Progress: 1678/2372 symbols completed. PGZ took 22.2s. Estimated remaining: 1h 32m 10s. Rate: 7.5 symbols/min [2025-09-19T20:42:55.043308] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-19T20:42:55.463708] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T20:42:55.843263] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-19T20:42:56.865953] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T20:42:56.868824] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-19T20:42:57.189567] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-19T20:42:57.443282] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-19T20:42:57.798762] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T20:42:58.243315] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-19T20:42:59.127455] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T20:42:59.130064] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-19T20:42:59.292670] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T20:42:59.843258] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-19T20:43:00.219432] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T20:43:00.643305] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-19T20:43:01.621214] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T20:43:01.637878] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T20:43:01.642040] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-19T20:43:02.243284] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-19T20:43:02.646167] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T20:43:03.043340] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-19T20:43:04.211314] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T20:43:04.216791] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-19T20:43:04.319635] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T20:43:04.643276] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-19T20:43:05.165555] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T20:43:05.443269] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-19T20:43:06.501076] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T20:43:06.511277] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-19T20:43:06.752341] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T20:43:06.754704] [INFO ] [REMOTE ] PHD: Full fetch complete (13792 records). [2025-09-19T20:43:06.754781] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-19T20:43:07.142148] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-19T20:43:07.142254] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-19T20:43:07.142596] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-19T20:43:07.142664] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-19T20:43:07.143263] [DEBUG] [LOCAL ] PHD: Trimmed 13792 records to 9763 (keeping 200 days of data) [2025-09-19T20:43:07.200899] [DEBUG] [LOCAL ] PHD: Primary data saved (9763 records). [2025-09-19T20:43:07.201048] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-19T20:43:07.201148] [INFO ] [MAIN ] Update Progress: 1679/2372 symbols completed. PHD took 15.7s. Estimated remaining: 1h 32m 4s. Rate: 7.5 symbols/min [2025-09-19T20:43:08.138370] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T20:43:08.144094] [INFO ] [REMOTE ] PH: Full fetch complete (56726 records). [2025-09-19T20:43:08.144265] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-19T20:43:08.544303] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-19T20:43:08.544386] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-19T20:43:08.545289] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-19T20:43:08.545353] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-19T20:43:08.546597] [DEBUG] [LOCAL ] PH: Trimmed 56726 records to 39897 (keeping 200 days of data) [2025-09-19T20:43:08.807876] [DEBUG] [LOCAL ] PH: Primary data saved (39897 records). [2025-09-19T20:43:08.808055] [INFO ] [MAIN ] PH: Full history saved. [2025-09-19T20:43:08.808157] [INFO ] [MAIN ] Update Progress: 1680/2372 symbols completed. PH took 31.9s. Estimated remaining: 1h 31m 53s. Rate: 7.5 symbols/min [2025-09-19T20:43:09.540739] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:43:09.602463] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:43:09.584832] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:43:09.629285] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:43:09.667909] [DEBUG] [LOCAL ] PHI: Loaded 15023 existing records from primary storage. [2025-09-19T20:43:09.668133] [INFO ] [MAIN ] PHI: Loaded 15023 existing records. [2025-09-19T20:43:09.777517] [DEBUG] [LOCAL ] PHK: Loaded 26933 existing records from primary storage. [2025-09-19T20:43:09.822031] [INFO ] [MAIN ] PHK: Loaded 26933 existing records. [2025-09-19T20:43:09.821900] [DEBUG] [LOCAL ] PHIN: Loaded 33825 existing records from primary storage. [2025-09-19T20:43:09.879520] [INFO ] [MAIN ] PHIN: Loaded 33825 existing records. [2025-09-19T20:43:10.096717] [DEBUG] [LOCAL ] PHG: Loaded 46651 existing records from primary storage. [2025-09-19T20:43:10.135930] [INFO ] [MAIN ] PHG: Loaded 46651 existing records. [2025-09-19T20:43:10.155551] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:43:10.189492] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-19T20:43:10.200004] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-19T20:43:10.256703] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-19T20:43:10.314287] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-19T20:43:10.404943] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:43:10.520702] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-19T20:43:10.518183] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:43:10.552774] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-19T20:43:10.617234] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-19T20:43:10.617145] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:43:10.618141] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-19T20:43:10.617508] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-19T20:43:10.628848] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-19T20:43:10.628953] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-19T20:43:10.639403] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-19T20:43:10.673318] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-19T20:43:10.707177] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-19T20:43:10.689576] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-19T20:43:10.723788] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-19T20:43:11.622714] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:43:11.739119] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-19T20:43:11.982600] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:43:11.932843] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:43:12.000126] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-19T20:43:12.004883] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-19T20:43:12.004623] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:43:12.005969] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-19T20:43:13.532494] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T20:43:13.536027] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-19T20:43:13.726933] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T20:43:13.734201] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-19T20:43:13.779494] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T20:43:13.785456] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-19T20:43:13.942349] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T20:43:13.951149] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-19T20:43:14.540758] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T20:43:14.543866] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-19T20:43:15.341528] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T20:43:15.351226] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-19T20:43:15.593325] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T20:43:15.599611] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-19T20:43:15.647213] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T20:43:15.843288] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-19T20:43:15.980546] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T20:43:16.643226] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-19T20:43:16.843037] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T20:43:16.882918] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T20:43:17.000145] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T20:43:17.443281] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-19T20:43:18.243276] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-19T20:43:18.511894] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T20:43:18.953543] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T20:43:18.970496] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T20:43:19.043222] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-19T20:43:19.843260] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-19T20:43:20.643339] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-19T20:43:20.768882] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T20:43:21.443266] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-19T20:43:21.760916] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T20:43:22.243294] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-19T20:43:22.427567] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T20:43:22.706115] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T20:43:23.043311] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-19T20:43:23.843279] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-19T20:43:24.229199] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T20:43:24.643319] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-19T20:43:24.825317] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T20:43:25.263102] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T20:43:25.443295] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-19T20:43:26.111268] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T20:43:26.243265] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-19T20:43:26.520579] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T20:43:27.043329] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-19T20:43:27.843240] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-19T20:43:28.173446] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T20:43:28.255840] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T20:43:28.643275] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-19T20:43:29.443349] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-19T20:43:29.654585] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T20:43:29.841565] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T20:43:30.243324] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-19T20:43:31.043300] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-19T20:43:31.499826] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T20:43:31.587876] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T20:43:31.591488] [INFO ] [REMOTE ] PHI: Full fetch complete (20671 records). [2025-09-19T20:43:31.591559] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-19T20:43:31.850808] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-19T20:43:31.975079] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-19T20:43:31.975177] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-19T20:43:31.975619] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-19T20:43:31.975687] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-19T20:43:31.976286] [DEBUG] [LOCAL ] PHI: Trimmed 20671 records to 15124 (keeping 200 days of data) [2025-09-19T20:43:32.073281] [DEBUG] [LOCAL ] PHI: Primary data saved (15124 records). [2025-09-19T20:43:32.073449] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-19T20:43:32.073550] [INFO ] [MAIN ] Update Progress: 1681/2372 symbols completed. PHI took 23.3s. Estimated remaining: 1h 31m 51s. Rate: 7.5 symbols/min [2025-09-19T20:43:32.243152] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:43:32.243401] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-19T20:43:32.243780] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-19T20:43:32.244166] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-19T20:43:32.244252] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-19T20:43:32.244390] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-19T20:43:32.244517] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-19T20:43:32.370179] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T20:43:32.620131] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:43:32.643224] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-19T20:43:33.443298] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-19T20:43:33.913531] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T20:43:34.243284] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-19T20:43:34.760296] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-19T20:43:34.851680] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T20:43:35.043278] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-19T20:43:35.843312] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-19T20:43:36.012998] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T20:43:36.019996] [INFO ] [REMOTE ] PHG: Full fetch complete (65738 records). [2025-09-19T20:43:36.020145] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-19T20:43:36.403383] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-19T20:43:36.403489] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-19T20:43:36.404447] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-19T20:43:36.404510] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-19T20:43:36.405878] [DEBUG] [LOCAL ] PHG: Trimmed 65738 records to 46960 (keeping 200 days of data) [2025-09-19T20:43:36.652318] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-19T20:43:36.657126] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T20:43:36.728039] [DEBUG] [LOCAL ] PHG: Primary data saved (46960 records). [2025-09-19T20:43:36.728169] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-19T20:43:36.728282] [INFO ] [MAIN ] Update Progress: 1682/2372 symbols completed. PHG took 27.9s. Estimated remaining: 1h 31m 42s. Rate: 7.5 symbols/min [2025-09-19T20:43:36.897826] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:43:36.933984] [DEBUG] [LOCAL ] PHR: Loaded 37429 existing records from primary storage. [2025-09-19T20:43:36.934121] [INFO ] [MAIN ] PHR: Loaded 37429 existing records. [2025-09-19T20:43:37.109885] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:43:37.110159] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-19T20:43:37.110205] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-19T20:43:37.111209] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-19T20:43:37.111279] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-19T20:43:37.446556] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-19T20:43:37.489272] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:43:37.505525] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T20:43:38.243289] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-19T20:43:38.785077] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T20:43:39.043297] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-19T20:43:39.214357] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T20:43:39.243516] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T20:43:39.249478] [INFO ] [REMOTE ] PHK: Full fetch complete (39357 records). [2025-09-19T20:43:39.249689] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-19T20:43:39.625828] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-19T20:43:39.625915] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-19T20:43:39.626850] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-19T20:43:39.626914] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-19T20:43:39.627924] [DEBUG] [LOCAL ] PHK: Trimmed 39357 records to 27059 (keeping 200 days of data) [2025-09-19T20:43:39.796611] [DEBUG] [LOCAL ] PHK: Primary data saved (27059 records). [2025-09-19T20:43:39.796819] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-19T20:43:39.796944] [INFO ] [MAIN ] Update Progress: 1683/2372 symbols completed. PHK took 31.0s. Estimated remaining: 1h 31m 32s. Rate: 7.5 symbols/min [2025-09-19T20:43:39.851776] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-19T20:43:39.974162] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:43:39.989957] [DEBUG] [LOCAL ] PHT: Loaded 15406 existing records from primary storage. [2025-09-19T20:43:39.990075] [INFO ] [MAIN ] PHT: Loaded 15406 existing records. [2025-09-19T20:43:40.166455] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:43:40.166791] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-19T20:43:40.166850] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-19T20:43:40.167416] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-19T20:43:40.167475] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-19T20:43:40.530460] [INFO ] [REMOTE ] PHT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:43:40.643251] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-12. [2025-09-19T20:43:41.153620] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T20:43:41.443325] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-19T20:43:41.512605] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T20:43:41.905190] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T20:43:42.243404] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-19T20:43:42.972561] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T20:43:43.043233] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-19T20:43:43.848605] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-19T20:43:43.857909] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T20:43:43.977589] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T20:43:43.982853] [INFO ] [REMOTE ] PHIN: Full fetch complete (48329 records). [2025-09-19T20:43:43.982991] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-19T20:43:44.377301] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-19T20:43:44.377485] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-19T20:43:44.378312] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-19T20:43:44.378374] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-19T20:43:44.379423] [DEBUG] [LOCAL ] PHIN: Trimmed 48329 records to 34030 (keeping 200 days of data) [2025-09-19T20:43:44.590490] [DEBUG] [LOCAL ] PHIN: Primary data saved (34030 records). [2025-09-19T20:43:44.590668] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-19T20:43:44.590819] [INFO ] [MAIN ] Update Progress: 1684/2372 symbols completed. PHIN took 35.8s. Estimated remaining: 1h 31m 23s. Rate: 7.5 symbols/min [2025-09-19T20:43:44.649918] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-01. [2025-09-19T20:43:44.777275] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:43:44.824049] [DEBUG] [LOCAL ] PII: Loaded 49751 existing records from primary storage. [2025-09-19T20:43:44.824209] [INFO ] [MAIN ] PII: Loaded 49751 existing records. [2025-09-19T20:43:45.010506] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:43:45.010855] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-19T20:43:45.010912] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-19T20:43:45.012428] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-19T20:43:45.012490] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-19T20:43:45.369377] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:43:45.443221] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-19T20:43:45.688180] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T20:43:45.870635] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T20:43:46.243309] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-19T20:43:47.043294] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-19T20:43:47.593347] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T20:43:47.817085] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T20:43:47.843212] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-19T20:43:48.643273] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-19T20:43:49.177564] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T20:43:49.443322] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-19T20:43:49.620715] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T20:43:49.674884] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T20:43:50.243269] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-19T20:43:51.043275] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-19T20:43:51.628901] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T20:43:51.843277] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-19T20:43:52.155762] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T20:43:52.301700] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T20:43:52.643287] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-19T20:43:53.443373] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-19T20:43:53.876616] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T20:43:53.899328] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T20:43:54.243306] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-19T20:43:55.043329] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-19T20:43:55.294110] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T20:43:55.403193] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T20:43:55.843317] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-19T20:43:55.976507] [DEBUG] [REMOTE ] PHT: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-19T20:43:55.977058] [WARN ] [REMOTE ] PHT: No data returned for month 2025-06 [2025-09-19T20:43:56.643396] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-19T20:43:56.949740] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T20:43:57.443296] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-19T20:43:57.922866] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T20:43:58.243308] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-19T20:43:58.617482] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T20:43:59.043278] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-19T20:43:59.843329] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-19T20:44:00.330107] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T20:44:00.424577] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T20:44:00.643249] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-19T20:44:01.437471] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T20:44:01.447633] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-19T20:44:01.592142] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T20:44:01.599699] [INFO ] [REMOTE ] PHM: Full fetch complete (74605 records). [2025-09-19T20:44:01.599826] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-19T20:44:01.600532] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:44:01.600620] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:44:01.600739] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:44:01.600812] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-19T20:44:01.600878] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-19T20:44:01.600913] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-19T20:44:01.600977] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-09-19T20:44:01.601064] [INFO ] [MAIN ] Update Progress: 1685/2372 symbols completed. PHM took 29.5s. Estimated remaining: 1h 31m 19s. Rate: 7.5 symbols/min [2025-09-19T20:44:01.776408] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:01.782861] [DEBUG] [LOCAL ] PIM: Loaded 4811 existing records from primary storage. [2025-09-19T20:44:01.782955] [INFO ] [MAIN ] PIM: Loaded 4811 existing records. [2025-09-19T20:44:01.964263] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:01.964511] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-19T20:44:01.964559] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-19T20:44:01.964902] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-19T20:44:01.964963] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-19T20:44:02.250089] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-19T20:44:02.336795] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:44:02.688344] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T20:44:03.043286] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-19T20:44:03.843282] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-19T20:44:03.910739] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T20:44:03.975579] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T20:44:04.643280] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-19T20:44:05.443271] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-19T20:44:05.476352] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T20:44:05.935414] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T20:44:06.243249] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-19T20:44:06.631025] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T20:44:06.633805] [INFO ] [REMOTE ] PHT: Full fetch complete (16977 records). [2025-09-19T20:44:06.633878] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-19T20:44:06.817420] [WARN ] [VALIDATOR ] PHT: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-19T20:44:06.817762] [FATAL] [MAIN ] PHT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:44:06.817835] [WARN ] [MAIN ] PHT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:44:06.817912] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-19T20:44:06.818002] [DEBUG] [LOCAL ] PHT: No primary data file found to delete. [2025-09-19T20:44:06.818057] [INFO ] [LOCAL ] PHT: Starting deletion of derivative data. [2025-09-19T20:44:06.818464] [DEBUG] [LOCAL ] PHT: Deleted derivative data file. [2025-09-19T20:44:06.818560] [INFO ] [MAIN ] Update Progress: 1686/2372 symbols completed. PHT took 27.0s. Estimated remaining: 1h 31m 10s. Rate: 7.5 symbols/min [2025-09-19T20:44:06.998911] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T20:44:07.000471] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:07.018407] [DEBUG] [LOCAL ] PINE: Loaded 14351 existing records from primary storage. [2025-09-19T20:44:07.018531] [INFO ] [MAIN ] PINE: Loaded 14351 existing records. [2025-09-19T20:44:07.048587] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-19T20:44:07.198267] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:07.198492] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-19T20:44:07.198539] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-19T20:44:07.199152] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-19T20:44:07.199212] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-19T20:44:07.554220] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:44:07.843255] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-19T20:44:08.643284] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-19T20:44:09.374225] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T20:44:09.443241] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-19T20:44:09.499056] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T20:44:09.554496] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T20:44:10.175937] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T20:44:10.243273] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-19T20:44:11.043322] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-19T20:44:11.125031] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T20:44:11.843349] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-19T20:44:12.328182] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T20:44:12.643268] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-19T20:44:13.443285] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-19T20:44:13.632101] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T20:44:13.658049] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T20:44:14.133740] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T20:44:14.243274] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-19T20:44:15.043302] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-19T20:44:15.843282] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-19T20:44:16.036117] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T20:44:16.134669] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T20:44:16.142548] [INFO ] [REMOTE ] PHR: Full fetch complete (52118 records). [2025-09-19T20:44:16.142728] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-19T20:44:16.562427] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-19T20:44:16.562526] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-19T20:44:16.563513] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-19T20:44:16.563580] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-19T20:44:16.564878] [DEBUG] [LOCAL ] PHR: Trimmed 52118 records to 37775 (keeping 200 days of data) [2025-09-19T20:44:16.655320] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-19T20:44:16.656177] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T20:44:16.802914] [DEBUG] [LOCAL ] PHR: Primary data saved (37775 records). [2025-09-19T20:44:16.803097] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-19T20:44:16.803189] [INFO ] [MAIN ] Update Progress: 1687/2372 symbols completed. PHR took 40.1s. Estimated remaining: 1h 31m 2s. Rate: 7.5 symbols/min [2025-09-19T20:44:16.979436] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:17.033246] [DEBUG] [LOCAL ] PINS: Loaded 54083 existing records from primary storage. [2025-09-19T20:44:17.033687] [INFO ] [MAIN ] PINS: Loaded 54083 existing records. [2025-09-19T20:44:17.216717] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:17.217014] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-19T20:44:17.217063] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-19T20:44:17.218889] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-19T20:44:17.218951] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-19T20:44:17.451193] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-19T20:44:17.611602] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:44:18.243294] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-19T20:44:18.637893] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T20:44:18.682628] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T20:44:18.988496] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T20:44:19.043223] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-19T20:44:19.843281] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-19T20:44:20.085235] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T20:44:20.643318] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-19T20:44:20.669709] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T20:44:21.443280] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-19T20:44:21.620432] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T20:44:22.243326] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-19T20:44:23.043300] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-19T20:44:23.529256] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T20:44:23.843315] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-19T20:44:23.964688] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T20:44:23.966715] [INFO ] [REMOTE ] PIM: Full fetch complete (6596 records). [2025-09-19T20:44:23.966793] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-19T20:44:24.407287] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-19T20:44:24.407371] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-19T20:44:24.407572] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-19T20:44:24.407610] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-19T20:44:24.408041] [DEBUG] [LOCAL ] PIM: Trimmed 6596 records to 4840 (keeping 200 days of data) [2025-09-19T20:44:24.436129] [DEBUG] [LOCAL ] PIM: Primary data saved (4840 records). [2025-09-19T20:44:24.436220] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-19T20:44:24.436325] [INFO ] [MAIN ] Update Progress: 1688/2372 symbols completed. PIM took 22.8s. Estimated remaining: 1h 30m 54s. Rate: 7.5 symbols/min [2025-09-19T20:44:24.613702] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:24.631729] [DEBUG] [LOCAL ] PIPR: Loaded 15563 existing records from primary storage. [2025-09-19T20:44:24.631859] [INFO ] [MAIN ] PIPR: Loaded 15563 existing records. [2025-09-19T20:44:24.663708] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-19T20:44:24.821185] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:24.821559] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-19T20:44:24.821633] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-19T20:44:24.832503] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-19T20:44:24.847455] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-19T20:44:24.918258] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-19T20:44:25.233411] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:44:25.443268] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-19T20:44:25.833513] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T20:44:25.995490] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T20:44:26.243318] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-19T20:44:27.043314] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-19T20:44:27.054543] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T20:44:27.608789] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-19T20:44:27.843315] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-19T20:44:28.113077] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T20:44:28.643273] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-19T20:44:29.443305] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-19T20:44:30.243273] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-19T20:44:31.117737] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (3.27 seconds). [2025-09-19T20:44:31.120145] [INFO ] [REMOTE ] PINE: Full fetch complete (21227 records). [2025-09-19T20:44:31.120379] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-19T20:44:31.497834] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-19T20:44:31.498046] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-19T20:44:31.498700] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-19T20:44:31.498789] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-19T20:44:31.500038] [DEBUG] [LOCAL ] PINE: Trimmed 21227 records to 14460 (keeping 200 days of data) [2025-09-19T20:44:31.587984] [DEBUG] [LOCAL ] PINE: Primary data saved (14460 records). [2025-09-19T20:44:31.588129] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-19T20:44:31.588238] [INFO ] [MAIN ] Update Progress: 1689/2372 symbols completed. PINE took 24.8s. Estimated remaining: 1h 30m 46s. Rate: 7.5 symbols/min [2025-09-19T20:44:31.763257] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:31.772040] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T20:44:31.775929] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-19T20:44:31.806480] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T20:44:31.833458] [DEBUG] [LOCAL ] PJT: Loaded 23067 existing records from primary storage. [2025-09-19T20:44:31.833601] [INFO ] [MAIN ] PJT: Loaded 23067 existing records. [2025-09-19T20:44:31.864379] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-19T20:44:32.011710] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:32.011982] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-19T20:44:32.012031] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-19T20:44:32.012992] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-19T20:44:32.013052] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-19T20:44:32.367940] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:44:32.643314] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-19T20:44:32.874900] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T20:44:32.960833] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (4.32 seconds). [2025-09-19T20:44:32.967837] [INFO ] [REMOTE ] PII: Full fetch complete (71087 records). [2025-09-19T20:44:32.967957] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-19T20:44:33.360367] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-19T20:44:33.360461] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-19T20:44:33.361489] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-19T20:44:33.361555] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-19T20:44:33.363258] [DEBUG] [LOCAL ] PII: Trimmed 71087 records to 50081 (keeping 200 days of data) [2025-09-19T20:44:33.456671] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-19T20:44:33.681333] [DEBUG] [LOCAL ] PII: Primary data saved (50081 records). [2025-09-19T20:44:33.681533] [INFO ] [MAIN ] PII: Full history saved. [2025-09-19T20:44:33.682718] [INFO ] [MAIN ] Update Progress: 1690/2372 symbols completed. PII took 49.1s. Estimated remaining: 1h 30m 36s. Rate: 7.5 symbols/min [2025-09-19T20:44:33.855196] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:33.909848] [DEBUG] [LOCAL ] PK: Loaded 53288 existing records from primary storage. [2025-09-19T20:44:33.909992] [INFO ] [MAIN ] PK: Loaded 53288 existing records. [2025-09-19T20:44:34.093006] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:34.093359] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-19T20:44:34.093592] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-19T20:44:34.104132] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-19T20:44:34.104270] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-19T20:44:34.128518] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T20:44:34.264183] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-19T20:44:34.491023] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:44:34.526534] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-19T20:44:34.763128] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T20:44:35.043270] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-19T20:44:35.646930] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T20:44:35.843274] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-19T20:44:36.385564] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T20:44:36.643286] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-19T20:44:37.443286] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-19T20:44:38.156135] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T20:44:38.243261] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-19T20:44:38.796981] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T20:44:39.043257] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-19T20:44:39.086883] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-19T20:44:39.843292] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-19T20:44:40.187088] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T20:44:40.243053] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T20:44:40.643276] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-19T20:44:41.324914] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T20:44:41.443241] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-19T20:44:42.243238] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-19T20:44:42.680020] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T20:44:42.749284] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T20:44:43.043274] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-19T20:44:43.844335] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-19T20:44:43.844220] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T20:44:44.643265] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-19T20:44:44.971399] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T20:44:45.443261] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-19T20:44:45.771049] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T20:44:45.941549] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T20:44:46.243267] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-19T20:44:47.043269] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-19T20:44:47.606742] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T20:44:47.760483] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T20:44:47.843266] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-19T20:44:48.205422] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T20:44:48.643301] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-19T20:44:49.146420] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T20:44:49.443270] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-19T20:44:50.243312] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-19T20:44:50.488450] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T20:44:50.490901] [INFO ] [REMOTE ] PIPR: Full fetch complete (20374 records). [2025-09-19T20:44:50.490974] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-19T20:44:50.882606] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-19T20:44:50.882833] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-19T20:44:50.883720] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-19T20:44:50.883863] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-19T20:44:50.885369] [DEBUG] [LOCAL ] PIPR: Trimmed 20374 records to 15659 (keeping 200 days of data) [2025-09-19T20:44:50.989839] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T20:44:51.031019] [DEBUG] [LOCAL ] PIPR: Primary data saved (15659 records). [2025-09-19T20:44:51.031207] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-19T20:44:51.031352] [INFO ] [MAIN ] Update Progress: 1691/2372 symbols completed. PIPR took 26.6s. Estimated remaining: 1h 30m 31s. Rate: 7.5 symbols/min [2025-09-19T20:44:51.054065] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-19T20:44:51.213822] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:51.228060] [DEBUG] [LOCAL ] PKE: Loaded 12430 existing records from primary storage. [2025-09-19T20:44:51.228173] [INFO ] [MAIN ] PKE: Loaded 12430 existing records. [2025-09-19T20:44:51.408952] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:51.409258] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-19T20:44:51.409309] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-19T20:44:51.409751] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-19T20:44:51.409828] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-19T20:44:51.793590] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:44:51.843325] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-19T20:44:52.553725] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T20:44:52.610804] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-19T20:44:52.643215] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-19T20:44:53.443314] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-19T20:44:54.222575] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T20:44:54.243216] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-19T20:44:54.401988] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-19T20:44:54.743906] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T20:44:55.043341] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-19T20:44:55.843308] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-19T20:44:56.337178] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T20:44:56.610982] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-19T20:44:56.643221] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-19T20:44:57.443295] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-19T20:44:57.504616] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-19T20:44:57.512853] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-09-19T20:44:57.513067] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-19T20:44:57.915241] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T20:44:57.942145] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-19T20:44:57.942232] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-19T20:44:57.943466] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-19T20:44:57.943565] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-19T20:44:57.944403] [INFO ] [REMOTE ] PJT: Full fetch complete (32124 records). [2025-09-19T20:44:57.944556] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-19T20:44:58.011408] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 54473 (keeping 200 days of data) [2025-09-19T20:44:58.243674] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-19T20:44:58.567277] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-19T20:44:58.567712] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-19T20:44:58.568760] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-19T20:44:58.569414] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-19T20:44:58.574323] [DEBUG] [LOCAL ] PJT: Trimmed 32124 records to 23163 (keeping 200 days of data) [2025-09-19T20:44:58.826226] [DEBUG] [LOCAL ] PJT: Primary data saved (23163 records). [2025-09-19T20:44:58.827566] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-19T20:44:58.828094] [INFO ] [MAIN ] Update Progress: 1692/2372 symbols completed. PJT took 27.2s. Estimated remaining: 1h 30m 23s. Rate: 7.5 symbols/min [2025-09-19T20:44:58.959572] [DEBUG] [LOCAL ] PINS: Primary data saved (54473 records). [2025-09-19T20:44:58.990669] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-19T20:44:58.990853] [INFO ] [MAIN ] Update Progress: 1693/2372 symbols completed. PINS took 42.2s. Estimated remaining: 1h 30m 12s. Rate: 7.5 symbols/min [2025-09-19T20:44:59.111203] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:59.196459] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:44:59.230469] [DEBUG] [LOCAL ] PKST: Loaded 19749 existing records from primary storage. [2025-09-19T20:44:59.230622] [INFO ] [MAIN ] PKST: Loaded 19749 existing records. [2025-09-19T20:44:59.436795] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:59.450552] [DEBUG] [LOCAL ] PKG: Loaded 39766 existing records from primary storage. [2025-09-19T20:44:59.448521] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-19T20:44:59.451752] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T20:44:59.451903] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-19T20:44:59.455761] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-19T20:44:59.454604] [INFO ] [MAIN ] PKG: Loaded 39766 existing records. [2025-09-19T20:44:59.461159] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-19T20:44:59.477927] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-19T20:44:59.837962] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:44:59.920825] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-19T20:44:59.958867] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-19T20:44:59.966709] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-19T20:44:59.980020] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-19T20:44:59.996270] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-19T20:44:59.990777] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-19T20:45:00.144544] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:45:00.421192] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:45:00.428063] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T20:45:00.643231] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-19T20:45:01.443281] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-19T20:45:02.243299] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-19T20:45:02.613681] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-19T20:45:03.043266] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-19T20:45:03.072938] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T20:45:03.178299] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-19T20:45:03.843306] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-19T20:45:04.643285] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-19T20:45:05.140955] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-19T20:45:05.443255] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-19T20:45:05.870851] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T20:45:06.243280] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-19T20:45:06.444209] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (3.40 seconds). [2025-09-19T20:45:06.453612] [INFO ] [REMOTE ] PK: Full fetch complete (76383 records). [2025-09-19T20:45:06.453862] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-19T20:45:06.815577] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T20:45:06.900729] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-19T20:45:06.900828] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-19T20:45:06.902025] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-19T20:45:06.902091] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-19T20:45:06.903773] [DEBUG] [LOCAL ] PK: Trimmed 76383 records to 53672 (keeping 200 days of data) [2025-09-19T20:45:07.093229] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-19T20:45:07.166824] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-19T20:45:07.267073] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-19T20:45:07.298666] [DEBUG] [LOCAL ] PK: Primary data saved (53672 records). [2025-09-19T20:45:07.298913] [INFO ] [MAIN ] PK: Full history saved. [2025-09-19T20:45:07.299378] [INFO ] [MAIN ] Update Progress: 1694/2372 symbols completed. PK took 33.6s. Estimated remaining: 1h 30m 4s. Rate: 7.5 symbols/min [2025-09-19T20:45:07.488760] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:45:07.527555] [DEBUG] [LOCAL ] PKX: Loaded 25600 existing records from primary storage. [2025-09-19T20:45:07.527818] [INFO ] [MAIN ] PKX: Loaded 25600 existing records. [2025-09-19T20:45:07.735020] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:45:07.735399] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-19T20:45:07.735465] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-19T20:45:07.736245] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-19T20:45:07.736309] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-19T20:45:07.848545] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-19T20:45:08.255769] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:45:08.550165] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T20:45:08.643337] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-19T20:45:09.443287] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-19T20:45:09.651369] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T20:45:09.737351] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T20:45:10.243329] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-19T20:45:10.797940] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T20:45:11.043263] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-19T20:45:11.568125] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T20:45:11.843262] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-19T20:45:12.643235] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-19T20:45:12.877523] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T20:45:13.067546] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T20:45:13.443318] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-19T20:45:14.243302] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-19T20:45:14.761065] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T20:45:15.043273] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-19T20:45:15.843277] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-19T20:45:16.173161] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-19T20:45:16.252620] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T20:45:16.601190] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T20:45:16.603879] [INFO ] [REMOTE ] PKE: Full fetch complete (16745 records). [2025-09-19T20:45:16.603955] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-19T20:45:16.648358] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-19T20:45:16.990575] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T20:45:17.000705] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-19T20:45:17.006103] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-19T20:45:17.006543] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-19T20:45:17.006621] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-19T20:45:17.007872] [DEBUG] [LOCAL ] PKE: Trimmed 16745 records to 12512 (keeping 200 days of data) [2025-09-19T20:45:17.091081] [DEBUG] [LOCAL ] PKE: Primary data saved (12512 records). [2025-09-19T20:45:17.091215] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-19T20:45:17.091301] [INFO ] [MAIN ] Update Progress: 1695/2372 symbols completed. PKE took 26.1s. Estimated remaining: 1h 29m 57s. Rate: 7.5 symbols/min [2025-09-19T20:45:17.262153] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:45:17.328716] [DEBUG] [LOCAL ] PL: Loaded 53494 existing records from primary storage. [2025-09-19T20:45:17.328883] [INFO ] [MAIN ] PL: Loaded 53494 existing records. [2025-09-19T20:45:17.448430] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-19T20:45:17.507216] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:45:17.507520] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-19T20:45:17.507592] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-19T20:45:17.508966] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-19T20:45:17.509030] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-19T20:45:17.921079] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:45:18.243295] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-19T20:45:18.523800] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T20:45:19.043254] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-19T20:45:19.277352] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T20:45:19.843259] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-19T20:45:20.643287] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-19T20:45:20.755796] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-19T20:45:20.787949] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T20:45:21.195175] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T20:45:21.443271] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-19T20:45:22.061179] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T20:45:22.243243] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-19T20:45:22.720348] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T20:45:23.043296] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-19T20:45:23.843269] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-19T20:45:24.211954] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T20:45:24.301281] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T20:45:24.643260] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-19T20:45:25.443348] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-19T20:45:26.130040] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T20:45:26.248396] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-19T20:45:26.268162] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-19T20:45:26.881283] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T20:45:27.043282] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-19T20:45:27.843306] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-19T20:45:27.877144] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T20:45:28.643330] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-19T20:45:29.443265] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-19T20:45:29.489329] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-19T20:45:29.588847] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T20:45:29.594886] [INFO ] [REMOTE ] PKG: Full fetch complete (57489 records). [2025-09-19T20:45:29.595011] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-19T20:45:29.984765] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-19T20:45:29.984891] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-19T20:45:29.985925] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-19T20:45:29.985994] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-19T20:45:29.987405] [DEBUG] [LOCAL ] PKG: Trimmed 57489 records to 40008 (keeping 200 days of data) [2025-09-19T20:45:30.075228] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T20:45:30.243223] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-19T20:45:30.274842] [DEBUG] [LOCAL ] PKG: Primary data saved (40008 records). [2025-09-19T20:45:30.274980] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-19T20:45:30.275085] [INFO ] [MAIN ] Update Progress: 1696/2372 symbols completed. PKG took 31.4s. Estimated remaining: 1h 29m 51s. Rate: 7.5 symbols/min [2025-09-19T20:45:30.452570] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:45:30.508359] [DEBUG] [LOCAL ] PLD: Loaded 53876 existing records from primary storage. [2025-09-19T20:45:30.508506] [INFO ] [MAIN ] PLD: Loaded 53876 existing records. [2025-09-19T20:45:30.686391] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:45:30.686695] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-19T20:45:30.686762] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-19T20:45:30.688018] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-19T20:45:30.688078] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-19T20:45:31.046527] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:45:31.046635] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-19T20:45:31.063675] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T20:45:31.430986] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T20:45:31.843260] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-19T20:45:32.643267] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-19T20:45:33.443275] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-19T20:45:33.488661] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T20:45:33.884816] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T20:45:34.140070] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-19T20:45:34.243302] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-19T20:45:34.773153] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T20:45:34.777264] [INFO ] [REMOTE ] PKX: Full fetch complete (38310 records). [2025-09-19T20:45:34.777375] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-19T20:45:35.050385] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-19T20:45:35.171798] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-19T20:45:35.171885] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-19T20:45:35.172632] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-19T20:45:35.172731] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-19T20:45:35.173603] [DEBUG] [LOCAL ] PKX: Trimmed 38310 records to 25728 (keeping 200 days of data) [2025-09-19T20:45:35.330295] [DEBUG] [LOCAL ] PKX: Primary data saved (25728 records). [2025-09-19T20:45:35.330467] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-19T20:45:35.330570] [INFO ] [MAIN ] Update Progress: 1697/2372 symbols completed. PKX took 28.0s. Estimated remaining: 1h 29m 42s. Rate: 7.5 symbols/min [2025-09-19T20:45:35.502712] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:45:35.553619] [DEBUG] [LOCAL ] PLNT: Loaded 48948 existing records from primary storage. [2025-09-19T20:45:35.553831] [INFO ] [MAIN ] PLNT: Loaded 48948 existing records. [2025-09-19T20:45:35.730792] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:45:35.731083] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-19T20:45:35.731152] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-19T20:45:35.732232] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-19T20:45:35.732292] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-19T20:45:35.844054] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-19T20:45:36.045530] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T20:45:36.068705] [INFO ] [REMOTE ] PKST: Full fetch complete (29778 records). [2025-09-19T20:45:36.079118] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-19T20:45:36.217969] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:45:36.528427] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-19T20:45:36.528544] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-19T20:45:36.529419] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-19T20:45:36.529591] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-19T20:45:36.530833] [DEBUG] [LOCAL ] PKST: Trimmed 29778 records to 19892 (keeping 200 days of data) [2025-09-19T20:45:36.651899] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-19T20:45:36.652130] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-19T20:45:36.702218] [DEBUG] [LOCAL ] PKST: Primary data saved (19892 records). [2025-09-19T20:45:36.702394] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-19T20:45:36.702513] [INFO ] [MAIN ] Update Progress: 1698/2372 symbols completed. PKST took 37.7s. Estimated remaining: 1h 29m 32s. Rate: 7.5 symbols/min [2025-09-19T20:45:36.878805] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:45:36.899844] [DEBUG] [LOCAL ] PLOW: Loaded 20914 existing records from primary storage. [2025-09-19T20:45:36.899986] [INFO ] [MAIN ] PLOW: Loaded 20914 existing records. [2025-09-19T20:45:37.075975] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:45:37.076246] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-19T20:45:37.076298] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-19T20:45:37.076878] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-19T20:45:37.076938] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-19T20:45:37.449406] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-19T20:45:37.455211] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:45:38.243243] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-19T20:45:38.356352] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-19T20:45:38.515184] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T20:45:39.032195] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T20:45:39.043148] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-19T20:45:39.637424] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T20:45:39.843257] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-19T20:45:40.636840] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T20:45:40.643201] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-19T20:45:41.443282] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-19T20:45:41.634868] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-19T20:45:41.880956] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T20:45:42.243303] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-19T20:45:43.043304] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-19T20:45:43.340670] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T20:45:43.565429] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T20:45:43.843265] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-19T20:45:44.503134] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-19T20:45:44.643218] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-19T20:45:44.864910] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T20:45:45.443329] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-19T20:45:46.243279] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-19T20:45:46.530296] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T20:45:47.043260] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-19T20:45:47.779090] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T20:45:47.843233] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-19T20:45:48.469120] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T20:45:48.622582] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-19T20:45:48.643221] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-19T20:45:49.443248] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-19T20:45:50.018568] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T20:45:50.243312] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-19T20:45:51.043290] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-19T20:45:51.418360] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-19T20:45:51.476943] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T20:45:51.772844] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T20:45:51.843238] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-19T20:45:52.359486] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T20:45:52.643275] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-19T20:45:53.443333] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-19T20:45:54.243290] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-19T20:45:54.339092] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-19T20:45:54.638704] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T20:45:54.718448] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T20:45:55.043286] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-19T20:45:55.843317] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-19T20:45:56.646111] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-19T20:45:56.652636] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-19T20:45:56.703122] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T20:45:57.443266] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-19T20:45:57.888057] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T20:45:58.243251] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-19T20:45:58.321728] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-19T20:45:58.330322] [INFO ] [REMOTE ] PL: Full fetch complete (76944 records). [2025-09-19T20:45:58.330466] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-19T20:45:58.769135] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-19T20:45:58.769278] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-19T20:45:58.770533] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-19T20:45:58.770604] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-19T20:45:58.772389] [DEBUG] [LOCAL ] PL: Trimmed 76944 records to 53884 (keeping 200 days of data) [2025-09-19T20:45:59.047620] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-19T20:45:59.099476] [DEBUG] [LOCAL ] PL: Primary data saved (53884 records). [2025-09-19T20:45:59.099614] [INFO ] [MAIN ] PL: Full history saved. [2025-09-19T20:45:59.099744] [INFO ] [MAIN ] Update Progress: 1699/2372 symbols completed. PL took 42.0s. Estimated remaining: 1h 29m 29s. Rate: 7.5 symbols/min [2025-09-19T20:45:59.272156] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:45:59.305122] [DEBUG] [LOCAL ] PLYM: Loaded 33320 existing records from primary storage. [2025-09-19T20:45:59.305268] [INFO ] [MAIN ] PLYM: Loaded 33320 existing records. [2025-09-19T20:45:59.511689] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T20:45:59.510819] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:45:59.516063] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-19T20:45:59.516475] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-19T20:45:59.516802] [INFO ] [REMOTE ] PLOW: Full fetch complete (28885 records). [2025-09-19T20:45:59.517067] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-19T20:45:59.522994] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-19T20:45:59.530440] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-19T20:46:00.313978] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:00.333037] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-19T20:46:00.341474] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-19T20:46:00.399018] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-19T20:46:00.399314] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-19T20:46:00.400600] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-19T20:46:00.401449] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-19T20:46:00.402973] [DEBUG] [LOCAL ] PLOW: Trimmed 28885 records to 20993 (keeping 200 days of data) [2025-09-19T20:46:00.548266] [DEBUG] [LOCAL ] PLOW: Primary data saved (20993 records). [2025-09-19T20:46:00.548485] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-19T20:46:00.548667] [INFO ] [MAIN ] Update Progress: 1700/2372 symbols completed. PLOW took 23.8s. Estimated remaining: 1h 29m 19s. Rate: 7.5 symbols/min [2025-09-19T20:46:00.655405] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-19T20:46:00.743803] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:46:00.744097] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-19T20:46:00.744171] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-19T20:46:00.744409] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-19T20:46:00.744482] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-19T20:46:00.744548] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-19T20:46:00.744605] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-19T20:46:01.224281] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:01.276108] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T20:46:01.443345] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-19T20:46:02.026610] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T20:46:02.243251] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-19T20:46:02.790020] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-19T20:46:02.798782] [INFO ] [REMOTE ] PLD: Full fetch complete (77431 records). [2025-09-19T20:46:02.798966] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-19T20:46:03.055603] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-19T20:46:03.232626] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-19T20:46:03.232907] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-19T20:46:03.234089] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-19T20:46:03.234175] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-19T20:46:03.264336] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T20:46:03.262806] [DEBUG] [LOCAL ] PLD: Trimmed 77431 records to 54265 (keeping 200 days of data) [2025-09-19T20:46:03.626097] [DEBUG] [LOCAL ] PLD: Primary data saved (54265 records). [2025-09-19T20:46:03.626243] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-19T20:46:03.627151] [INFO ] [MAIN ] Update Progress: 1701/2372 symbols completed. PLD took 33.4s. Estimated remaining: 1h 29m 9s. Rate: 7.5 symbols/min [2025-09-19T20:46:03.798260] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:46:03.816804] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T20:46:03.843492] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-19T20:46:03.845199] [DEBUG] [LOCAL ] PML: Loaded 20510 existing records from primary storage. [2025-09-19T20:46:03.845292] [INFO ] [MAIN ] PML: Loaded 20510 existing records. [2025-09-19T20:46:04.032997] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:46:04.033297] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-19T20:46:04.033346] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-19T20:46:04.033890] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-19T20:46:04.033950] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-19T20:46:04.398598] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:04.643260] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-19T20:46:05.035137] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T20:46:05.443268] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-19T20:46:05.615148] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T20:46:06.243279] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-19T20:46:06.298158] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T20:46:06.919282] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T20:46:07.043261] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-19T20:46:07.843276] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-19T20:46:08.193919] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T20:46:08.643278] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-19T20:46:09.185082] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-19T20:46:09.192219] [INFO ] [REMOTE ] PLNT: Full fetch complete (70073 records). [2025-09-19T20:46:09.192354] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-19T20:46:09.459305] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-19T20:46:09.614239] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-19T20:46:09.614336] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-19T20:46:09.615452] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-19T20:46:09.615521] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-19T20:46:09.617219] [DEBUG] [LOCAL ] PLNT: Trimmed 70073 records to 49283 (keeping 200 days of data) [2025-09-19T20:46:09.916616] [DEBUG] [LOCAL ] PLNT: Primary data saved (49283 records). [2025-09-19T20:46:09.916788] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-19T20:46:09.917273] [INFO ] [MAIN ] Update Progress: 1702/2372 symbols completed. PLNT took 34.6s. Estimated remaining: 1h 29m 0s. Rate: 7.5 symbols/min [2025-09-19T20:46:10.115573] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:46:10.153973] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T20:46:10.158972] [DEBUG] [LOCAL ] PMM: Loaded 10814 existing records from primary storage. [2025-09-19T20:46:10.171095] [INFO ] [MAIN ] PMM: Loaded 10814 existing records. [2025-09-19T20:46:10.248346] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-19T20:46:10.401521] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:46:10.402028] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-19T20:46:10.402166] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-19T20:46:10.402738] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-19T20:46:10.402811] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-19T20:46:10.590637] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T20:46:10.800137] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:10.819313] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T20:46:11.043331] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-19T20:46:11.843260] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-19T20:46:12.246877] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T20:46:12.456393] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-19T20:46:12.643293] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-19T20:46:13.028320] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T20:46:13.443239] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-19T20:46:13.456022] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T20:46:14.243320] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-19T20:46:15.043241] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-19T20:46:15.565702] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T20:46:15.790009] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-19T20:46:15.843230] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-19T20:46:16.435843] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T20:46:16.643263] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-19T20:46:17.443271] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-19T20:46:17.888469] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T20:46:18.243302] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-19T20:46:18.378548] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-19T20:46:18.979696] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T20:46:19.030139] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-19T20:46:19.043206] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-19T20:46:19.843259] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-19T20:46:20.615082] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T20:46:20.643219] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-19T20:46:20.988074] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T20:46:21.443269] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-19T20:46:22.243285] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-19T20:46:22.346682] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T20:46:22.368287] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T20:46:23.043240] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-19T20:46:23.478870] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T20:46:23.843498] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-19T20:46:24.643300] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-19T20:46:24.768486] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T20:46:25.208914] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T20:46:25.443290] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-19T20:46:26.185113] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-19T20:46:26.243223] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-19T20:46:26.734112] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T20:46:26.740711] [INFO ] [REMOTE ] PLYM: Full fetch complete (46182 records). [2025-09-19T20:46:26.740866] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-19T20:46:27.050370] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-19T20:46:27.145992] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-19T20:46:27.146133] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-19T20:46:27.147086] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-19T20:46:27.147203] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-19T20:46:27.148471] [DEBUG] [LOCAL ] PLYM: Trimmed 46182 records to 33622 (keeping 200 days of data) [2025-09-19T20:46:27.359553] [DEBUG] [LOCAL ] PLYM: Primary data saved (33622 records). [2025-09-19T20:46:27.359726] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-19T20:46:27.359838] [INFO ] [MAIN ] Update Progress: 1703/2372 symbols completed. PLYM took 28.3s. Estimated remaining: 1h 28m 56s. Rate: 7.5 symbols/min [2025-09-19T20:46:27.529381] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:46:27.542089] [DEBUG] [LOCAL ] PMO: Loaded 10785 existing records from primary storage. [2025-09-19T20:46:27.542198] [INFO ] [MAIN ] PMO: Loaded 10785 existing records. [2025-09-19T20:46:27.719736] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:46:27.720069] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-19T20:46:27.720184] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-19T20:46:27.720602] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-19T20:46:27.720690] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-19T20:46:27.858929] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-19T20:46:28.078637] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:28.388699] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T20:46:28.643244] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-19T20:46:28.825879] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-19T20:46:28.956879] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T20:46:29.443269] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-19T20:46:30.164462] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T20:46:30.243281] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-19T20:46:31.043251] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-19T20:46:31.468553] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T20:46:31.843237] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-19T20:46:31.955811] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-19T20:46:32.047107] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T20:46:32.643257] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-19T20:46:32.877898] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T20:46:33.443269] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-19T20:46:34.049332] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T20:46:34.243258] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-19T20:46:34.435878] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T20:46:35.043267] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-19T20:46:35.619569] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T20:46:35.624419] [INFO ] [REMOTE ] PML: Full fetch complete (29563 records). [2025-09-19T20:46:35.624513] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-19T20:46:35.852420] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-19T20:46:36.016400] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-19T20:46:36.016507] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-19T20:46:36.017170] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-19T20:46:36.017233] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-19T20:46:36.018109] [DEBUG] [LOCAL ] PML: Trimmed 29563 records to 20606 (keeping 200 days of data) [2025-09-19T20:46:36.142218] [DEBUG] [LOCAL ] PML: Primary data saved (20606 records). [2025-09-19T20:46:36.142361] [INFO ] [MAIN ] PML: Full history saved. [2025-09-19T20:46:36.142453] [INFO ] [MAIN ] Update Progress: 1704/2372 symbols completed. PML took 32.5s. Estimated remaining: 1h 28m 48s. Rate: 7.5 symbols/min [2025-09-19T20:46:36.323164] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:46:36.366433] [DEBUG] [LOCAL ] PMT: Loaded 40647 existing records from primary storage. [2025-09-19T20:46:36.366606] [INFO ] [MAIN ] PMT: Loaded 40647 existing records. [2025-09-19T20:46:36.554137] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:46:36.554389] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-19T20:46:36.554441] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-19T20:46:36.555751] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-19T20:46:36.555811] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-19T20:46:36.652567] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-19T20:46:36.916508] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:36.954193] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T20:46:36.956180] [INFO ] [REMOTE ] PMM: Full fetch complete (18350 records). [2025-09-19T20:46:36.956251] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-19T20:46:37.322713] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-19T20:46:37.322811] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-19T20:46:37.323277] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-19T20:46:37.323397] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-19T20:46:37.324219] [DEBUG] [LOCAL ] PMM: Trimmed 18350 records to 10862 (keeping 200 days of data) [2025-09-19T20:46:37.418834] [DEBUG] [LOCAL ] PMM: Primary data saved (10862 records). [2025-09-19T20:46:37.418981] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-19T20:46:37.419115] [INFO ] [MAIN ] Update Progress: 1705/2372 symbols completed. PMM took 27.5s. Estimated remaining: 1h 28m 38s. Rate: 7.5 symbols/min [2025-09-19T20:46:37.421409] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-19T20:46:37.452829] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-19T20:46:37.604887] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:46:37.605090] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-19T20:46:37.605146] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-19T20:46:37.605289] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-19T20:46:37.605333] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-19T20:46:37.605404] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-19T20:46:37.605465] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-19T20:46:37.893419] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T20:46:37.976891] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:38.243285] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-19T20:46:38.935922] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T20:46:39.043310] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-19T20:46:39.502464] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-19T20:46:39.843283] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-19T20:46:40.643285] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-19T20:46:40.829871] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T20:46:40.838119] [INFO ] [REMOTE ] PM: Full fetch complete (77310 records). [2025-09-19T20:46:40.838371] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-19T20:46:40.839617] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:46:40.839860] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:46:40.839940] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:46:40.858212] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-19T20:46:40.858353] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-19T20:46:40.858419] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-19T20:46:40.860813] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-09-19T20:46:40.860905] [INFO ] [MAIN ] Update Progress: 1706/2372 symbols completed. PM took 40.3s. Estimated remaining: 1h 28m 28s. Rate: 7.5 symbols/min [2025-09-19T20:46:40.926943] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T20:46:41.047052] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:46:41.047251] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-19T20:46:41.047318] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-19T20:46:41.047462] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-19T20:46:41.047504] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-19T20:46:41.047545] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-19T20:46:41.047576] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-19T20:46:41.413993] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:41.443211] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-19T20:46:41.604813] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T20:46:41.718198] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:46:41.718531] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-19T20:46:42.243263] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-19T20:46:42.545694] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:46:42.546022] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-19T20:46:43.043281] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-19T20:46:43.843231] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-19T20:46:44.235505] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T20:46:44.643263] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-19T20:46:45.202009] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T20:46:45.443271] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-19T20:46:45.604771] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T20:46:46.117192] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T20:46:46.243252] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-19T20:46:47.043269] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-19T20:46:47.636978] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-19T20:46:47.843264] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-19T20:46:48.350522] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T20:46:48.389181] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T20:46:48.643258] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-19T20:46:49.008825] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-19T20:46:49.443266] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-19T20:46:50.243266] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-19T20:46:51.043259] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-19T20:46:51.403973] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T20:46:51.463502] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T20:46:51.499688] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-19T20:46:51.843255] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-19T20:46:52.643286] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-19T20:46:52.862736] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T20:46:53.443350] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-19T20:46:53.610157] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T20:46:54.243414] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-19T20:46:54.411389] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T20:46:54.417345] [INFO ] [REMOTE ] PMO: Full fetch complete (17490 records). [2025-09-19T20:46:54.417612] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-19T20:46:54.920633] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-19T20:46:54.920772] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-19T20:46:54.921311] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-19T20:46:54.921385] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-19T20:46:54.922259] [DEBUG] [LOCAL ] PMO: Trimmed 17490 records to 10805 (keeping 200 days of data) [2025-09-19T20:46:54.995208] [DEBUG] [LOCAL ] PMO: Primary data saved (10805 records). [2025-09-19T20:46:54.995366] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-19T20:46:54.995512] [INFO ] [MAIN ] Update Progress: 1707/2372 symbols completed. PMO took 27.6s. Estimated remaining: 1h 28m 22s. Rate: 7.5 symbols/min [2025-09-19T20:46:55.045903] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-19T20:46:55.136616] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T20:46:55.195612] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:46:55.195861] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-19T20:46:55.195908] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-19T20:46:55.196069] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-19T20:46:55.196114] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-19T20:46:55.196224] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-19T20:46:55.196276] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-19T20:46:55.572337] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:46:55.575566] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-19T20:46:55.843288] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-19T20:46:56.150450] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:46:56.151201] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-19T20:46:56.643273] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-19T20:46:56.946438] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:46:56.946885] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-19T20:46:57.443305] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-19T20:46:57.734250] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:46:57.734572] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-19T20:46:58.243263] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-19T20:46:59.043269] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-19T20:46:59.388554] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:46:59.388940] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-19T20:46:59.843321] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-19T20:47:00.070891] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T20:47:00.643296] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-19T20:47:00.676765] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T20:47:00.976979] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:47:00.977300] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-19T20:47:01.443278] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-19T20:47:01.935850] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-19T20:47:02.243261] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-19T20:47:02.681377] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-19T20:47:03.043282] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-19T20:47:03.485612] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T20:47:03.486374] [INFO ] [REMOTE ] PMTU: Full fetch complete (1199 records). [2025-09-19T20:47:03.486443] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-19T20:47:03.681260] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-19T20:47:03.681490] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:47:03.681575] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:47:03.681711] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-19T20:47:03.681802] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-19T20:47:03.681856] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-19T20:47:03.681943] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-19T20:47:03.682093] [INFO ] [MAIN ] Update Progress: 1708/2372 symbols completed. PMTU took 26.3s. Estimated remaining: 1h 28m 15s. Rate: 7.5 symbols/min [2025-09-19T20:47:03.861134] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-19T20:47:03.864811] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:47:03.866457] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-19T20:47:03.866514] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-19T20:47:03.866768] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-19T20:47:03.866846] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-19T20:47:03.866911] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-19T20:47:03.866962] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-19T20:47:04.228972] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:47:04.643328] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-19T20:47:05.409404] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T20:47:05.443228] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-19T20:47:05.720247] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T20:47:06.228302] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T20:47:06.243220] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-19T20:47:06.979958] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T20:47:07.043272] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-19T20:47:07.831956] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-19T20:47:07.843211] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-19T20:47:08.590887] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T20:47:08.592435] [INFO ] [REMOTE ] PMTV: Full fetch complete (6066 records). [2025-09-19T20:47:08.592554] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-19T20:47:08.648465] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-19T20:47:08.782107] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 150 unique days, need 200 days [2025-09-19T20:47:08.782329] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:47:08.782396] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:47:08.782475] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-19T20:47:08.782567] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-19T20:47:08.782658] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-19T20:47:08.782731] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-19T20:47:08.782832] [INFO ] [MAIN ] Update Progress: 1709/2372 symbols completed. PMTV took 27.9s. Estimated remaining: 1h 28m 6s. Rate: 7.5 symbols/min [2025-09-19T20:47:08.959720] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:47:08.977321] [DEBUG] [LOCAL ] PNI: Loaded 6842 existing records from primary storage. [2025-09-19T20:47:08.977478] [INFO ] [MAIN ] PNI: Loaded 6842 existing records. [2025-09-19T20:47:09.157534] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:47:09.157843] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-19T20:47:09.157922] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-19T20:47:09.158370] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-19T20:47:09.158434] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-19T20:47:09.448505] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-19T20:47:09.557760] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:47:10.243285] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-19T20:47:10.633001] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T20:47:11.027954] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-19T20:47:11.043254] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-19T20:47:11.396758] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T20:47:11.843259] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-19T20:47:12.178875] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T20:47:12.643284] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-19T20:47:12.927387] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:47:12.927855] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-19T20:47:13.443373] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-19T20:47:13.909334] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T20:47:14.243312] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-19T20:47:15.043343] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-19T20:47:15.243695] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T20:47:15.305719] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T20:47:15.843277] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-19T20:47:16.643357] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-19T20:47:16.918338] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T20:47:17.174746] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T20:47:17.443317] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-19T20:47:18.196162] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T20:47:18.201813] [INFO ] [REMOTE ] PMT: Full fetch complete (58084 records). [2025-09-19T20:47:18.201925] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-19T20:47:18.248517] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-19T20:47:18.520415] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T20:47:18.599722] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-19T20:47:18.599822] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-19T20:47:18.600764] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-19T20:47:18.600851] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-19T20:47:18.602922] [DEBUG] [LOCAL ] PMT: Trimmed 58084 records to 40944 (keeping 200 days of data) [2025-09-19T20:47:18.880879] [DEBUG] [LOCAL ] PMT: Primary data saved (40944 records). [2025-09-19T20:47:18.881048] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-19T20:47:18.881219] [INFO ] [MAIN ] Update Progress: 1710/2372 symbols completed. PMT took 42.7s. Estimated remaining: 1h 27m 58s. Rate: 7.5 symbols/min [2025-09-19T20:47:19.048746] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-19T20:47:19.052429] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:47:19.058242] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-19T20:47:19.091449] [DEBUG] [LOCAL ] PNNT: Loaded 33225 existing records from primary storage. [2025-09-19T20:47:19.091613] [INFO ] [MAIN ] PNNT: Loaded 33225 existing records. [2025-09-19T20:47:19.269959] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:47:19.270242] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-19T20:47:19.270291] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-19T20:47:19.271462] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-19T20:47:19.271525] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-19T20:47:19.634239] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:47:19.760145] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T20:47:19.843275] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-19T20:47:20.643326] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-19T20:47:21.173382] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T20:47:21.443272] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-19T20:47:22.243292] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-19T20:47:22.328102] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T20:47:23.043308] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-19T20:47:23.077085] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T20:47:23.078247] [INFO ] [REMOTE ] PMTW: Full fetch complete (3629 records). [2025-09-19T20:47:23.078317] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-19T20:47:23.260339] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-19T20:47:23.260680] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:47:23.260776] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:47:23.260872] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-19T20:47:23.260957] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-19T20:47:23.260996] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-19T20:47:23.261037] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-19T20:47:23.261097] [INFO ] [MAIN ] Update Progress: 1711/2372 symbols completed. PMTW took 28.3s. Estimated remaining: 1h 27m 49s. Rate: 7.5 symbols/min [2025-09-19T20:47:23.488411] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:47:23.488917] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-19T20:47:23.488973] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-19T20:47:23.489250] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-19T20:47:23.489304] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-19T20:47:23.489348] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-19T20:47:23.489429] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-19T20:47:23.852250] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-19T20:47:23.858435] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:47:23.959904] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-19T20:47:24.102186] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T20:47:24.643302] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-19T20:47:25.443322] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-19T20:47:25.449956] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T20:47:25.537458] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T20:47:26.243344] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-19T20:47:27.043267] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-19T20:47:27.322981] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T20:47:27.843316] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-19T20:47:27.922953] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T20:47:28.622262] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T20:47:28.643218] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-19T20:47:29.194833] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T20:47:29.443278] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-19T20:47:30.250468] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-19T20:47:30.253326] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T20:47:31.013553] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T20:47:31.043288] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-19T20:47:31.329955] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T20:47:31.843273] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-19T20:47:32.643281] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-19T20:47:32.814246] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T20:47:32.816483] [INFO ] [REMOTE ] PNI: Full fetch complete (10070 records). [2025-09-19T20:47:32.816558] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-19T20:47:33.200935] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-19T20:47:33.201166] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-19T20:47:33.201551] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-19T20:47:33.201668] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-19T20:47:33.202490] [DEBUG] [LOCAL ] PNI: Trimmed 10070 records to 6860 (keeping 200 days of data) [2025-09-19T20:47:33.281755] [DEBUG] [LOCAL ] PNI: Primary data saved (6860 records). [2025-09-19T20:47:33.282436] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-19T20:47:33.285534] [INFO ] [MAIN ] Update Progress: 1712/2372 symbols completed. PNI took 24.5s. Estimated remaining: 1h 27m 42s. Rate: 7.5 symbols/min [2025-09-19T20:47:33.285332] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T20:47:33.447506] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-19T20:47:33.480416] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:47:33.539810] [DEBUG] [LOCAL ] PNW: Loaded 46459 existing records from primary storage. [2025-09-19T20:47:33.539969] [INFO ] [MAIN ] PNW: Loaded 46459 existing records. [2025-09-19T20:47:33.721697] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:47:33.722039] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-19T20:47:33.722098] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-19T20:47:33.724089] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-19T20:47:33.724151] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-19T20:47:34.082395] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:47:34.243240] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-19T20:47:34.315228] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T20:47:35.043335] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-19T20:47:35.388199] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T20:47:35.843301] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-19T20:47:36.137598] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T20:47:36.469233] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T20:47:36.643259] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-19T20:47:37.443274] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-19T20:47:37.826717] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T20:47:38.243271] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-19T20:47:38.384954] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T20:47:39.043281] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-19T20:47:39.779775] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T20:47:39.843216] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-19T20:47:40.074558] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T20:47:40.640348] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T20:47:40.646225] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-19T20:47:41.443243] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-19T20:47:41.538307] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T20:47:42.243268] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-19T20:47:42.489122] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T20:47:42.644976] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-19T20:47:42.654027] [INFO ] [REMOTE ] PNC: Full fetch complete (75158 records). [2025-09-19T20:47:42.654161] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-19T20:47:42.655038] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:47:42.655129] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:47:42.655171] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:47:42.655210] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-19T20:47:42.655283] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-19T20:47:42.655339] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-19T20:47:42.655383] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-09-19T20:47:42.655444] [INFO ] [MAIN ] Update Progress: 1713/2372 symbols completed. PNC took 39.0s. Estimated remaining: 1h 27m 34s. Rate: 7.5 symbols/min [2025-09-19T20:47:42.832186] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:47:42.865942] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-19T20:47:42.933191] [DEBUG] [LOCAL ] POR: Loaded 47313 existing records from primary storage. [2025-09-19T20:47:42.933369] [INFO ] [MAIN ] POR: Loaded 47313 existing records. [2025-09-19T20:47:43.048420] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-19T20:47:43.112394] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:47:43.112666] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-19T20:47:43.112729] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-19T20:47:43.113821] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-19T20:47:43.113881] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-19T20:47:43.470209] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:47:43.843257] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-19T20:47:44.643271] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-19T20:47:44.917755] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T20:47:45.443263] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-19T20:47:45.722998] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T20:47:46.243265] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-19T20:47:46.420981] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T20:47:47.043267] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-19T20:47:47.482241] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T20:47:47.843286] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-19T20:47:48.105500] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T20:47:48.643272] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-19T20:47:49.107312] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T20:47:49.150062] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T20:47:49.443351] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-19T20:47:50.243269] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-19T20:47:50.542789] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T20:47:51.043334] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-19T20:47:51.378141] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T20:47:51.686147] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T20:47:51.843299] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-19T20:47:52.163891] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T20:47:52.643274] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-19T20:47:52.860493] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T20:47:52.868550] [INFO ] [REMOTE ] PNR: Full fetch complete (68953 records). [2025-09-19T20:47:52.868803] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-19T20:47:52.870484] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:47:52.870784] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:47:52.870857] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:47:52.870948] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-19T20:47:52.871046] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-19T20:47:52.871089] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-19T20:47:52.871131] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-09-19T20:47:52.871229] [INFO ] [MAIN ] Update Progress: 1714/2372 symbols completed. PNR took 29.6s. Estimated remaining: 1h 27m 27s. Rate: 7.5 symbols/min [2025-09-19T20:47:53.049086] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:47:53.102937] [DEBUG] [LOCAL ] POST: Loaded 39219 existing records from primary storage. [2025-09-19T20:47:53.103111] [INFO ] [MAIN ] POST: Loaded 39219 existing records. [2025-09-19T20:47:53.279378] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:47:53.279664] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-19T20:47:53.279726] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-19T20:47:53.280878] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-19T20:47:53.280941] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-19T20:47:53.446256] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-19T20:47:53.651891] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:47:54.243305] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-19T20:47:54.702808] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T20:47:55.043298] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-19T20:47:55.443043] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T20:47:55.729888] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T20:47:55.735164] [INFO ] [REMOTE ] PNNT: Full fetch complete (47406 records). [2025-09-19T20:47:55.735262] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-19T20:47:55.848453] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-19T20:47:56.118391] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-19T20:47:56.118492] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-19T20:47:56.119299] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-19T20:47:56.119369] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-19T20:47:56.120490] [DEBUG] [LOCAL ] PNNT: Trimmed 47406 records to 33466 (keeping 200 days of data) [2025-09-19T20:47:56.315238] [DEBUG] [LOCAL ] PNNT: Primary data saved (33466 records). [2025-09-19T20:47:56.315375] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-19T20:47:56.315459] [INFO ] [MAIN ] Update Progress: 1715/2372 symbols completed. PNNT took 37.4s. Estimated remaining: 1h 27m 18s. Rate: 7.5 symbols/min [2025-09-19T20:47:56.485764] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:47:56.545472] [DEBUG] [LOCAL ] PPG: Loaded 51114 existing records from primary storage. [2025-09-19T20:47:56.545669] [INFO ] [MAIN ] PPG: Loaded 51114 existing records. [2025-09-19T20:47:56.646540] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-19T20:47:56.732635] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:47:56.732944] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-19T20:47:56.733010] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-19T20:47:56.734326] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-19T20:47:56.734387] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-19T20:47:57.090391] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:47:57.118156] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T20:47:57.158695] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T20:47:57.443327] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-19T20:47:58.243241] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-19T20:47:58.901131] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T20:47:59.043320] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-19T20:47:59.098560] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T20:47:59.622052] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T20:47:59.843270] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-19T20:48:00.643237] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-19T20:48:01.295680] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-19T20:48:01.443365] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-19T20:48:01.821406] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T20:48:02.243317] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-19T20:48:03.043306] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-19T20:48:03.281608] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-19T20:48:03.843272] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-19T20:48:04.629944] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (3.19 seconds). [2025-09-19T20:48:04.643220] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-19T20:48:04.797964] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-19T20:48:05.443323] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-19T20:48:05.649011] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-19T20:48:05.735254] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T20:48:06.243298] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-19T20:48:06.397814] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T20:48:07.043288] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-19T20:48:07.726676] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T20:48:07.782542] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T20:48:07.789519] [INFO ] [REMOTE ] PNW: Full fetch complete (66281 records). [2025-09-19T20:48:07.789683] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-19T20:48:07.854634] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-19T20:48:08.186529] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-19T20:48:08.186662] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-19T20:48:08.187625] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-19T20:48:08.187706] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-19T20:48:08.189108] [DEBUG] [LOCAL ] PNW: Trimmed 66281 records to 46778 (keeping 200 days of data) [2025-09-19T20:48:08.508438] [DEBUG] [LOCAL ] PNW: Primary data saved (46778 records). [2025-09-19T20:48:08.508623] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-19T20:48:08.508777] [INFO ] [MAIN ] Update Progress: 1716/2372 symbols completed. PNW took 35.2s. Estimated remaining: 1h 27m 11s. Rate: 7.5 symbols/min [2025-09-19T20:48:08.647277] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-19T20:48:08.726706] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:48:08.727157] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-19T20:48:08.727379] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-19T20:48:08.727795] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-19T20:48:08.728024] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-19T20:48:08.728157] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-19T20:48:08.728310] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-19T20:48:08.966306] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T20:48:09.179750] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:48:09.443275] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-19T20:48:10.243397] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-19T20:48:10.502192] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-19T20:48:10.788982] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T20:48:11.043299] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-19T20:48:11.486225] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-19T20:48:11.493388] [INFO ] [REMOTE ] POR: Full fetch complete (67829 records). [2025-09-19T20:48:11.493568] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-19T20:48:11.849999] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-19T20:48:11.897727] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-19T20:48:11.897813] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-19T20:48:11.898881] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-19T20:48:11.898944] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-19T20:48:11.900326] [DEBUG] [LOCAL ] POR: Trimmed 67829 records to 47675 (keeping 200 days of data) [2025-09-19T20:48:12.203227] [DEBUG] [LOCAL ] POR: Primary data saved (47675 records). [2025-09-19T20:48:12.203578] [INFO ] [MAIN ] POR: Full history saved. [2025-09-19T20:48:12.204274] [INFO ] [MAIN ] Update Progress: 1717/2372 symbols completed. POR took 29.5s. Estimated remaining: 1h 27m 2s. Rate: 7.5 symbols/min [2025-09-19T20:48:12.330130] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T20:48:12.643289] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-19T20:48:14.327083] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-19T20:48:14.335627] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-19T20:48:14.532191] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (3.49 seconds). [2025-09-19T20:48:14.543437] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-19T20:48:15.326794] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-19T20:48:15.337968] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-19T20:48:16.088490] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T20:48:16.095848] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-19T20:48:17.990139] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T20:48:18.004536] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-19T20:48:19.852571] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T20:48:19.861815] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-19T20:48:21.530165] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (6.99 seconds). [2025-09-19T20:48:21.540982] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-19T20:48:21.584984] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T20:48:21.591368] [INFO ] [REMOTE ] POST: Full fetch complete (55788 records). [2025-09-19T20:48:21.591490] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-19T20:48:21.995591] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-19T20:48:21.995706] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-19T20:48:21.996596] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-19T20:48:21.996672] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-19T20:48:21.997974] [DEBUG] [LOCAL ] POST: Trimmed 55788 records to 39517 (keeping 200 days of data) [2025-09-19T20:48:22.246596] [DEBUG] [LOCAL ] POST: Primary data saved (39517 records). [2025-09-19T20:48:22.246779] [INFO ] [MAIN ] POST: Full history saved. [2025-09-19T20:48:22.246874] [INFO ] [MAIN ] Update Progress: 1718/2372 symbols completed. POST took 29.4s. Estimated remaining: 1h 26m 54s. Rate: 7.5 symbols/min [2025-09-19T20:48:25.443529] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (10.11 seconds). [2025-09-19T20:48:25.454078] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-19T20:48:27.818933] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-19T20:48:27.830939] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-19T20:48:28.473705] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (6.93 seconds). [2025-09-19T20:48:28.484253] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-19T20:48:30.241549] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-19T20:48:30.253199] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-19T20:48:30.656827] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T20:48:30.668350] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-19T20:48:32.467289] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-19T20:48:32.478630] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-19T20:48:32.775538] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T20:48:32.786452] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-19T20:48:34.715481] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T20:48:34.723077] [INFO ] [REMOTE ] PPG: Full fetch complete (73708 records). [2025-09-19T20:48:34.723226] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-19T20:48:35.122397] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-19T20:48:35.122496] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-19T20:48:35.123538] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-19T20:48:35.123605] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-19T20:48:35.125252] [DEBUG] [LOCAL ] PPG: Trimmed 73708 records to 51474 (keeping 200 days of data) [2025-09-19T20:48:35.471075] [DEBUG] [LOCAL ] PPG: Primary data saved (51474 records). [2025-09-19T20:48:35.471229] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-19T20:48:35.472496] [INFO ] [MAIN ] Update Progress: 1719/2372 symbols completed. PPG took 39.2s. Estimated remaining: 1h 26m 49s. Rate: 7.5 symbols/min [2025-09-19T20:48:37.513121] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (5.03 seconds). [2025-09-19T20:48:37.524853] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-19T20:48:39.391066] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T20:48:39.403901] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-19T20:48:41.558554] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T20:48:41.570482] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-19T20:48:42.624091] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T20:48:42.632018] [INFO ] [REMOTE ] PPL: Full fetch complete (77027 records). [2025-09-19T20:48:42.632191] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-19T20:48:42.633311] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:48:42.633431] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:48:42.633505] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:48:42.633587] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-19T20:48:42.633702] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-19T20:48:42.633761] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-19T20:48:42.633831] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-09-19T20:48:42.633916] [INFO ] [MAIN ] Update Progress: 1720/2372 symbols completed. PPL took 34.1s. Estimated remaining: 1h 26m 40s. Rate: 7.5 symbols/min [2025-09-19T20:48:43.319957] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:48:43.444926] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:48:43.444073] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:48:43.445855] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-19T20:48:43.446004] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-19T20:48:43.440245] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:48:43.450749] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-19T20:48:43.450814] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-19T20:48:43.450858] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-19T20:48:43.450890] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-19T20:48:43.644337] [DEBUG] [LOCAL ] PPT: Loaded 20464 existing records from primary storage. [2025-09-19T20:48:43.677194] [INFO ] [MAIN ] PPT: Loaded 20464 existing records. [2025-09-19T20:48:43.812156] [DEBUG] [LOCAL ] PRA: Loaded 34928 existing records from primary storage. [2025-09-19T20:48:43.846043] [INFO ] [MAIN ] PRA: Loaded 34928 existing records. [2025-09-19T20:48:44.074797] [DEBUG] [LOCAL ] PR: Loaded 53999 existing records from primary storage. [2025-09-19T20:48:44.129049] [INFO ] [MAIN ] PR: Loaded 53999 existing records. [2025-09-19T20:48:44.242144] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:48:44.257417] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:48:44.287341] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-19T20:48:44.386360] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-19T20:48:44.396978] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-19T20:48:44.397209] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:48:44.402925] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-19T20:48:44.413583] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-19T20:48:44.403170] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-19T20:48:44.459753] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-19T20:48:44.525028] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-19T20:48:44.538000] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-19T20:48:44.525143] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:48:44.632884] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-19T20:48:44.660091] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-19T20:48:44.710176] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-19T20:48:44.774345] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-19T20:48:45.298487] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T20:48:45.327250] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-19T20:48:45.425738] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:48:45.505587] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:48:45.514939] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-19T20:48:45.534097] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-19T20:48:45.637964] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:48:45.638316] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-19T20:48:46.010990] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T20:48:46.012254] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-19T20:48:46.605309] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-19T20:48:46.607003] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-19T20:48:46.932112] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T20:48:46.937016] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-19T20:48:47.225962] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T20:48:47.227448] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-19T20:48:47.406949] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T20:48:47.412560] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-19T20:48:47.849902] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-19T20:48:47.861332] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-19T20:48:47.874589] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T20:48:47.878973] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-19T20:48:47.982948] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T20:48:47.985126] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-19T20:48:48.735602] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T20:48:48.740338] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-19T20:48:48.756016] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T20:48:48.757794] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-19T20:48:49.182066] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T20:48:49.186607] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-19T20:48:49.607602] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T20:48:49.609867] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-19T20:48:50.042887] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T20:48:50.047527] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-19T20:48:50.251465] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-19T20:48:50.253297] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-19T20:48:50.360807] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-19T20:48:50.371533] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-19T20:48:51.079407] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T20:48:51.081548] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-19T20:48:51.662822] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T20:48:51.663892] [INFO ] [REMOTE ] PRCS: Full fetch complete (3730 records). [2025-09-19T20:48:51.663972] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-19T20:48:51.875244] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-19T20:48:51.875484] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:48:51.875558] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:48:51.875631] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-19T20:48:51.875736] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-19T20:48:51.875779] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-19T20:48:51.875847] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-19T20:48:51.875949] [INFO ] [MAIN ] Update Progress: 1721/2372 symbols completed. PRCS took 9.2s. Estimated remaining: 1h 26m 33s. Rate: 7.5 symbols/min [2025-09-19T20:48:52.064411] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:48:52.097635] [DEBUG] [LOCAL ] PRG: Loaded 30738 existing records from primary storage. [2025-09-19T20:48:52.097819] [INFO ] [MAIN ] PRG: Loaded 30738 existing records. [2025-09-19T20:48:52.299785] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:48:52.317260] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-19T20:48:52.317372] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-19T20:48:52.321449] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (3.13 seconds). [2025-09-19T20:48:52.321623] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-19T20:48:52.329389] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-19T20:48:52.329093] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-19T20:48:52.719340] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:48:52.719805] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-19T20:48:52.751247] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-19T20:48:52.762988] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-19T20:48:53.328439] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (3.28 seconds). [2025-09-19T20:48:53.334183] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-19T20:48:53.757515] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T20:48:53.770735] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-19T20:48:54.090880] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T20:48:54.096323] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-19T20:48:54.386326] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T20:48:54.398919] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-19T20:48:55.097694] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-19T20:48:55.104806] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-19T20:48:55.498518] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T20:48:55.504311] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-19T20:48:55.606463] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T20:48:55.615308] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-19T20:48:56.166929] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T20:48:56.178769] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-19T20:48:56.549400] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T20:48:56.555218] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-19T20:48:56.654895] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T20:48:56.660086] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-19T20:48:57.148118] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T20:48:57.154904] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-19T20:48:57.903362] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T20:48:57.915334] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-19T20:48:58.125865] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T20:48:58.132156] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-19T20:48:58.312792] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T20:48:58.323826] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-19T20:48:58.803071] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T20:48:58.811948] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-19T20:48:59.412842] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T20:48:59.416983] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-19T20:49:00.015827] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T20:49:00.024934] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-19T20:49:00.158845] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T20:49:00.164064] [INFO ] [REMOTE ] PPT: Full fetch complete (29164 records). [2025-09-19T20:49:00.164279] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-19T20:49:00.662701] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-09-19T20:49:00.690929] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T20:49:00.747565] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-19T20:49:00.741734] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-19T20:49:00.856208] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-19T20:49:00.856368] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-19T20:49:00.857921] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-19T20:49:00.858020] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-19T20:49:00.859532] [DEBUG] [LOCAL ] PPT: Trimmed 29164 records to 20609 (keeping 200 days of data) [2025-09-19T20:49:01.054012] [DEBUG] [LOCAL ] PPT: Primary data saved (20609 records). [2025-09-19T20:49:01.054190] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-19T20:49:01.054336] [INFO ] [MAIN ] Update Progress: 1722/2372 symbols completed. PPT took 18.4s. Estimated remaining: 1h 26m 25s. Rate: 7.5 symbols/min [2025-09-19T20:49:01.245601] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:49:01.297814] [DEBUG] [LOCAL ] PRGO: Loaded 47312 existing records from primary storage. [2025-09-19T20:49:01.297963] [INFO ] [MAIN ] PRGO: Loaded 47312 existing records. [2025-09-19T20:49:01.525577] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:49:01.526148] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-19T20:49:01.526284] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-19T20:49:01.528094] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-19T20:49:01.528188] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-19T20:49:01.704391] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T20:49:01.769112] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-19T20:49:01.982295] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:49:02.243316] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-19T20:49:02.316760] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T20:49:02.321248] [INFO ] [REMOTE ] PRA: Full fetch complete (43298 records). [2025-09-19T20:49:02.321342] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-19T20:49:02.707027] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-19T20:49:02.707136] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-19T20:49:02.708031] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-19T20:49:02.708105] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-19T20:49:02.709407] [DEBUG] [LOCAL ] PRA: Trimmed 43298 records to 35074 (keeping 200 days of data) [2025-09-19T20:49:02.842908] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T20:49:02.975367] [DEBUG] [LOCAL ] PRA: Primary data saved (35074 records). [2025-09-19T20:49:02.975634] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-19T20:49:02.975839] [INFO ] [MAIN ] Update Progress: 1723/2372 symbols completed. PRA took 20.3s. Estimated remaining: 1h 26m 15s. Rate: 7.5 symbols/min [2025-09-19T20:49:03.047100] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-19T20:49:03.103880] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T20:49:03.182680] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:49:03.189665] [DEBUG] [LOCAL ] PRH: Loaded 4994 existing records from primary storage. [2025-09-19T20:49:03.189774] [INFO ] [MAIN ] PRH: Loaded 4994 existing records. [2025-09-19T20:49:03.367820] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:49:03.368133] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-19T20:49:03.368251] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-19T20:49:03.368572] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-19T20:49:03.368633] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-19T20:49:03.746277] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:49:03.774481] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T20:49:03.843213] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-19T20:49:04.643275] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-19T20:49:05.443276] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-19T20:49:05.637499] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T20:49:06.243322] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-19T20:49:06.507595] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (3.46 seconds). [2025-09-19T20:49:06.914991] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T20:49:07.043269] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-19T20:49:07.756357] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (3.91 seconds). [2025-09-19T20:49:07.843303] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-19T20:49:07.934330] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T20:49:08.643286] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-19T20:49:08.978267] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T20:49:08.990382] [INFO ] [REMOTE ] PR: Full fetch complete (77592 records). [2025-09-19T20:49:08.990583] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-19T20:49:09.442402] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-19T20:49:09.443663] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T20:49:09.443802] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-19T20:49:09.450039] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-19T20:49:09.451372] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-19T20:49:09.453166] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-19T20:49:09.455271] [DEBUG] [LOCAL ] PR: Trimmed 77592 records to 54389 (keeping 200 days of data) [2025-09-19T20:49:09.578461] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T20:49:09.833815] [DEBUG] [LOCAL ] PR: Primary data saved (54389 records). [2025-09-19T20:49:09.833979] [INFO ] [MAIN ] PR: Full history saved. [2025-09-19T20:49:09.834093] [INFO ] [MAIN ] Update Progress: 1724/2372 symbols completed. PR took 27.2s. Estimated remaining: 1h 26m 7s. Rate: 7.5 symbols/min [2025-09-19T20:49:10.008272] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:49:10.027247] [DEBUG] [LOCAL ] PRI: Loaded 18546 existing records from primary storage. [2025-09-19T20:49:10.027368] [INFO ] [MAIN ] PRI: Loaded 18546 existing records. [2025-09-19T20:49:10.211638] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:49:10.211947] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-19T20:49:10.212000] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-19T20:49:10.212854] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-19T20:49:10.212918] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-19T20:49:10.248538] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-19T20:49:10.590752] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:49:11.043315] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-19T20:49:11.316128] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T20:49:11.843550] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-19T20:49:11.843455] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T20:49:12.365451] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T20:49:12.643343] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-19T20:49:13.443323] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-19T20:49:13.859197] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T20:49:14.199914] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T20:49:14.243270] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-19T20:49:14.259638] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T20:49:15.043310] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-19T20:49:15.843286] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-19T20:49:16.259064] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T20:49:16.374470] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T20:49:16.643268] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-19T20:49:17.204799] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T20:49:17.209886] [INFO ] [REMOTE ] PRG: Full fetch complete (44084 records). [2025-09-19T20:49:17.209972] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-19T20:49:17.452984] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-19T20:49:17.592110] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-19T20:49:17.592232] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-19T20:49:17.593258] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-19T20:49:17.593341] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-19T20:49:17.596209] [DEBUG] [LOCAL ] PRG: Trimmed 44084 records to 30917 (keeping 200 days of data) [2025-09-19T20:49:17.603948] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T20:49:17.796256] [DEBUG] [LOCAL ] PRG: Primary data saved (30917 records). [2025-09-19T20:49:17.796387] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-19T20:49:17.796510] [INFO ] [MAIN ] Update Progress: 1725/2372 symbols completed. PRG took 25.9s. Estimated remaining: 1h 25m 59s. Rate: 7.5 symbols/min [2025-09-19T20:49:17.977018] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:49:18.026530] [DEBUG] [LOCAL ] PRIM: Loaded 44891 existing records from primary storage. [2025-09-19T20:49:18.026715] [INFO ] [MAIN ] PRIM: Loaded 44891 existing records. [2025-09-19T20:49:18.203066] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:49:18.203372] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-19T20:49:18.203442] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-19T20:49:18.205538] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-19T20:49:18.205610] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-19T20:49:18.248556] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-19T20:49:18.561357] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:49:19.043285] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-19T20:49:19.239262] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T20:49:19.504212] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T20:49:19.843305] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-19T20:49:20.596823] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T20:49:20.643228] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-19T20:49:20.773932] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T20:49:21.443249] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-19T20:49:21.986383] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T20:49:22.243261] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-19T20:49:23.043321] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-19T20:49:23.215355] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-19T20:49:23.843285] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-19T20:49:23.984123] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T20:49:24.149966] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T20:49:24.346549] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-19T20:49:24.643273] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-19T20:49:25.443308] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-19T20:49:26.243282] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-19T20:49:26.490277] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T20:49:26.571174] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T20:49:27.043272] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-19T20:49:27.515334] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-19T20:49:27.843283] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-19T20:49:28.222108] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-19T20:49:28.643263] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-19T20:49:29.443310] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-19T20:49:30.179540] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T20:49:30.243288] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-19T20:49:30.638165] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T20:49:30.718446] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T20:49:31.043283] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-19T20:49:31.843298] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-19T20:49:32.087426] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T20:49:32.097042] [INFO ] [REMOTE ] PRGO: Full fetch complete (68265 records). [2025-09-19T20:49:32.097222] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-19T20:49:32.496160] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-19T20:49:32.496247] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-19T20:49:32.497314] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-19T20:49:32.497400] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-19T20:49:32.499001] [DEBUG] [LOCAL ] PRGO: Trimmed 68265 records to 47667 (keeping 200 days of data) [2025-09-19T20:49:32.644983] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-19T20:49:32.649274] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T20:49:32.829529] [DEBUG] [LOCAL ] PRGO: Primary data saved (47667 records). [2025-09-19T20:49:32.829696] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-19T20:49:32.830683] [INFO ] [MAIN ] Update Progress: 1726/2372 symbols completed. PRGO took 31.8s. Estimated remaining: 1h 25m 53s. Rate: 7.5 symbols/min [2025-09-19T20:49:33.001565] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:49:33.052921] [DEBUG] [LOCAL ] PRKS: Loaded 43039 existing records from primary storage. [2025-09-19T20:49:33.053090] [INFO ] [MAIN ] PRKS: Loaded 43039 existing records. [2025-09-19T20:49:33.233047] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:49:33.233308] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-19T20:49:33.233356] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-19T20:49:33.234543] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-19T20:49:33.234618] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-19T20:49:33.426996] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T20:49:33.469323] [INFO ] [REMOTE ] PRH: Full fetch complete (7735 records). [2025-09-19T20:49:33.462759] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-19T20:49:33.469776] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-19T20:49:33.776741] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:49:33.998307] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-19T20:49:33.998438] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-19T20:49:33.998733] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-19T20:49:33.998811] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-19T20:49:33.999756] [DEBUG] [LOCAL ] PRH: Trimmed 7735 records to 5020 (keeping 200 days of data) [2025-09-19T20:49:34.052827] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T20:49:34.070295] [DEBUG] [LOCAL ] PRH: Primary data saved (5020 records). [2025-09-19T20:49:34.070390] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-19T20:49:34.070499] [INFO ] [MAIN ] Update Progress: 1727/2372 symbols completed. PRH took 31.1s. Estimated remaining: 1h 25m 43s. Rate: 7.5 symbols/min [2025-09-19T20:49:34.237973] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:49:34.243259] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-19T20:49:34.267785] [DEBUG] [LOCAL ] PRLB: Loaded 21046 existing records from primary storage. [2025-09-19T20:49:34.267909] [INFO ] [MAIN ] PRLB: Loaded 21046 existing records. [2025-09-19T20:49:34.447772] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:49:34.448071] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-19T20:49:34.448120] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-19T20:49:34.449310] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-19T20:49:34.449399] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-19T20:49:34.803247] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:49:34.845282] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T20:49:35.043267] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-19T20:49:35.843304] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-19T20:49:36.006523] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T20:49:36.359248] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T20:49:36.362252] [INFO ] [REMOTE ] PRI: Full fetch complete (25690 records). [2025-09-19T20:49:36.362327] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-19T20:49:36.652054] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-19T20:49:36.744081] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-19T20:49:36.744161] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-19T20:49:36.744741] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-19T20:49:36.744802] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-19T20:49:36.746531] [DEBUG] [LOCAL ] PRI: Trimmed 25690 records to 18684 (keeping 200 days of data) [2025-09-19T20:49:36.881819] [DEBUG] [LOCAL ] PRI: Primary data saved (18684 records). [2025-09-19T20:49:36.881973] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-19T20:49:36.882075] [INFO ] [MAIN ] Update Progress: 1728/2372 symbols completed. PRI took 27.0s. Estimated remaining: 1h 25m 33s. Rate: 7.5 symbols/min [2025-09-19T20:49:37.061498] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:49:37.114038] [DEBUG] [LOCAL ] PRM: Loaded 45037 existing records from primary storage. [2025-09-19T20:49:37.114207] [INFO ] [MAIN ] PRM: Loaded 45037 existing records. [2025-09-19T20:49:37.293619] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:49:37.293937] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-19T20:49:37.293995] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-19T20:49:37.295094] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-19T20:49:37.295156] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-19T20:49:37.448438] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-19T20:49:37.663704] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:49:37.901028] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T20:49:38.243317] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-19T20:49:38.468841] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T20:49:38.973398] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T20:49:39.043235] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-19T20:49:39.843228] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-19T20:49:40.015501] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T20:49:40.065593] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T20:49:40.643271] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-19T20:49:41.443269] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-19T20:49:41.656127] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T20:49:41.991161] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T20:49:42.243282] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-19T20:49:43.043275] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-19T20:49:43.225752] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T20:49:43.843286] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-19T20:49:44.085133] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T20:49:44.401795] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T20:49:44.643278] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-19T20:49:45.421439] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T20:49:45.443217] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-19T20:49:46.243344] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-19T20:49:46.515301] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T20:49:47.043317] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-19T20:49:47.642107] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-19T20:49:47.843278] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-19T20:49:48.643268] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-19T20:49:48.954539] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T20:49:49.443267] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-19T20:49:49.892485] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T20:49:50.243272] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-19T20:49:51.167815] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (5.72 seconds). [2025-09-19T20:49:51.172870] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-19T20:49:51.357356] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T20:49:51.843339] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-19T20:49:52.589763] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T20:49:52.643211] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-19T20:49:53.600436] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T20:49:53.610209] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-19T20:49:53.796597] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (5.15 seconds). [2025-09-19T20:49:53.939455] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T20:49:54.243331] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-19T20:49:55.043340] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-19T20:49:55.395277] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T20:49:55.843295] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-19T20:49:56.097979] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (5.85 seconds). [2025-09-19T20:49:56.345457] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T20:49:56.643295] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-19T20:49:57.443268] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-19T20:49:57.830180] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (3.59 seconds). [2025-09-19T20:49:57.837906] [INFO ] [REMOTE ] PRIM: Full fetch complete (63194 records). [2025-09-19T20:49:57.838024] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-19T20:49:58.244521] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-19T20:49:58.244894] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-19T20:49:58.245892] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-19T20:49:58.245958] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-19T20:49:58.247680] [DEBUG] [LOCAL ] PRIM: Trimmed 63194 records to 45230 (keeping 200 days of data) [2025-09-19T20:49:58.529856] [DEBUG] [LOCAL ] PRIM: Primary data saved (45230 records). [2025-09-19T20:49:58.530000] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-19T20:49:58.530104] [INFO ] [MAIN ] Update Progress: 1729/2372 symbols completed. PRIM took 40.7s. Estimated remaining: 1h 25m 30s. Rate: 7.5 symbols/min [2025-09-19T20:49:58.695820] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:49:58.749149] [DEBUG] [LOCAL ] PRMB: Loaded 53517 existing records from primary storage. [2025-09-19T20:49:58.749350] [INFO ] [MAIN ] PRMB: Loaded 53517 existing records. [2025-09-19T20:49:58.930428] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:49:58.930850] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-19T20:49:58.930910] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-19T20:49:58.942267] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-19T20:49:58.942845] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-19T20:49:58.974932] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T20:49:59.017808] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-19T20:49:59.306637] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:49:59.306998] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-19T20:50:00.414312] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T20:50:00.419165] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-19T20:50:00.911908] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (5.07 seconds). [2025-09-19T20:50:00.921116] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-19T20:50:01.352239] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T20:50:01.443330] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-19T20:50:02.749589] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T20:50:02.757773] [INFO ] [REMOTE ] PRKS: Full fetch complete (60891 records). [2025-09-19T20:50:02.757955] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-19T20:50:03.172813] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (6.53 seconds). [2025-09-19T20:50:03.196392] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-19T20:50:03.204518] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-19T20:50:03.205765] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-19T20:50:03.205846] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-19T20:50:03.206773] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-19T20:50:03.208603] [DEBUG] [LOCAL ] PRKS: Trimmed 60891 records to 43351 (keeping 200 days of data) [2025-09-19T20:50:03.456472] [DEBUG] [LOCAL ] PRKS: Primary data saved (43351 records). [2025-09-19T20:50:03.456610] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-19T20:50:03.457074] [INFO ] [MAIN ] Update Progress: 1730/2372 symbols completed. PRKS took 30.6s. Estimated remaining: 1h 25m 21s. Rate: 7.5 symbols/min [2025-09-19T20:50:03.633307] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:50:03.643029] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (3.22 seconds). [2025-09-19T20:50:03.646626] [INFO ] [REMOTE ] PRLB: Full fetch complete (31056 records). [2025-09-19T20:50:03.646872] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-19T20:50:03.966140] [DEBUG] [LOCAL ] PRO: Loaded 37513 existing records from primary storage. [2025-09-19T20:50:04.022589] [INFO ] [MAIN ] PRO: Loaded 37513 existing records. [2025-09-19T20:50:04.035155] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-19T20:50:04.193429] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-19T20:50:04.193310] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-19T20:50:04.206270] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-19T20:50:04.212317] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-19T20:50:04.213453] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-19T20:50:04.267892] [DEBUG] [LOCAL ] PRLB: Trimmed 31056 records to 21223 (keeping 200 days of data) [2025-09-19T20:50:04.369568] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:50:04.379159] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-19T20:50:04.405513] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-19T20:50:04.407396] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-19T20:50:04.407780] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-19T20:50:04.862576] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:50:04.863569] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-19T20:50:04.865757] [DEBUG] [LOCAL ] PRLB: Primary data saved (21223 records). [2025-09-19T20:50:04.865833] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-19T20:50:04.865922] [INFO ] [MAIN ] Update Progress: 1731/2372 symbols completed. PRLB took 30.8s. Estimated remaining: 1h 25m 10s. Rate: 7.5 symbols/min [2025-09-19T20:50:05.048908] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:50:05.049125] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-19T20:50:05.049182] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-19T20:50:05.049335] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-19T20:50:05.049382] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-19T20:50:05.049425] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-19T20:50:05.049458] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-19T20:50:05.417685] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:50:05.418121] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-19T20:50:05.445978] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T20:50:05.456589] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-19T20:50:05.792496] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T20:50:05.792906] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-19T20:50:05.960159] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-19T20:50:06.243274] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-19T20:50:07.020586] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T20:50:07.043222] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-19T20:50:07.155049] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (2.96 seconds). [2025-09-19T20:50:07.843310] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-19T20:50:07.978026] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T20:50:08.643274] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-19T20:50:08.915235] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T20:50:08.924430] [INFO ] [REMOTE ] PRM: Full fetch complete (64263 records). [2025-09-19T20:50:08.924614] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-19T20:50:09.323606] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-19T20:50:09.323879] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-19T20:50:09.325047] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-19T20:50:09.325264] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-19T20:50:09.341098] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T20:50:09.341244] [DEBUG] [LOCAL ] PRM: Trimmed 64263 records to 45339 (keeping 200 days of data) [2025-09-19T20:50:09.443581] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-19T20:50:09.611201] [DEBUG] [LOCAL ] PRM: Primary data saved (45339 records). [2025-09-19T20:50:09.611336] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-19T20:50:09.611485] [INFO ] [MAIN ] Update Progress: 1732/2372 symbols completed. PRM took 32.7s. Estimated remaining: 1h 25m 1s. Rate: 7.5 symbols/min [2025-09-19T20:50:09.790353] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:50:09.808839] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T20:50:09.819191] [DEBUG] [LOCAL ] PRT: Loaded 5448 existing records from primary storage. [2025-09-19T20:50:09.819280] [INFO ] [MAIN ] PRT: Loaded 5448 existing records. [2025-09-19T20:50:10.047185] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:50:10.047487] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-19T20:50:10.047543] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-19T20:50:10.047893] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-19T20:50:10.047954] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-19T20:50:10.248509] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-19T20:50:10.431799] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:50:10.448568] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T20:50:11.043271] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-19T20:50:11.525516] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T20:50:11.843269] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-19T20:50:12.050233] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T20:50:12.643307] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-19T20:50:13.443273] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-19T20:50:13.584400] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T20:50:14.243326] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-19T20:50:14.349210] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T20:50:15.043275] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-19T20:50:15.251242] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T20:50:15.663329] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T20:50:15.843297] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-19T20:50:16.643330] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-19T20:50:17.443303] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-19T20:50:17.623838] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-19T20:50:17.924780] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T20:50:18.075344] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T20:50:18.243291] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-19T20:50:18.410409] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T20:50:19.043269] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-19T20:50:19.843261] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-19T20:50:20.643298] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-19T20:50:21.165313] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-09-19T20:50:21.443255] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-19T20:50:21.878582] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-19T20:50:22.071693] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T20:50:22.220270] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-19T20:50:22.243222] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-19T20:50:23.043303] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-19T20:50:23.308314] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T20:50:23.843260] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-19T20:50:23.984052] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T20:50:24.551830] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T20:50:24.643270] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-19T20:50:25.243437] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T20:50:25.443321] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-19T20:50:26.243331] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-19T20:50:26.281564] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T20:50:27.043319] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-19T20:50:27.607074] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T20:50:27.634321] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T20:50:27.640117] [INFO ] [REMOTE ] PRO: Full fetch complete (51011 records). [2025-09-19T20:50:27.640218] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-19T20:50:27.853182] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-19T20:50:28.025106] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-19T20:50:28.025194] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-19T20:50:28.026053] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-19T20:50:28.026117] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-19T20:50:28.027307] [DEBUG] [LOCAL ] PRO: Trimmed 51011 records to 37833 (keeping 200 days of data) [2025-09-19T20:50:28.244614] [DEBUG] [LOCAL ] PRO: Primary data saved (37833 records). [2025-09-19T20:50:28.244792] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-19T20:50:28.245139] [INFO ] [MAIN ] Update Progress: 1733/2372 symbols completed. PRO took 24.8s. Estimated remaining: 1h 24m 57s. Rate: 7.5 symbols/min [2025-09-19T20:50:28.414770] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:50:28.469379] [DEBUG] [LOCAL ] PRU: Loaded 51940 existing records from primary storage. [2025-09-19T20:50:28.469555] [INFO ] [MAIN ] PRU: Loaded 51940 existing records. [2025-09-19T20:50:28.653638] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:50:28.653815] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-19T20:50:28.655536] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-19T20:50:28.655699] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-19T20:50:28.662531] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-19T20:50:28.671149] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-19T20:50:28.744396] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T20:50:28.798962] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T20:50:29.045217] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:50:29.443321] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-19T20:50:30.201813] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T20:50:30.243283] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-19T20:50:30.635228] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T20:50:30.997158] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T20:50:31.043232] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-19T20:50:31.843238] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-19T20:50:32.330729] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T20:50:32.334087] [INFO ] [REMOTE ] PRSU: Full fetch complete (31574 records). [2025-09-19T20:50:32.334170] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-19T20:50:32.520162] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-19T20:50:32.520602] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:50:32.520696] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:50:32.520769] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-19T20:50:32.520837] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-19T20:50:32.520874] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-19T20:50:32.520918] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-19T20:50:32.520981] [INFO ] [MAIN ] Update Progress: 1734/2372 symbols completed. PRSU took 27.7s. Estimated remaining: 1h 24m 48s. Rate: 7.5 symbols/min [2025-09-19T20:50:32.648398] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-19T20:50:32.696204] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:50:32.696397] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-19T20:50:32.696451] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-19T20:50:32.696601] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-19T20:50:32.696676] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-19T20:50:32.696740] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-19T20:50:32.696773] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-19T20:50:33.049226] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:50:33.443268] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-19T20:50:33.887870] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T20:50:33.974845] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T20:50:34.022745] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T20:50:34.034334] [INFO ] [REMOTE ] PRMB: Full fetch complete (76036 records). [2025-09-19T20:50:34.034516] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-19T20:50:34.249039] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-19T20:50:34.426707] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-19T20:50:34.426796] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-19T20:50:34.427829] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-19T20:50:34.427892] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-19T20:50:34.429386] [DEBUG] [LOCAL ] PRMB: Trimmed 76036 records to 53904 (keeping 200 days of data) [2025-09-19T20:50:34.761125] [DEBUG] [LOCAL ] PRMB: Primary data saved (53904 records). [2025-09-19T20:50:34.761265] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-19T20:50:34.761362] [INFO ] [MAIN ] Update Progress: 1735/2372 symbols completed. PRMB took 36.2s. Estimated remaining: 1h 24m 38s. Rate: 7.5 symbols/min [2025-09-19T20:50:34.937145] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:50:34.983008] [DEBUG] [LOCAL ] PSA: Loaded 42229 existing records from primary storage. [2025-09-19T20:50:34.983149] [INFO ] [MAIN ] PSA: Loaded 42229 existing records. [2025-09-19T20:50:35.048538] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-19T20:50:35.174464] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T20:50:35.174612] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:50:35.176893] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-19T20:50:35.177258] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-19T20:50:35.178616] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-19T20:50:35.178701] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-19T20:50:35.531016] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-19T20:50:35.536543] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:50:35.843279] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-19T20:50:36.643348] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-19T20:50:37.086407] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-19T20:50:37.443270] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-19T20:50:37.645289] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T20:50:38.230150] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-19T20:50:38.243203] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-19T20:50:39.026888] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T20:50:39.028402] [INFO ] [REMOTE ] PRT: Full fetch complete (9167 records). [2025-09-19T20:50:39.028471] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-19T20:50:39.049444] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-19T20:50:39.391713] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-19T20:50:39.391804] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-19T20:50:39.392044] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-19T20:50:39.392139] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-19T20:50:39.392615] [DEBUG] [LOCAL ] PRT: Trimmed 9167 records to 5488 (keeping 200 days of data) [2025-09-19T20:50:39.427063] [DEBUG] [LOCAL ] PRT: Primary data saved (5488 records). [2025-09-19T20:50:39.427213] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-19T20:50:39.427309] [INFO ] [MAIN ] Update Progress: 1736/2372 symbols completed. PRT took 29.8s. Estimated remaining: 1h 24m 29s. Rate: 7.5 symbols/min [2025-09-19T20:50:39.601004] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:50:39.610191] [DEBUG] [LOCAL ] PSBD: Loaded 6865 existing records from primary storage. [2025-09-19T20:50:39.610305] [INFO ] [MAIN ] PSBD: Loaded 6865 existing records. [2025-09-19T20:50:39.791144] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:50:39.791433] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-19T20:50:39.791484] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-19T20:50:39.791930] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-19T20:50:39.791993] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-19T20:50:39.856071] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-19T20:50:40.161992] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:50:40.364489] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T20:50:40.643239] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-19T20:50:41.232252] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-19T20:50:41.287491] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T20:50:41.443237] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-19T20:50:42.243310] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-19T20:50:42.315811] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T20:50:43.043256] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-19T20:50:43.488603] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-19T20:50:43.843270] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-19T20:50:44.643319] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-19T20:50:44.869994] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T20:50:45.443316] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-19T20:50:45.597862] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (3.35 seconds). [2025-09-19T20:50:46.212433] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T20:50:46.243298] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-19T20:50:47.048447] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-19T20:50:47.062286] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-19T20:50:47.843270] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-19T20:50:47.890385] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-19T20:50:48.207205] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-19T20:50:48.335345] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T20:50:48.643289] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-19T20:50:49.443307] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-19T20:50:50.243303] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-19T20:50:50.410147] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T20:50:51.043262] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-19T20:50:51.085458] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T20:50:51.843273] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-19T20:50:51.911509] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T20:50:52.136501] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T20:50:52.643273] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-19T20:50:53.083747] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-19T20:50:53.443309] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-19T20:50:54.244392] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-19T20:50:54.244304] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-19T20:50:54.328437] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T20:50:55.043269] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-19T20:50:55.843273] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-19T20:50:56.255759] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T20:50:56.402103] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-19T20:50:56.643259] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-19T20:50:57.210268] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T20:50:57.242932] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T20:50:57.443295] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-19T20:50:57.906251] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-19T20:50:58.243260] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-19T20:50:59.043314] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-19T20:50:59.112488] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T20:50:59.114216] [INFO ] [REMOTE ] PSBD: Full fetch complete (9113 records). [2025-09-19T20:50:59.114292] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-19T20:50:59.481631] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-19T20:50:59.481745] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-19T20:50:59.482028] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-19T20:50:59.482069] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-19T20:50:59.482577] [DEBUG] [LOCAL ] PSBD: Trimmed 9113 records to 6916 (keeping 200 days of data) [2025-09-19T20:50:59.524772] [DEBUG] [LOCAL ] PSBD: Primary data saved (6916 records). [2025-09-19T20:50:59.524909] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-19T20:50:59.525023] [INFO ] [MAIN ] Update Progress: 1737/2372 symbols completed. PSBD took 20.1s. Estimated remaining: 1h 24m 25s. Rate: 7.5 symbols/min [2025-09-19T20:50:59.698318] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:50:59.707258] [DEBUG] [LOCAL ] PSF: Loaded 6784 existing records from primary storage. [2025-09-19T20:50:59.707360] [INFO ] [MAIN ] PSF: Loaded 6784 existing records. [2025-09-19T20:50:59.850791] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-19T20:50:59.894819] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:50:59.895241] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-19T20:50:59.895352] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-19T20:50:59.895773] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-19T20:50:59.895834] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-19T20:51:00.273194] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:00.643283] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-19T20:51:01.205709] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-19T20:51:01.206549] [INFO ] [REMOTE ] PRVS: Full fetch complete (1238 records). [2025-09-19T20:51:01.206700] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-19T20:51:01.347037] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-19T20:51:01.438045] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-09-19T20:51:01.438257] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:51:01.438303] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:51:01.438341] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-19T20:51:01.438410] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-19T20:51:01.438467] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-19T20:51:01.438525] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-19T20:51:01.438611] [INFO ] [MAIN ] Update Progress: 1738/2372 symbols completed. PRVS took 28.9s. Estimated remaining: 1h 24m 15s. Rate: 7.5 symbols/min [2025-09-19T20:51:01.450145] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-19T20:51:01.617218] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:51:01.656401] [DEBUG] [LOCAL ] PSFE: Loaded 31087 existing records from primary storage. [2025-09-19T20:51:01.656595] [INFO ] [MAIN ] PSFE: Loaded 31087 existing records. [2025-09-19T20:51:01.849579] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:51:01.850240] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-19T20:51:01.850313] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-19T20:51:01.851472] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-19T20:51:01.851548] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-19T20:51:02.177194] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T20:51:02.257480] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-19T20:51:02.263472] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:03.043305] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-19T20:51:03.843285] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-19T20:51:04.880131] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-19T20:51:04.882327] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-19T20:51:05.222162] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (3.77 seconds). [2025-09-19T20:51:05.443272] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-19T20:51:05.462955] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T20:51:05.906365] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T20:51:06.072470] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T20:51:06.243273] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-19T20:51:07.043319] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-19T20:51:07.819895] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-19T20:51:07.843271] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-19T20:51:07.951671] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-19T20:51:08.197446] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T20:51:08.435017] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-19T20:51:08.643285] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-19T20:51:09.443331] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-19T20:51:10.243305] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-19T20:51:10.528609] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T20:51:10.556774] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T20:51:11.043296] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-19T20:51:11.656424] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T20:51:11.843274] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-19T20:51:12.371960] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T20:51:12.378182] [INFO ] [REMOTE ] PSA: Full fetch complete (59005 records). [2025-09-19T20:51:12.378285] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-19T20:51:12.648436] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-19T20:51:12.761449] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-19T20:51:12.761548] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-19T20:51:12.762488] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-19T20:51:12.762554] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-19T20:51:12.764149] [DEBUG] [LOCAL ] PSA: Trimmed 59005 records to 42535 (keeping 200 days of data) [2025-09-19T20:51:13.037046] [DEBUG] [LOCAL ] PSA: Primary data saved (42535 records). [2025-09-19T20:51:13.037194] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-19T20:51:13.037294] [INFO ] [MAIN ] Update Progress: 1739/2372 symbols completed. PSA took 38.3s. Estimated remaining: 1h 24m 8s. Rate: 7.5 symbols/min [2025-09-19T20:51:13.205313] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:51:13.249044] [DEBUG] [LOCAL ] PSN: Loaded 46785 existing records from primary storage. [2025-09-19T20:51:13.249188] [INFO ] [MAIN ] PSN: Loaded 46785 existing records. [2025-09-19T20:51:13.423705] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:51:13.423959] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-19T20:51:13.424007] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-19T20:51:13.425243] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-19T20:51:13.425304] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-19T20:51:13.456059] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-19T20:51:13.782390] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:13.884246] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T20:51:14.243270] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-19T20:51:15.043284] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-19T20:51:15.262213] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-19T20:51:15.270194] [INFO ] [REMOTE ] PRU: Full fetch complete (74264 records). [2025-09-19T20:51:15.270337] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-19T20:51:15.638201] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T20:51:15.679456] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-19T20:51:15.679556] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-19T20:51:15.680592] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-19T20:51:15.680683] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-19T20:51:15.682258] [DEBUG] [LOCAL ] PRU: Trimmed 74264 records to 52304 (keeping 200 days of data) [2025-09-19T20:51:15.869886] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-19T20:51:16.019495] [DEBUG] [LOCAL ] PRU: Primary data saved (52304 records). [2025-09-19T20:51:16.019638] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-19T20:51:16.020606] [INFO ] [MAIN ] Update Progress: 1740/2372 symbols completed. PRU took 47.8s. Estimated remaining: 1h 23m 58s. Rate: 7.5 symbols/min [2025-09-19T20:51:16.230307] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:51:16.271204] [DEBUG] [LOCAL ] PSO: Loaded 38132 existing records from primary storage. [2025-09-19T20:51:16.271352] [INFO ] [MAIN ] PSO: Loaded 38132 existing records. [2025-09-19T20:51:16.460504] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:51:16.460951] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-19T20:51:16.461035] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-19T20:51:16.462574] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-19T20:51:16.462635] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-19T20:51:16.763388] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T20:51:16.766237] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-19T20:51:16.854224] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:16.874259] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-19T20:51:16.905351] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T20:51:17.443325] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-19T20:51:17.522335] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T20:51:18.243311] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-19T20:51:19.043307] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-19T20:51:19.108507] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T20:51:19.843328] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-19T20:51:19.966949] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T20:51:20.025278] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T20:51:20.643319] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-19T20:51:21.443337] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-19T20:51:21.598327] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T20:51:22.243279] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-19T20:51:22.433217] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T20:51:22.985387] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T20:51:23.043232] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-19T20:51:23.415203] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T20:51:23.843254] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-19T20:51:24.229102] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T20:51:24.643281] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-19T20:51:25.443280] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-19T20:51:25.780609] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T20:51:25.783388] [INFO ] [REMOTE ] PSF: Full fetch complete (9642 records). [2025-09-19T20:51:25.783474] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-19T20:51:26.157104] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-19T20:51:26.157309] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-19T20:51:26.157694] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-19T20:51:26.157784] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-19T20:51:26.158421] [DEBUG] [LOCAL ] PSF: Trimmed 9642 records to 6842 (keeping 200 days of data) [2025-09-19T20:51:26.203051] [DEBUG] [LOCAL ] PSF: Primary data saved (6842 records). [2025-09-19T20:51:26.203162] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-19T20:51:26.203264] [INFO ] [MAIN ] Update Progress: 1741/2372 symbols completed. PSF took 26.7s. Estimated remaining: 1h 23m 51s. Rate: 7.5 symbols/min [2025-09-19T20:51:26.266482] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-19T20:51:26.377439] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:51:26.405828] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-19T20:51:26.445369] [DEBUG] [LOCAL ] PSQH: Loaded 34746 existing records from primary storage. [2025-09-19T20:51:26.445519] [INFO ] [MAIN ] PSQH: Loaded 34746 existing records. [2025-09-19T20:51:26.624785] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:51:26.625080] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-19T20:51:26.625137] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-19T20:51:26.626041] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-19T20:51:26.626110] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-19T20:51:26.978489] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:27.043242] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-19T20:51:27.383488] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T20:51:27.486332] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T20:51:27.843266] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-19T20:51:28.643240] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-19T20:51:28.783707] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T20:51:29.078469] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T20:51:29.443278] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-19T20:51:30.243286] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-19T20:51:30.327948] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T20:51:31.043337] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-19T20:51:31.395212] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T20:51:31.843281] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-19T20:51:31.951391] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T20:51:32.643273] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-19T20:51:33.120778] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T20:51:33.448390] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-19T20:51:33.471019] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T20:51:34.243323] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-19T20:51:34.398360] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T20:51:35.043267] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-19T20:51:35.160916] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T20:51:35.164857] [INFO ] [REMOTE ] PSFE: Full fetch complete (43329 records). [2025-09-19T20:51:35.164942] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-19T20:51:35.574795] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-19T20:51:35.575007] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-19T20:51:35.577208] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-19T20:51:35.577322] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-19T20:51:35.599570] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T20:51:35.607619] [DEBUG] [LOCAL ] PSFE: Trimmed 43329 records to 31222 (keeping 200 days of data) [2025-09-19T20:51:35.820061] [DEBUG] [LOCAL ] PSFE: Primary data saved (31222 records). [2025-09-19T20:51:35.820242] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-19T20:51:35.820379] [INFO ] [MAIN ] Update Progress: 1742/2372 symbols completed. PSFE took 34.4s. Estimated remaining: 1h 23m 44s. Rate: 7.5 symbols/min [2025-09-19T20:51:35.848536] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-19T20:51:36.017912] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:51:36.069550] [DEBUG] [LOCAL ] PSTG: Loaded 53241 existing records from primary storage. [2025-09-19T20:51:36.069732] [INFO ] [MAIN ] PSTG: Loaded 53241 existing records. [2025-09-19T20:51:36.252594] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:51:36.252868] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-19T20:51:36.252919] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-19T20:51:36.254014] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-19T20:51:36.254088] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-19T20:51:36.643333] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:36.643533] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-19T20:51:37.048398] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T20:51:37.365730] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T20:51:37.443220] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-19T20:51:38.243317] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-19T20:51:38.423874] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T20:51:38.756065] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:51:39.043254] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-19T20:51:39.843262] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-19T20:51:39.995124] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T20:51:40.445401] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T20:51:40.643344] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-19T20:51:41.294918] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T20:51:41.443287] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-19T20:51:42.243270] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-19T20:51:42.596610] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-19T20:51:43.043292] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-19T20:51:43.829796] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T20:51:43.835126] [INFO ] [REMOTE ] PSO: Full fetch complete (51742 records). [2025-09-19T20:51:43.835263] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-19T20:51:43.867668] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-19T20:51:44.236561] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-19T20:51:44.236710] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-19T20:51:44.237589] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-19T20:51:44.237670] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-19T20:51:44.239201] [DEBUG] [LOCAL ] PSO: Trimmed 51742 records to 38334 (keeping 200 days of data) [2025-09-19T20:51:44.493910] [DEBUG] [LOCAL ] PSO: Primary data saved (38334 records). [2025-09-19T20:51:44.494103] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-19T20:51:44.494929] [INFO ] [MAIN ] Update Progress: 1743/2372 symbols completed. PSO took 28.5s. Estimated remaining: 1h 23m 36s. Rate: 7.5 symbols/min [2025-09-19T20:51:44.718552] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:51:44.747416] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T20:51:44.759333] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-19T20:51:44.768709] [DEBUG] [LOCAL ] PSTL: Loaded 20779 existing records from primary storage. [2025-09-19T20:51:44.768819] [INFO ] [MAIN ] PSTL: Loaded 20779 existing records. [2025-09-19T20:51:44.969436] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:51:44.970113] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-19T20:51:44.970211] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-19T20:51:44.982775] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-19T20:51:44.997747] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-19T20:51:45.081372] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (3.64 seconds). [2025-09-19T20:51:45.400997] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:45.443231] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-19T20:51:45.894844] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T20:51:46.243373] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-19T20:51:46.448359] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T20:51:46.783421] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T20:51:47.043347] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-19T20:51:47.843244] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-19T20:51:48.399702] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T20:51:48.448548] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T20:51:48.643282] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-19T20:51:49.443245] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-19T20:51:49.536860] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T20:51:49.544707] [INFO ] [REMOTE ] PSN: Full fetch complete (66785 records). [2025-09-19T20:51:49.544856] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-19T20:51:49.957256] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-19T20:51:49.957362] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-19T20:51:49.958520] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-19T20:51:49.958591] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-19T20:51:49.960441] [DEBUG] [LOCAL ] PSN: Trimmed 66785 records to 47118 (keeping 200 days of data) [2025-09-19T20:51:50.251282] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-19T20:51:50.267330] [DEBUG] [LOCAL ] PSN: Primary data saved (47118 records). [2025-09-19T20:51:50.267456] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-19T20:51:50.267584] [INFO ] [MAIN ] Update Progress: 1744/2372 symbols completed. PSN took 37.2s. Estimated remaining: 1h 23m 27s. Rate: 7.5 symbols/min [2025-09-19T20:51:50.455359] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:51:50.519705] [DEBUG] [LOCAL ] PSX: Loaded 53519 existing records from primary storage. [2025-09-19T20:51:50.519866] [INFO ] [MAIN ] PSX: Loaded 53519 existing records. [2025-09-19T20:51:50.709032] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:51:50.709498] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-19T20:51:50.709574] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-19T20:51:50.711252] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-19T20:51:50.711316] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-19T20:51:51.127188] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-19T20:51:51.131038] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:51.165456] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-19T20:51:51.170804] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T20:51:51.190037] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T20:51:51.843306] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-19T20:51:52.643321] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-19T20:51:53.302765] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T20:51:53.328321] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T20:51:53.443276] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-19T20:51:54.243285] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-19T20:51:54.382406] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T20:51:54.800939] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T20:51:55.043293] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-19T20:51:55.843294] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-19T20:51:56.369139] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T20:51:56.448535] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T20:51:56.643264] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-19T20:51:57.443310] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-19T20:51:57.688967] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T20:51:57.695788] [INFO ] [REMOTE ] PSQH: Full fetch complete (53693 records). [2025-09-19T20:51:57.695939] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-19T20:51:58.100855] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-19T20:51:58.107721] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-19T20:51:58.108794] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-19T20:51:58.113449] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-19T20:51:58.115097] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T20:51:58.121353] [DEBUG] [LOCAL ] PSQH: Trimmed 53693 records to 35077 (keeping 200 days of data) [2025-09-19T20:51:58.249216] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-19T20:51:58.341084] [DEBUG] [LOCAL ] PSQH: Primary data saved (35077 records). [2025-09-19T20:51:58.341242] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-19T20:51:58.341333] [INFO ] [MAIN ] Update Progress: 1745/2372 symbols completed. PSQH took 32.1s. Estimated remaining: 1h 23m 20s. Rate: 7.5 symbols/min [2025-09-19T20:51:58.520629] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:51:58.540391] [DEBUG] [LOCAL ] PTA: Loaded 15157 existing records from primary storage. [2025-09-19T20:51:58.540548] [INFO ] [MAIN ] PTA: Loaded 15157 existing records. [2025-09-19T20:51:58.718701] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:51:58.719034] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-19T20:51:58.719090] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-19T20:51:58.719821] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-19T20:51:58.719882] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-19T20:51:59.052950] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-19T20:51:59.074370] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:51:59.504780] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T20:51:59.564071] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T20:51:59.843281] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-19T20:52:00.643231] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-19T20:52:01.188439] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T20:52:01.370179] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-19T20:52:01.443300] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-19T20:52:02.243315] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-19T20:52:02.633976] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T20:52:02.879429] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T20:52:03.043287] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-19T20:52:03.843273] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-19T20:52:04.405889] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T20:52:04.629996] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-19T20:52:04.643201] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-19T20:52:05.162904] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T20:52:05.166524] [INFO ] [REMOTE ] PSTL: Full fetch complete (29570 records). [2025-09-19T20:52:05.166610] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-19T20:52:05.450426] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-19T20:52:05.553445] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-19T20:52:05.553588] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-19T20:52:05.554367] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-19T20:52:05.554436] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-19T20:52:05.555480] [DEBUG] [LOCAL ] PSTL: Trimmed 29570 records to 20982 (keeping 200 days of data) [2025-09-19T20:52:05.696569] [DEBUG] [LOCAL ] PSTL: Primary data saved (20982 records). [2025-09-19T20:52:05.696736] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-19T20:52:05.696853] [INFO ] [MAIN ] Update Progress: 1746/2372 symbols completed. PSTL took 21.2s. Estimated remaining: 1h 23m 11s. Rate: 7.5 symbols/min [2025-09-19T20:52:05.865356] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:52:05.905763] [DEBUG] [LOCAL ] PTY: Loaded 37652 existing records from primary storage. [2025-09-19T20:52:05.905906] [INFO ] [MAIN ] PTY: Loaded 37652 existing records. [2025-09-19T20:52:06.084061] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:52:06.084342] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-19T20:52:06.084393] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-19T20:52:06.085353] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-19T20:52:06.085416] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-19T20:52:06.243436] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-19T20:52:06.473478] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:52:06.689556] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T20:52:06.864932] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T20:52:07.043301] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-19T20:52:07.843269] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-19T20:52:08.442910] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T20:52:08.520844] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T20:52:08.643280] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-19T20:52:09.056902] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T20:52:09.443285] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-19T20:52:10.243272] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-19T20:52:10.814589] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T20:52:11.043278] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-19T20:52:11.719362] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T20:52:11.843219] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-19T20:52:12.643327] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-19T20:52:12.799237] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (3.36 seconds). [2025-09-19T20:52:12.931946] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-19T20:52:13.448470] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-19T20:52:13.468070] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-19T20:52:14.243267] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-19T20:52:14.669088] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T20:52:15.043276] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-19T20:52:15.556327] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:52:15.727451] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-19T20:52:15.843305] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-19T20:52:16.643301] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-19T20:52:16.765753] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T20:52:16.838928] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T20:52:17.443272] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-19T20:52:18.243274] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-19T20:52:18.799911] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T20:52:18.808040] [INFO ] [REMOTE ] PSTG: Full fetch complete (76543 records). [2025-09-19T20:52:18.808213] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-19T20:52:19.053076] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-19T20:52:19.216987] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-19T20:52:19.217073] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-19T20:52:19.218098] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-19T20:52:19.218161] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-19T20:52:19.219673] [DEBUG] [LOCAL ] PSTG: Trimmed 76543 records to 53628 (keeping 200 days of data) [2025-09-19T20:52:19.546762] [DEBUG] [LOCAL ] PSTG: Primary data saved (53628 records). [2025-09-19T20:52:19.546917] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-19T20:52:19.547026] [INFO ] [MAIN ] Update Progress: 1747/2372 symbols completed. PSTG took 43.7s. Estimated remaining: 1h 23m 5s. Rate: 7.5 symbols/min [2025-09-19T20:52:19.768108] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:52:19.810781] [DEBUG] [LOCAL ] PUK: Loaded 45398 existing records from primary storage. [2025-09-19T20:52:19.810928] [INFO ] [MAIN ] PUK: Loaded 45398 existing records. [2025-09-19T20:52:19.995912] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:52:19.996249] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-19T20:52:19.996307] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-19T20:52:19.997420] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-19T20:52:19.997489] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-19T20:52:20.403069] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:52:20.403535] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-19T20:52:20.406444] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-19T20:52:20.459764] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T20:52:20.643258] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-19T20:52:20.783934] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T20:52:21.443325] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-19T20:52:21.866520] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T20:52:22.243247] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-19T20:52:22.717186] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T20:52:22.897113] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T20:52:22.916499] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T20:52:22.919358] [INFO ] [REMOTE ] PTA: Full fetch complete (23659 records). [2025-09-19T20:52:22.919431] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-19T20:52:23.048463] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-19T20:52:23.319280] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-19T20:52:23.319396] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-19T20:52:23.319919] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-19T20:52:23.319981] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-19T20:52:23.320617] [DEBUG] [LOCAL ] PTA: Trimmed 23659 records to 15248 (keeping 200 days of data) [2025-09-19T20:52:23.412364] [DEBUG] [LOCAL ] PTA: Primary data saved (15248 records). [2025-09-19T20:52:23.412504] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-19T20:52:23.412588] [INFO ] [MAIN ] Update Progress: 1748/2372 symbols completed. PTA took 25.1s. Estimated remaining: 1h 22m 56s. Rate: 7.5 symbols/min [2025-09-19T20:52:23.594810] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:52:23.648484] [DEBUG] [LOCAL ] PUMP: Loaded 49869 existing records from primary storage. [2025-09-19T20:52:23.648634] [INFO ] [MAIN ] PUMP: Loaded 49869 existing records. [2025-09-19T20:52:23.839938] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:52:23.840221] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-19T20:52:23.840316] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-19T20:52:23.841477] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-19T20:52:23.841541] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-19T20:52:23.853959] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-19T20:52:24.214727] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:52:24.643316] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-19T20:52:25.024240] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T20:52:25.032166] [INFO ] [REMOTE ] PSX: Full fetch complete (77043 records). [2025-09-19T20:52:25.032292] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-19T20:52:25.429502] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-19T20:52:25.429599] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-19T20:52:25.430761] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-19T20:52:25.430829] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-19T20:52:25.432360] [DEBUG] [LOCAL ] PSX: Trimmed 77043 records to 53908 (keeping 200 days of data) [2025-09-19T20:52:25.443390] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-19T20:52:25.789120] [DEBUG] [LOCAL ] PSX: Primary data saved (53908 records). [2025-09-19T20:52:25.789292] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-19T20:52:25.789404] [INFO ] [MAIN ] Update Progress: 1749/2372 symbols completed. PSX took 35.5s. Estimated remaining: 1h 22m 46s. Rate: 7.5 symbols/min [2025-09-19T20:52:26.002546] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:52:26.004617] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T20:52:26.064252] [DEBUG] [LOCAL ] PVH: Loaded 50759 existing records from primary storage. [2025-09-19T20:52:26.064406] [INFO ] [MAIN ] PVH: Loaded 50759 existing records. [2025-09-19T20:52:26.250314] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-19T20:52:26.255754] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:52:26.256741] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-19T20:52:26.256804] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-19T20:52:26.258053] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-19T20:52:26.258116] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-19T20:52:26.628321] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:52:26.659453] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T20:52:26.858032] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T20:52:27.043267] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-19T20:52:27.843266] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-19T20:52:28.161581] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T20:52:28.634730] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T20:52:28.644314] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-19T20:52:29.443318] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-19T20:52:29.812245] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T20:52:30.243260] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-19T20:52:30.794514] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T20:52:30.833298] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T20:52:31.043269] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-19T20:52:31.843256] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-19T20:52:32.257712] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T20:52:32.643275] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-19T20:52:32.782294] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T20:52:33.443261] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-19T20:52:34.075619] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T20:52:34.233208] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-19T20:52:34.243202] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-19T20:52:34.525869] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T20:52:35.043323] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-19T20:52:35.843310] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-19T20:52:36.463460] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T20:52:36.643232] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-19T20:52:37.032584] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T20:52:37.180471] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T20:52:37.443314] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-19T20:52:38.112392] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T20:52:38.243256] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-19T20:52:39.043259] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-19T20:52:39.328100] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T20:52:39.843329] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-19T20:52:40.279225] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-19T20:52:40.499516] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T20:52:40.643246] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-19T20:52:41.443302] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-19T20:52:41.538263] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T20:52:42.243292] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-19T20:52:42.345166] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T20:52:43.043340] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-19T20:52:43.506721] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T20:52:43.596214] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T20:52:43.602251] [INFO ] [REMOTE ] PTY: Full fetch complete (53860 records). [2025-09-19T20:52:43.602354] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-19T20:52:43.852274] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-19T20:52:44.001028] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-19T20:52:44.001127] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-19T20:52:44.002111] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-19T20:52:44.002189] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-19T20:52:44.003414] [DEBUG] [LOCAL ] PTY: Trimmed 53860 records to 37923 (keeping 200 days of data) [2025-09-19T20:52:44.249802] [DEBUG] [LOCAL ] PTY: Primary data saved (37923 records). [2025-09-19T20:52:44.249984] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-19T20:52:44.250362] [INFO ] [MAIN ] Update Progress: 1750/2372 symbols completed. PTY took 38.6s. Estimated remaining: 1h 22m 42s. Rate: 7.5 symbols/min [2025-09-19T20:52:44.422516] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:52:44.430130] [DEBUG] [LOCAL ] PVL: Loaded 4742 existing records from primary storage. [2025-09-19T20:52:44.430254] [INFO ] [MAIN ] PVL: Loaded 4742 existing records. [2025-09-19T20:52:44.605587] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:52:44.605859] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-19T20:52:44.605918] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-19T20:52:44.606198] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-19T20:52:44.606257] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-19T20:52:44.648455] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-19T20:52:44.968151] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:52:44.996297] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T20:52:45.443284] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-19T20:52:46.093244] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T20:52:46.109028] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T20:52:46.243222] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-19T20:52:47.043342] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-19T20:52:47.621110] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T20:52:47.651780] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-19T20:52:47.843252] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-19T20:52:48.105737] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T20:52:48.643317] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-19T20:52:49.443275] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-19T20:52:49.716573] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T20:52:50.243267] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-19T20:52:50.702868] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T20:52:50.714322] [INFO ] [REMOTE ] PUMP: Full fetch complete (71595 records). [2025-09-19T20:52:50.714515] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-19T20:52:51.048510] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-19T20:52:51.104711] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-19T20:52:51.104803] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-19T20:52:51.105929] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-19T20:52:51.105996] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-19T20:52:51.107494] [DEBUG] [LOCAL ] PUMP: Trimmed 71595 records to 50240 (keeping 200 days of data) [2025-09-19T20:52:51.392228] [DEBUG] [LOCAL ] PUMP: Primary data saved (50240 records). [2025-09-19T20:52:51.392375] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-19T20:52:51.392476] [INFO ] [MAIN ] Update Progress: 1751/2372 symbols completed. PUMP took 28.0s. Estimated remaining: 1h 22m 34s. Rate: 7.5 symbols/min [2025-09-19T20:52:51.580280] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:52:51.618330] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T20:52:51.670403] [DEBUG] [LOCAL ] PWR: Loaded 47954 existing records from primary storage. [2025-09-19T20:52:51.670554] [INFO ] [MAIN ] PWR: Loaded 47954 existing records. [2025-09-19T20:52:51.848299] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-19T20:52:51.853381] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:52:51.853770] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-19T20:52:51.853831] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-19T20:52:51.855054] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-19T20:52:51.855122] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-19T20:52:52.113675] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T20:52:52.232027] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:52:52.269872] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T20:52:52.276568] [INFO ] [REMOTE ] PUK: Full fetch complete (65061 records). [2025-09-19T20:52:52.276717] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-19T20:52:52.643958] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-19T20:52:52.683181] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-19T20:52:52.683282] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-19T20:52:52.684936] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-19T20:52:52.685127] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-19T20:52:52.686941] [DEBUG] [LOCAL ] PUK: Trimmed 65061 records to 45716 (keeping 200 days of data) [2025-09-19T20:52:53.097038] [DEBUG] [LOCAL ] PUK: Primary data saved (45716 records). [2025-09-19T20:52:53.097283] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-19T20:52:53.097501] [INFO ] [MAIN ] Update Progress: 1752/2372 symbols completed. PUK took 33.6s. Estimated remaining: 1h 22m 23s. Rate: 7.5 symbols/min [2025-09-19T20:52:53.379991] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:52:53.425927] [DEBUG] [LOCAL ] PX: Loaded 35019 existing records from primary storage. [2025-09-19T20:52:53.426119] [INFO ] [MAIN ] PX: Loaded 35019 existing records. [2025-09-19T20:52:53.449470] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-19T20:52:53.578122] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T20:52:53.734687] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:52:53.735217] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-19T20:52:53.735474] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-19T20:52:53.736436] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-19T20:52:53.736514] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-19T20:52:53.998034] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-19T20:52:54.110303] [INFO ] [REMOTE ] PVH: Full fetch complete (70762 records). [2025-09-19T20:52:54.130621] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-19T20:52:54.262553] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-19T20:52:54.304772] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:52:54.614249] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-19T20:52:54.614344] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-19T20:52:54.615476] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-19T20:52:54.615541] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-19T20:52:54.617093] [DEBUG] [LOCAL ] PVH: Trimmed 70762 records to 51116 (keeping 200 days of data) [2025-09-19T20:52:54.947633] [DEBUG] [LOCAL ] PVH: Primary data saved (51116 records). [2025-09-19T20:52:54.947851] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-19T20:52:54.947962] [INFO ] [MAIN ] Update Progress: 1753/2372 symbols completed. PVH took 29.2s. Estimated remaining: 1h 22m 13s. Rate: 7.5 symbols/min [2025-09-19T20:52:55.048531] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-19T20:52:55.126204] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:52:55.126377] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-09-19T20:52:55.126415] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-19T20:52:55.126558] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-19T20:52:55.126602] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-19T20:52:55.126668] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-19T20:52:55.126724] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-19T20:52:55.249282] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T20:52:55.495693] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:52:55.775402] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T20:52:55.843238] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-19T20:52:56.643332] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-19T20:52:56.806065] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T20:52:57.443280] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-19T20:52:58.184517] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T20:52:58.243260] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-19T20:52:58.930997] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T20:52:59.043271] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-19T20:52:59.164339] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-19T20:52:59.843296] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-19T20:52:59.856122] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T20:53:00.557974] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-19T20:53:00.643317] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-19T20:53:01.443330] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-19T20:53:02.243373] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-19T20:53:02.359466] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T20:53:02.651861] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-09-19T20:53:03.043252] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-19T20:53:03.130606] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-19T20:53:03.381199] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T20:53:03.579685] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T20:53:03.843269] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-19T20:53:04.643271] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-19T20:53:05.443262] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-19T20:53:06.239050] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-19T20:53:06.245799] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-19T20:53:06.486311] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T20:53:06.636523] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-19T20:53:07.043308] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-19T20:53:07.528216] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T20:53:07.843265] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-19T20:53:08.391974] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-19T20:53:08.643267] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-19T20:53:09.169971] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-19T20:53:09.171312] [INFO ] [REMOTE ] PVL: Full fetch complete (7575 records). [2025-09-19T20:53:09.171386] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-19T20:53:09.448414] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-19T20:53:09.545959] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-19T20:53:09.546042] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-19T20:53:09.546244] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-19T20:53:09.546284] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-19T20:53:09.546709] [DEBUG] [LOCAL ] PVL: Trimmed 7575 records to 4822 (keeping 200 days of data) [2025-09-19T20:53:09.575441] [DEBUG] [LOCAL ] PVL: Primary data saved (4822 records). [2025-09-19T20:53:09.575552] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-19T20:53:09.575678] [INFO ] [MAIN ] Update Progress: 1754/2372 symbols completed. PVL took 25.3s. Estimated remaining: 1h 22m 8s. Rate: 7.5 symbols/min [2025-09-19T20:53:09.747300] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:53:09.777061] [DEBUG] [LOCAL ] QD: Loaded 28239 existing records from primary storage. [2025-09-19T20:53:09.777222] [INFO ] [MAIN ] QD: Loaded 28239 existing records. [2025-09-19T20:53:09.951996] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:53:09.952257] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-19T20:53:09.952305] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-19T20:53:09.952947] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-19T20:53:09.953007] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-19T20:53:10.248410] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-19T20:53:10.311026] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:53:10.612200] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T20:53:10.909796] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-09-19T20:53:11.043232] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-19T20:53:11.843286] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-19T20:53:12.421566] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T20:53:12.643272] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-19T20:53:12.932186] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T20:53:13.443237] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-19T20:53:14.052785] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-09-19T20:53:14.243241] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-19T20:53:14.440034] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T20:53:14.726510] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T20:53:15.043263] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-19T20:53:15.843249] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-19T20:53:16.643289] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-19T20:53:17.175291] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T20:53:17.305851] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-09-19T20:53:17.443237] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-19T20:53:17.553273] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T20:53:18.022869] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-19T20:53:18.243271] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-19T20:53:19.043255] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-19T20:53:19.843264] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-19T20:53:20.244123] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-19T20:53:20.535123] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T20:53:20.579818] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (3.14 seconds). [2025-09-19T20:53:20.643231] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-19T20:53:21.331056] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T20:53:21.443263] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-19T20:53:22.243271] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-19T20:53:22.311077] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T20:53:23.043240] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-19T20:53:23.217392] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T20:53:23.843260] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-19T20:53:24.559604] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T20:53:24.566410] [INFO ] [REMOTE ] PWR: Full fetch complete (68947 records). [2025-09-19T20:53:24.566539] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-19T20:53:24.657484] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-19T20:53:24.965558] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-19T20:53:24.965676] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-19T20:53:24.966638] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-19T20:53:24.966721] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-19T20:53:24.968986] [DEBUG] [LOCAL ] PWR: Trimmed 68947 records to 48250 (keeping 200 days of data) [2025-09-19T20:53:25.115296] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T20:53:25.311890] [DEBUG] [LOCAL ] PWR: Primary data saved (48250 records). [2025-09-19T20:53:25.312065] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-19T20:53:25.312208] [INFO ] [MAIN ] Update Progress: 1755/2372 symbols completed. PWR took 33.9s. Estimated remaining: 1h 22m 2s. Rate: 7.5 symbols/min [2025-09-19T20:53:25.452002] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-19T20:53:25.492385] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:53:25.541950] [DEBUG] [LOCAL ] QGEN: Loaded 49545 existing records from primary storage. [2025-09-19T20:53:25.542123] [INFO ] [MAIN ] QGEN: Loaded 49545 existing records. [2025-09-19T20:53:25.742842] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:53:25.763166] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-19T20:53:25.763307] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-19T20:53:25.766106] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (3.52 seconds). [2025-09-19T20:53:25.766167] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-19T20:53:25.778777] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-19T20:53:26.143932] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:53:26.160469] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T20:53:26.243268] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-19T20:53:26.832857] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-19T20:53:26.837727] [INFO ] [REMOTE ] PX: Full fetch complete (51266 records). [2025-09-19T20:53:26.837874] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-19T20:53:27.048480] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-19T20:53:27.217626] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-19T20:53:27.217736] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-19T20:53:27.218546] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-19T20:53:27.218636] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-19T20:53:27.219735] [DEBUG] [LOCAL ] PX: Trimmed 51266 records to 35302 (keeping 200 days of data) [2025-09-19T20:53:27.449333] [DEBUG] [LOCAL ] PX: Primary data saved (35302 records). [2025-09-19T20:53:27.449485] [INFO ] [MAIN ] PX: Full history saved. [2025-09-19T20:53:27.449667] [INFO ] [MAIN ] Update Progress: 1756/2372 symbols completed. PX took 34.4s. Estimated remaining: 1h 21m 52s. Rate: 7.5 symbols/min [2025-09-19T20:53:27.629383] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:53:27.643588] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T20:53:27.702515] [DEBUG] [LOCAL ] QS: Loaded 54132 existing records from primary storage. [2025-09-19T20:53:27.702726] [INFO ] [MAIN ] QS: Loaded 54132 existing records. [2025-09-19T20:53:27.848425] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-19T20:53:27.934091] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:53:27.934382] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-19T20:53:27.934431] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-19T20:53:27.935490] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-19T20:53:27.935553] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-19T20:53:28.295127] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:53:28.643267] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-19T20:53:29.443229] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-19T20:53:29.944093] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T20:53:30.223970] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (3.18 seconds). [2025-09-19T20:53:30.243212] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-19T20:53:31.043327] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-19T20:53:31.182105] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T20:53:31.215333] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T20:53:31.223164] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-09-19T20:53:31.223349] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-19T20:53:31.224465] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:53:31.224559] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:53:31.224607] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:53:31.224727] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-19T20:53:31.224814] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-19T20:53:31.224864] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-19T20:53:31.224966] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-09-19T20:53:31.225085] [INFO ] [MAIN ] Update Progress: 1757/2372 symbols completed. QBTS took 36.3s. Estimated remaining: 1h 21m 43s. Rate: 7.5 symbols/min [2025-09-19T20:53:31.296172] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-19T20:53:31.843334] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-19T20:53:32.648842] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-19T20:53:32.667433] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T20:53:33.431838] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T20:53:33.443206] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-19T20:53:34.243279] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-19T20:53:34.888517] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-19T20:53:34.892973] [INFO ] [REMOTE ] QD: Full fetch complete (40705 records). [2025-09-19T20:53:34.893072] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-19T20:53:35.300606] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-19T20:53:35.300801] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-19T20:53:35.302126] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-19T20:53:35.302219] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-19T20:53:35.303825] [DEBUG] [LOCAL ] QD: Trimmed 40705 records to 28413 (keeping 200 days of data) [2025-09-19T20:53:35.386431] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-09-19T20:53:35.425259] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-19T20:53:35.504084] [DEBUG] [LOCAL ] QD: Primary data saved (28413 records). [2025-09-19T20:53:35.504224] [INFO ] [MAIN ] QD: Full history saved. [2025-09-19T20:53:35.504357] [INFO ] [MAIN ] Update Progress: 1758/2372 symbols completed. QD took 25.9s. Estimated remaining: 1h 21m 34s. Rate: 7.5 symbols/min [2025-09-19T20:53:36.114043] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T20:53:36.123178] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-19T20:53:37.433827] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-19T20:53:37.444638] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-19T20:53:38.320110] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T20:53:38.330724] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-19T20:53:39.687002] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T20:53:39.699861] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-19T20:53:40.743868] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-19T20:53:40.754486] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-19T20:53:42.133364] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-19T20:53:42.145095] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-19T20:53:43.063557] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T20:53:43.075479] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-19T20:53:44.598513] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-19T20:53:44.610048] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-19T20:53:44.637383] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-19T20:53:44.647938] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-19T20:53:46.653335] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T20:53:46.666329] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-19T20:53:47.165663] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-19T20:53:47.177491] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-19T20:53:48.414746] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T20:53:48.425379] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-19T20:53:50.268001] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T20:53:50.317021] [INFO ] [REMOTE ] QGEN: Full fetch complete (69976 records). [2025-09-19T20:53:50.317528] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-19T20:53:50.319777] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-09-19T20:53:50.404253] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-19T20:53:50.753966] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-19T20:53:50.754124] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-19T20:53:50.755710] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-19T20:53:50.755836] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-19T20:53:50.758342] [DEBUG] [LOCAL ] QGEN: Trimmed 69976 records to 49909 (keeping 200 days of data) [2025-09-19T20:53:51.072365] [DEBUG] [LOCAL ] QGEN: Primary data saved (49909 records). [2025-09-19T20:53:51.072631] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-19T20:53:51.072915] [INFO ] [MAIN ] Update Progress: 1759/2372 symbols completed. QGEN took 25.8s. Estimated remaining: 1h 21m 28s. Rate: 7.5 symbols/min [2025-09-19T20:53:53.226732] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-19T20:53:53.241486] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-19T20:53:55.927380] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-19T20:53:55.937014] [INFO ] [REMOTE ] QS: Full fetch complete (77883 records). [2025-09-19T20:53:55.937180] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-19T20:53:56.363346] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-19T20:53:56.363496] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-19T20:53:56.364849] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-19T20:53:56.364924] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-19T20:53:56.366723] [DEBUG] [LOCAL ] QS: Trimmed 77883 records to 54522 (keeping 200 days of data) [2025-09-19T20:53:56.700979] [DEBUG] [LOCAL ] QS: Primary data saved (54522 records). [2025-09-19T20:53:56.701299] [INFO ] [MAIN ] QS: Full history saved. [2025-09-19T20:53:56.701464] [INFO ] [MAIN ] Update Progress: 1760/2372 symbols completed. QS took 29.3s. Estimated remaining: 1h 21m 19s. Rate: 7.5 symbols/min [2025-09-19T20:53:57.331305] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:53:57.427096] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:53:57.399525] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:53:57.459731] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:53:57.474607] [DEBUG] [LOCAL ] QVCC: Loaded 9166 existing records from primary storage. [2025-09-19T20:53:57.474880] [INFO ] [MAIN ] QVCC: Loaded 9166 existing records. [2025-09-19T20:53:57.690058] [DEBUG] [LOCAL ] QUAD: Loaded 24380 existing records from primary storage. [2025-09-19T20:53:57.694632] [INFO ] [MAIN ] QUAD: Loaded 24380 existing records. [2025-09-19T20:53:57.694290] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:53:57.781063] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-19T20:53:57.791833] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-19T20:53:57.828284] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-19T20:53:57.828202] [DEBUG] [LOCAL ] QTWO: Loaded 39386 existing records from primary storage. [2025-09-19T20:53:57.828635] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-19T20:53:57.833969] [INFO ] [MAIN ] QTWO: Loaded 39386 existing records. [2025-09-19T20:53:58.121151] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:53:58.152192] [DEBUG] [LOCAL ] QSR: Loaded 52780 existing records from primary storage. [2025-09-19T20:53:58.167974] [INFO ] [MAIN ] QSR: Loaded 52780 existing records. [2025-09-19T20:53:58.179200] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-19T20:53:58.221150] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-19T20:53:58.380544] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-19T20:53:58.451255] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-19T20:53:58.451082] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:53:58.538877] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-19T20:53:58.592011] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-19T20:53:58.630151] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-19T20:53:58.666083] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-19T20:53:58.902174] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:53:58.954094] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:53:58.954175] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-19T20:53:59.000053] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-19T20:53:59.011259] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-19T20:53:59.074677] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-19T20:53:59.093891] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-19T20:53:59.717054] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:53:59.749550] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-19T20:53:59.778879] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:53:59.804366] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-19T20:53:59.902045] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:53:59.902381] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-19T20:54:00.344696] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T20:54:00.347481] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-19T20:54:01.206308] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T20:54:01.208472] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-19T20:54:01.287710] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T20:54:01.296958] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-19T20:54:01.546536] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T20:54:01.554836] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-19T20:54:01.647567] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T20:54:01.658873] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-19T20:54:02.746899] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T20:54:02.748416] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-19T20:54:04.454255] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (3.16 seconds). [2025-09-19T20:54:04.459739] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-19T20:54:04.999472] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (3.44 seconds). [2025-09-19T20:54:05.007894] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-19T20:54:05.247945] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (3.59 seconds). [2025-09-19T20:54:05.258795] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-19T20:54:05.300839] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-19T20:54:05.304149] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-19T20:54:05.528313] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T20:54:05.534370] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-19T20:54:06.256267] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T20:54:06.258638] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-19T20:54:06.847228] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T20:54:06.855898] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-19T20:54:06.981542] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T20:54:06.994410] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-19T20:54:07.030964] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T20:54:07.038104] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-19T20:54:07.305416] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T20:54:07.308587] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-19T20:54:08.385399] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T20:54:08.388967] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-19T20:54:08.647386] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T20:54:08.656665] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-19T20:54:08.692702] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-19T20:54:08.699906] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-19T20:54:09.098498] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T20:54:09.101065] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-19T20:54:09.133426] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T20:54:09.145285] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-19T20:54:10.044564] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-19T20:54:10.047239] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-19T20:54:10.284448] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T20:54:10.291300] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-19T20:54:10.601094] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T20:54:10.609582] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-19T20:54:10.758510] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T20:54:10.762188] [INFO ] [REMOTE ] QVCC: Full fetch complete (11992 records). [2025-09-19T20:54:10.762364] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-19T20:54:11.133725] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-19T20:54:11.133917] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-19T20:54:11.134240] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-19T20:54:11.134418] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-19T20:54:11.135149] [DEBUG] [LOCAL ] QVCC: Trimmed 11992 records to 9212 (keeping 200 days of data) [2025-09-19T20:54:11.188628] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T20:54:11.196151] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-19T20:54:11.211390] [DEBUG] [LOCAL ] QVCC: Primary data saved (9212 records). [2025-09-19T20:54:11.211523] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-19T20:54:11.211636] [INFO ] [MAIN ] Update Progress: 1761/2372 symbols completed. QVCC took 14.5s. Estimated remaining: 1h 21m 14s. Rate: 7.5 symbols/min [2025-09-19T20:54:11.381351] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:54:11.388454] [DEBUG] [LOCAL ] QVCD: Loaded 4676 existing records from primary storage. [2025-09-19T20:54:11.388561] [INFO ] [MAIN ] QVCD: Loaded 4676 existing records. [2025-09-19T20:54:11.576361] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:54:11.577796] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-19T20:54:11.577855] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-19T20:54:11.578748] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-19T20:54:11.578809] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-19T20:54:11.907396] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-19T20:54:11.973597] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-19T20:54:11.997270] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:54:11.997866] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-19T20:54:12.439749] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-19T20:54:12.448465] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-19T20:54:12.537263] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T20:54:12.643271] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-19T20:54:12.828866] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T20:54:13.443272] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-19T20:54:14.364674] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T20:54:14.372747] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-19T20:54:14.710108] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T20:54:15.043282] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-19T20:54:15.223445] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-09-19T20:54:15.630967] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-19T20:54:15.843259] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-19T20:54:16.643286] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-19T20:54:17.380414] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T20:54:17.443315] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-19T20:54:17.865675] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T20:54:18.243266] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-19T20:54:19.321680] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (6.68 seconds). [2025-09-19T20:54:19.328165] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-19T20:54:19.549115] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T20:54:19.843249] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-19T20:54:20.021430] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T20:54:20.076579] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (5.70 seconds). [2025-09-19T20:54:20.643287] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-19T20:54:20.765594] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T20:54:21.443275] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-19T20:54:22.243324] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-19T20:54:22.483356] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T20:54:23.043268] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-19T20:54:24.208772] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (4.88 seconds). [2025-09-19T20:54:24.212108] [INFO ] [REMOTE ] QUAD: Full fetch complete (35191 records). [2025-09-19T20:54:24.212190] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-19T20:54:24.520490] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-19T20:54:24.543378] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-19T20:54:24.616001] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-19T20:54:24.616105] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-19T20:54:24.616964] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-19T20:54:24.617040] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-19T20:54:24.618084] [DEBUG] [LOCAL ] QUAD: Trimmed 35191 records to 24482 (keeping 200 days of data) [2025-09-19T20:54:24.762948] [DEBUG] [LOCAL ] QUAD: Primary data saved (24482 records). [2025-09-19T20:54:24.763089] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-19T20:54:24.763175] [INFO ] [MAIN ] Update Progress: 1762/2372 symbols completed. QUAD took 28.1s. Estimated remaining: 1h 21m 8s. Rate: 7.5 symbols/min [2025-09-19T20:54:24.937269] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:54:24.997714] [DEBUG] [LOCAL ] QXO: Loaded 53532 existing records from primary storage. [2025-09-19T20:54:24.997893] [INFO ] [MAIN ] QXO: Loaded 53532 existing records. [2025-09-19T20:54:25.163415] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T20:54:25.217355] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:54:25.217750] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-19T20:54:25.217810] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-19T20:54:25.217931] [INFO ] [REMOTE ] QTWO: Full fetch complete (57202 records). [2025-09-19T20:54:25.218063] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-19T20:54:25.250917] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-19T20:54:25.290265] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-19T20:54:25.689204] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T20:54:25.769949] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-19T20:54:25.982196] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-19T20:54:25.987443] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-19T20:54:26.002222] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-19T20:54:26.019487] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-19T20:54:26.025213] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:54:26.025627] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-19T20:54:26.027216] [DEBUG] [LOCAL ] QTWO: Trimmed 57202 records to 39758 (keeping 200 days of data) [2025-09-19T20:54:26.275712] [DEBUG] [LOCAL ] QTWO: Primary data saved (39758 records). [2025-09-19T20:54:26.275854] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-19T20:54:26.275954] [INFO ] [MAIN ] Update Progress: 1763/2372 symbols completed. QTWO took 29.6s. Estimated remaining: 1h 20m 57s. Rate: 7.5 symbols/min [2025-09-19T20:54:26.448124] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:54:26.492273] [DEBUG] [LOCAL ] R: Loaded 30064 existing records from primary storage. [2025-09-19T20:54:26.492433] [INFO ] [MAIN ] R: Loaded 30064 existing records. [2025-09-19T20:54:26.657431] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T20:54:26.690521] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-19T20:54:26.733291] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:54:26.733966] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-19T20:54:26.734075] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-19T20:54:26.735287] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-19T20:54:26.735350] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-19T20:54:27.089698] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (5.65 seconds). [2025-09-19T20:54:27.148553] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-19T20:54:27.169630] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:54:27.381623] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-19T20:54:27.382692] [INFO ] [REMOTE ] QVCD: Full fetch complete (6176 records). [2025-09-19T20:54:27.382766] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-19T20:54:27.742430] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-19T20:54:27.742530] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-19T20:54:27.742716] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-19T20:54:27.742776] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-19T20:54:27.743204] [DEBUG] [LOCAL ] QVCD: Trimmed 6176 records to 4688 (keeping 200 days of data) [2025-09-19T20:54:27.771216] [DEBUG] [LOCAL ] QVCD: Primary data saved (4688 records). [2025-09-19T20:54:27.771351] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-19T20:54:27.771440] [INFO ] [MAIN ] Update Progress: 1764/2372 symbols completed. QVCD took 16.6s. Estimated remaining: 1h 20m 47s. Rate: 7.5 symbols/min [2025-09-19T20:54:27.849401] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-19T20:54:27.959798] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:54:27.983072] [DEBUG] [LOCAL ] RA: Loaded 21939 existing records from primary storage. [2025-09-19T20:54:27.983201] [INFO ] [MAIN ] RA: Loaded 21939 existing records. [2025-09-19T20:54:28.190400] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:54:28.190926] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-19T20:54:28.191066] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-19T20:54:28.191992] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-19T20:54:28.192053] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-19T20:54:28.394190] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T20:54:28.596748] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:54:28.629956] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T20:54:28.637868] [INFO ] [REMOTE ] QSR: Full fetch complete (75802 records). [2025-09-19T20:54:28.638037] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-19T20:54:28.650388] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-19T20:54:29.039973] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-19T20:54:29.040063] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-19T20:54:29.041205] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-19T20:54:29.041271] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-19T20:54:29.042936] [DEBUG] [LOCAL ] QSR: Trimmed 75802 records to 53169 (keeping 200 days of data) [2025-09-19T20:54:29.385389] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T20:54:29.403544] [DEBUG] [LOCAL ] QSR: Primary data saved (53169 records). [2025-09-19T20:54:29.403965] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-19T20:54:29.404100] [INFO ] [MAIN ] Update Progress: 1765/2372 symbols completed. QSR took 32.7s. Estimated remaining: 1h 20m 37s. Rate: 7.5 symbols/min [2025-09-19T20:54:29.448501] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-19T20:54:29.583232] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:54:29.620405] [DEBUG] [LOCAL ] RACE: Loaded 33413 existing records from primary storage. [2025-09-19T20:54:29.620555] [INFO ] [MAIN ] RACE: Loaded 33413 existing records. [2025-09-19T20:54:29.809279] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:54:29.809535] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-19T20:54:29.809584] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-19T20:54:29.810430] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-19T20:54:29.810494] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-19T20:54:30.193146] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:54:30.208320] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T20:54:30.243213] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-19T20:54:31.043308] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-19T20:54:31.448050] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T20:54:31.525031] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T20:54:31.843297] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-19T20:54:32.256900] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T20:54:32.643310] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-19T20:54:32.854099] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T20:54:33.443267] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-19T20:54:34.243318] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-19T20:54:34.499954] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T20:54:34.627456] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T20:54:35.043263] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-19T20:54:35.206806] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T20:54:35.843271] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-19T20:54:36.447991] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T20:54:36.643270] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-19T20:54:37.443273] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-19T20:54:37.705527] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T20:54:38.251630] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-19T20:54:38.287745] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T20:54:39.043318] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-19T20:54:39.843233] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-19T20:54:39.868217] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-19T20:54:40.179434] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T20:54:40.643350] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-19T20:54:41.443297] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-19T20:54:41.630393] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-19T20:54:41.907395] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T20:54:42.015006] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T20:54:42.243279] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-19T20:54:42.838609] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T20:54:43.043297] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-19T20:54:43.843269] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-19T20:54:44.527376] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-19T20:54:44.643282] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-19T20:54:44.852059] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T20:54:45.086483] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T20:54:45.443283] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-19T20:54:46.243228] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-19T20:54:46.761539] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T20:54:47.043268] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-19T20:54:47.223468] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T20:54:47.241714] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T20:54:47.843292] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-19T20:54:48.075220] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-19T20:54:48.643244] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-19T20:54:49.151312] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T20:54:49.443331] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-19T20:54:49.830405] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T20:54:50.243309] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-19T20:54:51.045423] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-19T20:54:51.048218] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T20:54:51.647254] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T20:54:51.843266] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-19T20:54:52.114228] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-19T20:54:52.643277] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-19T20:54:53.443291] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-19T20:54:53.688174] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T20:54:54.168285] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T20:54:54.243298] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-19T20:54:55.043236] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-19T20:54:55.599143] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T20:54:55.848639] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-19T20:54:55.872123] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-19T20:54:56.619673] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T20:54:56.624500] [INFO ] [REMOTE ] RACE: Full fetch complete (47651 records). [2025-09-19T20:54:56.624590] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-19T20:54:56.648395] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-19T20:54:57.018525] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-19T20:54:57.018670] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-19T20:54:57.020151] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-19T20:54:57.020215] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-19T20:54:57.021393] [DEBUG] [LOCAL ] RACE: Trimmed 47651 records to 33652 (keeping 200 days of data) [2025-09-19T20:54:57.237452] [DEBUG] [LOCAL ] RACE: Primary data saved (33652 records). [2025-09-19T20:54:57.237598] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-19T20:54:57.237704] [INFO ] [MAIN ] Update Progress: 1766/2372 symbols completed. RACE took 27.8s. Estimated remaining: 1h 20m 36s. Rate: 7.5 symbols/min [2025-09-19T20:54:57.419360] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:54:57.443288] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-19T20:54:57.457021] [DEBUG] [LOCAL ] RAMP: Loaded 37978 existing records from primary storage. [2025-09-19T20:54:57.457162] [INFO ] [MAIN ] RAMP: Loaded 37978 existing records. [2025-09-19T20:54:57.650774] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:54:57.651154] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-19T20:54:57.651222] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-19T20:54:57.652514] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-19T20:54:57.652575] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-19T20:54:57.972408] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T20:54:57.997670] [INFO ] [REMOTE ] R: Full fetch complete (41980 records). [2025-09-19T20:54:58.028227] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-19T20:54:58.062602] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:54:58.246482] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-19T20:54:58.464421] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-19T20:54:58.464505] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-19T20:54:58.465293] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-19T20:54:58.465356] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-19T20:54:58.466358] [DEBUG] [LOCAL ] R: Trimmed 41980 records to 30258 (keeping 200 days of data) [2025-09-19T20:54:58.658746] [DEBUG] [LOCAL ] R: Primary data saved (30258 records). [2025-09-19T20:54:58.658905] [INFO ] [MAIN ] R: Full history saved. [2025-09-19T20:54:58.659023] [INFO ] [MAIN ] Update Progress: 1767/2372 symbols completed. R took 32.4s. Estimated remaining: 1h 20m 26s. Rate: 7.5 symbols/min [2025-09-19T20:54:58.836854] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:54:58.847341] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T20:54:58.851528] [INFO ] [REMOTE ] RA: Full fetch complete (31907 records). [2025-09-19T20:54:58.851942] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-19T20:54:59.209678] [DEBUG] [LOCAL ] RBA: Loaded 46441 existing records from primary storage. [2025-09-19T20:54:59.243516] [INFO ] [MAIN ] RBA: Loaded 46441 existing records. [2025-09-19T20:54:59.336286] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-19T20:54:59.363930] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-19T20:54:59.415294] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-19T20:54:59.417307] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-19T20:54:59.448845] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-19T20:54:59.448633] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-19T20:54:59.531386] [DEBUG] [LOCAL ] RA: Trimmed 31907 records to 22056 (keeping 200 days of data) [2025-09-19T20:54:59.553307] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:54:59.553864] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-19T20:54:59.553967] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-19T20:54:59.604597] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-19T20:54:59.613577] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-19T20:55:00.076619] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T20:55:00.079981] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:55:00.087700] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-19T20:55:00.117577] [DEBUG] [LOCAL ] RA: Primary data saved (22056 records). [2025-09-19T20:55:00.117742] [INFO ] [MAIN ] RA: Full history saved. [2025-09-19T20:55:00.117849] [INFO ] [MAIN ] Update Progress: 1768/2372 symbols completed. RA took 32.3s. Estimated remaining: 1h 20m 16s. Rate: 7.5 symbols/min [2025-09-19T20:55:00.302320] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:55:00.320458] [DEBUG] [LOCAL ] RBC: Loaded 15135 existing records from primary storage. [2025-09-19T20:55:00.320583] [INFO ] [MAIN ] RBC: Loaded 15135 existing records. [2025-09-19T20:55:00.495206] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:55:00.495498] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-19T20:55:00.495561] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-19T20:55:00.496188] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-19T20:55:00.496249] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-19T20:55:00.649788] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-19T20:55:00.851728] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:55:01.443282] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-19T20:55:01.649734] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T20:55:01.658287] [INFO ] [REMOTE ] QXO: Full fetch complete (75433 records). [2025-09-19T20:55:01.658474] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-19T20:55:02.093608] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T20:55:02.156928] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-19T20:55:02.157056] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-19T20:55:02.158532] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-19T20:55:02.158603] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-19T20:55:02.160380] [DEBUG] [LOCAL ] QXO: Trimmed 75433 records to 53922 (keeping 200 days of data) [2025-09-19T20:55:02.249894] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-19T20:55:02.508326] [DEBUG] [LOCAL ] QXO: Primary data saved (53922 records). [2025-09-19T20:55:02.508499] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-19T20:55:02.508594] [INFO ] [MAIN ] Update Progress: 1769/2372 symbols completed. QXO took 37.7s. Estimated remaining: 1h 20m 6s. Rate: 7.5 symbols/min [2025-09-19T20:55:02.716871] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:55:02.743628] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T20:55:02.767067] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T20:55:02.824016] [DEBUG] [LOCAL ] RBLX: Loaded 54112 existing records from primary storage. [2025-09-19T20:55:02.824194] [INFO ] [MAIN ] RBLX: Loaded 54112 existing records. [2025-09-19T20:55:03.021002] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:55:03.021280] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-19T20:55:03.021375] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-19T20:55:03.022549] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-19T20:55:03.022632] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-19T20:55:03.048480] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-19T20:55:03.459188] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:55:03.843224] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-19T20:55:03.987579] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-19T20:55:04.154994] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T20:55:04.643288] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-19T20:55:05.443280] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-19T20:55:05.716163] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T20:55:06.243244] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-19T20:55:06.337294] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T20:55:07.043239] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-19T20:55:07.105585] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T20:55:07.311674] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T20:55:07.843266] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-19T20:55:08.492348] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T20:55:08.640056] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-19T20:55:08.644006] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-19T20:55:09.443311] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-19T20:55:10.243313] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-19T20:55:10.619878] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T20:55:10.702915] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T20:55:11.043322] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-19T20:55:11.843303] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-19T20:55:12.559637] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-19T20:55:12.643259] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-19T20:55:13.074885] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T20:55:13.443243] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-19T20:55:13.530606] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-19T20:55:14.243265] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-19T20:55:14.532586] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T20:55:14.626791] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T20:55:15.043281] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-19T20:55:15.843285] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-19T20:55:16.271416] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T20:55:16.643252] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-19T20:55:16.699727] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T20:55:17.287344] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-19T20:55:17.443287] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-19T20:55:18.243275] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-19T20:55:18.492268] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T20:55:18.494983] [INFO ] [REMOTE ] RBC: Full fetch complete (21938 records). [2025-09-19T20:55:18.495063] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-19T20:55:18.912068] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-19T20:55:18.916050] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-19T20:55:18.916725] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-19T20:55:18.915917] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T20:55:18.916937] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-19T20:55:18.929087] [DEBUG] [LOCAL ] RBC: Trimmed 21938 records to 15224 (keeping 200 days of data) [2025-09-19T20:55:19.028236] [DEBUG] [LOCAL ] RBC: Primary data saved (15224 records). [2025-09-19T20:55:19.028415] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-19T20:55:19.028515] [INFO ] [MAIN ] Update Progress: 1770/2372 symbols completed. RBC took 18.9s. Estimated remaining: 1h 20m 1s. Rate: 7.5 symbols/min [2025-09-19T20:55:19.050693] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-19T20:55:19.207604] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:55:19.214903] [DEBUG] [LOCAL ] RBOT: Loaded 5141 existing records from primary storage. [2025-09-19T20:55:19.215019] [INFO ] [MAIN ] RBOT: Loaded 5141 existing records. [2025-09-19T20:55:19.390878] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:55:19.391156] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-19T20:55:19.391205] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-19T20:55:19.391551] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-19T20:55:19.391610] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-19T20:55:19.743162] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:55:19.843241] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-19T20:55:20.643274] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-19T20:55:20.767883] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T20:55:20.865770] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-19T20:55:20.985814] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T20:55:21.443264] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-19T20:55:22.234210] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T20:55:22.243206] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-19T20:55:23.043233] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-19T20:55:23.279547] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T20:55:23.843282] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-19T20:55:24.077420] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T20:55:24.643239] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-19T20:55:24.994279] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T20:55:25.026637] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-19T20:55:25.443265] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-19T20:55:26.243329] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-19T20:55:26.354318] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T20:55:26.360161] [INFO ] [REMOTE ] RAMP: Full fetch complete (53103 records). [2025-09-19T20:55:26.360272] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-19T20:55:26.770493] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-19T20:55:26.770736] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-19T20:55:26.771780] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-19T20:55:26.771887] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-19T20:55:26.779031] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T20:55:26.781741] [DEBUG] [LOCAL ] RAMP: Trimmed 53103 records to 38311 (keeping 200 days of data) [2025-09-19T20:55:27.004837] [DEBUG] [LOCAL ] RAMP: Primary data saved (38311 records). [2025-09-19T20:55:27.004986] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-19T20:55:27.005074] [INFO ] [MAIN ] Update Progress: 1771/2372 symbols completed. RAMP took 29.8s. Estimated remaining: 1h 19m 53s. Rate: 7.5 symbols/min [2025-09-19T20:55:27.048417] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-19T20:55:27.180453] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:55:27.234411] [DEBUG] [LOCAL ] RBRK: Loaded 53461 existing records from primary storage. [2025-09-19T20:55:27.234572] [INFO ] [MAIN ] RBRK: Loaded 53461 existing records. [2025-09-19T20:55:27.416492] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:55:27.416827] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-19T20:55:27.416881] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-19T20:55:27.418336] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-19T20:55:27.418412] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-19T20:55:27.727789] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T20:55:27.804950] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:55:27.843291] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-19T20:55:27.906771] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-19T20:55:28.643265] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-19T20:55:29.443235] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-19T20:55:30.137957] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-19T20:55:30.243233] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-19T20:55:30.502264] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T20:55:31.043291] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-19T20:55:31.687703] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T20:55:31.770842] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T20:55:31.843322] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-19T20:55:32.095021] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T20:55:32.643345] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-19T20:55:33.443288] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-19T20:55:34.243259] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-19T20:55:34.486264] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T20:55:34.527562] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-09-19T20:55:34.664519] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-19T20:55:35.043292] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-19T20:55:35.565828] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-19T20:55:35.614596] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T20:55:35.843257] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-19T20:55:36.643278] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-19T20:55:37.443252] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-19T20:55:38.187928] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-19T20:55:38.243264] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-19T20:55:38.646940] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T20:55:38.655061] [INFO ] [REMOTE ] RBA: Full fetch complete (65298 records). [2025-09-19T20:55:38.655242] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-19T20:55:39.050106] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-19T20:55:39.050787] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-19T20:55:39.050863] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-19T20:55:39.052731] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-19T20:55:39.052905] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-19T20:55:39.054462] [DEBUG] [LOCAL ] RBA: Trimmed 65298 records to 46765 (keeping 200 days of data) [2025-09-19T20:55:39.362441] [DEBUG] [LOCAL ] RBA: Primary data saved (46765 records). [2025-09-19T20:55:39.362587] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-19T20:55:39.363757] [INFO ] [MAIN ] Update Progress: 1772/2372 symbols completed. RBA took 40.7s. Estimated remaining: 1h 19m 46s. Rate: 7.5 symbols/min [2025-09-19T20:55:39.541327] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:55:39.591553] [DEBUG] [LOCAL ] RC: Loaded 49495 existing records from primary storage. [2025-09-19T20:55:39.591734] [INFO ] [MAIN ] RC: Loaded 49495 existing records. [2025-09-19T20:55:39.774686] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:55:39.774943] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-19T20:55:39.774990] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-19T20:55:39.776278] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-19T20:55:39.776347] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-19T20:55:40.086064] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T20:55:40.152506] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-19T20:55:40.151709] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:55:40.188025] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (3.54 seconds). [2025-09-19T20:55:40.339242] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T20:55:40.643289] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-19T20:55:41.443312] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-19T20:55:41.464629] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T20:55:42.243272] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-19T20:55:42.631231] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T20:55:42.823185] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-19T20:55:42.824823] [INFO ] [REMOTE ] RBOT: Full fetch complete (8734 records). [2025-09-19T20:55:42.824895] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-19T20:55:43.048402] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-19T20:55:43.196517] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-19T20:55:43.196599] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-19T20:55:43.197005] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-19T20:55:43.197066] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-19T20:55:43.197479] [DEBUG] [LOCAL ] RBOT: Trimmed 8734 records to 5197 (keeping 200 days of data) [2025-09-19T20:55:43.227187] [DEBUG] [LOCAL ] RBOT: Primary data saved (5197 records). [2025-09-19T20:55:43.227285] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-19T20:55:43.227404] [INFO ] [MAIN ] Update Progress: 1773/2372 symbols completed. RBOT took 24.2s. Estimated remaining: 1h 19m 37s. Rate: 7.5 symbols/min [2025-09-19T20:55:43.403887] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:55:43.404134] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-19T20:55:43.404204] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-19T20:55:43.404377] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-19T20:55:43.404425] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-19T20:55:43.404468] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-19T20:55:43.404511] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-19T20:55:43.766003] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:55:43.843262] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-19T20:55:44.388150] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T20:55:44.643272] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-19T20:55:44.734509] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-09-19T20:55:45.260904] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T20:55:45.443298] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-19T20:55:45.887808] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (2.84 seconds). [2025-09-19T20:55:46.230084] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-19T20:55:46.243233] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-19T20:55:47.043263] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-19T20:55:47.843309] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-19T20:55:48.643280] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-19T20:55:49.054227] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-19T20:55:49.180276] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T20:55:49.416963] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-19T20:55:49.417750] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T20:55:49.443213] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-19T20:55:50.243313] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-19T20:55:51.043243] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-19T20:55:51.843267] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-19T20:55:52.427239] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-19T20:55:52.589826] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T20:55:52.643242] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-19T20:55:52.874991] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-19T20:55:52.883723] [INFO ] [REMOTE ] RBLX: Full fetch complete (77785 records). [2025-09-19T20:55:52.883893] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-19T20:55:53.287734] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-19T20:55:53.287860] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-19T20:55:53.289057] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-19T20:55:53.289249] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-19T20:55:53.318724] [DEBUG] [LOCAL ] RBLX: Trimmed 77785 records to 54502 (keeping 200 days of data) [2025-09-19T20:55:53.320621] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T20:55:53.444010] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-19T20:55:53.707147] [DEBUG] [LOCAL ] RBLX: Primary data saved (54502 records). [2025-09-19T20:55:53.707309] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-19T20:55:53.707424] [INFO ] [MAIN ] Update Progress: 1774/2372 symbols completed. RBLX took 51.2s. Estimated remaining: 1h 19m 30s. Rate: 7.5 symbols/min [2025-09-19T20:55:53.957633] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:55:53.957846] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-19T20:55:53.957901] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-19T20:55:53.958056] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-19T20:55:53.958098] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-19T20:55:53.958138] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-19T20:55:53.958223] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-19T20:55:54.246049] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-19T20:55:54.247736] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-19T20:55:54.331941] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:55:55.043278] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-19T20:55:55.650305] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T20:55:55.848415] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-19T20:55:55.869499] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-19T20:55:56.506487] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-19T20:55:56.538045] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T20:55:56.643258] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-19T20:55:57.443281] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-19T20:55:57.920549] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T20:55:58.243296] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-19T20:55:58.862229] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T20:55:58.870406] [INFO ] [REMOTE ] RBRK: Full fetch complete (76464 records). [2025-09-19T20:55:58.870575] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-19T20:55:59.048574] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-19T20:55:59.303435] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-19T20:55:59.303519] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-19T20:55:59.304584] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-19T20:55:59.304707] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-19T20:55:59.306264] [DEBUG] [LOCAL ] RBRK: Trimmed 76464 records to 53851 (keeping 200 days of data) [2025-09-19T20:55:59.530763] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T20:55:59.532544] [INFO ] [REMOTE ] RCB: Full fetch complete (3766 records). [2025-09-19T20:55:59.533215] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-19T20:55:59.744707] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T20:55:59.745560] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:55:59.746510] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:55:59.747179] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-19T20:55:59.747927] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-19T20:55:59.748371] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-19T20:55:59.749635] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-19T20:55:59.750078] [INFO ] [MAIN ] Update Progress: 1775/2372 symbols completed. RCB took 16.5s. Estimated remaining: 1h 19m 21s. Rate: 7.5 symbols/min [2025-09-19T20:55:59.851973] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-19T20:55:59.935033] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:56:00.032937] [DEBUG] [LOCAL ] RBRK: Primary data saved (53851 records). [2025-09-19T20:56:00.033140] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-19T20:56:00.033278] [INFO ] [MAIN ] Update Progress: 1776/2372 symbols completed. RBRK took 33.0s. Estimated remaining: 1h 19m 10s. Rate: 7.5 symbols/min [2025-09-19T20:56:00.186638] [DEBUG] [LOCAL ] RCI: Loaded 49208 existing records from primary storage. [2025-09-19T20:56:00.204019] [INFO ] [MAIN ] RCI: Loaded 49208 existing records. [2025-09-19T20:56:00.335634] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:56:00.346310] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-19T20:56:00.346376] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-19T20:56:00.346973] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-19T20:56:00.352458] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-19T20:56:00.362854] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-19T20:56:00.373180] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-19T20:56:00.535590] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:56:00.538343] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-19T20:56:00.538757] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-19T20:56:00.561115] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-19T20:56:00.578237] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-19T20:56:00.958898] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T20:56:01.040316] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-19T20:56:01.102555] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:56:01.183675] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:56:01.214819] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T20:56:01.443249] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-19T20:56:02.240755] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T20:56:02.243155] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-19T20:56:02.866589] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-19T20:56:03.043279] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-19T20:56:03.349488] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T20:56:03.843323] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-19T20:56:04.265488] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T20:56:04.643285] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-19T20:56:05.443279] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-19T20:56:05.710507] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T20:56:06.243278] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-19T20:56:06.456624] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T20:56:06.776422] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T20:56:07.043283] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-19T20:56:07.843365] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-19T20:56:08.102319] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-19T20:56:08.139269] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T20:56:08.643295] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-19T20:56:09.443308] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-19T20:56:09.822358] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T20:56:10.243308] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-19T20:56:10.473133] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-19T20:56:10.592380] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T20:56:10.969511] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T20:56:11.043217] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-19T20:56:11.843240] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-19T20:56:11.862284] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T20:56:12.643269] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-19T20:56:13.443330] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-19T20:56:13.592516] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T20:56:14.243311] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-19T20:56:14.558066] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T20:56:14.893035] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T20:56:15.043236] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-19T20:56:15.843316] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-19T20:56:16.044352] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T20:56:16.053490] [INFO ] [REMOTE ] RC: Full fetch complete (70809 records). [2025-09-19T20:56:16.053678] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-19T20:56:16.459141] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-19T20:56:16.459325] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-19T20:56:16.460335] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-19T20:56:16.460398] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-19T20:56:16.461836] [DEBUG] [LOCAL ] RC: Trimmed 70809 records to 49839 (keeping 200 days of data) [2025-09-19T20:56:16.645341] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-19T20:56:16.763717] [DEBUG] [LOCAL ] RC: Primary data saved (49839 records). [2025-09-19T20:56:16.763860] [INFO ] [MAIN ] RC: Full history saved. [2025-09-19T20:56:16.764008] [INFO ] [MAIN ] Update Progress: 1777/2372 symbols completed. RC took 37.4s. Estimated remaining: 1h 19m 5s. Rate: 7.5 symbols/min [2025-09-19T20:56:16.933788] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:56:16.946726] [DEBUG] [LOCAL ] RCS: Loaded 11657 existing records from primary storage. [2025-09-19T20:56:16.946947] [INFO ] [MAIN ] RCS: Loaded 11657 existing records. [2025-09-19T20:56:17.128313] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:56:17.128730] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-19T20:56:17.128794] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-19T20:56:17.129334] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-19T20:56:17.129400] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-19T20:56:17.266831] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T20:56:17.450333] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-19T20:56:17.485064] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T20:56:17.553322] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:56:17.990749] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T20:56:18.243273] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-19T20:56:19.043278] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-19T20:56:19.412986] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T20:56:19.472967] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T20:56:19.843273] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-19T20:56:19.862356] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T20:56:20.643271] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-19T20:56:21.105318] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T20:56:21.386582] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T20:56:21.443267] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-19T20:56:22.105775] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T20:56:22.107073] [INFO ] [REMOTE ] RCD: Full fetch complete (6736 records). [2025-09-19T20:56:22.107153] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-19T20:56:22.258206] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-19T20:56:22.360285] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-19T20:56:22.360593] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:56:22.360695] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:56:22.360797] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-19T20:56:22.360893] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-19T20:56:22.360951] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-19T20:56:22.360996] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-19T20:56:22.361064] [INFO ] [MAIN ] Update Progress: 1778/2372 symbols completed. RCD took 28.7s. Estimated remaining: 1h 18m 57s. Rate: 7.5 symbols/min [2025-09-19T20:56:22.541117] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:56:22.597405] [DEBUG] [LOCAL ] RCUS: Loaded 43205 existing records from primary storage. [2025-09-19T20:56:22.597583] [INFO ] [MAIN ] RCUS: Loaded 43205 existing records. [2025-09-19T20:56:22.772184] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:56:22.772457] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-19T20:56:22.772506] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-19T20:56:22.774044] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-19T20:56:22.774105] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-19T20:56:23.048039] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-19T20:56:23.131713] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:56:23.638839] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T20:56:23.843309] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-19T20:56:23.867638] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T20:56:24.643265] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-19T20:56:25.443306] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-19T20:56:25.544291] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T20:56:26.243280] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-19T20:56:26.741847] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T20:56:27.048358] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-19T20:56:27.064345] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T20:56:27.536183] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T20:56:27.843284] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-19T20:56:28.643325] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-19T20:56:28.713126] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T20:56:29.443282] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-19T20:56:29.527793] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T20:56:29.535003] [INFO ] [REMOTE ] RCL: Full fetch complete (75101 records). [2025-09-19T20:56:29.535141] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-19T20:56:29.536064] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T20:56:29.536154] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T20:56:29.536197] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T20:56:29.536272] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-19T20:56:29.536353] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-19T20:56:29.536389] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-19T20:56:29.536429] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-09-19T20:56:29.536486] [INFO ] [MAIN ] Update Progress: 1779/2372 symbols completed. RCL took 29.5s. Estimated remaining: 1h 18m 48s. Rate: 7.5 symbols/min [2025-09-19T20:56:29.717763] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:56:29.775789] [DEBUG] [LOCAL ] RDDT: Loaded 54174 existing records from primary storage. [2025-09-19T20:56:29.775962] [INFO ] [MAIN ] RDDT: Loaded 54174 existing records. [2025-09-19T20:56:29.971884] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:56:29.972239] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-19T20:56:29.972357] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-19T20:56:29.974446] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-19T20:56:29.974510] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-19T20:56:30.255758] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-19T20:56:30.291255] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-19T20:56:30.397960] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:56:31.043261] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-19T20:56:31.083436] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T20:56:31.170809] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T20:56:31.843274] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-19T20:56:32.643249] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-19T20:56:32.802960] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T20:56:32.810158] [INFO ] [REMOTE ] RCI: Full fetch complete (70571 records). [2025-09-19T20:56:32.810322] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-19T20:56:33.094833] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T20:56:33.232601] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-19T20:56:33.232721] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-19T20:56:33.233752] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-19T20:56:33.233833] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-19T20:56:33.235344] [DEBUG] [LOCAL ] RCI: Trimmed 70571 records to 49535 (keeping 200 days of data) [2025-09-19T20:56:33.456201] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-19T20:56:33.552859] [DEBUG] [LOCAL ] RCI: Primary data saved (49535 records). [2025-09-19T20:56:33.552999] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-19T20:56:33.553089] [INFO ] [MAIN ] Update Progress: 1780/2372 symbols completed. RCI took 33.8s. Estimated remaining: 1h 18m 39s. Rate: 7.5 symbols/min [2025-09-19T20:56:33.730929] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:56:33.772579] [DEBUG] [LOCAL ] RDN: Loaded 45529 existing records from primary storage. [2025-09-19T20:56:33.772805] [INFO ] [MAIN ] RDN: Loaded 45529 existing records. [2025-09-19T20:56:33.962697] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:56:33.963130] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-19T20:56:33.963277] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-19T20:56:33.964475] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-19T20:56:33.964537] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-19T20:56:34.219459] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T20:56:34.245912] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-19T20:56:34.376436] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:56:34.598521] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T20:56:35.043272] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-19T20:56:35.089187] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T20:56:35.843308] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-19T20:56:36.079485] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T20:56:36.643272] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-19T20:56:37.443307] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-19T20:56:37.742517] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T20:56:37.857585] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T20:56:38.243242] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-19T20:56:38.437587] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T20:56:39.043294] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-19T20:56:39.627325] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-19T20:56:39.843277] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-19T20:56:40.400145] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T20:56:40.643265] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-19T20:56:41.443269] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-19T20:56:41.656206] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T20:56:41.856715] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T20:56:42.243267] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-19T20:56:42.859687] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T20:56:43.043301] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-19T20:56:43.530513] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T20:56:43.687222] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T20:56:43.843286] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-19T20:56:44.643344] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-19T20:56:45.127174] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T20:56:45.443318] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-19T20:56:45.626450] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T20:56:46.243272] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-19T20:56:46.586498] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T20:56:47.043291] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-19T20:56:47.311288] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T20:56:47.843279] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-19T20:56:48.526835] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T20:56:48.643226] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-19T20:56:48.800597] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T20:56:49.443312] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-19T20:56:50.243362] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-19T20:56:50.424368] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T20:56:50.426811] [INFO ] [REMOTE ] RCS: Full fetch complete (19249 records). [2025-09-19T20:56:50.426888] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-19T20:56:50.816056] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-19T20:56:50.816189] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-19T20:56:50.816737] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-19T20:56:50.816859] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-19T20:56:50.818133] [DEBUG] [LOCAL ] RCS: Trimmed 19249 records to 11739 (keeping 200 days of data) [2025-09-19T20:56:50.906796] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T20:56:50.939475] [DEBUG] [LOCAL ] RCS: Primary data saved (11739 records). [2025-09-19T20:56:50.939676] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-19T20:56:50.939824] [INFO ] [MAIN ] Update Progress: 1781/2372 symbols completed. RCS took 34.2s. Estimated remaining: 1h 18m 34s. Rate: 7.5 symbols/min [2025-09-19T20:56:51.048522] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-19T20:56:51.120916] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:56:51.176792] [DEBUG] [LOCAL ] RDW: Loaded 52378 existing records from primary storage. [2025-09-19T20:56:51.176955] [INFO ] [MAIN ] RDW: Loaded 52378 existing records. [2025-09-19T20:56:51.361443] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:56:51.361998] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-19T20:56:51.362112] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-19T20:56:51.363489] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-19T20:56:51.363584] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-19T20:56:51.734245] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:56:51.766224] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T20:56:51.843260] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-19T20:56:52.643270] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-19T20:56:53.048701] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T20:56:53.448497] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-19T20:56:53.466775] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T20:56:54.243271] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-19T20:56:54.898414] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T20:56:55.043292] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-19T20:56:55.448317] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T20:56:55.843325] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-19T20:56:56.147755] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T20:56:56.643318] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-19T20:56:56.930931] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T20:56:57.443275] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-19T20:56:58.243275] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-19T20:56:58.286880] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-19T20:56:58.294964] [INFO ] [REMOTE ] RDDT: Full fetch complete (77892 records). [2025-09-19T20:56:58.295120] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-19T20:56:58.710736] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-19T20:56:58.711008] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-19T20:56:58.712282] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-19T20:56:58.712381] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-19T20:56:58.714353] [DEBUG] [LOCAL ] RDDT: Trimmed 77892 records to 54564 (keeping 200 days of data) [2025-09-19T20:56:58.827978] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T20:56:59.054109] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-19T20:56:59.083018] [DEBUG] [LOCAL ] RDDT: Primary data saved (54564 records). [2025-09-19T20:56:59.083149] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-19T20:56:59.083235] [INFO ] [MAIN ] Update Progress: 1782/2372 symbols completed. RDDT took 29.5s. Estimated remaining: 1h 18m 26s. Rate: 7.5 symbols/min [2025-09-19T20:56:59.266701] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:56:59.312456] [DEBUG] [LOCAL ] RDY: Loaded 47286 existing records from primary storage. [2025-09-19T20:56:59.312627] [INFO ] [MAIN ] RDY: Loaded 47286 existing records. [2025-09-19T20:56:59.513178] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:56:59.513492] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-19T20:56:59.513575] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-19T20:56:59.514724] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-19T20:56:59.514786] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-19T20:56:59.910853] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:56:59.911234] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-19T20:56:59.942896] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-19T20:56:59.971167] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T20:56:59.977557] [INFO ] [REMOTE ] RCUS: Full fetch complete (60301 records). [2025-09-19T20:56:59.977702] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-19T20:57:00.377318] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-19T20:57:00.377401] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-19T20:57:00.378316] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-19T20:57:00.378382] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-19T20:57:00.381739] [DEBUG] [LOCAL ] RCUS: Trimmed 60301 records to 43509 (keeping 200 days of data) [2025-09-19T20:57:00.633136] [DEBUG] [LOCAL ] RCUS: Primary data saved (43509 records). [2025-09-19T20:57:00.633321] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-19T20:57:00.633479] [INFO ] [MAIN ] Update Progress: 1783/2372 symbols completed. RCUS took 38.3s. Estimated remaining: 1h 18m 16s. Rate: 7.5 symbols/min [2025-09-19T20:57:00.655209] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-19T20:57:00.839456] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T20:57:00.842410] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:57:00.898592] [DEBUG] [LOCAL ] RELX: Loaded 48209 existing records from primary storage. [2025-09-19T20:57:00.898794] [INFO ] [MAIN ] RELX: Loaded 48209 existing records. [2025-09-19T20:57:01.072849] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:57:01.073132] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-19T20:57:01.073180] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-19T20:57:01.074261] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-19T20:57:01.074322] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-19T20:57:01.435183] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:57:01.443219] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-19T20:57:01.848885] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T20:57:02.243307] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-19T20:57:03.043301] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-19T20:57:03.182023] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-19T20:57:03.843406] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-19T20:57:04.322284] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-09-19T20:57:04.643271] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-19T20:57:04.909386] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T20:57:05.443303] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-19T20:57:05.704593] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-09-19T20:57:05.832350] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T20:57:05.970749] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T20:57:06.243272] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-19T20:57:07.049314] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-19T20:57:07.077924] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T20:57:07.086322] [INFO ] [REMOTE ] RDN: Full fetch complete (65637 records). [2025-09-19T20:57:07.086822] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-19T20:57:07.515707] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-19T20:57:07.515810] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-19T20:57:07.516988] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-19T20:57:07.517059] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-19T20:57:07.518752] [DEBUG] [LOCAL ] RDN: Trimmed 65637 records to 45916 (keeping 200 days of data) [2025-09-19T20:57:07.819915] [DEBUG] [LOCAL ] RDN: Primary data saved (45916 records). [2025-09-19T20:57:07.820085] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-19T20:57:07.820203] [INFO ] [MAIN ] Update Progress: 1784/2372 symbols completed. RDN took 34.3s. Estimated remaining: 1h 18m 8s. Rate: 7.5 symbols/min [2025-09-19T20:57:07.847166] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-19T20:57:08.018373] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:57:08.068063] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T20:57:08.114002] [DEBUG] [LOCAL ] RERE: Loaded 41126 existing records from primary storage. [2025-09-19T20:57:08.114186] [INFO ] [MAIN ] RERE: Loaded 41126 existing records. [2025-09-19T20:57:08.314423] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:57:08.314760] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-19T20:57:08.314820] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-19T20:57:08.315705] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-19T20:57:08.315765] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-19T20:57:08.648503] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-19T20:57:08.711925] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:57:09.279823] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-19T20:57:09.443290] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-19T20:57:09.634480] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T20:57:10.243314] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-19T20:57:11.043318] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-19T20:57:11.208362] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-19T20:57:11.286415] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T20:57:11.843338] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-19T20:57:12.230037] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T20:57:12.643325] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-19T20:57:12.957999] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T20:57:13.091774] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T20:57:13.443328] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-19T20:57:14.221523] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T20:57:14.243243] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-19T20:57:14.431340] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T20:57:15.043264] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-19T20:57:15.843261] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-19T20:57:16.643290] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-19T20:57:17.151247] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-19T20:57:17.443290] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-19T20:57:17.552453] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-19T20:57:18.243310] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-19T20:57:18.506781] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-19T20:57:18.768750] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T20:57:19.043321] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-19T20:57:19.843352] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-19T20:57:19.899921] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (3.26 seconds). [2025-09-19T20:57:19.996118] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T20:57:20.540457] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T20:57:20.643225] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-19T20:57:21.364737] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T20:57:21.443292] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-19T20:57:22.243256] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-19T20:57:22.571550] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T20:57:23.043424] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-19T20:57:23.071425] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T20:57:23.843298] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-19T20:57:24.651562] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-19T20:57:24.657215] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T20:57:25.066383] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T20:57:25.110172] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T20:57:25.443333] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-19T20:57:26.225009] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T20:57:26.243226] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-19T20:57:27.043287] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-19T20:57:27.721786] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-19T20:57:27.835863] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T20:57:27.845508] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-19T20:57:28.276064] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T20:57:28.282436] [INFO ] [REMOTE ] RDY: Full fetch complete (69172 records). [2025-09-19T20:57:28.282561] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-19T20:57:28.653397] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-19T20:57:28.700615] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-19T20:57:28.700747] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-19T20:57:28.701771] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-19T20:57:28.701836] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-19T20:57:28.703320] [DEBUG] [LOCAL ] RDY: Trimmed 69172 records to 47591 (keeping 200 days of data) [2025-09-19T20:57:28.995162] [DEBUG] [LOCAL ] RDY: Primary data saved (47591 records). [2025-09-19T20:57:28.995310] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-19T20:57:28.995399] [INFO ] [MAIN ] Update Progress: 1785/2372 symbols completed. RDY took 29.9s. Estimated remaining: 1h 18m 4s. Rate: 7.5 symbols/min [2025-09-19T20:57:29.171306] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:57:29.213593] [DEBUG] [LOCAL ] RES: Loaded 47909 existing records from primary storage. [2025-09-19T20:57:29.213772] [INFO ] [MAIN ] RES: Loaded 47909 existing records. [2025-09-19T20:57:29.387996] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:57:29.388244] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-19T20:57:29.388292] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-19T20:57:29.389368] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-19T20:57:29.389428] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-19T20:57:29.451506] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-19T20:57:29.744377] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:57:30.186320] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-19T20:57:30.194267] [INFO ] [REMOTE ] RDW: Full fetch complete (74258 records). [2025-09-19T20:57:30.194413] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-19T20:57:30.252087] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-19T20:57:30.597538] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-19T20:57:30.597620] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-19T20:57:30.598663] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-19T20:57:30.598727] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-19T20:57:30.600169] [DEBUG] [LOCAL ] RDW: Trimmed 74258 records to 52768 (keeping 200 days of data) [2025-09-19T20:57:30.930348] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-19T20:57:30.955725] [DEBUG] [LOCAL ] RDW: Primary data saved (52768 records). [2025-09-19T20:57:30.955842] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-19T20:57:30.957171] [INFO ] [MAIN ] Update Progress: 1786/2372 symbols completed. RDW took 40.0s. Estimated remaining: 1h 17m 54s. Rate: 7.5 symbols/min [2025-09-19T20:57:31.048373] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-19T20:57:31.133675] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:57:31.133864] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-09-19T20:57:31.133906] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-09-19T20:57:31.134043] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-19T20:57:31.134085] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-19T20:57:31.134124] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-09-19T20:57:31.134155] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-19T20:57:31.485521] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:57:31.560867] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T20:57:31.568242] [INFO ] [REMOTE ] RELX: Full fetch complete (66906 records). [2025-09-19T20:57:31.568355] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-19T20:57:31.850685] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-19T20:57:31.954521] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-19T20:57:31.954605] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-19T20:57:31.955561] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-19T20:57:31.955623] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-19T20:57:31.957020] [DEBUG] [LOCAL ] RELX: Trimmed 66906 records to 48561 (keeping 200 days of data) [2025-09-19T20:57:32.207623] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T20:57:32.285468] [DEBUG] [LOCAL ] RELX: Primary data saved (48561 records). [2025-09-19T20:57:32.285598] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-19T20:57:32.285715] [INFO ] [MAIN ] Update Progress: 1787/2372 symbols completed. RELX took 31.7s. Estimated remaining: 1h 17m 44s. Rate: 7.5 symbols/min [2025-09-19T20:57:32.454811] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:57:32.470869] [DEBUG] [LOCAL ] REX: Loaded 13927 existing records from primary storage. [2025-09-19T20:57:32.470984] [INFO ] [MAIN ] REX: Loaded 13927 existing records. [2025-09-19T20:57:32.646220] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-19T20:57:32.646134] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:57:32.647234] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-19T20:57:32.647290] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-19T20:57:32.647948] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-19T20:57:32.648034] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-19T20:57:33.000145] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:57:33.018935] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T20:57:33.025761] [INFO ] [REMOTE ] RERE: Full fetch complete (57475 records). [2025-09-19T20:57:33.025867] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-19T20:57:33.415277] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-19T20:57:33.415360] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-19T20:57:33.416310] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-19T20:57:33.416375] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-19T20:57:33.417559] [DEBUG] [LOCAL ] RERE: Trimmed 57475 records to 41496 (keeping 200 days of data) [2025-09-19T20:57:33.460881] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-19T20:57:33.653564] [DEBUG] [LOCAL ] RERE: Primary data saved (41496 records). [2025-09-19T20:57:33.653730] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-19T20:57:33.653838] [INFO ] [MAIN ] Update Progress: 1788/2372 symbols completed. RERE took 25.8s. Estimated remaining: 1h 17m 34s. Rate: 7.5 symbols/min [2025-09-19T20:57:33.849593] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:57:33.859882] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T20:57:33.916346] [DEBUG] [LOCAL ] REXR: Loaded 52409 existing records from primary storage. [2025-09-19T20:57:33.916493] [INFO ] [MAIN ] REXR: Loaded 52409 existing records. [2025-09-19T20:57:34.093221] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:57:34.093449] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-19T20:57:34.093500] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-19T20:57:34.094853] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-19T20:57:34.094927] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-19T20:57:34.245737] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-19T20:57:34.452255] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:57:34.637546] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T20:57:34.742069] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T20:57:35.043240] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-19T20:57:35.843331] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-19T20:57:36.024402] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T20:57:36.643297] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-19T20:57:36.802562] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T20:57:37.049161] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T20:57:37.443318] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-19T20:57:37.991676] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T20:57:38.243380] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-19T20:57:38.926450] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T20:57:39.043310] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-19T20:57:39.843306] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-19T20:57:40.502477] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T20:57:40.643282] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-19T20:57:41.198382] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T20:57:41.443268] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-19T20:57:42.053242] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T20:57:42.140438] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-19T20:57:42.243247] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-19T20:57:43.043279] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-19T20:57:43.280502] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T20:57:43.843306] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-19T20:57:44.108241] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-19T20:57:44.428960] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T20:57:44.643287] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-19T20:57:45.443265] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-19T20:57:45.801711] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T20:57:45.924329] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T20:57:46.243311] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-19T20:57:47.043295] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-19T20:57:47.225568] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T20:57:47.822120] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T20:57:47.843226] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-19T20:57:48.100159] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T20:57:48.643312] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-19T20:57:48.960029] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T20:57:49.443313] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-19T20:57:50.243297] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-19T20:57:50.454292] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T20:57:50.485946] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T20:57:51.043331] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-19T20:57:51.791944] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T20:57:51.843277] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-19T20:57:52.643335] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-19T20:57:52.899348] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T20:57:53.443333] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-19T20:57:53.922901] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T20:57:54.243349] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-19T20:57:54.696564] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T20:57:54.740370] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T20:57:55.043328] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-19T20:57:55.843318] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-19T20:57:56.495140] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T20:57:56.581629] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T20:57:56.613625] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T20:57:56.643225] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-19T20:57:57.443266] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-19T20:57:58.243277] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-19T20:57:58.501159] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T20:57:58.508079] [INFO ] [REMOTE ] RES: Full fetch complete (68798 records). [2025-09-19T20:57:58.508210] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-19T20:57:58.920546] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-19T20:57:58.920668] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-19T20:57:58.921703] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-19T20:57:58.921788] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-19T20:57:58.926334] [DEBUG] [LOCAL ] RES: Trimmed 68798 records to 48259 (keeping 200 days of data) [2025-09-19T20:57:59.043616] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-19T20:57:59.230430] [DEBUG] [LOCAL ] RES: Primary data saved (48259 records). [2025-09-19T20:57:59.230580] [INFO ] [MAIN ] RES: Full history saved. [2025-09-19T20:57:59.230728] [INFO ] [MAIN ] Update Progress: 1789/2372 symbols completed. RES took 30.2s. Estimated remaining: 1h 17m 32s. Rate: 7.5 symbols/min [2025-09-19T20:57:59.400456] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T20:57:59.428445] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:57:59.443690] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T20:57:59.446819] [INFO ] [REMOTE ] REX: Full fetch complete (21222 records). [2025-09-19T20:57:59.446919] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-19T20:57:59.455060] [INFO ] [REMOTE ] REVG: Full fetch complete (58332 records). [2025-09-19T20:57:59.455319] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-19T20:58:00.072531] [DEBUG] [LOCAL ] REZI: Loaded 47178 existing records from primary storage. [2025-09-19T20:58:00.085913] [INFO ] [MAIN ] REZI: Loaded 47178 existing records. [2025-09-19T20:58:00.366931] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-19T20:58:00.413131] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-19T20:58:00.454920] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-19T20:58:00.441597] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-19T20:58:00.482706] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-19T20:58:00.482574] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-19T20:58:00.515150] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:58:00.514809] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-19T20:58:00.515741] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-19T20:58:00.516123] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-19T20:58:00.516211] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-19T20:58:00.516434] [DEBUG] [LOCAL ] REX: Trimmed 21222 records to 14095 (keeping 200 days of data) [2025-09-19T20:58:00.517859] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-19T20:58:00.517947] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-19T20:58:00.698055] [DEBUG] [LOCAL ] REVG: Trimmed 58332 records to 41886 (keeping 200 days of data) [2025-09-19T20:58:01.088988] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:58:01.091234] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-19T20:58:01.097800] [DEBUG] [LOCAL ] REX: Primary data saved (14095 records). [2025-09-19T20:58:01.098466] [INFO ] [MAIN ] REX: Full history saved. [2025-09-19T20:58:01.098925] [INFO ] [MAIN ] Update Progress: 1790/2372 symbols completed. REX took 28.8s. Estimated remaining: 1h 17m 22s. Rate: 7.5 symbols/min [2025-09-19T20:58:01.321859] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:58:01.480339] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-19T20:58:01.516218] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-19T20:58:01.544608] [DEBUG] [LOCAL ] RF: Loaded 54020 existing records from primary storage. [2025-09-19T20:58:01.546121] [INFO ] [MAIN ] RF: Loaded 54020 existing records. [2025-09-19T20:58:01.769927] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:58:01.772630] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-19T20:58:01.774879] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-19T20:58:01.777433] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-19T20:58:01.778211] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-19T20:58:01.942159] [DEBUG] [LOCAL ] REVG: Primary data saved (41886 records). [2025-09-19T20:58:01.952683] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-19T20:58:01.970135] [INFO ] [MAIN ] Update Progress: 1791/2372 symbols completed. REVG took 31.0s. Estimated remaining: 1h 17m 12s. Rate: 7.5 symbols/min [2025-09-19T20:58:02.352504] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:58:02.393189] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:58:02.393830] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-19T20:58:02.404192] [DEBUG] [LOCAL ] RFI: Loaded 10613 existing records from primary storage. [2025-09-19T20:58:02.404348] [INFO ] [MAIN ] RFI: Loaded 10613 existing records. [2025-09-19T20:58:02.591523] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:58:02.591813] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-19T20:58:02.591863] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-19T20:58:02.592253] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-19T20:58:02.592312] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-19T20:58:02.954864] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:58:02.955283] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-19T20:58:02.996130] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T20:58:03.043233] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-19T20:58:03.105679] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T20:58:03.843238] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-19T20:58:04.145761] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T20:58:04.561775] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T20:58:04.643264] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-19T20:58:04.801497] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T20:58:05.443267] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-19T20:58:06.013756] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T20:58:06.243246] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-19T20:58:06.347981] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T20:58:06.660774] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T20:58:06.840306] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T20:58:07.043295] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-19T20:58:07.838300] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-19T20:58:07.843208] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-19T20:58:08.643266] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-19T20:58:08.865148] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T20:58:09.443276] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-19T20:58:10.243271] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-19T20:58:10.492076] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T20:58:10.997605] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T20:58:11.043240] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-19T20:58:11.843257] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-19T20:58:12.101202] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T20:58:12.643273] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-19T20:58:13.443273] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-19T20:58:13.794430] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T20:58:13.862443] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T20:58:14.106772] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (4.66 seconds). [2025-09-19T20:58:14.243336] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-19T20:58:15.043279] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-19T20:58:15.480270] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T20:58:15.592274] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T20:58:15.843281] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-19T20:58:16.643276] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-19T20:58:17.325208] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T20:58:17.443321] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-19T20:58:17.792342] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T20:58:17.803995] [INFO ] [REMOTE ] REXR: Full fetch complete (75069 records). [2025-09-19T20:58:17.804154] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-19T20:58:18.191465] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-19T20:58:18.191550] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-19T20:58:18.192572] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-19T20:58:18.192636] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-19T20:58:18.194165] [DEBUG] [LOCAL ] REXR: Trimmed 75069 records to 52797 (keeping 200 days of data) [2025-09-19T20:58:18.260229] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-19T20:58:18.475321] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T20:58:18.581507] [DEBUG] [LOCAL ] REXR: Primary data saved (52797 records). [2025-09-19T20:58:18.581684] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-19T20:58:18.581828] [INFO ] [MAIN ] Update Progress: 1792/2372 symbols completed. REXR took 44.9s. Estimated remaining: 1h 17m 7s. Rate: 7.5 symbols/min [2025-09-19T20:58:18.756611] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:58:18.769145] [DEBUG] [LOCAL ] RFL: Loaded 10653 existing records from primary storage. [2025-09-19T20:58:18.769282] [INFO ] [MAIN ] RFL: Loaded 10653 existing records. [2025-09-19T20:58:18.991519] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:58:18.991818] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-19T20:58:18.991868] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-19T20:58:18.992351] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-19T20:58:18.992410] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-19T20:58:19.055862] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-19T20:58:19.138380] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T20:58:19.374734] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:58:19.412940] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T20:58:19.843274] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-19T20:58:20.643253] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-19T20:58:20.856104] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T20:58:21.249544] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T20:58:21.443278] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-19T20:58:22.243285] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-19T20:58:22.651671] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T20:58:22.653927] [INFO ] [REMOTE ] RFI: Full fetch complete (15808 records). [2025-09-19T20:58:22.654073] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-19T20:58:22.970819] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-19T20:58:23.045092] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-19T20:58:23.082472] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T20:58:23.091334] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-19T20:58:23.094174] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-19T20:58:23.095528] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-19T20:58:23.095597] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-19T20:58:23.096383] [DEBUG] [LOCAL ] RFI: Trimmed 15808 records to 10657 (keeping 200 days of data) [2025-09-19T20:58:23.170052] [DEBUG] [LOCAL ] RFI: Primary data saved (10657 records). [2025-09-19T20:58:23.170487] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-19T20:58:23.170617] [INFO ] [MAIN ] Update Progress: 1793/2372 symbols completed. RFI took 21.2s. Estimated remaining: 1h 16m 57s. Rate: 7.5 symbols/min [2025-09-19T20:58:23.347879] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:58:23.355341] [DEBUG] [LOCAL ] RFM: Loaded 4093 existing records from primary storage. [2025-09-19T20:58:23.355448] [INFO ] [MAIN ] RFM: Loaded 4093 existing records. [2025-09-19T20:58:23.545304] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:58:23.545621] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-19T20:58:23.545705] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-19T20:58:23.546494] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-19T20:58:23.546555] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-19T20:58:23.846146] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-19T20:58:23.926735] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:58:24.643289] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-19T20:58:24.705705] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T20:58:25.002523] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T20:58:25.446071] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-19T20:58:25.447959] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T20:58:26.243277] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-19T20:58:27.043317] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-19T20:58:27.580549] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T20:58:27.843281] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-19T20:58:28.580577] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T20:58:28.643253] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-19T20:58:29.307235] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T20:58:29.307371] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T20:58:29.443215] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-19T20:58:29.679264] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (4.23 seconds). [2025-09-19T20:58:30.243274] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-19T20:58:30.943954] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T20:58:31.044140] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-19T20:58:31.049635] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T20:58:31.843258] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-19T20:58:32.643301] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-19T20:58:32.957720] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T20:58:32.965616] [INFO ] [REMOTE ] REZI: Full fetch complete (65546 records). [2025-09-19T20:58:32.965797] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-19T20:58:33.373689] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-19T20:58:33.373811] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-19T20:58:33.374777] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-19T20:58:33.374840] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-19T20:58:33.378632] [DEBUG] [LOCAL ] REZI: Trimmed 65546 records to 47558 (keeping 200 days of data) [2025-09-19T20:58:33.443439] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-19T20:58:33.471422] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-19T20:58:33.669676] [DEBUG] [LOCAL ] REZI: Primary data saved (47558 records). [2025-09-19T20:58:33.669817] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-19T20:58:33.669924] [INFO ] [MAIN ] Update Progress: 1794/2372 symbols completed. REZI took 34.4s. Estimated remaining: 1h 16m 50s. Rate: 7.5 symbols/min [2025-09-19T20:58:33.843899] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:58:33.868988] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T20:58:33.877151] [INFO ] [REMOTE ] RF: Full fetch complete (77619 records). [2025-09-19T20:58:33.881010] [DEBUG] [LOCAL ] RFMZ: Loaded 8561 existing records from primary storage. [2025-09-19T20:58:33.881113] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-19T20:58:33.881199] [INFO ] [MAIN ] RFMZ: Loaded 8561 existing records. [2025-09-19T20:58:34.224485] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:58:34.255633] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-19T20:58:34.260133] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-19T20:58:34.314302] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-19T20:58:34.361380] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-19T20:58:34.392990] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-19T20:58:34.394178] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T20:58:34.606071] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-19T20:58:34.611618] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-19T20:58:34.618116] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-19T20:58:34.628488] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-19T20:58:34.685798] [DEBUG] [LOCAL ] RF: Trimmed 77619 records to 54410 (keeping 200 days of data) [2025-09-19T20:58:34.903771] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-19T20:58:34.977266] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:58:35.065256] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-19T20:58:35.229487] [DEBUG] [LOCAL ] RF: Primary data saved (54410 records). [2025-09-19T20:58:35.229676] [INFO ] [MAIN ] RF: Full history saved. [2025-09-19T20:58:35.229800] [INFO ] [MAIN ] Update Progress: 1795/2372 symbols completed. RF took 34.1s. Estimated remaining: 1h 16m 40s. Rate: 7.5 symbols/min [2025-09-19T20:58:35.398738] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:58:35.436729] [DEBUG] [LOCAL ] RGA: Loaded 30484 existing records from primary storage. [2025-09-19T20:58:35.436914] [INFO ] [MAIN ] RGA: Loaded 30484 existing records. [2025-09-19T20:58:35.614912] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:58:35.615178] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-19T20:58:35.615227] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-19T20:58:35.616059] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-19T20:58:35.616119] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-19T20:58:35.853073] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-19T20:58:35.969836] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:58:35.977270] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T20:58:36.643291] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-19T20:58:36.838490] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T20:58:37.443279] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-19T20:58:38.243279] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-19T20:58:38.405075] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T20:58:38.421297] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T20:58:39.043267] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-19T20:58:39.612164] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T20:58:39.843318] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-19T20:58:40.259552] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-19T20:58:40.643307] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-19T20:58:40.985406] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T20:58:41.443310] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-19T20:58:41.582308] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T20:58:42.243238] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-19T20:58:42.610083] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T20:58:42.942831] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T20:58:43.043286] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-19T20:58:43.588369] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T20:58:43.843284] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-19T20:58:44.643284] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-19T20:58:45.443257] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-19T20:58:45.679624] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T20:58:45.915018] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-19T20:58:46.243292] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-19T20:58:46.362848] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T20:58:46.937242] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-19T20:58:47.043305] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-19T20:58:47.843278] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-19T20:58:48.643279] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-19T20:58:48.783509] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T20:58:48.795473] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T20:58:49.443262] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-19T20:58:49.846343] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T20:58:49.849752] [INFO ] [REMOTE ] RFL: Full fetch complete (12655 records). [2025-09-19T20:58:49.849844] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-19T20:58:50.214891] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-19T20:58:50.214994] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-19T20:58:50.215330] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-19T20:58:50.215372] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-19T20:58:50.215933] [DEBUG] [LOCAL ] RFL: Trimmed 12655 records to 10839 (keeping 200 days of data) [2025-09-19T20:58:50.246107] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-19T20:58:50.282099] [DEBUG] [LOCAL ] RFL: Primary data saved (10839 records). [2025-09-19T20:58:50.282213] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-19T20:58:50.282297] [INFO ] [MAIN ] Update Progress: 1796/2372 symbols completed. RFL took 31.7s. Estimated remaining: 1h 16m 35s. Rate: 7.5 symbols/min [2025-09-19T20:58:50.457678] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:58:50.478840] [DEBUG] [LOCAL ] RGR: Loaded 20255 existing records from primary storage. [2025-09-19T20:58:50.478995] [INFO ] [MAIN ] RGR: Loaded 20255 existing records. [2025-09-19T20:58:50.548390] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T20:58:50.578777] [INFO ] [REMOTE ] RFM: Full fetch complete (6020 records). [2025-09-19T20:58:50.587125] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-19T20:58:50.788532] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:58:50.828505] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-19T20:58:50.845499] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-19T20:58:50.864162] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-19T20:58:50.903386] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-19T20:58:51.044343] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-19T20:58:51.248452] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-19T20:58:51.259346] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-19T20:58:51.318821] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-19T20:58:51.324376] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-19T20:58:51.346454] [DEBUG] [LOCAL ] RFM: Trimmed 6020 records to 4122 (keeping 200 days of data) [2025-09-19T20:58:51.462845] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:58:51.468334] [DEBUG] [LOCAL ] RFM: Primary data saved (4122 records). [2025-09-19T20:58:51.468446] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-19T20:58:51.468553] [INFO ] [MAIN ] Update Progress: 1797/2372 symbols completed. RFM took 28.3s. Estimated remaining: 1h 16m 24s. Rate: 7.5 symbols/min [2025-09-19T20:58:51.843285] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-19T20:58:52.059565] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T20:58:52.073973] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T20:58:52.643268] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-19T20:58:52.732036] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T20:58:53.443282] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-19T20:58:53.541631] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T20:58:54.243288] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-19T20:58:54.750941] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T20:58:55.043267] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-19T20:58:55.843296] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-19T20:58:56.022330] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T20:58:56.476505] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T20:58:56.643296] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-19T20:58:56.769691] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-19T20:58:57.341173] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T20:58:57.443218] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-19T20:58:58.243244] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-19T20:58:58.835550] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T20:58:59.043875] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-19T20:58:59.170792] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T20:58:59.843271] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-19T20:59:00.507987] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T20:59:00.643221] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-19T20:59:01.445449] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-19T20:59:01.447513] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T20:59:02.005865] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T20:59:02.243271] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-19T20:59:02.429353] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T20:59:03.043370] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-19T20:59:03.658912] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T20:59:03.661154] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12835 records). [2025-09-19T20:59:03.661292] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-19T20:59:03.847337] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-19T20:59:04.064969] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-19T20:59:04.071726] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-19T20:59:04.083239] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-19T20:59:04.083722] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-19T20:59:04.084921] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T20:59:04.092385] [DEBUG] [LOCAL ] RFMZ: Trimmed 12835 records to 8608 (keeping 200 days of data) [2025-09-19T20:59:04.151818] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8608 records). [2025-09-19T20:59:04.151986] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-19T20:59:04.152081] [INFO ] [MAIN ] Update Progress: 1798/2372 symbols completed. RFMZ took 30.5s. Estimated remaining: 1h 16m 18s. Rate: 7.5 symbols/min [2025-09-19T20:59:04.643262] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-19T20:59:05.199516] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T20:59:05.443332] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-19T20:59:06.178469] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T20:59:06.183312] [INFO ] [REMOTE ] RGA: Full fetch complete (45726 records). [2025-09-19T20:59:06.183401] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-19T20:59:06.566416] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-19T20:59:06.566499] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-19T20:59:06.567540] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-19T20:59:06.567601] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-19T20:59:06.568539] [DEBUG] [LOCAL ] RGA: Trimmed 45726 records to 30740 (keeping 200 days of data) [2025-09-19T20:59:06.766829] [DEBUG] [LOCAL ] RGA: Primary data saved (30740 records). [2025-09-19T20:59:06.766981] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-19T20:59:06.767090] [INFO ] [MAIN ] Update Progress: 1799/2372 symbols completed. RGA took 31.5s. Estimated remaining: 1h 16m 8s. Rate: 7.5 symbols/min [2025-09-19T20:59:06.986856] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T20:59:06.991859] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-19T20:59:07.800353] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-19T20:59:07.804317] [INFO ] [REMOTE ] RGR: Full fetch complete (28359 records). [2025-09-19T20:59:07.804399] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-19T20:59:08.188462] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-19T20:59:08.188578] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-19T20:59:08.189254] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-19T20:59:08.189317] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-19T20:59:08.190106] [DEBUG] [LOCAL ] RGR: Trimmed 28359 records to 20432 (keeping 200 days of data) [2025-09-19T20:59:08.316421] [DEBUG] [LOCAL ] RGR: Primary data saved (20432 records). [2025-09-19T20:59:08.316551] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-19T20:59:08.316632] [INFO ] [MAIN ] Update Progress: 1800/2372 symbols completed. RGR took 18.0s. Estimated remaining: 1h 15m 58s. Rate: 7.5 symbols/min [2025-09-19T20:59:08.981138] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:59:09.021695] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:59:09.050720] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:59:09.074713] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:59:09.080601] [DEBUG] [LOCAL ] RGT: Loaded 2936 existing records from primary storage. [2025-09-19T20:59:09.080816] [INFO ] [MAIN ] RGT: Loaded 2936 existing records. [2025-09-19T20:59:09.306410] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:59:09.322219] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-19T20:59:09.322324] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-19T20:59:09.323260] [DEBUG] [LOCAL ] RHP: Loaded 42071 existing records from primary storage. [2025-09-19T20:59:09.324166] [INFO ] [MAIN ] RHP: Loaded 42071 existing records. [2025-09-19T20:59:09.324213] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-19T20:59:09.324496] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-19T20:59:09.554591] [DEBUG] [LOCAL ] RHI: Loaded 49598 existing records from primary storage. [2025-09-19T20:59:09.562091] [INFO ] [MAIN ] RHI: Loaded 49598 existing records. [2025-09-19T20:59:09.567987] [DEBUG] [LOCAL ] RH: Loaded 48119 existing records from primary storage. [2025-09-19T20:59:09.574105] [INFO ] [MAIN ] RH: Loaded 48119 existing records. [2025-09-19T20:59:09.957277] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:59:10.149405] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-19T20:59:10.194528] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-19T20:59:10.255229] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:59:10.228740] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:59:10.259595] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-19T20:59:10.259243] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-19T20:59:10.265585] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-19T20:59:10.260214] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-19T20:59:10.259779] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-19T20:59:10.286990] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-19T20:59:10.335565] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-19T20:59:10.346547] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-19T20:59:10.351962] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-19T20:59:10.386921] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-19T20:59:10.519327] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:59:10.591918] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-19T20:59:11.423036] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:59:11.530956] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:59:11.523018] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-19T20:59:11.557714] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-19T20:59:11.566556] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T20:59:11.576054] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-19T20:59:11.573012] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:59:11.577800] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-19T20:59:12.229366] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T20:59:12.230779] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-19T20:59:12.396062] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-19T20:59:12.404789] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-19T20:59:12.839096] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T20:59:12.840266] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-19T20:59:13.185107] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T20:59:13.306464] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T20:59:13.349488] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T20:59:13.376998] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T20:59:13.443228] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-19T20:59:14.203290] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T20:59:14.243293] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-19T20:59:15.043283] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-19T20:59:15.517005] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T20:59:15.727556] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T20:59:15.843227] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-19T20:59:16.613534] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T20:59:16.643286] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-19T20:59:17.443263] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-19T20:59:18.243267] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-19T20:59:18.404572] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T20:59:18.527907] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T20:59:19.043275] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-19T20:59:19.077794] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-19T20:59:19.843265] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-19T20:59:20.231839] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-19T20:59:20.643321] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-19T20:59:20.981941] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T20:59:21.192016] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T20:59:21.443291] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-19T20:59:22.243278] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-19T20:59:22.535741] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T20:59:23.043266] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-19T20:59:23.843286] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-19T20:59:24.133437] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T20:59:24.643315] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-19T20:59:24.677343] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T20:59:24.678558] [INFO ] [REMOTE ] RGT: Full fetch complete (4159 records). [2025-09-19T20:59:24.678638] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-19T20:59:25.071538] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-19T20:59:25.071739] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-19T20:59:25.071941] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-19T20:59:25.072076] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-19T20:59:25.072769] [DEBUG] [LOCAL ] RGT: Trimmed 4159 records to 2966 (keeping 200 days of data) [2025-09-19T20:59:25.092244] [DEBUG] [LOCAL ] RGT: Primary data saved (2966 records). [2025-09-19T20:59:25.092518] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-19T20:59:25.092680] [INFO ] [MAIN ] Update Progress: 1801/2372 symbols completed. RGT took 16.8s. Estimated remaining: 1h 15m 53s. Rate: 7.5 symbols/min [2025-09-19T20:59:25.301063] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:59:25.303319] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-19T20:59:25.372919] [DEBUG] [LOCAL ] RIG: Loaded 54062 existing records from primary storage. [2025-09-19T20:59:25.373137] [INFO ] [MAIN ] RIG: Loaded 54062 existing records. [2025-09-19T20:59:25.449304] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-19T20:59:25.557024] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:59:25.557273] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-19T20:59:25.557333] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-19T20:59:25.558743] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-19T20:59:25.558804] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-19T20:59:25.907175] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:59:26.243285] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-19T20:59:26.307054] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T20:59:26.645932] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T20:59:27.043315] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-19T20:59:27.843302] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-19T20:59:28.007505] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T20:59:28.643273] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-19T20:59:29.046427] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T20:59:29.443276] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-19T20:59:29.636905] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T20:59:29.767572] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T20:59:30.243256] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-19T20:59:31.043257] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-19T20:59:31.530962] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T20:59:31.646491] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T20:59:31.843280] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-19T20:59:32.181605] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T20:59:32.643286] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-19T20:59:33.443290] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-19T20:59:33.690687] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T20:59:34.243350] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-19T20:59:34.655463] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T20:59:34.808290] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T20:59:35.043282] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-19T20:59:35.843289] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-19T20:59:36.143461] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T20:59:36.643226] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-19T20:59:37.059853] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T20:59:37.066885] [INFO ] [REMOTE ] RH: Full fetch complete (65530 records). [2025-09-19T20:59:37.067008] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-19T20:59:37.446322] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-19T20:59:37.446154] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-19T20:59:37.446480] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-19T20:59:37.448321] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-19T20:59:37.448547] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-19T20:59:37.450305] [DEBUG] [LOCAL ] RH: Trimmed 65530 records to 48447 (keeping 200 days of data) [2025-09-19T20:59:37.580238] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T20:59:37.784376] [DEBUG] [LOCAL ] RH: Primary data saved (48447 records). [2025-09-19T20:59:37.784521] [INFO ] [MAIN ] RH: Full history saved. [2025-09-19T20:59:37.784608] [INFO ] [MAIN ] Update Progress: 1802/2372 symbols completed. RH took 29.5s. Estimated remaining: 1h 15m 47s. Rate: 7.5 symbols/min [2025-09-19T20:59:37.958996] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:59:38.011279] [DEBUG] [LOCAL ] RIO: Loaded 53789 existing records from primary storage. [2025-09-19T20:59:38.011462] [INFO ] [MAIN ] RIO: Loaded 53789 existing records. [2025-09-19T20:59:38.188978] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:59:38.189233] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-19T20:59:38.189282] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-19T20:59:38.190875] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-19T20:59:38.190935] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-19T20:59:38.253933] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-19T20:59:38.582045] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:59:38.614785] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T20:59:39.043251] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-19T20:59:39.649107] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-19T20:59:39.843322] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-19T20:59:39.924903] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T20:59:39.931393] [INFO ] [REMOTE ] RHP: Full fetch complete (57989 records). [2025-09-19T20:59:39.931571] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-19T20:59:40.335168] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-19T20:59:40.335300] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-19T20:59:40.336443] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-19T20:59:40.336519] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-19T20:59:40.338365] [DEBUG] [LOCAL ] RHP: Trimmed 57989 records to 42353 (keeping 200 days of data) [2025-09-19T20:59:40.607675] [DEBUG] [LOCAL ] RHP: Primary data saved (42353 records). [2025-09-19T20:59:40.607822] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-19T20:59:40.609686] [INFO ] [MAIN ] Update Progress: 1803/2372 symbols completed. RHP took 32.3s. Estimated remaining: 1h 15m 37s. Rate: 7.5 symbols/min [2025-09-19T20:59:40.653624] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-19T20:59:40.786122] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:59:40.855216] [DEBUG] [LOCAL ] RITM: Loaded 53187 existing records from primary storage. [2025-09-19T20:59:40.855438] [INFO ] [MAIN ] RITM: Loaded 53187 existing records. [2025-09-19T20:59:41.041988] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:59:41.042480] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-19T20:59:41.042789] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-19T20:59:41.044418] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-19T20:59:41.044481] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-19T20:59:41.427194] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T20:59:41.459980] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:59:41.460774] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-19T20:59:42.187072] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T20:59:42.243216] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-19T20:59:42.996639] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-19T20:59:43.043247] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-19T20:59:43.275482] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T20:59:43.786586] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T20:59:43.843224] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-19T20:59:44.643250] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-19T20:59:45.156579] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T20:59:45.163755] [INFO ] [REMOTE ] RHI: Full fetch complete (69543 records). [2025-09-19T20:59:45.163872] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-19T20:59:45.448361] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-19T20:59:45.520368] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T20:59:45.629848] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-19T20:59:45.629932] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-19T20:59:45.630922] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-19T20:59:45.630984] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-19T20:59:45.632476] [DEBUG] [LOCAL ] RHI: Trimmed 69543 records to 49966 (keeping 200 days of data) [2025-09-19T20:59:45.936252] [DEBUG] [LOCAL ] RHI: Primary data saved (49966 records). [2025-09-19T20:59:45.936399] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-19T20:59:45.936485] [INFO ] [MAIN ] Update Progress: 1804/2372 symbols completed. RHI took 37.6s. Estimated remaining: 1h 15m 28s. Rate: 7.5 symbols/min [2025-09-19T20:59:46.105834] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T20:59:46.118464] [DEBUG] [LOCAL ] RIV: Loaded 11782 existing records from primary storage. [2025-09-19T20:59:46.118563] [INFO ] [MAIN ] RIV: Loaded 11782 existing records. [2025-09-19T20:59:46.257994] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-19T20:59:46.299125] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T20:59:46.299363] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-19T20:59:46.299412] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-19T20:59:46.299890] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-19T20:59:46.299950] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-19T20:59:46.656480] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T20:59:47.055844] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-19T20:59:47.061249] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-19T20:59:47.600224] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T20:59:47.843286] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-19T20:59:48.097219] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T20:59:48.200256] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T20:59:48.643268] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-19T20:59:49.443255] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-19T20:59:50.053099] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-19T20:59:50.243282] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-19T20:59:50.474702] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T20:59:50.832491] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T20:59:51.043317] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-19T20:59:51.843331] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-19T20:59:52.167089] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T20:59:52.643247] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-19T20:59:53.305098] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T20:59:53.443291] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-19T20:59:53.599448] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T20:59:54.243270] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-19T20:59:54.363236] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-19T20:59:55.043226] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-19T20:59:55.573493] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T20:59:55.615812] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T20:59:55.843274] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-19T20:59:56.643285] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-19T20:59:56.836363] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T20:59:57.068836] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T20:59:57.443322] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-19T20:59:58.243343] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-19T20:59:58.372277] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T20:59:59.043335] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-19T20:59:59.110132] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-19T20:59:59.631183] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-19T20:59:59.843259] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-19T21:00:00.036214] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-19T21:00:00.643274] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-19T21:00:00.977032] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T21:00:01.443335] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-19T21:00:02.243308] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-19T21:00:03.043358] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-19T21:00:03.163372] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-19T21:00:03.843305] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-19T21:00:03.902066] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-09-19T21:00:04.643270] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-19T21:00:05.987383] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (3.74 seconds). [2025-09-19T21:00:05.999588] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-19T21:00:06.488182] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-19T21:00:06.492303] [INFO ] [REMOTE ] RIV: Full fetch complete (17221 records). [2025-09-19T21:00:06.492450] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-19T21:00:06.907512] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-19T21:00:06.907727] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-19T21:00:06.908186] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-19T21:00:06.908268] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-19T21:00:06.939218] [DEBUG] [LOCAL ] RIV: Trimmed 17221 records to 11910 (keeping 200 days of data) [2025-09-19T21:00:06.943096] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (3.90 seconds). [2025-09-19T21:00:07.010622] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-19T21:00:07.051638] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-19T21:00:07.067993] [INFO ] [REMOTE ] RIG: Full fetch complete (77700 records). [2025-09-19T21:00:07.072097] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-19T21:00:07.171487] [DEBUG] [LOCAL ] RIV: Primary data saved (11910 records). [2025-09-19T21:00:07.190946] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-19T21:00:07.196372] [INFO ] [MAIN ] Update Progress: 1805/2372 symbols completed. RIV took 21.3s. Estimated remaining: 1h 15m 24s. Rate: 7.5 symbols/min [2025-09-19T21:00:07.538914] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:00:07.798921] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-19T21:00:07.799158] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-19T21:00:07.800873] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-19T21:00:07.801060] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-19T21:00:07.803372] [DEBUG] [LOCAL ] RIG: Trimmed 77700 records to 54450 (keeping 200 days of data) [2025-09-19T21:00:07.879360] [DEBUG] [LOCAL ] RJF: Loaded 47500 existing records from primary storage. [2025-09-19T21:00:07.906406] [INFO ] [MAIN ] RJF: Loaded 47500 existing records. [2025-09-19T21:00:08.249312] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:00:08.285310] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-19T21:00:08.285599] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-19T21:00:08.318723] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-19T21:00:08.327371] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-19T21:00:08.485794] [DEBUG] [LOCAL ] RIG: Primary data saved (54450 records). [2025-09-19T21:00:08.502052] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-19T21:00:08.508739] [INFO ] [MAIN ] Update Progress: 1806/2372 symbols completed. RIG took 43.4s. Estimated remaining: 1h 15m 14s. Rate: 7.5 symbols/min [2025-09-19T21:00:08.692662] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-19T21:00:08.803389] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-19T21:00:09.004137] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:00:09.020431] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-19T21:00:09.042958] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:00:09.105305] [DEBUG] [LOCAL ] RKT: Loaded 54110 existing records from primary storage. [2025-09-19T21:00:09.105616] [INFO ] [MAIN ] RKT: Loaded 54110 existing records. [2025-09-19T21:00:09.319860] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:00:09.320835] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-19T21:00:09.320942] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-19T21:00:09.333717] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-19T21:00:09.351800] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-19T21:00:09.444539] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-19T21:00:09.491138] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-19T21:00:09.796187] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:00:09.796570] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-19T21:00:11.037581] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T21:00:11.047037] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-19T21:00:11.079314] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-19T21:00:11.091014] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-19T21:00:11.489753] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T21:00:11.843336] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-19T21:00:12.306740] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-19T21:00:12.643259] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-19T21:00:13.175894] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T21:00:13.299237] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T21:00:13.443222] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-19T21:00:14.224553] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-19T21:00:14.232290] [INFO ] [REMOTE ] RITM: Full fetch complete (76527 records). [2025-09-19T21:00:14.232404] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-19T21:00:14.264399] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-19T21:00:14.623273] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-19T21:00:14.623367] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-19T21:00:14.624434] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-19T21:00:14.624498] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-19T21:00:14.625968] [DEBUG] [LOCAL ] RITM: Trimmed 76527 records to 53575 (keeping 200 days of data) [2025-09-19T21:00:14.947535] [DEBUG] [LOCAL ] RITM: Primary data saved (53575 records). [2025-09-19T21:00:14.947705] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-19T21:00:14.947802] [INFO ] [MAIN ] Update Progress: 1807/2372 symbols completed. RITM took 34.3s. Estimated remaining: 1h 15m 6s. Rate: 7.5 symbols/min [2025-09-19T21:00:15.118153] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:00:15.159033] [DEBUG] [LOCAL ] RL: Loaded 42280 existing records from primary storage. [2025-09-19T21:00:15.159228] [INFO ] [MAIN ] RL: Loaded 42280 existing records. [2025-09-19T21:00:15.338166] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:00:15.338514] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-19T21:00:15.338609] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-19T21:00:15.340576] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-19T21:00:15.340675] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-19T21:00:15.630012] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (2.99 seconds). [2025-09-19T21:00:15.705719] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-19T21:00:15.766169] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:00:15.843234] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-19T21:00:16.972069] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-19T21:00:16.981924] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-19T21:00:17.002997] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (3.56 seconds). [2025-09-19T21:00:17.010937] [INFO ] [REMOTE ] RIO: Full fetch complete (77353 records). [2025-09-19T21:00:17.011090] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-19T21:00:17.441425] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-19T21:00:17.441565] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-19T21:00:17.442710] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-19T21:00:17.442826] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-19T21:00:17.444586] [DEBUG] [LOCAL ] RIO: Trimmed 77353 records to 54177 (keeping 200 days of data) [2025-09-19T21:00:17.562379] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T21:00:17.575112] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-19T21:00:17.819610] [DEBUG] [LOCAL ] RIO: Primary data saved (54177 records). [2025-09-19T21:00:17.819877] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-19T21:00:17.820000] [INFO ] [MAIN ] Update Progress: 1808/2372 symbols completed. RIO took 40.0s. Estimated remaining: 1h 14m 56s. Rate: 7.5 symbols/min [2025-09-19T21:00:18.011315] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T21:00:18.047004] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:00:18.079897] [DEBUG] [LOCAL ] RLI: Loaded 33515 existing records from primary storage. [2025-09-19T21:00:18.080063] [INFO ] [MAIN ] RLI: Loaded 33515 existing records. [2025-09-19T21:00:18.250408] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-19T21:00:18.255958] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:00:18.256124] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-19T21:00:18.256171] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-19T21:00:18.256921] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-19T21:00:18.256983] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-19T21:00:18.613777] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:00:18.751082] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T21:00:19.043278] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-19T21:00:19.849114] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-19T21:00:19.854795] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T21:00:20.261742] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T21:00:20.389821] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T21:00:20.643296] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-19T21:00:21.443262] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-19T21:00:22.240104] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T21:00:22.250266] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-19T21:00:22.516792] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T21:00:22.582518] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T21:00:23.043267] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-19T21:00:23.843265] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-19T21:00:24.549614] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T21:00:24.643317] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-19T21:00:24.891470] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T21:00:25.224212] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T21:00:25.443271] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-19T21:00:26.243264] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-19T21:00:27.026111] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T21:00:27.043232] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-19T21:00:27.447184] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T21:00:27.843262] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-19T21:00:28.088225] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T21:00:28.143865] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T21:00:28.643274] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-19T21:00:29.443281] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-19T21:00:29.878122] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T21:00:30.243259] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-19T21:00:30.751483] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T21:00:31.043254] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-19T21:00:31.602301] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T21:00:31.843227] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-19T21:00:32.445267] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T21:00:32.643268] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-19T21:00:32.767549] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T21:00:33.351392] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T21:00:33.443223] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-19T21:00:34.243322] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-19T21:00:34.597884] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T21:00:35.043292] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-19T21:00:35.329564] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T21:00:35.843329] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-19T21:00:36.056506] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T21:00:36.135186] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T21:00:36.643328] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-19T21:00:37.443322] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-19T21:00:38.102947] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T21:00:38.109819] [INFO ] [REMOTE ] RJF: Full fetch complete (68337 records). [2025-09-19T21:00:38.109975] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-19T21:00:38.254829] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-19T21:00:38.514381] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-19T21:00:38.514488] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-19T21:00:38.515596] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-19T21:00:38.515711] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-19T21:00:38.517465] [DEBUG] [LOCAL ] RJF: Trimmed 68337 records to 47859 (keeping 200 days of data) [2025-09-19T21:00:38.646669] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-19T21:00:38.870895] [DEBUG] [LOCAL ] RJF: Primary data saved (47859 records). [2025-09-19T21:00:38.871124] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-19T21:00:38.871349] [INFO ] [MAIN ] Update Progress: 1809/2372 symbols completed. RJF took 31.7s. Estimated remaining: 1h 14m 52s. Rate: 7.5 symbols/min [2025-09-19T21:00:39.048371] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:00:39.046762] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-19T21:00:39.098115] [DEBUG] [LOCAL ] RLJ: Loaded 48681 existing records from primary storage. [2025-09-19T21:00:39.098265] [INFO ] [MAIN ] RLJ: Loaded 48681 existing records. [2025-09-19T21:00:39.282639] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:00:39.282950] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-19T21:00:39.283028] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-19T21:00:39.284218] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-19T21:00:39.284306] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-19T21:00:39.415973] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T21:00:39.705427] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:00:39.736245] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T21:00:39.843253] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-19T21:00:40.643282] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-19T21:00:41.443336] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-19T21:00:41.630920] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T21:00:41.672774] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-19T21:00:41.682048] [INFO ] [REMOTE ] RKT: Full fetch complete (77319 records). [2025-09-19T21:00:41.682178] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-19T21:00:42.091421] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-19T21:00:42.091549] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-19T21:00:42.092753] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-19T21:00:42.092924] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-19T21:00:42.125588] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T21:00:42.136048] [DEBUG] [LOCAL ] RKT: Trimmed 77319 records to 54500 (keeping 200 days of data) [2025-09-19T21:00:42.245340] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-19T21:00:42.478181] [DEBUG] [LOCAL ] RKT: Primary data saved (54500 records). [2025-09-19T21:00:42.478354] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-19T21:00:42.478528] [INFO ] [MAIN ] Update Progress: 1810/2372 symbols completed. RKT took 33.9s. Estimated remaining: 1h 14m 43s. Rate: 7.5 symbols/min [2025-09-19T21:00:42.669146] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:00:42.694532] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T21:00:42.712473] [DEBUG] [LOCAL ] RLTY: Loaded 11372 existing records from primary storage. [2025-09-19T21:00:42.712702] [INFO ] [MAIN ] RLTY: Loaded 11372 existing records. [2025-09-19T21:00:42.901288] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:00:42.901632] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-19T21:00:42.901730] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-19T21:00:42.902134] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-19T21:00:42.902213] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-19T21:00:43.048444] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-19T21:00:43.262633] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:00:43.843264] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-19T21:00:44.156082] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T21:00:44.165950] [INFO ] [REMOTE ] RL: Full fetch complete (60213 records). [2025-09-19T21:00:44.166105] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-19T21:00:44.571057] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-19T21:00:44.571137] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-19T21:00:44.572084] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-19T21:00:44.572150] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-19T21:00:44.574731] [DEBUG] [LOCAL ] RL: Trimmed 60213 records to 42549 (keeping 200 days of data) [2025-09-19T21:00:44.644815] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-19T21:00:44.713504] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T21:00:44.722850] [INFO ] [REMOTE ] RLI: Full fetch complete (45873 records). [2025-09-19T21:00:44.723477] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-19T21:00:45.128052] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-19T21:00:45.128760] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-19T21:00:45.130489] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-19T21:00:45.130994] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-19T21:00:45.145506] [DEBUG] [LOCAL ] RLI: Trimmed 45873 records to 33794 (keeping 200 days of data) [2025-09-19T21:00:45.151508] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T21:00:45.455473] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-19T21:00:45.484361] [DEBUG] [LOCAL ] RL: Primary data saved (42549 records). [2025-09-19T21:00:45.485091] [INFO ] [MAIN ] RL: Full history saved. [2025-09-19T21:00:45.486043] [INFO ] [MAIN ] Update Progress: 1811/2372 symbols completed. RL took 30.5s. Estimated remaining: 1h 14m 34s. Rate: 7.5 symbols/min [2025-09-19T21:00:45.676368] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:00:45.695345] [DEBUG] [LOCAL ] RLI: Primary data saved (33794 records). [2025-09-19T21:00:45.695510] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-19T21:00:45.695692] [INFO ] [MAIN ] Update Progress: 1812/2372 symbols completed. RLI took 27.9s. Estimated remaining: 1h 14m 23s. Rate: 7.5 symbols/min [2025-09-19T21:00:45.905745] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:00:45.920274] [DEBUG] [LOCAL ] RLX: Loaded 48504 existing records from primary storage. [2025-09-19T21:00:45.920472] [INFO ] [MAIN ] RLX: Loaded 48504 existing records. [2025-09-19T21:00:46.034195] [DEBUG] [LOCAL ] RM: Loaded 7801 existing records from primary storage. [2025-09-19T21:00:46.034381] [INFO ] [MAIN ] RM: Loaded 7801 existing records. [2025-09-19T21:00:46.282965] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:00:46.295296] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-19T21:00:46.325973] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:00:46.326105] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-19T21:00:46.329794] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-19T21:00:46.329940] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-19T21:00:46.330411] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T21:00:46.330521] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-19T21:00:46.334517] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-19T21:00:46.334658] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-19T21:00:46.340330] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-19T21:00:46.340399] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-19T21:00:46.668065] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T21:00:47.063622] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-19T21:00:47.127283] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:00:47.151052] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:00:47.624319] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T21:00:47.843327] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-19T21:00:48.310937] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T21:00:48.643288] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-19T21:00:49.369920] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-19T21:00:49.443258] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-19T21:00:50.038060] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T21:00:50.243323] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-19T21:00:50.462991] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T21:00:51.043288] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-19T21:00:51.843269] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-19T21:00:52.156011] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T21:00:52.643274] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-19T21:00:52.869009] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-19T21:00:53.120386] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T21:00:53.443302] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-19T21:00:54.243268] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-19T21:00:54.553728] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T21:00:54.880453] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T21:00:55.043300] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-19T21:00:55.591279] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T21:00:55.843292] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-19T21:00:56.100316] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T21:00:56.643265] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-19T21:00:57.443232] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-19T21:00:57.732141] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-19T21:00:57.836069] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:00:58.064574] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-19T21:00:58.243365] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-19T21:00:59.043291] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-19T21:00:59.287549] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T21:00:59.843271] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-19T21:01:00.643286] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-19T21:01:00.954067] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T21:01:01.301699] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T21:01:01.443324] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-19T21:01:02.232509] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T21:01:02.243348] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-19T21:01:03.043291] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-19T21:01:03.281296] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T21:01:03.496050] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-19T21:01:03.843274] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-19T21:01:04.148119] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T21:01:04.643263] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-19T21:01:05.443290] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-19T21:01:05.815546] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T21:01:06.243278] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-19T21:01:06.552100] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T21:01:06.625099] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T21:01:07.043265] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-19T21:01:07.743179] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T21:01:07.843254] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-19T21:01:08.098445] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T21:01:08.643364] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-19T21:01:09.443248] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-19T21:01:09.623151] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T21:01:09.630475] [INFO ] [REMOTE ] RLJ: Full fetch complete (69267 records). [2025-09-19T21:01:09.630594] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-19T21:01:10.016274] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T21:01:10.041475] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-19T21:01:10.041863] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-19T21:01:10.043002] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-19T21:01:10.043067] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-19T21:01:10.044437] [DEBUG] [LOCAL ] RLJ: Trimmed 69267 records to 49043 (keeping 200 days of data) [2025-09-19T21:01:10.261209] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-19T21:01:10.345875] [DEBUG] [LOCAL ] RLJ: Primary data saved (49043 records). [2025-09-19T21:01:10.346007] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-19T21:01:10.346086] [INFO ] [MAIN ] Update Progress: 1813/2372 symbols completed. RLJ took 31.5s. Estimated remaining: 1h 14m 20s. Rate: 7.5 symbols/min [2025-09-19T21:01:10.518624] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:01:10.540409] [DEBUG] [LOCAL ] RMAX: Loaded 21953 existing records from primary storage. [2025-09-19T21:01:10.540530] [INFO ] [MAIN ] RMAX: Loaded 21953 existing records. [2025-09-19T21:01:10.723145] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:01:10.723404] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-19T21:01:10.723452] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-19T21:01:10.724385] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-19T21:01:10.724445] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-19T21:01:11.048181] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-19T21:01:11.084744] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:01:11.446978] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T21:01:11.525545] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T21:01:11.843291] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-19T21:01:12.061601] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T21:01:12.063815] [INFO ] [REMOTE ] RLTY: Full fetch complete (18186 records). [2025-09-19T21:01:12.063892] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-19T21:01:12.435920] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-19T21:01:12.435998] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-19T21:01:12.436422] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-19T21:01:12.436473] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-19T21:01:12.437062] [DEBUG] [LOCAL ] RLTY: Trimmed 18186 records to 11412 (keeping 200 days of data) [2025-09-19T21:01:12.510752] [DEBUG] [LOCAL ] RLTY: Primary data saved (11412 records). [2025-09-19T21:01:12.510875] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-19T21:01:12.510973] [INFO ] [MAIN ] Update Progress: 1814/2372 symbols completed. RLTY took 30.0s. Estimated remaining: 1h 14m 11s. Rate: 7.5 symbols/min [2025-09-19T21:01:12.653778] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-19T21:01:12.687813] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:01:12.735763] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T21:01:12.753816] [DEBUG] [LOCAL ] RMD: Loaded 42846 existing records from primary storage. [2025-09-19T21:01:12.753973] [INFO ] [MAIN ] RMD: Loaded 42846 existing records. [2025-09-19T21:01:12.935425] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:01:12.935805] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-19T21:01:12.935879] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-19T21:01:12.937231] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-19T21:01:12.937302] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-19T21:01:13.315538] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:01:13.443216] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-19T21:01:14.243371] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-19T21:01:14.634724] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T21:01:14.785305] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T21:01:15.043333] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-19T21:01:15.542208] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T21:01:15.843280] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-19T21:01:16.643307] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-19T21:01:16.691803] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T21:01:16.979005] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T21:01:16.980691] [INFO ] [REMOTE ] RM: Full fetch complete (11506 records). [2025-09-19T21:01:16.980770] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-19T21:01:17.342035] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-19T21:01:17.342150] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-19T21:01:17.342446] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-19T21:01:17.342498] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-19T21:01:17.343004] [DEBUG] [LOCAL ] RM: Trimmed 11506 records to 7872 (keeping 200 days of data) [2025-09-19T21:01:17.390610] [DEBUG] [LOCAL ] RM: Primary data saved (7872 records). [2025-09-19T21:01:17.390768] [INFO ] [MAIN ] RM: Full history saved. [2025-09-19T21:01:17.390860] [INFO ] [MAIN ] Update Progress: 1815/2372 symbols completed. RM took 31.7s. Estimated remaining: 1h 14m 2s. Rate: 7.5 symbols/min [2025-09-19T21:01:17.448470] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-19T21:01:17.588770] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:01:17.589194] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T21:01:17.599906] [DEBUG] [LOCAL ] RMI: Loaded 4657 existing records from primary storage. [2025-09-19T21:01:17.600031] [INFO ] [MAIN ] RMI: Loaded 4657 existing records. [2025-09-19T21:01:17.778271] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:01:17.778529] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-19T21:01:17.778579] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-19T21:01:17.778901] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-19T21:01:17.778967] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-19T21:01:18.140239] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:01:18.243277] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-19T21:01:19.043312] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-19T21:01:19.147455] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-19T21:01:19.319822] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T21:01:19.836091] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T21:01:19.843206] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-19T21:01:20.643286] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-19T21:01:21.153077] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T21:01:21.245821] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-19T21:01:21.443278] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-19T21:01:22.243285] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-19T21:01:22.966032] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T21:01:23.043248] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-19T21:01:23.225419] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T21:01:23.843265] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-19T21:01:24.512341] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T21:01:24.643279] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-19T21:01:25.000542] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T21:01:25.443278] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-19T21:01:26.243326] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-19T21:01:26.315784] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T21:01:26.933910] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T21:01:26.941709] [INFO ] [REMOTE ] RLX: Full fetch complete (70304 records). [2025-09-19T21:01:26.941880] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-19T21:01:27.049167] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-19T21:01:27.119514] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T21:01:27.360079] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-19T21:01:27.360183] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-19T21:01:27.361217] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-19T21:01:27.361289] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-19T21:01:27.362814] [DEBUG] [LOCAL ] RLX: Trimmed 70304 records to 48839 (keeping 200 days of data) [2025-09-19T21:01:27.673758] [DEBUG] [LOCAL ] RLX: Primary data saved (48839 records). [2025-09-19T21:01:27.673942] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-19T21:01:27.674059] [INFO ] [MAIN ] Update Progress: 1816/2372 symbols completed. RLX took 42.2s. Estimated remaining: 1h 13m 54s. Rate: 7.5 symbols/min [2025-09-19T21:01:27.845015] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:01:27.845142] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-19T21:01:27.858250] [DEBUG] [LOCAL ] RMM: Loaded 10271 existing records from primary storage. [2025-09-19T21:01:27.858849] [INFO ] [MAIN ] RMM: Loaded 10271 existing records. [2025-09-19T21:01:28.034783] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:01:28.035000] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-19T21:01:28.035061] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-19T21:01:28.035479] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-19T21:01:28.035538] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-19T21:01:28.391425] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:01:28.512770] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T21:01:28.611004] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T21:01:28.643276] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-19T21:01:29.443280] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-19T21:01:30.243283] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-19T21:01:30.336701] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T21:01:30.951411] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T21:01:31.027439] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-19T21:01:31.043233] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-19T21:01:31.843299] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-19T21:01:31.948421] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T21:01:32.643301] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-19T21:01:33.443301] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-19T21:01:33.701404] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T21:01:33.914475] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T21:01:33.917988] [INFO ] [REMOTE ] RMAX: Full fetch complete (29663 records). [2025-09-19T21:01:33.918076] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-19T21:01:34.246407] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-19T21:01:34.300872] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T21:01:34.319143] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-19T21:01:34.320042] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-19T21:01:34.320704] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-19T21:01:34.320905] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-19T21:01:34.321954] [DEBUG] [LOCAL ] RMAX: Trimmed 29663 records to 22107 (keeping 200 days of data) [2025-09-19T21:01:34.447863] [DEBUG] [LOCAL ] RMAX: Primary data saved (22107 records). [2025-09-19T21:01:34.447999] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-19T21:01:34.448079] [INFO ] [MAIN ] Update Progress: 1817/2372 symbols completed. RMAX took 24.1s. Estimated remaining: 1h 13m 46s. Rate: 7.5 symbols/min [2025-09-19T21:01:34.672033] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:01:34.678552] [DEBUG] [LOCAL ] RMMZ: Loaded 4843 existing records from primary storage. [2025-09-19T21:01:34.678666] [INFO ] [MAIN ] RMMZ: Loaded 4843 existing records. [2025-09-19T21:01:34.868253] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:01:34.868568] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-19T21:01:34.868636] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-19T21:01:34.869026] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-19T21:01:34.869087] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-19T21:01:35.048435] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-19T21:01:35.240765] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:01:35.843274] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-19T21:01:35.908796] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T21:01:35.953627] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T21:01:36.643268] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-19T21:01:36.659763] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T21:01:37.443266] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-19T21:01:37.797355] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T21:01:38.243329] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-19T21:01:38.397421] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T21:01:39.043278] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-19T21:01:39.556019] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T21:01:39.843333] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-19T21:01:40.643245] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-19T21:01:40.860351] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T21:01:40.922753] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-19T21:01:41.443273] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-19T21:01:41.451315] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-19T21:01:42.243270] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-19T21:01:43.043258] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-19T21:01:43.114117] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T21:01:43.366672] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T21:01:43.843232] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-19T21:01:44.051224] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T21:01:44.643268] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-19T21:01:45.443326] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-19T21:01:45.530249] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T21:01:45.531925] [INFO ] [REMOTE ] RMI: Full fetch complete (6341 records). [2025-09-19T21:01:45.531995] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-19T21:01:45.909937] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-19T21:01:45.910148] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-19T21:01:45.910446] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-19T21:01:45.910555] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-19T21:01:45.911246] [DEBUG] [LOCAL ] RMI: Trimmed 6341 records to 4687 (keeping 200 days of data) [2025-09-19T21:01:45.940140] [DEBUG] [LOCAL ] RMI: Primary data saved (4687 records). [2025-09-19T21:01:45.940252] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-19T21:01:45.940720] [INFO ] [MAIN ] Update Progress: 1818/2372 symbols completed. RMI took 28.5s. Estimated remaining: 1h 13m 39s. Rate: 7.5 symbols/min [2025-09-19T21:01:46.062100] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-19T21:01:46.109722] [INFO ] [REMOTE ] RMD: Full fetch complete (60929 records). [2025-09-19T21:01:46.127871] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-19T21:01:46.152821] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:01:46.243603] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-19T21:01:46.410972] [DEBUG] [LOCAL ] RMT: Loaded 17886 existing records from primary storage. [2025-09-19T21:01:46.424222] [INFO ] [MAIN ] RMT: Loaded 17886 existing records. [2025-09-19T21:01:46.551984] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T21:01:46.694631] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-19T21:01:46.694504] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-19T21:01:46.700086] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-19T21:01:46.718341] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-19T21:01:46.738952] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-19T21:01:46.782467] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:01:46.783033] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-19T21:01:46.783102] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-19T21:01:46.783277] [DEBUG] [LOCAL ] RMD: Trimmed 60929 records to 43125 (keeping 200 days of data) [2025-09-19T21:01:46.783770] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-19T21:01:46.784088] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-19T21:01:47.043615] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-19T21:01:47.273235] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:01:47.430704] [DEBUG] [LOCAL ] RMD: Primary data saved (43125 records). [2025-09-19T21:01:47.430841] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-19T21:01:47.431402] [INFO ] [MAIN ] Update Progress: 1819/2372 symbols completed. RMD took 34.9s. Estimated remaining: 1h 13m 29s. Rate: 7.5 symbols/min [2025-09-19T21:01:47.606327] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:01:47.656259] [DEBUG] [LOCAL ] RNG: Loaded 48600 existing records from primary storage. [2025-09-19T21:01:47.656408] [INFO ] [MAIN ] RNG: Loaded 48600 existing records. [2025-09-19T21:01:47.847536] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:01:47.847331] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-19T21:01:47.850535] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-19T21:01:47.850599] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-19T21:01:47.851785] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-19T21:01:47.851848] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-19T21:01:48.211304] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:01:48.261121] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T21:01:48.643270] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-19T21:01:48.714210] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T21:01:49.443268] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-19T21:01:50.243267] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-19T21:01:50.586282] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T21:01:50.650186] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T21:01:51.043264] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-19T21:01:51.548276] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T21:01:51.557785] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T21:01:51.843296] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-19T21:01:52.643254] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-19T21:01:52.941744] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T21:01:52.944484] [INFO ] [REMOTE ] RMM: Full fetch complete (14775 records). [2025-09-19T21:01:52.944564] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-19T21:01:53.323837] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-19T21:01:53.323964] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-19T21:01:53.324326] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-19T21:01:53.324367] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-19T21:01:53.325046] [DEBUG] [LOCAL ] RMM: Trimmed 14775 records to 10324 (keeping 200 days of data) [2025-09-19T21:01:53.390372] [DEBUG] [LOCAL ] RMM: Primary data saved (10324 records). [2025-09-19T21:01:53.390527] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-19T21:01:53.390619] [INFO ] [MAIN ] Update Progress: 1820/2372 symbols completed. RMM took 25.7s. Estimated remaining: 1h 13m 21s. Rate: 7.5 symbols/min [2025-09-19T21:01:53.448846] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-19T21:01:53.595981] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:01:53.617285] [DEBUG] [LOCAL ] RNGR: Loaded 20620 existing records from primary storage. [2025-09-19T21:01:53.617411] [INFO ] [MAIN ] RNGR: Loaded 20620 existing records. [2025-09-19T21:01:53.807189] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:01:53.807471] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-19T21:01:53.807528] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-19T21:01:53.808277] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-19T21:01:53.808338] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-19T21:01:54.179174] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:01:54.243268] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-19T21:01:54.477805] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T21:01:54.502029] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T21:01:55.043293] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-19T21:01:55.463922] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T21:01:55.843307] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-19T21:01:56.643266] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-19T21:01:56.851315] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T21:01:57.224817] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T21:01:57.443262] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-19T21:01:57.468630] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-19T21:01:58.243304] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-19T21:01:58.707561] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T21:01:59.043269] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-19T21:01:59.523881] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-19T21:01:59.843266] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-19T21:02:00.340773] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T21:02:00.596281] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T21:02:00.643225] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-19T21:02:01.443295] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-19T21:02:01.651813] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T21:02:02.243302] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-19T21:02:02.273700] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-19T21:02:03.043292] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-19T21:02:03.148547] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T21:02:03.843269] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-19T21:02:03.985435] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-19T21:02:04.472714] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T21:02:04.474067] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7261 records). [2025-09-19T21:02:04.474145] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-19T21:02:04.648394] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-19T21:02:04.880023] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-19T21:02:04.880107] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-19T21:02:04.880492] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-19T21:02:04.880554] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-19T21:02:04.881033] [DEBUG] [LOCAL ] RMMZ: Trimmed 7261 records to 4862 (keeping 200 days of data) [2025-09-19T21:02:04.913751] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4862 records). [2025-09-19T21:02:04.913848] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-19T21:02:04.913944] [INFO ] [MAIN ] Update Progress: 1821/2372 symbols completed. RMMZ took 30.5s. Estimated remaining: 1h 13m 14s. Rate: 7.5 symbols/min [2025-09-19T21:02:05.098340] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:02:05.117819] [DEBUG] [LOCAL ] RNP: Loaded 15981 existing records from primary storage. [2025-09-19T21:02:05.117980] [INFO ] [MAIN ] RNP: Loaded 15981 existing records. [2025-09-19T21:02:05.317531] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:02:05.317844] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-19T21:02:05.317897] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-19T21:02:05.318508] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-19T21:02:05.318570] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-19T21:02:05.448492] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-19T21:02:05.715198] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:02:06.243320] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-19T21:02:06.792903] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T21:02:06.909853] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T21:02:07.043260] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-19T21:02:07.093298] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T21:02:07.843296] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-19T21:02:08.586955] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T21:02:08.643240] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-19T21:02:09.194534] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T21:02:09.443285] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-19T21:02:09.937895] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T21:02:10.243280] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-19T21:02:11.043317] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-19T21:02:11.250811] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T21:02:11.436214] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T21:02:11.843270] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-19T21:02:11.922526] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-19T21:02:12.643297] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-19T21:02:12.876938] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T21:02:13.443331] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-19T21:02:13.704912] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T21:02:14.243278] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-19T21:02:14.686835] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T21:02:15.043273] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-19T21:02:15.843288] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-19T21:02:15.921704] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-19T21:02:16.482322] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T21:02:16.643274] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-19T21:02:17.226523] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T21:02:17.448443] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-19T21:02:17.458854] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-19T21:02:18.243297] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-19T21:02:18.568856] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T21:02:18.571583] [INFO ] [REMOTE ] RMT: Full fetch complete (25526 records). [2025-09-19T21:02:18.571703] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-19T21:02:18.962629] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-19T21:02:18.962745] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-19T21:02:18.963280] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-19T21:02:18.963321] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-19T21:02:18.964037] [DEBUG] [LOCAL ] RMT: Trimmed 25526 records to 18024 (keeping 200 days of data) [2025-09-19T21:02:19.043435] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-19T21:02:19.076242] [DEBUG] [LOCAL ] RMT: Primary data saved (18024 records). [2025-09-19T21:02:19.076401] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-19T21:02:19.076520] [INFO ] [MAIN ] Update Progress: 1822/2372 symbols completed. RMT took 33.1s. Estimated remaining: 1h 13m 8s. Rate: 7.5 symbols/min [2025-09-19T21:02:19.244561] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:02:19.292914] [DEBUG] [LOCAL ] RNR: Loaded 34997 existing records from primary storage. [2025-09-19T21:02:19.293089] [INFO ] [MAIN ] RNR: Loaded 34997 existing records. [2025-09-19T21:02:19.486153] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:02:19.486411] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-19T21:02:19.486459] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-19T21:02:19.487448] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-19T21:02:19.487523] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-19T21:02:19.859872] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:02:19.859964] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-19T21:02:20.169017] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T21:02:20.187714] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T21:02:20.191500] [INFO ] [REMOTE ] RNGR: Full fetch complete (28512 records). [2025-09-19T21:02:20.191581] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-19T21:02:20.578490] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-19T21:02:20.578573] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-19T21:02:20.579158] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-19T21:02:20.579219] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-19T21:02:20.579962] [DEBUG] [LOCAL ] RNGR: Trimmed 28512 records to 20800 (keeping 200 days of data) [2025-09-19T21:02:20.668697] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-19T21:02:20.714624] [DEBUG] [LOCAL ] RNGR: Primary data saved (20800 records). [2025-09-19T21:02:20.714935] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-19T21:02:20.715078] [INFO ] [MAIN ] Update Progress: 1823/2372 symbols completed. RNGR took 27.3s. Estimated remaining: 1h 12m 58s. Rate: 7.5 symbols/min [2025-09-19T21:02:20.854266] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T21:02:20.911214] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:02:20.953561] [DEBUG] [LOCAL ] RNST: Loaded 37630 existing records from primary storage. [2025-09-19T21:02:20.953797] [INFO ] [MAIN ] RNST: Loaded 37630 existing records. [2025-09-19T21:02:21.155204] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:02:21.155487] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-19T21:02:21.155535] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-19T21:02:21.156581] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-19T21:02:21.156672] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-19T21:02:21.448398] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-19T21:02:21.514767] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:02:22.243330] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-19T21:02:22.591147] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T21:02:23.043282] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-19T21:02:23.524204] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T21:02:23.843237] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-19T21:02:23.940276] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T21:02:24.436715] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T21:02:24.643276] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-19T21:02:25.443282] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-19T21:02:25.627485] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T21:02:26.243313] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-19T21:02:26.549952] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T21:02:26.557158] [INFO ] [REMOTE ] RNG: Full fetch complete (69491 records). [2025-09-19T21:02:26.557340] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-19T21:02:26.854486] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T21:02:26.986018] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-19T21:02:26.986106] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-19T21:02:26.987092] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-19T21:02:26.987155] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-19T21:02:26.988625] [DEBUG] [LOCAL ] RNG: Trimmed 69491 records to 48950 (keeping 200 days of data) [2025-09-19T21:02:27.051592] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-19T21:02:27.300494] [DEBUG] [LOCAL ] RNG: Primary data saved (48950 records). [2025-09-19T21:02:27.300701] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-19T21:02:27.302067] [INFO ] [MAIN ] Update Progress: 1824/2372 symbols completed. RNG took 39.9s. Estimated remaining: 1h 12m 49s. Rate: 7.5 symbols/min [2025-09-19T21:02:27.494604] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:02:27.521914] [DEBUG] [LOCAL ] ROG: Loaded 23600 existing records from primary storage. [2025-09-19T21:02:27.522056] [INFO ] [MAIN ] ROG: Loaded 23600 existing records. [2025-09-19T21:02:27.721282] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:02:27.721523] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-19T21:02:27.721573] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-19T21:02:27.722235] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-19T21:02:27.722297] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-19T21:02:27.848599] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-19T21:02:28.133819] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:02:28.159616] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T21:02:28.302446] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T21:02:28.643277] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-19T21:02:29.443343] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-19T21:02:29.698836] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T21:02:30.123461] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T21:02:30.243261] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-19T21:02:30.519484] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T21:02:30.959460] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-19T21:02:31.043219] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-19T21:02:31.843264] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-19T21:02:32.089800] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T21:02:32.643273] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-19T21:02:33.045996] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T21:02:33.443313] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-19T21:02:34.243305] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-19T21:02:34.517287] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T21:02:34.898854] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T21:02:35.043259] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-19T21:02:35.214688] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T21:02:35.217337] [INFO ] [REMOTE ] RNP: Full fetch complete (23502 records). [2025-09-19T21:02:35.217446] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-19T21:02:35.611122] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-19T21:02:35.611202] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-19T21:02:35.611735] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-19T21:02:35.611808] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-19T21:02:35.612459] [DEBUG] [LOCAL ] RNP: Trimmed 23502 records to 16058 (keeping 200 days of data) [2025-09-19T21:02:35.710924] [DEBUG] [LOCAL ] RNP: Primary data saved (16058 records). [2025-09-19T21:02:35.711067] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-19T21:02:35.711168] [INFO ] [MAIN ] Update Progress: 1825/2372 symbols completed. RNP took 30.8s. Estimated remaining: 1h 12m 41s. Rate: 7.5 symbols/min [2025-09-19T21:02:35.848468] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-19T21:02:35.895579] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:02:35.945314] [DEBUG] [LOCAL ] ROK: Loaded 44486 existing records from primary storage. [2025-09-19T21:02:35.945461] [INFO ] [MAIN ] ROK: Loaded 44486 existing records. [2025-09-19T21:02:36.127537] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:02:36.127824] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-19T21:02:36.127882] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-19T21:02:36.129935] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-19T21:02:36.129995] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-19T21:02:36.502823] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:02:36.643270] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-19T21:02:36.801590] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T21:02:37.443326] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-19T21:02:38.024505] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T21:02:38.243313] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-19T21:02:38.450350] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T21:02:38.610764] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T21:02:39.043274] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-19T21:02:39.675116] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T21:02:39.843370] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-19T21:02:40.392930] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T21:02:40.643286] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-19T21:02:41.164263] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T21:02:41.443315] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-19T21:02:41.882465] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T21:02:42.243272] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-19T21:02:42.733438] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T21:02:43.043272] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-19T21:02:43.612444] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T21:02:43.843301] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-19T21:02:44.134080] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-19T21:02:44.643393] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-19T21:02:45.015305] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T21:02:45.443270] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-19T21:02:45.889212] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-19T21:02:46.243291] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-19T21:02:47.043329] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-19T21:02:47.264176] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T21:02:47.843280] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-19T21:02:48.198780] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T21:02:48.297409] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T21:02:48.643262] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-19T21:02:48.961367] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T21:02:49.376878] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T21:02:49.379815] [INFO ] [REMOTE ] ROG: Full fetch complete (30751 records). [2025-09-19T21:02:49.379894] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-19T21:02:49.448364] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-19T21:02:49.775370] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-19T21:02:49.775464] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-19T21:02:49.776129] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-19T21:02:49.776192] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-19T21:02:49.777322] [DEBUG] [LOCAL ] ROG: Trimmed 30751 records to 23676 (keeping 200 days of data) [2025-09-19T21:02:49.926620] [DEBUG] [LOCAL ] ROG: Primary data saved (23676 records). [2025-09-19T21:02:49.926781] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-19T21:02:49.926894] [INFO ] [MAIN ] Update Progress: 1826/2372 symbols completed. ROG took 22.6s. Estimated remaining: 1h 12m 35s. Rate: 7.5 symbols/min [2025-09-19T21:02:50.099450] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:02:50.154531] [DEBUG] [LOCAL ] ROL: Loaded 50671 existing records from primary storage. [2025-09-19T21:02:50.154700] [INFO ] [MAIN ] ROL: Loaded 50671 existing records. [2025-09-19T21:02:50.249898] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-19T21:02:50.342386] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:02:50.342723] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-19T21:02:50.342795] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-19T21:02:50.344155] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-19T21:02:50.344235] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-19T21:02:50.700026] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:02:51.043232] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-19T21:02:51.646622] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T21:02:51.725533] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T21:02:51.843220] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-19T21:02:52.242018] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T21:02:52.643283] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-19T21:02:53.325428] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T21:02:53.330712] [INFO ] [REMOTE ] RNST: Full fetch complete (52787 records). [2025-09-19T21:02:53.330835] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-19T21:02:53.448539] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-19T21:02:53.733971] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-19T21:02:53.734079] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-19T21:02:53.735161] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-19T21:02:53.735259] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-19T21:02:53.739979] [DEBUG] [LOCAL ] RNST: Trimmed 52787 records to 37867 (keeping 200 days of data) [2025-09-19T21:02:53.984676] [DEBUG] [LOCAL ] RNST: Primary data saved (37867 records). [2025-09-19T21:02:53.984889] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-19T21:02:53.985126] [INFO ] [MAIN ] Update Progress: 1827/2372 symbols completed. RNST took 33.3s. Estimated remaining: 1h 12m 26s. Rate: 7.5 symbols/min [2025-09-19T21:02:54.255028] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-19T21:02:54.259705] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:02:54.262253] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T21:02:54.331667] [DEBUG] [LOCAL ] RPM: Loaded 41355 existing records from primary storage. [2025-09-19T21:02:54.331812] [INFO ] [MAIN ] RPM: Loaded 41355 existing records. [2025-09-19T21:02:54.507802] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:02:54.508024] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-19T21:02:54.508072] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-19T21:02:54.509091] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-19T21:02:54.509151] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-19T21:02:54.858549] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:02:55.044584] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-19T21:02:55.050043] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T21:02:55.843217] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-19T21:02:56.410071] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T21:02:56.573121] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T21:02:56.643221] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-19T21:02:57.317392] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T21:02:57.322096] [INFO ] [REMOTE ] RNR: Full fetch complete (51508 records). [2025-09-19T21:02:57.322196] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-19T21:02:57.448434] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-19T21:02:57.704994] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-19T21:02:57.705071] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-19T21:02:57.705932] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-19T21:02:57.705994] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-19T21:02:57.707064] [DEBUG] [LOCAL ] RNR: Trimmed 51508 records to 35210 (keeping 200 days of data) [2025-09-19T21:02:57.939336] [DEBUG] [LOCAL ] RNR: Primary data saved (35210 records). [2025-09-19T21:02:57.939495] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-19T21:02:57.939604] [INFO ] [MAIN ] Update Progress: 1828/2372 symbols completed. RNR took 38.9s. Estimated remaining: 1h 12m 17s. Rate: 7.5 symbols/min [2025-09-19T21:02:58.108469] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:02:58.108661] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-09-19T21:02:58.108717] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-09-19T21:02:58.108857] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-19T21:02:58.108900] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-19T21:02:58.108939] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-09-19T21:02:58.108971] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-19T21:02:58.248394] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-19T21:02:58.459830] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:02:58.640060] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T21:02:59.043272] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-19T21:02:59.569879] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T21:02:59.625834] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T21:02:59.843283] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-19T21:03:00.643312] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-19T21:03:00.760074] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-19T21:03:01.443272] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-19T21:03:01.697216] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T21:03:02.095303] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T21:03:02.243311] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-19T21:03:03.043310] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-19T21:03:03.843264] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-19T21:03:04.724527] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (3.28 seconds). [2025-09-19T21:03:04.737175] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-19T21:03:04.750501] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-19T21:03:04.836874] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T21:03:05.443262] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-19T21:03:05.945076] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T21:03:06.243318] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-19T21:03:06.888901] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T21:03:07.043261] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-19T21:03:07.289342] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T21:03:07.843276] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-19T21:03:08.210087] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T21:03:08.583323] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T21:03:08.643223] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-19T21:03:09.443264] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-19T21:03:09.750428] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T21:03:10.243281] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-19T21:03:10.644620] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T21:03:11.043276] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-19T21:03:11.215026] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T21:03:11.220967] [INFO ] [REMOTE ] ROK: Full fetch complete (63482 records). [2025-09-19T21:03:11.221102] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-19T21:03:11.610482] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-19T21:03:11.610612] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-19T21:03:11.611605] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-19T21:03:11.611689] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-19T21:03:11.613841] [DEBUG] [LOCAL ] ROK: Trimmed 63482 records to 44736 (keeping 200 days of data) [2025-09-19T21:03:11.852839] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-19T21:03:11.902845] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T21:03:11.974197] [DEBUG] [LOCAL ] ROK: Primary data saved (44736 records). [2025-09-19T21:03:11.974361] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-19T21:03:11.974479] [INFO ] [MAIN ] Update Progress: 1829/2372 symbols completed. ROK took 36.3s. Estimated remaining: 1h 12m 11s. Rate: 7.5 symbols/min [2025-09-19T21:03:12.152207] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:03:12.186077] [DEBUG] [LOCAL ] RQI: Loaded 29386 existing records from primary storage. [2025-09-19T21:03:12.186221] [INFO ] [MAIN ] RQI: Loaded 29386 existing records. [2025-09-19T21:03:12.367532] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:03:12.367854] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-19T21:03:12.367903] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-19T21:03:12.368759] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-19T21:03:12.368819] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-19T21:03:12.650416] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-19T21:03:12.772698] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:03:12.813394] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T21:03:13.118953] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T21:03:13.443282] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-19T21:03:14.243289] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-19T21:03:15.043275] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-19T21:03:15.772318] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-19T21:03:15.845020] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-19T21:03:15.848466] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T21:03:15.891845] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-19T21:03:15.905596] [INFO ] [REMOTE ] ROL: Full fetch complete (72537 records). [2025-09-19T21:03:15.905857] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-19T21:03:16.503571] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-19T21:03:16.524284] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-19T21:03:16.526302] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-19T21:03:16.528792] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T21:03:16.535589] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-19T21:03:16.538080] [DEBUG] [LOCAL ] ROL: Trimmed 72537 records to 51014 (keeping 200 days of data) [2025-09-19T21:03:16.646619] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-19T21:03:16.882996] [DEBUG] [LOCAL ] ROL: Primary data saved (51014 records). [2025-09-19T21:03:16.883146] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-19T21:03:16.883872] [INFO ] [MAIN ] Update Progress: 1830/2372 symbols completed. ROL took 27.0s. Estimated remaining: 1h 12m 2s. Rate: 7.5 symbols/min [2025-09-19T21:03:17.112337] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:03:17.171564] [DEBUG] [LOCAL ] RRC: Loaded 53166 existing records from primary storage. [2025-09-19T21:03:17.171750] [INFO ] [MAIN ] RRC: Loaded 53166 existing records. [2025-09-19T21:03:17.351699] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:03:17.351964] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-19T21:03:17.352012] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-19T21:03:17.353417] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-19T21:03:17.353480] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-19T21:03:17.451608] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-19T21:03:17.725466] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:03:17.751513] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T21:03:17.820822] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T21:03:18.243321] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-19T21:03:18.806914] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T21:03:19.043265] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-19T21:03:19.621574] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T21:03:19.843247] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-19T21:03:20.295628] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T21:03:20.643271] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-19T21:03:20.946227] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T21:03:21.443346] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-19T21:03:22.243283] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-19T21:03:22.776231] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T21:03:22.810799] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T21:03:23.043272] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-19T21:03:23.399587] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T21:03:23.843259] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-19T21:03:24.643278] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-19T21:03:25.279084] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T21:03:25.400520] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T21:03:25.443239] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-19T21:03:25.629944] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T21:03:26.178955] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T21:03:26.243259] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-19T21:03:27.043265] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-19T21:03:27.625984] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T21:03:27.843297] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-19T21:03:28.183578] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T21:03:28.187018] [INFO ] [REMOTE ] RPT: Full fetch complete (28530 records). [2025-09-19T21:03:28.187129] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-19T21:03:28.372812] [WARN ] [VALIDATOR ] RPT: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T21:03:28.373347] [FATAL] [MAIN ] RPT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:03:28.373438] [WARN ] [MAIN ] RPT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:03:28.373547] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-19T21:03:28.373720] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-09-19T21:03:28.373804] [INFO ] [LOCAL ] RPT: Starting deletion of derivative data. [2025-09-19T21:03:28.373927] [DEBUG] [LOCAL ] RPT: No derivative data file found to delete. [2025-09-19T21:03:28.374044] [INFO ] [MAIN ] Update Progress: 1831/2372 symbols completed. RPT took 30.4s. Estimated remaining: 1h 11m 55s. Rate: 7.5 symbols/min [2025-09-19T21:03:28.542595] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:03:28.596131] [DEBUG] [LOCAL ] RRX: Loaded 41467 existing records from primary storage. [2025-09-19T21:03:28.596317] [INFO ] [MAIN ] RRX: Loaded 41467 existing records. [2025-09-19T21:03:28.649291] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-19T21:03:28.782718] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:03:28.782987] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-19T21:03:28.783056] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-19T21:03:28.785116] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-19T21:03:28.785177] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-19T21:03:29.152366] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:03:29.443291] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-19T21:03:29.535469] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T21:03:29.541983] [INFO ] [REMOTE ] RPM: Full fetch complete (58587 records). [2025-09-19T21:03:29.542198] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-19T21:03:29.940207] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-19T21:03:29.940316] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-19T21:03:29.941331] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-19T21:03:29.941411] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-19T21:03:29.942808] [DEBUG] [LOCAL ] RPM: Trimmed 58587 records to 41664 (keeping 200 days of data) [2025-09-19T21:03:30.205237] [DEBUG] [LOCAL ] RPM: Primary data saved (41664 records). [2025-09-19T21:03:30.205372] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-19T21:03:30.205454] [INFO ] [MAIN ] Update Progress: 1832/2372 symbols completed. RPM took 36.2s. Estimated remaining: 1h 11m 45s. Rate: 7.5 symbols/min [2025-09-19T21:03:30.248435] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-19T21:03:30.381181] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:03:30.408724] [DEBUG] [LOCAL ] RS: Loaded 26060 existing records from primary storage. [2025-09-19T21:03:30.408879] [INFO ] [MAIN ] RS: Loaded 26060 existing records. [2025-09-19T21:03:30.598563] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:03:30.599061] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-19T21:03:30.599198] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-19T21:03:30.599959] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-19T21:03:30.600023] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-19T21:03:30.994314] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:03:31.015317] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-19T21:03:31.044247] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-19T21:03:31.046625] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T21:03:31.833198] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T21:03:31.843213] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-19T21:03:32.619366] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T21:03:32.643253] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-19T21:03:32.968980] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T21:03:33.443269] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-19T21:03:34.243318] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-19T21:03:34.302496] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T21:03:35.043280] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-19T21:03:35.149506] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T21:03:35.712792] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T21:03:35.843258] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-19T21:03:36.479094] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T21:03:36.643296] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-19T21:03:37.443280] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-19T21:03:37.701275] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T21:03:38.243293] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-19T21:03:38.455170] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T21:03:39.043271] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-19T21:03:39.196722] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T21:03:39.843300] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-19T21:03:40.238315] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T21:03:40.643297] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-19T21:03:40.861756] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T21:03:41.380762] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T21:03:41.443223] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-19T21:03:42.243272] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-19T21:03:42.499966] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T21:03:42.871321] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T21:03:42.877154] [INFO ] [REMOTE ] RQI: Full fetch complete (43177 records). [2025-09-19T21:03:42.877297] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-19T21:03:43.043343] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-19T21:03:43.289000] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-19T21:03:43.289127] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-19T21:03:43.290451] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-19T21:03:43.290515] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-19T21:03:43.291830] [DEBUG] [LOCAL ] RQI: Trimmed 43177 records to 29618 (keeping 200 days of data) [2025-09-19T21:03:43.495409] [DEBUG] [LOCAL ] RQI: Primary data saved (29618 records). [2025-09-19T21:03:43.495695] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-19T21:03:43.495846] [INFO ] [MAIN ] Update Progress: 1833/2372 symbols completed. RQI took 31.5s. Estimated remaining: 1h 11m 39s. Rate: 7.5 symbols/min [2025-09-19T21:03:43.675923] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:03:43.683039] [DEBUG] [LOCAL ] RSF: Loaded 4178 existing records from primary storage. [2025-09-19T21:03:43.683187] [INFO ] [MAIN ] RSF: Loaded 4178 existing records. [2025-09-19T21:03:43.855798] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-19T21:03:43.878350] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:03:43.879715] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-19T21:03:43.879779] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-19T21:03:43.880140] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-19T21:03:43.880225] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-19T21:03:44.269280] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:03:44.429760] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T21:03:44.643320] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-19T21:03:44.714804] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T21:03:45.263540] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-19T21:03:45.443253] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-19T21:03:45.522710] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-19T21:03:46.243270] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-19T21:03:46.987155] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T21:03:47.043237] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-19T21:03:47.219454] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T21:03:47.843266] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-19T21:03:48.613795] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T21:03:48.630575] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T21:03:48.643219] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-19T21:03:49.443272] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-19T21:03:50.243278] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-19T21:03:50.452939] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T21:03:51.043256] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-19T21:03:51.158391] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T21:03:51.482329] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-19T21:03:51.843243] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-19T21:03:52.470285] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T21:03:52.643259] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-19T21:03:52.714575] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T21:03:53.346854] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-19T21:03:53.443249] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-19T21:03:54.216224] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T21:03:54.243251] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-19T21:03:55.043251] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-19T21:03:55.244134] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T21:03:55.843278] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-19T21:03:56.393853] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T21:03:56.397629] [INFO ] [REMOTE ] RS: Full fetch complete (39477 records). [2025-09-19T21:03:56.397767] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-19T21:03:56.653633] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-19T21:03:56.778664] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-19T21:03:56.778750] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-19T21:03:56.779493] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-19T21:03:56.779533] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-19T21:03:56.780412] [DEBUG] [LOCAL ] RS: Trimmed 39477 records to 26305 (keeping 200 days of data) [2025-09-19T21:03:56.945314] [DEBUG] [LOCAL ] RS: Primary data saved (26305 records). [2025-09-19T21:03:56.945462] [INFO ] [MAIN ] RS: Full history saved. [2025-09-19T21:03:56.945549] [INFO ] [MAIN ] Update Progress: 1834/2372 symbols completed. RS took 26.7s. Estimated remaining: 1h 11m 32s. Rate: 7.5 symbols/min [2025-09-19T21:03:57.119819] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:03:57.170915] [DEBUG] [LOCAL ] RSG: Loaded 47819 existing records from primary storage. [2025-09-19T21:03:57.171083] [INFO ] [MAIN ] RSG: Loaded 47819 existing records. [2025-09-19T21:03:57.344123] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:03:57.344389] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-19T21:03:57.344449] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-19T21:03:57.345493] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-19T21:03:57.345552] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-19T21:03:57.443278] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-19T21:03:57.703755] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:03:57.722690] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T21:03:57.729234] [INFO ] [REMOTE ] RRX: Full fetch complete (57891 records). [2025-09-19T21:03:57.729367] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-19T21:03:58.111623] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-19T21:03:58.111737] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-19T21:03:58.112688] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-19T21:03:58.112787] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-19T21:03:58.114070] [DEBUG] [LOCAL ] RRX: Trimmed 57891 records to 41720 (keeping 200 days of data) [2025-09-19T21:03:58.243330] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-19T21:03:58.395143] [DEBUG] [LOCAL ] RRX: Primary data saved (41720 records). [2025-09-19T21:03:58.395307] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-19T21:03:58.395415] [INFO ] [MAIN ] Update Progress: 1835/2372 symbols completed. RRX took 30.0s. Estimated remaining: 1h 11m 23s. Rate: 7.5 symbols/min [2025-09-19T21:03:58.563419] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:03:58.614674] [DEBUG] [LOCAL ] RSI: Loaded 47640 existing records from primary storage. [2025-09-19T21:03:58.614826] [INFO ] [MAIN ] RSI: Loaded 47640 existing records. [2025-09-19T21:03:58.742634] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T21:03:58.802165] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:03:58.802400] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-19T21:03:58.802449] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-19T21:03:58.803406] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-19T21:03:58.803464] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-19T21:03:59.050933] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-19T21:03:59.174941] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:03:59.211131] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-19T21:03:59.774434] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T21:03:59.831663] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-19T21:03:59.843203] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-19T21:04:00.537007] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-19T21:04:00.538312] [INFO ] [REMOTE ] RSF: Full fetch complete (5601 records). [2025-09-19T21:04:00.538387] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-19T21:04:00.648433] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-19T21:04:00.950079] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-19T21:04:00.950179] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-19T21:04:00.950408] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-19T21:04:00.950449] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-19T21:04:00.950983] [DEBUG] [LOCAL ] RSF: Trimmed 5601 records to 4199 (keeping 200 days of data) [2025-09-19T21:04:00.977696] [DEBUG] [LOCAL ] RSF: Primary data saved (4199 records). [2025-09-19T21:04:00.977833] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-19T21:04:00.977993] [INFO ] [MAIN ] Update Progress: 1836/2372 symbols completed. RSF took 17.5s. Estimated remaining: 1h 11m 13s. Rate: 7.5 symbols/min [2025-09-19T21:04:01.174217] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:04:01.207485] [DEBUG] [LOCAL ] RSKD: Loaded 34536 existing records from primary storage. [2025-09-19T21:04:01.207632] [INFO ] [MAIN ] RSKD: Loaded 34536 existing records. [2025-09-19T21:04:01.397679] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:04:01.398068] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-19T21:04:01.398133] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-19T21:04:01.398891] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-19T21:04:01.398951] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-19T21:04:01.453164] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-19T21:04:01.818466] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:04:02.243279] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-19T21:04:02.815616] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T21:04:03.043263] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-19T21:04:03.371826] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T21:04:03.826906] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T21:04:03.843224] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-19T21:04:04.643272] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-19T21:04:05.321700] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T21:04:05.443257] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-19T21:04:05.611687] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-19T21:04:06.202519] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T21:04:06.243221] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-19T21:04:07.043295] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-19T21:04:07.402440] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-19T21:04:07.537867] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T21:04:07.843282] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-19T21:04:08.572918] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T21:04:08.643227] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-19T21:04:09.443332] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-19T21:04:09.854968] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T21:04:10.243272] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-19T21:04:10.728254] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T21:04:11.043269] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-19T21:04:11.537437] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T21:04:11.843343] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-19T21:04:11.930394] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T21:04:12.617183] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T21:04:12.643219] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-19T21:04:13.443277] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-19T21:04:13.773736] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T21:04:13.781455] [INFO ] [REMOTE ] RRC: Full fetch complete (76214 records). [2025-09-19T21:04:13.781577] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-19T21:04:14.187281] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-19T21:04:14.187415] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-19T21:04:14.188479] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-19T21:04:14.188544] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-19T21:04:14.190223] [DEBUG] [LOCAL ] RRC: Trimmed 76214 records to 53556 (keeping 200 days of data) [2025-09-19T21:04:14.251847] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-19T21:04:14.528619] [DEBUG] [LOCAL ] RRC: Primary data saved (53556 records). [2025-09-19T21:04:14.528812] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-19T21:04:14.529124] [INFO ] [MAIN ] Update Progress: 1837/2372 symbols completed. RRC took 57.6s. Estimated remaining: 1h 11m 7s. Rate: 7.5 symbols/min [2025-09-19T21:04:14.613505] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T21:04:15.043245] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-19T21:04:15.569230] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T21:04:15.666468] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T21:04:15.843247] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-19T21:04:16.486106] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T21:04:16.643368] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-19T21:04:17.443332] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-19T21:04:18.112474] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T21:04:18.154481] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T21:04:18.243235] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-19T21:04:19.043274] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-19T21:04:19.259726] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T21:04:19.779860] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T21:04:19.843221] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-19T21:04:20.134429] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T21:04:20.643274] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-19T21:04:21.302112] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T21:04:21.443315] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-19T21:04:22.243269] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-19T21:04:22.363799] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-19T21:04:23.043322] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-19T21:04:23.428709] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T21:04:23.685922] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T21:04:23.843268] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-19T21:04:24.638749] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T21:04:24.643577] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-19T21:04:24.645269] [INFO ] [REMOTE ] RSKD: Full fetch complete (48563 records). [2025-09-19T21:04:24.645349] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-19T21:04:25.021663] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-19T21:04:25.021754] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-19T21:04:25.022583] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-19T21:04:25.022622] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-19T21:04:25.023694] [DEBUG] [LOCAL ] RSKD: Trimmed 48563 records to 34859 (keeping 200 days of data) [2025-09-19T21:04:25.217237] [DEBUG] [LOCAL ] RSKD: Primary data saved (34859 records). [2025-09-19T21:04:25.217402] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-19T21:04:25.217516] [INFO ] [MAIN ] Update Progress: 1838/2372 symbols completed. RSKD took 24.2s. Estimated remaining: 1h 10m 59s. Rate: 7.5 symbols/min [2025-09-19T21:04:25.811167] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T21:04:25.821725] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-19T21:04:26.007590] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T21:04:26.243273] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-19T21:04:27.398899] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T21:04:27.410057] [INFO ] [REMOTE ] RSI: Full fetch complete (69517 records). [2025-09-19T21:04:27.410250] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-19T21:04:27.978357] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-19T21:04:27.978458] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-19T21:04:27.980037] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-19T21:04:27.980139] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-19T21:04:27.982076] [DEBUG] [LOCAL ] RSI: Trimmed 69517 records to 47971 (keeping 200 days of data) [2025-09-19T21:04:28.255879] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T21:04:28.275999] [INFO ] [REMOTE ] RSG: Full fetch complete (67769 records). [2025-09-19T21:04:28.277440] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-19T21:04:28.737525] [DEBUG] [LOCAL ] RSI: Primary data saved (47971 records). [2025-09-19T21:04:28.747963] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-19T21:04:28.761976] [INFO ] [MAIN ] Update Progress: 1839/2372 symbols completed. RSI took 30.4s. Estimated remaining: 1h 10m 50s. Rate: 7.5 symbols/min [2025-09-19T21:04:28.815519] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-19T21:04:28.815587] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-19T21:04:28.816551] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-19T21:04:28.816613] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-19T21:04:28.817993] [DEBUG] [LOCAL ] RSG: Trimmed 67769 records to 48173 (keeping 200 days of data) [2025-09-19T21:04:29.122339] [DEBUG] [LOCAL ] RSG: Primary data saved (48173 records). [2025-09-19T21:04:29.122475] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-19T21:04:29.123928] [INFO ] [MAIN ] Update Progress: 1840/2372 symbols completed. RSG took 32.2s. Estimated remaining: 1h 10m 40s. Rate: 7.5 symbols/min [2025-09-19T21:04:29.719203] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:04:29.821115] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:04:29.822107] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:04:29.826610] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:04:29.923915] [DEBUG] [LOCAL ] RTO: Loaded 40963 existing records from primary storage. [2025-09-19T21:04:29.924727] [INFO ] [MAIN ] RTO: Loaded 40963 existing records. [2025-09-19T21:04:29.931045] [DEBUG] [LOCAL ] RVT: Loaded 27715 existing records from primary storage. [2025-09-19T21:04:29.937163] [INFO ] [MAIN ] RVT: Loaded 27715 existing records. [2025-09-19T21:04:30.077575] [DEBUG] [LOCAL ] RTX: Loaded 54101 existing records from primary storage. [2025-09-19T21:04:30.093700] [INFO ] [MAIN ] RTX: Loaded 54101 existing records. [2025-09-19T21:04:30.046881] [DEBUG] [LOCAL ] RVLV: Loaded 48377 existing records from primary storage. [2025-09-19T21:04:30.133811] [INFO ] [MAIN ] RVLV: Loaded 48377 existing records. [2025-09-19T21:04:30.408050] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:04:30.496002] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-19T21:04:30.544369] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-19T21:04:30.582219] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:04:30.587456] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-19T21:04:30.611954] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-19T21:04:30.611870] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-19T21:04:30.668666] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-19T21:04:30.704463] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:04:30.736407] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-19T21:04:30.766554] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-19T21:04:30.766687] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-19T21:04:30.758918] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-19T21:04:30.815940] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:04:30.816309] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-19T21:04:30.831639] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-19T21:04:30.816610] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-19T21:04:30.850901] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-19T21:04:30.918315] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-19T21:04:30.932864] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-19T21:04:31.774160] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:04:31.818444] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-19T21:04:32.059632] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:04:32.100059] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-19T21:04:32.163028] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:04:32.216584] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-19T21:04:32.260638] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:04:32.261019] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-19T21:04:33.761206] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T21:04:33.769562] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-19T21:04:33.922145] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-19T21:04:33.929115] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-19T21:04:34.059403] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T21:04:34.069444] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-19T21:04:34.170565] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T21:04:34.181779] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-19T21:04:35.075377] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T21:04:35.084504] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-19T21:04:35.494966] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T21:04:35.501424] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-19T21:04:35.904250] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T21:04:35.913492] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-19T21:04:36.419541] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T21:04:36.430675] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-19T21:04:37.064400] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T21:04:37.070009] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-19T21:04:37.132214] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T21:04:37.328168] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T21:04:37.443310] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-19T21:04:38.243360] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-19T21:04:38.636718] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T21:04:38.708570] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T21:04:38.891293] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-19T21:04:39.043281] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-19T21:04:39.843283] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-19T21:04:40.361752] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T21:04:40.643330] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-19T21:04:40.964207] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T21:04:41.438458] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T21:04:41.445866] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-19T21:04:42.243280] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-19T21:04:42.339315] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T21:04:43.043234] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-19T21:04:43.505149] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T21:04:43.572734] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T21:04:43.843287] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-19T21:04:44.643364] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-19T21:04:44.820977] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T21:04:45.443327] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-19T21:04:45.744220] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T21:04:46.243312] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-19T21:04:46.484962] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T21:04:47.048471] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-19T21:04:47.062112] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T21:04:47.451620] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T21:04:47.843315] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-19T21:04:48.643348] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-19T21:04:49.078895] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T21:04:49.420791] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T21:04:49.443218] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-19T21:04:50.243258] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-19T21:04:50.916245] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T21:04:51.043238] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-19T21:04:51.125990] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T21:04:51.843353] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-19T21:04:52.227203] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T21:04:52.497218] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T21:04:52.643255] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-19T21:04:52.742736] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T21:04:52.747327] [INFO ] [REMOTE ] RVT: Full fetch complete (40233 records). [2025-09-19T21:04:52.747420] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-19T21:04:53.121081] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-19T21:04:53.121178] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-19T21:04:53.121982] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-19T21:04:53.122056] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-19T21:04:53.123144] [DEBUG] [LOCAL ] RVT: Trimmed 40233 records to 27865 (keeping 200 days of data) [2025-09-19T21:04:53.292917] [DEBUG] [LOCAL ] RVT: Primary data saved (27865 records). [2025-09-19T21:04:53.293050] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-19T21:04:53.293237] [INFO ] [MAIN ] Update Progress: 1841/2372 symbols completed. RVT took 24.2s. Estimated remaining: 1h 10m 37s. Rate: 7.5 symbols/min [2025-09-19T21:04:53.459964] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:04:53.456809] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-19T21:04:53.514415] [DEBUG] [LOCAL ] RVTY: Loaded 47953 existing records from primary storage. [2025-09-19T21:04:53.514555] [INFO ] [MAIN ] RVTY: Loaded 47953 existing records. [2025-09-19T21:04:53.690224] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:04:53.690439] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-19T21:04:53.690494] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-19T21:04:53.691964] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-19T21:04:53.692026] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-19T21:04:54.087904] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:04:54.106353] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T21:04:54.113493] [INFO ] [REMOTE ] RVLV: Full fetch complete (68901 records). [2025-09-19T21:04:54.113635] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-19T21:04:54.251395] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-19T21:04:54.505213] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-19T21:04:54.505303] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-19T21:04:54.506306] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-19T21:04:54.506392] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-19T21:04:54.507807] [DEBUG] [LOCAL ] RVLV: Trimmed 68901 records to 48685 (keeping 200 days of data) [2025-09-19T21:04:54.802084] [DEBUG] [LOCAL ] RVLV: Primary data saved (48685 records). [2025-09-19T21:04:54.802345] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-19T21:04:54.802587] [INFO ] [MAIN ] Update Progress: 1842/2372 symbols completed. RVLV took 25.6s. Estimated remaining: 1h 10m 27s. Rate: 7.5 symbols/min [2025-09-19T21:04:54.980742] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:04:55.030504] [DEBUG] [LOCAL ] RWT: Loaded 40816 existing records from primary storage. [2025-09-19T21:04:55.030698] [INFO ] [MAIN ] RWT: Loaded 40816 existing records. [2025-09-19T21:04:55.063815] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-19T21:04:55.219109] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:04:55.219399] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-19T21:04:55.219462] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-19T21:04:55.220590] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-19T21:04:55.220703] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-19T21:04:55.608262] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:04:55.648600] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T21:04:55.843246] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-19T21:04:56.237472] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T21:04:56.643380] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-19T21:04:57.045951] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T21:04:57.443267] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-19T21:04:57.740765] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T21:04:57.989531] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T21:04:58.243245] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-19T21:04:59.043321] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-19T21:04:59.838179] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-19T21:04:59.848306] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-19T21:04:59.918167] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-19T21:04:59.924113] [INFO ] [REMOTE ] RTO: Full fetch complete (58439 records). [2025-09-19T21:04:59.924263] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-19T21:05:00.310335] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-19T21:05:00.310431] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-19T21:05:00.311377] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-19T21:05:00.311444] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-19T21:05:00.312816] [DEBUG] [LOCAL ] RTO: Trimmed 58439 records to 41208 (keeping 200 days of data) [2025-09-19T21:05:00.581009] [DEBUG] [LOCAL ] RTO: Primary data saved (41208 records). [2025-09-19T21:05:00.581162] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-19T21:05:00.581291] [INFO ] [MAIN ] Update Progress: 1843/2372 symbols completed. RTO took 31.5s. Estimated remaining: 1h 10m 18s. Rate: 7.5 symbols/min [2025-09-19T21:05:00.650136] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-19T21:05:00.754442] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:05:00.754674] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-19T21:05:00.754731] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-19T21:05:00.754944] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-19T21:05:00.754999] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-19T21:05:00.755064] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-19T21:05:00.755099] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-19T21:05:01.127526] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:05:01.152536] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T21:05:01.326261] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T21:05:01.443268] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-19T21:05:02.121746] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-19T21:05:02.243289] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-19T21:05:03.043261] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-19T21:05:03.511529] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-19T21:05:03.817028] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T21:05:03.843241] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-19T21:05:04.264579] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T21:05:04.509766] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T21:05:04.643258] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-19T21:05:05.279232] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-19T21:05:05.443269] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-19T21:05:06.243274] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-19T21:05:06.825804] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T21:05:07.043256] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-19T21:05:07.843269] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-19T21:05:08.234822] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T21:05:08.354171] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T21:05:08.534948] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T21:05:08.643294] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-19T21:05:09.247690] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T21:05:09.443290] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-19T21:05:10.243321] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-19T21:05:10.679473] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T21:05:10.805883] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-19T21:05:11.043332] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-19T21:05:11.390277] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-19T21:05:11.843282] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-19T21:05:12.643281] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-19T21:05:13.443287] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-19T21:05:13.621296] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T21:05:13.913367] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-19T21:05:14.243300] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-19T21:05:14.396232] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T21:05:14.408209] [INFO ] [REMOTE ] RTX: Full fetch complete (77729 records). [2025-09-19T21:05:14.408463] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-19T21:05:14.871863] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-19T21:05:14.867922] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T21:05:14.873420] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-19T21:05:14.874730] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-19T21:05:14.874822] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-19T21:05:14.873362] [INFO ] [REMOTE ] RWTN: Full fetch complete (3071 records). [2025-09-19T21:05:14.875062] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-19T21:05:14.982310] [DEBUG] [LOCAL ] RTX: Trimmed 77729 records to 54491 (keeping 200 days of data) [2025-09-19T21:05:15.087129] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-19T21:05:15.130717] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-19T21:05:15.157450] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:05:15.157586] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:05:15.157683] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-19T21:05:15.157757] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-19T21:05:15.157794] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-19T21:05:15.159483] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-19T21:05:15.160450] [INFO ] [MAIN ] Update Progress: 1844/2372 symbols completed. RWTN took 14.6s. Estimated remaining: 1h 10m 12s. Rate: 7.5 symbols/min [2025-09-19T21:05:15.434859] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:05:15.444281] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-19T21:05:15.444347] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-19T21:05:15.475884] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-19T21:05:15.478169] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-19T21:05:15.482397] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-19T21:05:15.482786] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-19T21:05:15.860547] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-19T21:05:15.990306] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:05:16.002488] [DEBUG] [LOCAL ] RTX: Primary data saved (54491 records). [2025-09-19T21:05:16.002589] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-19T21:05:16.003921] [INFO ] [MAIN ] Update Progress: 1845/2372 symbols completed. RTX took 46.9s. Estimated remaining: 1h 10m 2s. Rate: 7.5 symbols/min [2025-09-19T21:05:16.173564] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:05:16.173779] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-19T21:05:16.173823] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-19T21:05:16.173964] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-19T21:05:16.174016] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-19T21:05:16.174056] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-19T21:05:16.174088] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-19T21:05:16.542482] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:05:16.643227] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-19T21:05:16.779743] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T21:05:16.991728] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:05:16.992062] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-19T21:05:17.443278] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-19T21:05:17.520984] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T21:05:18.009246] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-19T21:05:18.243270] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-19T21:05:19.043270] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-19T21:05:19.620047] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-19T21:05:19.843276] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-19T21:05:20.442330] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-19T21:05:20.643296] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-19T21:05:21.039171] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T21:05:21.443283] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-19T21:05:21.661758] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T21:05:22.243256] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-19T21:05:22.460428] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T21:05:22.824634] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T21:05:23.043263] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-19T21:05:23.843265] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-19T21:05:24.442322] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T21:05:24.643261] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-19T21:05:24.910821] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T21:05:25.036191] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-19T21:05:25.443262] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-19T21:05:26.243266] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-19T21:05:26.809901] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T21:05:27.043320] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-19T21:05:27.320927] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T21:05:27.499048] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-19T21:05:27.843284] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-19T21:05:28.588320] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T21:05:28.643253] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-19T21:05:29.443296] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-19T21:05:30.050216] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T21:05:30.243286] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-19T21:05:30.604183] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T21:05:30.949037] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T21:05:31.043253] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-19T21:05:31.843340] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-19T21:05:32.643373] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-19T21:05:32.828805] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T21:05:32.837748] [INFO ] [REMOTE ] RWT: Full fetch complete (58468 records). [2025-09-19T21:05:32.837904] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-19T21:05:33.250786] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-19T21:05:33.250927] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-19T21:05:33.252207] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-19T21:05:33.252339] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-19T21:05:33.254061] [DEBUG] [LOCAL ] RWT: Trimmed 58468 records to 41133 (keeping 200 days of data) [2025-09-19T21:05:33.367217] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T21:05:33.475924] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-19T21:05:33.521902] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T21:05:33.564419] [DEBUG] [LOCAL ] RWT: Primary data saved (41133 records). [2025-09-19T21:05:33.564549] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-19T21:05:33.564629] [INFO ] [MAIN ] Update Progress: 1846/2372 symbols completed. RWT took 38.8s. Estimated remaining: 1h 9m 57s. Rate: 7.5 symbols/min [2025-09-19T21:05:33.735211] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:05:33.781843] [DEBUG] [LOCAL ] RXO: Loaded 48105 existing records from primary storage. [2025-09-19T21:05:33.781993] [INFO ] [MAIN ] RXO: Loaded 48105 existing records. [2025-09-19T21:05:33.959290] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:05:33.959550] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-19T21:05:33.959597] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-19T21:05:33.961145] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-19T21:05:33.961207] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-19T21:05:34.248396] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-19T21:05:34.320520] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:05:34.774455] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-19T21:05:35.043265] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-19T21:05:35.314930] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T21:05:35.322134] [INFO ] [REMOTE ] RVTY: Full fetch complete (66373 records). [2025-09-19T21:05:35.322293] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-19T21:05:35.665724] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T21:05:35.734384] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-19T21:05:35.734477] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-19T21:05:35.735486] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-19T21:05:35.735564] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-19T21:05:35.737206] [DEBUG] [LOCAL ] RVTY: Trimmed 66373 records to 48310 (keeping 200 days of data) [2025-09-19T21:05:35.846153] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-19T21:05:36.060978] [DEBUG] [LOCAL ] RVTY: Primary data saved (48310 records). [2025-09-19T21:05:36.061136] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-19T21:05:36.061241] [INFO ] [MAIN ] Update Progress: 1847/2372 symbols completed. RVTY took 42.8s. Estimated remaining: 1h 9m 47s. Rate: 7.5 symbols/min [2025-09-19T21:05:36.271426] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:05:36.306893] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-19T21:05:36.325850] [DEBUG] [LOCAL ] RY: Loaded 48378 existing records from primary storage. [2025-09-19T21:05:36.325996] [INFO ] [MAIN ] RY: Loaded 48378 existing records. [2025-09-19T21:05:36.503011] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:05:36.503304] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-19T21:05:36.503371] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-19T21:05:36.504678] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-19T21:05:36.504740] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-19T21:05:36.653455] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-19T21:05:36.867757] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:05:37.366266] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-19T21:05:37.443259] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-19T21:05:38.230539] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T21:05:38.231931] [INFO ] [REMOTE ] RWTO: Full fetch complete (4720 records). [2025-09-19T21:05:38.232002] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-19T21:05:38.252586] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-19T21:05:38.422298] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T21:05:38.422548] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:05:38.422618] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:05:38.422712] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-19T21:05:38.422776] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-19T21:05:38.422811] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-19T21:05:38.422850] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-19T21:05:38.422908] [INFO ] [MAIN ] Update Progress: 1848/2372 symbols completed. RWTO took 23.3s. Estimated remaining: 1h 9m 38s. Rate: 7.5 symbols/min [2025-09-19T21:05:38.589868] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:05:38.633260] [DEBUG] [LOCAL ] RYAM: Loaded 35504 existing records from primary storage. [2025-09-19T21:05:38.633403] [INFO ] [MAIN ] RYAM: Loaded 35504 existing records. [2025-09-19T21:05:38.810969] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:05:38.811210] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-19T21:05:38.811259] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-19T21:05:38.812667] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-19T21:05:38.812727] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-19T21:05:39.048943] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-19T21:05:39.177167] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:05:39.841623] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T21:05:39.843035] [INFO ] [REMOTE ] RWTP: Full fetch complete (4371 records). [2025-09-19T21:05:39.843129] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-19T21:05:39.854722] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-19T21:05:40.027294] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 161 unique days, need 200 days [2025-09-19T21:05:40.027501] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:05:40.027585] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:05:40.027691] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-19T21:05:40.027767] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-19T21:05:40.027804] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-19T21:05:40.027842] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-19T21:05:40.027899] [INFO ] [MAIN ] Update Progress: 1849/2372 symbols completed. RWTP took 24.0s. Estimated remaining: 1h 9m 28s. Rate: 7.5 symbols/min [2025-09-19T21:05:40.200428] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:05:40.228100] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T21:05:40.281539] [DEBUG] [LOCAL ] RYAN: Loaded 44329 existing records from primary storage. [2025-09-19T21:05:40.281725] [INFO ] [MAIN ] RYAN: Loaded 44329 existing records. [2025-09-19T21:05:40.463777] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:05:40.464074] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-19T21:05:40.464133] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-19T21:05:40.465368] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-19T21:05:40.465430] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-19T21:05:40.654304] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-19T21:05:40.825862] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:05:41.443276] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-19T21:05:41.659772] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T21:05:42.243307] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-19T21:05:42.699186] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T21:05:43.043276] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-19T21:05:43.633949] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T21:05:43.665222] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T21:05:43.843320] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-19T21:05:44.643301] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-19T21:05:44.956437] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T21:05:45.443325] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-19T21:05:45.807951] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T21:05:45.911803] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T21:05:46.243271] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-19T21:05:46.818270] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T21:05:47.043341] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-19T21:05:47.843266] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-19T21:05:48.096604] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T21:05:48.612926] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T21:05:48.643218] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-19T21:05:49.338791] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T21:05:49.443213] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-19T21:05:50.243287] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-19T21:05:50.825861] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T21:05:50.905256] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T21:05:51.043313] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-19T21:05:51.843280] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-19T21:05:52.118557] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T21:05:52.643334] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-19T21:05:52.897116] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T21:05:53.128550] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T21:05:53.443264] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-19T21:05:54.243282] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-19T21:05:54.620188] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T21:05:55.043276] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-19T21:05:55.652889] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T21:05:55.843281] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-19T21:05:56.030785] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T21:05:56.643271] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-19T21:05:57.010808] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T21:05:57.187375] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T21:05:57.443316] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-19T21:05:58.195629] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T21:05:58.243231] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-19T21:05:59.043283] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-19T21:05:59.135227] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T21:05:59.843337] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-19T21:06:00.336970] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T21:06:00.643295] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-19T21:06:00.738176] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T21:06:01.443276] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-19T21:06:01.929361] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T21:06:02.243273] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-19T21:06:03.043299] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-19T21:06:03.202005] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-19T21:06:03.843326] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-19T21:06:04.101768] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-19T21:06:04.643261] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-19T21:06:04.857929] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T21:06:04.888343] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T21:06:05.443331] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-19T21:06:05.839001] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T21:06:05.845980] [INFO ] [REMOTE ] RY: Full fetch complete (68536 records). [2025-09-19T21:06:05.846101] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-19T21:06:06.245516] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-19T21:06:06.245289] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-19T21:06:06.245859] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-19T21:06:06.248368] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-19T21:06:06.248550] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-19T21:06:06.250540] [DEBUG] [LOCAL ] RY: Trimmed 68536 records to 48722 (keeping 200 days of data) [2025-09-19T21:06:06.548885] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T21:06:06.618361] [DEBUG] [LOCAL ] RY: Primary data saved (48722 records). [2025-09-19T21:06:06.618530] [INFO ] [MAIN ] RY: Full history saved. [2025-09-19T21:06:06.619521] [INFO ] [MAIN ] Update Progress: 1850/2372 symbols completed. RY took 30.6s. Estimated remaining: 1h 9m 25s. Rate: 7.5 symbols/min [2025-09-19T21:06:06.812987] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:06:06.840091] [DEBUG] [LOCAL ] RYI: Loaded 21745 existing records from primary storage. [2025-09-19T21:06:06.840249] [INFO ] [MAIN ] RYI: Loaded 21745 existing records. [2025-09-19T21:06:07.025072] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:06:07.025367] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-19T21:06:07.025429] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-19T21:06:07.026151] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-19T21:06:07.026211] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-19T21:06:07.064076] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-19T21:06:07.422815] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:06:07.532767] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T21:06:07.598564] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T21:06:07.843265] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-19T21:06:08.643247] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-19T21:06:09.053776] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T21:06:09.064209] [INFO ] [REMOTE ] RYAN: Full fetch complete (63323 records). [2025-09-19T21:06:09.064320] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-19T21:06:09.450502] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-19T21:06:09.455060] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-19T21:06:09.460454] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-19T21:06:09.470932] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T21:06:09.469630] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-19T21:06:09.471089] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-19T21:06:09.478322] [DEBUG] [LOCAL ] RYAN: Trimmed 63323 records to 44703 (keeping 200 days of data) [2025-09-19T21:06:09.764134] [DEBUG] [LOCAL ] RYAN: Primary data saved (44703 records). [2025-09-19T21:06:09.764308] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-19T21:06:09.764409] [INFO ] [MAIN ] Update Progress: 1851/2372 symbols completed. RYAN took 29.7s. Estimated remaining: 1h 9m 16s. Rate: 7.5 symbols/min [2025-09-19T21:06:09.967306] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:06:10.011987] [DEBUG] [LOCAL ] RYN: Loaded 46202 existing records from primary storage. [2025-09-19T21:06:10.012174] [INFO ] [MAIN ] RYN: Loaded 46202 existing records. [2025-09-19T21:06:10.195189] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:06:10.195688] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-19T21:06:10.195768] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-19T21:06:10.197239] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-19T21:06:10.197305] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-19T21:06:10.248377] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-19T21:06:10.537189] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T21:06:10.640698] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:06:10.676426] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T21:06:11.043291] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-19T21:06:11.300819] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T21:06:11.843264] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-19T21:06:12.643341] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-19T21:06:12.837720] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T21:06:13.443278] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-19T21:06:14.141989] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-19T21:06:14.243336] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-19T21:06:15.043259] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-19T21:06:15.887426] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T21:06:15.893147] [INFO ] [REMOTE ] RYAM: Full fetch complete (48631 records). [2025-09-19T21:06:15.893255] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-19T21:06:16.295837] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-19T21:06:16.296147] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-19T21:06:16.297416] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-19T21:06:16.297578] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-19T21:06:16.320611] [DEBUG] [LOCAL ] RYAM: Trimmed 48631 records to 35771 (keeping 200 days of data) [2025-09-19T21:06:16.321965] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-09-19T21:06:16.332191] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-19T21:06:16.447350] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (3.80 seconds). [2025-09-19T21:06:16.459989] [INFO ] [REMOTE ] RXO: Full fetch complete (67807 records). [2025-09-19T21:06:16.461374] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-19T21:06:16.915523] [DEBUG] [LOCAL ] RYAM: Primary data saved (35771 records). [2025-09-19T21:06:16.938007] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-19T21:06:16.945686] [INFO ] [MAIN ] Update Progress: 1852/2372 symbols completed. RYAM took 38.5s. Estimated remaining: 1h 9m 8s. Rate: 7.5 symbols/min [2025-09-19T21:06:16.955693] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T21:06:17.026958] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-19T21:06:17.223488] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-19T21:06:17.230056] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-19T21:06:17.237054] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-19T21:06:17.237948] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-19T21:06:17.257255] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:06:17.258381] [DEBUG] [LOCAL ] RXO: Trimmed 67807 records to 48495 (keeping 200 days of data) [2025-09-19T21:06:17.347419] [DEBUG] [LOCAL ] RZB: Loaded 6390 existing records from primary storage. [2025-09-19T21:06:17.349297] [INFO ] [MAIN ] RZB: Loaded 6390 existing records. [2025-09-19T21:06:17.538196] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:06:17.540268] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-19T21:06:17.540685] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-19T21:06:17.541789] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-19T21:06:17.542137] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-19T21:06:18.036728] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:06:18.037577] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-19T21:06:18.117320] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T21:06:18.138488] [DEBUG] [LOCAL ] RXO: Primary data saved (48495 records). [2025-09-19T21:06:18.138673] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-19T21:06:18.138797] [INFO ] [MAIN ] Update Progress: 1853/2372 symbols completed. RXO took 44.6s. Estimated remaining: 1h 8m 58s. Rate: 7.5 symbols/min [2025-09-19T21:06:18.243313] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-19T21:06:18.318868] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:06:18.352872] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T21:06:18.353151] [DEBUG] [LOCAL ] RZC: Loaded 6915 existing records from primary storage. [2025-09-19T21:06:18.362365] [INFO ] [MAIN ] RZC: Loaded 6915 existing records. [2025-09-19T21:06:18.541035] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:06:18.541313] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-19T21:06:18.541362] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-19T21:06:18.541725] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-19T21:06:18.541786] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-19T21:06:18.676682] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-19T21:06:18.929196] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:06:19.043273] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-19T21:06:19.608339] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T21:06:19.843226] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-19T21:06:20.276479] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T21:06:20.643239] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-19T21:06:21.150054] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T21:06:21.168202] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T21:06:21.443271] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-19T21:06:22.243273] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-19T21:06:22.431179] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T21:06:23.043260] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-19T21:06:23.511972] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T21:06:23.843270] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-19T21:06:24.044068] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T21:06:24.643246] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-19T21:06:25.226788] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T21:06:25.307809] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T21:06:25.443270] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-19T21:06:26.243254] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-19T21:06:26.443461] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T21:06:27.043261] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-19T21:06:27.069274] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T21:06:27.843272] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-19T21:06:27.974587] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T21:06:28.643266] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-19T21:06:29.170423] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T21:06:29.443256] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-19T21:06:29.595518] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T21:06:30.243284] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-19T21:06:30.813480] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T21:06:30.817452] [INFO ] [REMOTE ] RYI: Full fetch complete (32371 records). [2025-09-19T21:06:30.817545] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-19T21:06:31.048527] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-19T21:06:31.221529] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-19T21:06:31.221616] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-19T21:06:31.222350] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-19T21:06:31.222410] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-19T21:06:31.223227] [DEBUG] [LOCAL ] RYI: Trimmed 32371 records to 21926 (keeping 200 days of data) [2025-09-19T21:06:31.359760] [DEBUG] [LOCAL ] RYI: Primary data saved (21926 records). [2025-09-19T21:06:31.359898] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-19T21:06:31.359984] [INFO ] [MAIN ] Update Progress: 1854/2372 symbols completed. RYI took 24.7s. Estimated remaining: 1h 8m 51s. Rate: 7.5 symbols/min [2025-09-19T21:06:31.532751] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:06:31.591028] [DEBUG] [LOCAL ] S: Loaded 53934 existing records from primary storage. [2025-09-19T21:06:31.591182] [INFO ] [MAIN ] S: Loaded 53934 existing records. [2025-09-19T21:06:31.775953] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:06:31.776463] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-19T21:06:31.776549] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-19T21:06:31.778438] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-19T21:06:31.778595] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-19T21:06:31.854536] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-19T21:06:31.934229] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T21:06:32.034189] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T21:06:32.210935] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:06:32.643264] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-19T21:06:32.891578] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T21:06:33.108073] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-19T21:06:33.443313] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-19T21:06:34.243270] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-19T21:06:35.043274] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-19T21:06:35.291005] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T21:06:35.843338] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-19T21:06:36.540958] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T21:06:36.643248] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-19T21:06:36.996245] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-19T21:06:37.057114] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T21:06:37.443294] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-19T21:06:37.916625] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-19T21:06:38.118157] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T21:06:38.243295] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-19T21:06:38.986185] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T21:06:39.043305] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-19T21:06:39.823390] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-19T21:06:39.824965] [INFO ] [REMOTE ] RZC: Full fetch complete (9926 records). [2025-09-19T21:06:39.825042] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-19T21:06:39.853867] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-19T21:06:40.189125] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-19T21:06:40.189207] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-19T21:06:40.189476] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-19T21:06:40.189538] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-19T21:06:40.190027] [DEBUG] [LOCAL ] RZC: Trimmed 9926 records to 6940 (keeping 200 days of data) [2025-09-19T21:06:40.231594] [DEBUG] [LOCAL ] RZC: Primary data saved (6940 records). [2025-09-19T21:06:40.231736] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-19T21:06:40.231831] [INFO ] [MAIN ] Update Progress: 1855/2372 symbols completed. RZC took 22.1s. Estimated remaining: 1h 8m 44s. Rate: 7.5 symbols/min [2025-09-19T21:06:40.416531] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:06:40.459194] [DEBUG] [LOCAL ] SA: Loaded 43277 existing records from primary storage. [2025-09-19T21:06:40.459382] [INFO ] [MAIN ] SA: Loaded 43277 existing records. [2025-09-19T21:06:40.640546] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:06:40.640953] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-19T21:06:40.641011] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-19T21:06:40.642234] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-19T21:06:40.642297] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-19T21:06:40.653405] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-19T21:06:41.009294] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:06:41.211570] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T21:06:41.443264] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-19T21:06:42.243275] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-19T21:06:43.043300] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-19T21:06:43.189664] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T21:06:43.219081] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-19T21:06:43.671824] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-19T21:06:43.843260] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-19T21:06:44.225625] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T21:06:44.597154] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T21:06:44.598489] [INFO ] [REMOTE ] RZB: Full fetch complete (8837 records). [2025-09-19T21:06:44.598573] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-19T21:06:44.648362] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-19T21:06:44.985611] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-19T21:06:44.985773] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-19T21:06:44.986159] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-19T21:06:44.986233] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-19T21:06:44.986800] [DEBUG] [LOCAL ] RZB: Trimmed 8837 records to 6406 (keeping 200 days of data) [2025-09-19T21:06:45.025083] [DEBUG] [LOCAL ] RZB: Primary data saved (6406 records). [2025-09-19T21:06:45.025174] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-19T21:06:45.025255] [INFO ] [MAIN ] Update Progress: 1856/2372 symbols completed. RZB took 28.1s. Estimated remaining: 1h 8m 35s. Rate: 7.5 symbols/min [2025-09-19T21:06:45.192901] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:06:45.202867] [DEBUG] [LOCAL ] SABA: Loaded 9484 existing records from primary storage. [2025-09-19T21:06:45.202967] [INFO ] [MAIN ] SABA: Loaded 9484 existing records. [2025-09-19T21:06:45.377139] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:06:45.377418] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-19T21:06:45.377466] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-19T21:06:45.377962] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-19T21:06:45.378023] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-19T21:06:45.450622] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-19T21:06:45.729746] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:06:46.243244] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-19T21:06:46.550525] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T21:06:46.708509] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-19T21:06:46.715251] [INFO ] [REMOTE ] RYN: Full fetch complete (64541 records). [2025-09-19T21:06:46.715355] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-19T21:06:47.052842] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-19T21:06:47.097992] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-19T21:06:47.098065] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-19T21:06:47.099022] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-19T21:06:47.099085] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-19T21:06:47.100362] [DEBUG] [LOCAL ] RYN: Trimmed 64541 records to 46475 (keeping 200 days of data) [2025-09-19T21:06:47.387475] [DEBUG] [LOCAL ] RYN: Primary data saved (46475 records). [2025-09-19T21:06:47.387609] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-19T21:06:47.387732] [INFO ] [MAIN ] Update Progress: 1857/2372 symbols completed. RYN took 37.6s. Estimated remaining: 1h 8m 25s. Rate: 7.5 symbols/min [2025-09-19T21:06:47.559964] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:06:47.593408] [DEBUG] [LOCAL ] SAFE: Loaded 30726 existing records from primary storage. [2025-09-19T21:06:47.593538] [INFO ] [MAIN ] SAFE: Loaded 30726 existing records. [2025-09-19T21:06:47.768031] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:06:47.768331] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-19T21:06:47.768392] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-19T21:06:47.769739] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-19T21:06:47.769807] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-19T21:06:47.848380] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-19T21:06:48.126874] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:06:48.548403] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T21:06:48.579972] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-19T21:06:48.643235] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-19T21:06:48.970119] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T21:06:49.443269] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-19T21:06:50.166321] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T21:06:50.243251] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-19T21:06:51.043280] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-19T21:06:51.266079] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T21:06:51.800068] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-19T21:06:51.843230] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-19T21:06:52.305395] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T21:06:52.643280] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-19T21:06:53.443312] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-19T21:06:54.188240] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-19T21:06:54.243213] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-19T21:06:54.615781] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T21:06:55.043259] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-19T21:06:55.205160] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T21:06:55.843317] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-19T21:06:56.440909] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T21:06:56.510708] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T21:06:56.643230] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-19T21:06:57.443315] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-19T21:06:57.510621] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T21:06:58.243249] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-19T21:06:58.498470] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T21:06:59.043286] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-19T21:06:59.141750] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T21:06:59.174244] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-19T21:06:59.843269] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-19T21:07:00.643284] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-19T21:07:00.903925] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T21:07:01.443266] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-19T21:07:01.556610] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T21:07:01.726005] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T21:07:02.243301] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-19T21:07:03.043262] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-19T21:07:03.309595] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T21:07:03.697908] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-19T21:07:03.843271] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-19T21:07:04.643259] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-19T21:07:04.825899] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-19T21:07:04.878410] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T21:07:05.443266] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-19T21:07:06.243248] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-19T21:07:06.334101] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-19T21:07:07.043331] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-19T21:07:07.231071] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T21:07:07.843354] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-19T21:07:08.018540] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-19T21:07:08.451125] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T21:07:08.643267] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-19T21:07:08.815958] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T21:07:09.443322] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-19T21:07:09.829006] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T21:07:10.243280] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-19T21:07:11.043268] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-19T21:07:11.218083] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T21:07:11.828511] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-19T21:07:11.836970] [INFO ] [REMOTE ] S: Full fetch complete (77556 records). [2025-09-19T21:07:11.837112] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-19T21:07:11.850053] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-19T21:07:12.293296] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-19T21:07:12.293387] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-19T21:07:12.294527] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-19T21:07:12.294604] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-19T21:07:12.299228] [DEBUG] [LOCAL ] S: Trimmed 77556 records to 54324 (keeping 200 days of data) [2025-09-19T21:07:12.432624] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T21:07:12.445850] [INFO ] [REMOTE ] SA: Full fetch complete (61560 records). [2025-09-19T21:07:12.447203] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-19T21:07:12.646406] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-19T21:07:12.970684] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-19T21:07:12.971118] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-19T21:07:12.972555] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-19T21:07:12.973416] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-19T21:07:12.981490] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T21:07:12.985896] [INFO ] [REMOTE ] SABA: Full fetch complete (15508 records). [2025-09-19T21:07:12.986142] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-19T21:07:12.987396] [DEBUG] [LOCAL ] SA: Trimmed 61560 records to 43662 (keeping 200 days of data) [2025-09-19T21:07:13.506204] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-19T21:07:13.507021] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-19T21:07:13.510939] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-19T21:07:13.511678] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-19T21:07:13.516333] [DEBUG] [LOCAL ] SABA: Trimmed 15508 records to 9519 (keeping 200 days of data) [2025-09-19T21:07:13.753551] [DEBUG] [LOCAL ] SABA: Primary data saved (9519 records). [2025-09-19T21:07:13.755260] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-19T21:07:13.756354] [INFO ] [MAIN ] Update Progress: 1858/2372 symbols completed. SABA took 28.7s. Estimated remaining: 1h 8m 22s. Rate: 7.5 symbols/min [2025-09-19T21:07:13.965238] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:07:14.003379] [DEBUG] [LOCAL ] SAH: Loaded 22501 existing records from primary storage. [2025-09-19T21:07:14.006221] [DEBUG] [LOCAL ] S: Primary data saved (54324 records). [2025-09-19T21:07:14.006345] [INFO ] [MAIN ] SAH: Loaded 22501 existing records. [2025-09-19T21:07:14.018198] [INFO ] [MAIN ] S: Full history saved. [2025-09-19T21:07:14.038505] [INFO ] [MAIN ] Update Progress: 1859/2372 symbols completed. S took 42.7s. Estimated remaining: 1h 8m 12s. Rate: 7.5 symbols/min [2025-09-19T21:07:14.378548] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:07:14.378390] [DEBUG] [LOCAL ] SA: Primary data saved (43662 records). [2025-09-19T21:07:14.406773] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-19T21:07:14.409522] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-19T21:07:14.427624] [INFO ] [MAIN ] SA: Full history saved. [2025-09-19T21:07:14.427529] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:07:14.427799] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-19T21:07:14.428336] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-19T21:07:14.428036] [INFO ] [MAIN ] Update Progress: 1860/2372 symbols completed. SA took 34.2s. Estimated remaining: 1h 8m 2s. Rate: 7.5 symbols/min [2025-09-19T21:07:14.428234] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-19T21:07:14.428672] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-19T21:07:14.455275] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-19T21:07:14.471318] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-19T21:07:14.506995] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-19T21:07:14.582900] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-19T21:07:14.624465] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T21:07:14.787611] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-19T21:07:14.974027] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:07:15.373284] [DEBUG] [LOCAL ] SAM: Loaded 21867 existing records from primary storage. [2025-09-19T21:07:15.372182] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:07:15.373795] [INFO ] [MAIN ] SAM: Loaded 21867 existing records. [2025-09-19T21:07:15.374216] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-19T21:07:15.580492] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:07:15.591156] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-19T21:07:15.656617] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:07:15.656927] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-19T21:07:15.656986] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-19T21:07:15.657736] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-19T21:07:15.657806] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-19T21:07:16.031866] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:07:16.032231] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-19T21:07:16.194288] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-19T21:07:16.643329] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-19T21:07:16.786958] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T21:07:16.804194] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T21:07:17.116257] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T21:07:17.142714] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T21:07:17.443294] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-19T21:07:18.243282] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-19T21:07:18.758715] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T21:07:19.043273] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-19T21:07:19.843226] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-19T21:07:19.932838] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T21:07:19.940231] [INFO ] [REMOTE ] SAFE: Full fetch complete (44985 records). [2025-09-19T21:07:19.940369] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-19T21:07:20.316360] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-19T21:07:20.316486] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-19T21:07:20.317365] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-19T21:07:20.317428] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-19T21:07:20.318967] [DEBUG] [LOCAL ] SAFE: Trimmed 44985 records to 30915 (keeping 200 days of data) [2025-09-19T21:07:20.440466] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T21:07:20.542839] [DEBUG] [LOCAL ] SAFE: Primary data saved (30915 records). [2025-09-19T21:07:20.542981] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-19T21:07:20.543105] [INFO ] [MAIN ] Update Progress: 1861/2372 symbols completed. SAFE took 33.2s. Estimated remaining: 1h 7m 54s. Rate: 7.5 symbols/min [2025-09-19T21:07:20.646614] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-19T21:07:20.719712] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:07:20.784791] [DEBUG] [LOCAL ] SAN: Loaded 53427 existing records from primary storage. [2025-09-19T21:07:20.784949] [INFO ] [MAIN ] SAN: Loaded 53427 existing records. [2025-09-19T21:07:20.962864] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:07:20.963097] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-19T21:07:20.963145] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-19T21:07:20.964484] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-19T21:07:20.964546] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-19T21:07:21.221207] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T21:07:21.341793] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:07:21.355992] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T21:07:21.443264] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-19T21:07:22.243294] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-19T21:07:22.361972] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T21:07:23.043285] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-19T21:07:23.843281] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-19T21:07:23.950222] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T21:07:24.534257] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T21:07:24.643229] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-19T21:07:25.370520] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T21:07:25.443314] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-19T21:07:25.922215] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-19T21:07:26.016809] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T21:07:26.243317] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-19T21:07:27.043278] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-19T21:07:27.396405] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-19T21:07:27.471117] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T21:07:27.843283] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-19T21:07:28.643281] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-19T21:07:29.081001] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T21:07:29.443279] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-19T21:07:30.243318] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-19T21:07:30.868771] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T21:07:30.950578] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T21:07:31.043258] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-19T21:07:31.771299] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T21:07:31.791391] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T21:07:31.843228] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-19T21:07:32.643273] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-19T21:07:33.202460] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T21:07:33.443335] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-19T21:07:33.676262] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T21:07:33.858599] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-19T21:07:34.243290] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-19T21:07:35.043270] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-19T21:07:35.329842] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T21:07:35.843314] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-19T21:07:35.896687] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T21:07:36.643279] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-19T21:07:36.723380] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T21:07:37.443349] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-19T21:07:38.243315] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-19T21:07:38.363587] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T21:07:38.367540] [INFO ] [REMOTE ] SAM: Full fetch complete (30176 records). [2025-09-19T21:07:38.367627] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-19T21:07:38.753550] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-19T21:07:38.786052] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-19T21:07:38.786264] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-19T21:07:38.787080] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-19T21:07:38.787163] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-19T21:07:38.788306] [DEBUG] [LOCAL ] SAM: Trimmed 30176 records to 22014 (keeping 200 days of data) [2025-09-19T21:07:38.817374] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T21:07:38.964081] [DEBUG] [LOCAL ] SAM: Primary data saved (22014 records). [2025-09-19T21:07:38.964230] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-19T21:07:38.964319] [INFO ] [MAIN ] Update Progress: 1862/2372 symbols completed. SAM took 24.5s. Estimated remaining: 1h 7m 49s. Rate: 7.5 symbols/min [2025-09-19T21:07:39.048454] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-19T21:07:39.187303] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:07:39.244285] [DEBUG] [LOCAL ] SAND: Loaded 52120 existing records from primary storage. [2025-09-19T21:07:39.244481] [INFO ] [MAIN ] SAND: Loaded 52120 existing records. [2025-09-19T21:07:39.429064] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:07:39.430705] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-19T21:07:39.430925] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-19T21:07:39.433177] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-19T21:07:39.433242] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-19T21:07:39.805722] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:07:39.843225] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-19T21:07:39.926108] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T21:07:40.643312] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-19T21:07:41.052906] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-19T21:07:41.053632] [INFO ] [REMOTE ] SAJ: Full fetch complete (965 records). [2025-09-19T21:07:41.053749] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-19T21:07:41.229982] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-19T21:07:41.230190] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:07:41.230237] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:07:41.230308] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-19T21:07:41.230370] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-19T21:07:41.230405] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-19T21:07:41.230460] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-19T21:07:41.230539] [INFO ] [MAIN ] Update Progress: 1863/2372 symbols completed. SAJ took 27.2s. Estimated remaining: 1h 7m 39s. Rate: 7.5 symbols/min [2025-09-19T21:07:41.407548] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:07:41.440343] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T21:07:41.449923] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-19T21:07:41.504126] [DEBUG] [LOCAL ] SAP: Loaded 50481 existing records from primary storage. [2025-09-19T21:07:41.504283] [INFO ] [MAIN ] SAP: Loaded 50481 existing records. [2025-09-19T21:07:41.676944] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:07:41.677172] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-19T21:07:41.677228] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-19T21:07:41.678335] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-19T21:07:41.678395] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-19T21:07:42.035079] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:07:42.243297] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-19T21:07:42.978423] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T21:07:42.981818] [INFO ] [REMOTE ] SAH: Full fetch complete (30364 records). [2025-09-19T21:07:42.981922] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-19T21:07:43.044064] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-19T21:07:43.377963] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-19T21:07:43.378043] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-19T21:07:43.378590] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-19T21:07:43.378628] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-19T21:07:43.379379] [DEBUG] [LOCAL ] SAH: Trimmed 30364 records to 22598 (keeping 200 days of data) [2025-09-19T21:07:43.535806] [DEBUG] [LOCAL ] SAH: Primary data saved (22598 records). [2025-09-19T21:07:43.535962] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-19T21:07:43.536061] [INFO ] [MAIN ] Update Progress: 1864/2372 symbols completed. SAH took 29.8s. Estimated remaining: 1h 7m 30s. Rate: 7.5 symbols/min [2025-09-19T21:07:43.711280] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:07:43.711586] [DEBUG] [LOCAL ] SAR: No existing data file found in primary storage. [2025-09-19T21:07:43.711724] [WARN ] [MAIN ] SAR: No existing data found, performing full refresh instead. [2025-09-19T21:07:43.712058] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-19T21:07:43.712181] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-19T21:07:43.712334] [DEBUG] [LOCAL ] SAR: No primary data file found to delete. [2025-09-19T21:07:43.712405] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-19T21:07:43.852259] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-19T21:07:44.025229] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-19T21:07:44.121687] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:07:44.552728] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T21:07:44.643278] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-19T21:07:45.443273] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-19T21:07:45.656874] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T21:07:45.958024] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T21:07:46.243273] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-19T21:07:47.043266] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-19T21:07:47.320324] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T21:07:47.749401] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T21:07:47.843260] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-19T21:07:48.213205] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T21:07:48.643273] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-19T21:07:49.443256] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-19T21:07:49.903028] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T21:07:49.942534] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T21:07:50.243316] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-19T21:07:50.963088] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T21:07:51.043244] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-19T21:07:51.843278] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-19T21:07:52.385910] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T21:07:52.643277] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-19T21:07:53.320490] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-19T21:07:53.443316] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-19T21:07:53.944137] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T21:07:54.019770] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T21:07:54.243258] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-19T21:07:55.043296] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-19T21:07:55.494496] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T21:07:55.750368] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T21:07:55.843270] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-19T21:07:56.643248] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-19T21:07:57.085472] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T21:07:57.148598] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-19T21:07:57.443261] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-19T21:07:58.243275] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-19T21:07:58.490146] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T21:07:59.043229] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-19T21:07:59.103480] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T21:07:59.843341] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-19T21:07:59.896711] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T21:08:00.643331] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-19T21:08:01.062702] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T21:08:01.329210] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-19T21:08:01.443371] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-19T21:08:02.243258] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-19T21:08:02.430115] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T21:08:03.043305] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-19T21:08:03.769573] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T21:08:03.843305] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-19T21:08:03.914495] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T21:08:04.643276] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-19T21:08:05.130294] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-19T21:08:05.138904] [INFO ] [REMOTE ] SAN: Full fetch complete (76149 records). [2025-09-19T21:08:05.139124] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-19T21:08:05.448583] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-19T21:08:05.549314] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-19T21:08:05.549477] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-19T21:08:05.550737] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-19T21:08:05.550875] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-19T21:08:05.565326] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T21:08:05.570829] [DEBUG] [LOCAL ] SAN: Trimmed 76149 records to 53804 (keeping 200 days of data) [2025-09-19T21:08:05.891469] [DEBUG] [LOCAL ] SAN: Primary data saved (53804 records). [2025-09-19T21:08:05.891636] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-19T21:08:05.891777] [INFO ] [MAIN ] Update Progress: 1865/2372 symbols completed. SAN took 45.3s. Estimated remaining: 1h 7m 26s. Rate: 7.5 symbols/min [2025-09-19T21:08:06.062316] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:08:06.107201] [DEBUG] [LOCAL ] SARO: Loaded 49159 existing records from primary storage. [2025-09-19T21:08:06.107355] [INFO ] [MAIN ] SARO: Loaded 49159 existing records. [2025-09-19T21:08:06.249295] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-19T21:08:06.293522] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:08:06.293837] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-19T21:08:06.293906] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-19T21:08:06.295215] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-19T21:08:06.295278] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-19T21:08:06.652828] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:08:06.943169] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T21:08:07.043293] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-19T21:08:07.506918] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T21:08:07.516368] [INFO ] [REMOTE ] SAND: Full fetch complete (74234 records). [2025-09-19T21:08:07.516676] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-19T21:08:07.845163] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-19T21:08:07.954488] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T21:08:07.959282] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-19T21:08:07.959509] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-19T21:08:07.961268] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-19T21:08:07.961341] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-19T21:08:07.962919] [DEBUG] [LOCAL ] SAND: Trimmed 74234 records to 52509 (keeping 200 days of data) [2025-09-19T21:08:08.283052] [DEBUG] [LOCAL ] SAND: Primary data saved (52509 records). [2025-09-19T21:08:08.283213] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-19T21:08:08.283301] [INFO ] [MAIN ] Update Progress: 1866/2372 symbols completed. SAND took 29.3s. Estimated remaining: 1h 7m 16s. Rate: 7.5 symbols/min [2025-09-19T21:08:08.456527] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:08:08.456760] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-19T21:08:08.456817] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-19T21:08:08.456980] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-19T21:08:08.457025] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-19T21:08:08.457074] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-19T21:08:08.457108] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-19T21:08:08.647244] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-19T21:08:08.828936] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:08:09.443328] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-19T21:08:10.292285] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T21:08:10.293397] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-19T21:08:10.793569] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-19T21:08:11.043314] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-19T21:08:11.549961] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-19T21:08:11.843311] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-19T21:08:12.356056] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T21:08:12.643323] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-19T21:08:13.264781] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-19T21:08:13.443260] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-19T21:08:13.614000] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (6.57 seconds). [2025-09-19T21:08:14.243323] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-19T21:08:16.087590] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (8.24 seconds). [2025-09-19T21:08:16.098676] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-19T21:08:16.432999] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-09-19T21:08:16.433942] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (7.79 seconds). [2025-09-19T21:08:16.434935] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-19T21:08:16.438802] [INFO ] [REMOTE ] SAR: Full fetch complete (22679 records). [2025-09-19T21:08:16.438887] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-19T21:08:16.820577] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-19T21:08:16.820861] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-19T21:08:16.821366] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-19T21:08:16.821503] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-19T21:08:16.822400] [DEBUG] [LOCAL ] SAR: Trimmed 22679 records to 16703 (keeping 200 days of data) [2025-09-19T21:08:16.930864] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-19T21:08:16.950052] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-19T21:08:16.968152] [DEBUG] [LOCAL ] SAR: Primary data saved (16703 records). [2025-09-19T21:08:16.968270] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-19T21:08:16.968348] [INFO ] [MAIN ] Update Progress: 1867/2372 symbols completed. SAR took 33.4s. Estimated remaining: 1h 7m 8s. Rate: 7.5 symbols/min [2025-09-19T21:08:17.060259] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-19T21:08:17.140604] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:08:17.140796] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-19T21:08:17.140842] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-19T21:08:17.141047] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-19T21:08:17.141105] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-19T21:08:17.141149] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-19T21:08:17.141182] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-19T21:08:17.448346] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-19T21:08:17.521136] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:08:18.042229] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T21:08:18.243285] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-19T21:08:18.403066] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-19T21:08:18.585596] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T21:08:18.630891] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-19T21:08:19.043293] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-19T21:08:19.843299] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-19T21:08:20.643278] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-19T21:08:20.754739] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T21:08:20.993980] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-19T21:08:21.443262] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-19T21:08:22.016884] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-19T21:08:22.024483] [INFO ] [REMOTE ] SAP: Full fetch complete (71573 records). [2025-09-19T21:08:22.024606] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-19T21:08:22.253101] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-19T21:08:22.420795] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-19T21:08:22.420916] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-19T21:08:22.422064] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-19T21:08:22.422133] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-19T21:08:22.423682] [DEBUG] [LOCAL ] SAP: Trimmed 71573 records to 50851 (keeping 200 days of data) [2025-09-19T21:08:22.740340] [DEBUG] [LOCAL ] SAP: Primary data saved (50851 records). [2025-09-19T21:08:22.740484] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-19T21:08:22.742285] [INFO ] [MAIN ] Update Progress: 1868/2372 symbols completed. SAP took 41.5s. Estimated remaining: 1h 6m 60s. Rate: 7.5 symbols/min [2025-09-19T21:08:22.840836] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-19T21:08:22.921193] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:08:22.921371] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-19T21:08:22.921426] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-19T21:08:22.921592] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-19T21:08:22.921636] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-19T21:08:22.921746] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-19T21:08:22.921802] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-19T21:08:23.048385] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-19T21:08:23.288277] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:08:23.576802] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-19T21:08:23.577546] [INFO ] [REMOTE ] SAT: Full fetch complete (1611 records). [2025-09-19T21:08:23.577614] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-19T21:08:23.762388] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-19T21:08:23.762682] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:08:23.762872] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:08:23.763095] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-19T21:08:23.763227] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-19T21:08:23.763367] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-19T21:08:23.763469] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-19T21:08:23.763822] [INFO ] [MAIN ] Update Progress: 1869/2372 symbols completed. SAT took 15.5s. Estimated remaining: 1h 6m 50s. Rate: 7.5 symbols/min [2025-09-19T21:08:23.843252] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-19T21:08:23.956961] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:08:23.987803] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-19T21:08:24.029678] [DEBUG] [LOCAL ] SB: Loaded 33925 existing records from primary storage. [2025-09-19T21:08:24.029841] [INFO ] [MAIN ] SB: Loaded 33925 existing records. [2025-09-19T21:08:24.222545] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:08:24.222847] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-19T21:08:24.222899] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-19T21:08:24.223868] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-19T21:08:24.223935] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-19T21:08:24.400240] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T21:08:24.600153] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:08:24.643211] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-19T21:08:25.443331] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-19T21:08:26.243289] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-19T21:08:26.621899] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T21:08:26.778526] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T21:08:27.043314] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-19T21:08:27.457243] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T21:08:27.493082] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-19T21:08:27.843277] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-19T21:08:28.643327] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-19T21:08:28.783794] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T21:08:29.443278] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-19T21:08:30.243322] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-19T21:08:30.326790] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T21:08:30.711739] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-19T21:08:31.043311] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-19T21:08:31.419835] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-19T21:08:31.715047] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-19T21:08:31.843267] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-19T21:08:32.643339] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-19T21:08:33.446224] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-19T21:08:33.450400] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T21:08:33.467852] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T21:08:33.942716] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T21:08:34.243280] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-19T21:08:34.874934] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-19T21:08:35.043270] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-19T21:08:35.639101] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T21:08:35.843264] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-19T21:08:36.338443] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-19T21:08:36.643276] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-19T21:08:37.443306] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-19T21:08:37.942033] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-19T21:08:38.243278] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-19T21:08:38.676725] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T21:08:38.975601] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T21:08:39.043274] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-19T21:08:39.534780] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-19T21:08:39.843240] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-19T21:08:40.285591] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T21:08:40.286373] [INFO ] [REMOTE ] SAZ: Full fetch complete (1817 records). [2025-09-19T21:08:40.286444] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-19T21:08:40.463218] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T21:08:40.463406] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:08:40.463482] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:08:40.463529] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-19T21:08:40.463584] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-19T21:08:40.463618] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-19T21:08:40.463725] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-19T21:08:40.463820] [INFO ] [MAIN ] Update Progress: 1870/2372 symbols completed. SAZ took 17.7s. Estimated remaining: 1h 6m 44s. Rate: 7.5 symbols/min [2025-09-19T21:08:40.640579] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:08:40.640788] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-19T21:08:40.640851] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-19T21:08:40.641063] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-19T21:08:40.641120] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-19T21:08:40.641174] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-19T21:08:40.641207] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-19T21:08:40.652246] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-19T21:08:41.000988] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:08:41.443290] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-19T21:08:42.243263] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-19T21:08:42.628559] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T21:08:42.902146] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T21:08:42.914791] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T21:08:43.043281] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-19T21:08:43.843289] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-19T21:08:44.643269] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-19T21:08:44.804151] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-19T21:08:44.812204] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:08:44.813303] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-19T21:08:45.443302] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-19T21:08:45.901921] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-19T21:08:46.243271] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-19T21:08:46.600370] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T21:08:46.607453] [INFO ] [REMOTE ] SARO: Full fetch complete (68871 records). [2025-09-19T21:08:46.607580] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-19T21:08:46.730240] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T21:08:46.741759] [INFO ] [REMOTE ] SAY: Full fetch complete (1460 records). [2025-09-19T21:08:46.760154] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-19T21:08:47.048497] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-19T21:08:47.143125] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-19T21:08:47.158590] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:08:47.163794] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:08:47.177587] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-19T21:08:47.189577] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-19T21:08:47.189693] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-19T21:08:47.196011] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-19T21:08:47.197104] [INFO ] [MAIN ] Update Progress: 1871/2372 symbols completed. SAY took 30.2s. Estimated remaining: 1h 6m 36s. Rate: 7.5 symbols/min [2025-09-19T21:08:47.296798] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-19T21:08:47.302321] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-19T21:08:47.314195] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-19T21:08:47.325082] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-19T21:08:47.388723] [DEBUG] [LOCAL ] SARO: Trimmed 68871 records to 49469 (keeping 200 days of data) [2025-09-19T21:08:47.409396] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:08:47.646350] [DEBUG] [LOCAL ] SBH: Loaded 50188 existing records from primary storage. [2025-09-19T21:08:47.648826] [INFO ] [MAIN ] SBH: Loaded 50188 existing records. [2025-09-19T21:08:47.844257] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-19T21:08:47.844739] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:08:47.846857] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-19T21:08:47.847179] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-19T21:08:47.848970] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-19T21:08:47.851708] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-19T21:08:48.172477] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:08:48.202490] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-19T21:08:48.233836] [DEBUG] [LOCAL ] SARO: Primary data saved (49469 records). [2025-09-19T21:08:48.247722] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-19T21:08:48.247845] [INFO ] [MAIN ] Update Progress: 1872/2372 symbols completed. SARO took 42.4s. Estimated remaining: 1h 6m 26s. Rate: 7.5 symbols/min [2025-09-19T21:08:48.360533] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:08:48.460532] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:08:48.469471] [DEBUG] [LOCAL ] SBI: Loaded 7844 existing records from primary storage. [2025-09-19T21:08:48.469574] [INFO ] [MAIN ] SBI: Loaded 7844 existing records. [2025-09-19T21:08:48.643252] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:08:48.643395] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-19T21:08:48.643976] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-19T21:08:48.645079] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-19T21:08:48.645556] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-19T21:08:48.645674] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-19T21:08:49.005576] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:08:49.027179] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T21:08:49.443291] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-19T21:08:50.019852] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T21:08:50.243316] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-19T21:08:50.719092] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-19T21:08:51.043266] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-19T21:08:51.843282] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-19T21:08:51.950981] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T21:08:52.136471] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:08:52.136857] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-19T21:08:52.591200] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T21:08:52.643268] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-19T21:08:53.443263] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-19T21:08:53.768105] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:08:53.768472] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-19T21:08:54.243305] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-19T21:08:54.679189] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T21:08:54.797045] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:08:54.797393] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-19T21:08:55.043254] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-19T21:08:55.843272] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-19T21:08:56.637534] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T21:08:56.648840] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-19T21:08:56.648787] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-19T21:08:57.443333] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-19T21:08:58.243326] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-19T21:08:58.279401] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T21:08:58.792777] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T21:08:59.043314] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-19T21:08:59.843322] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-19T21:08:59.923123] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T21:08:59.961121] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T21:09:00.643271] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-19T21:09:01.448866] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-19T21:09:01.453301] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T21:09:01.828798] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:09:01.829177] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-19T21:09:02.130595] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T21:09:02.243286] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-19T21:09:03.043271] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-19T21:09:03.831959] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:09:03.832291] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-19T21:09:03.843202] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-19T21:09:04.643262] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-19T21:09:04.937884] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T21:09:05.207182] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-09-19T21:09:05.443292] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-19T21:09:06.243326] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-19T21:09:06.326113] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T21:09:06.798364] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-19T21:09:07.043289] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-19T21:09:07.345717] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T21:09:07.843285] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-19T21:09:08.533040] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T21:09:08.537607] [INFO ] [REMOTE ] SB: Full fetch complete (50880 records). [2025-09-19T21:09:08.537748] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-19T21:09:08.648484] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-19T21:09:08.925564] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-19T21:09:08.925745] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-19T21:09:08.926703] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-19T21:09:08.926764] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-19T21:09:08.927872] [DEBUG] [LOCAL ] SB: Trimmed 50880 records to 34106 (keeping 200 days of data) [2025-09-19T21:09:09.128178] [DEBUG] [LOCAL ] SB: Primary data saved (34106 records). [2025-09-19T21:09:09.128334] [INFO ] [MAIN ] SB: Full history saved. [2025-09-19T21:09:09.128421] [INFO ] [MAIN ] Update Progress: 1873/2372 symbols completed. SB took 45.4s. Estimated remaining: 1h 6m 22s. Rate: 7.5 symbols/min [2025-09-19T21:09:09.300026] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:09:09.308691] [DEBUG] [LOCAL ] SBR: Loaded 7318 existing records from primary storage. [2025-09-19T21:09:09.308820] [INFO ] [MAIN ] SBR: Loaded 7318 existing records. [2025-09-19T21:09:09.448425] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-19T21:09:09.491031] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:09:09.492319] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-19T21:09:09.492432] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-19T21:09:09.498869] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-19T21:09:09.499109] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-19T21:09:09.498482] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T21:09:09.871824] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:09:09.907034] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T21:09:10.095135] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-19T21:09:10.243260] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-19T21:09:11.043310] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-19T21:09:11.568776] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T21:09:11.843325] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-19T21:09:12.129460] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T21:09:12.610513] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-19T21:09:12.611879] [INFO ] [REMOTE ] SBDS: Full fetch complete (1002 records). [2025-09-19T21:09:12.611957] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-19T21:09:12.648525] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-19T21:09:12.892068] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 41 unique days, need 200 days [2025-09-19T21:09:12.892332] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:09:12.892417] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:09:12.892502] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-19T21:09:12.892613] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-19T21:09:12.892709] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-19T21:09:12.892779] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-19T21:09:12.892863] [INFO ] [MAIN ] Update Progress: 1874/2372 symbols completed. SBDS took 32.4s. Estimated remaining: 1h 6m 12s. Rate: 7.5 symbols/min [2025-09-19T21:09:13.099827] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:09:13.175016] [DEBUG] [LOCAL ] SBS: Loaded 49756 existing records from primary storage. [2025-09-19T21:09:13.175243] [INFO ] [MAIN ] SBS: Loaded 49756 existing records. [2025-09-19T21:09:13.389243] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:09:13.389499] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-19T21:09:13.389549] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-19T21:09:13.390887] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-19T21:09:13.390958] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-19T21:09:13.449958] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-19T21:09:13.708168] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T21:09:13.785477] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:09:14.243260] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-19T21:09:14.479927] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T21:09:15.043255] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-19T21:09:15.843274] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-19T21:09:16.328336] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T21:09:16.643314] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-19T21:09:16.923009] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T21:09:17.443244] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-19T21:09:17.668183] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T21:09:17.671094] [INFO ] [REMOTE ] SBI: Full fetch complete (10717 records). [2025-09-19T21:09:17.671300] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-19T21:09:17.897917] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-09-19T21:09:18.140735] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-19T21:09:18.140864] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-19T21:09:18.141455] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-19T21:09:18.141521] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-19T21:09:18.142125] [DEBUG] [LOCAL ] SBI: Trimmed 10717 records to 7869 (keeping 200 days of data) [2025-09-19T21:09:18.198216] [DEBUG] [LOCAL ] SBI: Primary data saved (7869 records). [2025-09-19T21:09:18.198451] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-19T21:09:18.198629] [INFO ] [MAIN ] Update Progress: 1875/2372 symbols completed. SBI took 29.9s. Estimated remaining: 1h 6m 4s. Rate: 7.5 symbols/min [2025-09-19T21:09:18.244064] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-19T21:09:18.384243] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:09:18.403563] [DEBUG] [LOCAL ] SBSI: Loaded 14759 existing records from primary storage. [2025-09-19T21:09:18.403789] [INFO ] [MAIN ] SBSI: Loaded 14759 existing records. [2025-09-19T21:09:18.601041] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:09:18.601855] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-19T21:09:18.601947] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-19T21:09:18.609591] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T21:09:18.611849] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-19T21:09:18.612026] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-19T21:09:18.997739] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:09:19.043260] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-19T21:09:19.843297] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-19T21:09:20.281538] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T21:09:20.404829] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T21:09:20.419234] [INFO ] [REMOTE ] SBH: Full fetch complete (72792 records). [2025-09-19T21:09:20.419386] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-19T21:09:20.648507] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-19T21:09:20.823513] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-19T21:09:20.823707] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-19T21:09:20.824876] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-19T21:09:20.824983] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-19T21:09:20.826421] [DEBUG] [LOCAL ] SBH: Trimmed 72792 records to 50554 (keeping 200 days of data) [2025-09-19T21:09:21.136168] [DEBUG] [LOCAL ] SBH: Primary data saved (50554 records). [2025-09-19T21:09:21.136312] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-19T21:09:21.137258] [INFO ] [MAIN ] Update Progress: 1876/2372 symbols completed. SBH took 33.9s. Estimated remaining: 1h 5m 54s. Rate: 7.5 symbols/min [2025-09-19T21:09:21.309316] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:09:21.369777] [DEBUG] [LOCAL ] SBSW: Loaded 53305 existing records from primary storage. [2025-09-19T21:09:21.369949] [INFO ] [MAIN ] SBSW: Loaded 53305 existing records. [2025-09-19T21:09:21.452712] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-19T21:09:21.563753] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:09:21.564067] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-19T21:09:21.564137] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-19T21:09:21.565245] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-19T21:09:21.565327] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-19T21:09:21.897348] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T21:09:21.944578] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:09:21.972249] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T21:09:22.209434] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T21:09:22.243224] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-19T21:09:23.043258] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-19T21:09:23.252170] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T21:09:23.843275] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-19T21:09:23.861871] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T21:09:24.643263] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-19T21:09:25.159992] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T21:09:25.443300] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-19T21:09:26.243280] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-19T21:09:26.768735] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-19T21:09:27.043270] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-19T21:09:27.058584] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T21:09:27.415103] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T21:09:27.843265] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-19T21:09:28.643279] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-19T21:09:28.661471] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-19T21:09:29.187164] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T21:09:29.331067] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-19T21:09:29.443297] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-19T21:09:30.243320] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-19T21:09:30.514443] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T21:09:31.043274] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-19T21:09:31.778903] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T21:09:31.843276] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-19T21:09:32.138519] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T21:09:32.643293] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-19T21:09:33.443308] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-19T21:09:33.944426] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T21:09:34.206260] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T21:09:34.243275] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-19T21:09:34.609834] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T21:09:35.043312] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-19T21:09:35.843268] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-19T21:09:36.360952] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T21:09:36.643226] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-19T21:09:37.000389] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T21:09:37.423855] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T21:09:37.443224] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-19T21:09:38.139501] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T21:09:38.243221] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-19T21:09:39.043291] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-19T21:09:39.603134] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T21:09:39.708958] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T21:09:39.843257] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-19T21:09:40.082728] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T21:09:40.084573] [INFO ] [REMOTE ] SBR: Full fetch complete (10989 records). [2025-09-19T21:09:40.084753] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-19T21:09:40.444055] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-19T21:09:40.444138] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-19T21:09:40.444409] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-19T21:09:40.444469] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-19T21:09:40.445409] [DEBUG] [LOCAL ] SBR: Trimmed 10989 records to 7374 (keeping 200 days of data) [2025-09-19T21:09:40.497671] [DEBUG] [LOCAL ] SBR: Primary data saved (7374 records). [2025-09-19T21:09:40.497828] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-19T21:09:40.497954] [INFO ] [MAIN ] Update Progress: 1877/2372 symbols completed. SBR took 31.4s. Estimated remaining: 1h 5m 50s. Rate: 7.5 symbols/min [2025-09-19T21:09:40.643360] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-19T21:09:41.443250] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-19T21:09:41.720536] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T21:09:41.723546] [INFO ] [REMOTE ] SBSI: Full fetch complete (20976 records). [2025-09-19T21:09:41.723711] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-19T21:09:42.106634] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-19T21:09:42.106924] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-19T21:09:42.107633] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-19T21:09:42.129361] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-19T21:09:42.155102] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T21:09:42.153328] [DEBUG] [LOCAL ] SBSI: Trimmed 20976 records to 14897 (keeping 200 days of data) [2025-09-19T21:09:42.244938] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-19T21:09:42.275450] [DEBUG] [LOCAL ] SBSI: Primary data saved (14897 records). [2025-09-19T21:09:42.275670] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-19T21:09:42.275821] [INFO ] [MAIN ] Update Progress: 1878/2372 symbols completed. SBSI took 24.1s. Estimated remaining: 1h 5m 40s. Rate: 7.5 symbols/min [2025-09-19T21:09:44.078145] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-19T21:09:44.089286] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-19T21:09:44.412831] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T21:09:44.427421] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-19T21:09:45.791149] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T21:09:45.802702] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-19T21:09:46.424568] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T21:09:46.432175] [INFO ] [REMOTE ] SBS: Full fetch complete (70171 records). [2025-09-19T21:09:46.432334] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-19T21:09:46.824757] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-19T21:09:46.824963] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-19T21:09:46.825999] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-19T21:09:46.826060] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-19T21:09:46.828524] [DEBUG] [LOCAL ] SBS: Trimmed 70171 records to 50107 (keeping 200 days of data) [2025-09-19T21:09:47.147688] [DEBUG] [LOCAL ] SBS: Primary data saved (50107 records). [2025-09-19T21:09:47.147834] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-19T21:09:47.147966] [INFO ] [MAIN ] Update Progress: 1879/2372 symbols completed. SBS took 34.3s. Estimated remaining: 1h 5m 31s. Rate: 7.5 symbols/min [2025-09-19T21:09:48.276340] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-19T21:09:48.288442] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-19T21:09:50.532575] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-19T21:09:50.543994] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-19T21:09:52.733431] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T21:09:52.741684] [INFO ] [REMOTE ] SBSW: Full fetch complete (76438 records). [2025-09-19T21:09:52.741853] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-19T21:09:53.142859] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-19T21:09:53.142993] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-19T21:09:53.144098] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-19T21:09:53.144164] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-19T21:09:53.145794] [DEBUG] [LOCAL ] SBSW: Trimmed 76438 records to 53695 (keeping 200 days of data) [2025-09-19T21:09:53.464585] [DEBUG] [LOCAL ] SBSW: Primary data saved (53695 records). [2025-09-19T21:09:53.464760] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-19T21:09:53.465144] [INFO ] [MAIN ] Update Progress: 1880/2372 symbols completed. SBSW took 32.3s. Estimated remaining: 1h 5m 23s. Rate: 7.5 symbols/min [2025-09-19T21:09:54.135087] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:09:54.265614] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:09:54.260934] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:09:54.290529] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-19T21:09:54.290097] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:09:54.291272] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-19T21:09:54.292420] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-19T21:09:54.292480] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-19T21:09:54.292528] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-19T21:09:54.292562] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-19T21:09:54.395848] [DEBUG] [LOCAL ] SCD: Loaded 12673 existing records from primary storage. [2025-09-19T21:09:54.410796] [INFO ] [MAIN ] SCD: Loaded 12673 existing records. [2025-09-19T21:09:54.845001] [DEBUG] [LOCAL ] SCCO: Loaded 49767 existing records from primary storage. [2025-09-19T21:09:54.919927] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-09-19T21:09:54.934765] [INFO ] [MAIN ] SCCO: Loaded 49767 existing records. [2025-09-19T21:09:54.938529] [INFO ] [MAIN ] SCHW: Loaded 54075 existing records. [2025-09-19T21:09:54.919053] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:09:54.973682] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-19T21:09:55.042605] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:09:55.058357] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-19T21:09:55.069453] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-19T21:09:55.076594] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-19T21:09:55.092219] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-19T21:09:55.558812] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:09:55.602541] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T21:09:55.638770] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-19T21:09:55.671343] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-19T21:09:55.663833] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-19T21:09:55.602166] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:09:55.709689] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-19T21:09:55.726055] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-19T21:09:55.739448] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-19T21:09:55.748986] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-19T21:09:55.772214] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-19T21:09:55.797884] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-19T21:09:55.947734] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:09:55.984275] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-19T21:09:56.166088] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-19T21:09:56.213631] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-19T21:09:56.582512] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:09:56.611261] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-19T21:09:56.649555] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:09:56.650178] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-19T21:09:56.788915] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-19T21:09:56.789866] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-19T21:09:56.967031] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T21:09:56.969119] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-19T21:09:57.106344] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-19T21:09:57.107300] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-19T21:09:57.555485] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-19T21:09:57.556363] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-19T21:09:57.943423] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-19T21:09:57.945919] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-19T21:09:58.014626] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-19T21:09:58.015627] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-19T21:09:58.528360] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T21:09:58.537710] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-19T21:09:58.617398] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T21:09:58.630276] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-19T21:09:58.640352] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T21:09:58.642680] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-19T21:09:58.998005] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T21:09:59.043223] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-19T21:09:59.644714] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-19T21:09:59.782785] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T21:09:59.843242] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-19T21:10:00.495365] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T21:10:00.530244] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T21:10:00.651896] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-19T21:10:00.658226] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T21:10:01.443299] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-19T21:10:02.243311] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-19T21:10:02.593761] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T21:10:02.624383] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-19T21:10:02.625240] [INFO ] [REMOTE ] SBXD: Full fetch complete (3070 records). [2025-09-19T21:10:02.625316] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-19T21:10:02.874428] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-19T21:10:02.868269] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T21:10:02.877473] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:10:02.877956] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:10:02.878031] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-19T21:10:02.878099] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-19T21:10:02.878137] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-19T21:10:02.878176] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-19T21:10:02.878249] [INFO ] [MAIN ] Update Progress: 1881/2372 symbols completed. SBXD took 9.4s. Estimated remaining: 1h 5m 15s. Rate: 7.5 symbols/min [2025-09-19T21:10:03.044791] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-19T21:10:03.068497] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:10:03.129327] [DEBUG] [LOCAL ] SCI: Loaded 47062 existing records from primary storage. [2025-09-19T21:10:03.129482] [INFO ] [MAIN ] SCI: Loaded 47062 existing records. [2025-09-19T21:10:03.320433] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:10:03.320787] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-19T21:10:03.320843] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-19T21:10:03.322275] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-19T21:10:03.322345] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-19T21:10:03.708951] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:10:03.843273] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-19T21:10:04.643305] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-19T21:10:05.167421] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T21:10:05.446969] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-19T21:10:05.449591] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-19T21:10:05.882514] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T21:10:06.243308] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-19T21:10:07.043307] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-19T21:10:07.458453] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T21:10:07.716500] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T21:10:07.843296] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-19T21:10:08.643308] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-19T21:10:09.033526] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T21:10:09.443315] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-19T21:10:09.805600] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T21:10:10.140450] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T21:10:10.243265] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-19T21:10:11.043284] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-19T21:10:11.144027] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T21:10:11.843292] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-19T21:10:12.145697] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T21:10:12.476275] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T21:10:12.608053] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T21:10:12.643262] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-19T21:10:13.443268] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-19T21:10:13.939282] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T21:10:13.941696] [INFO ] [REMOTE ] SCD: Full fetch complete (16109 records). [2025-09-19T21:10:13.941770] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-19T21:10:14.248422] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-19T21:10:14.313564] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-19T21:10:14.313708] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-19T21:10:14.314128] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-19T21:10:14.314173] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-19T21:10:14.314799] [DEBUG] [LOCAL ] SCD: Trimmed 16109 records to 12773 (keeping 200 days of data) [2025-09-19T21:10:14.396697] [DEBUG] [LOCAL ] SCD: Primary data saved (12773 records). [2025-09-19T21:10:14.396863] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-19T21:10:14.396956] [INFO ] [MAIN ] Update Progress: 1882/2372 symbols completed. SCD took 20.9s. Estimated remaining: 1h 5m 8s. Rate: 7.5 symbols/min [2025-09-19T21:10:14.565935] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:10:14.581938] [DEBUG] [LOCAL ] SCL: Loaded 14926 existing records from primary storage. [2025-09-19T21:10:14.582072] [INFO ] [MAIN ] SCL: Loaded 14926 existing records. [2025-09-19T21:10:14.773751] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:10:14.774091] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-19T21:10:14.774158] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-19T21:10:14.774865] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-19T21:10:14.774928] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-19T21:10:15.049415] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-19T21:10:15.165781] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:10:15.749293] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T21:10:15.848399] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-19T21:10:15.865225] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T21:10:16.643239] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-19T21:10:17.060462] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T21:10:17.205163] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T21:10:17.443322] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-19T21:10:18.243315] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-19T21:10:18.713566] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T21:10:18.944412] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T21:10:19.043257] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-19T21:10:19.315406] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T21:10:19.716090] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T21:10:19.843300] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-19T21:10:20.643334] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-19T21:10:21.443280] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-19T21:10:22.060130] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-19T21:10:22.243286] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-19T21:10:22.782911] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T21:10:22.864490] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T21:10:23.043228] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-19T21:10:23.557242] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T21:10:23.843282] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-19T21:10:24.643322] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-19T21:10:25.207295] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-19T21:10:25.214947] [INFO ] [REMOTE ] SCCO: Full fetch complete (70674 records). [2025-09-19T21:10:25.215083] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-19T21:10:25.449682] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-19T21:10:25.602244] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T21:10:25.654155] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-19T21:10:25.654256] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-19T21:10:25.655473] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-19T21:10:25.655540] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-19T21:10:25.657091] [DEBUG] [LOCAL ] SCCO: Trimmed 70674 records to 50123 (keeping 200 days of data) [2025-09-19T21:10:25.984303] [DEBUG] [LOCAL ] SCCO: Primary data saved (50123 records). [2025-09-19T21:10:25.984439] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-19T21:10:25.984553] [INFO ] [MAIN ] Update Progress: 1883/2372 symbols completed. SCCO took 32.5s. Estimated remaining: 1h 5m 1s. Rate: 7.5 symbols/min [2025-09-19T21:10:26.168250] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:10:26.190612] [DEBUG] [LOCAL ] SCM: Loaded 20323 existing records from primary storage. [2025-09-19T21:10:26.190771] [INFO ] [MAIN ] SCM: Loaded 20323 existing records. [2025-09-19T21:10:26.249440] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-19T21:10:26.383938] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:10:26.384231] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-19T21:10:26.384296] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-19T21:10:26.385012] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-19T21:10:26.385075] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-19T21:10:26.783024] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:10:26.821459] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T21:10:27.043259] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-19T21:10:27.324183] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T21:10:27.398932] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T21:10:27.843267] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-19T21:10:28.643281] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-19T21:10:29.105833] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T21:10:29.331734] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T21:10:29.351812] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-19T21:10:29.443252] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-19T21:10:30.243242] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-19T21:10:30.772790] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T21:10:31.043297] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-19T21:10:31.570175] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T21:10:31.843247] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-19T21:10:32.094395] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T21:10:32.643295] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-19T21:10:33.138047] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T21:10:33.443289] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-19T21:10:34.024353] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T21:10:34.243257] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-19T21:10:35.043261] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-19T21:10:35.561064] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T21:10:35.569428] [INFO ] [REMOTE ] SCHW: Full fetch complete (77698 records). [2025-09-19T21:10:35.569578] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-19T21:10:35.851472] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-19T21:10:35.996000] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-19T21:10:35.996095] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-19T21:10:35.997379] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-19T21:10:35.997450] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-19T21:10:35.999208] [DEBUG] [LOCAL ] SCHW: Trimmed 77698 records to 54465 (keeping 200 days of data) [2025-09-19T21:10:36.268187] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T21:10:36.399947] [DEBUG] [LOCAL ] SCHW: Primary data saved (54465 records). [2025-09-19T21:10:36.400252] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-19T21:10:36.400459] [INFO ] [MAIN ] Update Progress: 1884/2372 symbols completed. SCHW took 42.9s. Estimated remaining: 1h 4m 54s. Rate: 7.5 symbols/min [2025-09-19T21:10:36.444985] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T21:10:36.590022] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:10:36.634451] [DEBUG] [LOCAL ] SCS: Loaded 43154 existing records from primary storage. [2025-09-19T21:10:36.634618] [INFO ] [MAIN ] SCS: Loaded 43154 existing records. [2025-09-19T21:10:36.648412] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-19T21:10:36.814907] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:10:36.815205] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-19T21:10:36.815255] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-19T21:10:36.816511] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-19T21:10:36.816572] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-19T21:10:37.193906] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:10:37.194332] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T21:10:37.198218] [INFO ] [REMOTE ] SCL: Full fetch complete (20824 records). [2025-09-19T21:10:37.198325] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-19T21:10:37.456192] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-19T21:10:37.590506] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-19T21:10:37.590595] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-19T21:10:37.591104] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-19T21:10:37.591168] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-19T21:10:37.592733] [DEBUG] [LOCAL ] SCL: Trimmed 20824 records to 15051 (keeping 200 days of data) [2025-09-19T21:10:37.692090] [DEBUG] [LOCAL ] SCL: Primary data saved (15051 records). [2025-09-19T21:10:37.692277] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-19T21:10:37.692456] [INFO ] [MAIN ] Update Progress: 1885/2372 symbols completed. SCL took 23.3s. Estimated remaining: 1h 4m 44s. Rate: 7.5 symbols/min [2025-09-19T21:10:37.880226] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:10:37.914495] [DEBUG] [LOCAL ] SD: Loaded 29439 existing records from primary storage. [2025-09-19T21:10:37.914638] [INFO ] [MAIN ] SD: Loaded 29439 existing records. [2025-09-19T21:10:38.111477] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:10:38.111817] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-19T21:10:38.111884] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-19T21:10:38.112605] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-19T21:10:38.112700] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-19T21:10:38.248531] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-19T21:10:38.500514] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:10:38.520283] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T21:10:38.526964] [INFO ] [REMOTE ] SCI: Full fetch complete (67153 records). [2025-09-19T21:10:38.527085] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-19T21:10:38.931199] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-19T21:10:38.931351] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-19T21:10:38.932705] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-19T21:10:38.932828] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-19T21:10:38.934814] [DEBUG] [LOCAL ] SCI: Trimmed 67153 records to 47400 (keeping 200 days of data) [2025-09-19T21:10:38.958818] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T21:10:39.056768] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-19T21:10:39.261345] [DEBUG] [LOCAL ] SCI: Primary data saved (47400 records). [2025-09-19T21:10:39.261500] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-19T21:10:39.261589] [INFO ] [MAIN ] Update Progress: 1886/2372 symbols completed. SCI took 36.4s. Estimated remaining: 1h 4m 34s. Rate: 7.5 symbols/min [2025-09-19T21:10:39.428213] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:10:39.440294] [DEBUG] [LOCAL ] SDHC: Loaded 10681 existing records from primary storage. [2025-09-19T21:10:39.440568] [INFO ] [MAIN ] SDHC: Loaded 10681 existing records. [2025-09-19T21:10:39.635951] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:10:39.637418] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T21:10:39.643049] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-19T21:10:39.643920] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-19T21:10:39.644327] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-19T21:10:39.644389] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-19T21:10:39.854828] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-19T21:10:40.009805] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:10:40.643289] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-19T21:10:40.774532] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-19T21:10:40.821807] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T21:10:41.344055] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T21:10:41.443236] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-19T21:10:42.243263] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-19T21:10:42.698859] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T21:10:43.043257] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-19T21:10:43.843289] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-19T21:10:43.947275] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T21:10:44.406335] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T21:10:44.643254] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-19T21:10:44.859246] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T21:10:45.443265] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-19T21:10:45.994370] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T21:10:46.243277] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-19T21:10:47.043250] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-19T21:10:47.312982] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T21:10:47.404385] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T21:10:47.843267] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-19T21:10:48.190055] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T21:10:48.643330] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-19T21:10:49.125559] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T21:10:49.443279] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-19T21:10:50.243339] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-19T21:10:50.264789] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T21:10:51.021073] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T21:10:51.043230] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-19T21:10:51.843281] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-19T21:10:52.015301] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T21:10:52.180173] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T21:10:52.643277] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-19T21:10:52.884164] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T21:10:53.443284] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-19T21:10:53.498353] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T21:10:53.501835] [INFO ] [REMOTE ] SCM: Full fetch complete (28327 records). [2025-09-19T21:10:53.501929] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-19T21:10:53.874083] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-19T21:10:53.874167] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-19T21:10:53.874761] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-19T21:10:53.874824] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-19T21:10:53.875580] [DEBUG] [LOCAL ] SCM: Trimmed 28327 records to 20453 (keeping 200 days of data) [2025-09-19T21:10:54.000071] [DEBUG] [LOCAL ] SCM: Primary data saved (20453 records). [2025-09-19T21:10:54.000200] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-19T21:10:54.000282] [INFO ] [MAIN ] Update Progress: 1887/2372 symbols completed. SCM took 28.0s. Estimated remaining: 1h 4m 28s. Rate: 7.5 symbols/min [2025-09-19T21:10:54.177493] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:10:54.191033] [DEBUG] [LOCAL ] SDHY: Loaded 10805 existing records from primary storage. [2025-09-19T21:10:54.191161] [INFO ] [MAIN ] SDHY: Loaded 10805 existing records. [2025-09-19T21:10:54.254022] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-19T21:10:54.375913] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:10:54.376171] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-19T21:10:54.376221] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-19T21:10:54.376797] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-19T21:10:54.376862] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-19T21:10:54.778248] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:10:55.043266] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-19T21:10:55.300952] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-19T21:10:55.329639] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T21:10:55.843279] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-19T21:10:56.643303] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-19T21:10:56.683307] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T21:10:57.443289] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-19T21:10:57.633309] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T21:10:57.634147] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T21:10:58.193928] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-19T21:10:58.243231] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-19T21:10:59.043294] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-19T21:10:59.229379] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T21:10:59.843328] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-19T21:11:00.643301] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-19T21:11:01.097309] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T21:11:01.443274] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-19T21:11:01.494833] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T21:11:01.648986] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T21:11:02.243276] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-19T21:11:03.043273] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-19T21:11:03.310622] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T21:11:03.404935] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T21:11:03.640840] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T21:11:03.843268] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-19T21:11:04.643272] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-19T21:11:05.443277] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-19T21:11:05.686576] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T21:11:05.942939] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T21:11:06.243308] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-19T21:11:06.501489] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T21:11:07.043270] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-19T21:11:07.843283] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-19T21:11:08.056787] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T21:11:08.070738] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-19T21:11:08.643275] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-19T21:11:08.991581] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T21:11:09.443274] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-19T21:11:10.057738] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T21:11:10.061975] [INFO ] [REMOTE ] SD: Full fetch complete (41139 records). [2025-09-19T21:11:10.062066] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-19T21:11:10.249128] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-19T21:11:10.435510] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-19T21:11:10.435596] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-19T21:11:10.436384] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-19T21:11:10.436458] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-19T21:11:10.437395] [DEBUG] [LOCAL ] SD: Trimmed 41139 records to 29680 (keeping 200 days of data) [2025-09-19T21:11:10.613419] [DEBUG] [LOCAL ] SD: Primary data saved (29680 records). [2025-09-19T21:11:10.613553] [INFO ] [MAIN ] SD: Full history saved. [2025-09-19T21:11:10.613671] [INFO ] [MAIN ] Update Progress: 1888/2372 symbols completed. SD took 32.9s. Estimated remaining: 1h 4m 22s. Rate: 7.5 symbols/min [2025-09-19T21:11:10.792137] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:11:10.832148] [DEBUG] [LOCAL ] SDRL: Loaded 42440 existing records from primary storage. [2025-09-19T21:11:10.832294] [INFO ] [MAIN ] SDRL: Loaded 42440 existing records. [2025-09-19T21:11:11.007523] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:11:11.007800] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-19T21:11:11.007865] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-19T21:11:11.008969] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-19T21:11:11.009043] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-19T21:11:11.051475] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-19T21:11:11.373856] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:11:11.392442] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T21:11:11.405806] [INFO ] [REMOTE ] SCS: Full fetch complete (59850 records). [2025-09-19T21:11:11.406522] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T21:11:11.409109] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-19T21:11:11.732710] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-19T21:11:11.769344] [INFO ] [REMOTE ] SDHC: Full fetch complete (16946 records). [2025-09-19T21:11:11.792472] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-19T21:11:11.807404] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-19T21:11:11.807670] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-19T21:11:11.808760] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-19T21:11:11.808894] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-19T21:11:11.849053] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-19T21:11:11.904703] [DEBUG] [LOCAL ] SCS: Trimmed 59850 records to 43502 (keeping 200 days of data) [2025-09-19T21:11:12.286114] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-19T21:11:12.286424] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-19T21:11:12.290427] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-19T21:11:12.291568] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-19T21:11:12.299542] [DEBUG] [LOCAL ] SDHC: Trimmed 16946 records to 10760 (keeping 200 days of data) [2025-09-19T21:11:12.374469] [DEBUG] [LOCAL ] SDHC: Primary data saved (10760 records). [2025-09-19T21:11:12.378698] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-19T21:11:12.378911] [INFO ] [MAIN ] Update Progress: 1889/2372 symbols completed. SDHC took 33.1s. Estimated remaining: 1h 4m 13s. Rate: 7.5 symbols/min [2025-09-19T21:11:12.645329] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:11:12.643877] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-19T21:11:12.724959] [DEBUG] [LOCAL ] SCS: Primary data saved (43502 records). [2025-09-19T21:11:12.725155] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-19T21:11:12.726617] [INFO ] [MAIN ] Update Progress: 1890/2372 symbols completed. SCS took 36.3s. Estimated remaining: 1h 4m 3s. Rate: 7.5 symbols/min [2025-09-19T21:11:12.872706] [DEBUG] [LOCAL ] SE: Loaded 53786 existing records from primary storage. [2025-09-19T21:11:12.892833] [INFO ] [MAIN ] SE: Loaded 53786 existing records. [2025-09-19T21:11:12.974222] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:11:13.081081] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T21:11:13.126826] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:11:13.127112] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-19T21:11:13.127170] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-19T21:11:13.129003] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-09-19T21:11:13.129072] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-19T21:11:13.445593] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-19T21:11:13.433038] [DEBUG] [LOCAL ] SEE: Loaded 48830 existing records from primary storage. [2025-09-19T21:11:13.458265] [INFO ] [MAIN ] SEE: Loaded 48830 existing records. [2025-09-19T21:11:13.650786] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:11:13.730888] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:11:13.731265] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-19T21:11:13.731345] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-19T21:11:13.732740] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-19T21:11:13.732803] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-19T21:11:14.112543] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:11:14.243268] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-19T21:11:14.439620] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T21:11:14.588970] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T21:11:15.043265] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-19T21:11:15.575323] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-19T21:11:15.843238] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-19T21:11:16.643233] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-19T21:11:16.730557] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T21:11:16.732876] [INFO ] [REMOTE ] SDHY: Full fetch complete (16307 records). [2025-09-19T21:11:16.732949] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-19T21:11:16.961110] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-19T21:11:17.176929] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-19T21:11:17.177024] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-19T21:11:17.177464] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-19T21:11:17.177549] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-19T21:11:17.178159] [DEBUG] [LOCAL ] SDHY: Trimmed 16307 records to 10852 (keeping 200 days of data) [2025-09-19T21:11:17.254020] [DEBUG] [LOCAL ] SDHY: Primary data saved (10852 records). [2025-09-19T21:11:17.254176] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-19T21:11:17.254282] [INFO ] [MAIN ] Update Progress: 1891/2372 symbols completed. SDHY took 23.3s. Estimated remaining: 1h 3m 54s. Rate: 7.5 symbols/min [2025-09-19T21:11:17.442778] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:11:17.443337] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-19T21:11:17.462189] [DEBUG] [LOCAL ] SEG: Loaded 14020 existing records from primary storage. [2025-09-19T21:11:17.462326] [INFO ] [MAIN ] SEG: Loaded 14020 existing records. [2025-09-19T21:11:17.663455] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:11:17.664010] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-19T21:11:17.664108] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-19T21:11:17.664574] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-19T21:11:17.664695] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-19T21:11:18.024872] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:11:18.243263] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-19T21:11:18.325140] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T21:11:19.043253] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-19T21:11:19.268826] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T21:11:19.623421] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T21:11:19.843268] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-19T21:11:20.417138] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T21:11:20.643274] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-19T21:11:21.443361] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-19T21:11:21.668816] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T21:11:22.179686] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-19T21:11:22.243259] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-19T21:11:22.795181] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T21:11:23.043251] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-19T21:11:23.843311] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-19T21:11:24.643373] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-19T21:11:24.808384] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-19T21:11:24.874951] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T21:11:25.443256] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-19T21:11:25.702163] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T21:11:25.843299] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T21:11:26.243275] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-19T21:11:26.881112] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T21:11:27.043252] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-19T21:11:27.411494] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T21:11:27.843291] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-19T21:11:28.643270] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-19T21:11:29.443315] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-19T21:11:29.724079] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T21:11:29.837012] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-19T21:11:30.034632] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T21:11:30.243276] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-19T21:11:31.043257] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-19T21:11:31.233834] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T21:11:31.508815] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T21:11:31.724124] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T21:11:31.843271] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-19T21:11:32.643320] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-19T21:11:33.443276] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-19T21:11:34.243350] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-19T21:11:34.327332] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-19T21:11:34.655857] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T21:11:34.763584] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T21:11:35.043265] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-19T21:11:35.473586] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T21:11:35.843308] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-19T21:11:36.643276] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-19T21:11:36.813523] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T21:11:37.443299] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-19T21:11:37.759375] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T21:11:38.236783] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-19T21:11:38.247049] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-19T21:11:38.914252] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T21:11:38.920353] [INFO ] [REMOTE ] SDRL: Full fetch complete (61938 records). [2025-09-19T21:11:38.920498] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-19T21:11:39.048367] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-19T21:11:39.331416] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-19T21:11:39.331507] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-19T21:11:39.332578] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-19T21:11:39.332673] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-19T21:11:39.334088] [DEBUG] [LOCAL ] SDRL: Trimmed 61938 records to 42790 (keeping 200 days of data) [2025-09-19T21:11:39.473797] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T21:11:39.614947] [DEBUG] [LOCAL ] SDRL: Primary data saved (42790 records). [2025-09-19T21:11:39.615083] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-19T21:11:39.615245] [INFO ] [MAIN ] Update Progress: 1892/2372 symbols completed. SDRL took 29.0s. Estimated remaining: 1h 3m 50s. Rate: 7.5 symbols/min [2025-09-19T21:11:39.792515] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:11:39.846188] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-19T21:11:39.847331] [DEBUG] [LOCAL ] SEI: Loaded 49991 existing records from primary storage. [2025-09-19T21:11:39.847481] [INFO ] [MAIN ] SEI: Loaded 49991 existing records. [2025-09-19T21:11:40.036305] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:11:40.036733] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-19T21:11:40.036795] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-19T21:11:40.038230] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-19T21:11:40.038293] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-19T21:11:40.402343] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:11:40.643261] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-19T21:11:41.118931] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T21:11:41.443307] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-19T21:11:42.002879] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T21:11:42.039580] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T21:11:42.243280] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-19T21:11:43.043339] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-19T21:11:43.843306] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-19T21:11:43.887972] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-19T21:11:44.141442] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T21:11:44.495623] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T21:11:44.643234] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-19T21:11:44.865071] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T21:11:44.867570] [INFO ] [REMOTE ] SEG: Full fetch complete (19832 records). [2025-09-19T21:11:44.867677] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-19T21:11:45.246840] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-19T21:11:45.246994] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-19T21:11:45.247421] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-19T21:11:45.247462] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-19T21:11:45.248857] [DEBUG] [LOCAL ] SEG: Trimmed 19832 records to 14131 (keeping 200 days of data) [2025-09-19T21:11:45.343504] [DEBUG] [LOCAL ] SEG: Primary data saved (14131 records). [2025-09-19T21:11:45.343673] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-19T21:11:45.343857] [INFO ] [MAIN ] Update Progress: 1893/2372 symbols completed. SEG took 28.1s. Estimated remaining: 1h 3m 41s. Rate: 7.5 symbols/min [2025-09-19T21:11:45.444574] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-19T21:11:45.517254] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:11:45.571909] [DEBUG] [LOCAL ] SEM: Loaded 43446 existing records from primary storage. [2025-09-19T21:11:45.572036] [INFO ] [MAIN ] SEM: Loaded 43446 existing records. [2025-09-19T21:11:45.760416] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:11:45.760794] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-19T21:11:45.760854] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-19T21:11:45.761976] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-19T21:11:45.762038] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-19T21:11:46.124458] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:11:46.243236] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-19T21:11:46.519992] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T21:11:47.043306] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-19T21:11:47.386116] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T21:11:47.595040] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T21:11:47.843310] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-19T21:11:48.580683] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T21:11:48.643234] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-19T21:11:48.809724] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T21:11:48.817107] [INFO ] [REMOTE ] SE: Full fetch complete (76696 records). [2025-09-19T21:11:48.817252] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-19T21:11:48.821082] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T21:11:48.821172] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:11:48.821227] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:11:48.821292] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-19T21:11:48.821365] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-19T21:11:48.821431] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-09-19T21:11:48.822166] [DEBUG] [LOCAL ] SE: Deleted derivative data file. [2025-09-19T21:11:48.822306] [INFO ] [MAIN ] Update Progress: 1894/2372 symbols completed. SE took 36.4s. Estimated remaining: 1h 3m 32s. Rate: 7.5 symbols/min [2025-09-19T21:11:48.995138] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:11:49.043197] [DEBUG] [LOCAL ] SEMR: Loaded 42078 existing records from primary storage. [2025-09-19T21:11:49.043364] [INFO ] [MAIN ] SEMR: Loaded 42078 existing records. [2025-09-19T21:11:49.218017] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:11:49.218268] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-19T21:11:49.218324] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-19T21:11:49.219273] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-19T21:11:49.219333] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-19T21:11:49.449093] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-19T21:11:49.579593] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:11:50.243262] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-19T21:11:50.774770] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T21:11:51.043268] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-19T21:11:51.242277] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T21:11:51.754712] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T21:11:51.843262] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-19T21:11:52.643270] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-19T21:11:53.137467] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T21:11:53.443329] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-19T21:11:53.851130] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T21:11:54.243268] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-19T21:11:54.377277] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T21:11:55.043342] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-19T21:11:55.500897] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T21:11:55.818991] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T21:11:55.843213] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-19T21:11:56.643278] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-19T21:11:56.840034] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T21:11:56.848984] [INFO ] [REMOTE ] SEE: Full fetch complete (69591 records). [2025-09-19T21:11:56.849114] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-19T21:11:57.289901] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-19T21:11:57.290022] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-19T21:11:57.291154] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-19T21:11:57.291228] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-19T21:11:57.292701] [DEBUG] [LOCAL ] SEE: Trimmed 69591 records to 49178 (keeping 200 days of data) [2025-09-19T21:11:57.489276] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-19T21:11:57.619217] [DEBUG] [LOCAL ] SEE: Primary data saved (49178 records). [2025-09-19T21:11:57.619492] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-19T21:11:57.620123] [INFO ] [MAIN ] Update Progress: 1895/2372 symbols completed. SEE took 44.9s. Estimated remaining: 1h 3m 24s. Rate: 7.5 symbols/min [2025-09-19T21:11:57.789746] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T21:11:57.822610] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:11:57.878333] [DEBUG] [LOCAL ] SES: Loaded 51906 existing records from primary storage. [2025-09-19T21:11:57.878511] [INFO ] [MAIN ] SES: Loaded 51906 existing records. [2025-09-19T21:11:58.065053] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:11:58.065511] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-19T21:11:58.065699] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-19T21:11:58.074552] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-19T21:11:58.088915] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-19T21:11:58.154629] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T21:11:58.249844] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-19T21:11:58.459982] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:11:59.042350] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T21:11:59.052298] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-19T21:11:59.843268] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-19T21:12:00.250373] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T21:12:00.643263] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-19T21:12:01.004750] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T21:12:01.443279] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-19T21:12:01.716419] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T21:12:02.243285] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-19T21:12:02.369611] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T21:12:03.043285] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-19T21:12:03.843264] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-19T21:12:05.112532] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (3.67 seconds). [2025-09-19T21:12:05.123199] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-19T21:12:05.548930] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (3.31 seconds). [2025-09-19T21:12:05.559812] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-19T21:12:05.786443] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T21:12:05.823420] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-19T21:12:06.243310] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-19T21:12:07.043284] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-19T21:12:07.131602] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T21:12:07.139311] [INFO ] [REMOTE ] SEI: Full fetch complete (69478 records). [2025-09-19T21:12:07.139458] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-19T21:12:07.530140] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-19T21:12:07.530272] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-19T21:12:07.531426] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-19T21:12:07.531512] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-19T21:12:07.533165] [DEBUG] [LOCAL ] SEI: Trimmed 69478 records to 50377 (keeping 200 days of data) [2025-09-19T21:12:07.854257] [DEBUG] [LOCAL ] SEI: Primary data saved (50377 records). [2025-09-19T21:12:07.854405] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-19T21:12:07.854493] [INFO ] [MAIN ] Update Progress: 1896/2372 symbols completed. SEI took 28.2s. Estimated remaining: 1h 3m 17s. Rate: 7.5 symbols/min [2025-09-19T21:12:08.044348] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:12:08.074120] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.95 seconds). [2025-09-19T21:12:08.088922] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-19T21:12:08.115715] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T21:12:08.154218] [DEBUG] [LOCAL ] SF: Loaded 42264 existing records from primary storage. [2025-09-19T21:12:08.154375] [INFO ] [MAIN ] SF: Loaded 42264 existing records. [2025-09-19T21:12:08.328715] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:12:08.328964] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-19T21:12:08.329024] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-19T21:12:08.330156] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-19T21:12:08.330217] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-19T21:12:08.646121] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-19T21:12:08.687695] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:12:08.714478] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T21:12:09.443263] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-19T21:12:10.243277] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-19T21:12:10.446280] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T21:12:10.531855] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T21:12:11.043271] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-19T21:12:11.332420] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T21:12:11.843340] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-19T21:12:12.088227] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T21:12:12.643314] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-19T21:12:13.443340] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-19T21:12:14.270930] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-19T21:12:14.280931] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-19T21:12:14.722501] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (3.68 seconds). [2025-09-19T21:12:15.043256] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-19T21:12:15.300193] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T21:12:15.354359] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-19T21:12:15.843285] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-19T21:12:16.643318] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-19T21:12:16.710008] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-19T21:12:17.443330] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-19T21:12:17.628694] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T21:12:17.795398] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-19T21:12:18.243269] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-19T21:12:18.620257] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T21:12:18.628712] [INFO ] [REMOTE ] SEM: Full fetch complete (61898 records). [2025-09-19T21:12:18.628877] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-19T21:12:18.992980] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T21:12:19.051303] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-19T21:12:19.047691] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-19T21:12:19.051522] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-19T21:12:19.053674] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-19T21:12:19.054123] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-19T21:12:19.053931] [INFO ] [REMOTE ] SEMR: Full fetch complete (58690 records). [2025-09-19T21:12:19.054388] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-19T21:12:19.077734] [DEBUG] [LOCAL ] SEM: Trimmed 61898 records to 43721 (keeping 200 days of data) [2025-09-19T21:12:19.695567] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-19T21:12:19.697477] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-19T21:12:19.698524] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-19T21:12:19.699182] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-19T21:12:19.706890] [DEBUG] [LOCAL ] SEMR: Trimmed 58690 records to 42380 (keeping 200 days of data) [2025-09-19T21:12:19.867837] [DEBUG] [LOCAL ] SEM: Primary data saved (43721 records). [2025-09-19T21:12:19.868543] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-19T21:12:19.868712] [INFO ] [MAIN ] Update Progress: 1897/2372 symbols completed. SEM took 34.5s. Estimated remaining: 1h 3m 10s. Rate: 7.5 symbols/min [2025-09-19T21:12:20.054380] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:12:20.069559] [DEBUG] [LOCAL ] SFB: Loaded 4099 existing records from primary storage. [2025-09-19T21:12:20.123114] [INFO ] [MAIN ] SFB: Loaded 4099 existing records. [2025-09-19T21:12:20.358816] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:12:20.372608] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-19T21:12:20.382374] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-19T21:12:20.383698] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-19T21:12:20.383791] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-19T21:12:20.483106] [DEBUG] [LOCAL ] SEMR: Primary data saved (42380 records). [2025-09-19T21:12:20.537225] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-19T21:12:20.534592] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-19T21:12:20.555886] [INFO ] [MAIN ] Update Progress: 1898/2372 symbols completed. SEMR took 31.7s. Estimated remaining: 1h 3m 0s. Rate: 7.5 symbols/min [2025-09-19T21:12:20.656137] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-19T21:12:20.974087] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:12:21.021290] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:12:21.021715] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-19T21:12:21.059466] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T21:12:21.078539] [DEBUG] [LOCAL ] SFBS: Loaded 21591 existing records from primary storage. [2025-09-19T21:12:21.079090] [INFO ] [MAIN ] SFBS: Loaded 21591 existing records. [2025-09-19T21:12:21.271215] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:12:21.271514] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-19T21:12:21.271575] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-19T21:12:21.272189] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-19T21:12:21.272252] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-19T21:12:21.456229] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-19T21:12:21.648906] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:12:22.088083] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T21:12:22.243305] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-19T21:12:22.887849] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T21:12:23.043237] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-19T21:12:23.059497] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-19T21:12:23.843286] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-19T21:12:23.882443] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T21:12:24.171312] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-19T21:12:24.643330] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-19T21:12:25.343554] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T21:12:25.358402] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T21:12:25.443223] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-19T21:12:26.243276] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-19T21:12:26.427477] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T21:12:27.043239] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-19T21:12:27.351030] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-19T21:12:27.843281] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-19T21:12:28.407951] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T21:12:28.643317] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-19T21:12:29.443264] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-19T21:12:29.906175] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-19T21:12:30.177793] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-19T21:12:30.243236] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-19T21:12:30.368603] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T21:12:31.043276] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-19T21:12:31.795399] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T21:12:31.843292] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-19T21:12:31.931899] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T21:12:31.939694] [INFO ] [REMOTE ] SES: Full fetch complete (74367 records). [2025-09-19T21:12:31.939828] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-19T21:12:32.335281] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-19T21:12:32.335402] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-19T21:12:32.337268] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-19T21:12:32.337334] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-19T21:12:32.338859] [DEBUG] [LOCAL ] SES: Trimmed 74367 records to 52296 (keeping 200 days of data) [2025-09-19T21:12:32.643389] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-19T21:12:32.663568] [DEBUG] [LOCAL ] SES: Primary data saved (52296 records). [2025-09-19T21:12:32.663743] [INFO ] [MAIN ] SES: Full history saved. [2025-09-19T21:12:32.663848] [INFO ] [MAIN ] Update Progress: 1899/2372 symbols completed. SES took 35.0s. Estimated remaining: 1h 2m 53s. Rate: 7.5 symbols/min [2025-09-19T21:12:32.842144] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:12:32.890690] [DEBUG] [LOCAL ] SFL: Loaded 45807 existing records from primary storage. [2025-09-19T21:12:32.890874] [INFO ] [MAIN ] SFL: Loaded 45807 existing records. [2025-09-19T21:12:33.074973] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:12:33.075248] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-19T21:12:33.075316] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-19T21:12:33.076259] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-19T21:12:33.076321] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-19T21:12:33.454471] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:12:33.454577] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-19T21:12:33.455781] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T21:12:33.713927] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T21:12:34.243282] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-19T21:12:34.786726] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T21:12:35.043314] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-19T21:12:35.843271] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-19T21:12:36.184427] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T21:12:36.397972] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T21:12:36.640028] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T21:12:36.643211] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-19T21:12:37.285059] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-19T21:12:37.443307] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-19T21:12:38.060724] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-19T21:12:38.062276] [INFO ] [REMOTE ] SFB: Full fetch complete (5723 records). [2025-09-19T21:12:38.062395] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-19T21:12:38.248342] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-19T21:12:38.438219] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-19T21:12:38.438306] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-19T21:12:38.438480] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-19T21:12:38.438521] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-19T21:12:38.439019] [DEBUG] [LOCAL ] SFB: Trimmed 5723 records to 4115 (keeping 200 days of data) [2025-09-19T21:12:38.463568] [DEBUG] [LOCAL ] SFB: Primary data saved (4115 records). [2025-09-19T21:12:38.463715] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-19T21:12:38.463831] [INFO ] [MAIN ] Update Progress: 1900/2372 symbols completed. SFB took 18.6s. Estimated remaining: 1h 2m 45s. Rate: 7.5 symbols/min [2025-09-19T21:12:38.649855] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:12:38.703675] [DEBUG] [LOCAL ] SG: Loaded 53850 existing records from primary storage. [2025-09-19T21:12:38.703862] [INFO ] [MAIN ] SG: Loaded 53850 existing records. [2025-09-19T21:12:38.896340] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:12:38.896638] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-19T21:12:38.896723] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-19T21:12:38.898087] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-19T21:12:38.898151] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-19T21:12:39.054178] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-19T21:12:39.274622] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:12:39.609054] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T21:12:39.843267] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-19T21:12:40.643326] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-19T21:12:40.931470] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T21:12:41.443301] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-19T21:12:41.639562] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T21:12:42.243308] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-19T21:12:42.513344] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T21:12:42.874371] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T21:12:43.043274] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-19T21:12:43.154176] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T21:12:43.843285] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-19T21:12:44.643252] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-19T21:12:45.083593] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T21:12:45.443361] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-19T21:12:45.862357] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T21:12:45.983023] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T21:12:46.243316] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-19T21:12:46.681764] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T21:12:47.043229] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-19T21:12:47.566979] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T21:12:47.570596] [INFO ] [REMOTE ] SFBS: Full fetch complete (30264 records). [2025-09-19T21:12:47.570725] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-19T21:12:47.851053] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-19T21:12:47.962156] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-19T21:12:47.962255] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-19T21:12:47.963162] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-19T21:12:47.963237] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-19T21:12:47.965060] [DEBUG] [LOCAL ] SFBS: Trimmed 30264 records to 21769 (keeping 200 days of data) [2025-09-19T21:12:48.123295] [DEBUG] [LOCAL ] SFBS: Primary data saved (21769 records). [2025-09-19T21:12:48.123532] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-19T21:12:48.123744] [INFO ] [MAIN ] Update Progress: 1901/2372 symbols completed. SFBS took 27.6s. Estimated remaining: 1h 2m 37s. Rate: 7.5 symbols/min [2025-09-19T21:12:48.298226] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:12:48.315680] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-19T21:12:48.321868] [INFO ] [REMOTE ] SF: Full fetch complete (59364 records). [2025-09-19T21:12:48.321980] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-19T21:12:48.643361] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-19T21:12:48.643278] [DEBUG] [LOCAL ] SGHC: Loaded 45772 existing records from primary storage. [2025-09-19T21:12:48.656161] [INFO ] [MAIN ] SGHC: Loaded 45772 existing records. [2025-09-19T21:12:48.844850] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-19T21:12:48.845276] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-19T21:12:48.846297] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-19T21:12:48.846381] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-19T21:12:48.907311] [DEBUG] [LOCAL ] SF: Trimmed 59364 records to 42554 (keeping 200 days of data) [2025-09-19T21:12:48.928618] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:12:48.928989] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-19T21:12:48.929044] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-19T21:12:48.930129] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-19T21:12:48.930189] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-19T21:12:49.486137] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:12:49.495877] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-19T21:12:49.578661] [DEBUG] [LOCAL ] SF: Primary data saved (42554 records). [2025-09-19T21:12:49.578814] [INFO ] [MAIN ] SF: Full history saved. [2025-09-19T21:12:49.578913] [INFO ] [MAIN ] Update Progress: 1902/2372 symbols completed. SF took 41.7s. Estimated remaining: 1h 2m 27s. Rate: 7.5 symbols/min [2025-09-19T21:12:49.746181] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:12:49.746356] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-19T21:12:49.746393] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-19T21:12:49.746530] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-19T21:12:49.746571] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-19T21:12:49.746611] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-19T21:12:49.746663] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-19T21:12:50.111530] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:12:50.140167] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T21:12:50.243251] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-19T21:12:50.802688] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T21:12:51.043234] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-19T21:12:51.121792] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-19T21:12:51.843275] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-19T21:12:52.066442] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T21:12:52.593332] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T21:12:52.643233] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-19T21:12:53.443267] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-19T21:12:53.584741] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T21:12:54.243272] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-19T21:12:54.481256] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T21:12:54.554868] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:12:54.555159] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-19T21:12:55.043319] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-19T21:12:55.320696] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T21:12:55.368935] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:12:55.369215] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-19T21:12:55.843295] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-19T21:12:56.643274] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-19T21:12:57.443259] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-19T21:12:58.069249] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T21:12:58.243325] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-19T21:12:58.665239] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T21:12:58.946490] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T21:12:59.043216] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-19T21:12:59.843272] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-19T21:12:59.888927] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T21:13:00.643325] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-19T21:13:00.841431] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T21:13:01.311498] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T21:13:01.443237] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-19T21:13:02.243284] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-19T21:13:02.986753] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-19T21:13:03.043220] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-19T21:13:03.242126] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T21:13:03.248963] [INFO ] [REMOTE ] SFL: Full fetch complete (65294 records). [2025-09-19T21:13:03.249098] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-19T21:13:03.642771] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-19T21:13:03.642861] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-19T21:13:03.644016] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-19T21:13:03.644085] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-19T21:13:03.645453] [DEBUG] [LOCAL ] SFL: Trimmed 65294 records to 46153 (keeping 200 days of data) [2025-09-19T21:13:03.851287] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-19T21:13:03.927127] [DEBUG] [LOCAL ] SFL: Primary data saved (46153 records). [2025-09-19T21:13:03.927434] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-19T21:13:03.928487] [INFO ] [MAIN ] Update Progress: 1903/2372 symbols completed. SFL took 31.3s. Estimated remaining: 1h 2m 21s. Rate: 7.5 symbols/min [2025-09-19T21:13:04.099369] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:13:04.109364] [DEBUG] [LOCAL ] SGU: Loaded 6692 existing records from primary storage. [2025-09-19T21:13:04.109487] [INFO ] [MAIN ] SGU: Loaded 6692 existing records. [2025-09-19T21:13:04.299687] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:13:04.300075] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-19T21:13:04.300136] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-19T21:13:04.300623] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-19T21:13:04.300728] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-19T21:13:04.486288] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T21:13:04.648346] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-19T21:13:04.738299] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:13:05.247463] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T21:13:05.443289] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-19T21:13:05.664536] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T21:13:06.243315] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-19T21:13:06.467591] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T21:13:07.043308] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-19T21:13:07.050766] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-19T21:13:07.605626] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T21:13:07.843268] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-19T21:13:08.643268] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-19T21:13:08.995456] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T21:13:09.443265] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-19T21:13:09.796527] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T21:13:10.243249] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-19T21:13:10.781081] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T21:13:10.979356] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T21:13:10.987462] [INFO ] [REMOTE ] SG: Full fetch complete (77249 records). [2025-09-19T21:13:10.987606] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-19T21:13:11.048359] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-19T21:13:11.158492] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T21:13:11.404438] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-19T21:13:11.404542] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-19T21:13:11.405832] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-19T21:13:11.405910] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-19T21:13:11.407745] [DEBUG] [LOCAL ] SG: Trimmed 77249 records to 54238 (keeping 200 days of data) [2025-09-19T21:13:11.726759] [DEBUG] [LOCAL ] SG: Primary data saved (54238 records). [2025-09-19T21:13:11.726906] [INFO ] [MAIN ] SG: Full history saved. [2025-09-19T21:13:11.727010] [INFO ] [MAIN ] Update Progress: 1904/2372 symbols completed. SG took 33.3s. Estimated remaining: 1h 2m 13s. Rate: 7.5 symbols/min [2025-09-19T21:13:11.848484] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-19T21:13:11.903716] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:13:11.956548] [DEBUG] [LOCAL ] SHAK: Loaded 49593 existing records from primary storage. [2025-09-19T21:13:11.956827] [INFO ] [MAIN ] SHAK: Loaded 49593 existing records. [2025-09-19T21:13:12.141561] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:13:12.141902] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-19T21:13:12.141956] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-19T21:13:12.143253] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-19T21:13:12.143328] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-19T21:13:12.557629] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:13:12.643277] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-19T21:13:13.009879] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T21:13:13.081001] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T21:13:13.443262] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-19T21:13:14.164686] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T21:13:14.243269] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-19T21:13:15.043268] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-19T21:13:15.377760] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T21:13:15.385475] [INFO ] [REMOTE ] SGHC: Full fetch complete (63110 records). [2025-09-19T21:13:15.385591] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-19T21:13:15.783862] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-19T21:13:15.784010] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-19T21:13:15.785166] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-19T21:13:15.785276] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-19T21:13:15.788173] [DEBUG] [LOCAL ] SGHC: Trimmed 63110 records to 46162 (keeping 200 days of data) [2025-09-19T21:13:15.853229] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-19T21:13:15.939016] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T21:13:16.123411] [DEBUG] [LOCAL ] SGHC: Primary data saved (46162 records). [2025-09-19T21:13:16.123549] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-19T21:13:16.123634] [INFO ] [MAIN ] Update Progress: 1905/2372 symbols completed. SGHC took 28.0s. Estimated remaining: 1h 2m 4s. Rate: 7.5 symbols/min [2025-09-19T21:13:16.291685] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:13:16.318770] [DEBUG] [LOCAL ] SHCO: Loaded 26461 existing records from primary storage. [2025-09-19T21:13:16.318905] [INFO ] [MAIN ] SHCO: Loaded 26461 existing records. [2025-09-19T21:13:16.504238] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:13:16.509933] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-19T21:13:16.510234] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T21:13:16.510347] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-19T21:13:16.513567] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-19T21:13:16.513743] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-19T21:13:16.652074] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-19T21:13:16.883813] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:13:16.913487] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T21:13:17.443270] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-19T21:13:18.243291] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-19T21:13:18.686478] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T21:13:19.043283] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-19T21:13:19.149804] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T21:13:19.390026] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T21:13:19.638587] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-19T21:13:19.843270] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-19T21:13:20.643286] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-19T21:13:20.695124] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T21:13:21.443267] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-19T21:13:22.243295] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-19T21:13:22.794737] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-19T21:13:22.876030] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T21:13:23.043287] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-19T21:13:23.843226] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-19T21:13:23.874455] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T21:13:24.324749] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T21:13:24.643342] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-19T21:13:24.730420] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T21:13:25.443279] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-19T21:13:26.243267] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-19T21:13:26.711691] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-19T21:13:26.837247] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-19T21:13:26.856007] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T21:13:27.043265] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-19T21:13:27.843337] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-19T21:13:28.643340] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-19T21:13:29.038492] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T21:13:29.412985] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T21:13:29.443237] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-19T21:13:30.243290] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-19T21:13:30.597043] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T21:13:30.605866] [INFO ] [REMOTE ] SGI: Full fetch complete (56378 records). [2025-09-19T21:13:30.606097] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-19T21:13:30.824319] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-19T21:13:30.824986] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:13:30.825060] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:13:30.825135] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-19T21:13:30.825201] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-19T21:13:30.825235] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-19T21:13:30.825289] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-19T21:13:30.825384] [INFO ] [MAIN ] Update Progress: 1906/2372 symbols completed. SGI took 41.2s. Estimated remaining: 1h 1m 58s. Rate: 7.5 symbols/min [2025-09-19T21:13:31.031525] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:13:31.048184] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-19T21:13:31.068719] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T21:13:31.096871] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-19T21:13:31.144487] [DEBUG] [LOCAL ] SHEL: Loaded 54062 existing records from primary storage. [2025-09-19T21:13:31.144672] [INFO ] [MAIN ] SHEL: Loaded 54062 existing records. [2025-09-19T21:13:31.328987] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:13:31.329346] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-19T21:13:31.329407] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-19T21:13:31.330740] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-19T21:13:31.330802] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-19T21:13:31.711553] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:13:31.843291] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-19T21:13:32.091057] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-19T21:13:32.643272] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-19T21:13:33.443244] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-19T21:13:33.497000] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-19T21:13:33.499176] [INFO ] [REMOTE ] SGU: Full fetch complete (8905 records). [2025-09-19T21:13:33.499266] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-19T21:13:33.826600] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T21:13:33.916543] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-19T21:13:33.916658] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-19T21:13:33.916923] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-19T21:13:33.917013] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-19T21:13:33.918085] [DEBUG] [LOCAL ] SGU: Trimmed 8905 records to 6721 (keeping 200 days of data) [2025-09-19T21:13:33.962684] [DEBUG] [LOCAL ] SGU: Primary data saved (6721 records). [2025-09-19T21:13:33.962794] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-19T21:13:33.962959] [INFO ] [MAIN ] Update Progress: 1907/2372 symbols completed. SGU took 30.0s. Estimated remaining: 1h 1m 49s. Rate: 7.5 symbols/min [2025-09-19T21:13:34.133406] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:13:34.146116] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T21:13:34.198168] [DEBUG] [LOCAL ] SHG: Loaded 27806 existing records from primary storage. [2025-09-19T21:13:34.198344] [INFO ] [MAIN ] SHG: Loaded 27806 existing records. [2025-09-19T21:13:34.251092] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-19T21:13:34.386245] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:13:34.386569] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-19T21:13:34.386632] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-19T21:13:34.387633] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-19T21:13:34.387752] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-19T21:13:34.738359] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:13:35.043267] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-19T21:13:35.843286] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-19T21:13:36.643256] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-19T21:13:36.743125] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-19T21:13:36.821415] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T21:13:37.362745] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T21:13:37.443224] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-19T21:13:37.636128] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-19T21:13:38.243311] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-19T21:13:38.470102] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T21:13:39.043315] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-19T21:13:39.843321] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-19T21:13:39.894427] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T21:13:40.608028] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T21:13:40.643247] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-19T21:13:40.909728] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T21:13:41.443351] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-19T21:13:42.243301] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-19T21:13:42.754154] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T21:13:42.763222] [INFO ] [REMOTE ] SHAK: Full fetch complete (69927 records). [2025-09-19T21:13:42.763497] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-19T21:13:43.048380] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-19T21:13:43.179903] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-19T21:13:43.180012] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-19T21:13:43.181536] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-19T21:13:43.181606] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-19T21:13:43.183567] [DEBUG] [LOCAL ] SHAK: Trimmed 69927 records to 49932 (keeping 200 days of data) [2025-09-19T21:13:43.532025] [DEBUG] [LOCAL ] SHAK: Primary data saved (49932 records). [2025-09-19T21:13:43.532294] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-19T21:13:43.532428] [INFO ] [MAIN ] Update Progress: 1908/2372 symbols completed. SHAK took 31.8s. Estimated remaining: 1h 1m 41s. Rate: 7.5 symbols/min [2025-09-19T21:13:43.710695] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:13:43.748930] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T21:13:43.814663] [DEBUG] [LOCAL ] SHO: Loaded 50219 existing records from primary storage. [2025-09-19T21:13:43.814990] [INFO ] [MAIN ] SHO: Loaded 50219 existing records. [2025-09-19T21:13:43.848365] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-19T21:13:44.012447] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:13:44.013030] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-19T21:13:44.020804] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-19T21:13:44.034170] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T21:13:44.034253] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-19T21:13:44.034553] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-19T21:13:44.440332] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:13:44.636807] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T21:13:44.642342] [INFO ] [REMOTE ] SHCO: Full fetch complete (37207 records). [2025-09-19T21:13:44.642496] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-19T21:13:44.654506] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-19T21:13:45.018763] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-19T21:13:45.018857] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-19T21:13:45.019626] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-19T21:13:45.019700] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-19T21:13:45.022020] [DEBUG] [LOCAL ] SHCO: Trimmed 37207 records to 26650 (keeping 200 days of data) [2025-09-19T21:13:45.174544] [DEBUG] [LOCAL ] SHCO: Primary data saved (26650 records). [2025-09-19T21:13:45.174710] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-19T21:13:45.174819] [INFO ] [MAIN ] Update Progress: 1909/2372 symbols completed. SHCO took 29.1s. Estimated remaining: 1h 1m 32s. Rate: 7.5 symbols/min [2025-09-19T21:13:45.352512] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:13:45.361056] [DEBUG] [LOCAL ] SHOC: Loaded 4243 existing records from primary storage. [2025-09-19T21:13:45.361163] [INFO ] [MAIN ] SHOC: Loaded 4243 existing records. [2025-09-19T21:13:45.451445] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-19T21:13:45.547686] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:13:45.547917] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-19T21:13:45.547965] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-19T21:13:45.548275] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-19T21:13:45.548334] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-19T21:13:45.913072] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:13:46.193544] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-19T21:13:46.243232] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-19T21:13:46.410207] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T21:13:47.015149] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T21:13:47.043224] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-19T21:13:47.843262] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-19T21:13:48.643284] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-19T21:13:48.934409] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T21:13:49.038928] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.80 seconds). [2025-09-19T21:13:49.405676] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T21:13:49.443269] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-19T21:13:49.656781] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T21:13:50.243289] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-19T21:13:51.043301] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-19T21:13:51.251947] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T21:13:51.843349] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-19T21:13:52.048450] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T21:13:52.146746] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T21:13:52.643264] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-19T21:13:53.443267] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-19T21:13:53.755512] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T21:13:53.825574] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T21:13:54.243283] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-19T21:13:54.880168] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T21:13:55.043322] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-19T21:13:55.843282] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-19T21:13:56.141128] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-19T21:13:56.648426] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-19T21:13:56.671186] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-19T21:13:57.443352] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-19T21:13:57.696577] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T21:13:57.908958] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T21:13:58.243273] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-19T21:13:58.286623] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-19T21:13:59.029616] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T21:13:59.043274] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-19T21:13:59.692614] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-19T21:13:59.843320] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-19T21:14:00.643270] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-19T21:14:01.443284] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-19T21:14:01.829600] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:14:02.040279] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T21:14:02.044845] [INFO ] [REMOTE ] SHG: Full fetch complete (41551 records). [2025-09-19T21:14:02.044958] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-19T21:14:02.161757] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T21:14:02.249955] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-19T21:14:02.453563] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-19T21:14:02.453739] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-19T21:14:02.454682] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-19T21:14:02.454817] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-19T21:14:02.455926] [DEBUG] [LOCAL ] SHG: Trimmed 41551 records to 27955 (keeping 200 days of data) [2025-09-19T21:14:02.633138] [DEBUG] [LOCAL ] SHG: Primary data saved (27955 records). [2025-09-19T21:14:02.633271] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-19T21:14:02.633369] [INFO ] [MAIN ] Update Progress: 1910/2372 symbols completed. SHG took 28.7s. Estimated remaining: 1h 1m 26s. Rate: 7.5 symbols/min [2025-09-19T21:14:02.801999] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:14:02.852276] [DEBUG] [LOCAL ] SHW: Loaded 50914 existing records from primary storage. [2025-09-19T21:14:02.852417] [INFO ] [MAIN ] SHW: Loaded 50914 existing records. [2025-09-19T21:14:03.033326] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:14:03.033550] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-19T21:14:03.033597] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-19T21:14:03.034888] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-19T21:14:03.034950] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-19T21:14:03.048427] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-19T21:14:03.162327] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T21:14:03.416466] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:14:03.843261] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-19T21:14:04.643271] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-19T21:14:04.991140] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T21:14:05.368476] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T21:14:05.443237] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-19T21:14:06.243271] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-19T21:14:06.480384] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-19T21:14:06.874441] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T21:14:06.875506] [INFO ] [REMOTE ] SHOC: Full fetch complete (7555 records). [2025-09-19T21:14:06.875579] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-19T21:14:07.052965] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-19T21:14:07.248072] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-19T21:14:07.248160] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-19T21:14:07.248377] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-19T21:14:07.248425] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-19T21:14:07.248891] [DEBUG] [LOCAL ] SHOC: Trimmed 7555 records to 4258 (keeping 200 days of data) [2025-09-19T21:14:07.274622] [DEBUG] [LOCAL ] SHOC: Primary data saved (4258 records). [2025-09-19T21:14:07.274729] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-19T21:14:07.274817] [INFO ] [MAIN ] Update Progress: 1911/2372 symbols completed. SHOC took 22.1s. Estimated remaining: 1h 1m 17s. Rate: 7.5 symbols/min [2025-09-19T21:14:07.441561] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:14:07.441740] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-19T21:14:07.441785] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-19T21:14:07.441919] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-19T21:14:07.441981] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-19T21:14:07.442023] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-19T21:14:07.442057] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-19T21:14:07.802713] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:14:07.832099] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-19T21:14:07.843216] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-19T21:14:08.161997] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:14:08.162292] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-19T21:14:08.643271] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-19T21:14:08.991129] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:14:08.991470] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-19T21:14:09.066220] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T21:14:09.443276] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-19T21:14:09.729977] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:14:09.730355] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-19T21:14:10.243291] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-19T21:14:11.043290] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-19T21:14:11.843287] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-19T21:14:12.648525] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-19T21:14:12.663478] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T21:14:12.985588] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T21:14:12.996256] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:14:12.997084] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-19T21:14:13.443297] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-19T21:14:13.750891] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:14:13.751195] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-19T21:14:14.243260] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-19T21:14:14.363867] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-19T21:14:15.043253] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-19T21:14:15.843273] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-19T21:14:16.286957] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T21:14:16.448795] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-19T21:14:16.456837] [INFO ] [REMOTE ] SHO: Full fetch complete (71203 records). [2025-09-19T21:14:16.457362] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-19T21:14:16.643425] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-19T21:14:16.866404] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-19T21:14:16.866552] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-19T21:14:16.867668] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-19T21:14:16.867732] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-19T21:14:16.869265] [DEBUG] [LOCAL ] SHO: Trimmed 71203 records to 50584 (keeping 200 days of data) [2025-09-19T21:14:17.041922] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:14:17.052222] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-19T21:14:17.176474] [DEBUG] [LOCAL ] SHO: Primary data saved (50584 records). [2025-09-19T21:14:17.176633] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-19T21:14:17.176892] [INFO ] [MAIN ] Update Progress: 1912/2372 symbols completed. SHO took 33.6s. Estimated remaining: 1h 1m 10s. Rate: 7.5 symbols/min [2025-09-19T21:14:17.345943] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:14:17.387987] [DEBUG] [LOCAL ] SID: Loaded 42466 existing records from primary storage. [2025-09-19T21:14:17.388139] [INFO ] [MAIN ] SID: Loaded 42466 existing records. [2025-09-19T21:14:17.448788] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-19T21:14:17.583414] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:14:17.583699] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-19T21:14:17.583788] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-19T21:14:17.584620] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-19T21:14:17.584719] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-19T21:14:17.937153] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:14:18.134678] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-19T21:14:18.144271] [INFO ] [REMOTE ] SHEL: Full fetch complete (77689 records). [2025-09-19T21:14:18.144462] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-19T21:14:18.248404] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-19T21:14:18.605382] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:14:18.624491] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-19T21:14:18.624583] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-19T21:14:18.625108] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-19T21:14:18.626280] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-19T21:14:18.626346] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-19T21:14:18.628065] [DEBUG] [LOCAL ] SHEL: Trimmed 77689 records to 54452 (keeping 200 days of data) [2025-09-19T21:14:18.979124] [DEBUG] [LOCAL ] SHEL: Primary data saved (54452 records). [2025-09-19T21:14:18.979272] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-19T21:14:18.979372] [INFO ] [MAIN ] Update Progress: 1913/2372 symbols completed. SHEL took 48.2s. Estimated remaining: 1h 1m 0s. Rate: 7.5 symbols/min [2025-09-19T21:14:19.048331] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-19T21:14:19.155958] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:14:19.204998] [DEBUG] [LOCAL ] SIG: Loaded 47088 existing records from primary storage. [2025-09-19T21:14:19.205168] [INFO ] [MAIN ] SIG: Loaded 47088 existing records. [2025-09-19T21:14:19.404226] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:14:19.404591] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-19T21:14:19.404674] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-19T21:14:19.405737] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-19T21:14:19.405797] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-19T21:14:19.704801] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-19T21:14:19.808979] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:14:19.840447] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-19T21:14:19.849441] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-19T21:14:20.643294] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-19T21:14:21.443306] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-19T21:14:21.799554] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T21:14:22.243297] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-19T21:14:22.495595] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T21:14:23.043250] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-19T21:14:23.078284] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T21:14:23.153532] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-19T21:14:23.843281] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-19T21:14:24.643260] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-19T21:14:24.947738] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T21:14:25.048576] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T21:14:25.051612] [INFO ] [REMOTE ] SI: Full fetch complete (5429 records). [2025-09-19T21:14:25.051709] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-19T21:14:25.238476] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 36 unique days, need 200 days [2025-09-19T21:14:25.238799] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:14:25.238870] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:14:25.238941] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-19T21:14:25.239004] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-19T21:14:25.239040] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-19T21:14:25.239095] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-19T21:14:25.239172] [INFO ] [MAIN ] Update Progress: 1914/2372 symbols completed. SI took 18.0s. Estimated remaining: 1h 0m 52s. Rate: 7.5 symbols/min [2025-09-19T21:14:25.408032] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:14:25.430816] [DEBUG] [LOCAL ] SII: Loaded 23155 existing records from primary storage. [2025-09-19T21:14:25.430944] [INFO ] [MAIN ] SII: Loaded 23155 existing records. [2025-09-19T21:14:25.451450] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-19T21:14:25.613630] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:14:25.613912] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-19T21:14:25.613960] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-19T21:14:25.614827] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-19T21:14:25.614916] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-19T21:14:25.974175] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:14:26.243292] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-19T21:14:26.681858] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T21:14:27.043295] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-19T21:14:27.134232] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T21:14:27.372335] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T21:14:27.843296] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-19T21:14:28.257999] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T21:14:28.643274] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-19T21:14:29.443273] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-19T21:14:29.734110] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:14:29.929226] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T21:14:30.243251] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-19T21:14:30.834468] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-19T21:14:30.902257] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-19T21:14:31.043245] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-19T21:14:31.843236] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-19T21:14:32.369484] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-19T21:14:32.643267] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-19T21:14:33.443246] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-19T21:14:33.972609] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T21:14:34.243289] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-19T21:14:34.627490] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T21:14:34.999198] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T21:14:35.043225] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-19T21:14:35.843261] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-19T21:14:36.450286] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T21:14:36.485857] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T21:14:36.643297] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-19T21:14:37.443284] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-19T21:14:37.756870] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T21:14:37.968471] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T21:14:38.243314] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-19T21:14:39.043337] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-19T21:14:39.482191] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T21:14:39.590635] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T21:14:39.843314] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-19T21:14:40.643307] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-19T21:14:41.074533] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T21:14:41.082124] [INFO ] [REMOTE ] SHW: Full fetch complete (73016 records). [2025-09-19T21:14:41.082261] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-19T21:14:41.448425] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-19T21:14:41.469706] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-19T21:14:41.470983] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-19T21:14:41.472059] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-19T21:14:41.472210] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-19T21:14:41.473680] [DEBUG] [LOCAL ] SHW: Trimmed 73016 records to 51268 (keeping 200 days of data) [2025-09-19T21:14:41.746412] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T21:14:41.840300] [DEBUG] [LOCAL ] SHW: Primary data saved (51268 records). [2025-09-19T21:14:41.840437] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-19T21:14:41.840521] [INFO ] [MAIN ] Update Progress: 1915/2372 symbols completed. SHW took 39.2s. Estimated remaining: 1h 0m 46s. Rate: 7.5 symbols/min [2025-09-19T21:14:42.009582] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:14:42.039869] [DEBUG] [LOCAL ] SILA: Loaded 31543 existing records from primary storage. [2025-09-19T21:14:42.040003] [INFO ] [MAIN ] SILA: Loaded 31543 existing records. [2025-09-19T21:14:42.219245] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:14:42.219500] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-19T21:14:42.219547] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-19T21:14:42.220387] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-19T21:14:42.220447] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-19T21:14:42.251581] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-19T21:14:42.591310] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:14:42.606002] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T21:14:42.637503] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:14:43.043310] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-19T21:14:43.843264] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-19T21:14:44.355279] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T21:14:44.422949] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T21:14:44.643329] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-19T21:14:45.443323] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-19T21:14:45.489451] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T21:14:46.243266] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-19T21:14:46.651355] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T21:14:46.733179] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T21:14:47.043264] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-19T21:14:47.657810] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-19T21:14:47.843280] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-19T21:14:48.643338] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-19T21:14:49.071484] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T21:14:49.075173] [INFO ] [REMOTE ] SII: Full fetch complete (29459 records). [2025-09-19T21:14:49.075250] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-19T21:14:49.418197] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-19T21:14:49.460420] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-19T21:14:49.502524] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-19T21:14:49.502602] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-19T21:14:49.503220] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-19T21:14:49.503281] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-19T21:14:49.504071] [DEBUG] [LOCAL ] SII: Trimmed 29459 records to 23334 (keeping 200 days of data) [2025-09-19T21:14:49.650372] [DEBUG] [LOCAL ] SII: Primary data saved (23334 records). [2025-09-19T21:14:49.650507] [INFO ] [MAIN ] SII: Full history saved. [2025-09-19T21:14:49.650604] [INFO ] [MAIN ] Update Progress: 1916/2372 symbols completed. SII took 24.4s. Estimated remaining: 1h 0m 38s. Rate: 7.5 symbols/min [2025-09-19T21:14:49.817639] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:14:49.861364] [DEBUG] [LOCAL ] SITC: Loaded 41957 existing records from primary storage. [2025-09-19T21:14:49.861510] [INFO ] [MAIN ] SITC: Loaded 41957 existing records. [2025-09-19T21:14:50.037421] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:14:50.037731] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-19T21:14:50.037787] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-19T21:14:50.038915] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-19T21:14:50.038974] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-19T21:14:50.248407] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-19T21:14:50.400779] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:14:50.497338] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T21:14:50.541095] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T21:14:51.043292] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-19T21:14:51.746704] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-19T21:14:51.843302] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-19T21:14:52.338681] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T21:14:52.643332] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-19T21:14:53.442857] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T21:14:53.449837] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-19T21:14:54.243323] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-19T21:14:54.490636] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T21:14:54.497459] [INFO ] [REMOTE ] SID: Full fetch complete (60922 records). [2025-09-19T21:14:54.497619] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-19T21:14:54.890763] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-19T21:14:54.890848] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-19T21:14:54.892061] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-19T21:14:54.892128] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-19T21:14:54.893354] [DEBUG] [LOCAL ] SID: Trimmed 60922 records to 42784 (keeping 200 days of data) [2025-09-19T21:14:55.049098] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-19T21:14:55.135466] [DEBUG] [LOCAL ] SID: Primary data saved (42784 records). [2025-09-19T21:14:55.135665] [INFO ] [MAIN ] SID: Full history saved. [2025-09-19T21:14:55.135788] [INFO ] [MAIN ] Update Progress: 1917/2372 symbols completed. SID took 38.0s. Estimated remaining: 1h 0m 29s. Rate: 7.5 symbols/min [2025-09-19T21:14:55.338338] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T21:14:55.345928] [INFO ] [REMOTE ] SIG: Full fetch complete (68404 records). [2025-09-19T21:14:55.346191] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-19T21:14:55.767478] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-19T21:14:55.767597] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-19T21:14:55.769007] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-19T21:14:55.769082] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-19T21:14:55.771072] [DEBUG] [LOCAL ] SIG: Trimmed 68404 records to 47367 (keeping 200 days of data) [2025-09-19T21:14:56.034247] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T21:14:56.043830] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-19T21:14:56.123778] [DEBUG] [LOCAL ] SIG: Primary data saved (47367 records). [2025-09-19T21:14:56.123947] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-19T21:14:56.124055] [INFO ] [MAIN ] Update Progress: 1918/2372 symbols completed. SIG took 37.1s. Estimated remaining: 1h 0m 20s. Rate: 7.5 symbols/min [2025-09-19T21:14:56.277193] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T21:14:56.643319] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-19T21:14:57.765683] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T21:14:57.774440] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-19T21:14:57.813390] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T21:14:58.243358] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-19T21:14:59.425844] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T21:14:59.433882] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-19T21:15:00.026634] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T21:15:00.036595] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-19T21:15:00.708163] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T21:15:00.717358] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-19T21:15:01.917331] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T21:15:01.928537] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-19T21:15:02.900753] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T21:15:02.908705] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-19T21:15:05.059733] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-09-19T21:15:05.068362] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-19T21:15:05.819306] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-19T21:15:05.826259] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-19T21:15:06.311004] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-19T21:15:06.321173] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-19T21:15:06.631087] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T21:15:06.635257] [INFO ] [REMOTE ] SILA: Full fetch complete (45316 records). [2025-09-19T21:15:06.635370] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-19T21:15:07.032389] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-19T21:15:07.032627] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-19T21:15:07.033494] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-19T21:15:07.033543] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-19T21:15:07.034602] [DEBUG] [LOCAL ] SILA: Trimmed 45316 records to 31717 (keeping 200 days of data) [2025-09-19T21:15:07.231174] [DEBUG] [LOCAL ] SILA: Primary data saved (31717 records). [2025-09-19T21:15:07.231325] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-19T21:15:07.231412] [INFO ] [MAIN ] Update Progress: 1919/2372 symbols completed. SILA took 25.4s. Estimated remaining: 1h 0m 12s. Rate: 7.5 symbols/min [2025-09-19T21:15:08.296616] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T21:15:08.306387] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-19T21:15:09.959580] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T21:15:09.968540] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-19T21:15:11.765725] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T21:15:11.775863] [INFO ] [REMOTE ] SITC: Full fetch complete (60862 records). [2025-09-19T21:15:11.776067] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-19T21:15:12.203241] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-19T21:15:12.203346] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-19T21:15:12.204335] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-19T21:15:12.204398] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-19T21:15:12.205694] [DEBUG] [LOCAL ] SITC: Trimmed 60862 records to 42271 (keeping 200 days of data) [2025-09-19T21:15:12.462346] [DEBUG] [LOCAL ] SITC: Primary data saved (42271 records). [2025-09-19T21:15:12.462474] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-19T21:15:12.462554] [INFO ] [MAIN ] Update Progress: 1920/2372 symbols completed. SITC took 22.8s. Estimated remaining: 1h 0m 4s. Rate: 7.5 symbols/min [2025-09-19T21:15:13.043315] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:15:13.158624] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:15:13.179005] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:15:13.183370] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:15:13.227687] [DEBUG] [LOCAL ] SJT: Loaded 22312 existing records from primary storage. [2025-09-19T21:15:13.234704] [INFO ] [MAIN ] SJT: Loaded 22312 existing records. [2025-09-19T21:15:13.389170] [DEBUG] [LOCAL ] SKE: Loaded 35645 existing records from primary storage. [2025-09-19T21:15:13.409488] [INFO ] [MAIN ] SKE: Loaded 35645 existing records. [2025-09-19T21:15:13.438342] [DEBUG] [LOCAL ] SITE: Loaded 35589 existing records from primary storage. [2025-09-19T21:15:13.539978] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:15:13.531265] [INFO ] [MAIN ] SITE: Loaded 35589 existing records. [2025-09-19T21:15:13.563836] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-19T21:15:13.624721] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-19T21:15:13.640726] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-19T21:15:13.655091] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-19T21:15:13.614383] [DEBUG] [LOCAL ] SJM: Loaded 50511 existing records from primary storage. [2025-09-19T21:15:13.684567] [INFO ] [MAIN ] SJM: Loaded 50511 existing records. [2025-09-19T21:15:14.070386] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:15:14.279823] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-19T21:15:14.297906] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:15:14.303784] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:15:14.337334] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-19T21:15:14.330059] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-19T21:15:14.361830] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-19T21:15:14.356463] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-19T21:15:14.392187] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-19T21:15:14.392533] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-19T21:15:14.403053] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-19T21:15:14.392403] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-19T21:15:14.403218] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-19T21:15:14.429478] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-19T21:15:14.454195] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-19T21:15:14.842967] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:15:14.901364] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-19T21:15:15.630080] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:15:15.630407] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-19T21:15:15.586569] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:15:15.666750] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:15:15.662601] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-19T21:15:15.667114] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-19T21:15:16.687782] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T21:15:16.693517] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-19T21:15:17.249880] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T21:15:17.274217] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T21:15:17.273461] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-19T21:15:17.280747] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-19T21:15:17.402916] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T21:15:17.412726] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-19T21:15:17.507745] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-19T21:15:17.512122] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-19T21:15:18.818065] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T21:15:18.824743] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-19T21:15:19.060784] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T21:15:19.067287] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-19T21:15:19.080895] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T21:15:19.086203] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-19T21:15:20.328212] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-09-19T21:15:20.338438] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-19T21:15:21.012964] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-19T21:15:21.020099] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-19T21:15:21.159020] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T21:15:21.166162] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-19T21:15:21.286066] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-19T21:15:21.291168] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-19T21:15:22.048230] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T21:15:22.059007] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-19T21:15:22.139494] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T21:15:22.148851] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-19T21:15:22.857556] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T21:15:22.863154] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-19T21:15:22.955921] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T21:15:22.963747] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-19T21:15:23.643938] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T21:15:23.655690] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-19T21:15:23.894187] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T21:15:23.902564] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-19T21:15:23.944115] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-19T21:15:24.643315] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-19T21:15:24.897410] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T21:15:24.994960] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-19T21:15:25.102871] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T21:15:25.443275] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-19T21:15:25.988613] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T21:15:26.243263] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-19T21:15:27.043271] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-19T21:15:27.413120] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-19T21:15:27.843310] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-19T21:15:27.896889] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T21:15:27.919805] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T21:15:28.643320] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-19T21:15:29.443278] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-19T21:15:29.620999] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T21:15:30.245231] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-19T21:15:30.247933] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T21:15:31.043346] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-19T21:15:31.079305] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T21:15:31.658738] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-19T21:15:31.843310] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-19T21:15:32.162373] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T21:15:32.643320] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-19T21:15:33.147411] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T21:15:33.151127] [INFO ] [REMOTE ] SJT: Full fetch complete (32118 records). [2025-09-19T21:15:33.151212] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-19T21:15:33.448713] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-19T21:15:33.562025] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-19T21:15:33.562115] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-19T21:15:33.562838] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-19T21:15:33.562913] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-19T21:15:33.563819] [DEBUG] [LOCAL ] SJT: Trimmed 32118 records to 22386 (keeping 200 days of data) [2025-09-19T21:15:33.700167] [DEBUG] [LOCAL ] SJT: Primary data saved (22386 records). [2025-09-19T21:15:33.700415] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-19T21:15:33.700548] [INFO ] [MAIN ] Update Progress: 1921/2372 symbols completed. SJT took 21.2s. Estimated remaining: 59m 59s. Rate: 7.5 symbols/min [2025-09-19T21:15:33.874026] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:15:33.882376] [DEBUG] [LOCAL ] SKIL: Loaded 6445 existing records from primary storage. [2025-09-19T21:15:33.882495] [INFO ] [MAIN ] SKIL: Loaded 6445 existing records. [2025-09-19T21:15:34.061910] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:15:34.062155] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-19T21:15:34.062203] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-19T21:15:34.062582] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-19T21:15:34.062693] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-19T21:15:34.246850] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-19T21:15:34.365479] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T21:15:34.416031] [INFO ] [REMOTE ] SKE: Full fetch complete (50078 records). [2025-09-19T21:15:34.430541] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-19T21:15:34.518356] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:15:34.854096] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-19T21:15:34.854180] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-19T21:15:34.855187] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-19T21:15:34.855250] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-19T21:15:34.856479] [DEBUG] [LOCAL ] SKE: Trimmed 50078 records to 35981 (keeping 200 days of data) [2025-09-19T21:15:35.044880] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-19T21:15:35.075127] [DEBUG] [LOCAL ] SKE: Primary data saved (35981 records). [2025-09-19T21:15:35.075288] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-19T21:15:35.075411] [INFO ] [MAIN ] Update Progress: 1922/2372 symbols completed. SKE took 22.6s. Estimated remaining: 59m 49s. Rate: 7.5 symbols/min [2025-09-19T21:15:35.263747] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:15:35.290115] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T21:15:35.308362] [DEBUG] [LOCAL ] SKLZ: Loaded 12122 existing records from primary storage. [2025-09-19T21:15:35.308940] [INFO ] [MAIN ] SKLZ: Loaded 12122 existing records. [2025-09-19T21:15:35.491933] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:15:35.492251] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-19T21:15:35.492309] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-19T21:15:35.492724] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-19T21:15:35.492794] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-19T21:15:35.813100] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-19T21:15:35.877947] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:15:35.871863] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-19T21:15:36.385334] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-19T21:15:36.463850] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-19T21:15:36.643246] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-19T21:15:37.443267] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-19T21:15:38.243274] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-19T21:15:38.278338] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T21:15:39.043330] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-19T21:15:39.097492] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T21:15:39.563165] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-19T21:15:39.843247] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-19T21:15:39.878312] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-19T21:15:40.643243] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-19T21:15:41.187376] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T21:15:41.443276] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-19T21:15:42.176348] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T21:15:42.243224] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-19T21:15:42.492802] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T21:15:43.043277] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-19T21:15:43.614272] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T21:15:43.621957] [INFO ] [REMOTE ] SJM: Full fetch complete (72003 records). [2025-09-19T21:15:43.622085] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-19T21:15:43.808023] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-19T21:15:43.848443] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-19T21:15:44.043863] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-19T21:15:44.043968] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-19T21:15:44.045120] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-19T21:15:44.045206] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-19T21:15:44.052464] [DEBUG] [LOCAL ] SJM: Trimmed 72003 records to 50900 (keeping 200 days of data) [2025-09-19T21:15:44.387141] [DEBUG] [LOCAL ] SJM: Primary data saved (50900 records). [2025-09-19T21:15:44.387314] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-19T21:15:44.387425] [INFO ] [MAIN ] Update Progress: 1923/2372 symbols completed. SJM took 31.9s. Estimated remaining: 59m 42s. Rate: 7.5 symbols/min [2025-09-19T21:15:44.557857] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:15:44.604461] [DEBUG] [LOCAL ] SKM: Loaded 35636 existing records from primary storage. [2025-09-19T21:15:44.604763] [INFO ] [MAIN ] SKM: Loaded 35636 existing records. [2025-09-19T21:15:44.648409] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-19T21:15:44.794013] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:15:44.794373] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-19T21:15:44.794438] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-19T21:15:44.795422] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-19T21:15:44.795500] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-19T21:15:45.153900] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:15:45.270836] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T21:15:45.283513] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-19T21:15:45.283775] [INFO ] [REMOTE ] SITE: Full fetch complete (49181 records). [2025-09-19T21:15:45.285962] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-19T21:15:45.450964] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-19T21:15:45.707235] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-19T21:15:45.707320] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-19T21:15:45.708222] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-19T21:15:45.708285] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-19T21:15:45.709835] [DEBUG] [LOCAL ] SITE: Trimmed 49181 records to 35827 (keeping 200 days of data) [2025-09-19T21:15:45.952441] [DEBUG] [LOCAL ] SITE: Primary data saved (35827 records). [2025-09-19T21:15:45.952624] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-19T21:15:45.952894] [INFO ] [MAIN ] Update Progress: 1924/2372 symbols completed. SITE took 33.5s. Estimated remaining: 59m 32s. Rate: 7.5 symbols/min [2025-09-19T21:15:46.126818] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:15:46.171707] [DEBUG] [LOCAL ] SKT: Loaded 42905 existing records from primary storage. [2025-09-19T21:15:46.171853] [INFO ] [MAIN ] SKT: Loaded 42905 existing records. [2025-09-19T21:15:46.248445] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-19T21:15:46.354836] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:15:46.355094] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-19T21:15:46.355141] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-19T21:15:46.356118] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-19T21:15:46.356179] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-19T21:15:46.721531] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:15:47.043230] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-19T21:15:47.214395] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T21:15:47.334688] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T21:15:47.843283] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-19T21:15:48.643267] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-19T21:15:48.658117] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T21:15:48.996062] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T21:15:49.443264] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-19T21:15:49.985897] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T21:15:50.243262] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-19T21:15:50.721600] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T21:15:50.991530] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T21:15:51.043242] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-19T21:15:51.843322] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-19T21:15:52.643278] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-19T21:15:52.851198] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T21:15:53.404120] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T21:15:53.416737] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-19T21:15:53.443216] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-19T21:15:54.243278] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-19T21:15:54.568937] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-19T21:15:55.043324] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-19T21:15:55.843273] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-19T21:15:56.023818] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T21:15:56.643284] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-19T21:15:56.806730] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T21:15:56.815712] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T21:15:57.443316] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-19T21:15:57.524769] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T21:15:58.243261] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-19T21:15:58.702460] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T21:15:59.043261] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-19T21:15:59.557531] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T21:15:59.841928] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-19T21:15:59.843216] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-19T21:16:00.643259] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-19T21:16:01.064465] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T21:16:01.443257] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-19T21:16:01.683629] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T21:16:01.686153] [INFO ] [REMOTE ] SKIL: Full fetch complete (10008 records). [2025-09-19T21:16:01.686228] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-19T21:16:02.059422] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-19T21:16:02.059594] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-19T21:16:02.059888] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-19T21:16:02.059947] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-19T21:16:02.060422] [DEBUG] [LOCAL ] SKIL: Trimmed 10008 records to 6478 (keeping 200 days of data) [2025-09-19T21:16:02.101759] [DEBUG] [LOCAL ] SKIL: Primary data saved (6478 records). [2025-09-19T21:16:02.101901] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-19T21:16:02.102078] [INFO ] [MAIN ] Update Progress: 1925/2372 symbols completed. SKIL took 28.4s. Estimated remaining: 59m 26s. Rate: 7.5 symbols/min [2025-09-19T21:16:02.250041] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-19T21:16:02.285404] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:16:02.348070] [DEBUG] [LOCAL ] SKY: Loaded 37932 existing records from primary storage. [2025-09-19T21:16:02.348218] [INFO ] [MAIN ] SKY: Loaded 37932 existing records. [2025-09-19T21:16:02.537719] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:16:02.537971] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-19T21:16:02.538022] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-19T21:16:02.539179] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-19T21:16:02.539247] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-19T21:16:02.961871] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:16:02.968376] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T21:16:02.970698] [INFO ] [REMOTE ] SKLZ: Full fetch complete (19137 records). [2025-09-19T21:16:02.970781] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-19T21:16:03.048369] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-19T21:16:03.359341] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-19T21:16:03.359534] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-19T21:16:03.360118] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-19T21:16:03.360201] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-19T21:16:03.361273] [DEBUG] [LOCAL ] SKLZ: Trimmed 19137 records to 12179 (keeping 200 days of data) [2025-09-19T21:16:03.481439] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T21:16:03.510362] [DEBUG] [LOCAL ] SKLZ: Primary data saved (12179 records). [2025-09-19T21:16:03.510519] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-19T21:16:03.510608] [INFO ] [MAIN ] Update Progress: 1926/2372 symbols completed. SKLZ took 28.4s. Estimated remaining: 59m 17s. Rate: 7.5 symbols/min [2025-09-19T21:16:03.693255] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:16:03.714305] [DEBUG] [LOCAL ] SKYH: Loaded 16725 existing records from primary storage. [2025-09-19T21:16:03.714450] [INFO ] [MAIN ] SKYH: Loaded 16725 existing records. [2025-09-19T21:16:03.856934] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-19T21:16:03.903140] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:16:03.903475] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-19T21:16:03.903536] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-19T21:16:03.904702] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-19T21:16:03.904767] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-19T21:16:04.455297] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:16:04.643326] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-19T21:16:05.008311] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T21:16:05.443266] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-19T21:16:05.620397] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T21:16:06.198055] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T21:16:06.243283] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-19T21:16:06.297407] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-19T21:16:07.043295] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-19T21:16:07.843277] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-19T21:16:08.269380] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T21:16:08.391232] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T21:16:08.643289] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-19T21:16:09.126116] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T21:16:09.443272] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-19T21:16:10.007253] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-19T21:16:10.243268] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-19T21:16:10.368299] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T21:16:11.043230] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-19T21:16:11.843262] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-19T21:16:11.909438] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T21:16:12.609842] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T21:16:12.643224] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-19T21:16:12.691254] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-19T21:16:13.443290] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-19T21:16:13.885457] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T21:16:13.891284] [INFO ] [REMOTE ] SKM: Full fetch complete (48103 records). [2025-09-19T21:16:13.891444] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-19T21:16:14.263533] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-19T21:16:14.281866] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-19T21:16:14.281969] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-19T21:16:14.283933] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-19T21:16:14.284133] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-19T21:16:14.285375] [DEBUG] [LOCAL ] SKM: Trimmed 48103 records to 35883 (keeping 200 days of data) [2025-09-19T21:16:14.516144] [DEBUG] [LOCAL ] SKM: Primary data saved (35883 records). [2025-09-19T21:16:14.516302] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-19T21:16:14.516405] [INFO ] [MAIN ] Update Progress: 1927/2372 symbols completed. SKM took 30.1s. Estimated remaining: 59m 9s. Rate: 7.5 symbols/min [2025-09-19T21:16:14.684556] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:16:14.740091] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-09-19T21:16:14.740237] [INFO ] [MAIN ] SLB: Loaded 54087 existing records. [2025-09-19T21:16:14.939910] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T21:16:14.940039] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:16:14.947916] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-19T21:16:14.948257] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-19T21:16:14.949590] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-19T21:16:14.949685] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-19T21:16:15.049832] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-19T21:16:15.311582] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:16:15.843275] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-19T21:16:16.378307] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T21:16:16.430804] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T21:16:16.643274] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-19T21:16:17.443329] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-19T21:16:17.636093] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T21:16:18.244509] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-19T21:16:18.250346] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-19T21:16:19.043301] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-19T21:16:19.474093] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T21:16:19.498624] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T21:16:19.843275] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-19T21:16:20.569669] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T21:16:20.643231] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-19T21:16:21.443279] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-19T21:16:21.557988] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T21:16:22.243306] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-19T21:16:23.025846] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-19T21:16:23.043212] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-19T21:16:23.302845] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T21:16:23.566024] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T21:16:23.843272] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-19T21:16:24.643244] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-19T21:16:25.017958] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T21:16:25.312862] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T21:16:25.443226] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-19T21:16:26.152021] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T21:16:26.158774] [INFO ] [REMOTE ] SKT: Full fetch complete (59931 records). [2025-09-19T21:16:26.158927] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-19T21:16:26.250007] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-19T21:16:26.547356] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-19T21:16:26.547446] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-19T21:16:26.548504] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-19T21:16:26.548566] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-19T21:16:26.552384] [DEBUG] [LOCAL ] SKT: Trimmed 59931 records to 43272 (keeping 200 days of data) [2025-09-19T21:16:26.766390] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T21:16:26.863371] [DEBUG] [LOCAL ] SKT: Primary data saved (43272 records). [2025-09-19T21:16:26.863576] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-19T21:16:26.863767] [INFO ] [MAIN ] Update Progress: 1928/2372 symbols completed. SKT took 40.9s. Estimated remaining: 59m 2s. Rate: 7.5 symbols/min [2025-09-19T21:16:27.040009] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:16:27.043263] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-19T21:16:27.084861] [DEBUG] [LOCAL ] SLF: Loaded 39573 existing records from primary storage. [2025-09-19T21:16:27.085028] [INFO ] [MAIN ] SLF: Loaded 39573 existing records. [2025-09-19T21:16:27.265149] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:16:27.265410] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-19T21:16:27.265470] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-19T21:16:27.266423] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-19T21:16:27.266483] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-19T21:16:27.648844] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:16:27.843278] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-19T21:16:27.993600] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T21:16:28.643272] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-19T21:16:28.808134] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T21:16:28.959720] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T21:16:29.443278] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-19T21:16:29.633023] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-19T21:16:29.635701] [INFO ] [REMOTE ] SKYH: Full fetch complete (22578 records). [2025-09-19T21:16:29.635784] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-19T21:16:30.002202] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-19T21:16:30.002283] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-19T21:16:30.002797] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-19T21:16:30.002857] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-19T21:16:30.003494] [DEBUG] [LOCAL ] SKYH: Trimmed 22578 records to 16800 (keeping 200 days of data) [2025-09-19T21:16:30.118983] [DEBUG] [LOCAL ] SKYH: Primary data saved (16800 records). [2025-09-19T21:16:30.119209] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-19T21:16:30.119334] [INFO ] [MAIN ] Update Progress: 1929/2372 symbols completed. SKYH took 26.6s. Estimated remaining: 58m 53s. Rate: 7.5 symbols/min [2025-09-19T21:16:30.248415] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-19T21:16:30.299331] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:16:30.362006] [DEBUG] [LOCAL ] SLG: Loaded 46009 existing records from primary storage. [2025-09-19T21:16:30.362195] [INFO ] [MAIN ] SLG: Loaded 46009 existing records. [2025-09-19T21:16:30.550452] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:16:30.550782] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-19T21:16:30.550837] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-19T21:16:30.552018] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-19T21:16:30.552092] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-19T21:16:30.909411] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:16:31.043226] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-19T21:16:31.468595] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T21:16:31.843326] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-19T21:16:32.209636] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T21:16:32.643283] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-19T21:16:33.311155] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T21:16:33.443220] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-19T21:16:33.668606] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T21:16:33.675314] [INFO ] [REMOTE ] SKY: Full fetch complete (54839 records). [2025-09-19T21:16:33.675442] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-19T21:16:34.061592] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-19T21:16:34.061729] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-19T21:16:34.062637] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-19T21:16:34.062718] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-19T21:16:34.063833] [DEBUG] [LOCAL ] SKY: Trimmed 54839 records to 38269 (keeping 200 days of data) [2025-09-19T21:16:34.266262] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-19T21:16:34.303872] [DEBUG] [LOCAL ] SKY: Primary data saved (38269 records). [2025-09-19T21:16:34.303996] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-19T21:16:34.304882] [INFO ] [MAIN ] Update Progress: 1930/2372 symbols completed. SKY took 32.2s. Estimated remaining: 58m 45s. Rate: 7.5 symbols/min [2025-09-19T21:16:34.501430] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:16:34.512539] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T21:16:34.563290] [DEBUG] [LOCAL ] SLGN: Loaded 40594 existing records from primary storage. [2025-09-19T21:16:34.563438] [INFO ] [MAIN ] SLGN: Loaded 40594 existing records. [2025-09-19T21:16:34.742710] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:16:34.743207] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-19T21:16:34.743359] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-19T21:16:34.744455] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-19T21:16:34.744519] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-19T21:16:35.050970] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-19T21:16:35.097596] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-19T21:16:35.150843] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:16:35.843290] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-19T21:16:36.533585] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T21:16:36.643235] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-19T21:16:37.024128] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T21:16:37.443258] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-19T21:16:37.807632] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T21:16:38.243262] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-19T21:16:39.037331] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-19T21:16:39.047978] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-19T21:16:39.188674] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T21:16:39.416502] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-19T21:16:39.843281] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-19T21:16:40.643263] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-19T21:16:40.890194] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T21:16:41.443284] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-19T21:16:41.545639] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T21:16:42.247269] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-19T21:16:42.701180] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T21:16:43.043273] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-19T21:16:43.155688] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T21:16:43.345045] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-19T21:16:43.843255] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-19T21:16:44.643326] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-19T21:16:45.012537] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T21:16:45.443264] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-19T21:16:45.542855] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T21:16:46.243282] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-19T21:16:46.455598] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T21:16:47.043272] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-19T21:16:47.603349] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T21:16:47.843271] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-19T21:16:48.198160] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T21:16:48.643338] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-19T21:16:48.839887] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T21:16:49.210594] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T21:16:49.443280] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-19T21:16:50.243270] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-19T21:16:51.043297] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-19T21:16:51.088962] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-19T21:16:51.294559] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T21:16:51.598754] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T21:16:51.843262] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-19T21:16:52.102630] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T21:16:52.108379] [INFO ] [REMOTE ] SLF: Full fetch complete (56599 records). [2025-09-19T21:16:52.108486] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-19T21:16:52.514905] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-19T21:16:52.514993] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-19T21:16:52.516056] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-19T21:16:52.516122] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-19T21:16:52.517518] [DEBUG] [LOCAL ] SLF: Trimmed 56599 records to 39801 (keeping 200 days of data) [2025-09-19T21:16:52.643332] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-19T21:16:52.768100] [DEBUG] [LOCAL ] SLF: Primary data saved (39801 records). [2025-09-19T21:16:52.768234] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-19T21:16:52.768322] [INFO ] [MAIN ] Update Progress: 1931/2372 symbols completed. SLF took 25.9s. Estimated remaining: 58m 39s. Rate: 7.5 symbols/min [2025-09-19T21:16:52.958240] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:16:52.958454] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-19T21:16:52.958521] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-19T21:16:52.958827] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-19T21:16:52.958895] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-19T21:16:52.958944] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-19T21:16:52.959003] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-19T21:16:53.341367] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:16:53.448353] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-19T21:16:53.464032] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T21:16:53.916009] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-19T21:16:54.243267] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-19T21:16:54.627022] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T21:16:55.043280] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-19T21:16:55.409340] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T21:16:55.517463] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-19T21:16:55.843289] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-19T21:16:56.310692] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-19T21:16:56.643273] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-19T21:16:57.443351] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-19T21:16:58.243364] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-19T21:16:58.617346] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T21:16:59.043297] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-19T21:16:59.280903] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T21:16:59.387506] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-19T21:16:59.843270] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-19T21:16:59.971694] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T21:16:59.979598] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-09-19T21:16:59.979755] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-19T21:17:00.391083] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-19T21:17:00.391207] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-19T21:17:00.392310] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-19T21:17:00.392383] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-19T21:17:00.394721] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 54477 (keeping 200 days of data) [2025-09-19T21:17:00.646728] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-19T21:17:00.737891] [DEBUG] [LOCAL ] SLB: Primary data saved (54477 records). [2025-09-19T21:17:00.738028] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-19T21:17:00.738169] [INFO ] [MAIN ] Update Progress: 1932/2372 symbols completed. SLB took 46.2s. Estimated remaining: 58m 31s. Rate: 7.5 symbols/min [2025-09-19T21:17:00.945873] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:00.986816] [DEBUG] [LOCAL ] SLQT: Loaded 44598 existing records from primary storage. [2025-09-19T21:17:00.986960] [INFO ] [MAIN ] SLQT: Loaded 44598 existing records. [2025-09-19T21:17:01.169481] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:17:01.169783] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-19T21:17:01.169835] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-19T21:17:01.170794] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-19T21:17:01.170854] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-19T21:17:01.453692] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-19T21:17:01.551883] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:01.610201] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T21:17:01.957908] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T21:17:02.243313] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-19T21:17:02.624837] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T21:17:02.632042] [INFO ] [REMOTE ] SLG: Full fetch complete (65429 records). [2025-09-19T21:17:02.632166] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-19T21:17:02.739399] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-19T21:17:03.030440] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-19T21:17:03.030536] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-19T21:17:03.031674] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-19T21:17:03.031740] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-19T21:17:03.033238] [DEBUG] [LOCAL ] SLG: Trimmed 65429 records to 46335 (keeping 200 days of data) [2025-09-19T21:17:03.090533] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-19T21:17:03.325295] [DEBUG] [LOCAL ] SLG: Primary data saved (46335 records). [2025-09-19T21:17:03.325458] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-19T21:17:03.325564] [INFO ] [MAIN ] Update Progress: 1933/2372 symbols completed. SLG took 33.2s. Estimated remaining: 58m 22s. Rate: 7.5 symbols/min [2025-09-19T21:17:03.496754] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:03.526019] [DEBUG] [LOCAL ] SLVM: Loaded 28220 existing records from primary storage. [2025-09-19T21:17:03.526197] [INFO ] [MAIN ] SLVM: Loaded 28220 existing records. [2025-09-19T21:17:03.633408] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-19T21:17:03.715119] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:17:03.715395] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-19T21:17:03.715447] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-19T21:17:03.716259] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-19T21:17:03.716327] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-19T21:17:03.848404] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-19T21:17:04.091775] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:04.384187] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T21:17:04.643275] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-19T21:17:05.071273] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-19T21:17:05.443265] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-19T21:17:06.243287] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-19T21:17:07.043272] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-19T21:17:07.263497] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T21:17:07.270282] [INFO ] [REMOTE ] SLGN: Full fetch complete (57786 records). [2025-09-19T21:17:07.270392] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-19T21:17:07.484321] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T21:17:07.504860] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1054 records). [2025-09-19T21:17:07.505778] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-19T21:17:07.850117] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-19T21:17:07.861331] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-19T21:17:07.873542] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:17:07.876851] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-19T21:17:07.876754] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:17:07.877102] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-19T21:17:07.877212] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-19T21:17:07.877264] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-19T21:17:07.877055] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-19T21:17:07.877394] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-19T21:17:07.878502] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-19T21:17:07.878676] [INFO ] [MAIN ] Update Progress: 1934/2372 symbols completed. SLNZ took 15.1s. Estimated remaining: 58m 13s. Rate: 7.5 symbols/min [2025-09-19T21:17:07.878782] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-19T21:17:07.981293] [DEBUG] [LOCAL ] SLGN: Trimmed 57786 records to 40961 (keeping 200 days of data) [2025-09-19T21:17:08.147887] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:08.185773] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T21:17:08.319284] [DEBUG] [LOCAL ] SM: Loaded 52708 existing records from primary storage. [2025-09-19T21:17:08.349786] [INFO ] [MAIN ] SM: Loaded 52708 existing records. [2025-09-19T21:17:08.548772] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:17:08.553702] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-19T21:17:08.554081] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-19T21:17:08.556525] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-19T21:17:08.556832] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-19T21:17:08.655739] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-19T21:17:08.936036] [DEBUG] [LOCAL ] SLGN: Primary data saved (40961 records). [2025-09-19T21:17:08.943636] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-19T21:17:08.950818] [INFO ] [MAIN ] Update Progress: 1935/2372 symbols completed. SLGN took 34.6s. Estimated remaining: 58m 4s. Rate: 7.5 symbols/min [2025-09-19T21:17:08.949548] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:09.120365] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:09.120587] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-19T21:17:09.120662] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-19T21:17:09.120811] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-19T21:17:09.120854] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-19T21:17:09.120895] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-19T21:17:09.120927] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-19T21:17:09.444097] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-19T21:17:09.479915] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:09.496120] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T21:17:10.243272] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-19T21:17:10.530748] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T21:17:10.544870] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:17:10.545174] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-19T21:17:10.920746] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T21:17:11.043272] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-19T21:17:11.843324] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-19T21:17:12.174691] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:17:12.175040] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-19T21:17:12.643241] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-19T21:17:13.308238] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T21:17:13.443313] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-19T21:17:13.756889] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:17:13.757242] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-19T21:17:14.243281] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-19T21:17:14.725855] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T21:17:15.043296] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-19T21:17:15.843279] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-19T21:17:16.184825] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T21:17:16.450264] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T21:17:16.643293] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-19T21:17:17.443273] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-19T21:17:17.977240] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T21:17:18.243303] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-19T21:17:18.717582] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T21:17:18.966424] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-19T21:17:19.043281] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-19T21:17:19.843299] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-19T21:17:20.185967] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:17:20.187490] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T21:17:20.196758] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-19T21:17:20.643280] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-19T21:17:21.081214] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T21:17:21.443285] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-19T21:17:22.243258] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-19T21:17:22.813242] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T21:17:23.043281] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-19T21:17:23.108229] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T21:17:23.843247] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-19T21:17:23.889838] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-19T21:17:24.545260] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T21:17:24.643276] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-19T21:17:25.358501] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T21:17:25.443286] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-19T21:17:26.243279] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-19T21:17:26.762927] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T21:17:26.801724] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-19T21:17:27.043308] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-19T21:17:27.843327] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-19T21:17:28.096453] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T21:17:28.643393] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-19T21:17:28.966669] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T21:17:29.385898] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T21:17:29.443227] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-19T21:17:30.243247] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-19T21:17:30.333929] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T21:17:31.043278] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-19T21:17:31.226278] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T21:17:31.843357] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-19T21:17:32.423006] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T21:17:32.643294] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-19T21:17:32.714328] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T21:17:33.420135] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T21:17:33.429414] [INFO ] [REMOTE ] SLQT: Full fetch complete (63639 records). [2025-09-19T21:17:33.429631] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-19T21:17:33.448386] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-19T21:17:33.867769] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-19T21:17:33.867857] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-19T21:17:33.869403] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-19T21:17:33.869486] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-19T21:17:33.870790] [DEBUG] [LOCAL ] SLQT: Trimmed 63639 records to 44891 (keeping 200 days of data) [2025-09-19T21:17:34.126859] [DEBUG] [LOCAL ] SLQT: Primary data saved (44891 records). [2025-09-19T21:17:34.127009] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-19T21:17:34.127188] [INFO ] [MAIN ] Update Progress: 1936/2372 symbols completed. SLQT took 33.4s. Estimated remaining: 57m 59s. Rate: 7.5 symbols/min [2025-09-19T21:17:34.248407] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-19T21:17:34.296819] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:34.307601] [DEBUG] [LOCAL ] SMBK: Loaded 8341 existing records from primary storage. [2025-09-19T21:17:34.307790] [INFO ] [MAIN ] SMBK: Loaded 8341 existing records. [2025-09-19T21:17:34.486058] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:17:34.486321] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-19T21:17:34.486370] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-19T21:17:34.486721] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-19T21:17:34.486789] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-19T21:17:34.858239] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:34.896941] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T21:17:34.928728] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T21:17:35.043435] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-19T21:17:35.607919] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T21:17:35.613132] [INFO ] [REMOTE ] SMA: Full fetch complete (28869 records). [2025-09-19T21:17:35.613342] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-19T21:17:35.833800] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 118 unique days, need 200 days [2025-09-19T21:17:35.834469] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:17:35.834559] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:17:35.834692] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-19T21:17:35.834860] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-19T21:17:35.834990] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-19T21:17:35.835115] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-19T21:17:35.835295] [INFO ] [MAIN ] Update Progress: 1937/2372 symbols completed. SMA took 26.9s. Estimated remaining: 57m 50s. Rate: 7.5 symbols/min [2025-09-19T21:17:35.849056] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-19T21:17:36.014678] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:36.043869] [DEBUG] [LOCAL ] SMC: Loaded 11545 existing records from primary storage. [2025-09-19T21:17:36.044021] [INFO ] [MAIN ] SMC: Loaded 11545 existing records. [2025-09-19T21:17:36.167064] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T21:17:36.241359] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:17:36.241721] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-19T21:17:36.241780] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-19T21:17:36.242153] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-19T21:17:36.242275] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-19T21:17:36.614212] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:36.643271] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-19T21:17:37.354509] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T21:17:37.443241] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-19T21:17:37.776833] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T21:17:38.243307] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-19T21:17:38.620266] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T21:17:39.043276] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-19T21:17:39.125577] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T21:17:39.843263] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-19T21:17:40.643275] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-19T21:17:41.089089] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T21:17:41.182167] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T21:17:41.443299] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-19T21:17:41.650536] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T21:17:42.243282] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-19T21:17:43.043236] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-19T21:17:43.207997] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T21:17:43.215937] [INFO ] [REMOTE ] SM: Full fetch complete (75121 records). [2025-09-19T21:17:43.216073] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-19T21:17:43.564599] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T21:17:43.668932] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-19T21:17:43.669016] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-19T21:17:43.670225] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-19T21:17:43.670309] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-19T21:17:43.676944] [DEBUG] [LOCAL ] SM: Trimmed 75121 records to 53092 (keeping 200 days of data) [2025-09-19T21:17:43.876315] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-19T21:17:44.027467] [DEBUG] [LOCAL ] SM: Primary data saved (53092 records). [2025-09-19T21:17:44.027612] [INFO ] [MAIN ] SM: Full history saved. [2025-09-19T21:17:44.027779] [INFO ] [MAIN ] Update Progress: 1938/2372 symbols completed. SM took 36.1s. Estimated remaining: 57m 42s. Rate: 7.5 symbols/min [2025-09-19T21:17:44.195489] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:44.252584] [DEBUG] [LOCAL ] SMFG: Loaded 48525 existing records from primary storage. [2025-09-19T21:17:44.252963] [INFO ] [MAIN ] SMFG: Loaded 48525 existing records. [2025-09-19T21:17:44.428605] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:17:44.428999] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-19T21:17:44.429105] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-19T21:17:44.430561] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-19T21:17:44.430622] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-19T21:17:44.660685] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-19T21:17:44.669206] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T21:17:44.699590] [INFO ] [REMOTE ] SLVM: Full fetch complete (39414 records). [2025-09-19T21:17:44.717545] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-19T21:17:44.934544] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:45.134074] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T21:17:45.234719] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-19T21:17:45.234906] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-19T21:17:45.235748] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-19T21:17:45.235809] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-19T21:17:45.238418] [DEBUG] [LOCAL ] SLVM: Trimmed 39414 records to 28435 (keeping 200 days of data) [2025-09-19T21:17:45.423102] [DEBUG] [LOCAL ] SLVM: Primary data saved (28435 records). [2025-09-19T21:17:45.423244] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-19T21:17:45.423401] [INFO ] [MAIN ] Update Progress: 1939/2372 symbols completed. SLVM took 42.1s. Estimated remaining: 57m 33s. Rate: 7.5 symbols/min [2025-09-19T21:17:45.454497] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-19T21:17:45.599400] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:45.648466] [DEBUG] [LOCAL ] SMG: Loaded 44583 existing records from primary storage. [2025-09-19T21:17:45.648675] [INFO ] [MAIN ] SMG: Loaded 44583 existing records. [2025-09-19T21:17:45.769056] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-19T21:17:45.838997] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:17:45.839277] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-19T21:17:45.839325] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-19T21:17:45.841186] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-19T21:17:45.841250] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-19T21:17:46.206941] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:46.243234] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-19T21:17:47.043332] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-19T21:17:47.611962] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T21:17:47.843272] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-19T21:17:48.004339] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T21:17:48.291393] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-19T21:17:48.643272] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-19T21:17:49.443278] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-19T21:17:49.692479] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-19T21:17:49.779131] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T21:17:50.243334] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-19T21:17:50.489976] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-19T21:17:51.043278] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-19T21:17:51.843282] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-19T21:17:52.097001] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T21:17:52.156625] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T21:17:52.643272] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-19T21:17:52.749687] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T21:17:53.443309] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-19T21:17:53.617816] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T21:17:54.243295] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-19T21:17:55.043328] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-19T21:17:55.297767] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T21:17:55.843265] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-19T21:17:56.129774] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T21:17:56.300812] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T21:17:56.328283] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T21:17:56.329806] [INFO ] [REMOTE ] SMBK: Full fetch complete (11758 records). [2025-09-19T21:17:56.329875] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-19T21:17:56.653924] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-19T21:17:56.700601] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-19T21:17:56.700757] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-19T21:17:56.701054] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-19T21:17:56.701094] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-19T21:17:56.701591] [DEBUG] [LOCAL ] SMBK: Trimmed 11758 records to 8378 (keeping 200 days of data) [2025-09-19T21:17:56.762596] [DEBUG] [LOCAL ] SMBK: Primary data saved (8378 records). [2025-09-19T21:17:56.762782] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-19T21:17:56.762881] [INFO ] [MAIN ] Update Progress: 1940/2372 symbols completed. SMBK took 22.6s. Estimated remaining: 57m 25s. Rate: 7.5 symbols/min [2025-09-19T21:17:56.932867] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:17:56.956817] [DEBUG] [LOCAL ] SMHI: Loaded 14702 existing records from primary storage. [2025-09-19T21:17:56.956961] [INFO ] [MAIN ] SMHI: Loaded 14702 existing records. [2025-09-19T21:17:57.153524] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:17:57.153837] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-19T21:17:57.153891] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-19T21:17:57.154456] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-19T21:17:57.154518] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-19T21:17:57.448447] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-19T21:17:57.517137] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:17:58.243275] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-19T21:17:58.630996] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T21:17:59.043277] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-19T21:17:59.577023] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T21:17:59.834397] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-19T21:17:59.843209] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-19T21:18:00.643259] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-19T21:18:01.373912] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T21:18:01.443309] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-19T21:18:01.489481] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T21:18:01.876375] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-19T21:18:02.243301] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-19T21:18:02.301004] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T21:18:03.043266] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-19T21:18:03.843265] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-19T21:18:04.595107] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-19T21:18:04.643296] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-19T21:18:05.392084] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T21:18:05.443227] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-19T21:18:06.243304] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-19T21:18:06.354045] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (3.31 seconds). [2025-09-19T21:18:06.437446] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-19T21:18:06.764811] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T21:18:07.043292] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-19T21:18:07.533536] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T21:18:07.843297] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-19T21:18:08.087579] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T21:18:08.090296] [INFO ] [REMOTE ] SMC: Full fetch complete (16857 records). [2025-09-19T21:18:08.090479] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-19T21:18:08.572281] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-19T21:18:08.572444] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-19T21:18:08.573337] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-19T21:18:08.573414] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-19T21:18:08.574231] [DEBUG] [LOCAL ] SMC: Trimmed 16857 records to 11624 (keeping 200 days of data) [2025-09-19T21:18:08.643570] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-19T21:18:08.668973] [DEBUG] [LOCAL ] SMC: Primary data saved (11624 records). [2025-09-19T21:18:08.669147] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-19T21:18:08.669270] [INFO ] [MAIN ] Update Progress: 1941/2372 symbols completed. SMC took 32.8s. Estimated remaining: 57m 18s. Rate: 7.5 symbols/min [2025-09-19T21:18:08.846091] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:18:08.868990] [DEBUG] [LOCAL ] SMP: Loaded 20119 existing records from primary storage. [2025-09-19T21:18:08.869197] [INFO ] [MAIN ] SMP: Loaded 20119 existing records. [2025-09-19T21:18:09.071851] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:18:09.072215] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-19T21:18:09.072327] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-19T21:18:09.073077] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-19T21:18:09.073139] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-19T21:18:09.448486] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-19T21:18:09.496113] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:18:09.689825] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T21:18:10.243355] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-19T21:18:10.505155] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T21:18:10.787979] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T21:18:11.043331] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-19T21:18:11.368868] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T21:18:11.843265] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-19T21:18:12.222521] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T21:18:12.490124] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T21:18:12.643322] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-19T21:18:13.443322] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-19T21:18:14.243296] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-19T21:18:15.043339] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-19T21:18:15.320623] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-19T21:18:15.843281] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-19T21:18:16.341021] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-19T21:18:16.606541] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T21:18:16.643277] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-19T21:18:16.687430] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T21:18:17.441490] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T21:18:17.451364] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-19T21:18:17.963943] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T21:18:18.056812] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T21:18:18.243271] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-19T21:18:19.043290] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-19T21:18:19.763733] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T21:18:19.843233] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-19T21:18:20.176576] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T21:18:20.643238] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-19T21:18:21.179471] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T21:18:21.443271] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-19T21:18:21.677876] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T21:18:21.680437] [INFO ] [REMOTE ] SMHI: Full fetch complete (24846 records). [2025-09-19T21:18:21.680513] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-19T21:18:22.049864] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-19T21:18:22.049950] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-19T21:18:22.050467] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-19T21:18:22.050553] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-19T21:18:22.051220] [DEBUG] [LOCAL ] SMHI: Trimmed 24846 records to 14797 (keeping 200 days of data) [2025-09-19T21:18:22.137075] [DEBUG] [LOCAL ] SMHI: Primary data saved (14797 records). [2025-09-19T21:18:22.137206] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-19T21:18:22.137292] [INFO ] [MAIN ] Update Progress: 1942/2372 symbols completed. SMHI took 25.4s. Estimated remaining: 57m 12s. Rate: 7.5 symbols/min [2025-09-19T21:18:22.248363] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-19T21:18:22.317976] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:18:22.379584] [DEBUG] [LOCAL ] SMR: Loaded 54187 existing records from primary storage. [2025-09-19T21:18:22.379785] [INFO ] [MAIN ] SMR: Loaded 54187 existing records. [2025-09-19T21:18:22.555960] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:18:22.556207] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-19T21:18:22.556266] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-19T21:18:22.557817] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-09-19T21:18:22.557884] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-19T21:18:22.916730] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:18:23.043225] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-19T21:18:23.309884] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T21:18:23.843274] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-19T21:18:24.100258] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T21:18:24.107879] [INFO ] [REMOTE ] SMFG: Full fetch complete (68890 records). [2025-09-19T21:18:24.108032] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-19T21:18:24.499190] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-19T21:18:24.499299] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-19T21:18:24.500335] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-19T21:18:24.500397] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-19T21:18:24.501717] [DEBUG] [LOCAL ] SMFG: Trimmed 68890 records to 48863 (keeping 200 days of data) [2025-09-19T21:18:24.671320] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-19T21:18:24.798917] [DEBUG] [LOCAL ] SMFG: Primary data saved (48863 records). [2025-09-19T21:18:24.799062] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-19T21:18:24.799165] [INFO ] [MAIN ] Update Progress: 1943/2372 symbols completed. SMFG took 40.8s. Estimated remaining: 57m 2s. Rate: 7.5 symbols/min [2025-09-19T21:18:24.969932] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:18:25.016707] [DEBUG] [LOCAL ] SMRT: Loaded 44785 existing records from primary storage. [2025-09-19T21:18:25.016873] [INFO ] [MAIN ] SMRT: Loaded 44785 existing records. [2025-09-19T21:18:25.207978] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:18:25.208285] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-19T21:18:25.208375] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-19T21:18:25.209437] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-19T21:18:25.209499] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-19T21:18:25.580048] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:18:25.580466] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-19T21:18:25.597276] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T21:18:25.603517] [INFO ] [REMOTE ] SMG: Full fetch complete (62730 records). [2025-09-19T21:18:25.603625] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-19T21:18:26.005543] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-19T21:18:26.005785] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-19T21:18:26.006943] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-19T21:18:26.007138] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-19T21:18:26.009387] [DEBUG] [LOCAL ] SMG: Trimmed 62730 records to 44842 (keeping 200 days of data) [2025-09-19T21:18:26.021120] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T21:18:26.153390] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (3.11 seconds). [2025-09-19T21:18:26.254501] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-19T21:18:26.357932] [DEBUG] [LOCAL ] SMG: Primary data saved (44842 records). [2025-09-19T21:18:26.358073] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-19T21:18:26.358164] [INFO ] [MAIN ] Update Progress: 1944/2372 symbols completed. SMG took 40.9s. Estimated remaining: 56m 53s. Rate: 7.5 symbols/min [2025-09-19T21:18:26.537694] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:18:26.569739] [DEBUG] [LOCAL ] SMWB: Loaded 33579 existing records from primary storage. [2025-09-19T21:18:26.569881] [INFO ] [MAIN ] SMWB: Loaded 33579 existing records. [2025-09-19T21:18:26.752791] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:18:26.753058] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-19T21:18:26.753108] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-19T21:18:26.753922] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-19T21:18:26.753984] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-19T21:18:27.046445] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-19T21:18:27.129724] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:18:27.531816] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T21:18:27.843276] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-19T21:18:28.303945] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T21:18:28.643243] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-19T21:18:28.992739] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T21:18:29.430509] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (3.18 seconds). [2025-09-19T21:18:29.448329] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-19T21:18:29.458781] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-19T21:18:30.243290] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-19T21:18:31.043281] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-19T21:18:31.364307] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T21:18:31.367380] [INFO ] [REMOTE ] SMP: Full fetch complete (26040 records). [2025-09-19T21:18:31.367453] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-19T21:18:31.730905] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-19T21:18:31.730982] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-19T21:18:31.731558] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-19T21:18:31.731615] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-19T21:18:31.732281] [DEBUG] [LOCAL ] SMP: Trimmed 26040 records to 20250 (keeping 200 days of data) [2025-09-19T21:18:31.843372] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-19T21:18:31.869795] [DEBUG] [LOCAL ] SMP: Primary data saved (20250 records). [2025-09-19T21:18:31.869919] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-19T21:18:31.870000] [INFO ] [MAIN ] Update Progress: 1945/2372 symbols completed. SMP took 23.2s. Estimated remaining: 56m 45s. Rate: 7.5 symbols/min [2025-09-19T21:18:32.039353] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:18:32.039556] [DEBUG] [LOCAL ] SN: No existing data file found in primary storage. [2025-09-19T21:18:32.039595] [WARN ] [MAIN ] SN: No existing data found, performing full refresh instead. [2025-09-19T21:18:32.039789] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-19T21:18:32.039844] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-19T21:18:32.039915] [DEBUG] [LOCAL ] SN: No primary data file found to delete. [2025-09-19T21:18:32.039950] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-19T21:18:32.412018] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:18:32.443304] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.99 seconds). [2025-09-19T21:18:32.643278] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-19T21:18:32.796847] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T21:18:33.443294] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-19T21:18:33.578622] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T21:18:34.243286] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-19T21:18:35.003340] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T21:18:35.043226] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-19T21:18:35.597851] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-09-19T21:18:35.695400] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T21:18:35.843267] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-19T21:18:36.518210] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T21:18:36.643219] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-19T21:18:37.443265] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-19T21:18:37.715217] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T21:18:38.243325] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-19T21:18:38.528239] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:18:39.043287] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-19T21:18:39.373458] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T21:18:39.843326] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-19T21:18:40.239027] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T21:18:40.643270] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-19T21:18:40.916456] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T21:18:41.443279] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-19T21:18:41.647742] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T21:18:42.243268] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-19T21:18:43.043350] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-19T21:18:43.321185] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-19T21:18:43.362823] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T21:18:43.408818] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T21:18:43.843324] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-19T21:18:44.643329] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-19T21:18:45.009885] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T21:18:45.252395] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T21:18:45.443254] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-19T21:18:46.155197] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T21:18:46.243225] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-19T21:18:47.043275] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-19T21:18:47.509261] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T21:18:47.618195] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T21:18:47.843276] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-19T21:18:48.643323] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-19T21:18:48.908567] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T21:18:49.443317] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-19T21:18:49.931118] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T21:18:50.243262] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-19T21:18:50.952982] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-09-19T21:18:50.990060] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T21:18:50.995963] [INFO ] [REMOTE ] SMRT: Full fetch complete (62332 records). [2025-09-19T21:18:50.996090] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-19T21:18:51.053525] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-19T21:18:51.408433] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-19T21:18:51.408571] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-19T21:18:51.409988] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-19T21:18:51.410061] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-19T21:18:51.411631] [DEBUG] [LOCAL ] SMRT: Trimmed 62332 records to 45073 (keeping 200 days of data) [2025-09-19T21:18:51.679155] [DEBUG] [LOCAL ] SMRT: Primary data saved (45073 records). [2025-09-19T21:18:51.679322] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-19T21:18:51.679480] [INFO ] [MAIN ] Update Progress: 1946/2372 symbols completed. SMRT took 26.9s. Estimated remaining: 56m 39s. Rate: 7.5 symbols/min [2025-09-19T21:18:51.844949] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-19T21:18:51.872949] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:18:51.896225] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T21:18:51.928350] [DEBUG] [LOCAL ] SNA: Loaded 26615 existing records from primary storage. [2025-09-19T21:18:51.928500] [INFO ] [MAIN ] SNA: Loaded 26615 existing records. [2025-09-19T21:18:52.121537] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:18:52.121891] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-19T21:18:52.121948] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-19T21:18:52.122758] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-19T21:18:52.122817] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-19T21:18:52.496307] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:18:52.643281] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-19T21:18:53.443312] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-19T21:18:53.566538] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-19T21:18:54.012268] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T21:18:54.243301] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-19T21:18:54.432271] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T21:18:55.046883] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-19T21:18:55.049368] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T21:18:55.843269] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-19T21:18:56.403118] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T21:18:56.643267] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-19T21:18:57.443294] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-19T21:18:57.507044] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T21:18:57.615041] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T21:18:57.619885] [INFO ] [REMOTE ] SMWB: Full fetch complete (50481 records). [2025-09-19T21:18:57.619988] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-19T21:18:58.001663] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-19T21:18:58.001785] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-19T21:18:58.002852] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-19T21:18:58.002938] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-19T21:18:58.004352] [DEBUG] [LOCAL ] SMWB: Trimmed 50481 records to 33729 (keeping 200 days of data) [2025-09-19T21:18:58.197817] [DEBUG] [LOCAL ] SMWB: Primary data saved (33729 records). [2025-09-19T21:18:58.198096] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-19T21:18:58.198277] [INFO ] [MAIN ] Update Progress: 1947/2372 symbols completed. SMWB took 31.8s. Estimated remaining: 56m 31s. Rate: 7.5 symbols/min [2025-09-19T21:18:58.267397] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-19T21:18:58.362227] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-09-19T21:18:58.432149] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:18:58.483882] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-09-19T21:18:58.484062] [INFO ] [MAIN ] SNAP: Loaded 54186 existing records. [2025-09-19T21:18:58.664792] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:18:58.665069] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-19T21:18:58.665123] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-19T21:18:58.666277] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-19T21:18:58.666339] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-19T21:18:59.022884] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:18:59.043224] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-19T21:18:59.611704] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T21:18:59.843332] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-19T21:19:00.176986] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T21:19:00.643277] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-19T21:19:01.443275] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-19T21:19:01.693074] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T21:19:01.700711] [INFO ] [REMOTE ] SN: Full fetch complete (70822 records). [2025-09-19T21:19:01.700938] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-19T21:19:01.940338] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-19T21:19:02.202428] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-19T21:19:02.202532] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-19T21:19:02.203680] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-19T21:19:02.203784] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-19T21:19:02.205369] [DEBUG] [LOCAL ] SN: Trimmed 70822 records to 50520 (keeping 200 days of data) [2025-09-19T21:19:02.263692] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-19T21:19:02.536246] [DEBUG] [LOCAL ] SN: Primary data saved (50520 records). [2025-09-19T21:19:02.536403] [INFO ] [MAIN ] SN: Full history saved. [2025-09-19T21:19:02.536508] [INFO ] [MAIN ] Update Progress: 1948/2372 symbols completed. SN took 30.7s. Estimated remaining: 56m 22s. Rate: 7.5 symbols/min [2025-09-19T21:19:02.729264] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:19:02.751403] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T21:19:02.760919] [DEBUG] [LOCAL ] SNDA: Loaded 4786 existing records from primary storage. [2025-09-19T21:19:02.761760] [INFO ] [MAIN ] SNDA: Loaded 4786 existing records. [2025-09-19T21:19:02.956219] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:19:02.956517] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-19T21:19:02.956569] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-19T21:19:02.956923] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-19T21:19:02.956984] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-19T21:19:03.057367] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-19T21:19:03.361521] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:19:03.483739] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-19T21:19:03.843265] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-19T21:19:04.384701] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T21:19:04.643280] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-19T21:19:04.926735] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T21:19:04.935068] [INFO ] [REMOTE ] SMR: Full fetch complete (77584 records). [2025-09-19T21:19:04.935295] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-19T21:19:04.936531] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T21:19:04.936668] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:19:04.936991] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:19:04.937243] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-19T21:19:04.937339] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-19T21:19:04.937379] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-09-19T21:19:04.937923] [DEBUG] [LOCAL ] SMR: Deleted derivative data file. [2025-09-19T21:19:04.938119] [INFO ] [MAIN ] Update Progress: 1949/2372 symbols completed. SMR took 42.8s. Estimated remaining: 56m 13s. Rate: 7.5 symbols/min [2025-09-19T21:19:05.169178] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-09-19T21:19:05.195102] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:19:05.245471] [DEBUG] [LOCAL ] SNDR: Loaded 40781 existing records from primary storage. [2025-09-19T21:19:05.245618] [INFO ] [MAIN ] SNDR: Loaded 40781 existing records. [2025-09-19T21:19:05.419759] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-19T21:19:05.442570] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:19:05.442773] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-19T21:19:05.442824] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-19T21:19:05.443267] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-19T21:19:05.444584] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-19T21:19:05.444685] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-19T21:19:05.795527] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:19:06.243275] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-19T21:19:07.043248] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-19T21:19:07.100322] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T21:19:07.843265] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-19T21:19:08.001589] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T21:19:08.643271] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-19T21:19:09.262163] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T21:19:09.443274] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-19T21:19:09.632238] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-19T21:19:09.672490] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T21:19:10.243270] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-19T21:19:10.949533] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T21:19:11.043271] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-19T21:19:11.843283] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-19T21:19:12.643269] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-19T21:19:12.856250] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T21:19:12.931672] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T21:19:12.956469] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T21:19:13.148521] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-19T21:19:13.443294] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-19T21:19:14.243289] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-19T21:19:14.396058] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T21:19:15.043284] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-19T21:19:15.843292] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-19T21:19:16.027277] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T21:19:16.340515] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T21:19:16.345457] [INFO ] [REMOTE ] SNA: Full fetch complete (39253 records). [2025-09-19T21:19:16.345604] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-19T21:19:16.648394] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-19T21:19:16.755361] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-19T21:19:16.755450] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-19T21:19:16.756277] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-19T21:19:16.756353] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-19T21:19:16.757338] [DEBUG] [LOCAL ] SNA: Trimmed 39253 records to 26834 (keeping 200 days of data) [2025-09-19T21:19:16.926584] [DEBUG] [LOCAL ] SNA: Primary data saved (26834 records). [2025-09-19T21:19:16.926751] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-19T21:19:16.926875] [INFO ] [MAIN ] Update Progress: 1950/2372 symbols completed. SNA took 25.2s. Estimated remaining: 56m 6s. Rate: 7.5 symbols/min [2025-09-19T21:19:17.101435] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:19:17.143028] [DEBUG] [LOCAL ] SNN: Loaded 44690 existing records from primary storage. [2025-09-19T21:19:17.143175] [INFO ] [MAIN ] SNN: Loaded 44690 existing records. [2025-09-19T21:19:17.320835] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:19:17.321075] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-19T21:19:17.321126] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-19T21:19:17.322113] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-19T21:19:17.322185] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-19T21:19:17.448530] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-19T21:19:17.684948] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:19:18.064009] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T21:19:18.219583] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-19T21:19:18.243227] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-19T21:19:18.560515] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T21:19:19.043261] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-19T21:19:19.843263] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-19T21:19:20.643323] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-19T21:19:20.823939] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-19T21:19:20.861896] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T21:19:21.250499] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-19T21:19:21.443282] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-19T21:19:21.691857] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T21:19:22.243320] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-19T21:19:23.039675] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T21:19:23.043205] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-19T21:19:23.829494] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T21:19:23.843230] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-19T21:19:24.046921] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-19T21:19:24.631091] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-19T21:19:24.643253] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-19T21:19:25.384436] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T21:19:25.385753] [INFO ] [REMOTE ] SNDA: Full fetch complete (8606 records). [2025-09-19T21:19:25.385825] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-19T21:19:25.448633] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-19T21:19:25.752355] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-19T21:19:25.752431] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-19T21:19:25.752635] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-19T21:19:25.752712] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-19T21:19:25.753120] [DEBUG] [LOCAL ] SNDA: Trimmed 8606 records to 4832 (keeping 200 days of data) [2025-09-19T21:19:25.780879] [DEBUG] [LOCAL ] SNDA: Primary data saved (4832 records). [2025-09-19T21:19:25.780972] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-19T21:19:25.781073] [INFO ] [MAIN ] Update Progress: 1951/2372 symbols completed. SNDA took 23.2s. Estimated remaining: 55m 58s. Rate: 7.5 symbols/min [2025-09-19T21:19:25.948459] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:19:26.015149] [DEBUG] [LOCAL ] SNOW: Loaded 53959 existing records from primary storage. [2025-09-19T21:19:26.015321] [INFO ] [MAIN ] SNOW: Loaded 53959 existing records. [2025-09-19T21:19:26.196568] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:19:26.196852] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-19T21:19:26.196900] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-19T21:19:26.198211] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-09-19T21:19:26.198273] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-19T21:19:26.252086] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-19T21:19:26.552345] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:19:27.043269] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-19T21:19:27.342094] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:19:27.843272] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-19T21:19:28.229739] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T21:19:28.643260] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-19T21:19:29.374166] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T21:19:29.443230] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-19T21:19:29.543636] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T21:19:30.243304] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-19T21:19:30.465775] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T21:19:31.043359] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-19T21:19:31.843285] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-19T21:19:32.053382] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-19T21:19:32.156358] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T21:19:32.643262] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-19T21:19:32.950823] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T21:19:33.443274] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-19T21:19:34.243275] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-19T21:19:34.486439] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T21:19:34.574093] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-19T21:19:34.806055] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T21:19:35.043291] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-19T21:19:35.843275] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-19T21:19:36.478605] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-19T21:19:36.643277] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-19T21:19:37.443343] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-19T21:19:37.710815] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T21:19:37.814722] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-19T21:19:38.243289] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-19T21:19:38.580809] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T21:19:38.587754] [INFO ] [REMOTE ] SNDR: Full fetch complete (58902 records). [2025-09-19T21:19:38.587894] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-19T21:19:38.979460] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-19T21:19:38.979568] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-19T21:19:38.980725] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-19T21:19:38.980816] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-19T21:19:38.982169] [DEBUG] [LOCAL ] SNDR: Trimmed 58902 records to 41145 (keeping 200 days of data) [2025-09-19T21:19:39.051812] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-19T21:19:39.249542] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-19T21:19:39.303197] [DEBUG] [LOCAL ] SNDR: Primary data saved (41145 records). [2025-09-19T21:19:39.303343] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-19T21:19:39.303453] [INFO ] [MAIN ] Update Progress: 1952/2372 symbols completed. SNDR took 34.4s. Estimated remaining: 55m 51s. Rate: 7.5 symbols/min [2025-09-19T21:19:39.486282] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:19:39.545316] [DEBUG] [LOCAL ] SNV: Loaded 49306 existing records from primary storage. [2025-09-19T21:19:39.545519] [INFO ] [MAIN ] SNV: Loaded 49306 existing records. [2025-09-19T21:19:39.726602] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:19:39.726939] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-19T21:19:39.727011] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-19T21:19:39.728543] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-19T21:19:39.728615] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-19T21:19:39.848426] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-19T21:19:40.084559] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:19:40.114295] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T21:19:40.643271] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-19T21:19:41.443296] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-19T21:19:41.681294] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-19T21:19:41.692738] [INFO ] [REMOTE ] SNAP: Full fetch complete (77933 records). [2025-09-19T21:19:41.692879] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-19T21:19:42.133110] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-19T21:19:42.133268] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-19T21:19:42.134735] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-19T21:19:42.134855] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-19T21:19:42.167813] [DEBUG] [LOCAL ] SNAP: Trimmed 77933 records to 54576 (keeping 200 days of data) [2025-09-19T21:19:42.167661] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T21:19:42.250268] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-19T21:19:42.508569] [DEBUG] [LOCAL ] SNAP: Primary data saved (54576 records). [2025-09-19T21:19:42.508758] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-19T21:19:42.508939] [INFO ] [MAIN ] Update Progress: 1953/2372 symbols completed. SNAP took 44.3s. Estimated remaining: 55m 42s. Rate: 7.5 symbols/min [2025-09-19T21:19:42.689456] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:19:42.722449] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T21:19:42.776995] [DEBUG] [LOCAL ] SNX: Loaded 39913 existing records from primary storage. [2025-09-19T21:19:42.777155] [INFO ] [MAIN ] SNX: Loaded 39913 existing records. [2025-09-19T21:19:42.963465] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:19:42.964086] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-19T21:19:42.964159] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-19T21:19:42.965123] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-19T21:19:42.965195] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-19T21:19:43.053513] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-19T21:19:43.099144] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T21:19:43.362167] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:19:43.843292] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-19T21:19:44.643347] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-19T21:19:45.024817] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T21:19:45.130813] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-09-19T21:19:45.443276] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-19T21:19:45.938210] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T21:19:46.243291] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-19T21:19:46.407499] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T21:19:46.653235] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T21:19:46.664246] [INFO ] [REMOTE ] SNN: Full fetch complete (62883 records). [2025-09-19T21:19:46.664517] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-19T21:19:47.050712] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-19T21:19:47.092394] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-19T21:19:47.092512] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-19T21:19:47.093947] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-19T21:19:47.094020] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-19T21:19:47.096444] [DEBUG] [LOCAL ] SNN: Trimmed 62883 records to 44955 (keeping 200 days of data) [2025-09-19T21:19:47.409835] [DEBUG] [LOCAL ] SNN: Primary data saved (44955 records). [2025-09-19T21:19:47.410453] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-19T21:19:47.410757] [INFO ] [MAIN ] Update Progress: 1954/2372 symbols completed. SNN took 30.5s. Estimated remaining: 55m 34s. Rate: 7.5 symbols/min [2025-09-19T21:19:47.603777] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:19:47.665560] [DEBUG] [LOCAL ] SO: Loaded 53993 existing records from primary storage. [2025-09-19T21:19:47.665797] [INFO ] [MAIN ] SO: Loaded 53993 existing records. [2025-09-19T21:19:47.870705] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-19T21:19:47.876044] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:19:47.888313] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-19T21:19:47.888488] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-19T21:19:47.891442] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T21:19:47.891491] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-09-19T21:19:47.901615] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-19T21:19:48.273638] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:19:48.643271] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-19T21:19:48.934879] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T21:19:49.443310] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-19T21:19:50.044379] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T21:19:50.243305] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-19T21:19:50.791615] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-19T21:19:51.043269] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-19T21:19:51.111923] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T21:19:51.843271] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-19T21:19:52.643339] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-19T21:19:52.933735] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-19T21:19:53.182868] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T21:19:53.443269] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-19T21:19:53.841972] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T21:19:54.064598] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T21:19:54.243382] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-19T21:19:55.043334] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-19T21:19:55.638706] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-19T21:19:55.843346] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-19T21:19:56.247915] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T21:19:56.643299] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-19T21:19:57.443262] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-19T21:19:57.496429] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-19T21:19:58.098880] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T21:19:58.243237] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-19T21:19:58.462915] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T21:19:59.043260] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-19T21:19:59.211567] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T21:19:59.220591] [INFO ] [REMOTE ] SNOW: Full fetch complete (77265 records). [2025-09-19T21:19:59.220764] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-19T21:19:59.223697] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T21:19:59.223809] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:19:59.223872] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:19:59.223934] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-19T21:19:59.224008] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-19T21:19:59.224075] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-09-19T21:19:59.224535] [DEBUG] [LOCAL ] SNOW: Deleted derivative data file. [2025-09-19T21:19:59.225305] [INFO ] [MAIN ] Update Progress: 1955/2372 symbols completed. SNOW took 33.4s. Estimated remaining: 55m 26s. Rate: 7.5 symbols/min [2025-09-19T21:19:59.398701] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:19:59.432146] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T21:19:59.489980] [DEBUG] [LOCAL ] SOBO: Loaded 40351 existing records from primary storage. [2025-09-19T21:19:59.490149] [INFO ] [MAIN ] SOBO: Loaded 40351 existing records. [2025-09-19T21:19:59.669281] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:19:59.669541] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-19T21:19:59.669595] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-19T21:19:59.670550] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-19T21:19:59.670711] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-19T21:19:59.849835] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-19T21:20:00.068597] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:20:00.643264] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-19T21:20:01.443283] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-19T21:20:01.760664] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-19T21:20:01.832143] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-19T21:20:01.963590] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T21:20:02.243282] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-19T21:20:02.848122] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-19T21:20:03.043280] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-19T21:20:03.843284] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-19T21:20:04.142805] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T21:20:04.643261] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-19T21:20:04.844661] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T21:20:05.176149] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T21:20:05.443303] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-19T21:20:06.243283] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-19T21:20:06.348085] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T21:20:07.043277] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-19T21:20:07.223977] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T21:20:07.452422] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T21:20:07.843276] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-19T21:20:08.643284] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-19T21:20:08.843041] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T21:20:09.390155] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T21:20:09.443236] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-19T21:20:10.243350] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-19T21:20:10.665399] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T21:20:11.043302] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-19T21:20:11.686222] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T21:20:11.843282] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-19T21:20:12.386517] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-19T21:20:12.535284] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T21:20:12.643300] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-19T21:20:12.943789] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T21:20:13.443263] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-19T21:20:13.780950] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T21:20:13.787023] [INFO ] [REMOTE ] SNX: Full fetch complete (56379 records). [2025-09-19T21:20:13.787130] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-19T21:20:14.172064] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-19T21:20:14.172165] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-19T21:20:14.173134] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-19T21:20:14.173206] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-19T21:20:14.174411] [DEBUG] [LOCAL ] SNX: Trimmed 56379 records to 40267 (keeping 200 days of data) [2025-09-19T21:20:14.246978] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-19T21:20:14.436566] [DEBUG] [LOCAL ] SNX: Primary data saved (40267 records). [2025-09-19T21:20:14.436728] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-19T21:20:14.436821] [INFO ] [MAIN ] Update Progress: 1956/2372 symbols completed. SNX took 31.9s. Estimated remaining: 55m 20s. Rate: 7.5 symbols/min [2025-09-19T21:20:14.610166] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:20:14.659835] [DEBUG] [LOCAL ] SOC: Loaded 50598 existing records from primary storage. [2025-09-19T21:20:14.659977] [INFO ] [MAIN ] SOC: Loaded 50598 existing records. [2025-09-19T21:20:14.842711] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:20:14.843136] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-19T21:20:14.843213] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-19T21:20:14.844750] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-19T21:20:14.844815] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-19T21:20:14.995195] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T21:20:15.061325] [INFO ] [REMOTE ] SO: Full fetch complete (77196 records). [2025-09-19T21:20:15.052402] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-19T21:20:15.068492] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-19T21:20:15.096130] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-18) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T21:20:15.135929] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:20:15.151989] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:20:15.162308] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-19T21:20:15.162450] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-19T21:20:15.162820] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-19T21:20:15.184065] [DEBUG] [LOCAL ] SO: Deleted derivative data file. [2025-09-19T21:20:15.184265] [INFO ] [MAIN ] Update Progress: 1957/2372 symbols completed. SO took 27.8s. Estimated remaining: 55m 10s. Rate: 7.5 symbols/min [2025-09-19T21:20:15.240310] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:20:15.339695] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T21:20:15.843272] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-19T21:20:16.569127] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T21:20:16.576780] [INFO ] [REMOTE ] SNV: Full fetch complete (71081 records). [2025-09-19T21:20:16.576958] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-19T21:20:16.648323] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-19T21:20:17.060902] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-19T21:20:17.061044] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-19T21:20:17.062241] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-19T21:20:17.062445] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-19T21:20:17.064464] [DEBUG] [LOCAL ] SNV: Trimmed 71081 records to 49657 (keeping 200 days of data) [2025-09-19T21:20:17.179898] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T21:20:17.408823] [DEBUG] [LOCAL ] SNV: Primary data saved (49657 records). [2025-09-19T21:20:17.408969] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-19T21:20:17.409074] [INFO ] [MAIN ] Update Progress: 1958/2372 symbols completed. SNV took 38.1s. Estimated remaining: 55m 1s. Rate: 7.5 symbols/min [2025-09-19T21:20:17.443366] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-19T21:20:18.624164] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T21:20:18.634301] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-19T21:20:19.053299] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T21:20:19.061450] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-19T21:20:20.308429] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T21:20:20.316885] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-19T21:20:20.559031] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T21:20:20.643264] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-19T21:20:21.877132] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T21:20:21.883596] [INFO ] [REMOTE ] SOBO: Full fetch complete (58665 records). [2025-09-19T21:20:21.883750] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-19T21:20:22.290884] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-19T21:20:22.291043] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-19T21:20:22.292809] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-19T21:20:22.293057] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-19T21:20:22.321165] [DEBUG] [LOCAL ] SOBO: Trimmed 58665 records to 40586 (keeping 200 days of data) [2025-09-19T21:20:22.322130] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T21:20:22.333254] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-19T21:20:22.606205] [DEBUG] [LOCAL ] SOBO: Primary data saved (40586 records). [2025-09-19T21:20:22.606345] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-19T21:20:22.606748] [INFO ] [MAIN ] Update Progress: 1959/2372 symbols completed. SOBO took 23.4s. Estimated remaining: 54m 53s. Rate: 7.5 symbols/min [2025-09-19T21:20:24.284676] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T21:20:24.295125] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-19T21:20:26.463462] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T21:20:26.474672] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-19T21:20:28.526572] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T21:20:28.538596] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-19T21:20:29.975857] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T21:20:29.986413] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-19T21:20:32.165078] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T21:20:32.176923] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-19T21:20:34.267394] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T21:20:34.278296] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-19T21:20:35.651847] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T21:20:35.661007] [INFO ] [REMOTE ] SOC: Full fetch complete (71218 records). [2025-09-19T21:20:35.661175] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-19T21:20:36.076353] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-19T21:20:36.076501] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-19T21:20:36.077689] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-19T21:20:36.077755] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-19T21:20:36.079223] [DEBUG] [LOCAL ] SOC: Trimmed 71218 records to 50981 (keeping 200 days of data) [2025-09-19T21:20:36.374826] [DEBUG] [LOCAL ] SOC: Primary data saved (50981 records). [2025-09-19T21:20:36.374965] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-19T21:20:36.375050] [INFO ] [MAIN ] Update Progress: 1960/2372 symbols completed. SOC took 21.9s. Estimated remaining: 54m 46s. Rate: 7.5 symbols/min [2025-09-19T21:20:36.947865] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:20:37.073246] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:20:37.126223] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:20:37.126625] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-19T21:20:37.127620] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:20:37.127877] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-19T21:20:37.129018] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-19T21:20:37.129077] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-19T21:20:37.129120] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-19T21:20:37.129152] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-19T21:20:37.249782] [DEBUG] [LOCAL ] SOJC: Loaded 5199 existing records from primary storage. [2025-09-19T21:20:37.259516] [INFO ] [MAIN ] SOJC: Loaded 5199 existing records. [2025-09-19T21:20:37.250353] [DEBUG] [LOCAL ] SOJD: Loaded 13089 existing records from primary storage. [2025-09-19T21:20:37.264793] [INFO ] [MAIN ] SOJD: Loaded 13089 existing records. [2025-09-19T21:20:37.291092] [DEBUG] [LOCAL ] SOJE: Loaded 9537 existing records from primary storage. [2025-09-19T21:20:37.498707] [INFO ] [MAIN ] SOJE: Loaded 9537 existing records. [2025-09-19T21:20:37.961979] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:20:37.985216] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:20:37.994111] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-19T21:20:37.994251] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-19T21:20:37.994364] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-19T21:20:38.015993] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:20:38.016054] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-19T21:20:38.016117] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-19T21:20:38.037004] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-19T21:20:38.042862] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-19T21:20:38.042784] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-19T21:20:38.126239] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-19T21:20:38.189980] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:20:38.256499] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-19T21:20:38.311184] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-19T21:20:38.347898] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-19T21:20:38.427523] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-19T21:20:38.501190] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:20:38.566731] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-19T21:20:38.618434] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-19T21:20:38.917100] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:20:38.952023] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-19T21:20:39.055463] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:20:39.094051] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-19T21:20:39.232179] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:20:39.232512] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-19T21:20:39.436317] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T21:20:39.440753] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-19T21:20:40.028383] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T21:20:40.031170] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-19T21:20:40.237094] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T21:20:40.241212] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-19T21:20:40.255535] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T21:20:40.260436] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-19T21:20:40.396052] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T21:20:40.398835] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-19T21:20:40.908341] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T21:20:40.910348] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-19T21:20:41.086734] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T21:20:41.090532] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-19T21:20:41.189493] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T21:20:41.192165] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-19T21:20:41.434564] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T21:20:41.437298] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-19T21:20:41.823869] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T21:20:41.825912] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-19T21:20:41.942603] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-19T21:20:41.945993] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-19T21:20:42.100577] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T21:20:42.103379] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-19T21:20:42.598673] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T21:20:42.601240] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-19T21:20:42.709822] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T21:20:42.712023] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-19T21:20:42.824325] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T21:20:42.827851] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-19T21:20:42.974585] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T21:20:43.043259] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-19T21:20:43.276361] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T21:20:43.284607] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T21:20:43.843256] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-19T21:20:43.938472] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T21:20:44.016692] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T21:20:44.532447] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-19T21:20:44.643298] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-19T21:20:45.443268] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-19T21:20:45.562471] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T21:20:45.857404] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T21:20:46.243281] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-19T21:20:47.043275] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-19T21:20:47.138179] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T21:20:47.843332] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-19T21:20:48.033045] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-19T21:20:48.631007] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T21:20:48.643237] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-19T21:20:49.361086] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-19T21:20:49.443277] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-19T21:20:50.138764] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T21:20:50.140118] [INFO ] [REMOTE ] SOJC: Full fetch complete (8174 records). [2025-09-19T21:20:50.140188] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-19T21:20:50.244445] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-19T21:20:50.513730] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-19T21:20:50.513842] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-19T21:20:50.514062] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-19T21:20:50.514101] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-19T21:20:50.514501] [DEBUG] [LOCAL ] SOJC: Trimmed 8174 records to 5218 (keeping 200 days of data) [2025-09-19T21:20:50.545848] [DEBUG] [LOCAL ] SOJC: Primary data saved (5218 records). [2025-09-19T21:20:50.545954] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-19T21:20:50.546035] [INFO ] [MAIN ] Update Progress: 1961/2372 symbols completed. SOJC took 14.2s. Estimated remaining: 54m 39s. Rate: 7.5 symbols/min [2025-09-19T21:20:50.713490] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:20:50.729437] [DEBUG] [LOCAL ] SOL: Loaded 13829 existing records from primary storage. [2025-09-19T21:20:50.729553] [INFO ] [MAIN ] SOL: Loaded 13829 existing records. [2025-09-19T21:20:50.904746] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:20:50.905006] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-19T21:20:50.905054] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-19T21:20:50.905496] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-19T21:20:50.905556] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-19T21:20:51.016475] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-19T21:20:51.056967] [INFO ] [REMOTE ] SOJF: Full fetch complete (13008 records). [2025-09-19T21:20:51.057533] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-19T21:20:51.057385] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-19T21:20:51.491141] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:20:51.494975] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 170 unique days, need 200 days [2025-09-19T21:20:51.495294] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:20:51.495780] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:20:51.495854] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-19T21:20:51.495924] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-19T21:20:51.495961] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-19T21:20:51.496002] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-19T21:20:51.496080] [INFO ] [MAIN ] Update Progress: 1962/2372 symbols completed. SOJF took 15.1s. Estimated remaining: 54m 30s. Rate: 7.5 symbols/min [2025-09-19T21:20:51.672189] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:20:51.714933] [DEBUG] [LOCAL ] SOLV: Loaded 44615 existing records from primary storage. [2025-09-19T21:20:51.715102] [INFO ] [MAIN ] SOLV: Loaded 44615 existing records. [2025-09-19T21:20:51.848411] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-19T21:20:51.915238] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:20:51.915495] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-19T21:20:51.915549] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-19T21:20:51.916954] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-19T21:20:51.917063] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-19T21:20:52.285826] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:20:52.308001] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T21:20:52.643270] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-19T21:20:52.891517] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T21:20:53.443264] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-19T21:20:53.650001] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T21:20:54.243272] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-19T21:20:54.368972] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T21:20:55.043265] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-19T21:20:55.322470] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-19T21:20:55.843271] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-19T21:20:55.938519] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-19T21:20:56.643323] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-19T21:20:57.443309] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-19T21:20:57.502002] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T21:20:57.613834] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T21:20:58.243236] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-19T21:20:58.748085] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T21:20:59.043275] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-19T21:20:59.128913] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T21:20:59.843264] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-19T21:20:59.982098] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T21:20:59.984206] [INFO ] [REMOTE ] SOJD: Full fetch complete (20302 records). [2025-09-19T21:20:59.984299] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-19T21:21:00.378174] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-19T21:21:00.378252] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-19T21:21:00.378698] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-19T21:21:00.378759] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-19T21:21:00.379361] [DEBUG] [LOCAL ] SOJD: Trimmed 20302 records to 13155 (keeping 200 days of data) [2025-09-19T21:21:00.461736] [DEBUG] [LOCAL ] SOJD: Primary data saved (13155 records). [2025-09-19T21:21:00.461881] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-19T21:21:00.461993] [INFO ] [MAIN ] Update Progress: 1963/2372 symbols completed. SOJD took 24.1s. Estimated remaining: 54m 22s. Rate: 7.5 symbols/min [2025-09-19T21:21:00.636290] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:21:00.643229] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-19T21:21:00.679774] [DEBUG] [LOCAL ] SON: Loaded 43197 existing records from primary storage. [2025-09-19T21:21:00.679923] [INFO ] [MAIN ] SON: Loaded 43197 existing records. [2025-09-19T21:21:00.856079] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:21:00.856336] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-19T21:21:00.856392] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-19T21:21:00.857563] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-19T21:21:00.857625] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-19T21:21:01.222948] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:21:01.236547] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T21:21:01.443259] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-19T21:21:01.463849] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-19T21:21:01.465408] [INFO ] [REMOTE ] SOJE: Full fetch complete (14667 records). [2025-09-19T21:21:01.465478] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-19T21:21:01.833153] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-19T21:21:01.833242] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-19T21:21:01.833578] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-19T21:21:01.833626] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-19T21:21:01.834434] [DEBUG] [LOCAL ] SOJE: Trimmed 14667 records to 9557 (keeping 200 days of data) [2025-09-19T21:21:01.895406] [DEBUG] [LOCAL ] SOJE: Primary data saved (9557 records). [2025-09-19T21:21:01.895564] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-19T21:21:01.895678] [INFO ] [MAIN ] Update Progress: 1964/2372 symbols completed. SOJE took 25.5s. Estimated remaining: 54m 13s. Rate: 7.5 symbols/min [2025-09-19T21:21:02.092756] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:21:02.146486] [DEBUG] [LOCAL ] SONY: Loaded 53752 existing records from primary storage. [2025-09-19T21:21:02.146632] [INFO ] [MAIN ] SONY: Loaded 53752 existing records. [2025-09-19T21:21:02.248970] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-19T21:21:02.329807] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:21:02.330051] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-19T21:21:02.330108] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-19T21:21:02.331606] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-19T21:21:02.331704] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-19T21:21:02.693195] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:21:03.043266] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-19T21:21:03.843302] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-19T21:21:04.318886] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-09-19T21:21:04.643288] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-19T21:21:05.570316] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (3.32 seconds). [2025-09-19T21:21:05.579309] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-19T21:21:05.659013] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T21:21:05.691038] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T21:21:06.243285] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-19T21:21:06.750748] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-09-19T21:21:06.993961] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-19T21:21:07.043210] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-19T21:21:07.638800] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T21:21:07.843310] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-19T21:21:08.643303] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-19T21:21:08.861903] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T21:21:09.175362] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T21:21:09.443283] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-19T21:21:10.243279] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-19T21:21:10.479779] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T21:21:11.043263] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-19T21:21:11.230319] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T21:21:11.289353] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T21:21:11.843297] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-19T21:21:12.643293] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-19T21:21:12.900676] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T21:21:13.294161] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-19T21:21:13.443279] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-19T21:21:14.243278] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-19T21:21:15.043319] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-19T21:21:15.403876] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T21:21:15.823306] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-09-19T21:21:15.843213] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-19T21:21:16.199386] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-19T21:21:16.643292] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-19T21:21:17.270912] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T21:21:17.443269] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-19T21:21:18.243311] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-19T21:21:18.336608] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T21:21:18.893759] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T21:21:19.043275] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-19T21:21:19.655575] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-19T21:21:19.843272] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-19T21:21:20.648434] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-19T21:21:20.672096] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T21:21:20.787963] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (4.94 seconds). [2025-09-19T21:21:21.443277] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-19T21:21:21.695401] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T21:21:21.697729] [INFO ] [REMOTE ] SOL: Full fetch complete (21996 records). [2025-09-19T21:21:21.697830] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-19T21:21:22.130531] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-19T21:21:22.130711] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-19T21:21:22.131240] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-19T21:21:22.131282] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-19T21:21:22.131948] [DEBUG] [LOCAL ] SOL: Trimmed 21996 records to 13908 (keeping 200 days of data) [2025-09-19T21:21:22.219926] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T21:21:22.253738] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-19T21:21:22.242988] [DEBUG] [LOCAL ] SOL: Primary data saved (13908 records). [2025-09-19T21:21:22.255293] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-19T21:21:22.256742] [INFO ] [MAIN ] Update Progress: 1965/2372 symbols completed. SOL took 31.7s. Estimated remaining: 54m 7s. Rate: 7.5 symbols/min [2025-09-19T21:21:22.431176] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:21:22.437102] [DEBUG] [LOCAL ] SOR: Loaded 3003 existing records from primary storage. [2025-09-19T21:21:22.437276] [INFO ] [MAIN ] SOR: Loaded 3003 existing records. [2025-09-19T21:21:22.620302] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:21:22.620716] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-19T21:21:22.620775] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-19T21:21:22.621218] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-19T21:21:22.621280] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-19T21:21:22.982113] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:21:23.043218] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-19T21:21:23.135975] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T21:21:23.410126] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-19T21:21:23.843259] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-19T21:21:24.190103] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T21:21:24.643268] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-19T21:21:25.443286] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-19T21:21:25.704538] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T21:21:26.228856] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T21:21:26.243227] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-19T21:21:26.480263] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T21:21:26.849069] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-19T21:21:27.043303] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-19T21:21:27.707186] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T21:21:27.843305] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-19T21:21:28.643276] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-19T21:21:29.331452] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T21:21:29.443282] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-19T21:21:29.563347] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T21:21:29.570459] [INFO ] [REMOTE ] SOLV: Full fetch complete (63294 records). [2025-09-19T21:21:29.570580] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-19T21:21:29.987756] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-19T21:21:29.987866] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-19T21:21:29.988962] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-19T21:21:29.989030] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-19T21:21:29.990479] [DEBUG] [LOCAL ] SOLV: Trimmed 63294 records to 44919 (keeping 200 days of data) [2025-09-19T21:21:30.249036] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-19T21:21:30.258382] [DEBUG] [LOCAL ] SOLV: Primary data saved (44919 records). [2025-09-19T21:21:30.258455] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-19T21:21:30.258534] [INFO ] [MAIN ] Update Progress: 1966/2372 symbols completed. SOLV took 38.8s. Estimated remaining: 53m 59s. Rate: 7.5 symbols/min [2025-09-19T21:21:30.430946] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:21:30.440416] [DEBUG] [LOCAL ] SOS: Loaded 7525 existing records from primary storage. [2025-09-19T21:21:30.440529] [INFO ] [MAIN ] SOS: Loaded 7525 existing records. [2025-09-19T21:21:30.614719] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:21:30.615018] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-19T21:21:30.615080] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-19T21:21:30.615433] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-19T21:21:30.615504] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-19T21:21:30.963716] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:21:31.043226] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-19T21:21:31.744029] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T21:21:31.843240] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-19T21:21:32.038692] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T21:21:32.046839] [INFO ] [REMOTE ] SON: Full fetch complete (61759 records). [2025-09-19T21:21:32.046971] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-19T21:21:32.444726] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-19T21:21:32.444835] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-19T21:21:32.445916] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-19T21:21:32.445999] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-19T21:21:32.457872] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T21:21:32.461811] [DEBUG] [LOCAL ] SON: Trimmed 61759 records to 43516 (keeping 200 days of data) [2025-09-19T21:21:32.665423] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-19T21:21:32.764323] [DEBUG] [LOCAL ] SON: Primary data saved (43516 records). [2025-09-19T21:21:32.764499] [INFO ] [MAIN ] SON: Full history saved. [2025-09-19T21:21:32.764695] [INFO ] [MAIN ] Update Progress: 1967/2372 symbols completed. SON took 32.3s. Estimated remaining: 53m 50s. Rate: 7.5 symbols/min [2025-09-19T21:21:32.940445] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:21:32.975712] [DEBUG] [LOCAL ] SPB: Loaded 34447 existing records from primary storage. [2025-09-19T21:21:32.975866] [INFO ] [MAIN ] SPB: Loaded 34447 existing records. [2025-09-19T21:21:33.158560] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:21:33.158826] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-19T21:21:33.158881] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-19T21:21:33.159881] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-19T21:21:33.159942] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-19T21:21:33.310799] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-19T21:21:33.448421] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-19T21:21:33.559433] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:21:34.058118] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-19T21:21:34.179265] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T21:21:34.243294] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-19T21:21:34.932244] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T21:21:35.043259] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-19T21:21:35.600134] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T21:21:35.843285] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-19T21:21:36.643278] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-19T21:21:37.292034] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-19T21:21:37.443257] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-19T21:21:37.742205] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T21:21:38.116831] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T21:21:38.243253] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-19T21:21:39.043282] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-19T21:21:39.607105] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T21:21:39.843246] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-19T21:21:40.401468] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T21:21:40.583962] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T21:21:40.643217] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-19T21:21:41.443301] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-19T21:21:42.000051] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-19T21:21:42.001629] [INFO ] [REMOTE ] SOR: Full fetch complete (4390 records). [2025-09-19T21:21:42.001761] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-19T21:21:42.251164] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-19T21:21:42.469122] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-19T21:21:42.469266] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-19T21:21:42.469470] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-19T21:21:42.469580] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-19T21:21:42.470407] [DEBUG] [LOCAL ] SOR: Trimmed 4390 records to 3015 (keeping 200 days of data) [2025-09-19T21:21:42.491229] [DEBUG] [LOCAL ] SOR: Primary data saved (3015 records). [2025-09-19T21:21:42.491398] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-19T21:21:42.491543] [INFO ] [MAIN ] Update Progress: 1968/2372 symbols completed. SOR took 20.2s. Estimated remaining: 53m 43s. Rate: 7.5 symbols/min [2025-09-19T21:21:42.670980] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:21:42.716015] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T21:21:42.776069] [DEBUG] [LOCAL ] SPCE: Loaded 50170 existing records from primary storage. [2025-09-19T21:21:42.776262] [INFO ] [MAIN ] SPCE: Loaded 50170 existing records. [2025-09-19T21:21:42.951838] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:21:42.952082] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-19T21:21:42.952132] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-19T21:21:42.953903] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-19T21:21:42.953963] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-19T21:21:43.051606] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-19T21:21:43.132425] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-19T21:21:43.338678] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:21:43.843326] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-19T21:21:44.601374] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T21:21:44.643340] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-19T21:21:45.215424] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T21:21:45.443490] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-19T21:21:46.105712] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T21:21:46.243231] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-19T21:21:46.762550] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T21:21:47.043278] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-19T21:21:47.843232] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-19T21:21:48.203477] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T21:21:48.507816] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T21:21:48.643280] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-19T21:21:49.443287] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-19T21:21:49.825041] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T21:21:49.835954] [INFO ] [REMOTE ] SONY: Full fetch complete (77210 records). [2025-09-19T21:21:49.836141] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-19T21:21:50.255746] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-19T21:21:50.259946] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-19T21:21:50.261607] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-19T21:21:50.262882] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-19T21:21:50.263385] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-19T21:21:50.277795] [DEBUG] [LOCAL ] SONY: Trimmed 77210 records to 54141 (keeping 200 days of data) [2025-09-19T21:21:50.299924] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T21:21:50.629344] [DEBUG] [LOCAL ] SONY: Primary data saved (54141 records). [2025-09-19T21:21:50.629486] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-19T21:21:50.630297] [INFO ] [MAIN ] Update Progress: 1969/2372 symbols completed. SONY took 48.7s. Estimated remaining: 53m 35s. Rate: 7.5 symbols/min [2025-09-19T21:21:50.798051] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:21:50.821541] [DEBUG] [LOCAL ] SPE: Loaded 6451 existing records from primary storage. [2025-09-19T21:21:50.821778] [INFO ] [MAIN ] SPE: Loaded 6451 existing records. [2025-09-19T21:21:51.007578] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:21:51.008129] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-19T21:21:51.008282] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-19T21:21:51.008679] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-19T21:21:51.015754] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-19T21:21:51.055531] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-19T21:21:51.103203] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T21:21:51.399602] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:21:51.460485] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T21:21:51.464229] [INFO ] [REMOTE ] SOS: Full fetch complete (11248 records). [2025-09-19T21:21:51.464323] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-19T21:21:51.832307] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-19T21:21:51.832389] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-19T21:21:51.832678] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-19T21:21:51.832739] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-19T21:21:51.833243] [DEBUG] [LOCAL ] SOS: Trimmed 11248 records to 7689 (keeping 200 days of data) [2025-09-19T21:21:51.856959] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-19T21:21:51.887374] [DEBUG] [LOCAL ] SOS: Primary data saved (7689 records). [2025-09-19T21:21:51.887507] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-19T21:21:51.887670] [INFO ] [MAIN ] Update Progress: 1970/2372 symbols completed. SOS took 21.6s. Estimated remaining: 53m 25s. Rate: 7.5 symbols/min [2025-09-19T21:21:52.058898] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:21:52.135294] [DEBUG] [LOCAL ] SPG: Loaded 50828 existing records from primary storage. [2025-09-19T21:21:52.135470] [INFO ] [MAIN ] SPG: Loaded 50828 existing records. [2025-09-19T21:21:52.313980] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:21:52.314212] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-19T21:21:52.314260] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-19T21:21:52.315419] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-19T21:21:52.315479] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-19T21:21:52.646141] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-19T21:21:52.689424] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:21:52.779267] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T21:21:53.250234] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T21:21:53.443232] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-19T21:21:54.248427] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-19T21:21:54.262027] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T21:21:54.287162] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T21:21:55.043322] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-19T21:21:55.843321] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-19T21:21:56.239924] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T21:21:56.643243] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-19T21:21:56.740169] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T21:21:57.061366] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T21:21:57.443268] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-19T21:21:57.896782] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-19T21:21:58.224601] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T21:21:58.243223] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-19T21:21:59.043265] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-19T21:21:59.843321] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-19T21:22:00.187748] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T21:22:00.289127] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-19T21:22:00.643260] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-19T21:22:00.756212] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-19T21:22:01.443263] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-19T21:22:02.243267] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-19T21:22:02.810082] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-19T21:22:03.043280] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-19T21:22:03.054228] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-19T21:22:03.802091] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T21:22:03.843238] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-19T21:22:04.643268] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-19T21:22:04.673185] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-19T21:22:05.019993] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T21:22:05.443267] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-19T21:22:06.243300] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-19T21:22:06.949143] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-19T21:22:07.044873] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-19T21:22:07.047032] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T21:22:07.106625] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T21:22:07.843315] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-19T21:22:08.643300] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-19T21:22:09.448435] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-19T21:22:09.464176] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-19T21:22:09.937468] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T21:22:10.184626] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T21:22:10.243272] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-19T21:22:10.296549] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T21:22:10.684919] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T21:22:10.686779] [INFO ] [REMOTE ] SPE: Full fetch complete (10166 records). [2025-09-19T21:22:10.686850] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-19T21:22:11.041051] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-19T21:22:11.041127] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-19T21:22:11.041346] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-19T21:22:11.041384] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-19T21:22:11.041849] [DEBUG] [LOCAL ] SPE: Trimmed 10166 records to 6519 (keeping 200 days of data) [2025-09-19T21:22:11.059106] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-19T21:22:11.085907] [DEBUG] [LOCAL ] SPE: Primary data saved (6519 records). [2025-09-19T21:22:11.086340] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-19T21:22:11.086458] [INFO ] [MAIN ] Update Progress: 1971/2372 symbols completed. SPE took 20.5s. Estimated remaining: 53m 20s. Rate: 7.5 symbols/min [2025-09-19T21:22:11.254817] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:22:11.315457] [DEBUG] [LOCAL ] SPGI: Loaded 46192 existing records from primary storage. [2025-09-19T21:22:11.315952] [INFO ] [MAIN ] SPGI: Loaded 46192 existing records. [2025-09-19T21:22:11.496126] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:22:11.496450] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-19T21:22:11.496506] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-19T21:22:11.497720] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-19T21:22:11.497783] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-19T21:22:11.860585] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:22:11.854565] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-19T21:22:12.643296] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-19T21:22:12.726524] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T21:22:13.443307] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-19T21:22:14.171440] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T21:22:14.243216] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-19T21:22:14.454175] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T21:22:14.950028] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T21:22:15.043227] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-19T21:22:15.843354] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-19T21:22:16.553740] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-19T21:22:16.565170] [INFO ] [REMOTE ] SPCE: Full fetch complete (72307 records). [2025-09-19T21:22:16.565381] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-19T21:22:16.647074] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-19T21:22:16.870388] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T21:22:17.001272] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-19T21:22:17.001361] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-19T21:22:17.002386] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-19T21:22:17.002447] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-19T21:22:17.004000] [DEBUG] [LOCAL ] SPCE: Trimmed 72307 records to 50549 (keeping 200 days of data) [2025-09-19T21:22:17.306597] [DEBUG] [LOCAL ] SPCE: Primary data saved (50549 records). [2025-09-19T21:22:17.306761] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-19T21:22:17.306869] [INFO ] [MAIN ] Update Progress: 1972/2372 symbols completed. SPCE took 34.8s. Estimated remaining: 53m 11s. Rate: 7.5 symbols/min [2025-09-19T21:22:17.452702] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-19T21:22:17.478400] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:22:17.498031] [DEBUG] [LOCAL ] SPH: Loaded 18652 existing records from primary storage. [2025-09-19T21:22:17.498178] [INFO ] [MAIN ] SPH: Loaded 18652 existing records. [2025-09-19T21:22:17.726101] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:22:17.727356] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-19T21:22:17.727413] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-19T21:22:17.728458] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-19T21:22:17.728519] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-19T21:22:18.086972] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:22:18.111952] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-19T21:22:18.243219] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-19T21:22:18.658267] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T21:22:18.878935] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T21:22:18.883626] [INFO ] [REMOTE ] SPB: Full fetch complete (47435 records). [2025-09-19T21:22:18.883745] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-19T21:22:19.063321] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-19T21:22:19.270340] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-19T21:22:19.270419] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-19T21:22:19.271295] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-19T21:22:19.271358] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-19T21:22:19.272377] [DEBUG] [LOCAL ] SPB: Trimmed 47435 records to 34660 (keeping 200 days of data) [2025-09-19T21:22:19.493916] [DEBUG] [LOCAL ] SPB: Primary data saved (34660 records). [2025-09-19T21:22:19.494062] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-19T21:22:19.494163] [INFO ] [MAIN ] Update Progress: 1973/2372 symbols completed. SPB took 46.7s. Estimated remaining: 53m 2s. Rate: 7.5 symbols/min [2025-09-19T21:22:19.661164] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:22:19.702454] [DEBUG] [LOCAL ] SPHR: Loaded 40490 existing records from primary storage. [2025-09-19T21:22:19.702632] [INFO ] [MAIN ] SPHR: Loaded 40490 existing records. [2025-09-19T21:22:19.848307] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-19T21:22:19.883889] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:22:19.884164] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-19T21:22:19.884211] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-19T21:22:19.885167] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-19T21:22:19.885227] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-19T21:22:20.250174] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:22:20.469077] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-19T21:22:20.634540] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-19T21:22:20.643202] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-19T21:22:21.443241] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-19T21:22:21.912479] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T21:22:22.088913] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T21:22:22.243265] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-19T21:22:23.043243] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-19T21:22:23.515563] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T21:22:23.855288] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-19T21:22:23.883976] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T21:22:24.622168] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T21:22:24.643231] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-19T21:22:25.322518] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T21:22:25.443262] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-19T21:22:26.243269] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-19T21:22:26.473801] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T21:22:26.481309] [INFO ] [REMOTE ] SPG: Full fetch complete (72045 records). [2025-09-19T21:22:26.481446] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-19T21:22:26.873738] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-19T21:22:26.873912] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-19T21:22:26.875308] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-19T21:22:26.875393] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-19T21:22:26.877069] [DEBUG] [LOCAL ] SPG: Trimmed 72045 records to 51198 (keeping 200 days of data) [2025-09-19T21:22:27.075917] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-19T21:22:27.145364] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T21:22:27.257481] [DEBUG] [LOCAL ] SPG: Primary data saved (51198 records). [2025-09-19T21:22:27.257619] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-19T21:22:27.257744] [INFO ] [MAIN ] Update Progress: 1974/2372 symbols completed. SPG took 35.4s. Estimated remaining: 52m 54s. Rate: 7.5 symbols/min [2025-09-19T21:22:27.429287] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:22:27.471257] [DEBUG] [LOCAL ] SPIR: Loaded 37819 existing records from primary storage. [2025-09-19T21:22:27.471395] [INFO ] [MAIN ] SPIR: Loaded 37819 existing records. [2025-09-19T21:22:27.647415] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:22:27.647723] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-19T21:22:27.647780] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-19T21:22:27.648521] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-19T21:22:27.648580] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-19T21:22:27.848327] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-19T21:22:27.963277] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T21:22:28.034755] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:22:28.643317] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-19T21:22:29.434506] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-19T21:22:29.445146] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-19T21:22:29.470529] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T21:22:29.588800] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T21:22:30.243291] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-19T21:22:30.648801] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T21:22:31.043270] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-19T21:22:31.843291] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-19T21:22:32.240288] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-19T21:22:32.602705] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T21:22:32.643236] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-19T21:22:33.073112] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T21:22:33.443355] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-19T21:22:34.243294] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-19T21:22:34.357781] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T21:22:35.043542] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-19T21:22:35.130560] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T21:22:35.297799] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T21:22:35.843279] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-19T21:22:36.643300] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-19T21:22:36.938348] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T21:22:37.009961] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T21:22:37.443265] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-19T21:22:38.243298] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-19T21:22:38.317353] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T21:22:39.043269] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-19T21:22:39.440003] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T21:22:39.478197] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T21:22:39.843272] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-19T21:22:40.643228] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-19T21:22:40.781719] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T21:22:40.813211] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T21:22:40.818288] [INFO ] [REMOTE ] SPH: Full fetch complete (28635 records). [2025-09-19T21:22:40.818407] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-19T21:22:41.198869] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-19T21:22:41.198955] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-19T21:22:41.199353] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-19T21:22:41.199391] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-19T21:22:41.200080] [DEBUG] [LOCAL ] SPH: Trimmed 28635 records to 18734 (keeping 200 days of data) [2025-09-19T21:22:41.311173] [DEBUG] [LOCAL ] SPH: Primary data saved (18734 records). [2025-09-19T21:22:41.311315] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-19T21:22:41.311410] [INFO ] [MAIN ] Update Progress: 1975/2372 symbols completed. SPH took 24.0s. Estimated remaining: 52m 47s. Rate: 7.5 symbols/min [2025-09-19T21:22:41.454051] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-19T21:22:41.486828] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:22:41.494411] [DEBUG] [LOCAL ] SPMC: Loaded 5759 existing records from primary storage. [2025-09-19T21:22:41.494495] [INFO ] [MAIN ] SPMC: Loaded 5759 existing records. [2025-09-19T21:22:41.672022] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:22:41.672257] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-19T21:22:41.672316] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-19T21:22:41.672612] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-19T21:22:41.672705] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-19T21:22:42.027870] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:22:42.243507] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-19T21:22:42.539691] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T21:22:43.043341] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-19T21:22:43.209849] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-19T21:22:43.239608] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T21:22:43.843262] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-19T21:22:44.614095] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-19T21:22:44.643296] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-19T21:22:44.926417] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T21:22:45.443336] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-19T21:22:46.249824] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-19T21:22:46.263458] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T21:22:46.284275] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T21:22:47.043297] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-19T21:22:47.843331] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-19T21:22:47.924492] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T21:22:48.031336] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T21:22:48.643301] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-19T21:22:49.443314] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-19T21:22:49.616802] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-19T21:22:50.243258] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-19T21:22:50.298791] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-19T21:22:50.374451] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T21:22:51.043262] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-19T21:22:51.771389] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T21:22:51.843238] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-19T21:22:52.013991] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T21:22:52.643264] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-19T21:22:53.443283] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-19T21:22:53.748079] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T21:22:53.757094] [INFO ] [REMOTE ] SPGI: Full fetch complete (66416 records). [2025-09-19T21:22:53.757254] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-19T21:22:54.248280] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-19T21:22:54.249715] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T21:22:54.254448] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-19T21:22:54.263803] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-19T21:22:54.265483] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-19T21:22:54.266018] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-19T21:22:54.267952] [DEBUG] [LOCAL ] SPGI: Trimmed 66416 records to 46568 (keeping 200 days of data) [2025-09-19T21:22:54.576062] [DEBUG] [LOCAL ] SPGI: Primary data saved (46568 records). [2025-09-19T21:22:54.576208] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-19T21:22:54.576592] [INFO ] [MAIN ] Update Progress: 1976/2372 symbols completed. SPGI took 43.5s. Estimated remaining: 52m 40s. Rate: 7.5 symbols/min [2025-09-19T21:22:54.752242] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:22:54.752477] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-19T21:22:54.752532] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-19T21:22:54.752739] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-19T21:22:54.752801] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-19T21:22:54.752868] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-19T21:22:54.752906] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-19T21:22:55.052739] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-19T21:22:55.107446] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-19T21:22:55.171355] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:22:55.237389] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T21:22:55.245733] [INFO ] [REMOTE ] SPHR: Full fetch complete (57360 records). [2025-09-19T21:22:55.245966] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-19T21:22:55.654086] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-19T21:22:55.654176] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-19T21:22:55.655628] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-19T21:22:55.655719] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-19T21:22:55.657075] [DEBUG] [LOCAL ] SPHR: Trimmed 57360 records to 40825 (keeping 200 days of data) [2025-09-19T21:22:55.848000] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-19T21:22:55.920178] [DEBUG] [LOCAL ] SPHR: Primary data saved (40825 records). [2025-09-19T21:22:55.920334] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-19T21:22:55.920481] [INFO ] [MAIN ] Update Progress: 1977/2372 symbols completed. SPHR took 36.4s. Estimated remaining: 52m 31s. Rate: 7.5 symbols/min [2025-09-19T21:22:56.102337] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:22:56.140781] [DEBUG] [LOCAL ] SPNT: Loaded 35016 existing records from primary storage. [2025-09-19T21:22:56.140938] [INFO ] [MAIN ] SPNT: Loaded 35016 existing records. [2025-09-19T21:22:56.340162] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:22:56.346588] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:22:56.347386] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-19T21:22:56.347047] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-19T21:22:56.348010] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-19T21:22:56.348947] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-19T21:22:56.349011] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-19T21:22:56.645294] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-19T21:22:56.746463] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:22:56.768938] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-19T21:22:57.419105] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T21:22:57.443228] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-19T21:22:58.146393] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T21:22:58.243232] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-19T21:22:59.043323] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-19T21:22:59.843324] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-19T21:23:00.513940] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T21:23:00.519119] [INFO ] [REMOTE ] SPIR: Full fetch complete (52134 records). [2025-09-19T21:23:00.519241] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-19T21:23:00.648434] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-19T21:23:00.916691] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-19T21:23:00.916783] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-19T21:23:00.917688] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-19T21:23:00.917750] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-19T21:23:00.918903] [DEBUG] [LOCAL ] SPIR: Trimmed 52134 records to 38051 (keeping 200 days of data) [2025-09-19T21:23:01.152572] [DEBUG] [LOCAL ] SPIR: Primary data saved (38051 records). [2025-09-19T21:23:01.152751] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-19T21:23:01.152860] [INFO ] [MAIN ] Update Progress: 1978/2372 symbols completed. SPIR took 33.9s. Estimated remaining: 52m 23s. Rate: 7.5 symbols/min [2025-09-19T21:23:01.338913] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:23:01.372595] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:23:01.373635] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-19T21:23:01.399302] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T21:23:01.424596] [DEBUG] [LOCAL ] SPOT: Loaded 51433 existing records from primary storage. [2025-09-19T21:23:01.424782] [INFO ] [MAIN ] SPOT: Loaded 51433 existing records. [2025-09-19T21:23:01.455587] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-19T21:23:01.615350] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:23:01.615638] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-19T21:23:01.615723] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-19T21:23:01.617376] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-19T21:23:01.617441] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-19T21:23:02.009090] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:23:02.013663] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:23:02.014246] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-19T21:23:02.243299] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-19T21:23:03.043292] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-19T21:23:03.539061] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T21:23:03.843319] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-19T21:23:04.523071] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:23:04.523404] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-19T21:23:04.643284] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-19T21:23:05.090607] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:23:05.091045] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-19T21:23:05.333063] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (7.09 seconds). [2025-09-19T21:23:05.334476] [INFO ] [REMOTE ] SPMC: Full fetch complete (8133 records). [2025-09-19T21:23:05.334555] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-19T21:23:05.448583] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-19T21:23:05.739250] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-19T21:23:05.739342] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-19T21:23:05.739573] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-19T21:23:05.739611] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-19T21:23:05.740156] [DEBUG] [LOCAL ] SPMC: Trimmed 8133 records to 5772 (keeping 200 days of data) [2025-09-19T21:23:05.778013] [DEBUG] [LOCAL ] SPMC: Primary data saved (5772 records). [2025-09-19T21:23:05.778155] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-19T21:23:05.778273] [INFO ] [MAIN ] Update Progress: 1979/2372 symbols completed. SPMC took 24.5s. Estimated remaining: 52m 14s. Rate: 7.5 symbols/min [2025-09-19T21:23:05.953728] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:23:05.982442] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T21:23:06.031126] [DEBUG] [LOCAL ] SPR: Loaded 41763 existing records from primary storage. [2025-09-19T21:23:06.031274] [INFO ] [MAIN ] SPR: Loaded 41763 existing records. [2025-09-19T21:23:06.228581] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:23:06.228910] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-19T21:23:06.228967] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-19T21:23:06.230032] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-19T21:23:06.230091] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-19T21:23:06.248500] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-19T21:23:06.597115] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:23:06.620406] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:23:06.620819] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-19T21:23:07.043275] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-19T21:23:07.264718] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:23:07.265472] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-19T21:23:07.843290] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-19T21:23:07.985419] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-19T21:23:08.394803] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-19T21:23:08.643244] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-19T21:23:09.443286] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-19T21:23:10.243264] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-19T21:23:10.407522] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-19T21:23:10.522528] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T21:23:10.760818] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T21:23:11.043295] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-19T21:23:11.843285] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-19T21:23:12.643264] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-19T21:23:12.748424] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T21:23:13.443278] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-19T21:23:13.541950] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T21:23:13.839633] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-19T21:23:13.840429] [INFO ] [REMOTE ] SPME: Full fetch complete (642 records). [2025-09-19T21:23:13.840500] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-19T21:23:14.021530] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 45 unique days, need 200 days [2025-09-19T21:23:14.021758] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:23:14.021829] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:23:14.021902] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-19T21:23:14.021970] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-19T21:23:14.022007] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-19T21:23:14.022074] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-19T21:23:14.022190] [INFO ] [MAIN ] Update Progress: 1980/2372 symbols completed. SPME took 19.4s. Estimated remaining: 52m 6s. Rate: 7.5 symbols/min [2025-09-19T21:23:14.196849] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:23:14.210052] [DEBUG] [LOCAL ] SPRU: Loaded 8414 existing records from primary storage. [2025-09-19T21:23:14.210196] [INFO ] [MAIN ] SPRU: Loaded 8414 existing records. [2025-09-19T21:23:14.248365] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-19T21:23:14.398144] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:23:14.398412] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-19T21:23:14.398460] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-19T21:23:14.398883] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-19T21:23:14.398945] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-19T21:23:14.752963] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:23:15.025222] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-19T21:23:15.043215] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-19T21:23:15.843280] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-19T21:23:16.054807] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T21:23:16.376368] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-19T21:23:16.643281] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-19T21:23:17.403891] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T21:23:17.443217] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-19T21:23:18.248345] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-19T21:23:18.269317] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T21:23:19.005142] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T21:23:19.043224] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-19T21:23:19.373445] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T21:23:19.724108] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-19T21:23:19.843263] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-19T21:23:20.643265] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-19T21:23:21.323101] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T21:23:21.443276] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-19T21:23:22.243493] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-19T21:23:22.958009] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T21:23:23.043295] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-19T21:23:23.239966] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T21:23:23.272251] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T21:23:23.843290] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-19T21:23:23.976340] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T21:23:24.643276] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-19T21:23:25.388770] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T21:23:25.443227] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-19T21:23:26.243279] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-19T21:23:26.957936] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T21:23:26.963689] [INFO ] [REMOTE ] SPNT: Full fetch complete (48743 records). [2025-09-19T21:23:26.963827] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-19T21:23:27.046601] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-19T21:23:27.367919] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-19T21:23:27.368134] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-19T21:23:27.369074] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-19T21:23:27.369154] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-19T21:23:27.370520] [DEBUG] [LOCAL ] SPNT: Trimmed 48743 records to 35307 (keeping 200 days of data) [2025-09-19T21:23:27.487672] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-19T21:23:27.624850] [DEBUG] [LOCAL ] SPNT: Primary data saved (35307 records). [2025-09-19T21:23:27.625004] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-19T21:23:27.625094] [INFO ] [MAIN ] Update Progress: 1981/2372 symbols completed. SPNT took 31.7s. Estimated remaining: 51m 59s. Rate: 7.5 symbols/min [2025-09-19T21:23:27.796316] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:23:27.820450] [DEBUG] [LOCAL ] SPXC: Loaded 23627 existing records from primary storage. [2025-09-19T21:23:27.820575] [INFO ] [MAIN ] SPXC: Loaded 23627 existing records. [2025-09-19T21:23:27.851319] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-19T21:23:28.007881] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:23:28.008402] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-19T21:23:28.008480] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-19T21:23:28.009524] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-19T21:23:28.009591] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-19T21:23:28.171588] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T21:23:28.280411] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T21:23:28.434467] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:23:28.643272] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-19T21:23:29.443283] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-19T21:23:29.990143] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T21:23:30.243251] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-19T21:23:30.340751] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-19T21:23:30.817344] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T21:23:31.043228] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-19T21:23:31.167495] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-19T21:23:31.843278] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-19T21:23:32.643308] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-19T21:23:33.151348] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T21:23:33.359433] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T21:23:33.443231] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-19T21:23:33.656620] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-19T21:23:34.243296] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-19T21:23:34.787241] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T21:23:35.043278] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-19T21:23:35.843303] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-19T21:23:35.966467] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T21:23:36.643248] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-19T21:23:36.734501] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T21:23:37.380187] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T21:23:37.443234] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-19T21:23:37.870387] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T21:23:38.243275] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-19T21:23:38.911171] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T21:23:39.043301] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-19T21:23:39.843287] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-19T21:23:39.995716] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T21:23:39.997735] [INFO ] [REMOTE ] SPRU: Full fetch complete (11518 records). [2025-09-19T21:23:39.997808] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-19T21:23:40.374874] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-19T21:23:40.375078] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-19T21:23:40.375463] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-19T21:23:40.375549] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-19T21:23:40.376319] [DEBUG] [LOCAL ] SPRU: Trimmed 11518 records to 8469 (keeping 200 days of data) [2025-09-19T21:23:40.434946] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T21:23:40.445777] [INFO ] [REMOTE ] SPOT: Full fetch complete (74156 records). [2025-09-19T21:23:40.450148] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-19T21:23:40.451846] [DEBUG] [LOCAL ] SPRU: Primary data saved (8469 records). [2025-09-19T21:23:40.452118] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-19T21:23:40.452218] [INFO ] [MAIN ] Update Progress: 1982/2372 symbols completed. SPRU took 26.4s. Estimated remaining: 51m 52s. Rate: 7.5 symbols/min [2025-09-19T21:23:40.660164] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-19T21:23:40.796203] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:23:40.951523] [DEBUG] [LOCAL ] SPXX: Loaded 9084 existing records from primary storage. [2025-09-19T21:23:40.955076] [INFO ] [MAIN ] SPXX: Loaded 9084 existing records. [2025-09-19T21:23:41.228231] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-19T21:23:41.231163] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-19T21:23:41.232917] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-19T21:23:41.239602] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-19T21:23:41.262959] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:23:41.263336] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-19T21:23:41.263592] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-19T21:23:41.264080] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-19T21:23:41.264152] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-19T21:23:41.296321] [DEBUG] [LOCAL ] SPOT: Trimmed 74156 records to 51750 (keeping 200 days of data) [2025-09-19T21:23:41.752084] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:23:41.754354] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-19T21:23:41.792553] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T21:23:41.947065] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T21:23:42.057395] [DEBUG] [LOCAL ] SPOT: Primary data saved (51750 records). [2025-09-19T21:23:42.057559] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-19T21:23:42.057689] [INFO ] [MAIN ] Update Progress: 1983/2372 symbols completed. SPOT took 40.9s. Estimated remaining: 51m 43s. Rate: 7.5 symbols/min [2025-09-19T21:23:42.246275] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:23:42.246465] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-19T21:23:42.298896] [DEBUG] [LOCAL ] SQM: Loaded 49038 existing records from primary storage. [2025-09-19T21:23:42.299149] [INFO ] [MAIN ] SQM: Loaded 49038 existing records. [2025-09-19T21:23:42.495755] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:23:42.496017] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-19T21:23:42.496067] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-19T21:23:42.497160] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-19T21:23:42.497222] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-19T21:23:42.761678] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T21:23:42.876383] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:23:43.043269] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-19T21:23:43.843326] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-19T21:23:43.947798] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T21:23:44.274107] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T21:23:44.643284] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-19T21:23:45.443318] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-19T21:23:45.651105] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T21:23:45.952058] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T21:23:46.243423] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-19T21:23:46.379234] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-19T21:23:47.043438] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-19T21:23:47.843290] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-19T21:23:47.951215] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T21:23:48.195937] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T21:23:48.643317] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-19T21:23:49.443269] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-19T21:23:49.714924] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T21:23:49.894436] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T21:23:50.243256] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-19T21:23:51.043269] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-19T21:23:51.174847] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T21:23:51.182461] [INFO ] [REMOTE ] SPR: Full fetch complete (60075 records). [2025-09-19T21:23:51.182593] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-19T21:23:51.377630] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T21:23:51.648821] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-19T21:23:51.648907] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-19T21:23:51.649936] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-19T21:23:51.649998] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-19T21:23:51.651226] [DEBUG] [LOCAL ] SPR: Trimmed 60075 records to 42074 (keeping 200 days of data) [2025-09-19T21:23:51.850818] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-19T21:23:51.926096] [DEBUG] [LOCAL ] SPR: Primary data saved (42074 records). [2025-09-19T21:23:51.926280] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-19T21:23:51.926441] [INFO ] [MAIN ] Update Progress: 1984/2372 symbols completed. SPR took 46.1s. Estimated remaining: 51m 35s. Rate: 7.5 symbols/min [2025-09-19T21:23:52.097038] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:23:52.123573] [DEBUG] [LOCAL ] SQNS: Loaded 25398 existing records from primary storage. [2025-09-19T21:23:52.123750] [INFO ] [MAIN ] SQNS: Loaded 25398 existing records. [2025-09-19T21:23:52.301343] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:23:52.301603] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-19T21:23:52.301678] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-19T21:23:52.302309] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-19T21:23:52.302380] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-19T21:23:52.646624] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-19T21:23:52.693126] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:23:52.725697] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-19T21:23:52.881311] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T21:23:53.443264] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-19T21:23:53.575968] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T21:23:53.580371] [INFO ] [REMOTE ] SPXC: Full fetch complete (33930 records). [2025-09-19T21:23:53.580503] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-19T21:23:53.958340] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-19T21:23:53.958436] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-19T21:23:53.959533] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-19T21:23:53.959611] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-19T21:23:53.964058] [DEBUG] [LOCAL ] SPXC: Trimmed 33930 records to 23780 (keeping 200 days of data) [2025-09-19T21:23:54.126267] [DEBUG] [LOCAL ] SPXC: Primary data saved (23780 records). [2025-09-19T21:23:54.126409] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-19T21:23:54.126573] [INFO ] [MAIN ] Update Progress: 1985/2372 symbols completed. SPXC took 26.5s. Estimated remaining: 51m 26s. Rate: 7.5 symbols/min [2025-09-19T21:23:54.248330] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-19T21:23:54.304822] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:23:54.345366] [DEBUG] [LOCAL ] SR: Loaded 32904 existing records from primary storage. [2025-09-19T21:23:54.345514] [INFO ] [MAIN ] SR: Loaded 32904 existing records. [2025-09-19T21:23:54.540122] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:23:54.540400] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-19T21:23:54.540451] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-19T21:23:54.541187] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-19T21:23:54.541257] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-19T21:23:54.906874] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:23:55.043260] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-19T21:23:55.195761] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T21:23:55.441285] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T21:23:55.843239] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-19T21:23:56.255865] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T21:23:56.643267] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-19T21:23:57.443269] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-19T21:23:57.785850] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T21:23:58.243362] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-19T21:23:58.284863] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T21:23:58.608021] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-19T21:23:59.043307] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-19T21:23:59.843269] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-19T21:23:59.990730] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T21:24:00.147078] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T21:24:00.643276] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-19T21:24:00.775759] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T21:24:01.443294] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-19T21:24:02.243264] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-19T21:24:03.043293] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-19T21:24:03.294458] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T21:24:03.783732] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T21:24:03.843226] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-19T21:24:04.103420] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T21:24:04.477028] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T21:24:04.643263] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-19T21:24:05.426905] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T21:24:05.443224] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-19T21:24:05.501295] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-19T21:24:05.965133] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T21:24:06.243329] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-19T21:24:07.043363] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-19T21:24:07.163714] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T21:24:07.165956] [INFO ] [REMOTE ] SPXX: Full fetch complete (12296 records). [2025-09-19T21:24:07.166037] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-19T21:24:07.554351] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-19T21:24:07.554439] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-19T21:24:07.554874] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-19T21:24:07.554940] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-19T21:24:07.555546] [DEBUG] [LOCAL ] SPXX: Trimmed 12296 records to 9123 (keeping 200 days of data) [2025-09-19T21:24:07.620670] [DEBUG] [LOCAL ] SPXX: Primary data saved (9123 records). [2025-09-19T21:24:07.620839] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-19T21:24:07.620958] [INFO ] [MAIN ] Update Progress: 1986/2372 symbols completed. SPXX took 27.2s. Estimated remaining: 51m 19s. Rate: 7.5 symbols/min [2025-09-19T21:24:07.819290] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:24:07.843287] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-19T21:24:07.904391] [DEBUG] [LOCAL ] SRE: Loaded 53812 existing records from primary storage. [2025-09-19T21:24:07.904539] [INFO ] [MAIN ] SRE: Loaded 53812 existing records. [2025-09-19T21:24:08.028670] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T21:24:08.092921] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:24:08.093193] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-19T21:24:08.093241] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-19T21:24:08.094885] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-19T21:24:08.094946] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-19T21:24:08.485049] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:24:08.643218] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-19T21:24:09.398300] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T21:24:09.443265] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-19T21:24:10.243292] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-19T21:24:10.909858] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-19T21:24:11.043245] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-19T21:24:11.109322] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T21:24:11.477086] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T21:24:11.843305] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-19T21:24:12.643336] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-19T21:24:13.443252] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-19T21:24:14.903980] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-09-19T21:24:14.910874] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-19T21:24:15.234030] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (4.19 seconds). [2025-09-19T21:24:15.245111] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-19T21:24:15.322828] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T21:24:15.843337] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-19T21:24:16.412421] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T21:24:16.520884] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (3.88 seconds). [2025-09-19T21:24:16.643279] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-19T21:24:17.261470] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T21:24:17.443282] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-19T21:24:17.801441] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T21:24:18.243273] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-19T21:24:19.043263] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-19T21:24:19.088478] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-19T21:24:19.120282] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T21:24:19.843306] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-19T21:24:20.375155] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T21:24:20.643273] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-19T21:24:21.024169] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T21:24:21.031635] [INFO ] [REMOTE ] SQM: Full fetch complete (68897 records). [2025-09-19T21:24:21.031802] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-19T21:24:21.440241] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-19T21:24:21.440363] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-19T21:24:21.441536] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-19T21:24:21.441620] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-19T21:24:21.443182] [DEBUG] [LOCAL ] SQM: Trimmed 68897 records to 49335 (keeping 200 days of data) [2025-09-19T21:24:21.443252] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-19T21:24:21.760588] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T21:24:21.769423] [INFO ] [REMOTE ] SQNS: Full fetch complete (31657 records). [2025-09-19T21:24:21.769876] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-19T21:24:22.083440] [DEBUG] [LOCAL ] SQM: Primary data saved (49335 records). [2025-09-19T21:24:22.087048] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-19T21:24:22.087188] [INFO ] [MAIN ] Update Progress: 1987/2372 symbols completed. SQM took 40.0s. Estimated remaining: 51m 13s. Rate: 7.5 symbols/min [2025-09-19T21:24:22.325599] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-19T21:24:22.353279] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-19T21:24:22.353216] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:24:22.354134] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-19T21:24:22.354226] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-19T21:24:22.355333] [DEBUG] [LOCAL ] SQNS: Trimmed 31657 records to 25593 (keeping 200 days of data) [2025-09-19T21:24:22.369322] [DEBUG] [LOCAL ] SREA: Loaded 10496 existing records from primary storage. [2025-09-19T21:24:22.369458] [INFO ] [MAIN ] SREA: Loaded 10496 existing records. [2025-09-19T21:24:22.680910] [DEBUG] [LOCAL ] SQNS: Primary data saved (25593 records). [2025-09-19T21:24:22.706596] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-19T21:24:22.707141] [INFO ] [MAIN ] Update Progress: 1988/2372 symbols completed. SQNS took 30.8s. Estimated remaining: 51m 3s. Rate: 7.5 symbols/min [2025-09-19T21:24:22.706507] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:24:22.708042] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-19T21:24:22.708194] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-19T21:24:22.745901] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-19T21:24:22.751185] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-19T21:24:23.051782] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:24:23.206419] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T21:24:23.236912] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-19T21:24:23.336500] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-19T21:24:23.337628] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-19T21:24:23.373930] [DEBUG] [LOCAL ] SRFM: Loaded 35211 existing records from primary storage. [2025-09-19T21:24:23.396043] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:24:23.389784] [INFO ] [MAIN ] SRFM: Loaded 35211 existing records. [2025-09-19T21:24:23.577795] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:24:23.578069] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-19T21:24:23.578118] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-19T21:24:23.579021] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-19T21:24:23.579080] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-19T21:24:23.848454] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-19T21:24:23.954326] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:24:24.643321] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-19T21:24:24.905688] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T21:24:24.910517] [INFO ] [REMOTE ] SR: Full fetch complete (45630 records). [2025-09-19T21:24:24.910634] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-19T21:24:25.297254] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-19T21:24:25.297372] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-19T21:24:25.298307] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-19T21:24:25.298383] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-19T21:24:25.313262] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T21:24:25.319447] [DEBUG] [LOCAL ] SR: Trimmed 45630 records to 33089 (keeping 200 days of data) [2025-09-19T21:24:25.443405] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-19T21:24:25.533614] [DEBUG] [LOCAL ] SR: Primary data saved (33089 records). [2025-09-19T21:24:25.533824] [INFO ] [MAIN ] SR: Full history saved. [2025-09-19T21:24:25.533935] [INFO ] [MAIN ] Update Progress: 1989/2372 symbols completed. SR took 31.4s. Estimated remaining: 50m 54s. Rate: 7.5 symbols/min [2025-09-19T21:24:25.737040] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:24:25.749712] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-19T21:24:25.776455] [DEBUG] [LOCAL ] SRG: Loaded 16295 existing records from primary storage. [2025-09-19T21:24:25.776619] [INFO ] [MAIN ] SRG: Loaded 16295 existing records. [2025-09-19T21:24:25.970930] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:24:25.971248] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-19T21:24:25.971304] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-19T21:24:25.972304] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-19T21:24:25.972364] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-19T21:24:26.254512] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-19T21:24:26.343801] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:24:26.475970] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T21:24:26.590453] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T21:24:27.043265] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-19T21:24:27.843275] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-19T21:24:27.983591] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-19T21:24:28.474586] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T21:24:28.482506] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-19T21:24:28.643262] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-19T21:24:29.443306] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-19T21:24:29.477745] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T21:24:30.243303] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-19T21:24:31.043288] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-19T21:24:31.357988] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T21:24:31.547563] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T21:24:31.843278] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-19T21:24:31.955374] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T21:24:32.347832] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-19T21:24:32.643325] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-19T21:24:33.443318] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-19T21:24:33.730050] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-19T21:24:34.237731] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-19T21:24:34.243211] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-19T21:24:35.043241] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-19T21:24:35.613574] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T21:24:35.843331] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-19T21:24:35.914340] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-19T21:24:36.643315] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-19T21:24:37.443286] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-19T21:24:37.756367] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T21:24:37.791072] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T21:24:38.243339] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-19T21:24:38.815453] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T21:24:39.043339] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-19T21:24:39.339692] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T21:24:39.843293] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-19T21:24:40.643271] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-19T21:24:40.759386] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T21:24:40.873956] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T21:24:40.882131] [INFO ] [REMOTE ] SRE: Full fetch complete (77274 records). [2025-09-19T21:24:40.882282] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-19T21:24:41.302892] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-19T21:24:41.303115] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-19T21:24:41.304393] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-19T21:24:41.304461] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-19T21:24:41.306190] [DEBUG] [LOCAL ] SRE: Trimmed 77274 records to 54202 (keeping 200 days of data) [2025-09-19T21:24:41.493049] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-19T21:24:41.646455] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T21:24:41.669509] [DEBUG] [LOCAL ] SRE: Primary data saved (54202 records). [2025-09-19T21:24:41.669633] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-19T21:24:41.670416] [INFO ] [MAIN ] Update Progress: 1990/2372 symbols completed. SRE took 34.0s. Estimated remaining: 50m 48s. Rate: 7.5 symbols/min [2025-09-19T21:24:41.857769] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:24:41.889415] [DEBUG] [LOCAL ] SRI: Loaded 28249 existing records from primary storage. [2025-09-19T21:24:41.889553] [INFO ] [MAIN ] SRI: Loaded 28249 existing records. [2025-09-19T21:24:42.078757] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:24:42.079017] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-19T21:24:42.079064] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-19T21:24:42.079758] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-19T21:24:42.079817] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-19T21:24:42.257202] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-19T21:24:42.474259] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:24:42.515814] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-19T21:24:43.043259] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-19T21:24:43.430679] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T21:24:43.777218] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T21:24:43.779105] [INFO ] [REMOTE ] SREA: Full fetch complete (16016 records). [2025-09-19T21:24:43.779177] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-19T21:24:43.848430] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-19T21:24:44.146508] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-19T21:24:44.146599] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-19T21:24:44.146983] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-19T21:24:44.147045] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-19T21:24:44.147544] [DEBUG] [LOCAL ] SREA: Trimmed 16016 records to 10548 (keeping 200 days of data) [2025-09-19T21:24:44.211283] [DEBUG] [LOCAL ] SREA: Primary data saved (10548 records). [2025-09-19T21:24:44.211407] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-19T21:24:44.211489] [INFO ] [MAIN ] Update Progress: 1991/2372 symbols completed. SREA took 22.1s. Estimated remaining: 50m 39s. Rate: 7.5 symbols/min [2025-09-19T21:24:44.379913] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:24:44.380091] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-19T21:24:44.380184] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-19T21:24:44.380331] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-19T21:24:44.380388] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-19T21:24:44.380475] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-19T21:24:44.380515] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-19T21:24:44.651975] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-19T21:24:44.739166] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:24:45.397112] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T21:24:45.443223] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-19T21:24:45.483603] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T21:24:46.243230] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-19T21:24:46.863632] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T21:24:46.877208] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T21:24:46.880265] [INFO ] [REMOTE ] SRG: Full fetch complete (25680 records). [2025-09-19T21:24:46.880348] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-19T21:24:47.045120] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-19T21:24:47.267734] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-19T21:24:47.267852] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-19T21:24:47.268405] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-19T21:24:47.268446] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-19T21:24:47.269422] [DEBUG] [LOCAL ] SRG: Trimmed 25680 records to 16424 (keeping 200 days of data) [2025-09-19T21:24:47.360926] [DEBUG] [LOCAL ] SRG: Primary data saved (16424 records). [2025-09-19T21:24:47.361065] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-19T21:24:47.361152] [INFO ] [MAIN ] Update Progress: 1992/2372 symbols completed. SRG took 21.8s. Estimated remaining: 50m 30s. Rate: 7.5 symbols/min [2025-09-19T21:24:47.534936] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:24:47.544594] [DEBUG] [LOCAL ] SRV: Loaded 7846 existing records from primary storage. [2025-09-19T21:24:47.544741] [INFO ] [MAIN ] SRV: Loaded 7846 existing records. [2025-09-19T21:24:47.725095] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:24:47.725409] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-19T21:24:47.725484] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-19T21:24:47.725972] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-19T21:24:47.726036] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-19T21:24:47.848328] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-19T21:24:48.099394] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:24:48.475627] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-19T21:24:48.602353] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T21:24:48.643227] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-19T21:24:49.194952] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-19T21:24:49.443266] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-19T21:24:49.858698] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-19T21:24:50.243254] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-19T21:24:51.043283] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-19T21:24:51.510666] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-19T21:24:51.714532] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T21:24:51.843247] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-19T21:24:52.643312] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-19T21:24:53.302993] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-19T21:24:53.323505] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T21:24:53.443268] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-19T21:24:54.243267] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-19T21:24:54.888342] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T21:24:55.043312] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-19T21:24:55.481592] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T21:24:55.843313] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-19T21:24:55.861387] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T21:24:56.643300] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-19T21:24:56.777265] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T21:24:57.067241] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-19T21:24:57.443300] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-19T21:24:58.243226] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-19T21:24:58.876440] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-19T21:24:59.043235] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-19T21:24:59.450184] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T21:24:59.843230] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-19T21:25:00.037693] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T21:25:00.643284] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-19T21:25:01.443342] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-19T21:25:01.635837] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T21:25:01.875877] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T21:25:02.243290] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-19T21:25:03.016202] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T21:25:03.043220] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-19T21:25:03.774298] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-19T21:25:03.843296] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-19T21:25:04.643299] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-19T21:25:05.012571] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-19T21:25:05.289868] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T21:25:05.310944] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T21:25:05.443293] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-19T21:25:06.243260] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-19T21:25:06.815246] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T21:25:06.819194] [INFO ] [REMOTE ] SRI: Full fetch complete (41845 records). [2025-09-19T21:25:06.819334] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-19T21:25:07.048370] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-19T21:25:07.241527] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-19T21:25:07.241723] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-19T21:25:07.242700] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-19T21:25:07.242766] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-19T21:25:07.244028] [DEBUG] [LOCAL ] SRI: Trimmed 41845 records to 28412 (keeping 200 days of data) [2025-09-19T21:25:07.403605] [DEBUG] [LOCAL ] SRI: Primary data saved (28412 records). [2025-09-19T21:25:07.403768] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-19T21:25:07.403896] [INFO ] [MAIN ] Update Progress: 1993/2372 symbols completed. SRI took 25.7s. Estimated remaining: 50m 24s. Rate: 7.5 symbols/min [2025-09-19T21:25:07.576282] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:25:07.618124] [DEBUG] [LOCAL ] SSB: Loaded 43282 existing records from primary storage. [2025-09-19T21:25:07.618265] [INFO ] [MAIN ] SSB: Loaded 43282 existing records. [2025-09-19T21:25:07.795931] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T21:25:07.801494] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:25:07.802402] [INFO ] [REMOTE ] SRL: Full fetch complete (1919 records). [2025-09-19T21:25:07.802616] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-19T21:25:07.802671] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-19T21:25:07.835195] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-19T21:25:07.847056] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-19T21:25:07.859482] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-19T21:25:07.875179] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-19T21:25:08.139727] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-19T21:25:08.158810] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:25:08.186709] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:25:08.226431] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-19T21:25:08.258851] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-19T21:25:08.286214] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-19T21:25:08.288749] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-19T21:25:08.288862] [INFO ] [MAIN ] Update Progress: 1994/2372 symbols completed. SRL took 24.1s. Estimated remaining: 50m 15s. Rate: 7.5 symbols/min [2025-09-19T21:25:08.501605] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:25:08.578215] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:25:08.603717] [DEBUG] [LOCAL ] SSD: Loaded 22625 existing records from primary storage. [2025-09-19T21:25:08.603878] [INFO ] [MAIN ] SSD: Loaded 22625 existing records. [2025-09-19T21:25:08.659170] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-19T21:25:08.744381] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-19T21:25:08.832060] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:25:08.833207] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-19T21:25:08.837968] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-19T21:25:08.838597] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T21:25:08.840238] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-19T21:25:08.840943] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-19T21:25:09.208284] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:25:09.443308] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-19T21:25:10.243273] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-19T21:25:10.590548] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-19T21:25:11.043262] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-19T21:25:11.192566] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T21:25:11.523737] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-19T21:25:11.531067] [INFO ] [REMOTE ] SRFM: Full fetch complete (48511 records). [2025-09-19T21:25:11.531181] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-19T21:25:11.848376] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-19T21:25:11.957034] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-19T21:25:11.957116] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-19T21:25:11.958688] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-19T21:25:11.958943] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-19T21:25:11.960094] [DEBUG] [LOCAL ] SRFM: Trimmed 48511 records to 35580 (keeping 200 days of data) [2025-09-19T21:25:12.171440] [DEBUG] [LOCAL ] SRFM: Primary data saved (35580 records). [2025-09-19T21:25:12.171584] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-19T21:25:12.171696] [INFO ] [MAIN ] Update Progress: 1995/2372 symbols completed. SRFM took 49.5s. Estimated remaining: 50m 6s. Rate: 7.5 symbols/min [2025-09-19T21:25:12.350498] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:25:12.391416] [DEBUG] [LOCAL ] SSL: Loaded 41419 existing records from primary storage. [2025-09-19T21:25:12.391555] [INFO ] [MAIN ] SSL: Loaded 41419 existing records. [2025-09-19T21:25:12.584472] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:25:12.585262] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-19T21:25:12.585405] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-19T21:25:12.595530] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-19T21:25:12.612425] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-19T21:25:12.614375] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T21:25:12.647819] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-19T21:25:13.017552] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:25:13.240081] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T21:25:13.443291] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-19T21:25:13.771437] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T21:25:14.243342] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-19T21:25:15.043294] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-19T21:25:15.083872] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-19T21:25:15.574918] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T21:25:15.843280] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-19T21:25:16.643328] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-19T21:25:16.840897] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T21:25:17.448360] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-19T21:25:17.462610] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T21:25:18.243307] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-19T21:25:18.526131] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T21:25:19.043277] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-19T21:25:19.356927] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T21:25:19.735856] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T21:25:19.843247] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-19T21:25:20.643251] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-19T21:25:21.062169] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T21:25:21.443295] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-19T21:25:21.567266] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T21:25:21.986006] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T21:25:22.243274] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-19T21:25:23.043279] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-19T21:25:23.267132] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T21:25:23.843319] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-19T21:25:23.943012] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-19T21:25:24.040766] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T21:25:24.643253] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-19T21:25:24.774292] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T21:25:25.443267] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-19T21:25:26.243276] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-19T21:25:26.358819] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-19T21:25:26.557782] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T21:25:27.043315] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-19T21:25:27.732107] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T21:25:27.843317] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-19T21:25:28.643264] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-19T21:25:28.801674] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T21:25:28.817062] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T21:25:29.443245] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-19T21:25:29.524870] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-19T21:25:30.243277] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-19T21:25:30.326535] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-19T21:25:31.043284] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-19T21:25:31.843299] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-19T21:25:32.036486] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T21:25:32.643334] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-19T21:25:32.699412] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T21:25:33.136687] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T21:25:33.379366] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T21:25:33.384189] [INFO ] [REMOTE ] SSD: Full fetch complete (32207 records). [2025-09-19T21:25:33.384323] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-19T21:25:33.453491] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-19T21:25:33.788074] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-19T21:25:33.788165] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-19T21:25:33.788937] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-19T21:25:33.789001] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-19T21:25:33.789860] [DEBUG] [LOCAL ] SSD: Trimmed 32207 records to 22766 (keeping 200 days of data) [2025-09-19T21:25:33.935783] [DEBUG] [LOCAL ] SSD: Primary data saved (22766 records). [2025-09-19T21:25:33.935984] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-19T21:25:33.936101] [INFO ] [MAIN ] Update Progress: 1996/2372 symbols completed. SSD took 25.6s. Estimated remaining: 50m 1s. Rate: 7.5 symbols/min [2025-09-19T21:25:34.119473] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:25:34.135030] [DEBUG] [LOCAL ] SST: Loaded 12511 existing records from primary storage. [2025-09-19T21:25:34.135176] [INFO ] [MAIN ] SST: Loaded 12511 existing records. [2025-09-19T21:25:34.251856] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-19T21:25:34.359871] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:25:34.360149] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-19T21:25:34.360220] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-19T21:25:34.360691] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-19T21:25:34.360753] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-19T21:25:34.790913] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:25:35.043280] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-19T21:25:35.319163] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T21:25:35.726259] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T21:25:35.843266] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-19T21:25:35.987450] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T21:25:36.643281] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-19T21:25:37.443339] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-19T21:25:37.596256] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T21:25:38.243237] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-19T21:25:38.402378] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T21:25:38.409034] [INFO ] [REMOTE ] SSB: Full fetch complete (61088 records). [2025-09-19T21:25:38.409210] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-19T21:25:38.807000] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-19T21:25:38.807307] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-19T21:25:38.808352] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-19T21:25:38.808434] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-19T21:25:38.821119] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-19T21:25:38.826508] [DEBUG] [LOCAL ] SSB: Trimmed 61088 records to 43549 (keeping 200 days of data) [2025-09-19T21:25:39.046569] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-19T21:25:39.108577] [DEBUG] [LOCAL ] SSB: Primary data saved (43549 records). [2025-09-19T21:25:39.108740] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-19T21:25:39.109106] [INFO ] [MAIN ] Update Progress: 1997/2372 symbols completed. SSB took 31.7s. Estimated remaining: 49m 52s. Rate: 7.5 symbols/min [2025-09-19T21:25:39.793359] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T21:25:39.794922] [INFO ] [REMOTE ] SRV: Full fetch complete (11589 records). [2025-09-19T21:25:39.794994] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-19T21:25:39.853868] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-19T21:25:40.202275] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-19T21:25:40.202692] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-19T21:25:40.203095] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-19T21:25:40.203193] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-19T21:25:40.204226] [DEBUG] [LOCAL ] SRV: Trimmed 11589 records to 7878 (keeping 200 days of data) [2025-09-19T21:25:40.274455] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T21:25:40.293331] [DEBUG] [LOCAL ] SRV: Primary data saved (7878 records). [2025-09-19T21:25:40.293453] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-19T21:25:40.293554] [INFO ] [MAIN ] Update Progress: 1998/2372 symbols completed. SRV took 52.9s. Estimated remaining: 49m 43s. Rate: 7.5 symbols/min [2025-09-19T21:25:40.643285] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-19T21:25:40.870837] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T21:25:41.443261] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-19T21:25:42.108346] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T21:25:42.115134] [INFO ] [REMOTE ] SSL: Full fetch complete (60381 records). [2025-09-19T21:25:42.115264] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-19T21:25:42.500130] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-19T21:25:42.500331] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-19T21:25:42.501540] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-19T21:25:42.507686] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-19T21:25:42.509846] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-19T21:25:42.513011] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-19T21:25:42.515290] [DEBUG] [LOCAL ] SSL: Trimmed 60381 records to 41764 (keeping 200 days of data) [2025-09-19T21:25:42.751850] [DEBUG] [LOCAL ] SSL: Primary data saved (41764 records). [2025-09-19T21:25:42.752100] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-19T21:25:42.752213] [INFO ] [MAIN ] Update Progress: 1999/2372 symbols completed. SSL took 30.6s. Estimated remaining: 49m 34s. Rate: 7.5 symbols/min [2025-09-19T21:25:43.549316] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T21:25:43.552459] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-19T21:25:44.614819] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T21:25:44.618017] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-19T21:25:45.922229] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-19T21:25:45.927602] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-19T21:25:46.871449] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T21:25:46.874921] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-19T21:25:47.802534] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T21:25:47.805415] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-19T21:25:48.572930] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-19T21:25:48.575740] [INFO ] [REMOTE ] SST: Full fetch complete (19122 records). [2025-09-19T21:25:48.575883] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-19T21:25:48.939381] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-19T21:25:48.939509] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-19T21:25:48.939955] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-19T21:25:48.940016] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-19T21:25:48.940620] [DEBUG] [LOCAL ] SST: Trimmed 19122 records to 12554 (keeping 200 days of data) [2025-09-19T21:25:49.013743] [DEBUG] [LOCAL ] SST: Primary data saved (12554 records). [2025-09-19T21:25:49.013921] [INFO ] [MAIN ] SST: Full history saved. [2025-09-19T21:25:49.014048] [INFO ] [MAIN ] Update Progress: 2000/2372 symbols completed. SST took 15.1s. Estimated remaining: 49m 26s. Rate: 7.5 symbols/min [2025-09-19T21:25:49.659012] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:25:49.660694] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:25:49.744686] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:25:49.764895] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:25:49.785826] [DEBUG] [LOCAL ] STC: Loaded 18054 existing records from primary storage. [2025-09-19T21:25:49.786093] [INFO ] [MAIN ] STC: Loaded 18054 existing records. [2025-09-19T21:25:50.031363] [DEBUG] [LOCAL ] SSTK: Loaded 27288 existing records from primary storage. [2025-09-19T21:25:50.032358] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:25:50.032916] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-19T21:25:50.032689] [INFO ] [MAIN ] SSTK: Loaded 27288 existing records. [2025-09-19T21:25:50.033729] [DEBUG] [LOCAL ] ST: Loaded 50255 existing records from primary storage. [2025-09-19T21:25:50.034019] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-19T21:25:50.033943] [INFO ] [MAIN ] ST: Loaded 50255 existing records. [2025-09-19T21:25:50.055420] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-19T21:25:50.101705] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-19T21:25:50.272486] [DEBUG] [LOCAL ] STAG: Loaded 50407 existing records from primary storage. [2025-09-19T21:25:50.361387] [INFO ] [MAIN ] STAG: Loaded 50407 existing records. [2025-09-19T21:25:50.537287] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:25:50.641202] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-19T21:25:50.630785] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:25:50.709740] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-19T21:25:50.672712] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-19T21:25:50.760169] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-19T21:25:50.771594] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-19T21:25:50.806185] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-19T21:25:50.806280] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-19T21:25:50.925469] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-19T21:25:51.056321] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:25:51.180695] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-19T21:25:51.251915] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:25:51.262792] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-19T21:25:51.229264] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-19T21:25:51.345319] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-19T21:25:51.359413] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-19T21:25:51.972015] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:25:52.004485] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-19T21:25:52.173729] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:25:52.179978] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:25:52.180435] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-19T21:25:52.180820] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-19T21:25:52.659801] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T21:25:52.666073] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-19T21:25:53.884182] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T21:25:53.891502] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-19T21:25:54.011574] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T21:25:54.021458] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-19T21:25:54.083083] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T21:25:54.092865] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-19T21:25:54.193206] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T21:25:54.197584] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-19T21:25:55.376863] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T21:25:55.380990] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-19T21:25:55.603736] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T21:25:55.613923] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-19T21:25:55.704929] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T21:25:55.828254] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T21:25:55.843217] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-19T21:25:56.608869] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T21:25:56.643263] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-19T21:25:57.410482] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T21:25:57.443221] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-19T21:25:57.704012] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T21:25:57.881240] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T21:25:58.243333] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-19T21:25:59.043292] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-19T21:25:59.213331] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T21:25:59.795276] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T21:25:59.843242] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-19T21:26:00.256504] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T21:26:00.643274] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-19T21:26:01.443261] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-19T21:26:01.531182] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T21:26:02.098902] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T21:26:02.243456] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-19T21:26:03.016153] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-19T21:26:03.043239] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-19T21:26:03.843267] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-19T21:26:03.907315] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T21:26:04.643291] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-19T21:26:05.030210] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:26:05.443234] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-19T21:26:05.895306] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T21:26:05.930395] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T21:26:06.243306] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-19T21:26:07.043311] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-19T21:26:07.403503] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T21:26:07.642386] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T21:26:07.843302] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-19T21:26:08.293264] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-19T21:26:08.643287] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-19T21:26:08.797391] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-19T21:26:09.443282] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-19T21:26:10.243271] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-19T21:26:10.524160] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T21:26:10.864905] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T21:26:11.043248] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-19T21:26:11.843296] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-19T21:26:12.271332] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T21:26:12.643251] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-19T21:26:12.680790] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T21:26:12.870577] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T21:26:12.875523] [INFO ] [REMOTE ] STC: Full fetch complete (26170 records). [2025-09-19T21:26:12.875621] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-19T21:26:13.245388] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-19T21:26:13.245474] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-19T21:26:13.246068] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-19T21:26:13.246146] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-19T21:26:13.246995] [DEBUG] [LOCAL ] STC: Trimmed 26170 records to 18188 (keeping 200 days of data) [2025-09-19T21:26:13.370341] [DEBUG] [LOCAL ] STC: Primary data saved (18188 records). [2025-09-19T21:26:13.370492] [INFO ] [MAIN ] STC: Full history saved. [2025-09-19T21:26:13.370680] [INFO ] [MAIN ] Update Progress: 2001/2372 symbols completed. STC took 24.4s. Estimated remaining: 49m 21s. Rate: 7.5 symbols/min [2025-09-19T21:26:13.448356] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-19T21:26:13.553760] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:26:13.605029] [DEBUG] [LOCAL ] STE: Loaded 35784 existing records from primary storage. [2025-09-19T21:26:13.605216] [INFO ] [MAIN ] STE: Loaded 35784 existing records. [2025-09-19T21:26:13.789349] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:26:13.789661] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-19T21:26:13.789722] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-19T21:26:13.790670] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-19T21:26:13.790746] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-19T21:26:14.185545] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:26:14.243233] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-19T21:26:14.580492] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T21:26:15.043263] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-19T21:26:15.481406] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T21:26:15.514639] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T21:26:15.843289] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-19T21:26:16.383786] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T21:26:16.643275] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-19T21:26:17.058204] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T21:26:17.443304] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-19T21:26:18.021750] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T21:26:18.243292] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-19T21:26:19.043330] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-19T21:26:19.168933] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-19T21:26:19.179986] [INFO ] [REMOTE ] STAG: Full fetch complete (71820 records). [2025-09-19T21:26:19.180215] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-19T21:26:19.584600] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-19T21:26:19.584812] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-19T21:26:19.586058] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-19T21:26:19.586155] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-19T21:26:19.589308] [DEBUG] [LOCAL ] STAG: Trimmed 71820 records to 50788 (keeping 200 days of data) [2025-09-19T21:26:19.843331] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-19T21:26:19.924242] [DEBUG] [LOCAL ] STAG: Primary data saved (50788 records). [2025-09-19T21:26:19.924415] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-19T21:26:19.924593] [INFO ] [MAIN ] Update Progress: 2002/2372 symbols completed. STAG took 30.9s. Estimated remaining: 49m 13s. Rate: 7.5 symbols/min [2025-09-19T21:26:20.109248] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:26:20.143794] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T21:26:20.177197] [INFO ] [REMOTE ] ST: Full fetch complete (71900 records). [2025-09-19T21:26:20.182949] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-19T21:26:20.187872] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T21:26:20.282811] [DEBUG] [LOCAL ] STEL: Loaded 24014 existing records from primary storage. [2025-09-19T21:26:20.288202] [INFO ] [MAIN ] STEL: Loaded 24014 existing records. [2025-09-19T21:26:20.652384] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-19T21:26:20.662219] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:26:20.695158] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-19T21:26:20.699451] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-19T21:26:20.726436] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-19T21:26:20.742419] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-19T21:26:20.856471] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-19T21:26:20.880191] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-19T21:26:20.888281] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-19T21:26:20.893878] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-19T21:26:20.932663] [DEBUG] [LOCAL ] ST: Trimmed 71900 records to 50609 (keeping 200 days of data) [2025-09-19T21:26:21.234954] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T21:26:21.296789] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:26:21.443420] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-19T21:26:21.520371] [DEBUG] [LOCAL ] ST: Primary data saved (50609 records). [2025-09-19T21:26:21.520514] [INFO ] [MAIN ] ST: Full history saved. [2025-09-19T21:26:21.522306] [INFO ] [MAIN ] Update Progress: 2003/2372 symbols completed. ST took 32.5s. Estimated remaining: 49m 3s. Rate: 7.5 symbols/min [2025-09-19T21:26:21.691859] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:26:21.748364] [DEBUG] [LOCAL ] STEM: Loaded 40575 existing records from primary storage. [2025-09-19T21:26:21.748563] [INFO ] [MAIN ] STEM: Loaded 40575 existing records. [2025-09-19T21:26:21.926137] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:26:21.926399] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-19T21:26:21.926446] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-19T21:26:21.927294] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-19T21:26:21.927354] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-19T21:26:22.247979] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-19T21:26:22.293720] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:26:22.319611] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T21:26:22.665146] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T21:26:23.043272] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-19T21:26:23.129621] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T21:26:23.135906] [INFO ] [REMOTE ] SSTK: Full fetch complete (42477 records). [2025-09-19T21:26:23.136003] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-19T21:26:23.523485] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-19T21:26:23.523577] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-19T21:26:23.524459] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-19T21:26:23.524524] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-19T21:26:23.526708] [DEBUG] [LOCAL ] SSTK: Trimmed 42477 records to 27464 (keeping 200 days of data) [2025-09-19T21:26:23.724013] [DEBUG] [LOCAL ] SSTK: Primary data saved (27464 records). [2025-09-19T21:26:23.724589] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-19T21:26:23.724886] [INFO ] [MAIN ] Update Progress: 2004/2372 symbols completed. SSTK took 34.7s. Estimated remaining: 48m 54s. Rate: 7.5 symbols/min [2025-09-19T21:26:23.848409] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-19T21:26:23.907168] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:26:23.927872] [DEBUG] [LOCAL ] STEW: Loaded 16546 existing records from primary storage. [2025-09-19T21:26:23.928013] [INFO ] [MAIN ] STEW: Loaded 16546 existing records. [2025-09-19T21:26:24.113788] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:26:24.114123] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-19T21:26:24.114174] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-19T21:26:24.114895] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-19T21:26:24.114959] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-19T21:26:24.381809] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-19T21:26:24.548668] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:26:24.643321] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-19T21:26:25.443337] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-19T21:26:25.750768] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-19T21:26:26.081863] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T21:26:26.243333] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-19T21:26:26.708566] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T21:26:27.043279] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-19T21:26:27.395608] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T21:26:27.843310] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-19T21:26:28.643277] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-19T21:26:28.885501] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T21:26:29.322741] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T21:26:29.443290] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-19T21:26:30.243302] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-19T21:26:30.742145] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T21:26:30.773397] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T21:26:31.043280] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-19T21:26:31.352031] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T21:26:31.843270] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-19T21:26:32.643242] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-19T21:26:33.171085] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T21:26:33.202953] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-19T21:26:33.443267] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-19T21:26:33.661504] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-19T21:26:34.243322] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-19T21:26:34.925779] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T21:26:35.043292] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-19T21:26:35.125957] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T21:26:35.843264] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-19T21:26:36.643268] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-19T21:26:37.069673] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T21:26:37.241950] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T21:26:37.443281] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-19T21:26:37.807874] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T21:26:38.243275] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-19T21:26:39.043498] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-19T21:26:39.165995] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T21:26:39.251174] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T21:26:39.843276] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-19T21:26:40.643259] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-19T21:26:41.023146] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T21:26:41.043159] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T21:26:41.046870] [INFO ] [REMOTE ] STEL: Full fetch complete (32110 records). [2025-09-19T21:26:41.046956] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-19T21:26:41.424972] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-19T21:26:41.425188] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-19T21:26:41.425927] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-19T21:26:41.426075] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-19T21:26:41.440255] [DEBUG] [LOCAL ] STEL: Trimmed 32110 records to 24158 (keeping 200 days of data) [2025-09-19T21:26:41.441079] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-19T21:26:41.445795] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-19T21:26:41.603487] [DEBUG] [LOCAL ] STEL: Primary data saved (24158 records). [2025-09-19T21:26:41.603622] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-19T21:26:41.603740] [INFO ] [MAIN ] Update Progress: 2005/2372 symbols completed. STEL took 21.7s. Estimated remaining: 48m 48s. Rate: 7.5 symbols/min [2025-09-19T21:26:41.769563] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:26:41.769796] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-19T21:26:41.769877] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-19T21:26:41.770056] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-19T21:26:41.770097] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-19T21:26:41.770138] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-19T21:26:41.770169] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-19T21:26:42.119272] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:26:42.243220] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-19T21:26:42.633878] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-19T21:26:43.043266] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-19T21:26:43.203335] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T21:26:43.843262] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-19T21:26:44.360288] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T21:26:44.643273] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-19T21:26:45.082158] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-19T21:26:45.412015] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-19T21:26:45.443216] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-19T21:26:46.243251] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-19T21:26:46.644315] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T21:26:47.043275] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-19T21:26:47.339216] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-19T21:26:47.341724] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T21:26:47.843262] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-19T21:26:48.272454] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-19T21:26:48.643266] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-19T21:26:49.054447] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T21:26:49.443257] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-19T21:26:50.243231] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-19T21:26:50.585160] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T21:26:51.043299] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-19T21:26:51.440307] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T21:26:51.644891] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-19T21:26:51.843264] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-19T21:26:52.643225] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-19T21:26:53.191711] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T21:26:53.443269] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-19T21:26:54.243271] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-19T21:26:54.358243] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T21:26:54.363661] [INFO ] [REMOTE ] STE: Full fetch complete (50787 records). [2025-09-19T21:26:54.363761] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-19T21:26:54.688178] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T21:26:54.753901] [INFO ] [REMOTE ] STG: Full fetch complete (2484 records). [2025-09-19T21:26:54.769745] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-19T21:26:54.769506] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-19T21:26:54.769886] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-19T21:26:54.787139] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-19T21:26:54.786163] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-19T21:26:54.792501] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-19T21:26:54.887354] [DEBUG] [LOCAL ] STE: Trimmed 50787 records to 36040 (keeping 200 days of data) [2025-09-19T21:26:55.077929] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-19T21:26:55.090445] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-19T21:26:55.091752] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:26:55.092185] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:26:55.093288] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-19T21:26:55.094443] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-19T21:26:55.095111] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-19T21:26:55.095470] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-19T21:26:55.095871] [INFO ] [MAIN ] Update Progress: 2006/2372 symbols completed. STG took 13.5s. Estimated remaining: 48m 41s. Rate: 7.5 symbols/min [2025-09-19T21:26:55.295302] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:26:55.312395] [DEBUG] [LOCAL ] STK: Loaded 9502 existing records from primary storage. [2025-09-19T21:26:55.313324] [INFO ] [MAIN ] STK: Loaded 9502 existing records. [2025-09-19T21:26:55.506888] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:26:55.507993] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-19T21:26:55.508329] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-19T21:26:55.508988] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-19T21:26:55.509325] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-19T21:26:55.853121] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-19T21:26:55.969346] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:26:55.997766] [DEBUG] [LOCAL ] STE: Primary data saved (36040 records). [2025-09-19T21:26:55.998007] [INFO ] [MAIN ] STE: Full history saved. [2025-09-19T21:26:55.998192] [INFO ] [MAIN ] Update Progress: 2007/2372 symbols completed. STE took 42.6s. Estimated remaining: 48m 32s. Rate: 7.5 symbols/min [2025-09-19T21:26:56.167251] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:26:56.227300] [DEBUG] [LOCAL ] STLA: Loaded 53936 existing records from primary storage. [2025-09-19T21:26:56.227470] [INFO ] [MAIN ] STLA: Loaded 53936 existing records. [2025-09-19T21:26:56.408764] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:26:56.409066] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-19T21:26:56.409138] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-19T21:26:56.410434] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-19T21:26:56.410495] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-19T21:26:56.648534] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-19T21:26:56.767039] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:26:56.962877] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T21:26:57.015533] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T21:26:57.443313] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-19T21:26:57.650887] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-19T21:26:58.243275] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-19T21:26:59.043286] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-19T21:26:59.817972] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-19T21:26:59.843219] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-19T21:26:59.878522] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T21:27:00.070763] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T21:27:00.643320] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-19T21:27:01.443267] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-19T21:27:02.222805] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T21:27:02.226915] [INFO ] [REMOTE ] STEM: Full fetch complete (62953 records). [2025-09-19T21:27:02.227026] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-19T21:27:02.250765] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-19T21:27:02.614629] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T21:27:02.670114] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-19T21:27:02.670194] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-19T21:27:02.671208] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-19T21:27:02.671283] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-19T21:27:02.672576] [DEBUG] [LOCAL ] STEM: Trimmed 62953 records to 40808 (keeping 200 days of data) [2025-09-19T21:27:02.926952] [DEBUG] [LOCAL ] STEM: Primary data saved (40808 records). [2025-09-19T21:27:02.927200] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-19T21:27:02.927383] [INFO ] [MAIN ] Update Progress: 2008/2372 symbols completed. STEM took 41.4s. Estimated remaining: 48m 24s. Rate: 7.5 symbols/min [2025-09-19T21:27:03.069017] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-19T21:27:03.129784] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:27:03.132350] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (3.29 seconds). [2025-09-19T21:27:03.196072] [DEBUG] [LOCAL ] STM: Loaded 53979 existing records from primary storage. [2025-09-19T21:27:03.196243] [INFO ] [MAIN ] STM: Loaded 53979 existing records. [2025-09-19T21:27:03.370206] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:27:03.370463] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-19T21:27:03.370511] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-19T21:27:03.371683] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-19T21:27:03.371741] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-19T21:27:03.727722] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:27:03.843217] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-19T21:27:04.085178] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T21:27:04.087426] [INFO ] [REMOTE ] STEW: Full fetch complete (22122 records). [2025-09-19T21:27:04.087510] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-19T21:27:04.453606] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-19T21:27:04.453719] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-19T21:27:04.454231] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-19T21:27:04.454294] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-19T21:27:04.454924] [DEBUG] [LOCAL ] STEW: Trimmed 22122 records to 16621 (keeping 200 days of data) [2025-09-19T21:27:04.557893] [DEBUG] [LOCAL ] STEW: Primary data saved (16621 records). [2025-09-19T21:27:04.558037] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-19T21:27:04.558124] [INFO ] [MAIN ] Update Progress: 2009/2372 symbols completed. STEW took 40.8s. Estimated remaining: 48m 15s. Rate: 7.5 symbols/min [2025-09-19T21:27:04.648362] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-19T21:27:04.730102] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:27:04.752729] [DEBUG] [LOCAL ] STN: Loaded 23348 existing records from primary storage. [2025-09-19T21:27:04.752874] [INFO ] [MAIN ] STN: Loaded 23348 existing records. [2025-09-19T21:27:04.937201] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:27:04.937465] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-19T21:27:04.937554] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-19T21:27:04.938278] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-19T21:27:04.938346] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-19T21:27:05.301144] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:27:05.308911] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-19T21:27:05.443257] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-19T21:27:06.243235] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-19T21:27:06.547571] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T21:27:06.764951] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-09-19T21:27:06.802323] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-19T21:27:07.043282] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-19T21:27:07.491367] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-19T21:27:07.843282] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-19T21:27:08.643282] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-19T21:27:09.389492] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T21:27:09.443251] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-19T21:27:09.802805] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-09-19T21:27:10.243279] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-19T21:27:10.704129] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T21:27:10.979619] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T21:27:11.043221] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-19T21:27:11.221841] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T21:27:11.843299] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-19T21:27:12.643243] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-19T21:27:13.268638] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-19T21:27:13.443270] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-19T21:27:13.532941] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T21:27:13.928046] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T21:27:14.243248] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-19T21:27:15.043275] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-19T21:27:15.843284] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-19T21:27:16.856990] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T21:27:16.859507] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-19T21:27:17.150836] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (3.71 seconds). [2025-09-19T21:27:17.176166] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T21:27:17.243803] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-19T21:27:17.443270] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-19T21:27:17.763350] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-19T21:27:18.243302] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-19T21:27:18.893342] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T21:27:19.043285] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-19T21:27:19.843265] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-19T21:27:20.492819] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-19T21:27:20.579409] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T21:27:20.643217] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-19T21:27:21.443243] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-19T21:27:22.087913] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T21:27:22.243256] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-19T21:27:22.918239] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T21:27:23.003100] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T21:27:23.043217] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-19T21:27:23.843283] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-19T21:27:24.643271] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-19T21:27:24.745602] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-19T21:27:24.847073] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T21:27:24.910337] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T21:27:24.912340] [INFO ] [REMOTE ] STK: Full fetch complete (13890 records). [2025-09-19T21:27:24.912412] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-19T21:27:25.274409] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-19T21:27:25.274489] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-19T21:27:25.274837] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-19T21:27:25.274897] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-19T21:27:25.275376] [DEBUG] [LOCAL ] STK: Trimmed 13890 records to 9554 (keeping 200 days of data) [2025-09-19T21:27:25.336285] [DEBUG] [LOCAL ] STK: Primary data saved (9554 records). [2025-09-19T21:27:25.336437] [INFO ] [MAIN ] STK: Full history saved. [2025-09-19T21:27:25.336546] [INFO ] [MAIN ] Update Progress: 2010/2372 symbols completed. STK took 30.2s. Estimated remaining: 48m 9s. Rate: 7.5 symbols/min [2025-09-19T21:27:25.448382] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-19T21:27:25.511425] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:27:25.556381] [DEBUG] [LOCAL ] STNG: Loaded 44534 existing records from primary storage. [2025-09-19T21:27:25.556520] [INFO ] [MAIN ] STNG: Loaded 44534 existing records. [2025-09-19T21:27:25.732914] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:27:25.733170] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-19T21:27:25.733218] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-19T21:27:25.734323] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-19T21:27:25.734384] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-19T21:27:26.153304] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:27:26.167464] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T21:27:26.243243] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-19T21:27:27.043356] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-19T21:27:27.846120] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-19T21:27:27.851754] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T21:27:28.182632] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T21:27:28.643283] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-19T21:27:28.875415] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T21:27:29.249258] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T21:27:29.443298] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-19T21:27:30.243242] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-19T21:27:30.690724] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T21:27:31.043322] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-19T21:27:31.300985] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T21:27:31.495131] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T21:27:31.499238] [INFO ] [REMOTE ] STN: Full fetch complete (32238 records). [2025-09-19T21:27:31.499397] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-19T21:27:31.849040] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-19T21:27:31.893623] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-19T21:27:31.893742] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-19T21:27:31.894441] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-19T21:27:31.894502] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-19T21:27:31.895586] [DEBUG] [LOCAL ] STN: Trimmed 32238 records to 23504 (keeping 200 days of data) [2025-09-19T21:27:32.040298] [DEBUG] [LOCAL ] STN: Primary data saved (23504 records). [2025-09-19T21:27:32.040431] [INFO ] [MAIN ] STN: Full history saved. [2025-09-19T21:27:32.040528] [INFO ] [MAIN ] Update Progress: 2011/2372 symbols completed. STN took 27.5s. Estimated remaining: 48m 1s. Rate: 7.5 symbols/min [2025-09-19T21:27:32.209467] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:27:32.222389] [DEBUG] [LOCAL ] STRV: Loaded 11795 existing records from primary storage. [2025-09-19T21:27:32.222510] [INFO ] [MAIN ] STRV: Loaded 11795 existing records. [2025-09-19T21:27:32.400163] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:27:32.400437] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-19T21:27:32.400496] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-19T21:27:32.400951] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-19T21:27:32.401012] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-19T21:27:32.648412] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-19T21:27:32.763208] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:27:32.999388] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T21:27:33.008378] [INFO ] [REMOTE ] STLA: Full fetch complete (77532 records). [2025-09-19T21:27:33.008589] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-19T21:27:33.426789] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-19T21:27:33.426889] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-19T21:27:33.428159] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-19T21:27:33.428227] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-19T21:27:33.429861] [DEBUG] [LOCAL ] STLA: Trimmed 77532 records to 54326 (keeping 200 days of data) [2025-09-19T21:27:33.484497] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-19T21:27:33.689340] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T21:27:33.704907] [INFO ] [REMOTE ] STM: Full fetch complete (77525 records). [2025-09-19T21:27:33.707507] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-19T21:27:34.139384] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-19T21:27:34.139791] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-19T21:27:34.141408] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-19T21:27:34.141780] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-19T21:27:34.147572] [DEBUG] [LOCAL ] STM: Trimmed 77525 records to 54368 (keeping 200 days of data) [2025-09-19T21:27:34.458577] [DEBUG] [LOCAL ] STLA: Primary data saved (54326 records). [2025-09-19T21:27:34.459215] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-19T21:27:34.460298] [INFO ] [MAIN ] Update Progress: 2012/2372 symbols completed. STLA took 38.5s. Estimated remaining: 47m 52s. Rate: 7.5 symbols/min [2025-09-19T21:27:34.672188] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:27:34.706905] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-19T21:27:34.718638] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-19T21:27:34.826221] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T21:27:34.853872] [DEBUG] [LOCAL ] STM: Primary data saved (54368 records). [2025-09-19T21:27:34.854104] [INFO ] [MAIN ] STM: Full history saved. [2025-09-19T21:27:34.854237] [INFO ] [MAIN ] Update Progress: 2013/2372 symbols completed. STM took 31.9s. Estimated remaining: 47m 42s. Rate: 7.5 symbols/min [2025-09-19T21:27:34.980124] [DEBUG] [LOCAL ] STT: Loaded 51602 existing records from primary storage. [2025-09-19T21:27:34.986063] [INFO ] [MAIN ] STT: Loaded 51602 existing records. [2025-09-19T21:27:35.044074] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-19T21:27:35.154206] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:27:35.167247] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-19T21:27:35.183217] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-19T21:27:35.228002] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-19T21:27:35.228418] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-19T21:27:35.245574] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-19T21:27:35.245708] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-19T21:27:35.254951] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:27:35.329993] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-19T21:27:35.354288] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-19T21:27:35.363380] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-19T21:27:35.373724] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-19T21:27:35.942362] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:27:35.942858] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-19T21:27:36.027992] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:27:36.190187] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T21:27:36.201574] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:36.202873] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-19T21:27:36.337125] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T21:27:36.643340] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-19T21:27:37.443331] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-09-19T21:27:37.680441] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:37.681058] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-09-19T21:27:38.243256] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-19T21:27:38.818458] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T21:27:39.043289] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-19T21:27:39.843280] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-02. [2025-09-19T21:27:39.997908] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T21:27:40.091038] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:40.091380] [WARN ] [REMOTE ] STUB: No data returned for month 2025-02 [2025-09-19T21:27:40.145396] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T21:27:40.643269] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-19T21:27:41.443269] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-03. [2025-09-19T21:27:41.668634] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:41.669003] [WARN ] [REMOTE ] STUB: No data returned for month 2025-03 [2025-09-19T21:27:41.740344] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T21:27:42.243286] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-19T21:27:43.043278] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-19T21:27:43.843300] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-04. [2025-09-19T21:27:44.230150] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T21:27:44.279713] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T21:27:44.291282] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:44.292512] [WARN ] [REMOTE ] STUB: No data returned for month 2025-04 [2025-09-19T21:27:44.643272] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-19T21:27:45.443274] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-19T21:27:46.243269] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-19T21:27:46.559867] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T21:27:47.043295] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-05. [2025-09-19T21:27:47.219956] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T21:27:47.290122] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:47.290414] [WARN ] [REMOTE ] STUB: No data returned for month 2025-05 [2025-09-19T21:27:47.306169] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-19T21:27:47.843265] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-06. [2025-09-19T21:27:48.087697] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:48.088033] [WARN ] [REMOTE ] STUB: No data returned for month 2025-06 [2025-09-19T21:27:48.643267] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-19T21:27:49.443276] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-07. [2025-09-19T21:27:49.665521] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:49.665882] [WARN ] [REMOTE ] STUB: No data returned for month 2025-07 [2025-09-19T21:27:50.243272] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-19T21:27:50.344153] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T21:27:51.043242] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-19T21:27:51.362294] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-19T21:27:51.843234] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-19T21:27:52.643276] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-08. [2025-09-19T21:27:52.762464] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T21:27:52.863452] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:27:52.863908] [WARN ] [REMOTE ] STUB: No data returned for month 2025-08 [2025-09-19T21:27:53.112301] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-19T21:27:53.443283] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-19T21:27:54.243268] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-09. [2025-09-19T21:27:55.040035] [INFO ] [REMOTE ] STUB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T21:27:55.042020] [INFO ] [REMOTE ] STUB: Full fetch complete (1005 records). [2025-09-19T21:27:55.042132] [DEBUG] [VALIDATOR ] STUB: Validating primary data. [2025-09-19T21:27:55.054201] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-19T21:27:55.234222] [WARN ] [VALIDATOR ] STUB: Validation failed - insufficient historical data. Have 3 unique days, need 200 days [2025-09-19T21:27:55.234428] [FATAL] [MAIN ] STUB: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:27:55.234503] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:27:55.234557] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-19T21:27:55.234616] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-19T21:27:55.234686] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-19T21:27:55.234764] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-19T21:27:55.234848] [INFO ] [MAIN ] Update Progress: 2014/2372 symbols completed. STUB took 20.4s. Estimated remaining: 47m 37s. Rate: 7.5 symbols/min [2025-09-19T21:27:55.422705] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:27:55.450929] [DEBUG] [LOCAL ] STVN: Loaded 26785 existing records from primary storage. [2025-09-19T21:27:55.451084] [INFO ] [MAIN ] STVN: Loaded 26785 existing records. [2025-09-19T21:27:55.650904] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T21:27:55.690977] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:27:55.691426] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-19T21:27:55.691485] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-19T21:27:55.692280] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-19T21:27:55.692354] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-19T21:27:55.847526] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-19T21:27:56.057211] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:27:56.544271] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-19T21:27:56.643274] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-19T21:27:57.210272] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T21:27:57.443374] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-19T21:27:58.203322] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T21:27:58.243278] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-19T21:27:59.043300] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-19T21:27:59.275741] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T21:27:59.841134] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T21:27:59.843232] [INFO ] [REMOTE ] STRV: Full fetch complete (18660 records). [2025-09-19T21:27:59.843428] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-19T21:27:59.843306] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-19T21:28:00.228782] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-19T21:28:00.228935] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-19T21:28:00.229546] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-19T21:28:00.229733] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-19T21:28:00.230527] [DEBUG] [LOCAL ] STRV: Trimmed 18660 records to 11850 (keeping 200 days of data) [2025-09-19T21:28:00.324123] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T21:28:00.351672] [DEBUG] [LOCAL ] STRV: Primary data saved (11850 records). [2025-09-19T21:28:00.351851] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-19T21:28:00.351963] [INFO ] [MAIN ] Update Progress: 2015/2372 symbols completed. STRV took 28.3s. Estimated remaining: 47m 28s. Rate: 7.5 symbols/min [2025-09-19T21:28:00.536347] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:28:00.599406] [DEBUG] [LOCAL ] STWD: Loaded 52277 existing records from primary storage. [2025-09-19T21:28:00.599615] [INFO ] [MAIN ] STWD: Loaded 52277 existing records. [2025-09-19T21:28:00.648418] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-19T21:28:00.790425] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:28:00.790725] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-19T21:28:00.790784] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-19T21:28:00.792022] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-19T21:28:00.792085] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-19T21:28:01.154303] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:28:01.199940] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T21:28:01.207096] [INFO ] [REMOTE ] STNG: Full fetch complete (64472 records). [2025-09-19T21:28:01.207250] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-19T21:28:01.451387] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-19T21:28:01.633502] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-19T21:28:01.633670] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-19T21:28:01.635194] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-19T21:28:01.635275] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-19T21:28:01.637152] [DEBUG] [LOCAL ] STNG: Trimmed 64472 records to 44844 (keeping 200 days of data) [2025-09-19T21:28:01.929004] [DEBUG] [LOCAL ] STNG: Primary data saved (44844 records). [2025-09-19T21:28:01.929147] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-19T21:28:01.929247] [INFO ] [MAIN ] Update Progress: 2016/2372 symbols completed. STNG took 36.6s. Estimated remaining: 47m 19s. Rate: 7.5 symbols/min [2025-09-19T21:28:02.097760] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:28:02.100816] [DEBUG] [LOCAL ] STXD: Loaded 1374 existing records from primary storage. [2025-09-19T21:28:02.100886] [INFO ] [MAIN ] STXD: Loaded 1374 existing records. [2025-09-19T21:28:02.248349] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-19T21:28:02.280288] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:28:02.280548] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-19T21:28:02.280604] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-19T21:28:02.280906] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-19T21:28:02.280967] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-19T21:28:02.646427] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:28:02.676367] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T21:28:03.043295] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-19T21:28:03.616623] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T21:28:03.749386] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T21:28:03.798673] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T21:28:03.843299] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-19T21:28:04.643234] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-19T21:28:05.195422] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T21:28:05.443285] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-19T21:28:06.005727] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-19T21:28:06.243246] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-19T21:28:06.696950] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T21:28:07.043272] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-19T21:28:07.843284] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-19T21:28:08.159451] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-19T21:28:08.241506] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T21:28:08.643281] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-19T21:28:08.731617] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T21:28:09.202541] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-19T21:28:09.443289] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-19T21:28:10.011089] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T21:28:10.243261] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-19T21:28:10.774728] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-19T21:28:11.043318] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-19T21:28:11.448553] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T21:28:11.843277] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-19T21:28:12.256216] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-19T21:28:12.643310] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-19T21:28:13.443244] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-19T21:28:13.959723] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-19T21:28:14.243253] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-19T21:28:15.006301] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T21:28:15.043282] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-19T21:28:15.536534] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-19T21:28:15.843328] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-19T21:28:16.643306] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-19T21:28:17.062807] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-19T21:28:17.211370] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T21:28:17.244792] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T21:28:17.443227] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-19T21:28:18.243225] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-19T21:28:18.731564] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T21:28:19.043313] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-19T21:28:19.843268] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-19T21:28:20.222037] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T21:28:20.643333] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-19T21:28:20.834366] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T21:28:20.842003] [INFO ] [REMOTE ] STT: Full fetch complete (74654 records). [2025-09-19T21:28:20.842126] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-19T21:28:21.077243] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-19T21:28:21.128678] [INFO ] [REMOTE ] STXD: Full fetch complete (2080 records). [2025-09-19T21:28:21.147726] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-19T21:28:21.383957] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-19T21:28:21.384617] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-19T21:28:21.391194] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T21:28:21.403480] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-19T21:28:21.414219] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-19T21:28:21.446899] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-19T21:28:21.519141] [DEBUG] [LOCAL ] STT: Trimmed 74654 records to 51945 (keeping 200 days of data) [2025-09-19T21:28:21.764226] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-19T21:28:21.765065] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-19T21:28:21.765723] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-19T21:28:21.766304] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-19T21:28:21.767737] [DEBUG] [LOCAL ] STXD: Trimmed 2080 records to 1378 (keeping 200 days of data) [2025-09-19T21:28:21.778483] [DEBUG] [LOCAL ] STXD: Primary data saved (1378 records). [2025-09-19T21:28:21.778813] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-19T21:28:21.779166] [INFO ] [MAIN ] Update Progress: 2017/2372 symbols completed. STXD took 19.8s. Estimated remaining: 47m 13s. Rate: 7.5 symbols/min [2025-09-19T21:28:21.961544] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:28:21.970483] [DEBUG] [LOCAL ] STXE: Loaded 2267 existing records from primary storage. [2025-09-19T21:28:21.971665] [INFO ] [MAIN ] STXE: Loaded 2267 existing records. [2025-09-19T21:28:22.246074] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-19T21:28:22.252448] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:28:22.255806] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-19T21:28:22.256447] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-19T21:28:22.257082] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-19T21:28:22.257634] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-19T21:28:22.660170] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:28:22.730731] [DEBUG] [LOCAL ] STT: Primary data saved (51945 records). [2025-09-19T21:28:22.730869] [INFO ] [MAIN ] STT: Full history saved. [2025-09-19T21:28:22.730969] [INFO ] [MAIN ] Update Progress: 2018/2372 symbols completed. STT took 48.3s. Estimated remaining: 47m 4s. Rate: 7.5 symbols/min [2025-09-19T21:28:22.902733] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:28:22.916837] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T21:28:22.923558] [DEBUG] [LOCAL ] STXG: Loaded 2693 existing records from primary storage. [2025-09-19T21:28:22.923741] [INFO ] [REMOTE ] STVN: Full fetch complete (39379 records). [2025-09-19T21:28:22.923793] [INFO ] [MAIN ] STXG: Loaded 2693 existing records. [2025-09-19T21:28:22.955054] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-19T21:28:23.048360] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-19T21:28:23.309208] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:28:23.417779] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-19T21:28:23.447625] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-19T21:28:23.450336] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-19T21:28:23.460844] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-19T21:28:23.703319] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T21:28:23.741338] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-19T21:28:23.768549] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-19T21:28:23.823081] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-19T21:28:23.828366] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-19T21:28:23.846777] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-19T21:28:23.915703] [DEBUG] [LOCAL ] STVN: Trimmed 39379 records to 26950 (keeping 200 days of data) [2025-09-19T21:28:23.936299] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:28:24.068021] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T21:28:24.148602] [DEBUG] [LOCAL ] STVN: Primary data saved (26950 records). [2025-09-19T21:28:24.148770] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-19T21:28:24.148894] [INFO ] [MAIN ] Update Progress: 2019/2372 symbols completed. STVN took 28.9s. Estimated remaining: 46m 55s. Rate: 7.5 symbols/min [2025-09-19T21:28:24.318862] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:28:24.322081] [DEBUG] [LOCAL ] STXK: Loaded 1540 existing records from primary storage. [2025-09-19T21:28:24.322165] [INFO ] [MAIN ] STXK: Loaded 1540 existing records. [2025-09-19T21:28:24.509817] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:28:24.513564] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T21:28:24.513854] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-19T21:28:24.515518] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-19T21:28:24.515767] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-19T21:28:24.515835] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-19T21:28:24.656364] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-19T21:28:24.879503] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:28:25.443320] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-19T21:28:25.470410] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-19T21:28:25.979836] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-19T21:28:26.243283] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-19T21:28:27.043289] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-19T21:28:27.225164] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T21:28:27.569811] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-19T21:28:27.843289] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-19T21:28:28.445048] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T21:28:28.643335] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-19T21:28:29.172967] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-19T21:28:29.443297] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-19T21:28:30.243333] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-19T21:28:30.778225] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T21:28:31.043280] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-19T21:28:31.428822] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:28:31.428973] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-19T21:28:31.843275] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-19T21:28:32.427253] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-19T21:28:32.643272] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-19T21:28:33.168916] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-19T21:28:33.443281] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-19T21:28:34.180778] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T21:28:34.243238] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-19T21:28:34.786105] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T21:28:35.043268] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-19T21:28:35.554043] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-19T21:28:35.843287] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-19T21:28:36.378944] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-19T21:28:36.643278] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-19T21:28:37.167633] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-19T21:28:37.443307] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-19T21:28:37.838339] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-19T21:28:38.243285] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-19T21:28:38.916014] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-19T21:28:39.043263] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-19T21:28:39.472940] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-19T21:28:39.843242] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-19T21:28:40.270852] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-19T21:28:40.271679] [INFO ] [REMOTE ] STXK: Full fetch complete (2429 records). [2025-09-19T21:28:40.271753] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-19T21:28:40.628977] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-19T21:28:40.629081] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-19T21:28:40.629230] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-19T21:28:40.629316] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-19T21:28:40.629861] [DEBUG] [LOCAL ] STXK: Trimmed 2429 records to 1547 (keeping 200 days of data) [2025-09-19T21:28:40.641675] [DEBUG] [LOCAL ] STXK: Primary data saved (1547 records). [2025-09-19T21:28:40.641740] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-19T21:28:40.641825] [INFO ] [MAIN ] Update Progress: 2020/2372 symbols completed. STXK took 16.5s. Estimated remaining: 46m 48s. Rate: 7.5 symbols/min [2025-09-19T21:28:40.653095] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-19T21:28:40.812949] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:28:40.813107] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-19T21:28:40.813143] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-19T21:28:40.813292] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-19T21:28:40.813335] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-19T21:28:40.813375] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-19T21:28:40.813425] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-19T21:28:41.163978] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:28:41.378068] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T21:28:41.443263] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-19T21:28:42.148006] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-19T21:28:42.243271] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-19T21:28:43.043271] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-19T21:28:43.756558] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-19T21:28:43.843264] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-19T21:28:44.393627] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-19T21:28:44.408889] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-19T21:28:44.643309] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-19T21:28:45.147277] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-19T21:28:45.443322] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-19T21:28:46.039873] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-19T21:28:46.243295] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-19T21:28:46.783070] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-19T21:28:46.784093] [INFO ] [REMOTE ] STXE: Full fetch complete (3708 records). [2025-09-19T21:28:46.784214] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-19T21:28:47.048481] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-19T21:28:47.141305] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-19T21:28:47.141383] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-19T21:28:47.141511] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-19T21:28:47.141585] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-19T21:28:47.141976] [DEBUG] [LOCAL ] STXE: Trimmed 3708 records to 2277 (keeping 200 days of data) [2025-09-19T21:28:47.156732] [DEBUG] [LOCAL ] STXE: Primary data saved (2277 records). [2025-09-19T21:28:47.156791] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-19T21:28:47.156952] [INFO ] [MAIN ] Update Progress: 2021/2372 symbols completed. STXE took 25.4s. Estimated remaining: 46m 40s. Rate: 7.5 symbols/min [2025-09-19T21:28:47.323870] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:28:47.331327] [DEBUG] [LOCAL ] STXT: Loaded 2644 existing records from primary storage. [2025-09-19T21:28:47.331411] [INFO ] [MAIN ] STXT: Loaded 2644 existing records. [2025-09-19T21:28:47.510168] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:28:47.510487] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-19T21:28:47.510544] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-19T21:28:47.510779] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-19T21:28:47.510848] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-19T21:28:47.843870] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-19T21:28:47.865906] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:28:48.325062] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-19T21:28:48.643231] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-19T21:28:49.224614] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T21:28:49.338735] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-19T21:28:49.443281] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-19T21:28:50.024091] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-19T21:28:50.243259] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-19T21:28:50.971829] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T21:28:51.043244] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-19T21:28:51.702089] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T21:28:51.843265] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-19T21:28:52.396317] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T21:28:52.643273] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-19T21:28:53.279255] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-19T21:28:53.443278] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-19T21:28:54.021421] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-19T21:28:54.243239] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-19T21:28:54.755544] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-19T21:28:54.756509] [INFO ] [REMOTE ] STXG: Full fetch complete (4213 records). [2025-09-19T21:28:54.756581] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-19T21:28:55.048819] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-19T21:28:55.133057] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-19T21:28:55.133138] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-19T21:28:55.133275] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-19T21:28:55.133312] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-19T21:28:55.133733] [DEBUG] [LOCAL ] STXG: Trimmed 4213 records to 2705 (keeping 200 days of data) [2025-09-19T21:28:55.154432] [DEBUG] [LOCAL ] STXG: Primary data saved (2705 records). [2025-09-19T21:28:55.154543] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-19T21:28:55.154793] [INFO ] [MAIN ] Update Progress: 2022/2372 symbols completed. STXG took 32.4s. Estimated remaining: 46m 32s. Rate: 7.5 symbols/min [2025-09-19T21:28:55.334468] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:28:55.339574] [DEBUG] [LOCAL ] STXV: Loaded 1704 existing records from primary storage. [2025-09-19T21:28:55.339669] [INFO ] [MAIN ] STXV: Loaded 1704 existing records. [2025-09-19T21:28:55.531896] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:28:55.532589] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-19T21:28:55.532667] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-19T21:28:55.533023] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-19T21:28:55.533105] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-19T21:28:55.670410] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-19T21:28:55.848390] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-19T21:28:55.914030] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:28:56.643278] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-19T21:28:57.165463] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-19T21:28:57.443283] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-19T21:28:57.997305] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T21:28:58.170584] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T21:28:58.243271] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-19T21:28:58.775846] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-19T21:28:59.043285] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-19T21:28:59.765181] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T21:28:59.843266] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-19T21:29:00.414324] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T21:29:00.643282] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-19T21:29:01.443304] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-19T21:29:01.869841] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-19T21:29:02.243321] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-19T21:29:02.476316] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T21:29:02.486248] [INFO ] [REMOTE ] STWD: Full fetch complete (74904 records). [2025-09-19T21:29:02.486421] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-19T21:29:02.808393] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T21:29:02.908227] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-19T21:29:02.908323] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-19T21:29:02.909407] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-19T21:29:02.909474] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-19T21:29:02.911023] [DEBUG] [LOCAL ] STWD: Trimmed 74904 records to 52662 (keeping 200 days of data) [2025-09-19T21:29:03.043467] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-19T21:29:03.255714] [DEBUG] [LOCAL ] STWD: Primary data saved (52662 records). [2025-09-19T21:29:03.256126] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-19T21:29:03.257722] [INFO ] [MAIN ] Update Progress: 2023/2372 symbols completed. STWD took 1m 3s. Estimated remaining: 46m 24s. Rate: 7.5 symbols/min [2025-09-19T21:29:03.436854] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:29:03.503594] [DEBUG] [LOCAL ] STZ: Loaded 52658 existing records from primary storage. [2025-09-19T21:29:03.503774] [INFO ] [MAIN ] STZ: Loaded 52658 existing records. [2025-09-19T21:29:03.694562] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:29:03.694862] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-19T21:29:03.694964] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-19T21:29:03.696743] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-19T21:29:03.696806] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-19T21:29:03.811581] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-19T21:29:03.855010] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-19T21:29:04.084054] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:29:04.506782] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-19T21:29:04.643297] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-19T21:29:05.195422] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T21:29:05.443364] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-19T21:29:05.843318] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T21:29:06.243294] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-19T21:29:07.043273] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-19T21:29:07.584188] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-19T21:29:07.843273] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-19T21:29:08.244979] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T21:29:08.394282] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-19T21:29:08.395282] [INFO ] [REMOTE ] STXT: Full fetch complete (4059 records). [2025-09-19T21:29:08.395351] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-19T21:29:08.648365] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-19T21:29:08.759124] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-19T21:29:08.759209] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-19T21:29:08.759346] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-19T21:29:08.759385] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-19T21:29:08.759830] [DEBUG] [LOCAL ] STXT: Trimmed 4059 records to 2655 (keeping 200 days of data) [2025-09-19T21:29:08.778904] [DEBUG] [LOCAL ] STXT: Primary data saved (2655 records). [2025-09-19T21:29:08.779023] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-19T21:29:08.779108] [INFO ] [MAIN ] Update Progress: 2024/2372 symbols completed. STXT took 21.6s. Estimated remaining: 46m 16s. Rate: 7.5 symbols/min [2025-09-19T21:29:08.952993] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:29:09.028167] [DEBUG] [LOCAL ] SU: Loaded 53850 existing records from primary storage. [2025-09-19T21:29:09.028334] [INFO ] [MAIN ] SU: Loaded 53850 existing records. [2025-09-19T21:29:09.209822] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:29:09.210089] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-19T21:29:09.210162] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-19T21:29:09.211527] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-19T21:29:09.211590] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-19T21:29:09.453095] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-19T21:29:09.570545] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:29:09.908963] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-19T21:29:10.243283] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-19T21:29:10.647281] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-19T21:29:10.825598] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T21:29:11.043238] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-19T21:29:11.843332] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-19T21:29:12.643254] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-19T21:29:13.195263] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-19T21:29:13.259144] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-19T21:29:13.443309] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-19T21:29:13.879946] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T21:29:14.243286] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-19T21:29:14.642311] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-19T21:29:15.043267] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-19T21:29:15.748248] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T21:29:15.843233] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-19T21:29:16.643266] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-19T21:29:17.053337] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-19T21:29:17.272474] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T21:29:17.443266] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-19T21:29:18.177984] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T21:29:18.243265] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-19T21:29:19.043336] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-19T21:29:19.321775] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T21:29:19.553573] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-19T21:29:19.554464] [INFO ] [REMOTE ] STXM: Full fetch complete (1457 records). [2025-09-19T21:29:19.554535] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-19T21:29:19.737942] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-19T21:29:19.738172] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:29:19.738243] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:29:19.738322] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-19T21:29:19.738401] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-19T21:29:19.738452] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-19T21:29:19.738535] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-19T21:29:19.738663] [INFO ] [MAIN ] Update Progress: 2025/2372 symbols completed. STXM took 39.1s. Estimated remaining: 46m 8s. Rate: 7.5 symbols/min [2025-09-19T21:29:19.848394] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-19T21:29:19.914111] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:29:19.978173] [DEBUG] [LOCAL ] SUI: Loaded 42541 existing records from primary storage. [2025-09-19T21:29:19.978340] [INFO ] [MAIN ] SUI: Loaded 42541 existing records. [2025-09-19T21:29:20.154956] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:29:20.155576] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-19T21:29:20.155722] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-19T21:29:20.157220] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-19T21:29:20.157290] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-19T21:29:20.502788] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-19T21:29:20.583071] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:29:20.643261] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-19T21:29:21.443251] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-19T21:29:22.037089] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T21:29:22.079245] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T21:29:22.243265] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-19T21:29:23.043340] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-19T21:29:23.560962] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-19T21:29:23.843285] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-19T21:29:24.068164] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-19T21:29:24.102697] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T21:29:24.364959] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T21:29:24.643264] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-19T21:29:25.443281] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-19T21:29:26.243260] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-19T21:29:26.958582] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T21:29:27.043264] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-19T21:29:27.453888] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T21:29:27.523981] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T21:29:27.843262] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-19T21:29:28.643367] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-19T21:29:29.114957] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-19T21:29:29.115862] [INFO ] [REMOTE ] STXV: Full fetch complete (2634 records). [2025-09-19T21:29:29.115932] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-19T21:29:29.446702] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-19T21:29:29.520130] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-19T21:29:29.520412] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-19T21:29:29.520764] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-19T21:29:29.521130] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-19T21:29:29.521953] [DEBUG] [LOCAL ] STXV: Trimmed 2634 records to 1708 (keeping 200 days of data) [2025-09-19T21:29:29.549961] [DEBUG] [LOCAL ] STXV: Primary data saved (1708 records). [2025-09-19T21:29:29.567123] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-19T21:29:29.567263] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-19T21:29:29.578069] [INFO ] [MAIN ] Update Progress: 2026/2372 symbols completed. STXV took 34.4s. Estimated remaining: 46m 1s. Rate: 7.5 symbols/min [2025-09-19T21:29:29.713089] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T21:29:29.794893] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:29:29.850542] [DEBUG] [LOCAL ] SUN: Loaded 37520 existing records from primary storage. [2025-09-19T21:29:29.850772] [INFO ] [MAIN ] SUN: Loaded 37520 existing records. [2025-09-19T21:29:30.027831] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:29:30.028070] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-19T21:29:30.028138] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-19T21:29:30.029749] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-19T21:29:30.029820] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-19T21:29:30.248503] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-19T21:29:30.397166] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:29:31.043272] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-19T21:29:31.335385] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T21:29:31.843270] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-19T21:29:32.416554] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-19T21:29:32.643256] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-19T21:29:32.685376] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T21:29:33.443306] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-19T21:29:33.691732] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T21:29:34.243229] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-19T21:29:34.905256] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-19T21:29:34.913151] [INFO ] [REMOTE ] STZ: Full fetch complete (75684 records). [2025-09-19T21:29:34.913292] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-19T21:29:35.064281] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-19T21:29:35.327276] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-19T21:29:35.327400] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-19T21:29:35.336116] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-19T21:29:35.342012] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-19T21:29:35.352306] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T21:29:35.360451] [DEBUG] [LOCAL ] STZ: Trimmed 75684 records to 53045 (keeping 200 days of data) [2025-09-19T21:29:35.697796] [DEBUG] [LOCAL ] STZ: Primary data saved (53045 records). [2025-09-19T21:29:35.697943] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-19T21:29:35.698370] [INFO ] [MAIN ] Update Progress: 2027/2372 symbols completed. STZ took 32.4s. Estimated remaining: 45m 52s. Rate: 7.5 symbols/min [2025-09-19T21:29:35.850675] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-19T21:29:35.876440] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:29:35.924401] [DEBUG] [LOCAL ] SUPV: Loaded 47311 existing records from primary storage. [2025-09-19T21:29:35.924553] [INFO ] [MAIN ] SUPV: Loaded 47311 existing records. [2025-09-19T21:29:36.154050] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:29:36.162010] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-19T21:29:36.172974] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-19T21:29:36.176596] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T21:29:36.176662] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-19T21:29:36.184780] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-19T21:29:36.538517] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:29:36.643255] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-19T21:29:37.309263] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T21:29:37.443230] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-19T21:29:37.578725] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T21:29:38.243322] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-19T21:29:38.609032] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T21:29:39.043278] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-19T21:29:39.574538] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T21:29:39.611301] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T21:29:39.843294] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-19T21:29:40.643313] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-19T21:29:40.785503] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T21:29:41.443274] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-19T21:29:41.750787] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-19T21:29:41.758606] [INFO ] [REMOTE ] SU: Full fetch complete (77402 records). [2025-09-19T21:29:41.758764] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-19T21:29:42.152145] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-19T21:29:42.152302] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-19T21:29:42.153583] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-19T21:29:42.153722] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-19T21:29:42.155678] [DEBUG] [LOCAL ] SU: Trimmed 77402 records to 54240 (keeping 200 days of data) [2025-09-19T21:29:42.247763] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-19T21:29:42.283966] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T21:29:42.514693] [DEBUG] [LOCAL ] SU: Primary data saved (54240 records). [2025-09-19T21:29:42.514835] [INFO ] [MAIN ] SU: Full history saved. [2025-09-19T21:29:42.514917] [INFO ] [MAIN ] Update Progress: 2028/2372 symbols completed. SU took 33.7s. Estimated remaining: 45m 44s. Rate: 7.5 symbols/min [2025-09-19T21:29:42.697062] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:29:42.741399] [DEBUG] [LOCAL ] SUZ: Loaded 46263 existing records from primary storage. [2025-09-19T21:29:42.741559] [INFO ] [MAIN ] SUZ: Loaded 46263 existing records. [2025-09-19T21:29:42.937025] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:29:42.937393] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-19T21:29:42.937462] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-19T21:29:42.938522] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-19T21:29:42.938585] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-19T21:29:43.046891] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-19T21:29:43.315761] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:29:43.354372] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T21:29:43.843289] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-19T21:29:44.426670] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T21:29:44.643273] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-19T21:29:44.792715] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-19T21:29:45.443271] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-19T21:29:45.847521] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T21:29:46.243271] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-19T21:29:46.475148] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-19T21:29:46.596568] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T21:29:47.043272] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-19T21:29:47.843264] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-19T21:29:48.072019] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T21:29:48.643292] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-19T21:29:48.741697] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-19T21:29:49.443265] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-19T21:29:49.487348] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T21:29:50.027582] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T21:29:50.243274] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-19T21:29:51.043318] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-19T21:29:51.198257] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T21:29:51.843305] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-19T21:29:51.907147] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T21:29:51.913713] [INFO ] [REMOTE ] SUI: Full fetch complete (61172 records). [2025-09-19T21:29:51.913825] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-19T21:29:52.302696] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-19T21:29:52.302791] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-19T21:29:52.303789] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-19T21:29:52.303964] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-19T21:29:52.305271] [DEBUG] [LOCAL ] SUI: Trimmed 61172 records to 42841 (keeping 200 days of data) [2025-09-19T21:29:52.584099] [DEBUG] [LOCAL ] SUI: Primary data saved (42841 records). [2025-09-19T21:29:52.584260] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-19T21:29:52.584367] [INFO ] [MAIN ] Update Progress: 2029/2372 symbols completed. SUI took 32.8s. Estimated remaining: 45m 37s. Rate: 7.5 symbols/min [2025-09-19T21:29:52.653042] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-19T21:29:52.754952] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:29:52.795402] [DEBUG] [LOCAL ] SVV: Loaded 39709 existing records from primary storage. [2025-09-19T21:29:52.795548] [INFO ] [MAIN ] SVV: Loaded 39709 existing records. [2025-09-19T21:29:52.981855] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:29:52.982778] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-19T21:29:52.983088] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-19T21:29:52.984865] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-19T21:29:52.984943] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-19T21:29:53.085959] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T21:29:53.213485] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T21:29:53.451512] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-19T21:29:53.458625] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:29:54.243261] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-19T21:29:54.591526] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T21:29:55.043331] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-19T21:29:55.237491] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T21:29:55.747823] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T21:29:55.843292] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-19T21:29:56.643309] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-19T21:29:56.828386] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T21:29:57.443345] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-19T21:29:57.701316] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T21:29:58.243266] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-19T21:29:58.315416] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T21:29:58.481072] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T21:29:58.486797] [INFO ] [REMOTE ] SUN: Full fetch complete (54291 records). [2025-09-19T21:29:58.486924] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-19T21:29:58.887369] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-19T21:29:58.887694] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-19T21:29:58.888627] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-19T21:29:58.888706] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-19T21:29:58.890925] [DEBUG] [LOCAL ] SUN: Trimmed 54291 records to 37807 (keeping 200 days of data) [2025-09-19T21:29:59.068296] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-19T21:29:59.136487] [DEBUG] [LOCAL ] SUN: Primary data saved (37807 records). [2025-09-19T21:29:59.136667] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-19T21:29:59.136804] [INFO ] [MAIN ] Update Progress: 2030/2372 symbols completed. SUN took 29.6s. Estimated remaining: 45m 28s. Rate: 7.5 symbols/min [2025-09-19T21:29:59.307663] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:29:59.364022] [DEBUG] [LOCAL ] SW: Loaded 53554 existing records from primary storage. [2025-09-19T21:29:59.364201] [INFO ] [MAIN ] SW: Loaded 53554 existing records. [2025-09-19T21:29:59.549529] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:29:59.549907] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-19T21:29:59.549966] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-19T21:29:59.551185] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-19T21:29:59.551248] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-19T21:29:59.848408] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-19T21:29:59.928685] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:29:59.994888] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T21:30:00.643262] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-19T21:30:01.334217] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-19T21:30:01.443266] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-19T21:30:01.543803] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T21:30:02.243277] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-19T21:30:03.043308] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-19T21:30:03.632409] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (2.99 seconds). [2025-09-19T21:30:03.843263] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-19T21:30:04.996933] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (3.55 seconds). [2025-09-19T21:30:05.007426] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-19T21:30:05.432620] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (3.19 seconds). [2025-09-19T21:30:05.443203] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-19T21:30:06.295678] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-09-19T21:30:06.306011] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-19T21:30:06.730988] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (2.89 seconds). [2025-09-19T21:30:07.042362] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T21:30:07.052615] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-19T21:30:07.340390] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T21:30:07.686364] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-19T21:30:07.843283] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-19T21:30:08.643315] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-19T21:30:09.088554] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T21:30:09.443291] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-19T21:30:09.692368] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T21:30:10.243274] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-19T21:30:10.287692] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T21:30:10.294216] [INFO ] [REMOTE ] SUZ: Full fetch complete (67156 records). [2025-09-19T21:30:10.294336] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-19T21:30:10.682080] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-19T21:30:10.682190] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-19T21:30:10.683323] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-19T21:30:10.683387] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-19T21:30:10.684916] [DEBUG] [LOCAL ] SUZ: Trimmed 67156 records to 46596 (keeping 200 days of data) [2025-09-19T21:30:10.979931] [DEBUG] [LOCAL ] SUZ: Primary data saved (46596 records). [2025-09-19T21:30:10.980085] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-19T21:30:10.980211] [INFO ] [MAIN ] Update Progress: 2031/2372 symbols completed. SUZ took 28.5s. Estimated remaining: 45m 21s. Rate: 7.5 symbols/min [2025-09-19T21:30:11.052616] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-19T21:30:11.165396] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:30:11.217898] [DEBUG] [LOCAL ] SWK: Loaded 52912 existing records from primary storage. [2025-09-19T21:30:11.218081] [INFO ] [MAIN ] SWK: Loaded 52912 existing records. [2025-09-19T21:30:11.414229] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:30:11.414788] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-19T21:30:11.414874] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-19T21:30:11.416308] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-19T21:30:11.416378] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-19T21:30:11.842883] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:30:11.846809] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-19T21:30:11.850261] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-19T21:30:11.884094] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T21:30:12.643276] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-19T21:30:12.998818] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-19T21:30:13.012320] [INFO ] [REMOTE ] SUPV: Full fetch complete (68097 records). [2025-09-19T21:30:13.012682] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-19T21:30:13.414994] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-19T21:30:13.415082] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-19T21:30:13.416128] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-19T21:30:13.416191] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-19T21:30:13.417616] [DEBUG] [LOCAL ] SUPV: Trimmed 68097 records to 47686 (keeping 200 days of data) [2025-09-19T21:30:13.471948] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-19T21:30:13.698289] [DEBUG] [LOCAL ] SUPV: Primary data saved (47686 records). [2025-09-19T21:30:13.698423] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-19T21:30:13.699345] [INFO ] [MAIN ] Update Progress: 2032/2372 symbols completed. SUPV took 38.0s. Estimated remaining: 45m 12s. Rate: 7.5 symbols/min [2025-09-19T21:30:13.868705] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:30:13.901493] [DEBUG] [LOCAL ] SWX: Loaded 31595 existing records from primary storage. [2025-09-19T21:30:13.901628] [INFO ] [MAIN ] SWX: Loaded 31595 existing records. [2025-09-19T21:30:14.076042] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:30:14.076407] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-19T21:30:14.076488] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-19T21:30:14.077529] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-19T21:30:14.077594] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-19T21:30:14.427584] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:30:14.427925] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-19T21:30:14.932369] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (3.09 seconds). [2025-09-19T21:30:15.043234] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-19T21:30:15.847424] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (3.20 seconds). [2025-09-19T21:30:15.863311] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-19T21:30:16.265274] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-19T21:30:16.367895] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T21:30:16.643335] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-19T21:30:17.035829] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T21:30:17.443302] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-19T21:30:17.970408] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T21:30:18.248430] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-19T21:30:18.267325] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-19T21:30:19.043234] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-19T21:30:19.723496] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-19T21:30:19.841981] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-19T21:30:19.844403] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-19T21:30:20.542753] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T21:30:20.643260] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-19T21:30:21.426484] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T21:30:21.443207] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-19T21:30:22.243304] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-19T21:30:22.840784] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-19T21:30:23.043247] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-19T21:30:23.679177] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T21:30:23.843352] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-19T21:30:23.964803] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T21:30:23.971408] [INFO ] [REMOTE ] SVV: Full fetch complete (55629 records). [2025-09-19T21:30:23.971542] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-19T21:30:24.359823] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-19T21:30:24.359913] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-19T21:30:24.360870] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-19T21:30:24.360949] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-19T21:30:24.362221] [DEBUG] [LOCAL ] SVV: Trimmed 55629 records to 40046 (keeping 200 days of data) [2025-09-19T21:30:24.600786] [DEBUG] [LOCAL ] SVV: Primary data saved (40046 records). [2025-09-19T21:30:24.600914] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-19T21:30:24.600994] [INFO ] [MAIN ] Update Progress: 2033/2372 symbols completed. SVV took 32.0s. Estimated remaining: 45m 5s. Rate: 7.5 symbols/min [2025-09-19T21:30:24.665751] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-19T21:30:24.784015] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:30:24.792069] [DEBUG] [LOCAL ] SWZ: Loaded 6201 existing records from primary storage. [2025-09-19T21:30:24.792181] [INFO ] [MAIN ] SWZ: Loaded 6201 existing records. [2025-09-19T21:30:25.024694] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:30:25.025156] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-19T21:30:25.025382] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-19T21:30:25.036947] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-19T21:30:25.055979] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-19T21:30:25.115050] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-19T21:30:25.428710] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:30:25.443212] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-19T21:30:26.020409] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-19T21:30:26.203531] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T21:30:26.243233] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-19T21:30:26.493318] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T21:30:26.944317] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T21:30:27.043353] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-19T21:30:27.843267] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-19T21:30:28.643274] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-19T21:30:29.056956] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T21:30:29.067191] [INFO ] [REMOTE ] SW: Full fetch complete (76720 records). [2025-09-19T21:30:29.067344] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-19T21:30:29.399686] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-19T21:30:29.454364] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-19T21:30:29.498544] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-19T21:30:29.499609] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T21:30:29.499668] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-19T21:30:29.501435] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-19T21:30:29.501515] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-19T21:30:29.515443] [DEBUG] [LOCAL ] SW: Trimmed 76720 records to 53944 (keeping 200 days of data) [2025-09-19T21:30:29.856179] [DEBUG] [LOCAL ] SW: Primary data saved (53944 records). [2025-09-19T21:30:29.856339] [INFO ] [MAIN ] SW: Full history saved. [2025-09-19T21:30:29.856455] [INFO ] [MAIN ] Update Progress: 2034/2372 symbols completed. SW took 30.7s. Estimated remaining: 44m 56s. Rate: 7.5 symbols/min [2025-09-19T21:30:30.028853] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:30:30.068517] [DEBUG] [LOCAL ] SXC: Loaded 42124 existing records from primary storage. [2025-09-19T21:30:30.068691] [INFO ] [MAIN ] SXC: Loaded 42124 existing records. [2025-09-19T21:30:30.249069] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-19T21:30:30.249238] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:30:30.259894] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T21:30:30.261819] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-19T21:30:30.262575] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-19T21:30:30.263490] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-19T21:30:30.263565] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-19T21:30:30.623474] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:30:31.043262] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-19T21:30:31.843279] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-19T21:30:31.963002] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T21:30:32.643329] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-19T21:30:32.868858] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T21:30:33.443308] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-19T21:30:33.818559] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T21:30:33.947290] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T21:30:34.243295] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-19T21:30:35.022270] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T21:30:35.043225] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-19T21:30:35.843246] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-19T21:30:36.306449] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T21:30:36.643279] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-19T21:30:36.817197] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-19T21:30:36.842345] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-19T21:30:37.443289] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-19T21:30:37.710570] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T21:30:38.243317] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-19T21:30:38.843508] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-19T21:30:39.043265] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-19T21:30:39.828537] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-19T21:30:39.843203] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-19T21:30:40.643270] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-19T21:30:40.877204] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T21:30:41.370551] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T21:30:41.420705] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T21:30:41.443232] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-19T21:30:42.243319] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-19T21:30:43.043329] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-19T21:30:43.187617] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T21:30:43.831618] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T21:30:43.843207] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-19T21:30:44.086863] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T21:30:44.095750] [INFO ] [REMOTE ] SWK: Full fetch complete (75390 records). [2025-09-19T21:30:44.095894] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-19T21:30:44.528812] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-19T21:30:44.528894] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-19T21:30:44.530080] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-19T21:30:44.530143] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-19T21:30:44.531704] [DEBUG] [LOCAL ] SWK: Trimmed 75390 records to 53276 (keeping 200 days of data) [2025-09-19T21:30:44.643353] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-19T21:30:44.906424] [DEBUG] [LOCAL ] SWK: Primary data saved (53276 records). [2025-09-19T21:30:44.906671] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-19T21:30:44.906788] [INFO ] [MAIN ] Update Progress: 2035/2372 symbols completed. SWK took 33.9s. Estimated remaining: 44m 49s. Rate: 7.5 symbols/min [2025-09-19T21:30:45.078728] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-19T21:30:45.096853] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:30:45.112964] [DEBUG] [LOCAL ] SXI: Loaded 11512 existing records from primary storage. [2025-09-19T21:30:45.113069] [INFO ] [MAIN ] SXI: Loaded 11512 existing records. [2025-09-19T21:30:45.304473] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:30:45.304884] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-19T21:30:45.304963] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-19T21:30:45.305507] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-19T21:30:45.305600] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-19T21:30:45.457065] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-19T21:30:45.688440] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:30:45.984598] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T21:30:45.991586] [INFO ] [REMOTE ] SWX: Full fetch complete (43699 records). [2025-09-19T21:30:45.991752] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-19T21:30:46.253677] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-19T21:30:46.389522] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-19T21:30:46.389620] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-19T21:30:46.390684] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-19T21:30:46.390767] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-19T21:30:46.392589] [DEBUG] [LOCAL ] SWX: Trimmed 43699 records to 31786 (keeping 200 days of data) [2025-09-19T21:30:46.615571] [DEBUG] [LOCAL ] SWX: Primary data saved (31786 records). [2025-09-19T21:30:46.615738] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-19T21:30:46.615966] [INFO ] [MAIN ] Update Progress: 2036/2372 symbols completed. SWX took 32.9s. Estimated remaining: 44m 40s. Rate: 7.5 symbols/min [2025-09-19T21:30:46.808838] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:30:46.844140] [DEBUG] [LOCAL ] SXT: Loaded 29141 existing records from primary storage. [2025-09-19T21:30:46.844281] [INFO ] [MAIN ] SXT: Loaded 29141 existing records. [2025-09-19T21:30:47.023344] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:30:47.023603] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-19T21:30:47.023677] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-19T21:30:47.024417] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-19T21:30:47.024486] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-19T21:30:47.055515] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-19T21:30:47.143286] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T21:30:47.420126] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:30:47.451568] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T21:30:47.843291] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-19T21:30:48.067892] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T21:30:48.069408] [INFO ] [REMOTE ] SWZ: Full fetch complete (8080 records). [2025-09-19T21:30:48.069491] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-19T21:30:48.524368] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-19T21:30:48.524520] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-19T21:30:48.524833] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-19T21:30:48.524895] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-19T21:30:48.525331] [DEBUG] [LOCAL ] SWZ: Trimmed 8080 records to 6224 (keeping 200 days of data) [2025-09-19T21:30:48.565302] [DEBUG] [LOCAL ] SWZ: Primary data saved (6224 records). [2025-09-19T21:30:48.565433] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-19T21:30:48.565575] [INFO ] [MAIN ] Update Progress: 2037/2372 symbols completed. SWZ took 24.0s. Estimated remaining: 44m 31s. Rate: 7.5 symbols/min [2025-09-19T21:30:48.643244] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-19T21:30:49.138505] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-19T21:30:49.443279] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-19T21:30:50.243255] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-19T21:30:50.280784] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T21:30:50.694323] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T21:30:51.043320] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-19T21:30:51.083750] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-19T21:30:51.843231] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-19T21:30:52.341687] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T21:30:52.643271] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-19T21:30:53.443314] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-19T21:30:53.616713] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T21:30:54.212808] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T21:30:54.243218] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-19T21:30:54.441465] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T21:30:55.043266] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-19T21:30:55.843274] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-19T21:30:55.886362] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T21:30:56.643231] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-19T21:30:56.782353] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T21:30:56.884524] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T21:30:57.443268] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-19T21:30:57.656843] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T21:30:58.243270] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-19T21:30:59.043329] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-19T21:30:59.173610] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T21:30:59.309725] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-19T21:30:59.843263] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-19T21:31:00.561519] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T21:31:00.643227] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-19T21:31:01.443327] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-19T21:31:01.559515] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T21:31:01.565626] [INFO ] [REMOTE ] SXC: Full fetch complete (61266 records). [2025-09-19T21:31:01.565764] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-19T21:31:01.996723] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-19T21:31:01.996868] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-19T21:31:01.997867] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-19T21:31:01.997930] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-19T21:31:01.999274] [DEBUG] [LOCAL ] SXC: Trimmed 61266 records to 42389 (keeping 200 days of data) [2025-09-19T21:31:02.300154] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T21:31:02.310281] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-19T21:31:02.311096] [DEBUG] [LOCAL ] SXC: Primary data saved (42389 records). [2025-09-19T21:31:02.312089] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-19T21:31:02.312204] [INFO ] [MAIN ] Update Progress: 2038/2372 symbols completed. SXC took 32.5s. Estimated remaining: 44m 24s. Rate: 7.5 symbols/min [2025-09-19T21:31:02.397721] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T21:31:03.043322] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-19T21:31:03.849841] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T21:31:03.856706] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-19T21:31:03.864917] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T21:31:04.643261] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-19T21:31:05.284281] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T21:31:05.289716] [INFO ] [REMOTE ] SXT: Full fetch complete (37484 records). [2025-09-19T21:31:05.289879] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-19T21:31:05.690106] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-19T21:31:05.690295] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-19T21:31:05.691389] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-19T21:31:05.691507] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-19T21:31:05.703424] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T21:31:05.704879] [DEBUG] [LOCAL ] SXT: Trimmed 37484 records to 29369 (keeping 200 days of data) [2025-09-19T21:31:05.708228] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-19T21:31:05.900123] [DEBUG] [LOCAL ] SXT: Primary data saved (29369 records). [2025-09-19T21:31:05.900272] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-19T21:31:05.900358] [INFO ] [MAIN ] Update Progress: 2039/2372 symbols completed. SXT took 19.3s. Estimated remaining: 44m 16s. Rate: 7.5 symbols/min [2025-09-19T21:31:07.236696] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T21:31:07.240443] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-19T21:31:08.186126] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T21:31:08.188442] [INFO ] [REMOTE ] SXI: Full fetch complete (14439 records). [2025-09-19T21:31:08.188514] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-19T21:31:08.583156] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-19T21:31:08.583469] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-19T21:31:08.583831] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-19T21:31:08.583909] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-19T21:31:08.584466] [DEBUG] [LOCAL ] SXI: Trimmed 14439 records to 11589 (keeping 200 days of data) [2025-09-19T21:31:08.668628] [DEBUG] [LOCAL ] SXI: Primary data saved (11589 records). [2025-09-19T21:31:08.668809] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-19T21:31:08.668899] [INFO ] [MAIN ] Update Progress: 2040/2372 symbols completed. SXI took 23.8s. Estimated remaining: 44m 7s. Rate: 7.5 symbols/min [2025-09-19T21:31:09.318144] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:31:09.317229] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:31:09.285787] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:31:09.395868] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:31:09.521554] [DEBUG] [LOCAL ] SYY: Loaded 53641 existing records from primary storage. [2025-09-19T21:31:09.521978] [INFO ] [MAIN ] SYY: Loaded 53641 existing records. [2025-09-19T21:31:09.535220] [DEBUG] [LOCAL ] SYF: Loaded 53850 existing records from primary storage. [2025-09-19T21:31:09.547267] [INFO ] [MAIN ] SYF: Loaded 53850 existing records. [2025-09-19T21:31:09.643906] [DEBUG] [LOCAL ] SYK: Loaded 47505 existing records from primary storage. [2025-09-19T21:31:09.700988] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-09-19T21:31:09.722088] [INFO ] [MAIN ] T: Loaded 54188 existing records. [2025-09-19T21:31:09.677773] [INFO ] [MAIN ] SYK: Loaded 47505 existing records. [2025-09-19T21:31:10.122249] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:31:10.169475] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-19T21:31:10.174749] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:31:10.180223] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-19T21:31:10.262686] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-19T21:31:10.264874] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-19T21:31:10.268987] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-19T21:31:10.269131] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:31:10.268906] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-19T21:31:10.325252] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-19T21:31:10.346858] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-19T21:31:10.352213] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-19T21:31:10.400247] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:31:10.415905] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-19T21:31:10.440728] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-19T21:31:10.473056] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-19T21:31:10.508524] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-19T21:31:10.508414] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-19T21:31:10.555619] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-19T21:31:10.529707] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-19T21:31:11.624336] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:31:11.656715] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:31:11.657047] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-19T21:31:11.653699] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-19T21:31:11.824187] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:31:11.825907] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-19T21:31:11.845737] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:31:11.846085] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-19T21:31:13.756736] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T21:31:13.768285] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-19T21:31:13.800406] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T21:31:13.811599] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-19T21:31:13.842877] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T21:31:13.852280] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-19T21:31:14.567336] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-19T21:31:14.578999] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-19T21:31:15.789273] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T21:31:15.800999] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-19T21:31:15.834325] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-19T21:31:15.845064] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-19T21:31:16.107086] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-19T21:31:16.118328] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-19T21:31:17.278933] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-19T21:31:17.290216] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-19T21:31:17.449406] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T21:31:17.460460] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-19T21:31:17.599436] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T21:31:17.609378] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-19T21:31:17.705738] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T21:31:18.243334] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-19T21:31:19.090599] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T21:31:19.102504] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-19T21:31:19.417897] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T21:31:19.529164] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-19T21:31:19.843284] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-19T21:31:20.376090] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T21:31:20.646961] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-19T21:31:20.652310] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T21:31:21.443313] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-19T21:31:22.062300] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T21:31:22.243274] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-19T21:31:22.829905] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T21:31:23.043316] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-19T21:31:23.584582] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T21:31:23.843313] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-19T21:31:24.643282] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-19T21:31:24.876261] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-19T21:31:25.109170] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T21:31:25.443296] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-19T21:31:26.064393] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-19T21:31:26.243238] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-19T21:31:26.742687] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T21:31:27.043280] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-19T21:31:27.843348] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-19T21:31:28.198405] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-19T21:31:28.643340] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-19T21:31:28.782745] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-19T21:31:29.256250] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T21:31:29.443373] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-19T21:31:30.216616] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-19T21:31:30.243242] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-19T21:31:31.043279] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-19T21:31:31.297681] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T21:31:31.540789] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-19T21:31:31.843275] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-19T21:31:32.279886] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T21:31:32.643266] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-19T21:31:33.403147] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-19T21:31:33.443229] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-19T21:31:34.036597] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T21:31:34.243297] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-19T21:31:34.679286] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T21:31:35.043277] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-19T21:31:35.380161] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T21:31:35.524333] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T21:31:35.532468] [INFO ] [REMOTE ] SYF: Full fetch complete (77335 records). [2025-09-19T21:31:35.532604] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-19T21:31:35.848500] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-19T21:31:35.945276] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-19T21:31:35.945375] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-19T21:31:35.946523] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-19T21:31:35.946593] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-19T21:31:35.949545] [DEBUG] [LOCAL ] SYF: Trimmed 77335 records to 54240 (keeping 200 days of data) [2025-09-19T21:31:36.308223] [DEBUG] [LOCAL ] SYF: Primary data saved (54240 records). [2025-09-19T21:31:36.308385] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-19T21:31:36.308474] [INFO ] [MAIN ] Update Progress: 2041/2372 symbols completed. SYF took 27.6s. Estimated remaining: 44m 2s. Rate: 7.5 symbols/min [2025-09-19T21:31:36.494060] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:31:36.538506] [DEBUG] [LOCAL ] TAC: Loaded 43355 existing records from primary storage. [2025-09-19T21:31:36.538710] [INFO ] [MAIN ] TAC: Loaded 43355 existing records. [2025-09-19T21:31:36.648393] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-19T21:31:36.726557] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:31:36.726828] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-19T21:31:36.726893] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-19T21:31:36.727950] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-19T21:31:36.728011] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-19T21:31:37.092731] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:31:37.443312] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-19T21:31:37.646992] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T21:31:37.655023] [INFO ] [REMOTE ] SYK: Full fetch complete (68694 records). [2025-09-19T21:31:37.655262] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-19T21:31:37.811794] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-19T21:31:38.123568] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-19T21:31:38.123731] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-19T21:31:38.125038] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-19T21:31:38.125121] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-19T21:31:38.126878] [DEBUG] [LOCAL ] SYK: Trimmed 68694 records to 47843 (keeping 200 days of data) [2025-09-19T21:31:38.243380] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-19T21:31:38.441623] [DEBUG] [LOCAL ] SYK: Primary data saved (47843 records). [2025-09-19T21:31:38.441798] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-19T21:31:38.441886] [INFO ] [MAIN ] Update Progress: 2042/2372 symbols completed. SYK took 29.8s. Estimated remaining: 43m 53s. Rate: 7.5 symbols/min [2025-09-19T21:31:38.622133] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:31:38.673517] [DEBUG] [LOCAL ] TAK: Loaded 50341 existing records from primary storage. [2025-09-19T21:31:38.673706] [INFO ] [MAIN ] TAK: Loaded 50341 existing records. [2025-09-19T21:31:38.867443] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T21:31:38.914920] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:31:38.915283] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-19T21:31:38.915802] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-19T21:31:38.916853] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-19T21:31:38.916914] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-19T21:31:39.048392] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-19T21:31:39.307055] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:31:39.344388] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T21:31:39.843262] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-19T21:31:40.428728] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T21:31:40.437016] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-09-19T21:31:40.437189] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-19T21:31:40.668896] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-19T21:31:40.837928] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-19T21:31:40.838013] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-19T21:31:40.839185] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-19T21:31:40.839248] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-19T21:31:40.840803] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 54578 (keeping 200 days of data) [2025-09-19T21:31:41.102142] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-19T21:31:41.113701] [INFO ] [REMOTE ] SYY: Full fetch complete (76982 records). [2025-09-19T21:31:41.115828] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-19T21:31:41.622553] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-19T21:31:41.622707] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-19T21:31:41.623872] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-19T21:31:41.624217] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-19T21:31:41.628722] [DEBUG] [LOCAL ] SYY: Trimmed 76982 records to 54029 (keeping 200 days of data) [2025-09-19T21:31:41.763290] [DEBUG] [LOCAL ] T: Primary data saved (54578 records). [2025-09-19T21:31:41.767432] [INFO ] [MAIN ] T: Full history saved. [2025-09-19T21:31:41.768345] [INFO ] [MAIN ] Update Progress: 2043/2372 symbols completed. T took 33.1s. Estimated remaining: 43m 45s. Rate: 7.5 symbols/min [2025-09-19T21:31:42.127368] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:31:42.156072] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T21:31:42.176535] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-19T21:31:42.315132] [DEBUG] [LOCAL ] TAL: Loaded 52549 existing records from primary storage. [2025-09-19T21:31:42.325401] [INFO ] [MAIN ] TAL: Loaded 52549 existing records. [2025-09-19T21:31:42.326788] [DEBUG] [LOCAL ] SYY: Primary data saved (54029 records). [2025-09-19T21:31:42.370025] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-19T21:31:42.391306] [INFO ] [MAIN ] Update Progress: 2044/2372 symbols completed. SYY took 33.7s. Estimated remaining: 43m 35s. Rate: 7.5 symbols/min [2025-09-19T21:31:42.720811] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:31:42.717006] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:31:42.721819] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-19T21:31:42.722137] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-19T21:31:42.723429] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-19T21:31:42.723494] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-19T21:31:42.888277] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T21:31:42.978886] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-19T21:31:43.075342] [DEBUG] [LOCAL ] TALO: Loaded 51209 existing records from primary storage. [2025-09-19T21:31:43.083039] [INFO ] [MAIN ] TALO: Loaded 51209 existing records. [2025-09-19T21:31:43.275595] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:31:43.281796] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-19T21:31:43.362246] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:31:43.362504] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-19T21:31:43.362555] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-19T21:31:43.364208] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-19T21:31:43.364271] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-19T21:31:43.748047] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:31:43.772304] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T21:31:43.843245] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-19T21:31:44.643279] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-19T21:31:45.019922] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T21:31:45.072213] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-19T21:31:45.117690] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T21:31:45.443267] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-19T21:31:45.957950] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T21:31:46.243271] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-19T21:31:47.043302] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-19T21:31:47.509581] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T21:31:47.843270] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-19T21:31:48.127157] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T21:31:48.643276] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-19T21:31:48.959216] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T21:31:49.443291] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-19T21:31:49.718524] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T21:31:49.967465] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T21:31:50.243292] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-19T21:31:51.043270] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-19T21:31:51.229010] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T21:31:51.843275] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-19T21:31:52.020428] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T21:31:52.643279] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-19T21:31:52.831242] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T21:31:53.302144] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T21:31:53.443307] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-19T21:31:54.243312] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-19T21:31:54.540373] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T21:31:55.043290] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-19T21:31:55.555086] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T21:31:55.843281] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-19T21:31:56.259746] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T21:31:56.643244] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-19T21:31:57.349124] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T21:31:57.443293] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-19T21:31:58.030929] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T21:31:58.243237] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-19T21:31:58.624686] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T21:31:58.729620] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T21:31:59.043271] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-19T21:31:59.843298] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-19T21:32:00.166039] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T21:32:00.643271] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-19T21:32:01.219674] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T21:32:01.443295] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-19T21:32:01.863982] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-19T21:32:02.243307] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-19T21:32:02.589186] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T21:32:03.043358] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-19T21:32:03.743142] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T21:32:03.843277] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-19T21:32:03.970566] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T21:32:04.643280] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-19T21:32:04.797338] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T21:32:05.240845] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T21:32:05.443268] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-19T21:32:06.247464] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-19T21:32:06.251877] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T21:32:06.260475] [INFO ] [REMOTE ] TAC: Full fetch complete (64359 records). [2025-09-19T21:32:06.260639] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-19T21:32:06.663386] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-19T21:32:06.663490] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-19T21:32:06.664539] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-19T21:32:06.664604] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-19T21:32:06.666183] [DEBUG] [LOCAL ] TAC: Trimmed 64359 records to 43676 (keeping 200 days of data) [2025-09-19T21:32:06.930287] [DEBUG] [LOCAL ] TAC: Primary data saved (43676 records). [2025-09-19T21:32:06.930499] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-19T21:32:06.930638] [INFO ] [MAIN ] Update Progress: 2045/2372 symbols completed. TAC took 30.6s. Estimated remaining: 43m 30s. Rate: 7.5 symbols/min [2025-09-19T21:32:07.048374] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-19T21:32:07.105260] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:07.155548] [DEBUG] [LOCAL ] TAP: Loaded 53235 existing records from primary storage. [2025-09-19T21:32:07.155719] [INFO ] [MAIN ] TAP: Loaded 53235 existing records. [2025-09-19T21:32:07.331094] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:32:07.331420] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-19T21:32:07.331675] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-19T21:32:07.333032] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-19T21:32:07.333096] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-19T21:32:07.542418] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T21:32:07.755595] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:07.800409] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T21:32:07.843220] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-19T21:32:08.643308] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-19T21:32:09.090959] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T21:32:09.443314] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-19T21:32:09.811056] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T21:32:09.985962] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T21:32:09.993498] [INFO ] [REMOTE ] TAK: Full fetch complete (71521 records). [2025-09-19T21:32:09.993674] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-19T21:32:10.251869] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-19T21:32:10.385270] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-19T21:32:10.385362] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-19T21:32:10.386460] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-19T21:32:10.386527] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-19T21:32:10.388207] [DEBUG] [LOCAL ] TAK: Trimmed 71521 records to 50690 (keeping 200 days of data) [2025-09-19T21:32:10.729044] [DEBUG] [LOCAL ] TAK: Primary data saved (50690 records). [2025-09-19T21:32:10.729290] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-19T21:32:10.729548] [INFO ] [MAIN ] Update Progress: 2046/2372 symbols completed. TAK took 32.3s. Estimated remaining: 43m 21s. Rate: 7.5 symbols/min [2025-09-19T21:32:10.911293] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T21:32:11.007588] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:11.007969] [INFO ] [REMOTE ] TALO: Full fetch complete (73142 records). [2025-09-19T21:32:11.008408] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-19T21:32:11.044038] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-19T21:32:11.142401] [DEBUG] [LOCAL ] TBB: Loaded 11813 existing records from primary storage. [2025-09-19T21:32:11.148458] [INFO ] [MAIN ] TBB: Loaded 11813 existing records. [2025-09-19T21:32:11.610173] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:32:11.656285] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-19T21:32:11.692103] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-19T21:32:11.696020] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-19T21:32:11.696132] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-19T21:32:11.697251] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-19T21:32:11.697445] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-19T21:32:11.697352] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-19T21:32:11.697668] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-19T21:32:11.789571] [DEBUG] [LOCAL ] TALO: Trimmed 73142 records to 51587 (keeping 200 days of data) [2025-09-19T21:32:12.255243] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:12.255710] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-19T21:32:12.399861] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T21:32:12.511024] [DEBUG] [LOCAL ] TALO: Primary data saved (51587 records). [2025-09-19T21:32:12.511200] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-19T21:32:12.511324] [INFO ] [MAIN ] Update Progress: 2047/2372 symbols completed. TALO took 30.1s. Estimated remaining: 43m 12s. Rate: 7.5 symbols/min [2025-09-19T21:32:12.648429] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-19T21:32:12.704772] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:12.745449] [DEBUG] [LOCAL ] TBBB: Loaded 36224 existing records from primary storage. [2025-09-19T21:32:12.745609] [INFO ] [MAIN ] TBBB: Loaded 36224 existing records. [2025-09-19T21:32:12.949733] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:32:12.950160] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-19T21:32:12.950344] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-19T21:32:12.951708] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-19T21:32:12.951773] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-19T21:32:13.352114] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-19T21:32:13.387040] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:13.443280] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-19T21:32:13.550209] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T21:32:14.243274] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-19T21:32:14.570950] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-19T21:32:14.578829] [INFO ] [REMOTE ] TAL: Full fetch complete (75700 records). [2025-09-19T21:32:14.578957] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-19T21:32:14.962296] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T21:32:15.006840] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-19T21:32:15.006914] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-19T21:32:15.008002] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-19T21:32:15.008065] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-19T21:32:15.009425] [DEBUG] [LOCAL ] TAL: Trimmed 75700 records to 52924 (keeping 200 days of data) [2025-09-19T21:32:15.061216] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-19T21:32:15.326501] [DEBUG] [LOCAL ] TAL: Primary data saved (52924 records). [2025-09-19T21:32:15.326660] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-19T21:32:15.326780] [INFO ] [MAIN ] Update Progress: 2048/2372 symbols completed. TAL took 33.6s. Estimated remaining: 43m 4s. Rate: 7.5 symbols/min [2025-09-19T21:32:15.499932] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:15.521506] [DEBUG] [LOCAL ] TBI: Loaded 22917 existing records from primary storage. [2025-09-19T21:32:15.521726] [INFO ] [MAIN ] TBI: Loaded 22917 existing records. [2025-09-19T21:32:15.703014] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:32:15.703247] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-19T21:32:15.703307] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-19T21:32:15.703939] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-19T21:32:15.703999] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-19T21:32:15.853026] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-19T21:32:16.063519] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:16.177065] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T21:32:16.452693] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T21:32:16.643262] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-19T21:32:17.005017] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T21:32:17.443341] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-19T21:32:18.243266] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-19T21:32:18.752613] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T21:32:18.787606] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T21:32:19.043260] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-19T21:32:19.843270] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-19T21:32:19.936203] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T21:32:20.643272] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-19T21:32:21.045256] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T21:32:21.068372] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T21:32:21.443271] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-19T21:32:22.243467] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-19T21:32:22.392240] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T21:32:23.043288] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-19T21:32:23.439476] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T21:32:23.566978] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T21:32:23.843267] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-19T21:32:24.643286] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-19T21:32:24.720145] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T21:32:25.435575] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-19T21:32:25.443227] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-19T21:32:25.538124] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T21:32:26.243318] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-19T21:32:26.747574] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T21:32:27.043288] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-19T21:32:27.748072] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-19T21:32:27.843252] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-19T21:32:28.470705] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T21:32:28.643267] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-19T21:32:29.102989] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T21:32:29.443237] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-19T21:32:29.769524] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T21:32:29.948806] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-19T21:32:30.243318] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-19T21:32:31.043274] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-19T21:32:31.200307] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-19T21:32:31.843281] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-19T21:32:32.643256] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-19T21:32:32.698252] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T21:32:32.706381] [INFO ] [REMOTE ] TAP: Full fetch complete (76140 records). [2025-09-19T21:32:32.706519] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-19T21:32:33.107478] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-19T21:32:33.107593] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-19T21:32:33.108821] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-19T21:32:33.108915] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-19T21:32:33.115876] [DEBUG] [LOCAL ] TAP: Trimmed 76140 records to 53624 (keeping 200 days of data) [2025-09-19T21:32:33.126108] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T21:32:33.445695] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-19T21:32:33.459715] [DEBUG] [LOCAL ] TAP: Primary data saved (53624 records). [2025-09-19T21:32:33.459819] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-19T21:32:33.459901] [INFO ] [MAIN ] Update Progress: 2049/2372 symbols completed. TAP took 26.5s. Estimated remaining: 42m 57s. Rate: 7.5 symbols/min [2025-09-19T21:32:33.629051] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:33.629239] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-19T21:32:33.629277] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-19T21:32:33.629419] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-19T21:32:33.629463] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-19T21:32:33.629506] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-19T21:32:33.629556] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-19T21:32:33.924197] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T21:32:34.005632] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:34.243273] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-19T21:32:34.616162] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-19T21:32:34.668250] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-19T21:32:35.043269] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-19T21:32:35.434670] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-19T21:32:35.843259] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-19T21:32:36.643281] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-19T21:32:37.363247] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T21:32:37.379337] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T21:32:37.443220] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-19T21:32:38.243276] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-19T21:32:38.862374] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-19T21:32:39.043262] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-19T21:32:39.143684] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T21:32:39.444445] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-19T21:32:39.843273] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-19T21:32:40.252861] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-19T21:32:40.643278] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-19T21:32:41.443276] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-19T21:32:41.719145] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T21:32:42.077741] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T21:32:42.243266] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-19T21:32:43.043264] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-19T21:32:43.617267] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T21:32:43.622736] [INFO ] [REMOTE ] TBBB: Full fetch complete (51356 records). [2025-09-19T21:32:43.622833] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-19T21:32:43.848362] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-19T21:32:44.010777] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-19T21:32:44.010860] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-19T21:32:44.011755] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-19T21:32:44.011819] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-19T21:32:44.012967] [DEBUG] [LOCAL ] TBBB: Trimmed 51356 records to 36426 (keeping 200 days of data) [2025-09-19T21:32:44.224256] [DEBUG] [LOCAL ] TBBB: Primary data saved (36426 records). [2025-09-19T21:32:44.224411] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-19T21:32:44.225403] [INFO ] [MAIN ] Update Progress: 2050/2372 symbols completed. TBBB took 31.7s. Estimated remaining: 42m 50s. Rate: 7.5 symbols/min [2025-09-19T21:32:44.407130] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:44.422039] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T21:32:44.431014] [DEBUG] [LOCAL ] TBN: Loaded 3059 existing records from primary storage. [2025-09-19T21:32:44.431462] [INFO ] [MAIN ] TBN: Loaded 3059 existing records. [2025-09-19T21:32:44.611885] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:32:44.612161] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-19T21:32:44.612217] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-19T21:32:44.612449] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-19T21:32:44.612508] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-19T21:32:44.648347] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-19T21:32:44.981877] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:44.978064] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-19T21:32:45.443251] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-19T21:32:46.003971] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-19T21:32:46.021753] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-19T21:32:46.243260] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-19T21:32:47.043277] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-19T21:32:47.440912] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T21:32:47.843277] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-19T21:32:48.045456] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T21:32:48.051829] [INFO ] [REMOTE ] TBI: Full fetch complete (31658 records). [2025-09-19T21:32:48.052122] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-19T21:32:48.438143] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-19T21:32:48.438311] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-19T21:32:48.439044] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-19T21:32:48.439128] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-19T21:32:48.439987] [DEBUG] [LOCAL ] TBI: Trimmed 31658 records to 23061 (keeping 200 days of data) [2025-09-19T21:32:48.503801] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T21:32:48.587871] [DEBUG] [LOCAL ] TBI: Primary data saved (23061 records). [2025-09-19T21:32:48.588011] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-19T21:32:48.588117] [INFO ] [MAIN ] Update Progress: 2051/2372 symbols completed. TBI took 33.3s. Estimated remaining: 42m 41s. Rate: 7.5 symbols/min [2025-09-19T21:32:48.651227] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-19T21:32:48.771176] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:48.771387] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-19T21:32:48.771442] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-19T21:32:48.771605] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-19T21:32:48.771673] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-19T21:32:48.771773] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-19T21:32:48.771841] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-19T21:32:49.140004] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:49.443282] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-19T21:32:49.688305] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T21:32:49.691855] [INFO ] [REMOTE ] TBB: Full fetch complete (18262 records). [2025-09-19T21:32:49.691964] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-19T21:32:49.917168] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-19T21:32:50.070864] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-19T21:32:50.070945] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-19T21:32:50.071337] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-19T21:32:50.071412] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-19T21:32:50.072794] [DEBUG] [LOCAL ] TBB: Trimmed 18262 records to 11863 (keeping 200 days of data) [2025-09-19T21:32:50.154300] [DEBUG] [LOCAL ] TBB: Primary data saved (11863 records). [2025-09-19T21:32:50.154449] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-19T21:32:50.154685] [INFO ] [MAIN ] Update Progress: 2052/2372 symbols completed. TBB took 39.4s. Estimated remaining: 42m 32s. Rate: 7.5 symbols/min [2025-09-19T21:32:50.251356] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-19T21:32:50.325511] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:50.391929] [DEBUG] [LOCAL ] TD: Loaded 52676 existing records from primary storage. [2025-09-19T21:32:50.392100] [INFO ] [MAIN ] TD: Loaded 52676 existing records. [2025-09-19T21:32:50.573247] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:32:50.573510] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-19T21:32:50.573575] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-19T21:32:50.575070] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-19T21:32:50.575141] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-19T21:32:50.739017] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-19T21:32:50.940109] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:51.043243] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-19T21:32:51.843300] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-19T21:32:52.080031] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:32:52.080571] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-19T21:32:52.643351] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-19T21:32:52.898213] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:32:52.898551] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-19T21:32:53.044639] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T21:32:53.443296] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-19T21:32:53.844172] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-19T21:32:53.844992] [INFO ] [REMOTE ] TBLU: Full fetch complete (1176 records). [2025-09-19T21:32:53.845063] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-19T21:32:54.027828] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T21:32:54.028036] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:32:54.028124] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:32:54.028200] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-19T21:32:54.028279] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-19T21:32:54.028348] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-19T21:32:54.028435] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-19T21:32:54.028549] [INFO ] [MAIN ] Update Progress: 2053/2372 symbols completed. TBLU took 20.6s. Estimated remaining: 42m 24s. Rate: 7.5 symbols/min [2025-09-19T21:32:54.205155] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:32:54.250123] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-19T21:32:54.278374] [DEBUG] [LOCAL ] TDC: Loaded 47386 existing records from primary storage. [2025-09-19T21:32:54.278676] [INFO ] [MAIN ] TDC: Loaded 47386 existing records. [2025-09-19T21:32:54.473794] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:32:54.474180] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-19T21:32:54.474242] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-19T21:32:54.475520] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-19T21:32:54.475585] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-19T21:32:54.536710] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:32:54.563411] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-19T21:32:54.860575] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:32:55.043268] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-19T21:32:55.268059] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:32:55.268456] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-19T21:32:55.843263] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-19T21:32:56.083242] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:32:56.083575] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-19T21:32:56.643269] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-19T21:32:57.443274] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-19T21:32:58.132855] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-19T21:32:58.243271] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-19T21:32:58.601136] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-19T21:32:58.970348] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T21:32:59.043229] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-19T21:32:59.727226] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T21:32:59.843244] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-19T21:33:00.078047] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:33:00.078331] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-19T21:33:00.643264] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-19T21:33:01.443279] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-19T21:33:02.243308] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-19T21:33:02.596838] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:33:02.597254] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-19T21:33:03.043304] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-19T21:33:03.188446] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-19T21:33:03.672273] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T21:33:03.843311] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-19T21:33:04.643292] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-19T21:33:05.295022] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:33:05.295356] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-19T21:33:05.443247] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-19T21:33:05.517561] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-19T21:33:05.953480] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-19T21:33:06.003368] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T21:33:06.243277] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-19T21:33:07.001275] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-19T21:33:07.043300] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-19T21:33:07.843272] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-19T21:33:08.643306] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-19T21:33:08.777794] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T21:33:09.215730] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T21:33:09.357318] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T21:33:09.443259] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-19T21:33:10.243346] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-19T21:33:11.044932] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-19T21:33:11.047411] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T21:33:11.817815] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-19T21:33:11.843231] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-19T21:33:12.643270] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-19T21:33:13.002441] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T21:33:13.432230] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-19T21:33:13.443206] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-19T21:33:14.243280] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-19T21:33:14.592148] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-19T21:33:14.594476] [INFO ] [REMOTE ] TCAI: Full fetch complete (856 records). [2025-09-19T21:33:14.594799] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-19T21:33:14.832418] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 33 unique days, need 200 days [2025-09-19T21:33:14.832722] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:33:14.832794] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:33:14.832854] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-19T21:33:14.832955] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-19T21:33:14.833025] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-19T21:33:14.833104] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-19T21:33:14.833245] [INFO ] [MAIN ] Update Progress: 2054/2372 symbols completed. TCAI took 26.2s. Estimated remaining: 42m 18s. Rate: 7.5 symbols/min [2025-09-19T21:33:15.056849] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-19T21:33:15.060937] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:33:15.076476] [DEBUG] [LOCAL ] TDF: Loaded 6549 existing records from primary storage. [2025-09-19T21:33:15.076758] [INFO ] [MAIN ] TDF: Loaded 6549 existing records. [2025-09-19T21:33:15.340288] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:33:15.340634] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-19T21:33:15.340729] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-19T21:33:15.341175] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-19T21:33:15.341242] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-19T21:33:15.803875] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:33:15.810140] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T21:33:15.812907] [INFO ] [REMOTE ] TBN: Full fetch complete (4767 records). [2025-09-19T21:33:15.813105] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-19T21:33:15.848333] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-19T21:33:16.043404] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (3.40 seconds). [2025-09-19T21:33:16.251917] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-19T21:33:16.252031] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-19T21:33:16.252224] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-19T21:33:16.252333] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-19T21:33:16.253102] [DEBUG] [LOCAL ] TBN: Trimmed 4767 records to 3109 (keeping 200 days of data) [2025-09-19T21:33:16.272194] [DEBUG] [LOCAL ] TBN: Primary data saved (3109 records). [2025-09-19T21:33:16.272308] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-19T21:33:16.272437] [INFO ] [MAIN ] Update Progress: 2055/2372 symbols completed. TBN took 32.0s. Estimated remaining: 42m 9s. Rate: 7.5 symbols/min [2025-09-19T21:33:16.408080] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-09-19T21:33:16.492922] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:33:16.524377] [DEBUG] [LOCAL ] TDG: Loaded 22331 existing records from primary storage. [2025-09-19T21:33:16.524526] [INFO ] [MAIN ] TDG: Loaded 22331 existing records. [2025-09-19T21:33:16.648511] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-19T21:33:16.712849] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:33:16.713109] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-19T21:33:16.713157] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-19T21:33:16.714096] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-19T21:33:16.714159] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-19T21:33:16.975121] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-19T21:33:17.113842] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:33:17.443270] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-19T21:33:18.243308] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-19T21:33:18.505234] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T21:33:18.771588] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T21:33:19.043327] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-19T21:33:19.612494] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T21:33:19.843277] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-19T21:33:20.643252] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-19T21:33:20.943048] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T21:33:21.114918] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-19T21:33:21.146226] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T21:33:21.443281] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-19T21:33:22.243266] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-19T21:33:22.342792] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T21:33:23.043311] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-19T21:33:23.843270] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-19T21:33:24.376240] [DEBUG] [REMOTE ] TDG: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-19T21:33:24.376570] [WARN ] [REMOTE ] TDG: No data returned for month 2025-02 [2025-09-19T21:33:24.384187] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T21:33:24.431481] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-19T21:33:24.643254] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-19T21:33:25.443320] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-19T21:33:26.006001] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T21:33:26.013900] [INFO ] [REMOTE ] TD: Full fetch complete (75784 records). [2025-09-19T21:33:26.014033] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-19T21:33:26.248367] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-19T21:33:26.440708] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T21:33:26.440451] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-19T21:33:26.440934] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-19T21:33:26.444308] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-19T21:33:26.444704] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-19T21:33:26.446170] [DEBUG] [LOCAL ] TD: Trimmed 75784 records to 53049 (keeping 200 days of data) [2025-09-19T21:33:26.779884] [DEBUG] [LOCAL ] TD: Primary data saved (53049 records). [2025-09-19T21:33:26.780070] [INFO ] [MAIN ] TD: Full history saved. [2025-09-19T21:33:26.780186] [INFO ] [MAIN ] Update Progress: 2056/2372 symbols completed. TD took 36.6s. Estimated remaining: 42m 1s. Rate: 7.5 symbols/min [2025-09-19T21:33:26.955799] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:33:27.008670] [DEBUG] [LOCAL ] TDOC: Loaded 53744 existing records from primary storage. [2025-09-19T21:33:27.008825] [INFO ] [MAIN ] TDOC: Loaded 53744 existing records. [2025-09-19T21:33:27.048393] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-19T21:33:27.199859] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:33:27.200110] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-19T21:33:27.200157] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-19T21:33:27.201269] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-19T21:33:27.201332] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-19T21:33:27.570438] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:33:27.843261] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-19T21:33:28.006675] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T21:33:28.218518] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-19T21:33:28.288218] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-19T21:33:28.643317] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-19T21:33:29.443321] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-19T21:33:30.243268] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-19T21:33:31.028507] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T21:33:31.043249] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-19T21:33:31.248407] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-19T21:33:31.431155] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-19T21:33:31.843258] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-19T21:33:32.099819] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T21:33:32.643334] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-19T21:33:33.443244] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-19T21:33:33.470325] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-19T21:33:34.053170] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T21:33:34.243305] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-19T21:33:34.488129] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-19T21:33:34.982108] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T21:33:34.983969] [INFO ] [REMOTE ] TDF: Full fetch complete (10725 records). [2025-09-19T21:33:34.984043] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-19T21:33:35.048472] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-19T21:33:35.359593] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-19T21:33:35.359701] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-19T21:33:35.359976] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-19T21:33:35.360026] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-19T21:33:35.360474] [DEBUG] [LOCAL ] TDF: Trimmed 10725 records to 6581 (keeping 200 days of data) [2025-09-19T21:33:35.401051] [DEBUG] [LOCAL ] TDF: Primary data saved (6581 records). [2025-09-19T21:33:35.401172] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-19T21:33:35.401256] [INFO ] [MAIN ] Update Progress: 2057/2372 symbols completed. TDF took 20.6s. Estimated remaining: 41m 53s. Rate: 7.5 symbols/min [2025-09-19T21:33:35.569913] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:33:35.620571] [DEBUG] [LOCAL ] TDS: Loaded 43200 existing records from primary storage. [2025-09-19T21:33:35.620767] [INFO ] [MAIN ] TDS: Loaded 43200 existing records. [2025-09-19T21:33:35.799302] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:33:35.799561] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-19T21:33:35.799625] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-19T21:33:35.800859] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-19T21:33:35.800921] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-19T21:33:35.853816] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-19T21:33:36.171525] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:33:36.519742] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-19T21:33:36.643222] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-19T21:33:37.443292] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-19T21:33:37.683176] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T21:33:37.806999] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-19T21:33:38.243280] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-19T21:33:39.043263] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-19T21:33:39.575465] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T21:33:39.630425] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-19T21:33:39.843260] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-19T21:33:40.164037] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T21:33:40.643275] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-19T21:33:41.443291] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-19T21:33:41.993733] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T21:33:42.243235] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-19T21:33:42.326294] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T21:33:42.794529] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T21:33:42.801732] [INFO ] [REMOTE ] TDC: Full fetch complete (66727 records). [2025-09-19T21:33:42.801864] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-19T21:33:43.049291] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-19T21:33:43.207880] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-19T21:33:43.207989] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-19T21:33:43.209072] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-19T21:33:43.209138] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-19T21:33:43.210684] [DEBUG] [LOCAL ] TDC: Trimmed 66727 records to 47741 (keeping 200 days of data) [2025-09-19T21:33:43.498970] [DEBUG] [LOCAL ] TDC: Primary data saved (47741 records). [2025-09-19T21:33:43.499163] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-19T21:33:43.499279] [INFO ] [MAIN ] Update Progress: 2058/2372 symbols completed. TDC took 49.5s. Estimated remaining: 41m 45s. Rate: 7.5 symbols/min [2025-09-19T21:33:43.674208] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:33:43.717517] [DEBUG] [LOCAL ] TDW: Loaded 46057 existing records from primary storage. [2025-09-19T21:33:43.717714] [INFO ] [MAIN ] TDW: Loaded 46057 existing records. [2025-09-19T21:33:43.845180] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-19T21:33:43.901530] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:33:43.902437] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-19T21:33:43.902488] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-19T21:33:43.903524] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-19T21:33:43.903585] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-19T21:33:44.222966] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T21:33:44.314188] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:33:44.643258] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-19T21:33:45.071581] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-19T21:33:45.304055] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T21:33:45.443318] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-19T21:33:46.061753] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T21:33:46.243327] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-19T21:33:47.043289] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-19T21:33:47.615470] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-19T21:33:47.639434] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-19T21:33:47.643732] [INFO ] [REMOTE ] TDG: Full fetch complete (29297 records). [2025-09-19T21:33:47.643814] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-19T21:33:47.831929] [WARN ] [VALIDATOR ] TDG: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-19T21:33:47.832332] [FATAL] [MAIN ] TDG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:33:47.832457] [WARN ] [MAIN ] TDG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:33:47.832532] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-19T21:33:47.832599] [DEBUG] [LOCAL ] TDG: No primary data file found to delete. [2025-09-19T21:33:47.832637] [INFO ] [LOCAL ] TDG: Starting deletion of derivative data. [2025-09-19T21:33:47.833165] [DEBUG] [LOCAL ] TDG: Deleted derivative data file. [2025-09-19T21:33:47.833263] [INFO ] [MAIN ] Update Progress: 2059/2372 symbols completed. TDG took 31.6s. Estimated remaining: 41m 37s. Rate: 7.5 symbols/min [2025-09-19T21:33:47.848351] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-19T21:33:48.014756] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:33:48.041442] [DEBUG] [LOCAL ] TDY: Loaded 23132 existing records from primary storage. [2025-09-19T21:33:48.041571] [INFO ] [MAIN ] TDY: Loaded 23132 existing records. [2025-09-19T21:33:48.217603] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:33:48.217848] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-19T21:33:48.217898] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-19T21:33:48.218528] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-19T21:33:48.218588] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-19T21:33:48.574215] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:33:48.643261] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-19T21:33:49.145464] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T21:33:49.443294] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-19T21:33:50.045029] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T21:33:50.243291] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-19T21:33:50.486480] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-19T21:33:50.815754] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T21:33:51.043269] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-19T21:33:51.843293] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-19T21:33:52.071304] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T21:33:52.553729] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T21:33:52.643264] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-19T21:33:53.443250] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-19T21:33:53.913348] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T21:33:54.243242] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-19T21:33:54.364180] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-19T21:33:55.043240] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-19T21:33:55.166268] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T21:33:55.556281] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T21:33:55.843291] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-19T21:33:56.643274] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-19T21:33:57.276131] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T21:33:57.306089] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-19T21:33:57.443286] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-19T21:33:58.243258] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-19T21:33:58.653536] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T21:33:58.875423] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T21:33:59.043310] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-19T21:33:59.843331] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-19T21:33:59.890021] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-19T21:34:00.643283] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-19T21:34:01.155814] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T21:34:01.163633] [INFO ] [REMOTE ] TDOC: Full fetch complete (77276 records). [2025-09-19T21:34:01.163815] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-19T21:34:01.458436] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-19T21:34:01.560898] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-19T21:34:01.561360] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-19T21:34:01.562543] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-19T21:34:01.563023] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-19T21:34:01.581469] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T21:34:01.586796] [DEBUG] [LOCAL ] TDOC: Trimmed 77276 records to 54132 (keeping 200 days of data) [2025-09-19T21:34:01.735695] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:34:01.946982] [DEBUG] [LOCAL ] TDOC: Primary data saved (54132 records). [2025-09-19T21:34:01.947156] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-19T21:34:01.947261] [INFO ] [MAIN ] Update Progress: 2060/2372 symbols completed. TDOC took 35.2s. Estimated remaining: 41m 30s. Rate: 7.5 symbols/min [2025-09-19T21:34:02.116869] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:02.117055] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-19T21:34:02.117094] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-19T21:34:02.117253] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-19T21:34:02.117306] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-19T21:34:02.117373] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-19T21:34:02.117407] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-19T21:34:02.258025] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-19T21:34:02.482503] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:34:03.043273] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-19T21:34:03.349288] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:34:03.418898] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T21:34:03.843256] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-19T21:34:04.643298] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-19T21:34:04.751025] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-19T21:34:04.874405] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:34:04.874725] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-19T21:34:05.443340] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-19T21:34:05.718771] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T21:34:05.888416] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:34:05.888753] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-19T21:34:06.243339] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-19T21:34:07.043261] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-19T21:34:07.136107] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T21:34:07.843338] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-19T21:34:08.643324] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-19T21:34:08.824967] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T21:34:08.934283] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:34:08.934717] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-19T21:34:09.083156] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T21:34:09.086217] [INFO ] [REMOTE ] TDY: Full fetch complete (32300 records). [2025-09-19T21:34:09.086326] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-19T21:34:09.448382] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-19T21:34:09.463329] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-19T21:34:09.463416] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-19T21:34:09.464338] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-19T21:34:09.464403] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-19T21:34:09.465454] [DEBUG] [LOCAL ] TDY: Trimmed 32300 records to 23259 (keeping 200 days of data) [2025-09-19T21:34:09.615065] [DEBUG] [LOCAL ] TDY: Primary data saved (23259 records). [2025-09-19T21:34:09.615202] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-19T21:34:09.615291] [INFO ] [MAIN ] Update Progress: 2061/2372 symbols completed. TDY took 21.8s. Estimated remaining: 41m 22s. Rate: 7.5 symbols/min [2025-09-19T21:34:09.783584] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:09.792796] [DEBUG] [LOCAL ] TEAF: Loaded 7310 existing records from primary storage. [2025-09-19T21:34:09.792907] [INFO ] [MAIN ] TEAF: Loaded 7310 existing records. [2025-09-19T21:34:09.978541] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:34:09.978848] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-19T21:34:09.978898] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-19T21:34:09.979293] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-19T21:34:09.979354] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-19T21:34:10.250224] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-19T21:34:10.339981] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:34:11.043264] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-19T21:34:11.366524] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-19T21:34:11.804556] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T21:34:11.843294] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-19T21:34:12.102383] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T21:34:12.643313] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-19T21:34:13.112615] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T21:34:13.443258] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-19T21:34:14.243370] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-19T21:34:14.403819] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T21:34:14.412269] [INFO ] [REMOTE ] TDS: Full fetch complete (61473 records). [2025-09-19T21:34:14.412394] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-19T21:34:14.807624] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-19T21:34:14.807771] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-19T21:34:14.808871] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-19T21:34:14.808933] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-19T21:34:14.811103] [DEBUG] [LOCAL ] TDS: Trimmed 61473 records to 43487 (keeping 200 days of data) [2025-09-19T21:34:15.043415] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-19T21:34:15.075940] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-19T21:34:15.133334] [DEBUG] [LOCAL ] TDS: Primary data saved (43487 records). [2025-09-19T21:34:15.133493] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-19T21:34:15.133589] [INFO ] [MAIN ] Update Progress: 2062/2372 symbols completed. TDS took 39.7s. Estimated remaining: 41m 13s. Rate: 7.5 symbols/min [2025-09-19T21:34:15.312916] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:15.365693] [DEBUG] [LOCAL ] TECK: Loaded 53829 existing records from primary storage. [2025-09-19T21:34:15.365845] [INFO ] [MAIN ] TECK: Loaded 53829 existing records. [2025-09-19T21:34:15.545325] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:34:15.545597] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-19T21:34:15.545669] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-19T21:34:15.547514] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-19T21:34:15.547577] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-19T21:34:15.848584] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-19T21:34:15.921959] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:34:16.108803] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T21:34:16.136816] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T21:34:16.643301] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-19T21:34:17.443299] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-19T21:34:18.005262] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T21:34:18.123358] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T21:34:18.172757] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T21:34:18.243270] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-19T21:34:19.043338] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-19T21:34:19.843280] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-19T21:34:20.177261] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T21:34:20.198394] [INFO ] [REMOTE ] TDW: Full fetch complete (67283 records). [2025-09-19T21:34:20.209859] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-19T21:34:20.211221] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T21:34:20.340900] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-19T21:34:20.623632] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-19T21:34:20.623773] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-19T21:34:20.624892] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-19T21:34:20.624960] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-19T21:34:20.626463] [DEBUG] [LOCAL ] TDW: Trimmed 67283 records to 46386 (keeping 200 days of data) [2025-09-19T21:34:20.675737] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-19T21:34:20.901447] [DEBUG] [LOCAL ] TDW: Primary data saved (46386 records). [2025-09-19T21:34:20.901614] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-19T21:34:20.901769] [INFO ] [MAIN ] Update Progress: 2063/2372 symbols completed. TDW took 37.4s. Estimated remaining: 41m 5s. Rate: 7.5 symbols/min [2025-09-19T21:34:21.085446] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:21.135933] [DEBUG] [LOCAL ] TEF: Loaded 37836 existing records from primary storage. [2025-09-19T21:34:21.136097] [INFO ] [MAIN ] TEF: Loaded 37836 existing records. [2025-09-19T21:34:21.325933] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:34:21.326177] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-19T21:34:21.326226] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-19T21:34:21.327099] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-19T21:34:21.327160] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-19T21:34:21.448411] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-19T21:34:21.742562] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:34:21.752093] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-19T21:34:22.243270] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-19T21:34:23.043303] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-19T21:34:23.672668] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T21:34:23.843266] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-19T21:34:23.933514] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T21:34:24.643268] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-19T21:34:24.967525] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-19T21:34:25.385639] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T21:34:25.443247] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-19T21:34:25.936265] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T21:34:26.243349] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-19T21:34:26.316426] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-19T21:34:27.043270] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-19T21:34:27.843312] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-19T21:34:27.908243] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T21:34:27.967840] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T21:34:28.643266] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-19T21:34:29.443266] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-19T21:34:29.918583] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T21:34:30.243269] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-19T21:34:30.302208] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T21:34:30.314631] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-19T21:34:31.043275] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-19T21:34:31.725765] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T21:34:31.732712] [INFO ] [REMOTE ] TE: Full fetch complete (45586 records). [2025-09-19T21:34:31.732826] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-19T21:34:31.848580] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-19T21:34:31.936744] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 140 unique days, need 200 days [2025-09-19T21:34:31.937283] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:34:31.937355] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:34:31.937428] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-19T21:34:31.937518] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-19T21:34:31.937566] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-19T21:34:31.937633] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-19T21:34:31.937744] [INFO ] [MAIN ] Update Progress: 2064/2372 symbols completed. TE took 30.0s. Estimated remaining: 40m 57s. Rate: 7.5 symbols/min [2025-09-19T21:34:32.104083] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:32.129037] [DEBUG] [LOCAL ] TEI: Loaded 20582 existing records from primary storage. [2025-09-19T21:34:32.129312] [INFO ] [MAIN ] TEI: Loaded 20582 existing records. [2025-09-19T21:34:32.319964] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:34:32.320250] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-19T21:34:32.320307] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-19T21:34:32.320999] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-19T21:34:32.321060] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-19T21:34:32.648560] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-19T21:34:32.727916] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:34:32.733162] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T21:34:32.734875] [INFO ] [REMOTE ] TEAF: Full fetch complete (9786 records). [2025-09-19T21:34:32.734950] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-19T21:34:33.100078] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T21:34:33.141755] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-19T21:34:33.141860] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-19T21:34:33.142146] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-19T21:34:33.142189] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-19T21:34:33.142710] [DEBUG] [LOCAL ] TEAF: Trimmed 9786 records to 7367 (keeping 200 days of data) [2025-09-19T21:34:33.187695] [DEBUG] [LOCAL ] TEAF: Primary data saved (7367 records). [2025-09-19T21:34:33.187829] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-19T21:34:33.187941] [INFO ] [MAIN ] Update Progress: 2065/2372 symbols completed. TEAF took 23.6s. Estimated remaining: 40m 48s. Rate: 7.5 symbols/min [2025-09-19T21:34:33.359430] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:33.423415] [DEBUG] [LOCAL ] TEL: Loaded 51567 existing records from primary storage. [2025-09-19T21:34:33.423626] [INFO ] [MAIN ] TEL: Loaded 51567 existing records. [2025-09-19T21:34:33.454822] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-19T21:34:33.606287] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:34:33.606520] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-19T21:34:33.606568] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-19T21:34:33.608436] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-19T21:34:33.608497] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-19T21:34:34.032401] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:34:34.243266] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-19T21:34:34.307296] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T21:34:35.043261] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-19T21:34:35.371857] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T21:34:35.750758] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T21:34:35.843216] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-19T21:34:36.260430] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T21:34:36.643260] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-19T21:34:37.443311] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-19T21:34:37.917577] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T21:34:38.243226] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-19T21:34:38.857837] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-19T21:34:39.043265] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-19T21:34:39.155533] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T21:34:39.843310] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-19T21:34:40.078920] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T21:34:40.643232] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-19T21:34:40.749567] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T21:34:41.382303] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T21:34:41.443253] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-19T21:34:42.147113] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T21:34:42.243217] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-19T21:34:43.044373] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T21:34:43.044521] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-19T21:34:43.843306] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-19T21:34:44.512431] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-19T21:34:44.645150] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-19T21:34:44.647870] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T21:34:45.347186] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-19T21:34:45.443258] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-19T21:34:45.603238] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T21:34:46.243305] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-19T21:34:47.043304] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-19T21:34:47.509739] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T21:34:47.845017] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-19T21:34:47.851387] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T21:34:48.300762] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T21:34:48.643306] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-19T21:34:49.443264] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-19T21:34:50.173377] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T21:34:50.178833] [INFO ] [REMOTE ] TEF: Full fetch complete (54441 records). [2025-09-19T21:34:50.178932] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-19T21:34:50.248470] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-19T21:34:50.571137] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-19T21:34:50.571249] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-19T21:34:50.572240] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-19T21:34:50.572385] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-19T21:34:50.573754] [DEBUG] [LOCAL ] TEF: Trimmed 54441 records to 38107 (keeping 200 days of data) [2025-09-19T21:34:50.685582] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-19T21:34:50.833454] [DEBUG] [LOCAL ] TEF: Primary data saved (38107 records). [2025-09-19T21:34:50.833613] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-19T21:34:50.833735] [INFO ] [MAIN ] Update Progress: 2066/2372 symbols completed. TEF took 29.9s. Estimated remaining: 40m 42s. Rate: 7.5 symbols/min [2025-09-19T21:34:51.002984] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:51.034476] [DEBUG] [LOCAL ] TEN: Loaded 31428 existing records from primary storage. [2025-09-19T21:34:51.034608] [INFO ] [MAIN ] TEN: Loaded 31428 existing records. [2025-09-19T21:34:51.065979] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-19T21:34:51.214134] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:34:51.214385] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-19T21:34:51.214848] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-19T21:34:51.216094] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-19T21:34:51.216161] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-19T21:34:51.572917] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:34:51.585477] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T21:34:51.840094] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-19T21:34:51.850573] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-19T21:34:52.643493] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-19T21:34:52.663833] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T21:34:53.059703] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-19T21:34:53.443311] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-19T21:34:53.936984] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T21:34:54.243273] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-19T21:34:55.043268] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-19T21:34:55.480324] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-19T21:34:55.550548] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T21:34:55.843262] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-19T21:34:56.643251] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-19T21:34:57.053823] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T21:34:57.061754] [INFO ] [REMOTE ] TECK: Full fetch complete (77300 records). [2025-09-19T21:34:57.061896] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-19T21:34:57.448385] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-19T21:34:57.473332] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-19T21:34:57.473430] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-19T21:34:57.474636] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-19T21:34:57.474724] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-19T21:34:57.476527] [DEBUG] [LOCAL ] TECK: Trimmed 77300 records to 54219 (keeping 200 days of data) [2025-09-19T21:34:57.742732] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-19T21:34:57.757501] [INFO ] [REMOTE ] TEL: Full fetch complete (73260 records). [2025-09-19T21:34:57.759000] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-19T21:34:57.855556] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T21:34:58.243320] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-19T21:34:58.297336] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-19T21:34:58.297786] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-19T21:34:58.299287] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-19T21:34:58.300235] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-19T21:34:58.305967] [DEBUG] [LOCAL ] TEL: Trimmed 73260 records to 51925 (keeping 200 days of data) [2025-09-19T21:34:58.411506] [DEBUG] [LOCAL ] TECK: Primary data saved (54219 records). [2025-09-19T21:34:58.412476] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-19T21:34:58.413575] [INFO ] [MAIN ] Update Progress: 2067/2372 symbols completed. TECK took 43.3s. Estimated remaining: 40m 34s. Rate: 7.5 symbols/min [2025-09-19T21:34:58.594707] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:58.621349] [DEBUG] [LOCAL ] TEO: Loaded 21772 existing records from primary storage. [2025-09-19T21:34:58.622485] [INFO ] [MAIN ] TEO: Loaded 21772 existing records. [2025-09-19T21:34:58.812684] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:34:58.820013] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-19T21:34:58.820257] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-19T21:34:58.879958] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-19T21:34:58.895608] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-19T21:34:58.950002] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T21:34:59.048336] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-19T21:34:59.412445] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:34:59.428523] [DEBUG] [LOCAL ] TEL: Primary data saved (51925 records). [2025-09-19T21:34:59.428731] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-19T21:34:59.429562] [INFO ] [MAIN ] Update Progress: 2068/2372 symbols completed. TEL took 26.2s. Estimated remaining: 40m 25s. Rate: 7.5 symbols/min [2025-09-19T21:34:59.597552] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:34:59.666516] [DEBUG] [LOCAL ] TEVA: Loaded 54022 existing records from primary storage. [2025-09-19T21:34:59.666699] [INFO ] [MAIN ] TEVA: Loaded 54022 existing records. [2025-09-19T21:34:59.847616] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:34:59.848088] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-19T21:34:59.848197] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-19T21:34:59.848395] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-19T21:34:59.849628] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-19T21:34:59.849758] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-19T21:34:59.940020] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T21:35:00.242259] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:35:00.370802] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T21:35:00.643317] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-19T21:35:01.267051] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T21:35:01.443287] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-19T21:35:02.243311] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-19T21:35:02.767890] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T21:35:02.886785] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T21:35:03.043262] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-19T21:35:03.298687] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T21:35:03.843274] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-19T21:35:04.643275] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-19T21:35:04.955307] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T21:35:05.106847] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T21:35:05.443249] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-19T21:35:06.243299] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-19T21:35:06.269371] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T21:35:07.051588] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-19T21:35:07.053823] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-19T21:35:07.293350] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T21:35:07.843266] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-19T21:35:08.299564] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T21:35:08.643313] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-19T21:35:09.354474] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-19T21:35:09.443280] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-19T21:35:09.887141] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-19T21:35:09.891934] [INFO ] [REMOTE ] TEI: Full fetch complete (29804 records). [2025-09-19T21:35:09.892106] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-19T21:35:10.243288] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-19T21:35:10.275589] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-19T21:35:10.275699] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-19T21:35:10.276687] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-19T21:35:10.276782] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-19T21:35:10.278186] [DEBUG] [LOCAL ] TEI: Trimmed 29804 records to 20713 (keeping 200 days of data) [2025-09-19T21:35:10.355670] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T21:35:10.428318] [DEBUG] [LOCAL ] TEI: Primary data saved (20713 records). [2025-09-19T21:35:10.428447] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-19T21:35:10.428607] [INFO ] [MAIN ] Update Progress: 2069/2372 symbols completed. TEI took 38.5s. Estimated remaining: 40m 17s. Rate: 7.5 symbols/min [2025-09-19T21:35:10.596383] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:35:10.649563] [DEBUG] [LOCAL ] TEX: Loaded 45339 existing records from primary storage. [2025-09-19T21:35:10.649731] [INFO ] [MAIN ] TEX: Loaded 45339 existing records. [2025-09-19T21:35:10.825169] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:35:10.825423] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-19T21:35:10.825471] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-19T21:35:10.826500] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-19T21:35:10.826578] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-19T21:35:11.048395] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-19T21:35:11.197295] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:35:11.843292] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-19T21:35:12.359247] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T21:35:12.648393] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-19T21:35:12.668248] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-19T21:35:12.872610] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T21:35:13.443385] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-19T21:35:14.019812] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T21:35:14.243321] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-19T21:35:14.868488] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T21:35:14.953412] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-19T21:35:15.043341] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-19T21:35:15.843277] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-19T21:35:16.555192] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-19T21:35:16.561101] [INFO ] [REMOTE ] TEO: Full fetch complete (32719 records). [2025-09-19T21:35:16.561213] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-19T21:35:16.652636] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-19T21:35:16.999751] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-19T21:35:16.999906] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-19T21:35:17.000684] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-19T21:35:17.000747] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-19T21:35:17.001594] [DEBUG] [LOCAL ] TEO: Trimmed 32719 records to 22044 (keeping 200 days of data) [2025-09-19T21:35:17.144885] [DEBUG] [LOCAL ] TEO: Primary data saved (22044 records). [2025-09-19T21:35:17.145016] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-19T21:35:17.145119] [INFO ] [MAIN ] Update Progress: 2070/2372 symbols completed. TEO took 18.7s. Estimated remaining: 40m 9s. Rate: 7.5 symbols/min [2025-09-19T21:35:17.313931] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:35:17.381328] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-09-19T21:35:17.381495] [INFO ] [MAIN ] TFC: Loaded 54057 existing records. [2025-09-19T21:35:17.450779] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-19T21:35:17.568328] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:35:17.568709] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-19T21:35:17.568774] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-19T21:35:17.570055] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-19T21:35:17.570117] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-19T21:35:17.941798] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:35:18.256261] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-19T21:35:18.263994] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-19T21:35:18.395850] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T21:35:18.670247] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T21:35:19.043329] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-19T21:35:19.843357] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-19T21:35:20.289798] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T21:35:20.618502] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-19T21:35:20.643280] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-19T21:35:20.786836] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T21:35:21.443283] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-19T21:35:22.243288] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-19T21:35:22.571705] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T21:35:23.043257] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-19T21:35:23.516925] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T21:35:23.843318] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-19T21:35:24.495090] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-19T21:35:24.643300] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-19T21:35:24.789416] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T21:35:25.137867] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T21:35:25.443267] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-19T21:35:26.243275] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-19T21:35:26.553355] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T21:35:26.671522] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T21:35:27.043281] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-19T21:35:27.313740] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-19T21:35:27.319400] [INFO ] [REMOTE ] TEN: Full fetch complete (44993 records). [2025-09-19T21:35:27.319528] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-19T21:35:27.710268] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-19T21:35:27.710415] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-19T21:35:27.711288] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-19T21:35:27.711354] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-19T21:35:27.714001] [DEBUG] [LOCAL ] TEN: Trimmed 44993 records to 31614 (keeping 200 days of data) [2025-09-19T21:35:27.851065] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-19T21:35:27.923030] [DEBUG] [LOCAL ] TEN: Primary data saved (31614 records). [2025-09-19T21:35:27.923194] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-19T21:35:27.923324] [INFO ] [MAIN ] Update Progress: 2071/2372 symbols completed. TEN took 37.1s. Estimated remaining: 40m 2s. Rate: 7.5 symbols/min [2025-09-19T21:35:28.105482] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:35:28.144316] [DEBUG] [LOCAL ] TFII: Loaded 35116 existing records from primary storage. [2025-09-19T21:35:28.144483] [INFO ] [MAIN ] TFII: Loaded 35116 existing records. [2025-09-19T21:35:28.337859] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:35:28.338184] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-19T21:35:28.338255] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-19T21:35:28.339135] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-19T21:35:28.339219] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-19T21:35:28.648399] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-19T21:35:28.714067] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:35:28.831203] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T21:35:29.443275] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-19T21:35:29.598555] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T21:35:30.243242] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-19T21:35:30.454950] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-19T21:35:30.781933] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T21:35:31.043289] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-19T21:35:31.843269] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-19T21:35:32.332905] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T21:35:32.513525] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T21:35:32.643279] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-19T21:35:33.443311] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-19T21:35:33.897241] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T21:35:34.243278] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-19T21:35:34.323867] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T21:35:35.043267] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-19T21:35:35.763110] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T21:35:35.843271] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-19T21:35:35.994324] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T21:35:36.643263] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-19T21:35:36.691261] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-19T21:35:37.443264] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-19T21:35:38.042310] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T21:35:38.085290] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T21:35:38.091759] [INFO ] [REMOTE ] TEX: Full fetch complete (64740 records). [2025-09-19T21:35:38.091891] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-19T21:35:38.249919] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-19T21:35:38.501467] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-19T21:35:38.501586] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-19T21:35:38.502673] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-19T21:35:38.502740] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-19T21:35:38.504464] [DEBUG] [LOCAL ] TEX: Trimmed 64740 records to 45628 (keeping 200 days of data) [2025-09-19T21:35:38.797884] [DEBUG] [LOCAL ] TEX: Primary data saved (45628 records). [2025-09-19T21:35:38.798067] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-19T21:35:38.798205] [INFO ] [MAIN ] Update Progress: 2072/2372 symbols completed. TEX took 28.4s. Estimated remaining: 39m 54s. Rate: 7.5 symbols/min [2025-09-19T21:35:38.998977] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:35:39.028247] [DEBUG] [LOCAL ] TFIN: Loaded 23775 existing records from primary storage. [2025-09-19T21:35:39.028410] [INFO ] [MAIN ] TFIN: Loaded 23775 existing records. [2025-09-19T21:35:39.064419] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-19T21:35:39.233604] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:35:39.234301] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-19T21:35:39.234426] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-19T21:35:39.235144] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-19T21:35:39.235223] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-19T21:35:39.398702] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T21:35:39.660440] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:35:39.843268] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-19T21:35:40.435588] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T21:35:40.643261] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-19T21:35:41.062748] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-19T21:35:41.070884] [INFO ] [REMOTE ] TEVA: Full fetch complete (77670 records). [2025-09-19T21:35:41.071033] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-19T21:35:41.465355] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-19T21:35:41.490530] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-19T21:35:41.490683] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-19T21:35:41.491924] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-19T21:35:41.492052] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-19T21:35:41.494009] [DEBUG] [LOCAL ] TEVA: Trimmed 77670 records to 54412 (keeping 200 days of data) [2025-09-19T21:35:41.644014] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T21:35:41.877443] [DEBUG] [LOCAL ] TEVA: Primary data saved (54412 records). [2025-09-19T21:35:41.877614] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-19T21:35:41.878216] [INFO ] [MAIN ] Update Progress: 2073/2372 symbols completed. TEVA took 42.4s. Estimated remaining: 39m 45s. Rate: 7.5 symbols/min [2025-09-19T21:35:42.047698] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:35:42.090950] [DEBUG] [LOCAL ] TFPM: Loaded 37239 existing records from primary storage. [2025-09-19T21:35:42.091089] [INFO ] [MAIN ] TFPM: Loaded 37239 existing records. [2025-09-19T21:35:42.246887] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-19T21:35:42.272073] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:35:42.272448] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-19T21:35:42.272614] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-19T21:35:42.273669] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-19T21:35:42.273737] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-19T21:35:42.536463] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T21:35:42.700728] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:35:42.695607] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T21:35:43.043264] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-19T21:35:43.843248] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-19T21:35:43.948055] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-19T21:35:44.643336] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-19T21:35:45.070784] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T21:35:45.155287] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T21:35:45.443290] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-19T21:35:46.141934] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T21:35:46.243230] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-19T21:35:47.043265] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-19T21:35:47.333174] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T21:35:47.341150] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-09-19T21:35:47.341306] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-19T21:35:47.747901] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-19T21:35:47.748011] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-19T21:35:47.749119] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-19T21:35:47.749181] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-19T21:35:47.750738] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 54447 (keeping 200 days of data) [2025-09-19T21:35:47.843869] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-19T21:35:47.998922] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T21:35:48.134485] [DEBUG] [LOCAL ] TFC: Primary data saved (54447 records). [2025-09-19T21:35:48.134631] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-19T21:35:48.134776] [INFO ] [MAIN ] Update Progress: 2074/2372 symbols completed. TFC took 31.0s. Estimated remaining: 39m 37s. Rate: 7.5 symbols/min [2025-09-19T21:35:48.305408] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:35:48.345119] [DEBUG] [LOCAL ] TFX: Loaded 38015 existing records from primary storage. [2025-09-19T21:35:48.345261] [INFO ] [MAIN ] TFX: Loaded 38015 existing records. [2025-09-19T21:35:48.524994] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:35:48.525407] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-19T21:35:48.525500] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-19T21:35:48.532943] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-19T21:35:48.543313] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-19T21:35:48.565836] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T21:35:48.652892] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-19T21:35:48.739991] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T21:35:48.924164] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:35:49.443271] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-19T21:35:50.208807] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T21:35:50.243238] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-19T21:35:50.525208] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T21:35:51.043284] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-19T21:35:51.657203] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T21:35:51.843254] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-19T21:35:51.988951] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T21:35:52.643319] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-19T21:35:53.443312] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-19T21:35:53.598384] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T21:35:53.674931] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T21:35:53.679772] [INFO ] [REMOTE ] TFII: Full fetch complete (47560 records). [2025-09-19T21:35:53.679894] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-19T21:35:54.085766] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-19T21:35:54.085859] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-19T21:35:54.086885] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-19T21:35:54.086950] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-19T21:35:54.088207] [DEBUG] [LOCAL ] TFII: Trimmed 47560 records to 35312 (keeping 200 days of data) [2025-09-19T21:35:54.269821] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-19T21:35:54.341045] [DEBUG] [LOCAL ] TFII: Primary data saved (35312 records). [2025-09-19T21:35:54.341242] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-19T21:35:54.341370] [INFO ] [MAIN ] Update Progress: 2075/2372 symbols completed. TFII took 26.4s. Estimated remaining: 39m 29s. Rate: 7.5 symbols/min [2025-09-19T21:35:54.516943] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:35:54.528401] [DEBUG] [LOCAL ] TG: Loaded 10478 existing records from primary storage. [2025-09-19T21:35:54.528536] [INFO ] [MAIN ] TG: Loaded 10478 existing records. [2025-09-19T21:35:54.705513] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:35:54.705806] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-19T21:35:54.705909] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-19T21:35:54.706290] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-19T21:35:54.706348] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-19T21:35:55.057904] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-19T21:35:55.062844] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:35:55.479243] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T21:35:55.512239] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T21:35:55.843262] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-19T21:35:56.309493] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-19T21:35:56.571968] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-19T21:35:56.643273] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-19T21:35:57.443249] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-19T21:35:57.694451] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-19T21:35:58.243269] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-19T21:35:58.789455] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T21:35:59.043309] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-19T21:35:59.238376] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T21:35:59.843256] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-19T21:36:00.643251] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-19T21:36:00.749594] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T21:36:00.778746] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-19T21:36:01.443320] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-19T21:36:02.243284] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-19T21:36:03.043301] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-19T21:36:03.115207] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T21:36:03.843264] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-19T21:36:03.961298] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (3.32 seconds). [2025-09-19T21:36:04.643292] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-19T21:36:04.844386] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-19T21:36:04.901415] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-19T21:36:05.272768] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T21:36:05.443298] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-19T21:36:06.243279] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-19T21:36:06.409610] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T21:36:06.742140] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T21:36:07.032170] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T21:36:07.043206] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-19T21:36:07.843289] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-19T21:36:08.523347] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T21:36:08.643276] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-19T21:36:08.973277] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T21:36:09.351486] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-19T21:36:09.443293] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-19T21:36:10.243272] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-19T21:36:11.043282] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-19T21:36:11.138840] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T21:36:11.202076] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T21:36:11.843262] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-19T21:36:11.979843] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T21:36:12.643294] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-19T21:36:13.211130] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T21:36:13.219327] [INFO ] [REMOTE ] TFPM: Full fetch complete (50121 records). [2025-09-19T21:36:13.219517] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-19T21:36:13.449949] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-19T21:36:13.453302] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-19T21:36:13.811931] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-19T21:36:13.812072] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-19T21:36:13.814050] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-19T21:36:13.814181] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-19T21:36:13.816017] [DEBUG] [LOCAL ] TFPM: Trimmed 50121 records to 37558 (keeping 200 days of data) [2025-09-19T21:36:14.090489] [DEBUG] [LOCAL ] TFPM: Primary data saved (37558 records). [2025-09-19T21:36:14.090674] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-19T21:36:14.091035] [INFO ] [MAIN ] Update Progress: 2076/2372 symbols completed. TFPM took 32.2s. Estimated remaining: 39m 23s. Rate: 7.5 symbols/min [2025-09-19T21:36:14.249013] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-19T21:36:14.291076] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:36:14.291324] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-19T21:36:14.291388] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-19T21:36:14.291573] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-19T21:36:14.291852] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-19T21:36:14.291945] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-19T21:36:14.292003] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-19T21:36:14.672774] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:36:15.043273] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-19T21:36:15.843271] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-19T21:36:16.229587] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:36:16.229953] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-19T21:36:16.241737] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-19T21:36:16.265957] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-19T21:36:16.354877] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T21:36:16.358532] [INFO ] [REMOTE ] TFIN: Full fetch complete (30721 records). [2025-09-19T21:36:16.358630] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-19T21:36:16.648445] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-19T21:36:16.729238] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-19T21:36:16.729312] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-19T21:36:16.729937] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-19T21:36:16.729998] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-19T21:36:16.730755] [DEBUG] [LOCAL ] TFIN: Trimmed 30721 records to 23958 (keeping 200 days of data) [2025-09-19T21:36:16.873144] [DEBUG] [LOCAL ] TFIN: Primary data saved (23958 records). [2025-09-19T21:36:16.873296] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-19T21:36:16.873400] [INFO ] [MAIN ] Update Progress: 2077/2372 symbols completed. TFIN took 38.1s. Estimated remaining: 39m 14s. Rate: 7.5 symbols/min [2025-09-19T21:36:17.443323] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-19T21:36:17.914512] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:36:17.915045] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-19T21:36:17.924278] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T21:36:18.243263] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-19T21:36:19.043277] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-19T21:36:19.318805] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T21:36:19.321409] [INFO ] [REMOTE ] TG: Full fetch complete (15327 records). [2025-09-19T21:36:19.321546] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-19T21:36:19.686322] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-19T21:36:19.686405] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-19T21:36:19.686833] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-19T21:36:19.686893] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-19T21:36:19.687413] [DEBUG] [LOCAL ] TG: Trimmed 15327 records to 10626 (keeping 200 days of data) [2025-09-19T21:36:19.750991] [DEBUG] [LOCAL ] TG: Primary data saved (10626 records). [2025-09-19T21:36:19.751167] [INFO ] [MAIN ] TG: Full history saved. [2025-09-19T21:36:19.751352] [INFO ] [MAIN ] Update Progress: 2078/2372 symbols completed. TG took 25.4s. Estimated remaining: 39m 5s. Rate: 7.5 symbols/min [2025-09-19T21:36:19.843299] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-19T21:36:20.093906] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:36:20.094247] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-19T21:36:20.643317] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-19T21:36:20.835669] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-19T21:36:20.885520] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:36:20.885937] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-19T21:36:21.443279] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-19T21:36:21.691779] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:36:21.692119] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-19T21:36:22.243295] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-19T21:36:22.475480] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:36:22.475848] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-19T21:36:23.043296] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-19T21:36:23.843272] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-19T21:36:24.074405] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T21:36:24.080501] [INFO ] [REMOTE ] TFX: Full fetch complete (54061 records). [2025-09-19T21:36:24.080636] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-19T21:36:24.457080] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-19T21:36:24.457167] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-19T21:36:24.458096] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-19T21:36:24.458159] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-19T21:36:24.459392] [DEBUG] [LOCAL ] TFX: Trimmed 54061 records to 38306 (keeping 200 days of data) [2025-09-19T21:36:24.704317] [DEBUG] [LOCAL ] TFX: Primary data saved (38306 records). [2025-09-19T21:36:24.704544] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-19T21:36:24.704846] [INFO ] [MAIN ] Update Progress: 2079/2372 symbols completed. TFX took 36.6s. Estimated remaining: 38m 57s. Rate: 7.5 symbols/min [2025-09-19T21:36:25.728592] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T21:36:25.734097] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-19T21:36:26.441194] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T21:36:26.444238] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-19T21:36:27.456769] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T21:36:27.460378] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-19T21:36:28.609364] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T21:36:28.612636] [INFO ] [REMOTE ] TGE: Full fetch complete (8351 records). [2025-09-19T21:36:28.612743] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-19T21:36:28.798259] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-19T21:36:28.798492] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:36:28.798559] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:36:28.798629] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-19T21:36:28.798727] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-19T21:36:28.798770] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-19T21:36:28.798823] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-19T21:36:28.798925] [INFO ] [MAIN ] Update Progress: 2080/2372 symbols completed. TGE took 14.7s. Estimated remaining: 38m 48s. Rate: 7.5 symbols/min [2025-09-19T21:36:29.619556] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:36:29.626110] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:36:29.629285] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:36:29.627593] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:36:29.671988] [DEBUG] [LOCAL ] TGLS: Loaded 28792 existing records from primary storage. [2025-09-19T21:36:29.672139] [INFO ] [MAIN ] TGLS: Loaded 28792 existing records. [2025-09-19T21:36:29.747549] [DEBUG] [LOCAL ] TGS: Loaded 32525 existing records from primary storage. [2025-09-19T21:36:29.768376] [INFO ] [MAIN ] TGS: Loaded 32525 existing records. [2025-09-19T21:36:30.007708] [DEBUG] [LOCAL ] TGNA: Loaded 49066 existing records from primary storage. [2025-09-19T21:36:30.010333] [INFO ] [MAIN ] TGNA: Loaded 49066 existing records. [2025-09-19T21:36:30.052593] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:36:30.085161] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-19T21:36:30.053419] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-09-19T21:36:30.151216] [INFO ] [MAIN ] TGT: Loaded 54168 existing records. [2025-09-19T21:36:30.105009] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-19T21:36:30.157696] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:36:30.174499] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-19T21:36:30.202528] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-19T21:36:30.265332] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-19T21:36:30.265473] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-19T21:36:30.388909] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-19T21:36:30.389066] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-19T21:36:30.689377] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:36:30.737423] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:36:30.755601] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-19T21:36:30.844530] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-19T21:36:30.844449] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-19T21:36:30.872195] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-19T21:36:30.890690] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-19T21:36:30.959710] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-19T21:36:30.945071] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-19T21:36:30.978891] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-19T21:36:31.379116] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:36:31.391398] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-19T21:36:31.618629] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:36:31.673701] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-19T21:36:31.964981] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:36:31.987396] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-19T21:36:32.025716] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:36:32.026039] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-19T21:36:33.079762] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T21:36:33.086429] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-19T21:36:33.302699] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T21:36:33.309097] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-19T21:36:33.957618] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T21:36:33.968611] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-19T21:36:34.005552] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-19T21:36:34.016910] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-19T21:36:34.293944] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T21:36:34.301586] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-19T21:36:34.496219] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T21:36:34.502110] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-19T21:36:35.343391] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T21:36:35.353446] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-19T21:36:35.600727] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T21:36:35.783908] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-19T21:36:35.843233] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-19T21:36:35.878707] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T21:36:36.630482] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T21:36:36.643226] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-19T21:36:37.378775] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T21:36:37.443270] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-19T21:36:38.243277] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-19T21:36:38.605296] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T21:36:38.713865] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T21:36:39.043265] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-19T21:36:39.843244] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-19T21:36:40.046208] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T21:36:40.643260] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-19T21:36:41.030063] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T21:36:41.123376] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T21:36:41.443278] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-19T21:36:42.243251] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-19T21:36:42.282396] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T21:36:42.678133] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T21:36:43.043264] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-19T21:36:43.813207] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-19T21:36:43.843225] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-19T21:36:44.643269] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-19T21:36:44.781244] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T21:36:45.375627] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-19T21:36:45.443302] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-19T21:36:45.935224] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T21:36:46.243289] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-19T21:36:46.973639] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T21:36:47.043299] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-19T21:36:47.843293] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-19T21:36:48.182630] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T21:36:48.643269] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-19T21:36:48.769769] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T21:36:49.443325] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-19T21:36:50.243327] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-19T21:36:50.408870] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-19T21:36:50.522704] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T21:36:50.589051] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T21:36:50.595277] [INFO ] [REMOTE ] TGS: Full fetch complete (47166 records). [2025-09-19T21:36:50.595370] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-19T21:36:50.975980] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-19T21:36:50.976064] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-19T21:36:50.976956] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-19T21:36:50.977017] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-19T21:36:50.978050] [DEBUG] [LOCAL ] TGS: Trimmed 47166 records to 32870 (keeping 200 days of data) [2025-09-19T21:36:51.061355] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-19T21:36:51.176847] [DEBUG] [LOCAL ] TGS: Primary data saved (32870 records). [2025-09-19T21:36:51.177003] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-19T21:36:51.177107] [INFO ] [MAIN ] Update Progress: 2081/2372 symbols completed. TGS took 22.4s. Estimated remaining: 38m 42s. Rate: 7.5 symbols/min [2025-09-19T21:36:51.342519] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:36:51.389689] [DEBUG] [LOCAL ] THC: Loaded 48664 existing records from primary storage. [2025-09-19T21:36:51.389853] [INFO ] [MAIN ] THC: Loaded 48664 existing records. [2025-09-19T21:36:51.574113] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:36:51.574386] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-19T21:36:51.574434] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-19T21:36:51.575772] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-19T21:36:51.575832] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-19T21:36:51.844767] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-19T21:36:51.952317] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T21:36:51.977059] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:36:52.290259] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-19T21:36:52.297621] [INFO ] [REMOTE ] TGNA: Full fetch complete (69843 records). [2025-09-19T21:36:52.297911] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-19T21:36:52.646614] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-19T21:36:52.692847] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-19T21:36:52.692939] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-19T21:36:52.694049] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-19T21:36:52.694160] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-19T21:36:52.695874] [DEBUG] [LOCAL ] TGNA: Trimmed 69843 records to 49434 (keeping 200 days of data) [2025-09-19T21:36:52.995051] [DEBUG] [LOCAL ] TGNA: Primary data saved (49434 records). [2025-09-19T21:36:52.995187] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-19T21:36:52.998003] [INFO ] [MAIN ] Update Progress: 2082/2372 symbols completed. TGNA took 24.2s. Estimated remaining: 38m 33s. Rate: 7.5 symbols/min [2025-09-19T21:36:53.171851] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:36:53.207740] [DEBUG] [LOCAL ] THG: Loaded 22325 existing records from primary storage. [2025-09-19T21:36:53.207972] [INFO ] [MAIN ] THG: Loaded 22325 existing records. [2025-09-19T21:36:53.384844] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:36:53.385087] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-19T21:36:53.385136] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-19T21:36:53.385868] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-19T21:36:53.385928] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-19T21:36:53.443675] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-19T21:36:53.740892] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:36:54.243332] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-19T21:36:54.303881] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-19T21:36:54.410579] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-19T21:36:54.518103] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T21:36:55.043318] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-19T21:36:55.455175] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T21:36:55.843272] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-19T21:36:56.389031] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-19T21:36:56.643248] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-19T21:36:57.146302] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T21:36:57.443284] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-19T21:36:58.243268] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-19T21:36:58.406300] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T21:36:59.043275] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-19T21:36:59.573337] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T21:36:59.843316] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-19T21:37:00.069234] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-19T21:37:00.599907] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T21:37:00.604159] [INFO ] [REMOTE ] TGLS: Full fetch complete (40209 records). [2025-09-19T21:37:00.604255] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-19T21:37:00.648449] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-19T21:37:00.983944] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-19T21:37:00.984033] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-19T21:37:00.984873] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-19T21:37:00.984959] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-19T21:37:00.985964] [DEBUG] [LOCAL ] TGLS: Trimmed 40209 records to 28984 (keeping 200 days of data) [2025-09-19T21:37:01.172171] [DEBUG] [LOCAL ] TGLS: Primary data saved (28984 records). [2025-09-19T21:37:01.172326] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-19T21:37:01.172456] [INFO ] [MAIN ] Update Progress: 2083/2372 symbols completed. TGLS took 32.4s. Estimated remaining: 38m 25s. Rate: 7.5 symbols/min [2025-09-19T21:37:01.348634] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:37:01.353495] [DEBUG] [LOCAL ] THIR: Loaded 2166 existing records from primary storage. [2025-09-19T21:37:01.353742] [INFO ] [MAIN ] THIR: Loaded 2166 existing records. [2025-09-19T21:37:01.446756] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-19T21:37:01.552916] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:37:01.580821] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-19T21:37:01.581044] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-19T21:37:01.583034] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T21:37:01.583141] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-19T21:37:01.583440] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-19T21:37:01.876403] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T21:37:02.003151] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:37:02.243287] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-19T21:37:03.043267] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-19T21:37:03.633475] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T21:37:03.843234] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-19T21:37:04.062930] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-19T21:37:04.643244] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-19T21:37:04.707913] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T21:37:05.365206] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-19T21:37:05.383181] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T21:37:05.443313] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-19T21:37:05.838381] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-19T21:37:06.243323] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-19T21:37:06.638320] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-19T21:37:07.043317] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-19T21:37:07.843265] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-19T21:37:08.332674] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-19T21:37:08.643273] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-19T21:37:09.443293] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-19T21:37:09.612909] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-19T21:37:09.910169] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T21:37:10.243298] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-19T21:37:11.043240] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-19T21:37:11.133778] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T21:37:11.761109] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-19T21:37:11.843255] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-19T21:37:12.643322] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-19T21:37:12.719321] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-19T21:37:13.219836] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T21:37:13.443289] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-19T21:37:14.243280] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-19T21:37:14.518584] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T21:37:14.556197] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-19T21:37:14.639479] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T21:37:15.043260] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-19T21:37:15.843283] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-19T21:37:16.355772] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-19T21:37:16.643277] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-19T21:37:16.996579] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T21:37:17.157826] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-19T21:37:17.443273] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-19T21:37:18.054384] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-19T21:37:18.243295] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-19T21:37:18.741070] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-19T21:37:19.043263] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-19T21:37:19.843295] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-19T21:37:20.643289] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-19T21:37:20.789504] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T21:37:21.178497] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-19T21:37:21.179669] [INFO ] [REMOTE ] THIR: Full fetch complete (2603 records). [2025-09-19T21:37:21.179742] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-19T21:37:21.448399] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-19T21:37:21.564261] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-19T21:37:21.564343] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-19T21:37:21.564458] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-19T21:37:21.564496] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-19T21:37:21.564910] [DEBUG] [LOCAL ] THIR: Trimmed 2603 records to 2187 (keeping 200 days of data) [2025-09-19T21:37:21.581446] [DEBUG] [LOCAL ] THIR: Primary data saved (2187 records). [2025-09-19T21:37:21.581603] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-19T21:37:21.581765] [INFO ] [MAIN ] Update Progress: 2084/2372 symbols completed. THIR took 20.4s. Estimated remaining: 38m 19s. Rate: 7.5 symbols/min [2025-09-19T21:37:21.762185] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:37:21.765928] [DEBUG] [LOCAL ] THLV: Loaded 1687 existing records from primary storage. [2025-09-19T21:37:21.766012] [INFO ] [MAIN ] THLV: Loaded 1687 existing records. [2025-09-19T21:37:21.942585] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:37:21.942865] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-19T21:37:21.942973] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-19T21:37:21.943205] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-19T21:37:21.943264] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-19T21:37:22.245799] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-19T21:37:22.309256] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:37:22.333266] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-19T21:37:22.345593] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-09-19T21:37:22.345773] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-19T21:37:22.743094] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-19T21:37:22.743173] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-19T21:37:22.744266] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-19T21:37:22.744330] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-19T21:37:22.745799] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 54558 (keeping 200 days of data) [2025-09-19T21:37:23.049794] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-19T21:37:23.115921] [DEBUG] [LOCAL ] TGT: Primary data saved (54558 records). [2025-09-19T21:37:23.116088] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-19T21:37:23.117335] [INFO ] [MAIN ] Update Progress: 2085/2372 symbols completed. TGT took 54.3s. Estimated remaining: 38m 10s. Rate: 7.5 symbols/min [2025-09-19T21:37:23.293819] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:37:23.303762] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T21:37:23.312947] [INFO ] [REMOTE ] THG: Full fetch complete (31156 records). [2025-09-19T21:37:23.313068] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-19T21:37:23.466934] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-19T21:37:23.666123] [DEBUG] [LOCAL ] THO: Loaded 42800 existing records from primary storage. [2025-09-19T21:37:23.695404] [INFO ] [MAIN ] THO: Loaded 42800 existing records. [2025-09-19T21:37:23.853299] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-19T21:37:23.933830] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-19T21:37:23.969358] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-19T21:37:24.017257] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-19T21:37:24.025196] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:37:24.025736] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-19T21:37:24.025526] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-19T21:37:24.027552] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-19T21:37:24.026461] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-19T21:37:24.041670] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-19T21:37:24.041876] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-19T21:37:24.041982] [DEBUG] [LOCAL ] THG: Trimmed 31156 records to 22479 (keeping 200 days of data) [2025-09-19T21:37:24.080592] [INFO ] [REMOTE ] THC: Full fetch complete (69649 records). [2025-09-19T21:37:24.110858] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-19T21:37:24.476333] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-19T21:37:24.654332] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-19T21:37:24.904840] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:37:25.010438] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-19T21:37:25.011230] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-19T21:37:25.012959] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-19T21:37:25.013053] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-19T21:37:25.018087] [DEBUG] [LOCAL ] THC: Trimmed 69649 records to 48988 (keeping 200 days of data) [2025-09-19T21:37:25.157946] [DEBUG] [LOCAL ] THG: Primary data saved (22479 records). [2025-09-19T21:37:25.163513] [INFO ] [MAIN ] THG: Full history saved. [2025-09-19T21:37:25.168713] [INFO ] [MAIN ] Update Progress: 2086/2372 symbols completed. THG took 32.2s. Estimated remaining: 38m 2s. Rate: 7.5 symbols/min [2025-09-19T21:37:25.428318] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-19T21:37:25.444045] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-19T21:37:25.469552] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:37:25.564361] [DEBUG] [LOCAL ] THQ: Loaded 24478 existing records from primary storage. [2025-09-19T21:37:25.565619] [INFO ] [MAIN ] THQ: Loaded 24478 existing records. [2025-09-19T21:37:25.762888] [DEBUG] [LOCAL ] THC: Primary data saved (48988 records). [2025-09-19T21:37:25.761485] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:37:25.763139] [INFO ] [MAIN ] THC: Full history saved. [2025-09-19T21:37:25.763386] [INFO ] [MAIN ] Update Progress: 2087/2372 symbols completed. THC took 34.6s. Estimated remaining: 37m 53s. Rate: 7.5 symbols/min [2025-09-19T21:37:25.763867] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-19T21:37:25.764127] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-19T21:37:25.807637] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-19T21:37:25.834108] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-19T21:37:26.060977] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:37:26.061356] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-19T21:37:26.247139] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-19T21:37:26.282082] [DEBUG] [LOCAL ] THR: Loaded 20234 existing records from primary storage. [2025-09-19T21:37:26.296327] [INFO ] [MAIN ] THR: Loaded 20234 existing records. [2025-09-19T21:37:26.370272] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:37:26.519444] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:37:26.519742] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-19T21:37:26.519798] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-19T21:37:26.520256] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-19T21:37:26.520314] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-19T21:37:26.876859] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:37:27.043254] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-19T21:37:27.843274] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-19T21:37:27.998027] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T21:37:28.285042] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T21:37:28.643249] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-19T21:37:29.101166] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T21:37:29.443291] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-19T21:37:29.900866] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T21:37:30.243270] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-19T21:37:30.776327] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T21:37:31.043275] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-19T21:37:31.216621] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-19T21:37:31.366129] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-19T21:37:31.843357] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-19T21:37:32.643294] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-19T21:37:32.754319] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T21:37:33.030181] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-19T21:37:33.443259] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-19T21:37:34.243271] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-19T21:37:35.043289] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-19T21:37:35.149320] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T21:37:35.450600] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-19T21:37:35.564545] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T21:37:35.843267] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-19T21:37:36.359225] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-19T21:37:36.643256] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-19T21:37:37.443257] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-19T21:37:38.097831] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T21:37:38.243280] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-19T21:37:38.769184] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T21:37:39.043241] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-19T21:37:39.544332] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T21:37:39.843286] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-19T21:37:40.513697] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-19T21:37:40.698815] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-19T21:37:40.720118] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T21:37:41.133095] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-19T21:37:41.134039] [INFO ] [REMOTE ] THLV: Full fetch complete (2703 records). [2025-09-19T21:37:41.134114] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-19T21:37:41.459171] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-19T21:37:41.505953] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-19T21:37:41.506042] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-19T21:37:41.506166] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-19T21:37:41.506210] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-19T21:37:41.506556] [DEBUG] [LOCAL ] THLV: Trimmed 2703 records to 1690 (keeping 200 days of data) [2025-09-19T21:37:41.518405] [DEBUG] [LOCAL ] THLV: Primary data saved (1690 records). [2025-09-19T21:37:41.518512] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-19T21:37:41.518622] [INFO ] [MAIN ] Update Progress: 2088/2372 symbols completed. THLV took 19.9s. Estimated remaining: 37m 46s. Rate: 7.5 symbols/min [2025-09-19T21:37:41.688599] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:37:41.742029] [DEBUG] [LOCAL ] THS: Loaded 38245 existing records from primary storage. [2025-09-19T21:37:41.742176] [INFO ] [MAIN ] THS: Loaded 38245 existing records. [2025-09-19T21:37:41.924838] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:37:41.925149] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-19T21:37:41.925198] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-19T21:37:41.926204] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-19T21:37:41.926265] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-19T21:37:42.248710] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-19T21:37:42.310362] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:37:43.043286] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-19T21:37:43.342307] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T21:37:43.510570] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-19T21:37:43.843265] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-19T21:37:44.079876] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T21:37:44.507701] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-19T21:37:44.643262] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-19T21:37:45.443272] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-19T21:37:45.930914] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T21:37:46.243294] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-19T21:37:46.764501] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T21:37:47.043281] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-19T21:37:47.365002] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T21:37:47.843269] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-19T21:37:48.643344] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-19T21:37:48.829516] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T21:37:49.409380] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T21:37:49.443248] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-19T21:37:50.247988] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-19T21:37:50.252497] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T21:37:50.270533] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T21:37:50.274288] [INFO ] [REMOTE ] THR: Full fetch complete (28897 records). [2025-09-19T21:37:50.274374] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-19T21:37:50.649314] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-19T21:37:50.649431] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-19T21:37:50.650036] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-19T21:37:50.650097] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-19T21:37:50.650842] [DEBUG] [LOCAL ] THR: Trimmed 28897 records to 20422 (keeping 200 days of data) [2025-09-19T21:37:50.771535] [DEBUG] [LOCAL ] THR: Primary data saved (20422 records). [2025-09-19T21:37:50.771691] [INFO ] [MAIN ] THR: Full history saved. [2025-09-19T21:37:50.771798] [INFO ] [MAIN ] Update Progress: 2089/2372 symbols completed. THR took 25.0s. Estimated remaining: 37m 38s. Rate: 7.5 symbols/min [2025-09-19T21:37:50.941977] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:37:50.964132] [DEBUG] [LOCAL ] THW: Loaded 19276 existing records from primary storage. [2025-09-19T21:37:50.964273] [INFO ] [MAIN ] THW: Loaded 19276 existing records. [2025-09-19T21:37:51.048362] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-19T21:37:51.176071] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:37:51.176308] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-19T21:37:51.176358] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-19T21:37:51.177038] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-19T21:37:51.177099] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-19T21:37:51.564331] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:37:51.843273] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-19T21:37:52.341954] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-19T21:37:52.643252] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-19T21:37:52.745270] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T21:37:53.120686] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T21:37:53.443277] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-19T21:37:54.243256] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-19T21:37:54.338122] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-19T21:37:55.043271] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-19T21:37:55.216101] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T21:37:55.790548] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T21:37:55.843225] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-19T21:37:56.598803] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-19T21:37:56.605057] [INFO ] [REMOTE ] THO: Full fetch complete (60071 records). [2025-09-19T21:37:56.605166] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-19T21:37:56.651709] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-19T21:37:57.012154] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-19T21:37:57.012241] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-19T21:37:57.013348] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-19T21:37:57.013412] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-19T21:37:57.014800] [DEBUG] [LOCAL ] THO: Trimmed 60071 records to 43130 (keeping 200 days of data) [2025-09-19T21:37:57.097196] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T21:37:57.308813] [DEBUG] [LOCAL ] THO: Primary data saved (43130 records). [2025-09-19T21:37:57.308967] [INFO ] [MAIN ] THO: Full history saved. [2025-09-19T21:37:57.309476] [INFO ] [MAIN ] Update Progress: 2090/2372 symbols completed. THO took 34.2s. Estimated remaining: 37m 30s. Rate: 7.5 symbols/min [2025-09-19T21:37:57.455053] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-19T21:37:57.487094] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:37:57.488611] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-19T21:37:57.488699] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-19T21:37:57.488893] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-19T21:37:57.488936] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-19T21:37:57.488978] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-19T21:37:57.489009] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-19T21:37:57.848704] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:37:58.243282] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-19T21:37:58.406466] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T21:37:58.722375] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:37:58.726415] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-19T21:37:58.729389] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T21:37:59.043329] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-19T21:37:59.843329] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-19T21:38:00.532866] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T21:38:00.643231] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-19T21:38:01.443287] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-19T21:38:01.746570] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T21:38:01.916285] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T21:38:01.944883] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:38:01.945118] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-19T21:38:02.243266] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-19T21:38:03.043234] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-19T21:38:03.551619] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T21:38:03.843345] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-19T21:38:04.145773] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-19T21:38:04.643246] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-19T21:38:04.714536] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T21:38:05.443361] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-19T21:38:05.986732] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T21:38:06.243274] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-19T21:38:06.945163] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T21:38:06.949242] [INFO ] [REMOTE ] THQ: Full fetch complete (34647 records). [2025-09-19T21:38:06.949326] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-19T21:38:07.048934] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-19T21:38:07.336827] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-19T21:38:07.336943] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-19T21:38:07.337756] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-19T21:38:07.337829] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-19T21:38:07.338754] [DEBUG] [LOCAL ] THQ: Trimmed 34647 records to 24661 (keeping 200 days of data) [2025-09-19T21:38:07.488574] [DEBUG] [LOCAL ] THQ: Primary data saved (24661 records). [2025-09-19T21:38:07.488884] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-19T21:38:07.489049] [INFO ] [MAIN ] Update Progress: 2091/2372 symbols completed. THQ took 42.3s. Estimated remaining: 37m 22s. Rate: 7.5 symbols/min [2025-09-19T21:38:07.567788] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T21:38:07.678999] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:38:07.723555] [DEBUG] [LOCAL ] TIMB: Loaded 37389 existing records from primary storage. [2025-09-19T21:38:07.723722] [INFO ] [MAIN ] TIMB: Loaded 37389 existing records. [2025-09-19T21:38:07.848361] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-19T21:38:07.905710] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:38:07.906060] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-19T21:38:07.906208] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-19T21:38:07.913877] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-19T21:38:07.914075] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-19T21:38:07.927895] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-19T21:38:08.274480] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:38:08.643267] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-19T21:38:09.104349] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T21:38:09.443266] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-19T21:38:09.889980] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-19T21:38:10.243302] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-19T21:38:10.658183] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T21:38:11.043311] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-19T21:38:11.538003] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T21:38:11.843330] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-19T21:38:12.080863] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T21:38:12.643271] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-19T21:38:13.067537] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T21:38:13.443325] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-19T21:38:14.243346] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-19T21:38:14.407635] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T21:38:14.425402] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T21:38:14.428272] [INFO ] [REMOTE ] THW: Full fetch complete (29408 records). [2025-09-19T21:38:14.428357] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-19T21:38:14.801589] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-19T21:38:14.801723] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-19T21:38:14.802331] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-19T21:38:14.802373] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-19T21:38:14.803212] [DEBUG] [LOCAL ] THW: Trimmed 29408 records to 19372 (keeping 200 days of data) [2025-09-19T21:38:14.919614] [DEBUG] [LOCAL ] THW: Primary data saved (19372 records). [2025-09-19T21:38:14.919818] [INFO ] [MAIN ] THW: Full history saved. [2025-09-19T21:38:14.919936] [INFO ] [MAIN ] Update Progress: 2092/2372 symbols completed. THW took 24.1s. Estimated remaining: 37m 14s. Rate: 7.5 symbols/min [2025-09-19T21:38:15.048419] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-19T21:38:15.096486] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:38:15.102516] [DEBUG] [LOCAL ] TISI: Loaded 3886 existing records from primary storage. [2025-09-19T21:38:15.102612] [INFO ] [MAIN ] TISI: Loaded 3886 existing records. [2025-09-19T21:38:15.291385] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:38:15.291815] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-19T21:38:15.291931] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-19T21:38:15.292288] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-19T21:38:15.292402] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-19T21:38:15.497124] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T21:38:15.696318] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:38:15.843288] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-19T21:38:16.643231] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-19T21:38:16.760512] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T21:38:17.443291] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-19T21:38:17.626746] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-19T21:38:17.666350] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T21:38:18.243298] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-19T21:38:19.029968] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-19T21:38:19.043207] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-19T21:38:19.264814] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T21:38:19.843238] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-19T21:38:19.872433] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T21:38:20.643262] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-19T21:38:21.386244] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-19T21:38:21.443234] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-19T21:38:21.738042] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T21:38:22.243273] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-19T21:38:22.325660] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-19T21:38:23.043276] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-19T21:38:23.843286] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-19T21:38:24.175996] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-19T21:38:24.238695] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-19T21:38:24.463877] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T21:38:24.643275] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-19T21:38:25.443265] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-19T21:38:25.465811] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T21:38:26.243272] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-19T21:38:26.771754] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-19T21:38:27.043316] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-19T21:38:27.153430] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-19T21:38:27.843273] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-19T21:38:28.418130] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T21:38:28.425111] [INFO ] [REMOTE ] TIC: Full fetch complete (37154 records). [2025-09-19T21:38:28.425225] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-19T21:38:28.613826] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 147 unique days, need 200 days [2025-09-19T21:38:28.614328] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:38:28.614402] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:38:28.614477] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-19T21:38:28.614548] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-19T21:38:28.614585] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-19T21:38:28.614628] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-19T21:38:28.614727] [INFO ] [MAIN ] Update Progress: 2093/2372 symbols completed. TIC took 31.3s. Estimated remaining: 37m 7s. Rate: 7.5 symbols/min [2025-09-19T21:38:28.648401] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-19T21:38:28.803364] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:38:28.835155] [DEBUG] [LOCAL ] TIXT: Loaded 31399 existing records from primary storage. [2025-09-19T21:38:28.835292] [INFO ] [MAIN ] TIXT: Loaded 31399 existing records. [2025-09-19T21:38:29.020999] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:38:29.021416] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-19T21:38:29.021528] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-19T21:38:29.028376] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-19T21:38:29.039906] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-19T21:38:29.072583] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T21:38:29.142479] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-19T21:38:29.410012] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:38:29.443226] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-19T21:38:30.243319] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-19T21:38:30.717469] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-19T21:38:30.718442] [INFO ] [REMOTE ] TISI: Full fetch complete (5078 records). [2025-09-19T21:38:30.718512] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-19T21:38:31.061128] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-19T21:38:31.086763] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-19T21:38:31.086894] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-19T21:38:31.087061] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-19T21:38:31.087230] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-19T21:38:31.104290] [DEBUG] [LOCAL ] TISI: Trimmed 5078 records to 3916 (keeping 200 days of data) [2025-09-19T21:38:31.105265] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T21:38:31.136143] [DEBUG] [LOCAL ] TISI: Primary data saved (3916 records). [2025-09-19T21:38:31.136242] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-19T21:38:31.136323] [INFO ] [MAIN ] Update Progress: 2094/2372 symbols completed. TISI took 16.2s. Estimated remaining: 36m 58s. Rate: 7.5 symbols/min [2025-09-19T21:38:31.301710] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:38:31.362256] [DEBUG] [LOCAL ] TJX: Loaded 54066 existing records from primary storage. [2025-09-19T21:38:31.362433] [INFO ] [MAIN ] TJX: Loaded 54066 existing records. [2025-09-19T21:38:31.542819] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:38:31.543084] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-19T21:38:31.543132] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-19T21:38:31.544850] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-19T21:38:31.544911] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-19T21:38:31.848536] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-19T21:38:31.910448] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:38:32.643300] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-19T21:38:32.768057] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T21:38:33.413056] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T21:38:33.443211] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-19T21:38:33.845502] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T21:38:34.243284] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-19T21:38:34.280980] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-19T21:38:35.043279] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-19T21:38:35.819788] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T21:38:35.825893] [INFO ] [REMOTE ] THS: Full fetch complete (53441 records). [2025-09-19T21:38:35.825994] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-19T21:38:35.848495] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-19T21:38:36.237042] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-19T21:38:36.237119] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-19T21:38:36.238016] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-19T21:38:36.238077] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-19T21:38:36.239263] [DEBUG] [LOCAL ] THS: Trimmed 53441 records to 38516 (keeping 200 days of data) [2025-09-19T21:38:36.462969] [DEBUG] [LOCAL ] THS: Primary data saved (38516 records). [2025-09-19T21:38:36.463108] [INFO ] [MAIN ] THS: Full history saved. [2025-09-19T21:38:36.463192] [INFO ] [MAIN ] Update Progress: 2095/2372 symbols completed. THS took 54.9s. Estimated remaining: 36m 50s. Rate: 7.5 symbols/min [2025-09-19T21:38:36.638920] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:38:36.643220] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-19T21:38:36.670907] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T21:38:36.707032] [DEBUG] [LOCAL ] TK: Loaded 40271 existing records from primary storage. [2025-09-19T21:38:36.707189] [INFO ] [MAIN ] TK: Loaded 40271 existing records. [2025-09-19T21:38:36.883969] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:38:36.884311] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-19T21:38:36.884379] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-19T21:38:36.885294] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-19T21:38:36.885354] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-19T21:38:37.237801] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:38:37.254999] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-19T21:38:37.443259] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-19T21:38:38.243252] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-19T21:38:38.710712] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-19T21:38:38.745848] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-19T21:38:39.043261] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-19T21:38:39.843273] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-19T21:38:39.935733] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-19T21:38:40.643275] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-19T21:38:41.135171] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T21:38:41.448631] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-19T21:38:41.457831] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T21:38:41.920028] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T21:38:42.243297] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-19T21:38:43.043274] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-19T21:38:43.139057] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T21:38:43.289850] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-19T21:38:43.294870] [INFO ] [REMOTE ] TIMB: Full fetch complete (55265 records). [2025-09-19T21:38:43.294993] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-19T21:38:43.680835] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-19T21:38:43.680926] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-19T21:38:43.681853] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-19T21:38:43.681917] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-19T21:38:43.683136] [DEBUG] [LOCAL ] TIMB: Trimmed 55265 records to 37541 (keeping 200 days of data) [2025-09-19T21:38:43.858984] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-19T21:38:43.922698] [DEBUG] [LOCAL ] TIMB: Primary data saved (37541 records). [2025-09-19T21:38:43.922847] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-19T21:38:43.922943] [INFO ] [MAIN ] Update Progress: 2096/2372 symbols completed. TIMB took 36.4s. Estimated remaining: 36m 42s. Rate: 7.5 symbols/min [2025-09-19T21:38:44.093185] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:38:44.128930] [DEBUG] [LOCAL ] TKC: Loaded 38120 existing records from primary storage. [2025-09-19T21:38:44.129070] [INFO ] [MAIN ] TKC: Loaded 38120 existing records. [2025-09-19T21:38:44.306096] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:38:44.306385] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-19T21:38:44.306433] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-19T21:38:44.307329] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-19T21:38:44.307392] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-19T21:38:44.656171] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-19T21:38:44.661479] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:38:44.683427] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T21:38:45.443314] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-19T21:38:46.014435] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-19T21:38:46.243325] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-19T21:38:46.452032] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T21:38:46.900521] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-19T21:38:47.043266] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-19T21:38:47.843332] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-19T21:38:48.554432] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-19T21:38:48.584635] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T21:38:48.643254] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-19T21:38:49.443307] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-19T21:38:49.588869] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T21:38:50.243278] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-19T21:38:51.032493] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-19T21:38:51.043365] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-19T21:38:51.076583] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T21:38:51.425843] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T21:38:51.843319] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-19T21:38:52.643278] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-19T21:38:52.726099] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T21:38:53.443332] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-19T21:38:54.039804] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-19T21:38:54.243296] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-19T21:38:54.351293] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T21:38:55.043355] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-19T21:38:55.267416] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T21:38:55.843290] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-19T21:38:56.330503] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T21:38:56.508187] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-19T21:38:56.643224] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-19T21:38:57.443298] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-19T21:38:57.596552] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T21:38:58.243247] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-19T21:38:58.481501] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-19T21:38:59.043320] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-19T21:38:59.086508] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T21:38:59.843277] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-19T21:39:00.282831] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T21:39:00.617238] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T21:39:00.643233] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-19T21:39:01.443296] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-19T21:39:01.516073] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T21:39:01.525049] [INFO ] [REMOTE ] TJX: Full fetch complete (77681 records). [2025-09-19T21:39:01.525289] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-19T21:39:01.974163] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-19T21:39:01.982474] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-19T21:39:01.989010] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-19T21:39:01.999940] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-19T21:39:02.002542] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T21:39:02.014695] [DEBUG] [LOCAL ] TJX: Trimmed 77681 records to 54453 (keeping 200 days of data) [2025-09-19T21:39:02.243411] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-19T21:39:02.376374] [DEBUG] [LOCAL ] TJX: Primary data saved (54453 records). [2025-09-19T21:39:02.376554] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-19T21:39:02.376670] [INFO ] [MAIN ] Update Progress: 2097/2372 symbols completed. TJX took 31.2s. Estimated remaining: 36m 35s. Rate: 7.5 symbols/min [2025-09-19T21:39:02.569538] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:39:02.615138] [DEBUG] [LOCAL ] TKO: Loaded 44746 existing records from primary storage. [2025-09-19T21:39:02.615292] [INFO ] [MAIN ] TKO: Loaded 44746 existing records. [2025-09-19T21:39:02.801062] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:39:02.801439] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-19T21:39:02.801503] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-19T21:39:02.802706] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-19T21:39:02.802770] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-19T21:39:03.051333] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-19T21:39:03.180077] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:39:03.843282] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-19T21:39:05.212030] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (3.77 seconds). [2025-09-19T21:39:05.220062] [INFO ] [REMOTE ] TIXT: Full fetch complete (45401 records). [2025-09-19T21:39:05.220187] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-19T21:39:05.626256] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-19T21:39:05.634398] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-19T21:39:05.649350] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-19T21:39:05.649487] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-19T21:39:05.651515] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-19T21:39:05.660980] [DEBUG] [LOCAL ] TIXT: Trimmed 45401 records to 31649 (keeping 200 days of data) [2025-09-19T21:39:05.662109] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-19T21:39:05.800593] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-19T21:39:05.810769] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-19T21:39:05.888955] [DEBUG] [LOCAL ] TIXT: Primary data saved (31649 records). [2025-09-19T21:39:05.889184] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-19T21:39:05.889357] [INFO ] [MAIN ] Update Progress: 2098/2372 symbols completed. TIXT took 37.3s. Estimated remaining: 36m 26s. Rate: 7.5 symbols/min [2025-09-19T21:39:06.035838] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (3.79 seconds). [2025-09-19T21:39:06.100836] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:39:06.140026] [DEBUG] [LOCAL ] TKR: Loaded 40482 existing records from primary storage. [2025-09-19T21:39:06.140186] [INFO ] [MAIN ] TKR: Loaded 40482 existing records. [2025-09-19T21:39:06.248381] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-19T21:39:06.324165] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:39:06.324485] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-19T21:39:06.324537] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-19T21:39:06.325422] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-19T21:39:06.325483] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-19T21:39:06.688772] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:39:07.043329] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-19T21:39:07.379862] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T21:39:07.650328] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T21:39:07.792420] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T21:39:07.798146] [INFO ] [REMOTE ] TK: Full fetch complete (57303 records). [2025-09-19T21:39:07.798283] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-19T21:39:07.853627] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-19T21:39:08.211272] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-19T21:39:08.211397] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-19T21:39:08.212471] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-19T21:39:08.212589] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-19T21:39:08.232406] [DEBUG] [LOCAL ] TK: Trimmed 57303 records to 40472 (keeping 200 days of data) [2025-09-19T21:39:08.234710] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T21:39:08.488774] [DEBUG] [LOCAL ] TK: Primary data saved (40472 records). [2025-09-19T21:39:08.488931] [INFO ] [MAIN ] TK: Full history saved. [2025-09-19T21:39:08.489033] [INFO ] [MAIN ] Update Progress: 2099/2372 symbols completed. TK took 32.0s. Estimated remaining: 36m 18s. Rate: 7.5 symbols/min [2025-09-19T21:39:08.650718] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-19T21:39:08.672306] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:39:08.712539] [DEBUG] [LOCAL ] TLK: Loaded 40251 existing records from primary storage. [2025-09-19T21:39:08.712746] [INFO ] [MAIN ] TLK: Loaded 40251 existing records. [2025-09-19T21:39:08.900382] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:39:08.900846] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-19T21:39:08.900904] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-19T21:39:08.902002] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-19T21:39:08.902104] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-19T21:39:09.281703] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:39:09.443290] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-19T21:39:09.852163] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-19T21:39:10.246975] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-19T21:39:10.252429] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-19T21:39:10.965627] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T21:39:11.043291] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-19T21:39:11.464261] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T21:39:11.843291] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-19T21:39:12.643290] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-19T21:39:12.741569] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T21:39:12.748258] [INFO ] [REMOTE ] TKC: Full fetch complete (51055 records). [2025-09-19T21:39:12.748398] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-19T21:39:13.146140] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-19T21:39:13.146261] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-19T21:39:13.147365] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-19T21:39:13.147452] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-19T21:39:13.148712] [DEBUG] [LOCAL ] TKC: Trimmed 51055 records to 38470 (keeping 200 days of data) [2025-09-19T21:39:13.399186] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T21:39:13.433121] [DEBUG] [LOCAL ] TKC: Primary data saved (38470 records). [2025-09-19T21:39:13.433295] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-19T21:39:13.433411] [INFO ] [MAIN ] Update Progress: 2100/2372 symbols completed. TKC took 29.5s. Estimated remaining: 36m 9s. Rate: 7.5 symbols/min [2025-09-19T21:39:13.448325] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-19T21:39:13.608961] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:39:13.626753] [DEBUG] [LOCAL ] TLYS: Loaded 17081 existing records from primary storage. [2025-09-19T21:39:13.626887] [INFO ] [MAIN ] TLYS: Loaded 17081 existing records. [2025-09-19T21:39:13.803159] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:39:13.803462] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-19T21:39:13.803513] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-19T21:39:13.804058] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-19T21:39:13.804119] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-19T21:39:14.156596] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:39:14.243279] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-19T21:39:15.043343] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-19T21:39:15.358146] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-19T21:39:15.843219] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-19T21:39:16.275715] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T21:39:16.318548] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T21:39:16.612577] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (3.16 seconds). [2025-09-19T21:39:16.643213] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-19T21:39:17.448490] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-19T21:39:17.464012] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-19T21:39:18.243356] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-19T21:39:18.386406] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T21:39:18.434736] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-19T21:39:19.043353] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-19T21:39:19.629136] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T21:39:19.843271] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-19T21:39:20.105358] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T21:39:20.344125] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-19T21:39:20.643284] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-19T21:39:21.443270] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-19T21:39:22.243292] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-19T21:39:22.552469] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T21:39:22.578974] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T21:39:23.043272] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-19T21:39:23.843272] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-19T21:39:24.281119] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T21:39:24.419639] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T21:39:24.643267] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-19T21:39:25.323406] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T21:39:25.443263] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-19T21:39:26.165223] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T21:39:26.243283] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-19T21:39:27.043319] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-19T21:39:27.071921] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-19T21:39:27.216525] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T21:39:27.843274] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-19T21:39:28.319552] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T21:39:28.643301] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-19T21:39:29.082893] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T21:39:29.443280] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-19T21:39:29.612312] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T21:39:30.243277] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-19T21:39:30.962230] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-19T21:39:31.043234] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-19T21:39:31.843289] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-19T21:39:31.873208] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T21:39:32.319483] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T21:39:32.643270] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-19T21:39:33.443262] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-19T21:39:33.599759] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T21:39:33.606813] [INFO ] [REMOTE ] TKO: Full fetch complete (64587 records). [2025-09-19T21:39:33.606945] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-19T21:39:34.010005] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-19T21:39:34.010115] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-19T21:39:34.011560] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-19T21:39:34.011637] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-19T21:39:34.015184] [DEBUG] [LOCAL ] TKO: Trimmed 64587 records to 45040 (keeping 200 days of data) [2025-09-19T21:39:34.243381] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-19T21:39:34.302760] [DEBUG] [LOCAL ] TKO: Primary data saved (45040 records). [2025-09-19T21:39:34.302889] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-19T21:39:34.303024] [INFO ] [MAIN ] Update Progress: 2101/2372 symbols completed. TKO took 31.9s. Estimated remaining: 36m 3s. Rate: 7.5 symbols/min [2025-09-19T21:39:34.519250] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:39:34.537617] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-19T21:39:34.544753] [INFO ] [REMOTE ] TKR: Full fetch complete (57329 records). [2025-09-19T21:39:34.544885] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-19T21:39:34.886609] [DEBUG] [LOCAL ] TM: Loaded 37307 existing records from primary storage. [2025-09-19T21:39:34.892520] [INFO ] [MAIN ] TM: Loaded 37307 existing records. [2025-09-19T21:39:35.110728] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-19T21:39:35.115989] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-19T21:39:35.134132] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-19T21:39:35.154970] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-19T21:39:35.179182] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:39:35.181127] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-19T21:39:35.181545] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-19T21:39:35.190472] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-19T21:39:35.190847] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-19T21:39:35.190772] [DEBUG] [LOCAL ] TKR: Trimmed 57329 records to 40746 (keeping 200 days of data) [2025-09-19T21:39:35.240025] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-19T21:39:35.277067] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-19T21:39:35.556264] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T21:39:35.714079] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:39:35.843254] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-19T21:39:35.872772] [DEBUG] [LOCAL ] TKR: Primary data saved (40746 records). [2025-09-19T21:39:35.872927] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-19T21:39:35.873030] [INFO ] [MAIN ] Update Progress: 2102/2372 symbols completed. TKR took 30.0s. Estimated remaining: 35m 54s. Rate: 7.5 symbols/min [2025-09-19T21:39:36.049191] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:39:36.123720] [DEBUG] [LOCAL ] TME: Loaded 53590 existing records from primary storage. [2025-09-19T21:39:36.124105] [INFO ] [MAIN ] TME: Loaded 53590 existing records. [2025-09-19T21:39:36.306945] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:39:36.307279] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-19T21:39:36.307356] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-19T21:39:36.308585] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-19T21:39:36.308682] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-19T21:39:36.482821] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-19T21:39:36.512091] [INFO ] [REMOTE ] TLYS: Full fetch complete (21973 records). [2025-09-19T21:39:36.550845] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-19T21:39:36.667677] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-19T21:39:36.808636] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:39:37.116683] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-19T21:39:37.116808] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-19T21:39:37.117575] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-19T21:39:37.117694] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-19T21:39:37.118533] [DEBUG] [LOCAL ] TLYS: Trimmed 21973 records to 17139 (keeping 200 days of data) [2025-09-19T21:39:37.249024] [DEBUG] [LOCAL ] TLYS: Primary data saved (17139 records). [2025-09-19T21:39:37.249183] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-19T21:39:37.249366] [INFO ] [MAIN ] Update Progress: 2103/2372 symbols completed. TLYS took 23.8s. Estimated remaining: 35m 45s. Rate: 7.5 symbols/min [2025-09-19T21:39:37.423237] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:39:37.443379] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-19T21:39:37.476452] [DEBUG] [LOCAL ] TMHC: Loaded 45970 existing records from primary storage. [2025-09-19T21:39:37.476581] [INFO ] [MAIN ] TMHC: Loaded 45970 existing records. [2025-09-19T21:39:37.658392] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:39:37.658775] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-19T21:39:37.658833] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-19T21:39:37.660078] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-19T21:39:37.660149] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-19T21:39:38.064780] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T21:39:38.063280] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:39:38.105068] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T21:39:38.243282] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-19T21:39:39.043327] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-19T21:39:39.271244] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T21:39:39.843276] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-19T21:39:40.031145] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T21:39:40.348436] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T21:39:40.643317] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-19T21:39:41.443231] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-19T21:39:42.176448] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-19T21:39:42.243217] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-19T21:39:42.327706] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T21:39:43.043267] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-19T21:39:43.307858] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T21:39:43.670474] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T21:39:43.843253] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-19T21:39:44.620838] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T21:39:44.626808] [INFO ] [REMOTE ] TLK: Full fetch complete (57590 records). [2025-09-19T21:39:44.626928] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-19T21:39:44.648405] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-19T21:39:45.008951] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-19T21:39:45.009034] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-19T21:39:45.009988] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-19T21:39:45.010052] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-19T21:39:45.011409] [DEBUG] [LOCAL ] TLK: Trimmed 57590 records to 40539 (keeping 200 days of data) [2025-09-19T21:39:45.272447] [DEBUG] [LOCAL ] TLK: Primary data saved (40539 records). [2025-09-19T21:39:45.272723] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-19T21:39:45.272849] [INFO ] [MAIN ] Update Progress: 2104/2372 symbols completed. TLK took 36.8s. Estimated remaining: 35m 38s. Rate: 7.5 symbols/min [2025-09-19T21:39:45.441556] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:39:45.443255] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-19T21:39:45.506033] [DEBUG] [LOCAL ] TMO: Loaded 52722 existing records from primary storage. [2025-09-19T21:39:45.506189] [INFO ] [MAIN ] TMO: Loaded 52722 existing records. [2025-09-19T21:39:45.684717] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:39:45.684994] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-19T21:39:45.685042] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-19T21:39:45.686469] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-19T21:39:45.686531] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-19T21:39:46.061547] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:39:46.102086] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T21:39:46.149283] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T21:39:46.243279] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-19T21:39:46.656481] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T21:39:47.043311] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-19T21:39:47.843345] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-19T21:39:48.298850] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-19T21:39:48.402161] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T21:39:48.643312] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-19T21:39:49.368569] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T21:39:49.443361] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-19T21:39:50.243283] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-19T21:39:50.791989] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T21:39:51.043304] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-19T21:39:51.360276] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T21:39:51.843336] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-19T21:39:52.106989] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T21:39:52.643285] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-19T21:39:53.139046] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T21:39:53.301051] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T21:39:53.443290] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-19T21:39:54.243380] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-19T21:39:54.632780] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T21:39:55.043316] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-19T21:39:55.336157] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T21:39:55.782520] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T21:39:55.843224] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-19T21:39:56.643297] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-19T21:39:57.056254] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T21:39:57.443251] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-19T21:39:57.478663] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-19T21:39:58.243323] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-19T21:39:58.460050] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T21:39:59.043278] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-19T21:39:59.174207] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-19T21:39:59.819580] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-19T21:39:59.843221] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-19T21:40:00.643282] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-19T21:40:00.875071] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T21:40:01.443254] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-19T21:40:01.855667] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-19T21:40:01.869890] [INFO ] [REMOTE ] TME: Full fetch complete (76919 records). [2025-09-19T21:40:01.870140] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-19T21:40:02.249263] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-19T21:40:02.318185] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-19T21:40:02.318542] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-19T21:40:02.319838] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-19T21:40:02.319903] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-19T21:40:02.322279] [DEBUG] [LOCAL ] TME: Trimmed 76919 records to 53980 (keeping 200 days of data) [2025-09-19T21:40:02.593123] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T21:40:02.695882] [DEBUG] [LOCAL ] TME: Primary data saved (53980 records). [2025-09-19T21:40:02.696046] [INFO ] [MAIN ] TME: Full history saved. [2025-09-19T21:40:02.697247] [INFO ] [MAIN ] Update Progress: 2105/2372 symbols completed. TME took 26.8s. Estimated remaining: 35m 31s. Rate: 7.5 symbols/min [2025-09-19T21:40:02.875960] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:02.897434] [DEBUG] [LOCAL ] TNC: Loaded 15629 existing records from primary storage. [2025-09-19T21:40:02.897630] [INFO ] [MAIN ] TNC: Loaded 15629 existing records. [2025-09-19T21:40:03.048372] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-19T21:40:03.090569] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:40:03.090890] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-19T21:40:03.090940] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-19T21:40:03.091609] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-19T21:40:03.091700] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-19T21:40:03.497855] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:40:03.527677] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T21:40:03.843322] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-19T21:40:04.550329] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-19T21:40:04.643347] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-19T21:40:05.025956] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T21:40:05.440335] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T21:40:05.445038] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-19T21:40:05.529217] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T21:40:06.243268] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-19T21:40:06.839705] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T21:40:07.043285] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-19T21:40:07.843289] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-19T21:40:08.115909] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-19T21:40:08.245377] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T21:40:08.643266] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-19T21:40:09.443262] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-19T21:40:09.964277] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-19T21:40:10.243242] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-19T21:40:10.271327] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T21:40:11.043273] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-19T21:40:11.308615] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T21:40:11.313223] [INFO ] [REMOTE ] TM: Full fetch complete (53288 records). [2025-09-19T21:40:11.313330] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-19T21:40:11.713168] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-19T21:40:11.713301] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-19T21:40:11.714421] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-19T21:40:11.714489] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-19T21:40:11.715873] [DEBUG] [LOCAL ] TM: Trimmed 53288 records to 37448 (keeping 200 days of data) [2025-09-19T21:40:11.845459] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-19T21:40:11.976982] [DEBUG] [LOCAL ] TM: Primary data saved (37448 records). [2025-09-19T21:40:11.977135] [INFO ] [MAIN ] TM: Full history saved. [2025-09-19T21:40:11.977304] [INFO ] [MAIN ] Update Progress: 2106/2372 symbols completed. TM took 37.7s. Estimated remaining: 35m 23s. Rate: 7.5 symbols/min [2025-09-19T21:40:12.160303] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:12.193837] [DEBUG] [LOCAL ] TNET: Loaded 29368 existing records from primary storage. [2025-09-19T21:40:12.194001] [INFO ] [MAIN ] TNET: Loaded 29368 existing records. [2025-09-19T21:40:12.372354] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:40:12.372841] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-19T21:40:12.372957] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-19T21:40:12.373732] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-19T21:40:12.373794] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-19T21:40:12.758815] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:40:12.759556] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-19T21:40:12.800537] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-19T21:40:12.823921] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T21:40:12.847961] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-19T21:40:12.855236] [INFO ] [REMOTE ] TMHC: Full fetch complete (65789 records). [2025-09-19T21:40:12.855402] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-19T21:40:13.242506] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-19T21:40:13.242622] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-19T21:40:13.243633] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-19T21:40:13.243730] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-19T21:40:13.245073] [DEBUG] [LOCAL ] TMHC: Trimmed 65789 records to 46324 (keeping 200 days of data) [2025-09-19T21:40:13.448301] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-19T21:40:13.528133] [DEBUG] [LOCAL ] TMHC: Primary data saved (46324 records). [2025-09-19T21:40:13.528280] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-19T21:40:13.528382] [INFO ] [MAIN ] Update Progress: 2107/2372 symbols completed. TMHC took 36.3s. Estimated remaining: 35m 14s. Rate: 7.5 symbols/min [2025-09-19T21:40:13.717492] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:13.717726] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-19T21:40:13.717783] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-19T21:40:13.718003] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-19T21:40:13.718070] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-19T21:40:13.718141] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-19T21:40:13.718178] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-19T21:40:14.095261] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:40:14.248393] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-19T21:40:14.259628] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T21:40:14.516844] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:40:14.517590] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-19T21:40:15.043318] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-19T21:40:15.594580] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T21:40:15.773188] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T21:40:15.843283] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-19T21:40:16.368092] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:40:16.368441] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-19T21:40:16.643275] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-19T21:40:17.443256] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-19T21:40:17.544741] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T21:40:17.552619] [INFO ] [REMOTE ] TMO: Full fetch complete (75472 records). [2025-09-19T21:40:17.552869] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-19T21:40:17.968075] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-19T21:40:17.968204] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-19T21:40:17.969410] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-19T21:40:17.969485] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-19T21:40:17.971178] [DEBUG] [LOCAL ] TMO: Trimmed 75472 records to 53102 (keeping 200 days of data) [2025-09-19T21:40:18.259612] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-19T21:40:18.313424] [DEBUG] [LOCAL ] TMO: Primary data saved (53102 records). [2025-09-19T21:40:18.313621] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-19T21:40:18.313766] [INFO ] [MAIN ] Update Progress: 2108/2372 symbols completed. TMO took 33.0s. Estimated remaining: 35m 6s. Rate: 7.5 symbols/min [2025-09-19T21:40:18.494414] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:18.510120] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T21:40:18.550010] [DEBUG] [LOCAL ] TNK: Loaded 35731 existing records from primary storage. [2025-09-19T21:40:18.550162] [INFO ] [MAIN ] TNK: Loaded 35731 existing records. [2025-09-19T21:40:18.731686] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:40:18.732023] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-19T21:40:18.732080] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-19T21:40:18.732925] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-19T21:40:18.732985] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-19T21:40:19.048431] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-19T21:40:19.086251] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:40:19.448316] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T21:40:19.538886] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:40:19.539231] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-19T21:40:19.843289] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-19T21:40:20.643329] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-19T21:40:21.408606] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-19T21:40:21.443219] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-19T21:40:22.243267] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-19T21:40:22.476134] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-19T21:40:22.955596] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T21:40:23.036222] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-19T21:40:23.043203] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-19T21:40:23.843266] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-19T21:40:24.083193] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T21:40:24.643261] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-19T21:40:25.451733] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-19T21:40:25.458057] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T21:40:25.692525] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:40:25.692889] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-19T21:40:25.714635] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-19T21:40:26.243277] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-19T21:40:26.492306] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:40:26.492633] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-19T21:40:27.043287] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-19T21:40:27.182358] [DEBUG] [REMOTE ] TNC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-19T21:40:27.182794] [WARN ] [REMOTE ] TNC: No data returned for month 2025-09 [2025-09-19T21:40:27.182934] [INFO ] [REMOTE ] TNC: Full fetch complete (21971 records). [2025-09-19T21:40:27.183025] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-19T21:40:27.183934] [FATAL] [VALIDATOR ] TNC: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-19). Symbol may be delisted or halted. [2025-09-19T21:40:27.184046] [FATAL] [MAIN ] TNC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:40:27.184116] [WARN ] [MAIN ] TNC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:40:27.184164] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-19T21:40:27.184232] [DEBUG] [LOCAL ] TNC: No primary data file found to delete. [2025-09-19T21:40:27.184302] [INFO ] [LOCAL ] TNC: Starting deletion of derivative data. [2025-09-19T21:40:27.184809] [DEBUG] [LOCAL ] TNC: Deleted derivative data file. [2025-09-19T21:40:27.184918] [INFO ] [MAIN ] Update Progress: 2109/2372 symbols completed. TNC took 24.5s. Estimated remaining: 34m 58s. Rate: 7.5 symbols/min [2025-09-19T21:40:27.368345] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:27.421216] [DEBUG] [LOCAL ] TNL: Loaded 42273 existing records from primary storage. [2025-09-19T21:40:27.421376] [INFO ] [MAIN ] TNL: Loaded 42273 existing records. [2025-09-19T21:40:27.612734] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:40:27.612987] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-19T21:40:27.613037] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-19T21:40:27.614083] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-19T21:40:27.614169] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-19T21:40:27.851069] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-19T21:40:27.982122] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:40:28.643293] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-19T21:40:29.443279] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-19T21:40:29.602825] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T21:40:29.713942] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T21:40:29.891896] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:40:29.892238] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-19T21:40:30.243264] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-19T21:40:31.043281] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-19T21:40:31.820110] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T21:40:31.843215] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-19T21:40:32.091264] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-19T21:40:32.643274] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-19T21:40:33.028606] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T21:40:33.443265] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-19T21:40:33.577187] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T21:40:34.243267] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-19T21:40:35.041258] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-19T21:40:35.043333] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-19T21:40:35.131987] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T21:40:35.843276] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-19T21:40:35.898584] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T21:40:36.643273] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-19T21:40:37.443288] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-19T21:40:37.729521] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T21:40:37.842797] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T21:40:38.196923] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-19T21:40:38.198780] [INFO ] [REMOTE ] TNGY: Full fetch complete (3109 records). [2025-09-19T21:40:38.198854] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-19T21:40:38.248398] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-19T21:40:38.397450] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-19T21:40:38.397730] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:40:38.397800] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:40:38.397879] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-19T21:40:38.397957] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-19T21:40:38.397994] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-19T21:40:38.398032] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-19T21:40:38.398134] [INFO ] [MAIN ] Update Progress: 2110/2372 symbols completed. TNGY took 24.9s. Estimated remaining: 34m 50s. Rate: 7.5 symbols/min [2025-09-19T21:40:38.610917] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:38.674105] [DEBUG] [LOCAL ] TOL: Loaded 51509 existing records from primary storage. [2025-09-19T21:40:38.674277] [INFO ] [MAIN ] TOL: Loaded 51509 existing records. [2025-09-19T21:40:38.852612] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:40:38.852874] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-19T21:40:38.852924] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-19T21:40:38.855167] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-19T21:40:38.855232] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-19T21:40:39.049723] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-19T21:40:39.227667] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:40:39.362981] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T21:40:39.843282] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-19T21:40:40.643263] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-19T21:40:40.926086] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T21:40:41.443345] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-19T21:40:41.910992] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-19T21:40:42.243308] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-19T21:40:42.274612] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-19T21:40:42.413223] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T21:40:43.043285] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-19T21:40:43.614305] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T21:40:43.843272] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-19T21:40:44.643268] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-19T21:40:44.789067] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T21:40:45.443258] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-19T21:40:45.568782] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T21:40:46.243296] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-19T21:40:46.291321] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-19T21:40:47.043324] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-19T21:40:47.290228] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T21:40:47.762401] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T21:40:47.766913] [INFO ] [REMOTE ] TNET: Full fetch complete (41683 records). [2025-09-19T21:40:47.767051] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-19T21:40:47.848349] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-19T21:40:48.171604] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-19T21:40:48.171724] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-19T21:40:48.172541] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-19T21:40:48.172586] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-19T21:40:48.173635] [DEBUG] [LOCAL ] TNET: Trimmed 41683 records to 29575 (keeping 200 days of data) [2025-09-19T21:40:48.362097] [DEBUG] [LOCAL ] TNET: Primary data saved (29575 records). [2025-09-19T21:40:48.362245] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-19T21:40:48.362332] [INFO ] [MAIN ] Update Progress: 2111/2372 symbols completed. TNET took 36.4s. Estimated remaining: 34m 43s. Rate: 7.5 symbols/min [2025-09-19T21:40:48.556010] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:48.616636] [DEBUG] [LOCAL ] TOST: Loaded 54071 existing records from primary storage. [2025-09-19T21:40:48.616812] [INFO ] [MAIN ] TOST: Loaded 54071 existing records. [2025-09-19T21:40:48.649580] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-19T21:40:48.803115] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:40:48.803600] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-19T21:40:48.803709] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-19T21:40:48.805123] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-19T21:40:48.805188] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-19T21:40:49.125075] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T21:40:49.226992] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:40:49.443260] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-19T21:40:49.546414] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T21:40:50.243269] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-19T21:40:50.433929] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T21:40:51.043300] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-19T21:40:51.615171] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-19T21:40:51.843314] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-19T21:40:52.093600] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T21:40:52.643304] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-19T21:40:53.196999] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T21:40:53.443253] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-19T21:40:53.622676] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T21:40:54.144482] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-19T21:40:54.243296] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-19T21:40:55.043274] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-19T21:40:55.403019] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T21:40:55.843317] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-19T21:40:55.988866] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T21:40:56.078059] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T21:40:56.083469] [INFO ] [REMOTE ] TNK: Full fetch complete (51981 records). [2025-09-19T21:40:56.083574] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-19T21:40:56.476093] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-19T21:40:56.476193] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-19T21:40:56.477118] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-19T21:40:56.477183] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-19T21:40:56.478525] [DEBUG] [LOCAL ] TNK: Trimmed 51981 records to 35945 (keeping 200 days of data) [2025-09-19T21:40:56.644344] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-19T21:40:56.704773] [DEBUG] [LOCAL ] TNK: Primary data saved (35945 records). [2025-09-19T21:40:56.704946] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-19T21:40:56.705051] [INFO ] [MAIN ] Update Progress: 2112/2372 symbols completed. TNK took 38.4s. Estimated remaining: 34m 35s. Rate: 7.5 symbols/min [2025-09-19T21:40:56.888511] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:56.914575] [DEBUG] [LOCAL ] TPB: Loaded 25169 existing records from primary storage. [2025-09-19T21:40:56.914758] [INFO ] [MAIN ] TPB: Loaded 25169 existing records. [2025-09-19T21:40:57.104767] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:40:57.105048] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-19T21:40:57.105098] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-19T21:40:57.105766] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-19T21:40:57.105829] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-19T21:40:57.448579] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-19T21:40:57.513345] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:40:57.913327] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T21:40:58.243548] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-19T21:40:58.854675] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-19T21:40:58.943039] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T21:40:58.949501] [INFO ] [REMOTE ] TNL: Full fetch complete (58697 records). [2025-09-19T21:40:58.949712] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-19T21:40:59.048379] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-19T21:40:59.354581] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-19T21:40:59.354708] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-19T21:40:59.355782] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-19T21:40:59.355847] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-19T21:40:59.357116] [DEBUG] [LOCAL ] TNL: Trimmed 58697 records to 42508 (keeping 200 days of data) [2025-09-19T21:40:59.629899] [DEBUG] [LOCAL ] TNL: Primary data saved (42508 records). [2025-09-19T21:40:59.630043] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-19T21:40:59.630531] [INFO ] [MAIN ] Update Progress: 2113/2372 symbols completed. TNL took 32.4s. Estimated remaining: 34m 26s. Rate: 7.5 symbols/min [2025-09-19T21:40:59.838806] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:40:59.842023] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T21:40:59.851753] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-19T21:40:59.892412] [DEBUG] [LOCAL ] TPC: Loaded 39263 existing records from primary storage. [2025-09-19T21:40:59.892593] [INFO ] [MAIN ] TPC: Loaded 39263 existing records. [2025-09-19T21:41:00.086076] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:41:00.086372] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-19T21:41:00.086428] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-19T21:41:00.087250] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-19T21:41:00.087312] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-19T21:41:00.466408] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:41:00.643268] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-19T21:41:01.337263] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-19T21:41:01.362067] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T21:41:01.443308] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-19T21:41:02.175062] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T21:41:02.243302] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-19T21:41:02.991802] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T21:41:03.043294] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-19T21:41:03.843290] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-19T21:41:04.111875] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T21:41:04.643298] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-19T21:41:05.107620] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T21:41:05.211385] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T21:41:05.443252] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-19T21:41:06.243303] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-19T21:41:06.533557] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:41:07.007236] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T21:41:07.043309] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-19T21:41:07.557177] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T21:41:07.843274] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-19T21:41:08.643317] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-19T21:41:09.233166] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-19T21:41:09.241614] [INFO ] [REMOTE ] TOL: Full fetch complete (73888 records). [2025-09-19T21:41:09.241856] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-19T21:41:09.359175] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-19T21:41:09.445277] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-19T21:41:09.664425] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-19T21:41:09.664594] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-19T21:41:09.665737] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-19T21:41:09.665831] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-19T21:41:09.667736] [DEBUG] [LOCAL ] TOL: Trimmed 73888 records to 51876 (keeping 200 days of data) [2025-09-19T21:41:09.777533] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-19T21:41:10.023337] [DEBUG] [LOCAL ] TOL: Primary data saved (51876 records). [2025-09-19T21:41:10.023606] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-19T21:41:10.026103] [INFO ] [MAIN ] Update Progress: 2114/2372 symbols completed. TOL took 31.6s. Estimated remaining: 34m 18s. Rate: 7.5 symbols/min [2025-09-19T21:41:10.192928] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:41:10.239899] [DEBUG] [LOCAL ] TPH: Loaded 45657 existing records from primary storage. [2025-09-19T21:41:10.240041] [INFO ] [MAIN ] TPH: Loaded 45657 existing records. [2025-09-19T21:41:10.251385] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-19T21:41:10.418307] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:41:10.418611] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-19T21:41:10.418692] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-19T21:41:10.419577] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-19T21:41:10.419635] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-19T21:41:10.768360] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:41:11.043269] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-19T21:41:11.283675] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T21:41:11.530617] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T21:41:11.843268] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-19T21:41:12.643275] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-19T21:41:12.714467] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T21:41:13.443240] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-19T21:41:13.644973] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-19T21:41:13.984406] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T21:41:14.243327] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-19T21:41:14.612160] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T21:41:15.043271] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-19T21:41:15.843295] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-19T21:41:16.468689] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-19T21:41:16.642355] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T21:41:16.647970] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-19T21:41:16.679899] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-19T21:41:17.443278] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-19T21:41:18.243291] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-19T21:41:18.632271] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-19T21:41:18.640219] [INFO ] [REMOTE ] TOST: Full fetch complete (77698 records). [2025-09-19T21:41:18.640380] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-19T21:41:19.048070] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-19T21:41:19.048246] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-19T21:41:19.047841] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-19T21:41:19.049539] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-19T21:41:19.049842] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-19T21:41:19.052910] [DEBUG] [LOCAL ] TOST: Trimmed 77698 records to 54461 (keeping 200 days of data) [2025-09-19T21:41:19.188946] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T21:41:19.335091] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T21:41:19.450249] [DEBUG] [LOCAL ] TOST: Primary data saved (54461 records). [2025-09-19T21:41:19.450405] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-19T21:41:19.450511] [INFO ] [MAIN ] Update Progress: 2115/2372 symbols completed. TOST took 31.1s. Estimated remaining: 34m 11s. Rate: 7.5 symbols/min [2025-09-19T21:41:19.619517] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:41:19.633123] [DEBUG] [LOCAL ] TPL: Loaded 12528 existing records from primary storage. [2025-09-19T21:41:19.633250] [INFO ] [MAIN ] TPL: Loaded 12528 existing records. [2025-09-19T21:41:19.808071] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:41:19.808311] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-19T21:41:19.808361] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-19T21:41:19.808829] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-19T21:41:19.808917] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-19T21:41:19.850753] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-19T21:41:20.160100] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:41:20.562037] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-19T21:41:20.643272] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-19T21:41:21.443286] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-19T21:41:21.697876] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T21:41:22.243274] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-19T21:41:22.361302] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T21:41:23.043244] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-19T21:41:23.141081] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T21:41:23.751759] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-19T21:41:23.843266] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-19T21:41:24.332919] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T21:41:24.643282] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-19T21:41:24.939684] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T21:41:24.945833] [INFO ] [REMOTE ] TPC: Full fetch complete (54666 records). [2025-09-19T21:41:24.945993] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-19T21:41:25.325143] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-19T21:41:25.325230] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-19T21:41:25.326166] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-19T21:41:25.326230] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-19T21:41:25.327565] [DEBUG] [LOCAL ] TPC: Trimmed 54666 records to 39544 (keeping 200 days of data) [2025-09-19T21:41:25.443327] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-19T21:41:25.571684] [DEBUG] [LOCAL ] TPC: Primary data saved (39544 records). [2025-09-19T21:41:25.571846] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-19T21:41:25.573146] [INFO ] [MAIN ] Update Progress: 2116/2372 symbols completed. TPC took 25.9s. Estimated remaining: 34m 2s. Rate: 7.5 symbols/min [2025-09-19T21:41:25.746803] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:41:25.807195] [DEBUG] [LOCAL ] TPR: Loaded 53875 existing records from primary storage. [2025-09-19T21:41:25.807352] [INFO ] [MAIN ] TPR: Loaded 53875 existing records. [2025-09-19T21:41:26.007057] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:41:26.009608] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-19T21:41:26.009726] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-19T21:41:26.011199] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-19T21:41:26.011154] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T21:41:26.011342] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-19T21:41:26.248410] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-19T21:41:26.384737] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:41:26.593855] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T21:41:27.043271] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-19T21:41:27.843269] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-19T21:41:27.890168] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-19T21:41:27.894398] [INFO ] [REMOTE ] TPB: Full fetch complete (34623 records). [2025-09-19T21:41:27.894521] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-19T21:41:28.277354] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-19T21:41:28.277460] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-19T21:41:28.278269] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-19T21:41:28.278336] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-19T21:41:28.279567] [DEBUG] [LOCAL ] TPB: Trimmed 34623 records to 25347 (keeping 200 days of data) [2025-09-19T21:41:28.446604] [DEBUG] [LOCAL ] TPB: Primary data saved (25347 records). [2025-09-19T21:41:28.446805] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-19T21:41:28.446996] [INFO ] [MAIN ] Update Progress: 2117/2372 symbols completed. TPB took 31.7s. Estimated remaining: 33m 54s. Rate: 7.5 symbols/min [2025-09-19T21:41:28.643359] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-19T21:41:28.849169] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-19T21:41:28.924837] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T21:41:29.443269] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-19T21:41:30.243237] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-19T21:41:30.546802] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T21:41:30.753217] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-19T21:41:31.043277] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-19T21:41:31.669064] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T21:41:31.814884] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-19T21:41:31.843277] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-19T21:41:32.643268] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-19T21:41:32.886312] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T21:41:33.443350] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-19T21:41:34.243318] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-19T21:41:34.645359] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T21:41:35.043273] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-19T21:41:35.133164] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T21:41:35.533604] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T21:41:35.843282] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-19T21:41:36.643258] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-19T21:41:37.041150] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T21:41:37.152545] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T21:41:37.355722] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-19T21:41:37.443255] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-19T21:41:38.243295] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-19T21:41:39.043280] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-19T21:41:39.499952] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T21:41:39.686282] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-19T21:41:39.843276] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-19T21:41:39.960404] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T21:41:40.643270] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-19T21:41:40.859468] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T21:41:40.861600] [INFO ] [REMOTE ] TPL: Full fetch complete (18483 records). [2025-09-19T21:41:40.861709] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-19T21:41:41.250555] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-19T21:41:41.250703] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-19T21:41:41.251220] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-19T21:41:41.251313] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-19T21:41:41.251966] [DEBUG] [LOCAL ] TPL: Trimmed 18483 records to 12621 (keeping 200 days of data) [2025-09-19T21:41:41.343843] [DEBUG] [LOCAL ] TPL: Primary data saved (12621 records). [2025-09-19T21:41:41.344047] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-19T21:41:41.344201] [INFO ] [MAIN ] Update Progress: 2118/2372 symbols completed. TPL took 21.9s. Estimated remaining: 33m 46s. Rate: 7.5 symbols/min [2025-09-19T21:41:41.443332] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-19T21:41:42.446538] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T21:41:42.458434] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-19T21:41:43.526855] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T21:41:43.538078] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-19T21:41:44.134824] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T21:41:44.141225] [INFO ] [REMOTE ] TPH: Full fetch complete (64836 records). [2025-09-19T21:41:44.141340] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-19T21:41:44.539515] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-19T21:41:44.539598] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-19T21:41:44.540714] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-19T21:41:44.540779] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-19T21:41:44.543169] [DEBUG] [LOCAL ] TPH: Trimmed 64836 records to 45991 (keeping 200 days of data) [2025-09-19T21:41:44.839520] [DEBUG] [LOCAL ] TPH: Primary data saved (45991 records). [2025-09-19T21:41:44.839819] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-19T21:41:44.840165] [INFO ] [MAIN ] Update Progress: 2119/2372 symbols completed. TPH took 34.8s. Estimated remaining: 33m 38s. Rate: 7.5 symbols/min [2025-09-19T21:41:45.645202] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T21:41:45.658733] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-19T21:41:47.134987] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T21:41:47.146301] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-19T21:41:48.620105] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-19T21:41:48.632414] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-19T21:41:50.849720] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-19T21:41:50.864090] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-19T21:41:52.894423] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-19T21:41:52.903393] [INFO ] [REMOTE ] TPR: Full fetch complete (77446 records). [2025-09-19T21:41:52.903687] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-19T21:41:53.425926] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-19T21:41:53.426044] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-19T21:41:53.427810] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-19T21:41:53.427885] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-19T21:41:53.430109] [DEBUG] [LOCAL ] TPR: Trimmed 77446 records to 54265 (keeping 200 days of data) [2025-09-19T21:41:53.852702] [DEBUG] [LOCAL ] TPR: Primary data saved (54265 records). [2025-09-19T21:41:53.852960] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-19T21:41:53.853399] [INFO ] [MAIN ] Update Progress: 2120/2372 symbols completed. TPR took 28.3s. Estimated remaining: 33m 30s. Rate: 7.5 symbols/min [2025-09-19T21:41:54.530400] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:41:54.574969] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:41:54.660217] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:41:54.667311] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:41:54.690101] [DEBUG] [LOCAL ] TPYP: Loaded 8065 existing records from primary storage. [2025-09-19T21:41:54.690490] [INFO ] [MAIN ] TPYP: Loaded 8065 existing records. [2025-09-19T21:41:54.775824] [DEBUG] [LOCAL ] TPZ: Loaded 5323 existing records from primary storage. [2025-09-19T21:41:54.799414] [INFO ] [MAIN ] TPZ: Loaded 5323 existing records. [2025-09-19T21:41:54.837892] [DEBUG] [LOCAL ] TR: Loaded 18344 existing records from primary storage. [2025-09-19T21:41:54.924800] [INFO ] [MAIN ] TR: Loaded 18344 existing records. [2025-09-19T21:41:54.961596] [DEBUG] [LOCAL ] TPVG: Loaded 27300 existing records from primary storage. [2025-09-19T21:41:54.985120] [INFO ] [MAIN ] TPVG: Loaded 27300 existing records. [2025-09-19T21:41:55.142183] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:41:55.193515] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-19T21:41:55.225054] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-19T21:41:55.368173] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:41:55.378546] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-19T21:41:55.431573] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-19T21:41:55.414962] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-19T21:41:55.465535] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-19T21:41:55.569877] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:41:55.627332] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-19T21:41:55.653580] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-19T21:41:55.653703] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-19T21:41:55.653217] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-19T21:41:55.653406] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:41:55.659999] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-19T21:41:55.654719] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-19T21:41:55.672544] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-19T21:41:55.688889] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-19T21:41:55.713869] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-19T21:41:55.724304] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-19T21:41:57.033535] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:41:57.068067] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:41:57.089557] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-19T21:41:57.051574] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:41:57.112929] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-19T21:41:57.130295] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-19T21:41:57.138926] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:41:57.139366] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-19T21:41:58.050566] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-19T21:41:58.052925] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-19T21:41:58.127207] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-19T21:41:58.130510] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-19T21:41:58.200021] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T21:41:58.207924] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-19T21:41:58.248408] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T21:41:58.250585] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-19T21:41:58.563942] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T21:41:58.566842] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-19T21:41:58.856525] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T21:41:58.860215] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-19T21:41:59.372944] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T21:41:59.377490] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-19T21:41:59.439237] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T21:41:59.442757] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-19T21:41:59.490709] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T21:41:59.497019] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-19T21:41:59.975329] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-19T21:41:59.978915] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-19T21:41:59.996116] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-19T21:41:59.998729] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-19T21:42:00.332195] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-19T21:42:00.334783] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-19T21:42:00.582278] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T21:42:00.587784] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-19T21:42:00.595592] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-19T21:42:00.643281] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-19T21:42:00.966547] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T21:42:01.172754] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T21:42:01.443277] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-19T21:42:01.822938] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T21:42:02.243262] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-19T21:42:02.317485] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T21:42:03.043269] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-19T21:42:03.843312] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-19T21:42:04.037908] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T21:42:04.643263] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-19T21:42:04.780958] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (3.34 seconds). [2025-09-19T21:42:05.022126] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T21:42:05.443262] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-19T21:42:05.539193] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T21:42:05.604263] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T21:42:05.839249] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T21:42:06.243287] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-19T21:42:07.043306] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-19T21:42:07.152060] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-19T21:42:07.843280] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-19T21:42:08.339138] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T21:42:08.643266] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-19T21:42:08.732764] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T21:42:09.443267] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-19T21:42:09.710834] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-19T21:42:10.243233] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-19T21:42:10.866510] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T21:42:11.043302] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-19T21:42:11.516007] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-19T21:42:11.517969] [INFO ] [REMOTE ] TPYP: Full fetch complete (12532 records). [2025-09-19T21:42:11.518108] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-19T21:42:11.722584] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T21:42:11.848327] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-19T21:42:11.926008] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-19T21:42:11.926098] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-19T21:42:11.926381] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-19T21:42:11.926419] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-19T21:42:11.926971] [DEBUG] [LOCAL ] TPYP: Trimmed 12532 records to 8107 (keeping 200 days of data) [2025-09-19T21:42:11.976684] [DEBUG] [LOCAL ] TPYP: Primary data saved (8107 records). [2025-09-19T21:42:11.976803] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-19T21:42:11.976887] [INFO ] [MAIN ] Update Progress: 2121/2372 symbols completed. TPYP took 18.1s. Estimated remaining: 33m 23s. Rate: 7.5 symbols/min [2025-09-19T21:42:12.153699] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:42:12.165109] [DEBUG] [LOCAL ] TRAK: Loaded 9519 existing records from primary storage. [2025-09-19T21:42:12.165228] [INFO ] [MAIN ] TRAK: Loaded 9519 existing records. [2025-09-19T21:42:12.361723] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:42:12.362000] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-19T21:42:12.362050] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-19T21:42:12.362519] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-19T21:42:12.362582] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-19T21:42:12.648405] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-19T21:42:12.698158] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-19T21:42:12.782477] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:42:13.443269] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-19T21:42:14.243317] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-19T21:42:14.875452] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T21:42:15.043274] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-19T21:42:15.456639] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T21:42:15.597740] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-19T21:42:15.843271] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-19T21:42:16.392104] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T21:42:16.643259] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-19T21:42:17.161893] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T21:42:17.270776] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T21:42:17.272551] [INFO ] [REMOTE ] TPZ: Full fetch complete (9289 records). [2025-09-19T21:42:17.272685] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-19T21:42:17.445149] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-19T21:42:17.683163] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-19T21:42:17.683247] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-19T21:42:17.683495] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-19T21:42:17.683536] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-19T21:42:17.684279] [DEBUG] [LOCAL ] TPZ: Trimmed 9289 records to 5353 (keeping 200 days of data) [2025-09-19T21:42:17.722198] [DEBUG] [LOCAL ] TPZ: Primary data saved (5353 records). [2025-09-19T21:42:17.722363] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-19T21:42:17.722460] [INFO ] [MAIN ] Update Progress: 2122/2372 symbols completed. TPZ took 23.8s. Estimated remaining: 33m 15s. Rate: 7.5 symbols/min [2025-09-19T21:42:17.901353] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:42:17.920206] [DEBUG] [LOCAL ] TRC: Loaded 16154 existing records from primary storage. [2025-09-19T21:42:17.920393] [INFO ] [MAIN ] TRC: Loaded 16154 existing records. [2025-09-19T21:42:18.106023] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:42:18.106301] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-19T21:42:18.106358] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-19T21:42:18.107038] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-19T21:42:18.107098] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-19T21:42:18.250630] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-19T21:42:18.481505] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:42:18.758280] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T21:42:19.043277] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-19T21:42:19.636045] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-19T21:42:19.723357] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T21:42:19.727908] [INFO ] [REMOTE ] TPVG: Full fetch complete (40180 records). [2025-09-19T21:42:19.728015] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-19T21:42:19.848346] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-19T21:42:20.143096] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-19T21:42:20.143202] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-19T21:42:20.144121] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-19T21:42:20.144188] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-19T21:42:20.145525] [DEBUG] [LOCAL ] TPVG: Trimmed 40180 records to 27486 (keeping 200 days of data) [2025-09-19T21:42:20.317829] [DEBUG] [LOCAL ] TPVG: Primary data saved (27486 records). [2025-09-19T21:42:20.317966] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-19T21:42:20.318055] [INFO ] [MAIN ] Update Progress: 2123/2372 symbols completed. TPVG took 26.5s. Estimated remaining: 33m 6s. Rate: 7.5 symbols/min [2025-09-19T21:42:20.490287] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:42:20.545599] [DEBUG] [LOCAL ] TREX: Loaded 50357 existing records from primary storage. [2025-09-19T21:42:20.545819] [INFO ] [MAIN ] TREX: Loaded 50357 existing records. [2025-09-19T21:42:20.644796] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-19T21:42:20.724121] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:42:20.724395] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-19T21:42:20.724458] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-19T21:42:20.725719] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-19T21:42:20.725779] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-19T21:42:20.888952] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-19T21:42:21.092070] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:42:21.355247] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-19T21:42:21.443236] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-19T21:42:22.243297] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-19T21:42:22.515402] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T21:42:23.043278] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-19T21:42:23.407914] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T21:42:23.411398] [INFO ] [REMOTE ] TR: Full fetch complete (24728 records). [2025-09-19T21:42:23.411478] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-19T21:42:23.816606] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-19T21:42:23.816729] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-19T21:42:23.817265] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-19T21:42:23.817317] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-19T21:42:23.818173] [DEBUG] [LOCAL ] TR: Trimmed 24728 records to 18499 (keeping 200 days of data) [2025-09-19T21:42:23.870135] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-19T21:42:23.943339] [DEBUG] [LOCAL ] TR: Primary data saved (18499 records). [2025-09-19T21:42:23.943497] [INFO ] [MAIN ] TR: Full history saved. [2025-09-19T21:42:23.943590] [INFO ] [MAIN ] Update Progress: 2124/2372 symbols completed. TR took 30.1s. Estimated remaining: 32m 58s. Rate: 7.5 symbols/min [2025-09-19T21:42:24.130554] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:42:24.142761] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T21:42:24.205062] [DEBUG] [LOCAL ] TRGP: Loaded 51262 existing records from primary storage. [2025-09-19T21:42:24.205217] [INFO ] [MAIN ] TRGP: Loaded 51262 existing records. [2025-09-19T21:42:24.383539] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:42:24.384020] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-19T21:42:24.384130] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-19T21:42:24.389674] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-19T21:42:24.389801] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-19T21:42:24.435370] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-19T21:42:24.649578] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-19T21:42:24.800743] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:42:25.443310] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-19T21:42:26.081402] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T21:42:26.243273] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-19T21:42:26.731227] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T21:42:27.043281] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-19T21:42:27.843256] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-19T21:42:27.977853] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T21:42:28.035941] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T21:42:28.643278] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-19T21:42:29.002921] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T21:42:29.205671] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-19T21:42:29.443255] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-19T21:42:30.155124] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T21:42:30.243286] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-19T21:42:31.043234] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-19T21:42:31.451009] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T21:42:31.843283] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-19T21:42:31.957788] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T21:42:32.643281] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-19T21:42:33.443254] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-19T21:42:33.711741] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T21:42:34.243282] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-19T21:42:34.408749] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-19T21:42:34.681557] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-19T21:42:35.043268] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-19T21:42:35.843251] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-19T21:42:36.235717] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-19T21:42:36.590935] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-19T21:42:36.643223] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-19T21:42:37.443286] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-19T21:42:37.846591] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T21:42:38.243241] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-19T21:42:38.614342] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T21:42:38.658626] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-19T21:42:39.043294] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-19T21:42:39.146515] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T21:42:39.148964] [INFO ] [REMOTE ] TRAK: Full fetch complete (13393 records). [2025-09-19T21:42:39.149042] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-19T21:42:39.511577] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-19T21:42:39.511706] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-19T21:42:39.512015] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-19T21:42:39.512055] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-19T21:42:39.512558] [DEBUG] [LOCAL ] TRAK: Trimmed 13393 records to 9553 (keeping 200 days of data) [2025-09-19T21:42:39.569919] [DEBUG] [LOCAL ] TRAK: Primary data saved (9553 records). [2025-09-19T21:42:39.570057] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-19T21:42:39.570140] [INFO ] [MAIN ] Update Progress: 2125/2372 symbols completed. TRAK took 27.6s. Estimated remaining: 32m 51s. Rate: 7.5 symbols/min [2025-09-19T21:42:39.738543] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:42:39.788607] [DEBUG] [LOCAL ] TRN: Loaded 37803 existing records from primary storage. [2025-09-19T21:42:39.788784] [INFO ] [MAIN ] TRN: Loaded 37803 existing records. [2025-09-19T21:42:39.850795] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-19T21:42:39.968925] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:42:39.969202] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-19T21:42:39.969268] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-19T21:42:39.970357] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-19T21:42:39.970418] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-19T21:42:40.337319] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:42:40.333445] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T21:42:40.643330] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-19T21:42:41.443304] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-19T21:42:41.928904] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T21:42:42.243263] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-19T21:42:42.264821] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T21:42:42.467750] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-19T21:42:42.470549] [INFO ] [REMOTE ] TRC: Full fetch complete (22036 records). [2025-09-19T21:42:42.470630] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-19T21:42:42.858766] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-19T21:42:42.858848] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-19T21:42:42.859337] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-19T21:42:42.859384] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-19T21:42:42.860013] [DEBUG] [LOCAL ] TRC: Trimmed 22036 records to 16277 (keeping 200 days of data) [2025-09-19T21:42:42.958999] [DEBUG] [LOCAL ] TRC: Primary data saved (16277 records). [2025-09-19T21:42:42.959154] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-19T21:42:42.959241] [INFO ] [MAIN ] Update Progress: 2126/2372 symbols completed. TRC took 25.2s. Estimated remaining: 32m 42s. Rate: 7.5 symbols/min [2025-09-19T21:42:43.048601] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-19T21:42:43.160553] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:42:43.204199] [DEBUG] [LOCAL ] TRNO: Loaded 44567 existing records from primary storage. [2025-09-19T21:42:43.204346] [INFO ] [MAIN ] TRNO: Loaded 44567 existing records. [2025-09-19T21:42:43.385030] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:42:43.385384] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-19T21:42:43.385458] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-19T21:42:43.386544] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-19T21:42:43.386604] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-19T21:42:43.737200] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:42:43.843236] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-19T21:42:44.020939] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-19T21:42:44.643269] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-19T21:42:44.951121] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T21:42:45.375171] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T21:42:45.443222] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-19T21:42:46.243287] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-19T21:42:46.461677] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T21:42:47.043307] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-19T21:42:47.295504] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-19T21:42:47.843268] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-19T21:42:48.192927] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T21:42:48.643237] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-19T21:42:48.738519] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T21:42:49.023252] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T21:42:49.443312] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-19T21:42:50.243316] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-19T21:42:50.496402] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T21:42:51.043461] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-19T21:42:51.488008] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T21:42:51.843401] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-19T21:42:52.157792] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T21:42:52.643341] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-19T21:42:52.850142] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-19T21:42:52.857789] [INFO ] [REMOTE ] TREX: Full fetch complete (70847 records). [2025-09-19T21:42:52.857931] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-19T21:42:53.253761] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-19T21:42:53.253869] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-19T21:42:53.255274] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-19T21:42:53.255404] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-19T21:42:53.257246] [DEBUG] [LOCAL ] TREX: Trimmed 70847 records to 50744 (keeping 200 days of data) [2025-09-19T21:42:53.375384] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T21:42:53.470776] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-19T21:42:53.623617] [DEBUG] [LOCAL ] TREX: Primary data saved (50744 records). [2025-09-19T21:42:53.623866] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-19T21:42:53.624041] [INFO ] [MAIN ] Update Progress: 2127/2372 symbols completed. TREX took 33.3s. Estimated remaining: 32m 35s. Rate: 7.5 symbols/min [2025-09-19T21:42:53.812607] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:42:53.864243] [DEBUG] [LOCAL ] TROX: Loaded 52140 existing records from primary storage. [2025-09-19T21:42:53.864417] [INFO ] [MAIN ] TROX: Loaded 52140 existing records. [2025-09-19T21:42:54.040184] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:42:54.040423] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-19T21:42:54.040471] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-19T21:42:54.041541] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-19T21:42:54.041602] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-19T21:42:54.261421] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-19T21:42:54.427046] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:42:54.536283] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T21:42:55.043296] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-19T21:42:55.587391] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T21:42:55.843238] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-19T21:42:55.985293] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T21:42:56.643306] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-19T21:42:56.778620] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T21:42:57.443340] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-19T21:42:57.645714] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T21:42:58.159318] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-19T21:42:58.243264] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-19T21:42:59.020542] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T21:42:59.043228] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-19T21:42:59.843329] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-19T21:43:00.186897] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-19T21:43:00.643303] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-19T21:43:00.676479] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T21:43:01.443258] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-19T21:43:01.591701] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T21:43:02.243348] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-19T21:43:02.653095] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T21:43:02.708673] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T21:43:03.043337] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-19T21:43:03.843307] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-19T21:43:04.093288] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T21:43:04.395785] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-19T21:43:04.643259] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-19T21:43:05.443344] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-19T21:43:05.749013] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T21:43:06.243265] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-19T21:43:06.488563] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T21:43:06.496408] [INFO ] [REMOTE ] TRGP: Full fetch complete (73513 records). [2025-09-19T21:43:06.496575] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-19T21:43:06.908419] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-19T21:43:06.908527] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-19T21:43:06.909691] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-19T21:43:06.909773] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-19T21:43:06.911252] [DEBUG] [LOCAL ] TRGP: Trimmed 73513 records to 51625 (keeping 200 days of data) [2025-09-19T21:43:07.032103] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T21:43:07.044595] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-19T21:43:07.278332] [DEBUG] [LOCAL ] TRGP: Primary data saved (51625 records). [2025-09-19T21:43:07.278558] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-19T21:43:07.279028] [INFO ] [MAIN ] Update Progress: 2128/2372 symbols completed. TRGP took 43.3s. Estimated remaining: 32m 27s. Rate: 7.5 symbols/min [2025-09-19T21:43:07.339531] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-19T21:43:07.414540] [INFO ] [REMOTE ] TRN: Full fetch complete (52837 records). [2025-09-19T21:43:07.430259] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-19T21:43:07.532302] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:43:07.847984] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-19T21:43:07.935604] [DEBUG] [LOCAL ] TRP: Loaded 52542 existing records from primary storage. [2025-09-19T21:43:07.938765] [INFO ] [MAIN ] TRP: Loaded 52542 existing records. [2025-09-19T21:43:07.938891] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-19T21:43:07.971696] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-19T21:43:07.984191] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-19T21:43:07.984297] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-19T21:43:08.050621] [DEBUG] [LOCAL ] TRN: Trimmed 52837 records to 38047 (keeping 200 days of data) [2025-09-19T21:43:08.236309] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:43:08.242365] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-19T21:43:08.252021] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-19T21:43:08.295967] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-19T21:43:08.296096] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-19T21:43:08.515835] [DEBUG] [LOCAL ] TRN: Primary data saved (38047 records). [2025-09-19T21:43:08.552073] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-19T21:43:08.552364] [INFO ] [MAIN ] Update Progress: 2129/2372 symbols completed. TRN took 29.0s. Estimated remaining: 32m 19s. Rate: 7.5 symbols/min [2025-09-19T21:43:08.877043] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:43:08.905428] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-19T21:43:08.927712] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:43:08.956565] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T21:43:08.995857] [DEBUG] [LOCAL ] TRTX: Loaded 37676 existing records from primary storage. [2025-09-19T21:43:08.996006] [INFO ] [MAIN ] TRTX: Loaded 37676 existing records. [2025-09-19T21:43:09.170362] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:43:09.170699] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-19T21:43:09.170757] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-19T21:43:09.171556] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-19T21:43:09.171615] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-19T21:43:09.452021] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-19T21:43:09.570130] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:43:09.642026] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T21:43:09.649184] [INFO ] [REMOTE ] TRNO: Full fetch complete (64106 records). [2025-09-19T21:43:09.649303] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-19T21:43:10.032240] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-19T21:43:10.032320] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-19T21:43:10.033325] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-19T21:43:10.033388] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-19T21:43:10.034834] [DEBUG] [LOCAL ] TRNO: Trimmed 64106 records to 44882 (keeping 200 days of data) [2025-09-19T21:43:10.244432] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-19T21:43:10.306712] [DEBUG] [LOCAL ] TRNO: Primary data saved (44882 records). [2025-09-19T21:43:10.306857] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-19T21:43:10.306966] [INFO ] [MAIN ] Update Progress: 2130/2372 symbols completed. TRNO took 27.3s. Estimated remaining: 32m 10s. Rate: 7.5 symbols/min [2025-09-19T21:43:10.486860] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:43:10.518949] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T21:43:10.573577] [DEBUG] [LOCAL ] TRU: Loaded 51565 existing records from primary storage. [2025-09-19T21:43:10.573750] [INFO ] [MAIN ] TRU: Loaded 51565 existing records. [2025-09-19T21:43:10.755244] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:43:10.755473] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-19T21:43:10.755519] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-19T21:43:10.756547] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-19T21:43:10.756607] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-19T21:43:11.048453] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-19T21:43:11.125822] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:43:11.300135] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T21:43:11.849785] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-19T21:43:11.868049] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T21:43:12.643278] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-19T21:43:13.384545] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-19T21:43:13.443308] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-19T21:43:13.888789] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-19T21:43:14.186857] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T21:43:14.243307] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-19T21:43:14.493271] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T21:43:15.043335] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-19T21:43:15.843324] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-19T21:43:16.283457] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T21:43:16.370230] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-19T21:43:16.643277] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-19T21:43:17.443277] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-19T21:43:18.167514] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-19T21:43:18.243224] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-19T21:43:18.521548] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T21:43:18.687057] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-19T21:43:19.043320] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-19T21:43:19.657447] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T21:43:19.843266] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-19T21:43:20.643263] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-19T21:43:21.136392] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T21:43:21.445399] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-19T21:43:21.451211] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T21:43:21.987397] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T21:43:22.243306] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-19T21:43:23.043264] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-19T21:43:23.529776] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T21:43:23.843239] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-19T21:43:24.124609] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T21:43:24.482034] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-19T21:43:24.643259] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-19T21:43:25.443314] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-19T21:43:25.849408] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T21:43:26.243277] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-19T21:43:26.710403] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T21:43:27.043252] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-19T21:43:27.699349] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T21:43:27.843277] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-19T21:43:28.002561] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T21:43:28.434872] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-19T21:43:28.643250] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-19T21:43:29.443287] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-19T21:43:30.086922] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T21:43:30.243260] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-19T21:43:30.606584] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T21:43:30.641586] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-19T21:43:31.043283] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-19T21:43:31.843287] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-19T21:43:32.032053] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T21:43:32.350522] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T21:43:32.643323] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-19T21:43:33.175543] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-19T21:43:33.443264] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-19T21:43:33.654034] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T21:43:34.243272] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-19T21:43:35.043345] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-19T21:43:35.515105] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T21:43:35.843277] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-19T21:43:36.067364] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T21:43:36.075545] [INFO ] [REMOTE ] TROX: Full fetch complete (72364 records). [2025-09-19T21:43:36.075742] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-19T21:43:36.472807] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-19T21:43:36.472902] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-19T21:43:36.474028] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-19T21:43:36.474097] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-19T21:43:36.475591] [DEBUG] [LOCAL ] TROX: Trimmed 72364 records to 52525 (keeping 200 days of data) [2025-09-19T21:43:36.648054] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-19T21:43:36.798791] [DEBUG] [LOCAL ] TROX: Primary data saved (52525 records). [2025-09-19T21:43:36.799508] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-19T21:43:36.799768] [INFO ] [MAIN ] Update Progress: 2131/2372 symbols completed. TROX took 43.2s. Estimated remaining: 32m 4s. Rate: 7.5 symbols/min [2025-09-19T21:43:36.977887] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:43:36.999097] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T21:43:37.050579] [DEBUG] [LOCAL ] TRV: Loaded 48772 existing records from primary storage. [2025-09-19T21:43:37.050776] [INFO ] [MAIN ] TRV: Loaded 48772 existing records. [2025-09-19T21:43:37.229909] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:43:37.230179] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-19T21:43:37.230229] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-19T21:43:37.231468] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-19T21:43:37.231529] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-19T21:43:37.457346] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-19T21:43:37.596360] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:43:38.133862] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-19T21:43:38.243233] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-19T21:43:38.392750] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T21:43:38.400904] [INFO ] [REMOTE ] TRP: Full fetch complete (75567 records). [2025-09-19T21:43:38.401079] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-19T21:43:38.745666] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T21:43:38.825634] [INFO ] [REMOTE ] TRTX: Full fetch complete (52836 records). [2025-09-19T21:43:38.825938] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-19T21:43:38.826046] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-19T21:43:38.826312] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-19T21:43:38.827785] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-19T21:43:38.871686] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-19T21:43:38.936353] [DEBUG] [LOCAL ] TRP: Trimmed 75567 records to 52906 (keeping 200 days of data) [2025-09-19T21:43:39.068158] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-19T21:43:39.320725] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-19T21:43:39.322600] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-19T21:43:39.323934] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-19T21:43:39.324262] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-19T21:43:39.329574] [DEBUG] [LOCAL ] TRTX: Trimmed 52836 records to 37925 (keeping 200 days of data) [2025-09-19T21:43:39.603794] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T21:43:39.618015] [INFO ] [REMOTE ] TRU: Full fetch complete (72979 records). [2025-09-19T21:43:39.660554] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-19T21:43:40.120583] [DEBUG] [LOCAL ] TRP: Primary data saved (52906 records). [2025-09-19T21:43:40.126166] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-19T21:43:40.127875] [INFO ] [MAIN ] Update Progress: 2132/2372 symbols completed. TRP took 32.8s. Estimated remaining: 31m 55s. Rate: 7.5 symbols/min [2025-09-19T21:43:40.222947] [DEBUG] [LOCAL ] TRTX: Primary data saved (37925 records). [2025-09-19T21:43:40.269068] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-19T21:43:40.269199] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-19T21:43:40.283536] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-19T21:43:40.300943] [INFO ] [MAIN ] Update Progress: 2133/2372 symbols completed. TRTX took 31.7s. Estimated remaining: 31m 47s. Rate: 7.5 symbols/min [2025-09-19T21:43:40.319013] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-19T21:43:40.319444] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-19T21:43:40.468224] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:43:40.485335] [DEBUG] [LOCAL ] TRU: Trimmed 72979 records to 51951 (keeping 200 days of data) [2025-09-19T21:43:40.676398] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:43:40.808056] [DEBUG] [LOCAL ] TSE: Loaded 29154 existing records from primary storage. [2025-09-19T21:43:40.835255] [INFO ] [MAIN ] TSE: Loaded 29154 existing records. [2025-09-19T21:43:40.944598] [DEBUG] [LOCAL ] TS: Loaded 52076 existing records from primary storage. [2025-09-19T21:43:40.951329] [INFO ] [MAIN ] TS: Loaded 52076 existing records. [2025-09-19T21:43:41.157169] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:43:41.200519] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-19T21:43:41.217846] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-19T21:43:41.219300] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-19T21:43:41.219449] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-19T21:43:41.287618] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:43:41.321490] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-19T21:43:41.327122] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-19T21:43:41.361423] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-19T21:43:41.361584] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-19T21:43:41.928733] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-19T21:43:42.007121] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-19T21:43:42.092826] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:43:42.101003] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-19T21:43:42.109178] [DEBUG] [LOCAL ] TRU: Primary data saved (51951 records). [2025-09-19T21:43:42.136184] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-19T21:43:42.153457] [INFO ] [MAIN ] Update Progress: 2134/2372 symbols completed. TRU took 31.8s. Estimated remaining: 31m 38s. Rate: 7.5 symbols/min [2025-09-19T21:43:42.175292] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:43:42.217876] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-19T21:43:42.345912] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:43:42.356094] [DEBUG] [LOCAL ] TSI: Loaded 8718 existing records from primary storage. [2025-09-19T21:43:42.356214] [INFO ] [MAIN ] TSI: Loaded 8718 existing records. [2025-09-19T21:43:42.533853] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:43:42.534206] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-19T21:43:42.534261] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-19T21:43:42.534578] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-19T21:43:42.534638] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-19T21:43:42.890051] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:43:42.890365] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-19T21:43:43.750963] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T21:43:43.751221] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T21:43:43.761147] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-19T21:43:43.843272] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-19T21:43:44.145763] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-19T21:43:44.457402] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T21:43:44.502125] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-19T21:43:44.643234] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-19T21:43:44.956141] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T21:43:45.443262] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-19T21:43:46.243243] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-19T21:43:46.616763] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T21:43:46.877070] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T21:43:47.043317] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-19T21:43:47.843262] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-19T21:43:48.119032] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T21:43:48.189536] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T21:43:48.643317] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-19T21:43:48.825443] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-19T21:43:49.443255] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-19T21:43:50.060570] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T21:43:50.243307] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-19T21:43:51.043282] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-19T21:43:51.496461] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T21:43:51.540456] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-19T21:43:51.843313] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-19T21:43:52.252903] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T21:43:52.643241] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-19T21:43:53.443326] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-19T21:43:53.897038] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-19T21:43:53.965862] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-19T21:43:54.243261] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-19T21:43:54.680117] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T21:43:55.043360] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-19T21:43:55.843312] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-19T21:43:56.145021] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T21:43:56.643290] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-19T21:43:56.901746] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T21:43:57.443256] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-19T21:43:57.598099] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T21:43:57.936545] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T21:43:58.243274] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-19T21:43:59.043246] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-19T21:43:59.376318] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-19T21:43:59.467631] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T21:43:59.515026] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-19T21:43:59.843274] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-19T21:44:00.643279] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-19T21:44:01.443320] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-19T21:44:01.732631] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:44:02.243316] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-19T21:44:02.768735] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T21:44:03.043356] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-19T21:44:03.113277] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T21:44:03.446379] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T21:44:03.843279] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-19T21:44:04.603483] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T21:44:04.643226] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-19T21:44:04.732913] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T21:44:05.443233] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-19T21:44:05.529483] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-19T21:44:05.539616] [INFO ] [REMOTE ] TRV: Full fetch complete (70110 records). [2025-09-19T21:44:05.539806] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-19T21:44:05.940576] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-19T21:44:05.940686] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-19T21:44:05.942234] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-19T21:44:05.942297] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-19T21:44:05.945235] [DEBUG] [LOCAL ] TRV: Trimmed 70110 records to 49097 (keeping 200 days of data) [2025-09-19T21:44:06.247498] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-19T21:44:06.266506] [DEBUG] [LOCAL ] TRV: Primary data saved (49097 records). [2025-09-19T21:44:06.266660] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-19T21:44:06.266768] [INFO ] [MAIN ] Update Progress: 2135/2372 symbols completed. TRV took 29.5s. Estimated remaining: 31m 32s. Rate: 7.5 symbols/min [2025-09-19T21:44:06.437855] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:44:06.473880] [DEBUG] [LOCAL ] TSLX: Loaded 35680 existing records from primary storage. [2025-09-19T21:44:06.474078] [INFO ] [MAIN ] TSLX: Loaded 35680 existing records. [2025-09-19T21:44:06.665567] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:44:06.666322] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T21:44:06.669129] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-19T21:44:06.669195] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-19T21:44:06.670150] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-19T21:44:06.670225] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-19T21:44:07.026500] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:44:07.043226] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-19T21:44:07.390032] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T21:44:07.843301] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-19T21:44:08.489247] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T21:44:08.639859] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T21:44:08.641629] [INFO ] [REMOTE ] TSI: Full fetch complete (13282 records). [2025-09-19T21:44:08.641726] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-19T21:44:08.652993] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-19T21:44:09.023200] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-19T21:44:09.023327] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-19T21:44:09.023750] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-19T21:44:09.023840] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-19T21:44:09.024527] [DEBUG] [LOCAL ] TSI: Trimmed 13282 records to 8745 (keeping 200 days of data) [2025-09-19T21:44:09.079298] [DEBUG] [LOCAL ] TSI: Primary data saved (8745 records). [2025-09-19T21:44:09.079429] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-19T21:44:09.079582] [INFO ] [MAIN ] Update Progress: 2136/2372 symbols completed. TSI took 26.9s. Estimated remaining: 31m 23s. Rate: 7.5 symbols/min [2025-09-19T21:44:09.251074] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:44:09.320557] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-09-19T21:44:09.320749] [INFO ] [MAIN ] TSM: Loaded 54209 existing records. [2025-09-19T21:44:09.448477] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-19T21:44:09.502852] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:44:09.503226] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-19T21:44:09.503311] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-19T21:44:09.504680] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-19T21:44:09.504754] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-19T21:44:09.873276] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:44:10.187421] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T21:44:10.243278] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-19T21:44:10.883283] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T21:44:11.043302] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-19T21:44:11.715674] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T21:44:11.843279] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-19T21:44:12.639290] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T21:44:12.645979] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-19T21:44:13.135371] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T21:44:13.146368] [INFO ] [REMOTE ] TS: Full fetch complete (74443 records). [2025-09-19T21:44:13.146553] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-19T21:44:13.448361] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-19T21:44:13.584446] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-19T21:44:13.584544] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-19T21:44:13.585853] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-19T21:44:13.585952] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-19T21:44:13.587557] [DEBUG] [LOCAL ] TS: Trimmed 74443 records to 52447 (keeping 200 days of data) [2025-09-19T21:44:13.938411] [DEBUG] [LOCAL ] TS: Primary data saved (52447 records). [2025-09-19T21:44:13.938558] [INFO ] [MAIN ] TS: Full history saved. [2025-09-19T21:44:13.938760] [INFO ] [MAIN ] Update Progress: 2137/2372 symbols completed. TS took 33.8s. Estimated remaining: 31m 15s. Rate: 7.5 symbols/min [2025-09-19T21:44:14.134971] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:44:14.199795] [DEBUG] [LOCAL ] TSN: Loaded 53226 existing records from primary storage. [2025-09-19T21:44:14.200057] [INFO ] [MAIN ] TSN: Loaded 53226 existing records. [2025-09-19T21:44:14.269325] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-19T21:44:14.396394] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:44:14.396824] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-19T21:44:14.396893] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-19T21:44:14.398375] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-19T21:44:14.398448] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-19T21:44:14.781264] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:44:15.043230] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-19T21:44:15.133219] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T21:44:15.561096] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T21:44:15.566560] [INFO ] [REMOTE ] TSE: Full fetch complete (42055 records). [2025-09-19T21:44:15.566747] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-19T21:44:15.845514] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-19T21:44:15.995812] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-19T21:44:15.995955] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-19T21:44:15.999957] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-19T21:44:16.000054] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-19T21:44:16.002877] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (3.36 seconds). [2025-09-19T21:44:16.016088] [DEBUG] [LOCAL ] TSE: Trimmed 42055 records to 29327 (keeping 200 days of data) [2025-09-19T21:44:16.207954] [DEBUG] [LOCAL ] TSE: Primary data saved (29327 records). [2025-09-19T21:44:16.208106] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-19T21:44:16.208205] [INFO ] [MAIN ] Update Progress: 2138/2372 symbols completed. TSE took 35.9s. Estimated remaining: 31m 6s. Rate: 7.5 symbols/min [2025-09-19T21:44:16.382379] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:44:16.396836] [DEBUG] [LOCAL ] TSQ: Loaded 12099 existing records from primary storage. [2025-09-19T21:44:16.397016] [INFO ] [MAIN ] TSQ: Loaded 12099 existing records. [2025-09-19T21:44:16.575794] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:44:16.576184] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-19T21:44:16.576255] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-19T21:44:16.576845] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-19T21:44:16.576905] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-19T21:44:16.643562] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-19T21:44:16.900861] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T21:44:16.997094] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:44:17.081907] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-19T21:44:17.443284] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-19T21:44:18.243269] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-19T21:44:18.459799] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-19T21:44:19.043315] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-19T21:44:19.428321] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-19T21:44:19.509454] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-19T21:44:19.585819] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-19T21:44:19.843268] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-19T21:44:20.643276] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-19T21:44:20.742558] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T21:44:21.443251] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-19T21:44:22.243304] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-19T21:44:22.413139] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-19T21:44:22.588968] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T21:44:23.043262] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-19T21:44:23.586666] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T21:44:23.843268] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-19T21:44:24.373122] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T21:44:24.643263] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-19T21:44:25.450293] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-19T21:44:25.472255] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-19T21:44:25.767978] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T21:44:26.243286] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-19T21:44:26.636130] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-19T21:44:27.043286] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-19T21:44:27.403394] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-19T21:44:27.843261] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-19T21:44:28.643262] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-19T21:44:28.879705] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T21:44:29.443237] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-19T21:44:30.189886] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (3.15 seconds). [2025-09-19T21:44:30.243215] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-19T21:44:30.566836] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T21:44:30.695215] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T21:44:31.043261] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-19T21:44:31.843267] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-19T21:44:32.640901] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T21:44:32.642984] [INFO ] [REMOTE ] TSQ: Full fetch complete (16737 records). [2025-09-19T21:44:32.643060] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-19T21:44:32.676392] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-19T21:44:33.020804] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-19T21:44:33.020981] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-19T21:44:33.021594] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-19T21:44:33.021695] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-19T21:44:33.022607] [DEBUG] [LOCAL ] TSQ: Trimmed 16737 records to 12203 (keeping 200 days of data) [2025-09-19T21:44:33.097467] [DEBUG] [LOCAL ] TSQ: Primary data saved (12203 records). [2025-09-19T21:44:33.097660] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-19T21:44:33.097775] [INFO ] [MAIN ] Update Progress: 2139/2372 symbols completed. TSQ took 16.9s. Estimated remaining: 30m 59s. Rate: 7.5 symbols/min [2025-09-19T21:44:33.298055] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-19T21:44:33.331533] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:44:33.383045] [DEBUG] [LOCAL ] TT: Loaded 48402 existing records from primary storage. [2025-09-19T21:44:33.383208] [INFO ] [MAIN ] TT: Loaded 48402 existing records. [2025-09-19T21:44:33.449580] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-19T21:44:33.576586] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:44:33.576971] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-19T21:44:33.577104] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-19T21:44:33.578556] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-19T21:44:33.578619] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-19T21:44:34.008503] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (3.77 seconds). [2025-09-19T21:44:34.014524] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:44:34.243284] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-19T21:44:34.322170] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T21:44:35.043306] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-19T21:44:35.740599] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T21:44:35.843301] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-19T21:44:36.050575] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-19T21:44:36.394705] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-19T21:44:36.399771] [INFO ] [REMOTE ] TSLX: Full fetch complete (48912 records). [2025-09-19T21:44:36.399878] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-19T21:44:36.651575] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-19T21:44:36.798757] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-19T21:44:36.798845] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-19T21:44:36.799733] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-19T21:44:36.799796] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-19T21:44:36.800979] [DEBUG] [LOCAL ] TSLX: Trimmed 48912 records to 35905 (keeping 200 days of data) [2025-09-19T21:44:37.044116] [DEBUG] [LOCAL ] TSLX: Primary data saved (35905 records). [2025-09-19T21:44:37.044283] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-19T21:44:37.044397] [INFO ] [MAIN ] Update Progress: 2140/2372 symbols completed. TSLX took 30.8s. Estimated remaining: 30m 51s. Rate: 7.5 symbols/min [2025-09-19T21:44:37.214194] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:44:37.214350] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-19T21:44:37.214431] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-19T21:44:37.214543] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-19T21:44:37.214582] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-19T21:44:37.214623] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-19T21:44:37.214686] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-19T21:44:37.462882] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-19T21:44:37.586475] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:44:37.618464] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T21:44:38.163571] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T21:44:38.243239] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-19T21:44:39.043281] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-19T21:44:39.843282] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-19T21:44:39.916470] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T21:44:40.096271] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:44:40.096630] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-19T21:44:40.558480] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (3.10 seconds). [2025-09-19T21:44:40.643302] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-19T21:44:40.874688] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:44:40.875204] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-19T21:44:41.045095] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T21:44:41.443272] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-19T21:44:42.243272] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-19T21:44:43.043350] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-19T21:44:43.520781] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T21:44:43.564959] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T21:44:43.843299] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-19T21:44:44.643294] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-19T21:44:44.853141] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T21:44:45.443263] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-19T21:44:45.947448] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T21:44:46.243270] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-19T21:44:46.543947] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T21:44:47.043299] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-19T21:44:47.188870] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-19T21:44:47.843273] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-19T21:44:48.176284] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-19T21:44:48.406366] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-19T21:44:48.417810] [INFO ] [REMOTE ] TSN: Full fetch complete (76211 records). [2025-09-19T21:44:48.418105] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-19T21:44:48.648569] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-19T21:44:49.041970] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-19T21:44:49.042106] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-19T21:44:49.043371] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-19T21:44:49.043449] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-19T21:44:49.045346] [DEBUG] [LOCAL ] TSN: Trimmed 76211 records to 53612 (keeping 200 days of data) [2025-09-19T21:44:49.402696] [DEBUG] [LOCAL ] TSN: Primary data saved (53612 records). [2025-09-19T21:44:49.402863] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-19T21:44:49.403905] [INFO ] [MAIN ] Update Progress: 2141/2372 symbols completed. TSN took 35.5s. Estimated remaining: 30m 43s. Rate: 7.5 symbols/min [2025-09-19T21:44:49.448417] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-19T21:44:49.580816] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:44:49.623723] [DEBUG] [LOCAL ] TTC: Loaded 43308 existing records from primary storage. [2025-09-19T21:44:49.623895] [INFO ] [MAIN ] TTC: Loaded 43308 existing records. [2025-09-19T21:44:49.810381] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:44:49.810809] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-19T21:44:49.810898] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-19T21:44:49.811904] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-19T21:44:49.811966] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-19T21:44:50.198830] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:44:50.212002] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-19T21:44:50.243216] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-19T21:44:50.896596] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-09-19T21:44:51.043314] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-19T21:44:51.130241] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T21:44:51.360365] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T21:44:51.843282] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-19T21:44:52.643276] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-19T21:44:53.069280] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-19T21:44:53.443263] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-19T21:44:53.921952] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-19T21:44:54.187157] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-19T21:44:54.243270] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-19T21:44:54.475155] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T21:44:55.043283] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-19T21:44:55.477421] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T21:44:55.843273] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-19T21:44:56.643266] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-19T21:44:56.860965] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T21:44:57.443293] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-19T21:44:58.168262] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T21:44:58.243272] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-19T21:44:58.380752] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T21:44:58.387935] [INFO ] [REMOTE ] TT: Full fetch complete (69767 records). [2025-09-19T21:44:58.388055] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-19T21:44:58.803107] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-19T21:44:58.803285] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-19T21:44:58.804433] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-19T21:44:58.804547] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-19T21:44:58.823665] [DEBUG] [LOCAL ] TT: Trimmed 69767 records to 48717 (keeping 200 days of data) [2025-09-19T21:44:58.827874] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-09-19T21:44:58.837418] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-09-19T21:44:58.837626] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-19T21:44:59.048212] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-19T21:44:59.243387] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T21:44:59.286758] [INFO ] [REMOTE ] TTAM: Full fetch complete (32397 records). [2025-09-19T21:44:59.310719] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-19T21:44:59.436791] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-19T21:44:59.437744] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-19T21:44:59.439681] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-19T21:44:59.440271] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-19T21:44:59.511232] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 54599 (keeping 200 days of data) [2025-09-19T21:44:59.706541] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 155 unique days, need 200 days [2025-09-19T21:44:59.708737] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:44:59.709117] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:44:59.715132] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-19T21:44:59.716134] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-19T21:44:59.717198] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-19T21:44:59.780562] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-19T21:44:59.781889] [INFO ] [MAIN ] Update Progress: 2142/2372 symbols completed. TTAM took 22.7s. Estimated remaining: 30m 36s. Rate: 7.5 symbols/min [2025-09-19T21:45:00.021880] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:00.112085] [DEBUG] [LOCAL ] TT: Primary data saved (48717 records). [2025-09-19T21:45:00.112937] [INFO ] [MAIN ] TT: Full history saved. [2025-09-19T21:45:00.113338] [INFO ] [MAIN ] Update Progress: 2143/2372 symbols completed. TT took 27.0s. Estimated remaining: 30m 27s. Rate: 7.5 symbols/min [2025-09-19T21:45:00.276684] [DEBUG] [LOCAL ] TTE: Loaded 52053 existing records from primary storage. [2025-09-19T21:45:00.292738] [INFO ] [MAIN ] TTE: Loaded 52053 existing records. [2025-09-19T21:45:00.377073] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:00.539624] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:00.553458] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-19T21:45:00.553548] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-19T21:45:00.609335] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-19T21:45:00.617512] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-19T21:45:00.791926] [DEBUG] [LOCAL ] TTI: Loaded 45604 existing records from primary storage. [2025-09-19T21:45:00.793002] [INFO ] [MAIN ] TTI: Loaded 45604 existing records. [2025-09-19T21:45:01.252828] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:01.276086] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-19T21:45:01.281621] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-19T21:45:01.322225] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-19T21:45:01.345076] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-19T21:45:01.348377] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:01.348858] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-19T21:45:01.507597] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-19T21:45:01.528718] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-19T21:45:01.794721] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:01.795756] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-19T21:45:01.801245] [DEBUG] [LOCAL ] TSM: Primary data saved (54599 records). [2025-09-19T21:45:01.801497] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-19T21:45:01.801699] [INFO ] [MAIN ] Update Progress: 2144/2372 symbols completed. TSM took 52.7s. Estimated remaining: 30m 18s. Rate: 7.5 symbols/min [2025-09-19T21:45:01.985049] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:02.034560] [DEBUG] [LOCAL ] TU: Loaded 50329 existing records from primary storage. [2025-09-19T21:45:02.034733] [INFO ] [MAIN ] TU: Loaded 50329 existing records. [2025-09-19T21:45:02.231926] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:02.232206] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-19T21:45:02.232257] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-19T21:45:02.233450] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-19T21:45:02.233516] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-19T21:45:02.639028] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:02.639568] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-19T21:45:04.741168] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (3.39 seconds). [2025-09-19T21:45:04.752569] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-19T21:45:04.777729] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (3.25 seconds). [2025-09-19T21:45:04.786900] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-19T21:45:05.568253] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (3.77 seconds). [2025-09-19T21:45:05.577218] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-19T21:45:05.902425] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (3.26 seconds). [2025-09-19T21:45:05.913142] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-19T21:45:06.533870] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T21:45:06.542780] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-19T21:45:06.831438] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T21:45:06.947065] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-19T21:45:07.043226] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-19T21:45:07.385201] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T21:45:07.843268] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-19T21:45:08.032586] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T21:45:08.643275] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-19T21:45:08.873451] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T21:45:09.306976] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-19T21:45:09.443271] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-19T21:45:10.243330] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-19T21:45:10.639074] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-19T21:45:10.675201] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-19T21:45:11.043263] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-19T21:45:11.843289] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-19T21:45:12.400924] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T21:45:12.643344] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-19T21:45:13.094578] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T21:45:13.398451] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T21:45:13.443264] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-19T21:45:14.243271] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-19T21:45:14.521997] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T21:45:15.043266] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-19T21:45:15.384552] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T21:45:15.843267] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-19T21:45:16.643266] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-19T21:45:17.164606] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-09-19T21:45:17.443271] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-19T21:45:18.359228] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (3.32 seconds). [2025-09-19T21:45:18.371270] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-19T21:45:18.540379] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T21:45:18.581793] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-19T21:45:19.043229] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-19T21:45:19.176486] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T21:45:19.843278] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-19T21:45:20.362938] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:45:20.643257] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-19T21:45:20.816526] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T21:45:21.270530] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-19T21:45:21.443294] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-19T21:45:22.243266] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-19T21:45:22.682710] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T21:45:23.043260] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-19T21:45:23.292478] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T21:45:23.386379] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-19T21:45:23.843263] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-19T21:45:24.643260] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-19T21:45:25.080859] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-19T21:45:25.443261] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-19T21:45:25.587374] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-19T21:45:25.594255] [INFO ] [REMOTE ] TTI: Full fetch complete (64738 records). [2025-09-19T21:45:25.594435] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-19T21:45:26.016016] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-19T21:45:26.016101] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-19T21:45:26.017119] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-19T21:45:26.017182] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-19T21:45:26.018602] [DEBUG] [LOCAL ] TTI: Trimmed 64738 records to 45947 (keeping 200 days of data) [2025-09-19T21:45:26.245860] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-19T21:45:26.280984] [DEBUG] [LOCAL ] TTI: Primary data saved (45947 records). [2025-09-19T21:45:26.281086] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-19T21:45:26.281167] [INFO ] [MAIN ] Update Progress: 2145/2372 symbols completed. TTI took 26.2s. Estimated remaining: 30m 12s. Rate: 7.5 symbols/min [2025-09-19T21:45:26.492370] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:26.541540] [DEBUG] [LOCAL ] TUYA: Loaded 47037 existing records from primary storage. [2025-09-19T21:45:26.541895] [INFO ] [MAIN ] TUYA: Loaded 47037 existing records. [2025-09-19T21:45:26.741362] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:26.741848] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-19T21:45:26.742018] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-19T21:45:26.743142] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-19T21:45:26.743228] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-19T21:45:26.895175] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-19T21:45:27.048385] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-19T21:45:27.162793] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:27.648304] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-19T21:45:27.816798] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T21:45:27.843215] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-19T21:45:28.643270] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-19T21:45:29.251562] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-19T21:45:29.443246] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-19T21:45:29.876451] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-19T21:45:30.243265] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-19T21:45:30.466816] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T21:45:30.474316] [INFO ] [REMOTE ] TU: Full fetch complete (72953 records). [2025-09-19T21:45:30.474447] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-19T21:45:30.866457] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-19T21:45:30.866569] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-19T21:45:30.867672] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-19T21:45:30.867735] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-19T21:45:30.869170] [DEBUG] [LOCAL ] TU: Trimmed 72953 records to 50687 (keeping 200 days of data) [2025-09-19T21:45:31.047390] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-19T21:45:31.187039] [DEBUG] [LOCAL ] TU: Primary data saved (50687 records). [2025-09-19T21:45:31.187182] [INFO ] [MAIN ] TU: Full history saved. [2025-09-19T21:45:31.187269] [INFO ] [MAIN ] Update Progress: 2146/2372 symbols completed. TU took 29.4s. Estimated remaining: 30m 4s. Rate: 7.5 symbols/min [2025-09-19T21:45:31.401012] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:31.442011] [DEBUG] [LOCAL ] TV: Loaded 43423 existing records from primary storage. [2025-09-19T21:45:31.442177] [INFO ] [MAIN ] TV: Loaded 43423 existing records. [2025-09-19T21:45:31.627529] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:31.627830] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-19T21:45:31.627880] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-19T21:45:31.628821] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-19T21:45:31.628885] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-19T21:45:32.014682] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:32.027758] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-19T21:45:32.039269] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-19T21:45:32.058356] [INFO ] [REMOTE ] TTE: Full fetch complete (75101 records). [2025-09-19T21:45:32.065146] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-19T21:45:32.066477] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T21:45:32.122970] [INFO ] [REMOTE ] TTC: Full fetch complete (62207 records). [2025-09-19T21:45:32.157414] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-19T21:45:32.898952] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-19T21:45:32.914335] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-19T21:45:32.914080] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-19T21:45:32.914485] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-19T21:45:32.916470] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-19T21:45:32.915835] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-19T21:45:32.916770] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-19T21:45:32.917162] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-19T21:45:32.919392] [DEBUG] [LOCAL ] TTE: Trimmed 75101 records to 52436 (keeping 200 days of data) [2025-09-19T21:45:32.920200] [DEBUG] [LOCAL ] TTC: Trimmed 62207 records to 43603 (keeping 200 days of data) [2025-09-19T21:45:33.096222] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T21:45:33.149690] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-19T21:45:33.537498] [DEBUG] [LOCAL ] TTE: Primary data saved (52436 records). [2025-09-19T21:45:33.538254] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-19T21:45:33.538413] [INFO ] [MAIN ] Update Progress: 2147/2372 symbols completed. TTE took 33.7s. Estimated remaining: 29m 55s. Rate: 7.5 symbols/min [2025-09-19T21:45:33.691025] [DEBUG] [LOCAL ] TTC: Primary data saved (43603 records). [2025-09-19T21:45:33.704873] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-19T21:45:33.710718] [INFO ] [MAIN ] Update Progress: 2148/2372 symbols completed. TTC took 44.3s. Estimated remaining: 29m 46s. Rate: 7.5 symbols/min [2025-09-19T21:45:33.768928] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:33.916013] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:33.918448] [DEBUG] [LOCAL ] TVC: Loaded 3569 existing records from primary storage. [2025-09-19T21:45:33.918614] [INFO ] [MAIN ] TVC: Loaded 3569 existing records. [2025-09-19T21:45:34.013455] [DEBUG] [LOCAL ] TVE: Loaded 2867 existing records from primary storage. [2025-09-19T21:45:34.040132] [INFO ] [MAIN ] TVE: Loaded 2867 existing records. [2025-09-19T21:45:34.266627] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:34.280317] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-19T21:45:34.312411] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T21:45:34.310348] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-19T21:45:34.341594] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-19T21:45:34.359894] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-19T21:45:34.359400] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-19T21:45:34.366802] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:34.421100] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-19T21:45:34.435264] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-19T21:45:34.462126] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-19T21:45:34.472532] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-19T21:45:34.823024] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T21:45:34.975441] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-19T21:45:35.008131] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:35.048767] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-19T21:45:35.159572] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:35.621030] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-19T21:45:35.843289] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-19T21:45:36.036430] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T21:45:36.643240] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-19T21:45:36.737690] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T21:45:37.443279] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-19T21:45:37.640285] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T21:45:37.663770] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-19T21:45:38.243335] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-19T21:45:38.913731] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T21:45:39.043270] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-19T21:45:39.344247] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T21:45:39.724922] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-19T21:45:39.843272] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-19T21:45:40.502477] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-19T21:45:40.643224] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-19T21:45:41.443341] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-19T21:45:42.238929] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-19T21:45:42.243220] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-19T21:45:42.438753] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T21:45:42.633769] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-19T21:45:43.043292] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-19T21:45:43.843281] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-19T21:45:44.643253] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-19T21:45:44.890390] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T21:45:45.334156] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-19T21:45:45.443288] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-19T21:45:45.721935] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T21:45:45.836726] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-19T21:45:46.243279] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-19T21:45:47.043289] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-19T21:45:47.748105] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-19T21:45:47.843279] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-19T21:45:48.041328] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-19T21:45:48.207863] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-19T21:45:48.643267] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-19T21:45:49.400725] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-19T21:45:49.443234] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-19T21:45:50.243255] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-19T21:45:50.912110] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-19T21:45:51.043279] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-19T21:45:51.290285] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T21:45:51.612103] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T21:45:51.843300] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-19T21:45:52.643269] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-19T21:45:53.443312] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-19T21:45:53.547932] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-19T21:45:53.582328] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T21:45:54.052287] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-19T21:45:54.053322] [INFO ] [REMOTE ] TVC: Full fetch complete (5768 records). [2025-09-19T21:45:54.053391] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-19T21:45:54.248400] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-19T21:45:54.431577] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-19T21:45:54.431686] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-19T21:45:54.431868] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-19T21:45:54.431909] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-19T21:45:54.432283] [DEBUG] [LOCAL ] TVC: Trimmed 5768 records to 3577 (keeping 200 days of data) [2025-09-19T21:45:54.455306] [DEBUG] [LOCAL ] TVC: Primary data saved (3577 records). [2025-09-19T21:45:54.455401] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-19T21:45:54.455494] [INFO ] [MAIN ] Update Progress: 2149/2372 symbols completed. TVC took 20.9s. Estimated remaining: 29m 40s. Rate: 7.5 symbols/min [2025-09-19T21:45:54.634506] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:54.669115] [DEBUG] [LOCAL ] TWI: Loaded 35162 existing records from primary storage. [2025-09-19T21:45:54.669263] [INFO ] [MAIN ] TWI: Loaded 35162 existing records. [2025-09-19T21:45:54.805602] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-19T21:45:54.867962] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:54.868219] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-19T21:45:54.868270] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-19T21:45:54.869456] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-19T21:45:54.869521] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-19T21:45:55.049855] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-19T21:45:55.239919] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:55.645871] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-19T21:45:55.843278] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-19T21:45:56.387966] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-19T21:45:56.643274] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-19T21:45:57.443288] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-19T21:45:58.035711] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T21:45:58.036726] [INFO ] [REMOTE ] TVE: Full fetch complete (4460 records). [2025-09-19T21:45:58.036797] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-19T21:45:58.250318] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-19T21:45:58.426246] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-19T21:45:58.426339] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-19T21:45:58.426519] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-19T21:45:58.426606] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-19T21:45:58.427079] [DEBUG] [LOCAL ] TVE: Trimmed 4460 records to 2875 (keeping 200 days of data) [2025-09-19T21:45:58.446538] [DEBUG] [LOCAL ] TVE: Primary data saved (2875 records). [2025-09-19T21:45:58.446749] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-19T21:45:58.446849] [INFO ] [MAIN ] Update Progress: 2150/2372 symbols completed. TVE took 24.7s. Estimated remaining: 29m 31s. Rate: 7.5 symbols/min [2025-09-19T21:45:58.634820] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:45:58.661943] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-19T21:45:58.724197] [DEBUG] [LOCAL ] TWLO: Loaded 53108 existing records from primary storage. [2025-09-19T21:45:58.724380] [INFO ] [MAIN ] TWLO: Loaded 53108 existing records. [2025-09-19T21:45:58.916537] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:45:58.916841] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-19T21:45:58.916893] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-19T21:45:58.918063] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-19T21:45:58.918124] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-19T21:45:59.048459] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-19T21:45:59.314937] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:45:59.843279] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-19T21:46:00.001741] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T21:46:00.643312] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-19T21:46:00.900066] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T21:46:01.443310] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-19T21:46:02.243253] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-19T21:46:02.343280] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T21:46:02.392025] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-19T21:46:03.043326] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-19T21:46:03.214895] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T21:46:03.672918] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T21:46:03.680082] [INFO ] [REMOTE ] TUYA: Full fetch complete (65932 records). [2025-09-19T21:46:03.680264] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-19T21:46:03.860797] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-19T21:46:04.100167] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-19T21:46:04.100247] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-19T21:46:04.101310] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-19T21:46:04.101386] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-19T21:46:04.102802] [DEBUG] [LOCAL ] TUYA: Trimmed 65932 records to 47368 (keeping 200 days of data) [2025-09-19T21:46:04.373671] [DEBUG] [LOCAL ] TUYA: Primary data saved (47368 records). [2025-09-19T21:46:04.373825] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-19T21:46:04.373915] [INFO ] [MAIN ] Update Progress: 2151/2372 symbols completed. TUYA took 38.1s. Estimated remaining: 29m 23s. Rate: 7.5 symbols/min [2025-09-19T21:46:04.541427] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:46:04.546928] [DEBUG] [LOCAL ] TWN: Loaded 3362 existing records from primary storage. [2025-09-19T21:46:04.547066] [INFO ] [MAIN ] TWN: Loaded 3362 existing records. [2025-09-19T21:46:04.646497] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-19T21:46:04.725538] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:46:04.725803] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-19T21:46:04.725852] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-19T21:46:04.726111] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-19T21:46:04.726168] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-19T21:46:05.095303] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:46:05.134122] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T21:46:05.443301] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-19T21:46:05.593779] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-19T21:46:06.243428] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-19T21:46:06.269513] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-19T21:46:06.374901] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T21:46:07.043262] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-19T21:46:07.419534] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-19T21:46:07.842118] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-19T21:46:07.844272] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-19T21:46:07.849352] [INFO ] [REMOTE ] TV: Full fetch complete (62716 records). [2025-09-19T21:46:07.849440] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-19T21:46:08.232587] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-19T21:46:08.232711] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-19T21:46:08.233753] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-19T21:46:08.233815] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-19T21:46:08.235138] [DEBUG] [LOCAL ] TV: Trimmed 62716 records to 43675 (keeping 200 days of data) [2025-09-19T21:46:08.487553] [DEBUG] [LOCAL ] TV: Primary data saved (43675 records). [2025-09-19T21:46:08.487716] [INFO ] [MAIN ] TV: Full history saved. [2025-09-19T21:46:08.487827] [INFO ] [MAIN ] Update Progress: 2152/2372 symbols completed. TV took 37.3s. Estimated remaining: 29m 15s. Rate: 7.5 symbols/min [2025-09-19T21:46:08.647709] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-19T21:46:08.663739] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:46:08.675113] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T21:46:08.719930] [DEBUG] [LOCAL ] TWO: Loaded 48571 existing records from primary storage. [2025-09-19T21:46:08.720072] [INFO ] [MAIN ] TWO: Loaded 48571 existing records. [2025-09-19T21:46:08.895265] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:46:08.895560] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-19T21:46:08.895616] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-19T21:46:08.897005] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-19T21:46:08.897075] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-19T21:46:09.267222] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:46:09.443263] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-19T21:46:09.803188] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-19T21:46:10.194591] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T21:46:10.243241] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-19T21:46:11.043280] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-19T21:46:11.735067] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-19T21:46:11.843276] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-19T21:46:12.094253] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T21:46:12.643296] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-19T21:46:12.888382] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T21:46:13.443298] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-19T21:46:14.051777] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-19T21:46:14.243277] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-19T21:46:14.506259] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T21:46:15.043267] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-19T21:46:15.843286] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-19T21:46:16.153896] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-19T21:46:16.589780] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T21:46:16.643323] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-19T21:46:16.794891] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T21:46:17.443359] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-19T21:46:17.999917] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T21:46:18.243281] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-19T21:46:18.407145] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T21:46:19.043301] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-19T21:46:19.409267] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-19T21:46:19.410350] [INFO ] [REMOTE ] TWN: Full fetch complete (5334 records). [2025-09-19T21:46:19.410458] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-19T21:46:19.775020] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-19T21:46:19.775171] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-19T21:46:19.775406] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-19T21:46:19.775529] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-19T21:46:19.776100] [DEBUG] [LOCAL ] TWN: Trimmed 5334 records to 3371 (keeping 200 days of data) [2025-09-19T21:46:19.822278] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T21:46:19.835825] [DEBUG] [LOCAL ] TWN: Primary data saved (3371 records). [2025-09-19T21:46:19.835912] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-19T21:46:19.836005] [INFO ] [MAIN ] Update Progress: 2153/2372 symbols completed. TWN took 15.5s. Estimated remaining: 29m 7s. Rate: 7.5 symbols/min [2025-09-19T21:46:19.848370] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-19T21:46:20.007838] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:46:20.008026] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-19T21:46:20.008064] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-19T21:46:20.008275] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-19T21:46:20.008326] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-19T21:46:20.008368] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-19T21:46:20.008421] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-19T21:46:20.384169] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:46:20.643265] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-19T21:46:20.874143] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:46:20.874515] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-19T21:46:21.443326] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-19T21:46:21.660121] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:46:21.660457] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-19T21:46:22.176852] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-19T21:46:22.243247] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-19T21:46:23.043274] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-19T21:46:23.843267] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-19T21:46:24.139230] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-19T21:46:24.643312] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-19T21:46:25.124096] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T21:46:25.161702] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:46:25.162057] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-19T21:46:25.198199] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T21:46:25.443286] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-19T21:46:26.243272] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-19T21:46:27.043342] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-19T21:46:27.201344] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T21:46:27.256118] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:46:27.256394] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-19T21:46:27.843260] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-19T21:46:28.148505] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T21:46:28.643263] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-19T21:46:28.887012] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:46:28.887329] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-19T21:46:29.425639] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T21:46:29.443178] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-19T21:46:30.243291] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-19T21:46:30.335487] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T21:46:31.043323] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-19T21:46:31.792774] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T21:46:31.843220] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-19T21:46:32.643271] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-19T21:46:33.170556] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T21:46:33.177217] [INFO ] [REMOTE ] TWI: Full fetch complete (53410 records). [2025-09-19T21:46:33.177353] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-19T21:46:33.444368] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-19T21:46:33.611042] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-19T21:46:33.641826] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-19T21:46:33.642098] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-19T21:46:33.643516] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-19T21:46:33.643930] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-19T21:46:33.647546] [DEBUG] [LOCAL ] TWI: Trimmed 53410 records to 35388 (keeping 200 days of data) [2025-09-19T21:46:33.864591] [DEBUG] [LOCAL ] TWI: Primary data saved (35388 records). [2025-09-19T21:46:33.864749] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-19T21:46:33.864904] [INFO ] [MAIN ] Update Progress: 2154/2372 symbols completed. TWI took 39.4s. Estimated remaining: 28m 60s. Rate: 7.5 symbols/min [2025-09-19T21:46:34.037857] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:46:34.075814] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-19T21:46:34.100836] [DEBUG] [LOCAL ] TX: Loaded 23999 existing records from primary storage. [2025-09-19T21:46:34.100973] [INFO ] [MAIN ] TX: Loaded 23999 existing records. [2025-09-19T21:46:34.248355] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-19T21:46:34.292199] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:46:34.292461] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-19T21:46:34.292512] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-19T21:46:34.293179] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-19T21:46:34.293252] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-19T21:46:34.419341] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-19T21:46:34.669898] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:46:35.043290] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-19T21:46:35.579787] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-19T21:46:35.843259] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-19T21:46:36.643273] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-19T21:46:36.709163] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-19T21:46:36.760621] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T21:46:37.443262] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-19T21:46:37.799967] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T21:46:38.243279] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-19T21:46:38.961331] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-19T21:46:38.963043] [INFO ] [REMOTE ] TWOD: Full fetch complete (4219 records). [2025-09-19T21:46:38.963119] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-19T21:46:39.048507] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-19T21:46:39.203431] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 87 unique days, need 200 days [2025-09-19T21:46:39.203679] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:46:39.203750] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:46:39.203819] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-19T21:46:39.203887] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-19T21:46:39.203922] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-19T21:46:39.203961] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-19T21:46:39.204035] [INFO ] [MAIN ] Update Progress: 2155/2372 symbols completed. TWOD took 19.4s. Estimated remaining: 28m 51s. Rate: 7.5 symbols/min [2025-09-19T21:46:39.372699] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:46:39.439055] [DEBUG] [LOCAL ] TXNM: Loaded 44448 existing records from primary storage. [2025-09-19T21:46:39.439240] [INFO ] [MAIN ] TXNM: Loaded 44448 existing records. [2025-09-19T21:46:39.627357] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:46:39.628012] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-19T21:46:39.628121] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-19T21:46:39.629488] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-19T21:46:39.629554] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-19T21:46:39.780237] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T21:46:39.849401] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-19T21:46:40.038009] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:46:40.643257] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-19T21:46:40.811864] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T21:46:41.211325] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T21:46:41.443318] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-19T21:46:42.243264] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-19T21:46:42.345846] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T21:46:43.043265] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-19T21:46:43.276196] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-19T21:46:43.843269] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-19T21:46:43.962559] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-19T21:46:44.643262] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-19T21:46:44.780380] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T21:46:45.443237] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-19T21:46:46.140352] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-19T21:46:46.243259] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-19T21:46:46.302215] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-19T21:46:46.361476] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T21:46:46.372277] [INFO ] [REMOTE ] TWO: Full fetch complete (68671 records). [2025-09-19T21:46:46.372441] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-19T21:46:46.798717] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-19T21:46:46.799234] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-19T21:46:46.800526] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-19T21:46:46.800611] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-19T21:46:46.802193] [DEBUG] [LOCAL ] TWO: Trimmed 68671 records to 48924 (keeping 200 days of data) [2025-09-19T21:46:47.043676] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-19T21:46:47.121582] [DEBUG] [LOCAL ] TWO: Primary data saved (48924 records). [2025-09-19T21:46:47.121753] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-19T21:46:47.121878] [INFO ] [MAIN ] Update Progress: 2156/2372 symbols completed. TWO took 38.6s. Estimated remaining: 28m 43s. Rate: 7.5 symbols/min [2025-09-19T21:46:47.299310] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:46:47.324953] [DEBUG] [LOCAL ] TXO: Loaded 18834 existing records from primary storage. [2025-09-19T21:46:47.325837] [INFO ] [MAIN ] TXO: Loaded 18834 existing records. [2025-09-19T21:46:47.519318] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:46:47.519566] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-19T21:46:47.519617] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-19T21:46:47.520323] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-19T21:46:47.520385] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-19T21:46:47.848479] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-19T21:46:47.907178] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:46:47.973563] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T21:46:48.236930] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T21:46:48.643279] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-19T21:46:49.443288] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-19T21:46:49.598217] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T21:46:49.606508] [INFO ] [REMOTE ] TWLO: Full fetch complete (76428 records). [2025-09-19T21:46:49.606712] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-19T21:46:50.030381] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-19T21:46:50.030467] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-19T21:46:50.031559] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-19T21:46:50.031624] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-19T21:46:50.033753] [DEBUG] [LOCAL ] TWLO: Trimmed 76428 records to 53497 (keeping 200 days of data) [2025-09-19T21:46:50.169469] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-19T21:46:50.249154] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-19T21:46:50.407971] [DEBUG] [LOCAL ] TWLO: Primary data saved (53497 records). [2025-09-19T21:46:50.408131] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-19T21:46:50.408677] [INFO ] [MAIN ] Update Progress: 2157/2372 symbols completed. TWLO took 52.0s. Estimated remaining: 28m 35s. Rate: 7.5 symbols/min [2025-09-19T21:46:51.019498] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-19T21:46:51.043290] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-19T21:46:51.556570] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-19T21:46:51.843258] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-19T21:46:51.994753] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-19T21:46:52.643350] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-19T21:46:52.678564] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-19T21:46:53.443275] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-19T21:46:53.626614] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T21:46:54.243331] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-19T21:46:55.043343] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-19T21:46:55.321983] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T21:46:55.425686] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T21:46:55.843300] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-19T21:46:55.960359] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-19T21:46:56.643316] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-19T21:46:57.443268] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-19T21:46:57.717584] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T21:46:57.908280] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-19T21:46:58.243307] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-19T21:46:58.596369] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T21:46:58.950022] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T21:46:58.953582] [INFO ] [REMOTE ] TX: Full fetch complete (35807 records). [2025-09-19T21:46:58.953754] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-19T21:46:59.048494] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-19T21:46:59.342151] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-19T21:46:59.342274] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-19T21:46:59.343132] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-19T21:46:59.343212] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-19T21:46:59.344360] [DEBUG] [LOCAL ] TX: Trimmed 35807 records to 24231 (keeping 200 days of data) [2025-09-19T21:46:59.491437] [DEBUG] [LOCAL ] TX: Primary data saved (24231 records). [2025-09-19T21:46:59.491592] [INFO ] [MAIN ] TX: Full history saved. [2025-09-19T21:46:59.491707] [INFO ] [MAIN ] Update Progress: 2158/2372 symbols completed. TX took 25.6s. Estimated remaining: 28m 27s. Rate: 7.5 symbols/min [2025-09-19T21:46:59.843345] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-19T21:47:00.810203] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-19T21:47:00.813379] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-19T21:47:00.958962] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T21:47:01.443382] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-19T21:47:01.795241] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T21:47:02.243328] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-19T21:47:02.894302] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-19T21:47:03.043289] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-19T21:47:03.572185] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T21:47:03.843307] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-19T21:47:04.706449] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-19T21:47:04.717452] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-19T21:47:05.280350] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T21:47:05.443344] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-19T21:47:06.244562] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T21:47:06.252799] [INFO ] [REMOTE ] TXNM: Full fetch complete (62819 records). [2025-09-19T21:47:06.252933] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-19T21:47:06.631678] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-19T21:47:06.631782] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-19T21:47:06.632819] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-19T21:47:06.632880] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-19T21:47:06.634286] [DEBUG] [LOCAL ] TXNM: Trimmed 62819 records to 44698 (keeping 200 days of data) [2025-09-19T21:47:06.875805] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T21:47:06.883213] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-19T21:47:06.949939] [DEBUG] [LOCAL ] TXNM: Primary data saved (44698 records). [2025-09-19T21:47:06.950121] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-19T21:47:06.950237] [INFO ] [MAIN ] Update Progress: 2159/2372 symbols completed. TXNM took 27.7s. Estimated remaining: 28m 19s. Rate: 7.5 symbols/min [2025-09-19T21:47:08.026358] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T21:47:08.029723] [INFO ] [REMOTE ] TXO: Full fetch complete (25787 records). [2025-09-19T21:47:08.029839] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-19T21:47:08.418944] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-19T21:47:08.419072] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-19T21:47:08.419970] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-19T21:47:08.420033] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-19T21:47:08.420891] [DEBUG] [LOCAL ] TXO: Trimmed 25787 records to 18968 (keeping 200 days of data) [2025-09-19T21:47:08.550164] [DEBUG] [LOCAL ] TXO: Primary data saved (18968 records). [2025-09-19T21:47:08.550387] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-19T21:47:08.550499] [INFO ] [MAIN ] Update Progress: 2160/2372 symbols completed. TXO took 21.4s. Estimated remaining: 28m 11s. Rate: 7.5 symbols/min [2025-09-19T21:47:09.201706] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:47:09.245050] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:47:09.263566] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:47:09.300752] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:47:09.317376] [DEBUG] [LOCAL ] TYG: Loaded 14583 existing records from primary storage. [2025-09-19T21:47:09.317741] [INFO ] [MAIN ] TYG: Loaded 14583 existing records. [2025-09-19T21:47:09.367488] [DEBUG] [LOCAL ] TY: Loaded 7746 existing records from primary storage. [2025-09-19T21:47:09.427027] [INFO ] [MAIN ] TY: Loaded 7746 existing records. [2025-09-19T21:47:09.537014] [DEBUG] [LOCAL ] TYL: Loaded 22643 existing records from primary storage. [2025-09-19T21:47:09.572896] [INFO ] [MAIN ] TYL: Loaded 22643 existing records. [2025-09-19T21:47:09.650830] [DEBUG] [LOCAL ] TXT: Loaded 50166 existing records from primary storage. [2025-09-19T21:47:09.695756] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:47:09.743139] [INFO ] [MAIN ] TXT: Loaded 50166 existing records. [2025-09-19T21:47:09.773032] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-19T21:47:09.822746] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-19T21:47:09.899428] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-19T21:47:09.957828] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-19T21:47:10.134995] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:47:10.121377] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:47:10.160524] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-19T21:47:10.176227] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-19T21:47:10.206181] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-19T21:47:10.230361] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-19T21:47:10.246688] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-19T21:47:10.262889] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-19T21:47:10.263041] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-19T21:47:10.279070] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:47:10.279169] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-19T21:47:10.362463] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-19T21:47:10.402173] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-19T21:47:10.573479] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-19T21:47:10.628830] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-19T21:47:11.001603] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:47:11.042759] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-19T21:47:11.441308] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:47:11.503596] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-19T21:47:11.673265] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:47:11.677791] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:47:11.678309] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-19T21:47:11.678715] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-19T21:47:12.188756] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T21:47:12.192114] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-19T21:47:12.479465] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T21:47:12.484104] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-19T21:47:12.723571] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T21:47:12.726158] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-19T21:47:13.459362] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T21:47:13.464834] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-19T21:47:13.638491] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T21:47:13.652172] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-19T21:47:13.671861] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T21:47:13.973770] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T21:47:14.160924] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-19T21:47:14.243289] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-19T21:47:14.695949] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-19T21:47:15.043268] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-19T21:47:15.843270] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-19T21:47:15.958383] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T21:47:16.501045] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-19T21:47:16.643247] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-19T21:47:17.030580] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T21:47:17.443264] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-19T21:47:18.150681] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T21:47:18.243219] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-19T21:47:18.632802] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T21:47:19.043266] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-19T21:47:19.857824] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-19T21:47:19.881639] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T21:47:20.174789] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-19T21:47:20.643364] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-19T21:47:20.864583] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T21:47:21.443318] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-19T21:47:21.721870] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T21:47:22.243290] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-19T21:47:22.999542] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-19T21:47:23.043221] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-19T21:47:23.512930] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T21:47:23.843263] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-19T21:47:24.622446] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-19T21:47:24.645457] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-19T21:47:24.649718] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T21:47:25.443290] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-19T21:47:26.158943] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-19T21:47:26.243337] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-19T21:47:26.376176] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T21:47:27.043241] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-19T21:47:27.843296] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-19T21:47:28.044670] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T21:47:28.047219] [INFO ] [REMOTE ] TYG: Full fetch complete (22466 records). [2025-09-19T21:47:28.047307] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-19T21:47:28.399011] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T21:47:28.481378] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-19T21:47:28.481489] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-19T21:47:28.482127] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-19T21:47:28.482190] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-19T21:47:28.482917] [DEBUG] [LOCAL ] TYG: Trimmed 22466 records to 14677 (keeping 200 days of data) [2025-09-19T21:47:28.575160] [DEBUG] [LOCAL ] TYG: Primary data saved (14677 records). [2025-09-19T21:47:28.575320] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-19T21:47:28.575422] [INFO ] [MAIN ] Update Progress: 2161/2372 symbols completed. TYG took 20.0s. Estimated remaining: 28m 4s. Rate: 7.5 symbols/min [2025-09-19T21:47:28.648785] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-19T21:47:28.751469] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:47:28.805117] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-09-19T21:47:28.805277] [INFO ] [MAIN ] U: Loaded 54189 existing records. [2025-09-19T21:47:28.995921] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:47:28.996385] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-19T21:47:28.996512] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-19T21:47:28.997769] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-19T21:47:28.997832] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-19T21:47:29.129052] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T21:47:29.387825] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:47:29.443226] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-19T21:47:29.789401] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-19T21:47:30.243314] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-19T21:47:30.717005] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-19T21:47:31.043269] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-19T21:47:31.770664] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-19T21:47:31.843234] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-19T21:47:32.002357] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T21:47:32.643304] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-19T21:47:33.443250] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-19T21:47:33.965716] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T21:47:34.243300] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-19T21:47:34.391251] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-19T21:47:34.391811] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T21:47:35.043333] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-19T21:47:35.492681] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T21:47:35.843351] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-19T21:47:36.643352] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-19T21:47:37.190993] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-19T21:47:37.193111] [INFO ] [REMOTE ] TY: Full fetch complete (11774 records). [2025-09-19T21:47:37.193209] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-19T21:47:37.448616] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-19T21:47:37.547437] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T21:47:37.682507] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-19T21:47:37.682688] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-19T21:47:37.683359] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-19T21:47:37.683533] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-19T21:47:37.687019] [DEBUG] [LOCAL ] TY: Trimmed 11774 records to 7780 (keeping 200 days of data) [2025-09-19T21:47:37.686849] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-19T21:47:37.751181] [DEBUG] [LOCAL ] TY: Primary data saved (7780 records). [2025-09-19T21:47:37.751351] [INFO ] [MAIN ] TY: Full history saved. [2025-09-19T21:47:37.751491] [INFO ] [MAIN ] Update Progress: 2162/2372 symbols completed. TY took 29.2s. Estimated remaining: 27m 56s. Rate: 7.5 symbols/min [2025-09-19T21:47:37.931512] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:47:37.989064] [DEBUG] [LOCAL ] UA: Loaded 50758 existing records from primary storage. [2025-09-19T21:47:37.989251] [INFO ] [MAIN ] UA: Loaded 50758 existing records. [2025-09-19T21:47:38.166874] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:47:38.167114] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-19T21:47:38.167162] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-19T21:47:38.168273] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-19T21:47:38.168336] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-19T21:47:38.248336] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-19T21:47:38.530748] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:47:39.043236] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-19T21:47:39.616098] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T21:47:39.843269] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-19T21:47:40.203091] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T21:47:40.308313] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-19T21:47:40.643304] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-19T21:47:40.923216] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T21:47:41.443281] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-19T21:47:42.243292] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-19T21:47:42.979169] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-19T21:47:43.043363] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-19T21:47:43.103532] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-19T21:47:43.200956] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T21:47:43.843273] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-19T21:47:43.910802] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T21:47:43.914390] [INFO ] [REMOTE ] TYL: Full fetch complete (31418 records). [2025-09-19T21:47:43.914521] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-19T21:47:44.311916] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-19T21:47:44.312025] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-19T21:47:44.312861] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-19T21:47:44.312927] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-19T21:47:44.313923] [DEBUG] [LOCAL ] TYL: Trimmed 31418 records to 22841 (keeping 200 days of data) [2025-09-19T21:47:44.456411] [DEBUG] [LOCAL ] TYL: Primary data saved (22841 records). [2025-09-19T21:47:44.456550] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-19T21:47:44.456672] [INFO ] [MAIN ] Update Progress: 2163/2372 symbols completed. TYL took 35.9s. Estimated remaining: 27m 48s. Rate: 7.5 symbols/min [2025-09-19T21:47:44.632202] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:47:44.643318] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-19T21:47:44.687901] [DEBUG] [LOCAL ] UAA: Loaded 53900 existing records from primary storage. [2025-09-19T21:47:44.688055] [INFO ] [MAIN ] UAA: Loaded 53900 existing records. [2025-09-19T21:47:44.888260] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:47:44.888703] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-19T21:47:44.888769] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-19T21:47:44.889929] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-19T21:47:44.889992] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-19T21:47:45.357852] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:47:45.443347] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-19T21:47:45.722112] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T21:47:46.243357] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-19T21:47:46.934437] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T21:47:46.942238] [INFO ] [REMOTE ] TXT: Full fetch complete (72154 records). [2025-09-19T21:47:46.942431] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-19T21:47:47.049889] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-19T21:47:47.359263] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-19T21:47:47.359377] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-19T21:47:47.360559] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-19T21:47:47.360623] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-19T21:47:47.362212] [DEBUG] [LOCAL ] TXT: Trimmed 72154 records to 50523 (keeping 200 days of data) [2025-09-19T21:47:47.487478] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-19T21:47:47.742170] [DEBUG] [LOCAL ] TXT: Primary data saved (50523 records). [2025-09-19T21:47:47.742505] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-19T21:47:47.742706] [INFO ] [MAIN ] Update Progress: 2164/2372 symbols completed. TXT took 39.2s. Estimated remaining: 27m 39s. Rate: 7.5 symbols/min [2025-09-19T21:47:47.848324] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-19T21:47:47.947122] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T21:47:47.966931] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:47:47.989473] [DEBUG] [LOCAL ] UAN: Loaded 5573 existing records from primary storage. [2025-09-19T21:47:47.989696] [INFO ] [MAIN ] UAN: Loaded 5573 existing records. [2025-09-19T21:47:48.212679] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:47:48.213141] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-19T21:47:48.213212] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-19T21:47:48.213857] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-19T21:47:48.214019] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-19T21:47:48.592265] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:47:48.643314] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-19T21:47:48.757325] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T21:47:49.443286] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-19T21:47:50.243355] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-19T21:47:50.411095] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-19T21:47:50.699607] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-19T21:47:50.871974] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T21:47:51.043710] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-19T21:47:51.049550] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T21:47:51.843310] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-19T21:47:52.643276] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-19T21:47:53.443318] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-19T21:47:53.745802] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T21:47:53.788898] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-19T21:47:53.966116] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-19T21:47:54.243269] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-19T21:47:54.593344] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T21:47:55.043277] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-19T21:47:55.715105] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T21:47:55.843287] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-19T21:47:55.958007] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T21:47:56.643347] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-19T21:47:57.443339] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-19T21:47:57.814923] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T21:47:58.243281] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-19T21:47:58.742866] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T21:47:59.043275] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-19T21:47:59.725615] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T21:47:59.843345] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-19T21:48:00.122165] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-19T21:48:00.643291] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-19T21:48:00.705353] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T21:48:01.337134] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-19T21:48:01.443364] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-19T21:48:02.243305] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-19T21:48:03.043345] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-19T21:48:03.594732] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-19T21:48:03.603553] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-09-19T21:48:03.603867] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-19T21:48:04.014348] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-19T21:48:04.014452] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-19T21:48:04.015601] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-19T21:48:04.015691] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-19T21:48:04.017352] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 54579 (keeping 200 days of data) [2025-09-19T21:48:04.368425] [DEBUG] [LOCAL ] U: Primary data saved (54579 records). [2025-09-19T21:48:04.368570] [INFO ] [MAIN ] U: Full history saved. [2025-09-19T21:48:04.368678] [INFO ] [MAIN ] Update Progress: 2165/2372 symbols completed. U took 35.8s. Estimated remaining: 27m 32s. Rate: 7.5 symbols/min [2025-09-19T21:48:04.544669] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:48:04.552181] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T21:48:04.555404] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-19T21:48:04.598943] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (3.16 seconds). [2025-09-19T21:48:04.656214] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-19T21:48:04.659723] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-09-19T21:48:04.659997] [INFO ] [MAIN ] UBER: Loaded 54196 existing records. [2025-09-19T21:48:04.843844] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:48:04.844157] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-19T21:48:04.844216] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-19T21:48:04.846119] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-19T21:48:04.846182] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-19T21:48:05.203544] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:48:05.443277] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-19T21:48:05.486340] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T21:48:05.512255] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-19T21:48:05.520147] [INFO ] [REMOTE ] UA: Full fetch complete (72881 records). [2025-09-19T21:48:05.520269] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-19T21:48:05.917219] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-19T21:48:05.917308] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-19T21:48:05.918401] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-19T21:48:05.918464] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-19T21:48:05.920080] [DEBUG] [LOCAL ] UA: Trimmed 72881 records to 51145 (keeping 200 days of data) [2025-09-19T21:48:06.219144] [DEBUG] [LOCAL ] UA: Primary data saved (51145 records). [2025-09-19T21:48:06.219294] [INFO ] [MAIN ] UA: Full history saved. [2025-09-19T21:48:06.219383] [INFO ] [MAIN ] Update Progress: 2166/2372 symbols completed. UA took 28.5s. Estimated remaining: 27m 24s. Rate: 7.5 symbols/min [2025-09-19T21:48:06.254791] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-19T21:48:06.436044] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T21:48:06.434378] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:48:06.499603] [DEBUG] [LOCAL ] UBS: Loaded 52883 existing records from primary storage. [2025-09-19T21:48:06.499851] [INFO ] [MAIN ] UBS: Loaded 52883 existing records. [2025-09-19T21:48:06.677921] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:48:06.678157] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-19T21:48:06.678203] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-19T21:48:06.679826] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-19T21:48:06.679887] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-19T21:48:07.042804] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:48:07.043157] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-19T21:48:07.194619] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T21:48:07.843257] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-19T21:48:08.523336] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (3.08 seconds). [2025-09-19T21:48:08.546698] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T21:48:08.643255] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-19T21:48:08.897539] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T21:48:09.197081] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-19T21:48:09.443264] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-19T21:48:10.243266] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-19T21:48:11.043270] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-19T21:48:11.560424] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T21:48:11.843317] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-19T21:48:12.643324] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-19T21:48:12.710878] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T21:48:12.930662] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-09-19T21:48:13.443324] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-19T21:48:13.526261] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T21:48:13.527500] [INFO ] [REMOTE ] UAN: Full fetch complete (8464 records). [2025-09-19T21:48:13.527571] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-19T21:48:13.880451] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-19T21:48:13.880528] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-19T21:48:13.880766] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-19T21:48:13.880825] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-19T21:48:13.881233] [DEBUG] [LOCAL ] UAN: Trimmed 8464 records to 5615 (keeping 200 days of data) [2025-09-19T21:48:13.914855] [DEBUG] [LOCAL ] UAN: Primary data saved (5615 records). [2025-09-19T21:48:13.914926] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-19T21:48:13.915010] [INFO ] [MAIN ] Update Progress: 2167/2372 symbols completed. UAN took 26.2s. Estimated remaining: 27m 16s. Rate: 7.5 symbols/min [2025-09-19T21:48:14.097933] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:48:14.139579] [DEBUG] [LOCAL ] UCB: Loaded 38471 existing records from primary storage. [2025-09-19T21:48:14.139757] [INFO ] [MAIN ] UCB: Loaded 38471 existing records. [2025-09-19T21:48:14.248480] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-19T21:48:14.324355] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:48:14.324724] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-19T21:48:14.324788] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-19T21:48:14.325958] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-19T21:48:14.326030] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-19T21:48:14.696464] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:48:14.946504] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (3.10 seconds). [2025-09-19T21:48:15.043239] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-19T21:48:15.843337] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-19T21:48:16.910086] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-19T21:48:16.921600] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-19T21:48:17.220990] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T21:48:17.265416] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (3.82 seconds). [2025-09-19T21:48:17.443251] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-19T21:48:17.474159] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T21:48:18.243225] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-19T21:48:18.916045] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-19T21:48:18.924048] [INFO ] [REMOTE ] UAA: Full fetch complete (77481 records). [2025-09-19T21:48:18.924214] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-19T21:48:19.048344] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-19T21:48:19.351764] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-19T21:48:19.351847] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-19T21:48:19.353398] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-19T21:48:19.353463] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-19T21:48:19.355060] [DEBUG] [LOCAL ] UAA: Trimmed 77481 records to 54290 (keeping 200 days of data) [2025-09-19T21:48:19.699406] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T21:48:19.730386] [DEBUG] [LOCAL ] UAA: Primary data saved (54290 records). [2025-09-19T21:48:19.730509] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-19T21:48:19.730588] [INFO ] [MAIN ] Update Progress: 2168/2372 symbols completed. UAA took 35.3s. Estimated remaining: 27m 7s. Rate: 7.5 symbols/min [2025-09-19T21:48:19.846910] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-19T21:48:19.901115] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:48:19.929831] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T21:48:19.988080] [DEBUG] [LOCAL ] UDR: Loaded 52187 existing records from primary storage. [2025-09-19T21:48:19.988253] [INFO ] [MAIN ] UDR: Loaded 52187 existing records. [2025-09-19T21:48:20.162762] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:48:20.162991] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-19T21:48:20.163038] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-19T21:48:20.164041] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-19T21:48:20.164114] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-19T21:48:20.512986] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:48:20.643248] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-19T21:48:21.443283] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-19T21:48:21.514532] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T21:48:22.243240] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-19T21:48:22.526670] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T21:48:22.957506] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T21:48:23.008958] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (3.16 seconds). [2025-09-19T21:48:23.043227] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-19T21:48:23.843273] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-19T21:48:24.353698] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T21:48:24.567391] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-19T21:48:24.643266] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-19T21:48:25.253284] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-19T21:48:25.443241] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-19T21:48:26.171112] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-19T21:48:26.243287] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-19T21:48:27.043311] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-19T21:48:27.669043] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T21:48:27.843283] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-19T21:48:27.989788] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T21:48:28.179889] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T21:48:28.643253] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-19T21:48:29.443280] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-19T21:48:30.212021] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T21:48:30.243282] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-19T21:48:30.492731] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-19T21:48:31.043260] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-19T21:48:31.418532] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T21:48:31.527164] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T21:48:31.843265] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-19T21:48:32.643325] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-19T21:48:33.299162] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T21:48:33.443253] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-19T21:48:33.923200] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T21:48:34.134669] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-19T21:48:34.243268] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-19T21:48:35.043350] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-19T21:48:35.540589] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-19T21:48:35.843280] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-19T21:48:36.173127] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-19T21:48:36.184590] [INFO ] [REMOTE ] UBS: Full fetch complete (75572 records). [2025-09-19T21:48:36.184915] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-19T21:48:36.426756] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T21:48:36.645870] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-19T21:48:36.649823] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-19T21:48:36.649955] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-19T21:48:36.652098] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-19T21:48:36.672511] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-19T21:48:36.677039] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T21:48:36.687671] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-09-19T21:48:36.687526] [DEBUG] [LOCAL ] UBS: Trimmed 75572 records to 53254 (keeping 200 days of data) [2025-09-19T21:48:36.687850] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-19T21:48:37.410511] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-19T21:48:37.410947] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-19T21:48:37.412391] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-19T21:48:37.412476] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-19T21:48:37.450220] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-19T21:48:37.450117] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 54586 (keeping 200 days of data) [2025-09-19T21:48:37.502910] [DEBUG] [LOCAL ] UBS: Primary data saved (53254 records). [2025-09-19T21:48:37.553872] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-19T21:48:37.554147] [INFO ] [MAIN ] Update Progress: 2169/2372 symbols completed. UBS took 31.3s. Estimated remaining: 27m 0s. Rate: 7.5 symbols/min [2025-09-19T21:48:37.809042] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:48:38.038404] [DEBUG] [LOCAL ] UBER: Primary data saved (54586 records). [2025-09-19T21:48:38.038606] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-19T21:48:38.038817] [INFO ] [MAIN ] Update Progress: 2170/2372 symbols completed. UBER took 33.7s. Estimated remaining: 26m 52s. Rate: 7.5 symbols/min [2025-09-19T21:48:38.159168] [DEBUG] [LOCAL ] UE: Loaded 43394 existing records from primary storage. [2025-09-19T21:48:38.165131] [INFO ] [MAIN ] UE: Loaded 43394 existing records. [2025-09-19T21:48:38.362727] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:48:38.446427] [DEBUG] [LOCAL ] UFI: Loaded 8340 existing records from primary storage. [2025-09-19T21:48:38.470141] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:48:38.462792] [INFO ] [MAIN ] UFI: Loaded 8340 existing records. [2025-09-19T21:48:38.500630] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-19T21:48:38.512069] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-19T21:48:38.570841] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-19T21:48:38.576676] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-19T21:48:38.858596] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:48:38.879670] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-19T21:48:38.891130] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-19T21:48:38.923411] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-19T21:48:38.929722] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-19T21:48:39.242332] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-19T21:48:39.384031] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-19T21:48:39.671721] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:48:39.684964] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-19T21:48:39.786593] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-19T21:48:39.848838] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-19T21:48:39.894510] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:48:40.643345] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-19T21:48:41.453434] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T21:48:41.464449] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-19T21:48:41.511922] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T21:48:41.517265] [INFO ] [REMOTE ] UCB: Full fetch complete (54717 records). [2025-09-19T21:48:41.517360] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-19T21:48:41.669003] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T21:48:41.921337] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-19T21:48:41.921472] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-19T21:48:41.922434] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-19T21:48:41.922516] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-19T21:48:41.924308] [DEBUG] [LOCAL ] UCB: Trimmed 54717 records to 38738 (keeping 200 days of data) [2025-09-19T21:48:41.948876] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-19T21:48:42.196632] [DEBUG] [LOCAL ] UCB: Primary data saved (38738 records). [2025-09-19T21:48:42.196808] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-19T21:48:42.198167] [INFO ] [MAIN ] Update Progress: 2171/2372 symbols completed. UCB took 28.3s. Estimated remaining: 26m 43s. Rate: 7.5 symbols/min [2025-09-19T21:48:42.248464] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-19T21:48:42.381498] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:48:42.440317] [DEBUG] [LOCAL ] UGI: Loaded 50925 existing records from primary storage. [2025-09-19T21:48:42.440495] [INFO ] [MAIN ] UGI: Loaded 50925 existing records. [2025-09-19T21:48:42.623295] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:48:42.623580] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-19T21:48:42.623628] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-19T21:48:42.624887] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-19T21:48:42.624950] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-19T21:48:42.982762] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:48:43.043220] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-19T21:48:43.324589] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-19T21:48:43.843254] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-19T21:48:44.321722] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-19T21:48:44.643300] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-19T21:48:44.758178] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-19T21:48:45.279509] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T21:48:45.443219] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-19T21:48:46.255092] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-19T21:48:46.257228] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-19T21:48:47.043279] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-19T21:48:47.252127] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-19T21:48:47.338812] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T21:48:47.843273] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-19T21:48:48.643282] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-19T21:48:49.100968] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T21:48:49.443267] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-19T21:48:49.502608] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T21:48:49.957017] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-19T21:48:50.243308] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-19T21:48:51.043331] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-19T21:48:51.248714] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T21:48:51.360713] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T21:48:51.843262] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-19T21:48:52.169704] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T21:48:52.643267] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-19T21:48:53.443301] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-19T21:48:53.511596] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T21:48:54.243280] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-19T21:48:54.355833] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-19T21:48:54.496455] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T21:48:54.507851] [INFO ] [REMOTE ] UDR: Full fetch complete (74312 records). [2025-09-19T21:48:54.507984] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-19T21:48:54.914778] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-19T21:48:54.914940] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-19T21:48:54.916086] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-19T21:48:54.916153] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-19T21:48:54.917766] [DEBUG] [LOCAL ] UDR: Trimmed 74312 records to 52563 (keeping 200 days of data) [2025-09-19T21:48:55.048492] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-19T21:48:55.274211] [DEBUG] [LOCAL ] UDR: Primary data saved (52563 records). [2025-09-19T21:48:55.274458] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-19T21:48:55.274611] [INFO ] [MAIN ] Update Progress: 2172/2372 symbols completed. UDR took 35.5s. Estimated remaining: 26m 36s. Rate: 7.5 symbols/min [2025-09-19T21:48:55.453397] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:48:55.499116] [DEBUG] [LOCAL ] UGP: Loaded 42890 existing records from primary storage. [2025-09-19T21:48:55.499358] [INFO ] [MAIN ] UGP: Loaded 42890 existing records. [2025-09-19T21:48:55.691476] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:48:55.692273] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-19T21:48:55.692407] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-19T21:48:55.693788] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-19T21:48:55.693893] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-19T21:48:55.848071] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-19T21:48:55.975176] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-19T21:48:56.092840] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T21:48:56.139262] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:48:56.643301] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-19T21:48:57.443276] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-19T21:48:57.556232] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T21:48:58.243273] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-19T21:48:58.374905] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-19T21:48:59.043336] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-19T21:48:59.542530] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T21:48:59.627098] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T21:48:59.843276] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-19T21:49:00.643252] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-19T21:49:00.931735] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-19T21:49:01.073573] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T21:49:01.443282] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-19T21:49:02.126745] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-19T21:49:02.243254] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-19T21:49:03.043279] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-19T21:49:03.164765] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-19T21:49:03.843270] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-19T21:49:04.207375] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-19T21:49:04.643264] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-19T21:49:04.949269] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T21:49:05.443289] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-19T21:49:05.616792] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T21:49:05.898407] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-19T21:49:06.243260] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-19T21:49:06.464063] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T21:49:07.043267] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-19T21:49:07.843251] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-19T21:49:08.181146] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-19T21:49:08.369248] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-19T21:49:08.643262] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-19T21:49:09.443281] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-19T21:49:09.627118] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T21:49:09.633274] [INFO ] [REMOTE ] UE: Full fetch complete (61585 records). [2025-09-19T21:49:09.633377] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-19T21:49:10.017939] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-19T21:49:10.018050] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-19T21:49:10.019061] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-19T21:49:10.019124] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-19T21:49:10.020356] [DEBUG] [LOCAL ] UE: Trimmed 61585 records to 43638 (keeping 200 days of data) [2025-09-19T21:49:10.246521] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-19T21:49:10.303495] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T21:49:10.308015] [INFO ] [REMOTE ] UFI: Full fetch complete (12357 records). [2025-09-19T21:49:10.309448] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-19T21:49:10.345340] [DEBUG] [LOCAL ] UE: Primary data saved (43638 records). [2025-09-19T21:49:10.385522] [INFO ] [MAIN ] UE: Full history saved. [2025-09-19T21:49:10.408517] [INFO ] [MAIN ] Update Progress: 2173/2372 symbols completed. UE took 32.9s. Estimated remaining: 26m 29s. Rate: 7.5 symbols/min [2025-09-19T21:49:10.795467] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:49:10.884707] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-19T21:49:10.884838] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-19T21:49:10.885179] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-19T21:49:10.885270] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-19T21:49:10.886125] [DEBUG] [LOCAL ] UFI: Trimmed 12357 records to 8403 (keeping 200 days of data) [2025-09-19T21:49:10.953760] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-19T21:49:10.977528] [DEBUG] [LOCAL ] UHAL: Loaded 16528 existing records from primary storage. [2025-09-19T21:49:10.978005] [INFO ] [MAIN ] UHAL: Loaded 16528 existing records. [2025-09-19T21:49:11.047078] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-19T21:49:11.095853] [DEBUG] [LOCAL ] UFI: Primary data saved (8403 records). [2025-09-19T21:49:11.096010] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-19T21:49:11.096111] [INFO ] [MAIN ] Update Progress: 2174/2372 symbols completed. UFI took 33.1s. Estimated remaining: 26m 20s. Rate: 7.5 symbols/min [2025-09-19T21:49:11.305098] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:49:11.330767] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-19T21:49:11.350730] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:49:11.349538] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-19T21:49:11.351861] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-19T21:49:11.352577] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-19T21:49:11.697515] [DEBUG] [LOCAL ] UHS: Loaded 41794 existing records from primary storage. [2025-09-19T21:49:11.707927] [INFO ] [MAIN ] UHS: Loaded 41794 existing records. [2025-09-19T21:49:11.856899] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:49:11.867599] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-19T21:49:11.946221] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:49:11.946490] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-19T21:49:11.946558] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-19T21:49:11.947711] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-19T21:49:11.947772] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-19T21:49:12.308339] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:49:12.335793] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T21:49:12.643338] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-19T21:49:12.888775] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T21:49:13.102759] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-19T21:49:13.443245] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-19T21:49:14.243248] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-19T21:49:14.472487] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T21:49:14.492546] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-19T21:49:14.492170] [INFO ] [REMOTE ] UGI: Full fetch complete (73426 records). [2025-09-19T21:49:14.496149] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-19T21:49:14.889003] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-19T21:49:14.889106] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-19T21:49:14.890245] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-19T21:49:14.890310] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-19T21:49:14.891835] [DEBUG] [LOCAL ] UGI: Trimmed 73426 records to 51298 (keeping 200 days of data) [2025-09-19T21:49:15.072946] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-19T21:49:15.216355] [DEBUG] [LOCAL ] UGI: Primary data saved (51298 records). [2025-09-19T21:49:15.216503] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-19T21:49:15.216920] [INFO ] [MAIN ] Update Progress: 2175/2372 symbols completed. UGI took 33.0s. Estimated remaining: 26m 12s. Rate: 7.5 symbols/min [2025-09-19T21:49:15.392667] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:49:15.404914] [DEBUG] [LOCAL ] UHT: Loaded 10094 existing records from primary storage. [2025-09-19T21:49:15.405048] [INFO ] [MAIN ] UHT: Loaded 10094 existing records. [2025-09-19T21:49:15.583805] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:49:15.584034] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-19T21:49:15.584101] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-19T21:49:15.584504] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-19T21:49:15.584565] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-19T21:49:15.850557] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-19T21:49:15.935275] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-19T21:49:15.956450] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:49:15.986674] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T21:49:16.643255] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-19T21:49:17.443236] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-19T21:49:17.686102] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-19T21:49:17.764744] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-19T21:49:18.243269] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-19T21:49:19.043236] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-19T21:49:19.419819] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-19T21:49:19.521526] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-19T21:49:19.843248] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-19T21:49:20.036824] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-19T21:49:20.643265] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-19T21:49:21.443249] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-19T21:49:21.526807] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-19T21:49:21.533234] [INFO ] [REMOTE ] UGP: Full fetch complete (62091 records). [2025-09-19T21:49:21.533338] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-19T21:49:21.865343] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-19T21:49:21.952219] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-19T21:49:21.952303] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-19T21:49:21.953304] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-19T21:49:21.953368] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-19T21:49:21.954725] [DEBUG] [LOCAL ] UGP: Trimmed 62091 records to 43183 (keeping 200 days of data) [2025-09-19T21:49:22.172854] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-19T21:49:22.222797] [DEBUG] [LOCAL ] UGP: Primary data saved (43183 records). [2025-09-19T21:49:22.222923] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-19T21:49:22.223018] [INFO ] [MAIN ] Update Progress: 2176/2372 symbols completed. UGP took 26.9s. Estimated remaining: 26m 3s. Rate: 7.5 symbols/min [2025-09-19T21:49:22.252692] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-19T21:49:22.396893] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:49:22.411110] [DEBUG] [LOCAL ] UI: Loaded 12646 existing records from primary storage. [2025-09-19T21:49:22.411259] [INFO ] [MAIN ] UI: Loaded 12646 existing records. [2025-09-19T21:49:22.591903] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:49:22.592143] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-19T21:49:22.592200] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-19T21:49:22.592601] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-19T21:49:22.592704] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-19T21:49:22.950226] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:49:23.043225] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-19T21:49:23.843285] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-19T21:49:24.280574] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T21:49:24.428071] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T21:49:24.643255] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-19T21:49:24.738005] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-19T21:49:25.443255] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-19T21:49:26.251487] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-19T21:49:26.267408] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-19T21:49:26.530873] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T21:49:27.043332] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-19T21:49:27.421535] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-19T21:49:27.613041] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-19T21:49:27.843306] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-19T21:49:28.643315] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-19T21:49:28.792806] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T21:49:29.443276] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-19T21:49:29.943415] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-19T21:49:30.243261] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-19T21:49:30.483083] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-19T21:49:31.043300] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-19T21:49:31.327520] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-19T21:49:31.843279] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-19T21:49:32.024110] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-19T21:49:32.643319] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-19T21:49:33.124704] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-19T21:49:33.443283] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-19T21:49:34.243307] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-19T21:49:34.564596] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T21:49:34.641261] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-19T21:49:35.043286] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-19T21:49:35.282284] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-19T21:49:35.843242] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-19T21:49:36.032969] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-19T21:49:36.643314] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-19T21:49:36.790698] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T21:49:37.443266] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-19T21:49:38.243323] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-19T21:49:38.546331] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T21:49:38.625222] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T21:49:38.628775] [INFO ] [REMOTE ] UHAL: Full fetch complete (23038 records). [2025-09-19T21:49:38.628858] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-19T21:49:39.001389] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-19T21:49:39.001490] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-19T21:49:39.002015] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-19T21:49:39.002078] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-19T21:49:39.003029] [DEBUG] [LOCAL ] UHAL: Trimmed 23038 records to 16672 (keeping 200 days of data) [2025-09-19T21:49:39.048502] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-19T21:49:39.115096] [DEBUG] [LOCAL ] UHAL: Primary data saved (16672 records). [2025-09-19T21:49:39.115259] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-19T21:49:39.115353] [INFO ] [MAIN ] Update Progress: 2177/2372 symbols completed. UHAL took 28.7s. Estimated remaining: 25m 56s. Rate: 7.5 symbols/min [2025-09-19T21:49:39.245030] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-19T21:49:39.272754] [INFO ] [REMOTE ] UHT: Full fetch complete (15213 records). [2025-09-19T21:49:39.275526] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-19T21:49:39.357242] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:49:39.692439] [DEBUG] [LOCAL ] UIS: Loaded 37454 existing records from primary storage. [2025-09-19T21:49:39.701348] [INFO ] [MAIN ] UIS: Loaded 37454 existing records. [2025-09-19T21:49:39.784810] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-19T21:49:39.801125] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-19T21:49:39.813191] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-19T21:49:39.820234] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-19T21:49:39.840034] [DEBUG] [LOCAL ] UHT: Trimmed 15213 records to 10206 (keeping 200 days of data) [2025-09-19T21:49:39.850607] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-19T21:49:39.955350] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:49:39.968832] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-19T21:49:39.976348] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-19T21:49:39.977923] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-19T21:49:39.978510] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-19T21:49:40.068296] [DEBUG] [LOCAL ] UHT: Primary data saved (10206 records). [2025-09-19T21:49:40.086150] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-19T21:49:40.097756] [INFO ] [MAIN ] Update Progress: 2178/2372 symbols completed. UHT took 24.9s. Estimated remaining: 25m 48s. Rate: 7.5 symbols/min [2025-09-19T21:49:40.481118] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:49:40.554784] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:49:40.564234] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T21:49:40.613793] [DEBUG] [LOCAL ] UL: Loaded 53461 existing records from primary storage. [2025-09-19T21:49:40.613965] [INFO ] [MAIN ] UL: Loaded 53461 existing records. [2025-09-19T21:49:40.648355] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-19T21:49:40.795205] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:49:40.795460] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-19T21:49:40.795509] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-19T21:49:40.796796] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-19T21:49:40.796857] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-19T21:49:41.151994] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:49:41.443274] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-19T21:49:41.759970] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T21:49:41.790912] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T21:49:42.134674] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-19T21:49:42.243274] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-19T21:49:43.043341] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-19T21:49:43.630798] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T21:49:43.843270] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-19T21:49:44.643295] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-19T21:49:44.958194] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-19T21:49:45.220980] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T21:49:45.443299] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-19T21:49:46.152910] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T21:49:46.243276] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-19T21:49:47.043327] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-19T21:49:47.573296] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T21:49:47.843284] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-19T21:49:47.925183] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T21:49:48.051439] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-19T21:49:48.643291] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-19T21:49:49.337243] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-19T21:49:49.443269] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-19T21:49:49.647785] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-19T21:49:50.243300] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-19T21:49:51.043287] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-19T21:49:51.531018] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T21:49:51.661024] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-19T21:49:51.666743] [INFO ] [REMOTE ] UHS: Full fetch complete (58338 records). [2025-09-19T21:49:51.666845] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-19T21:49:51.859820] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-19T21:49:52.061122] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-19T21:49:52.061201] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-19T21:49:52.062185] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-19T21:49:52.062247] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-19T21:49:52.063423] [DEBUG] [LOCAL ] UHS: Trimmed 58338 records to 42032 (keeping 200 days of data) [2025-09-19T21:49:52.340516] [DEBUG] [LOCAL ] UHS: Primary data saved (42032 records). [2025-09-19T21:49:52.340675] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-19T21:49:52.340795] [INFO ] [MAIN ] Update Progress: 2179/2372 symbols completed. UHS took 41.2s. Estimated remaining: 25m 40s. Rate: 7.5 symbols/min [2025-09-19T21:49:52.513013] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:49:52.552774] [DEBUG] [LOCAL ] ULS: Loaded 39475 existing records from primary storage. [2025-09-19T21:49:52.552916] [INFO ] [MAIN ] ULS: Loaded 39475 existing records. [2025-09-19T21:49:52.648361] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-19T21:49:52.742803] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:49:52.743167] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-19T21:49:52.743276] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-19T21:49:52.752117] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-19T21:49:52.764797] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-19T21:49:52.827337] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-19T21:49:53.181571] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:49:53.190448] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T21:49:53.443261] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-19T21:49:54.243277] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-19T21:49:54.847074] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-19T21:49:55.022102] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T21:49:55.043216] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-19T21:49:55.429764] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T21:49:55.843286] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-19T21:49:56.531300] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T21:49:56.643226] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-19T21:49:57.443277] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-19T21:49:57.562535] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T21:49:58.006068] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T21:49:58.243277] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-19T21:49:58.694992] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T21:49:59.043274] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-19T21:49:59.843337] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-19T21:50:00.192442] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T21:50:00.645275] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-19T21:50:00.648015] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T21:50:01.115262] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-19T21:50:01.443322] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-19T21:50:02.243274] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-19T21:50:02.597257] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T21:50:02.601078] [INFO ] [REMOTE ] UI: Full fetch complete (17916 records). [2025-09-19T21:50:02.601198] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-19T21:50:03.012259] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-19T21:50:03.012398] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-19T21:50:03.012850] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-19T21:50:03.013079] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-19T21:50:03.026803] [DEBUG] [LOCAL ] UI: Trimmed 17916 records to 12760 (keeping 200 days of data) [2025-09-19T21:50:03.045970] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-19T21:50:03.051018] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-19T21:50:03.150336] [DEBUG] [LOCAL ] UI: Primary data saved (12760 records). [2025-09-19T21:50:03.150499] [INFO ] [MAIN ] UI: Full history saved. [2025-09-19T21:50:03.150592] [INFO ] [MAIN ] Update Progress: 2180/2372 symbols completed. UI took 40.9s. Estimated remaining: 25m 32s. Rate: 7.5 symbols/min [2025-09-19T21:50:03.318430] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:50:03.370135] [DEBUG] [LOCAL ] UMC: Loaded 53118 existing records from primary storage. [2025-09-19T21:50:03.370279] [INFO ] [MAIN ] UMC: Loaded 53118 existing records. [2025-09-19T21:50:03.561107] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:50:03.561789] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-19T21:50:03.561882] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-19T21:50:03.563091] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-19T21:50:03.563155] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-19T21:50:03.785219] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-19T21:50:03.856034] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-19T21:50:03.983589] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:50:04.262506] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T21:50:04.643271] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-19T21:50:05.443313] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-19T21:50:06.105534] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-19T21:50:06.243272] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-19T21:50:06.412679] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-19T21:50:06.418159] [INFO ] [REMOTE ] UIS: Full fetch complete (51919 records). [2025-09-19T21:50:06.418273] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-19T21:50:06.804995] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-19T21:50:06.805205] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-19T21:50:06.806320] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-19T21:50:06.806409] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-19T21:50:06.808168] [DEBUG] [LOCAL ] UIS: Trimmed 51919 records to 37722 (keeping 200 days of data) [2025-09-19T21:50:06.950578] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-19T21:50:07.043374] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-19T21:50:07.074160] [DEBUG] [LOCAL ] UIS: Primary data saved (37722 records). [2025-09-19T21:50:07.074308] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-19T21:50:07.074412] [INFO ] [MAIN ] Update Progress: 2181/2372 symbols completed. UIS took 28.0s. Estimated remaining: 25m 24s. Rate: 7.5 symbols/min [2025-09-19T21:50:07.268197] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:50:07.303541] [DEBUG] [LOCAL ] UMH: Loaded 33251 existing records from primary storage. [2025-09-19T21:50:07.303711] [INFO ] [MAIN ] UMH: Loaded 33251 existing records. [2025-09-19T21:50:07.511832] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:50:07.512117] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-19T21:50:07.512195] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-19T21:50:07.513080] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-19T21:50:07.513142] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-19T21:50:07.847730] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-19T21:50:07.913716] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:50:07.941490] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-19T21:50:08.643245] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-19T21:50:09.287405] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-19T21:50:09.443266] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-19T21:50:09.738996] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-19T21:50:09.812125] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T21:50:09.819976] [INFO ] [REMOTE ] UL: Full fetch complete (76836 records). [2025-09-19T21:50:09.820110] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-19T21:50:10.215412] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-19T21:50:10.215517] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-19T21:50:10.217057] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-19T21:50:10.217130] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-19T21:50:10.218834] [DEBUG] [LOCAL ] UL: Trimmed 76836 records to 53844 (keeping 200 days of data) [2025-09-19T21:50:10.272795] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-19T21:50:10.555049] [DEBUG] [LOCAL ] UL: Primary data saved (53844 records). [2025-09-19T21:50:10.555214] [INFO ] [MAIN ] UL: Full history saved. [2025-09-19T21:50:10.555308] [INFO ] [MAIN ] Update Progress: 2182/2372 symbols completed. UL took 30.4s. Estimated remaining: 25m 16s. Rate: 7.5 symbols/min [2025-09-19T21:50:10.723746] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:50:10.737307] [DEBUG] [LOCAL ] UNF: Loaded 11907 existing records from primary storage. [2025-09-19T21:50:10.737436] [INFO ] [MAIN ] UNF: Loaded 11907 existing records. [2025-09-19T21:50:10.912039] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:50:10.912304] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-19T21:50:10.912352] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-19T21:50:10.912789] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-19T21:50:10.912854] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-19T21:50:11.052005] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-19T21:50:11.277746] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:50:11.382051] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T21:50:11.843280] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-19T21:50:11.898639] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T21:50:12.377094] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-19T21:50:12.643279] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-19T21:50:13.396802] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T21:50:13.443287] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-19T21:50:13.692211] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-19T21:50:14.243276] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-19T21:50:15.043314] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-19T21:50:15.103962] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T21:50:15.373047] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T21:50:15.843270] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-19T21:50:16.643274] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-19T21:50:16.697071] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-19T21:50:17.036739] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-19T21:50:17.443266] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-19T21:50:18.243272] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-19T21:50:18.706881] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T21:50:18.786255] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T21:50:19.043298] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-19T21:50:19.099238] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T21:50:19.843265] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-19T21:50:20.643259] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-19T21:50:20.810332] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T21:50:21.225800] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T21:50:21.443256] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-19T21:50:22.170540] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-19T21:50:22.176498] [INFO ] [REMOTE ] ULS: Full fetch complete (54402 records). [2025-09-19T21:50:22.176692] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-19T21:50:22.248425] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-19T21:50:22.623562] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-19T21:50:22.623711] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-19T21:50:22.625199] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-19T21:50:22.625374] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-19T21:50:22.635886] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-19T21:50:22.640200] [DEBUG] [LOCAL ] ULS: Trimmed 54402 records to 39734 (keeping 200 days of data) [2025-09-19T21:50:22.901675] [DEBUG] [LOCAL ] ULS: Primary data saved (39734 records). [2025-09-19T21:50:22.901837] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-19T21:50:22.901926] [INFO ] [MAIN ] Update Progress: 2183/2372 symbols completed. ULS took 30.6s. Estimated remaining: 25m 8s. Rate: 7.5 symbols/min [2025-09-19T21:50:23.052264] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-19T21:50:23.087598] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:50:23.131502] [DEBUG] [LOCAL ] UNFI: Loaded 42263 existing records from primary storage. [2025-09-19T21:50:23.131691] [INFO ] [MAIN ] UNFI: Loaded 42263 existing records. [2025-09-19T21:50:23.322835] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:50:23.323100] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-19T21:50:23.323153] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-19T21:50:23.324580] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-19T21:50:23.324676] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-19T21:50:23.686993] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:50:23.843280] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-19T21:50:23.887387] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T21:50:24.643291] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-19T21:50:25.183211] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-19T21:50:25.185216] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T21:50:25.443296] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-19T21:50:25.773840] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-19T21:50:26.243332] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-19T21:50:27.043288] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-19T21:50:27.337854] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-19T21:50:27.604780] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-19T21:50:27.622014] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T21:50:27.843274] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-19T21:50:28.643295] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-19T21:50:29.132865] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T21:50:29.443310] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-19T21:50:29.701245] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T21:50:30.243299] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-19T21:50:31.043268] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-19T21:50:31.518160] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-19T21:50:31.526220] [INFO ] [REMOTE ] UMC: Full fetch complete (76607 records). [2025-09-19T21:50:31.526417] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-19T21:50:31.857855] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-19T21:50:31.939198] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-19T21:50:31.939311] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-19T21:50:31.940710] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-19T21:50:31.940790] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-19T21:50:31.942506] [DEBUG] [LOCAL ] UMC: Trimmed 76607 records to 53507 (keeping 200 days of data) [2025-09-19T21:50:32.026407] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T21:50:32.294719] [DEBUG] [LOCAL ] UMC: Primary data saved (53507 records). [2025-09-19T21:50:32.294879] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-19T21:50:32.295008] [INFO ] [MAIN ] Update Progress: 2184/2372 symbols completed. UMC took 29.1s. Estimated remaining: 25m 0s. Rate: 7.5 symbols/min [2025-09-19T21:50:32.496497] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:50:32.557040] [DEBUG] [LOCAL ] UNH: Loaded 54183 existing records from primary storage. [2025-09-19T21:50:32.557187] [INFO ] [MAIN ] UNH: Loaded 54183 existing records. [2025-09-19T21:50:32.646571] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-19T21:50:32.756482] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:50:32.756790] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-19T21:50:32.756848] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-19T21:50:32.758536] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-19T21:50:32.758597] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-19T21:50:33.146434] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-19T21:50:33.191678] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:50:33.202914] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T21:50:33.443298] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-19T21:50:33.878566] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-19T21:50:34.243342] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-19T21:50:35.043299] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-19T21:50:35.321808] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-19T21:50:35.843340] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-19T21:50:36.010592] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T21:50:36.129239] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-19T21:50:36.643289] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-19T21:50:37.351520] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T21:50:37.354526] [INFO ] [REMOTE ] UNF: Full fetch complete (17035 records). [2025-09-19T21:50:37.354663] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-19T21:50:37.448445] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-19T21:50:37.732346] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-19T21:50:37.732424] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-19T21:50:37.732812] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-19T21:50:37.732872] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-19T21:50:37.733387] [DEBUG] [LOCAL ] UNF: Trimmed 17035 records to 11981 (keeping 200 days of data) [2025-09-19T21:50:37.823193] [DEBUG] [LOCAL ] UNF: Primary data saved (11981 records). [2025-09-19T21:50:37.823784] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-19T21:50:37.824056] [INFO ] [MAIN ] Update Progress: 2185/2372 symbols completed. UNF took 27.3s. Estimated remaining: 24m 52s. Rate: 7.5 symbols/min [2025-09-19T21:50:37.975208] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-19T21:50:38.035454] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:50:38.085842] [DEBUG] [LOCAL ] UNM: Loaded 49184 existing records from primary storage. [2025-09-19T21:50:38.085989] [INFO ] [MAIN ] UNM: Loaded 49184 existing records. [2025-09-19T21:50:38.251038] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-19T21:50:38.264410] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:50:38.266072] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-19T21:50:38.266125] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-19T21:50:38.267106] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-19T21:50:38.267180] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-19T21:50:38.632533] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:50:38.935520] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T21:50:39.043313] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-19T21:50:39.820005] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-19T21:50:39.828000] [INFO ] [REMOTE ] UMH: Full fetch complete (46251 records). [2025-09-19T21:50:39.828126] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-19T21:50:39.849622] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-19T21:50:40.215973] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-19T21:50:40.216089] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-19T21:50:40.217066] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-19T21:50:40.217148] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-19T21:50:40.218502] [DEBUG] [LOCAL ] UMH: Trimmed 46251 records to 33497 (keeping 200 days of data) [2025-09-19T21:50:40.449578] [DEBUG] [LOCAL ] UMH: Primary data saved (33497 records). [2025-09-19T21:50:40.449794] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-19T21:50:40.450030] [INFO ] [MAIN ] Update Progress: 2186/2372 symbols completed. UMH took 33.4s. Estimated remaining: 24m 44s. Rate: 7.5 symbols/min [2025-09-19T21:50:40.637833] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:50:40.643254] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-19T21:50:40.648157] [DEBUG] [LOCAL ] UNMA: Loaded 3759 existing records from primary storage. [2025-09-19T21:50:40.648322] [INFO ] [MAIN ] UNMA: Loaded 3759 existing records. [2025-09-19T21:50:40.827088] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:50:40.827476] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-19T21:50:40.828127] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-19T21:50:40.828379] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-19T21:50:40.828473] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-19T21:50:41.281350] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:50:41.283275] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T21:50:41.443269] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-19T21:50:41.645081] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-19T21:50:42.243261] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-19T21:50:42.476975] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-19T21:50:43.043272] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-19T21:50:43.281508] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-19T21:50:43.367569] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T21:50:43.519257] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-19T21:50:43.843264] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-19T21:50:44.643350] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-19T21:50:45.313805] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-19T21:50:45.443315] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-19T21:50:46.243288] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-19T21:50:47.032532] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-19T21:50:47.043230] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-19T21:50:47.741713] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-19T21:50:47.775421] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-19T21:50:47.843257] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-19T21:50:47.994265] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T21:50:48.643282] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-19T21:50:49.061226] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T21:50:49.443277] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-19T21:50:50.243292] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-19T21:50:50.450269] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T21:50:51.043267] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-19T21:50:51.202275] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T21:50:51.209146] [INFO ] [REMOTE ] UNFI: Full fetch complete (58772 records). [2025-09-19T21:50:51.209272] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-19T21:50:51.627031] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-19T21:50:51.627296] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-19T21:50:51.628413] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-19T21:50:51.628477] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-19T21:50:51.630161] [DEBUG] [LOCAL ] UNFI: Trimmed 58772 records to 42573 (keeping 200 days of data) [2025-09-19T21:50:51.858893] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-19T21:50:51.916771] [DEBUG] [LOCAL ] UNFI: Primary data saved (42573 records). [2025-09-19T21:50:51.916912] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-19T21:50:51.917068] [INFO ] [MAIN ] Update Progress: 2187/2372 symbols completed. UNFI took 29.0s. Estimated remaining: 24m 36s. Rate: 7.5 symbols/min [2025-09-19T21:50:52.107827] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:50:52.173295] [DEBUG] [LOCAL ] UNP: Loaded 53610 existing records from primary storage. [2025-09-19T21:50:52.173501] [INFO ] [MAIN ] UNP: Loaded 53610 existing records. [2025-09-19T21:50:52.341302] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-19T21:50:52.420309] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T21:50:52.420577] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:50:52.432900] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-19T21:50:52.432994] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-19T21:50:52.434892] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-19T21:50:52.435233] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-19T21:50:52.652204] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-19T21:50:52.827442] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:50:53.069581] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-19T21:50:53.110560] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-19T21:50:53.443311] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-19T21:50:54.243273] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-19T21:50:54.925531] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T21:50:55.043241] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-19T21:50:55.843306] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-19T21:50:56.338020] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T21:50:56.643295] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-19T21:50:57.125932] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-19T21:50:57.443267] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-19T21:50:58.128973] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-19T21:50:58.248457] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-19T21:50:58.274835] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-19T21:50:58.496930] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T21:50:58.980515] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-19T21:50:59.043305] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-19T21:50:59.843288] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-19T21:51:00.643265] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-19T21:51:00.837465] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T21:51:01.359069] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T21:51:01.443289] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-19T21:51:02.243267] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-19T21:51:03.043288] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-19T21:51:03.974977] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-19T21:51:03.976417] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-19T21:51:04.153533] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (4.31 seconds). [2025-09-19T21:51:04.643292] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-19T21:51:04.702320] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T21:51:04.703409] [INFO ] [REMOTE ] UNMA: Full fetch complete (5834 records). [2025-09-19T21:51:04.703480] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-19T21:51:05.070035] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-19T21:51:05.070182] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-19T21:51:05.070486] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-19T21:51:05.070571] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-19T21:51:05.071372] [DEBUG] [LOCAL ] UNMA: Trimmed 5834 records to 3790 (keeping 200 days of data) [2025-09-19T21:51:05.096818] [DEBUG] [LOCAL ] UNMA: Primary data saved (3790 records). [2025-09-19T21:51:05.096943] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-19T21:51:05.097031] [INFO ] [MAIN ] Update Progress: 2188/2372 symbols completed. UNMA took 24.6s. Estimated remaining: 24m 28s. Rate: 7.5 symbols/min [2025-09-19T21:51:05.306815] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:51:05.309048] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-19T21:51:05.355903] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (3.91 seconds). [2025-09-19T21:51:05.405341] [DEBUG] [LOCAL ] UP: Loaded 43319 existing records from primary storage. [2025-09-19T21:51:05.406431] [INFO ] [MAIN ] UP: Loaded 43319 existing records. [2025-09-19T21:51:05.448926] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-19T21:51:05.595337] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:51:05.595723] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-19T21:51:05.595783] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-19T21:51:05.597311] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-19T21:51:05.597385] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-19T21:51:05.956561] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:51:06.243300] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-19T21:51:07.043271] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-19T21:51:07.434302] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T21:51:07.517410] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.87 seconds). [2025-09-19T21:51:07.792301] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-19T21:51:07.843224] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-19T21:51:08.568869] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T21:51:08.643312] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-19T21:51:09.443271] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-19T21:51:10.079763] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-19T21:51:10.243256] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-19T21:51:10.426268] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T21:51:11.043261] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-19T21:51:11.754194] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T21:51:11.843235] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-19T21:51:11.977389] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-19T21:51:12.643269] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-19T21:51:12.643351] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-19T21:51:13.443261] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-19T21:51:14.243352] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-19T21:51:14.789461] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (2.95 seconds). [2025-09-19T21:51:15.043326] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-19T21:51:15.554812] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T21:51:15.843287] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-19T21:51:15.886229] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (3.24 seconds). [2025-09-19T21:51:16.447347] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-19T21:51:16.456847] [INFO ] [REMOTE ] UNM: Full fetch complete (70135 records). [2025-09-19T21:51:16.457017] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-19T21:51:16.643743] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-19T21:51:16.860602] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-19T21:51:16.860731] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-19T21:51:16.861867] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-19T21:51:16.861941] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-19T21:51:16.863469] [DEBUG] [LOCAL ] UNM: Trimmed 70135 records to 49543 (keeping 200 days of data) [2025-09-19T21:51:17.176118] [DEBUG] [LOCAL ] UNM: Primary data saved (49543 records). [2025-09-19T21:51:17.176266] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-19T21:51:17.176366] [INFO ] [MAIN ] Update Progress: 2189/2372 symbols completed. UNM took 39.4s. Estimated remaining: 24m 21s. Rate: 7.5 symbols/min [2025-09-19T21:51:17.347779] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:51:17.385040] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-19T21:51:17.450695] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-19T21:51:17.455560] [DEBUG] [LOCAL ] UPS: Loaded 54100 existing records from primary storage. [2025-09-19T21:51:17.455814] [INFO ] [MAIN ] UPS: Loaded 54100 existing records. [2025-09-19T21:51:17.649398] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:51:17.650983] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-19T21:51:17.651132] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-19T21:51:17.652843] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-19T21:51:17.652910] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-19T21:51:17.785504] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-19T21:51:18.013139] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-19T21:51:18.049697] [INFO ] [REMOTE ] UNH: Full fetch complete (77857 records). [2025-09-19T21:51:18.072234] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-19T21:51:18.128759] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:51:18.248351] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-19T21:51:18.520430] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-19T21:51:18.520523] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-19T21:51:18.521638] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-19T21:51:18.521723] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-19T21:51:18.523287] [DEBUG] [LOCAL ] UNH: Trimmed 77857 records to 54573 (keeping 200 days of data) [2025-09-19T21:51:18.905353] [DEBUG] [LOCAL ] UNH: Primary data saved (54573 records). [2025-09-19T21:51:18.905565] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-19T21:51:18.908280] [INFO ] [MAIN ] Update Progress: 2190/2372 symbols completed. UNH took 46.6s. Estimated remaining: 24m 12s. Rate: 7.5 symbols/min [2025-09-19T21:51:19.048354] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-19T21:51:19.108246] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:51:19.154820] [DEBUG] [LOCAL ] URI: Loaded 37118 existing records from primary storage. [2025-09-19T21:51:19.154983] [INFO ] [MAIN ] URI: Loaded 37118 existing records. [2025-09-19T21:51:19.352221] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:51:19.352502] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-19T21:51:19.352566] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-19T21:51:19.353439] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-19T21:51:19.353501] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-19T21:51:19.731459] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:51:19.765917] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T21:51:19.843266] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-19T21:51:19.964602] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-19T21:51:20.643231] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-19T21:51:20.679052] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T21:51:20.687980] [INFO ] [REMOTE ] UNP: Full fetch complete (76893 records). [2025-09-19T21:51:20.688128] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-19T21:51:21.099892] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-19T21:51:21.100009] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-19T21:51:21.101355] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-19T21:51:21.101471] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-19T21:51:21.103478] [DEBUG] [LOCAL ] UNP: Trimmed 76893 records to 53996 (keeping 200 days of data) [2025-09-19T21:51:21.234441] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T21:51:21.451810] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-19T21:51:21.509334] [DEBUG] [LOCAL ] UNP: Primary data saved (53996 records). [2025-09-19T21:51:21.509524] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-19T21:51:21.509674] [INFO ] [MAIN ] Update Progress: 2191/2372 symbols completed. UNP took 29.6s. Estimated remaining: 24m 4s. Rate: 7.5 symbols/min [2025-09-19T21:51:21.680152] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:51:21.715124] [DEBUG] [LOCAL ] USA: Loaded 36577 existing records from primary storage. [2025-09-19T21:51:21.715296] [INFO ] [MAIN ] USA: Loaded 36577 existing records. [2025-09-19T21:51:21.892526] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:51:21.892828] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-19T21:51:21.892878] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-19T21:51:21.893716] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-19T21:51:21.893789] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-19T21:51:22.246386] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-19T21:51:22.250031] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:51:22.308683] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-19T21:51:23.043266] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-19T21:51:23.115749] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T21:51:23.394085] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-19T21:51:23.843289] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-19T21:51:24.643375] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-19T21:51:25.390806] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-19T21:51:25.443221] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-19T21:51:26.038119] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T21:51:26.243294] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-19T21:51:26.678316] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T21:51:27.045880] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-19T21:51:27.048251] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-19T21:51:27.843265] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-19T21:51:28.170908] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T21:51:28.496488] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-19T21:51:28.643284] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-19T21:51:28.718868] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T21:51:29.443290] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-19T21:51:30.243235] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-19T21:51:30.759718] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-19T21:51:30.767364] [INFO ] [REMOTE ] UP: Full fetch complete (61900 records). [2025-09-19T21:51:30.767490] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-19T21:51:31.056493] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-19T21:51:31.170246] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-19T21:51:31.170522] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-19T21:51:31.171883] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-19T21:51:31.172011] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-19T21:51:31.173860] [DEBUG] [LOCAL ] UP: Trimmed 61900 records to 43694 (keeping 200 days of data) [2025-09-19T21:51:31.299634] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T21:51:31.471424] [DEBUG] [LOCAL ] UP: Primary data saved (43694 records). [2025-09-19T21:51:31.471618] [INFO ] [MAIN ] UP: Full history saved. [2025-09-19T21:51:31.471791] [INFO ] [MAIN ] Update Progress: 2192/2372 symbols completed. UP took 26.4s. Estimated remaining: 23m 56s. Rate: 7.5 symbols/min [2025-09-19T21:51:31.643920] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:51:31.666567] [DEBUG] [LOCAL ] USAC: Loaded 23233 existing records from primary storage. [2025-09-19T21:51:31.666734] [INFO ] [MAIN ] USAC: Loaded 23233 existing records. [2025-09-19T21:51:31.845391] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:51:31.845253] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-19T21:51:31.845807] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-19T21:51:31.846667] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-19T21:51:31.847333] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-19T21:51:31.847411] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-19T21:51:32.234718] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:51:32.641002] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-19T21:51:32.651814] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-19T21:51:32.801221] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T21:51:33.269994] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T21:51:33.443229] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-19T21:51:33.985168] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T21:51:34.243302] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-19T21:51:35.043298] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-19T21:51:35.843249] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-19T21:51:35.879728] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T21:51:35.927721] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-19T21:51:36.517384] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T21:51:36.643310] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-19T21:51:37.438013] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-19T21:51:37.449678] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-19T21:51:38.243283] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-19T21:51:38.400262] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T21:51:39.012784] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T21:51:39.043280] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-19T21:51:39.843274] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-19T21:51:40.617489] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-19T21:51:40.643218] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-19T21:51:40.745692] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-19T21:51:41.446495] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-19T21:51:41.447912] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-19T21:51:42.088957] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T21:51:42.243266] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-19T21:51:43.043269] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-19T21:51:43.801273] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-19T21:51:43.843215] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-19T21:51:44.173404] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-19T21:51:44.411906] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T21:51:44.643295] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-19T21:51:45.443287] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-19T21:51:46.243278] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-19T21:51:46.341129] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T21:51:46.460318] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T21:51:47.043256] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-19T21:51:47.155881] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T21:51:47.605387] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T21:51:47.843302] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-19T21:51:48.237472] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T21:51:48.243497] [INFO ] [REMOTE ] USA: Full fetch complete (51569 records). [2025-09-19T21:51:48.243606] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-19T21:51:48.647682] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-19T21:51:48.664922] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-19T21:51:48.665009] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-19T21:51:48.666072] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-19T21:51:48.666148] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-19T21:51:48.667575] [DEBUG] [LOCAL ] USA: Trimmed 51569 records to 36841 (keeping 200 days of data) [2025-09-19T21:51:48.886554] [DEBUG] [LOCAL ] USA: Primary data saved (36841 records). [2025-09-19T21:51:48.886739] [INFO ] [MAIN ] USA: Full history saved. [2025-09-19T21:51:48.886837] [INFO ] [MAIN ] Update Progress: 2193/2372 symbols completed. USA took 27.4s. Estimated remaining: 23m 49s. Rate: 7.5 symbols/min [2025-09-19T21:51:49.057725] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:51:49.083699] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T21:51:49.123538] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-09-19T21:51:49.123714] [INFO ] [MAIN ] USB: Loaded 54078 existing records. [2025-09-19T21:51:49.307999] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:51:49.308352] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-19T21:51:49.308408] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-19T21:51:49.309501] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-19T21:51:49.309559] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-19T21:51:49.449967] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-19T21:51:49.669174] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:51:50.243279] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-19T21:51:51.043256] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-19T21:51:51.107621] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T21:51:51.249000] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-19T21:51:51.466194] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T21:51:51.843277] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-19T21:51:52.643270] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-19T21:51:52.764579] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T21:51:52.772592] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-09-19T21:51:52.772794] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-19T21:51:53.189007] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-19T21:51:53.189215] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-19T21:51:53.190444] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-19T21:51:53.190564] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-19T21:51:53.192623] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 54490 (keeping 200 days of data) [2025-09-19T21:51:53.320380] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-19T21:51:53.460575] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-19T21:51:53.485754] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T21:51:53.492160] [INFO ] [REMOTE ] USAC: Full fetch complete (35611 records). [2025-09-19T21:51:53.492550] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-19T21:51:53.895908] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-19T21:51:53.896284] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-19T21:51:53.897750] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-19T21:51:53.897845] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-19T21:51:53.901341] [DEBUG] [LOCAL ] USAC: Trimmed 35611 records to 23461 (keeping 200 days of data) [2025-09-19T21:51:54.126532] [DEBUG] [LOCAL ] UPS: Primary data saved (54490 records). [2025-09-19T21:51:54.127509] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-19T21:51:54.128429] [INFO ] [MAIN ] Update Progress: 2194/2372 symbols completed. UPS took 37.0s. Estimated remaining: 23m 41s. Rate: 7.5 symbols/min [2025-09-19T21:51:54.248210] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-19T21:51:54.314833] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:51:54.339484] [DEBUG] [LOCAL ] USAC: Primary data saved (23461 records). [2025-09-19T21:51:54.339629] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-19T21:51:54.339766] [INFO ] [MAIN ] Update Progress: 2195/2372 symbols completed. USAC took 22.9s. Estimated remaining: 23m 32s. Rate: 7.5 symbols/min [2025-09-19T21:51:54.524327] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:51:54.543389] [DEBUG] [LOCAL ] USFD: Loaded 51643 existing records from primary storage. [2025-09-19T21:51:54.543571] [INFO ] [MAIN ] USFD: Loaded 51643 existing records. [2025-09-19T21:51:54.656789] [DEBUG] [LOCAL ] USNA: Loaded 18545 existing records from primary storage. [2025-09-19T21:51:54.662703] [INFO ] [MAIN ] USNA: Loaded 18545 existing records. [2025-09-19T21:51:54.841265] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:51:54.867468] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-19T21:51:54.868089] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-19T21:51:54.898432] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-19T21:51:54.902878] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-19T21:51:54.923734] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:51:55.015832] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-19T21:51:55.026435] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-19T21:51:55.032163] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-19T21:51:55.037366] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-19T21:51:55.610763] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:51:55.626548] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-19T21:51:55.697910] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:51:55.734614] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-19T21:51:55.843216] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-19T21:51:56.383158] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-19T21:51:56.643274] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-19T21:51:57.443265] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-19T21:51:57.580765] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T21:51:57.791402] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-19T21:51:57.825583] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T21:51:58.243363] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-19T21:51:59.043291] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-19T21:51:59.185783] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T21:51:59.513862] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T21:51:59.843271] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-19T21:52:00.377630] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T21:52:00.643246] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-19T21:52:00.907003] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-19T21:52:00.912535] [INFO ] [REMOTE ] URI: Full fetch complete (53757 records). [2025-09-19T21:52:00.912686] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-19T21:52:01.346609] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-19T21:52:01.346721] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-19T21:52:01.347663] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-19T21:52:01.347725] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-19T21:52:01.348824] [DEBUG] [LOCAL ] URI: Trimmed 53757 records to 37373 (keeping 200 days of data) [2025-09-19T21:52:01.443245] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-19T21:52:01.594623] [DEBUG] [LOCAL ] URI: Primary data saved (37373 records). [2025-09-19T21:52:01.594849] [INFO ] [MAIN ] URI: Full history saved. [2025-09-19T21:52:01.594947] [INFO ] [MAIN ] Update Progress: 2196/2372 symbols completed. URI took 42.7s. Estimated remaining: 23m 24s. Rate: 7.5 symbols/min [2025-09-19T21:52:01.774016] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:52:01.792233] [DEBUG] [LOCAL ] USPH: Loaded 16781 existing records from primary storage. [2025-09-19T21:52:01.792382] [INFO ] [MAIN ] USPH: Loaded 16781 existing records. [2025-09-19T21:52:01.995276] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:52:01.995701] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-19T21:52:01.995798] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-19T21:52:01.996443] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-19T21:52:01.996513] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-19T21:52:02.153548] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-19T21:52:02.254208] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-19T21:52:02.445245] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:52:02.653274] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T21:52:03.043264] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-19T21:52:03.843229] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-19T21:52:04.472310] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T21:52:04.528349] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-19T21:52:04.643235] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-19T21:52:05.184392] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-19T21:52:05.443281] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-19T21:52:06.243290] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-19T21:52:06.576738] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-19T21:52:06.596112] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T21:52:07.043262] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-19T21:52:07.614043] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-19T21:52:07.843309] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-19T21:52:08.056961] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-19T21:52:08.643298] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-19T21:52:09.086052] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T21:52:09.443234] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-19T21:52:09.932011] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T21:52:10.243293] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-19T21:52:10.569225] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-19T21:52:11.043274] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-19T21:52:11.843342] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-19T21:52:12.251537] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-19T21:52:12.643305] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-19T21:52:13.074180] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T21:52:13.443309] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-19T21:52:13.534377] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-19T21:52:13.801530] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-19T21:52:14.243279] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-19T21:52:14.600515] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T21:52:15.043324] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-19T21:52:15.843239] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-19T21:52:16.255591] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-19T21:52:16.408241] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T21:52:16.482620] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T21:52:16.643231] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-19T21:52:17.443279] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-19T21:52:18.243255] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-19T21:52:18.636277] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:52:18.763119] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-19T21:52:19.043264] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-19T21:52:19.843261] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-19T21:52:20.284814] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T21:52:20.433089] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-19T21:52:20.643348] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-19T21:52:20.857880] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T21:52:20.860550] [INFO ] [REMOTE ] USNA: Full fetch complete (26444 records). [2025-09-19T21:52:20.860625] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-19T21:52:21.241317] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-19T21:52:21.241404] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-19T21:52:21.242246] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-19T21:52:21.242311] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-19T21:52:21.243001] [DEBUG] [LOCAL ] USNA: Trimmed 26444 records to 18648 (keeping 200 days of data) [2025-09-19T21:52:21.356048] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-19T21:52:21.362284] [DEBUG] [LOCAL ] USNA: Primary data saved (18648 records). [2025-09-19T21:52:21.362764] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-19T21:52:21.363006] [INFO ] [MAIN ] Update Progress: 2197/2372 symbols completed. USNA took 27.0s. Estimated remaining: 23m 17s. Rate: 7.5 symbols/min [2025-09-19T21:52:21.363108] [INFO ] [REMOTE ] USPH: Full fetch complete (22409 records). [2025-09-19T21:52:21.363267] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-19T21:52:21.452321] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-19T21:52:21.725167] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-19T21:52:21.725244] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-19T21:52:21.725713] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-19T21:52:21.725774] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-19T21:52:21.726393] [DEBUG] [LOCAL ] USPH: Trimmed 22409 records to 16866 (keeping 200 days of data) [2025-09-19T21:52:21.834143] [DEBUG] [LOCAL ] USPH: Primary data saved (16866 records). [2025-09-19T21:52:21.834308] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-19T21:52:21.834397] [INFO ] [MAIN ] Update Progress: 2198/2372 symbols completed. USPH took 20.2s. Estimated remaining: 23m 8s. Rate: 7.5 symbols/min [2025-09-19T21:52:22.243334] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-19T21:52:23.377310] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-19T21:52:23.387940] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-19T21:52:24.462287] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T21:52:24.474347] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-19T21:52:25.329441] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T21:52:25.340814] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-19T21:52:26.106497] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T21:52:26.118420] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-19T21:52:26.988329] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T21:52:26.996495] [INFO ] [REMOTE ] USB: Full fetch complete (77709 records). [2025-09-19T21:52:26.996675] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-19T21:52:27.415787] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-19T21:52:27.415902] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-19T21:52:27.417139] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-19T21:52:27.417287] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-19T21:52:27.449467] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T21:52:27.460194] [DEBUG] [LOCAL ] USB: Trimmed 77709 records to 54468 (keeping 200 days of data) [2025-09-19T21:52:27.461739] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-19T21:52:27.813317] [DEBUG] [LOCAL ] USB: Primary data saved (54468 records). [2025-09-19T21:52:27.813472] [INFO ] [MAIN ] USB: Full history saved. [2025-09-19T21:52:27.813559] [INFO ] [MAIN ] Update Progress: 2199/2372 symbols completed. USB took 38.9s. Estimated remaining: 23m 0s. Rate: 7.5 symbols/min [2025-09-19T21:52:29.306147] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-19T21:52:29.314048] [INFO ] [REMOTE ] USFD: Full fetch complete (73930 records). [2025-09-19T21:52:29.314259] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-19T21:52:29.785709] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-19T21:52:29.785857] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-19T21:52:29.787855] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-19T21:52:29.787964] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-19T21:52:29.790228] [DEBUG] [LOCAL ] USFD: Trimmed 73930 records to 52005 (keeping 200 days of data) [2025-09-19T21:52:30.275105] [DEBUG] [LOCAL ] USFD: Primary data saved (52005 records). [2025-09-19T21:52:30.275291] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-19T21:52:30.276615] [INFO ] [MAIN ] Update Progress: 2200/2372 symbols completed. USFD took 36.1s. Estimated remaining: 22m 52s. Rate: 7.5 symbols/min [2025-09-19T21:52:30.975473] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:52:31.050767] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:52:31.107488] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:52:31.089983] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:52:31.124358] [DEBUG] [LOCAL ] UTL: Loaded 10959 existing records from primary storage. [2025-09-19T21:52:31.124497] [INFO ] [MAIN ] UTL: Loaded 10959 existing records. [2025-09-19T21:52:31.286823] [DEBUG] [LOCAL ] UTF: Loaded 28516 existing records from primary storage. [2025-09-19T21:52:31.306019] [INFO ] [MAIN ] UTF: Loaded 28516 existing records. [2025-09-19T21:52:31.415441] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:52:31.452054] [DEBUG] [LOCAL ] UTZ: Loaded 45153 existing records from primary storage. [2025-09-19T21:52:31.474320] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-19T21:52:31.478361] [DEBUG] [LOCAL ] UTI: Loaded 40997 existing records from primary storage. [2025-09-19T21:52:31.478553] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-19T21:52:31.474215] [INFO ] [MAIN ] UTZ: Loaded 45153 existing records. [2025-09-19T21:52:31.478691] [INFO ] [MAIN ] UTI: Loaded 40997 existing records. [2025-09-19T21:52:31.494717] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-19T21:52:31.510883] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-19T21:52:31.873419] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:52:31.904810] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-19T21:52:31.910047] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-19T21:52:31.920554] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-19T21:52:31.985875] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-19T21:52:32.229108] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:52:32.255833] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:52:32.287135] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-19T21:52:32.307905] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-19T21:52:32.323785] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-19T21:52:32.331144] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-19T21:52:32.331248] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-19T21:52:32.331327] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-19T21:52:32.356177] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-19T21:52:32.378517] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-19T21:52:32.743947] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:52:32.784850] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-19T21:52:33.301168] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:52:33.326505] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-19T21:52:33.374504] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:52:33.390517] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-19T21:52:33.448991] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:52:33.449364] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-19T21:52:33.458065] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-19T21:52:33.461017] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-19T21:52:34.459287] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T21:52:34.462198] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-19T21:52:34.678946] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T21:52:34.684899] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-19T21:52:34.804011] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T21:52:34.811580] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-19T21:52:34.976971] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-19T21:52:34.979403] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-19T21:52:35.086428] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T21:52:35.094529] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-19T21:52:35.544218] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-19T21:52:35.550105] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-19T21:52:35.631365] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-19T21:52:35.843237] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-19T21:52:36.501180] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-19T21:52:36.643277] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-19T21:52:36.790822] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T21:52:36.878272] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T21:52:36.968044] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T21:52:37.443256] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-19T21:52:37.793265] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-19T21:52:38.243319] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-19T21:52:39.043307] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-19T21:52:39.378797] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T21:52:39.843275] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-19T21:52:39.980287] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T21:52:40.047929] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T21:52:40.643332] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-19T21:52:41.443345] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-19T21:52:41.694666] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T21:52:42.243311] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-19T21:52:42.402188] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T21:52:42.450802] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-19T21:52:43.043321] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-19T21:52:43.705889] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-19T21:52:43.843338] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-19T21:52:44.643296] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-19T21:52:44.890245] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T21:52:44.965978] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T21:52:45.443301] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-19T21:52:46.243271] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-19T21:52:46.539512] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-19T21:52:46.653892] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-19T21:52:47.043294] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-19T21:52:47.851831] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-19T21:52:47.870495] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T21:52:48.107752] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T21:52:48.110472] [INFO ] [REMOTE ] UTL: Full fetch complete (15042 records). [2025-09-19T21:52:48.110544] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-19T21:52:48.478162] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-19T21:52:48.478285] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-19T21:52:48.478639] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-19T21:52:48.478723] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-19T21:52:48.479221] [DEBUG] [LOCAL ] UTL: Trimmed 15042 records to 11073 (keeping 200 days of data) [2025-09-19T21:52:48.551049] [DEBUG] [LOCAL ] UTL: Primary data saved (11073 records). [2025-09-19T21:52:48.551200] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-19T21:52:48.551315] [INFO ] [MAIN ] Update Progress: 2201/2372 symbols completed. UTL took 18.3s. Estimated remaining: 22m 45s. Rate: 7.5 symbols/min [2025-09-19T21:52:48.648380] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-19T21:52:48.722356] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:52:48.744228] [DEBUG] [LOCAL ] UVE: Loaded 22022 existing records from primary storage. [2025-09-19T21:52:48.744398] [INFO ] [MAIN ] UVE: Loaded 22022 existing records. [2025-09-19T21:52:48.919164] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:52:48.919437] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-19T21:52:48.919490] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-19T21:52:48.920168] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-19T21:52:48.920240] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-19T21:52:49.274946] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:52:49.443289] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-19T21:52:49.742036] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:52:50.243247] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-19T21:52:50.274604] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-19T21:52:50.664974] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T21:52:51.043273] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-19T21:52:51.843301] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-19T21:52:52.002018] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T21:52:52.529174] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T21:52:52.643267] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-19T21:52:53.266450] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T21:52:53.443326] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-19T21:52:54.154638] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T21:52:54.173357] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-19T21:52:54.243217] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-19T21:52:55.043288] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-19T21:52:55.152455] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-19T21:52:55.843270] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-19T21:52:56.138037] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-19T21:52:56.643271] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-19T21:52:57.443271] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-19T21:52:57.800759] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T21:52:57.977248] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T21:52:58.243267] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-19T21:52:59.049097] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-19T21:52:59.054062] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T21:52:59.633103] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T21:52:59.843273] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-19T21:53:00.324316] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T21:53:00.643341] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-19T21:53:01.443339] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-19T21:53:01.612767] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T21:53:02.229082] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-19T21:53:02.236553] [INFO ] [REMOTE ] UTZ: Full fetch complete (63516 records). [2025-09-19T21:53:02.236794] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-19T21:53:02.251399] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-19T21:53:02.706811] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-19T21:53:02.706904] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-19T21:53:02.707924] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-19T21:53:02.707989] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-19T21:53:02.709326] [DEBUG] [LOCAL ] UTZ: Trimmed 63516 records to 45430 (keeping 200 days of data) [2025-09-19T21:53:02.844765] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T21:53:03.037515] [DEBUG] [LOCAL ] UTZ: Primary data saved (45430 records). [2025-09-19T21:53:03.037736] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-19T21:53:03.037942] [INFO ] [MAIN ] Update Progress: 2202/2372 symbols completed. UTZ took 32.7s. Estimated remaining: 22m 37s. Rate: 7.5 symbols/min [2025-09-19T21:53:03.049309] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-19T21:53:03.214925] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:03.238088] [DEBUG] [LOCAL ] UVV: Loaded 22438 existing records from primary storage. [2025-09-19T21:53:03.238215] [INFO ] [MAIN ] UVV: Loaded 22438 existing records. [2025-09-19T21:53:03.417293] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:03.417593] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-19T21:53:03.417672] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-19T21:53:03.418380] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-19T21:53:03.418443] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-19T21:53:03.786582] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:03.804942] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T21:53:03.843215] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-19T21:53:04.569322] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T21:53:04.576877] [INFO ] [REMOTE ] UTI: Full fetch complete (58107 records). [2025-09-19T21:53:04.577053] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-19T21:53:04.651739] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-19T21:53:04.963879] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-19T21:53:04.963972] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-19T21:53:04.964991] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-19T21:53:04.965101] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-19T21:53:04.966760] [DEBUG] [LOCAL ] UTI: Trimmed 58107 records to 41259 (keeping 200 days of data) [2025-09-19T21:53:05.230781] [DEBUG] [LOCAL ] UTI: Primary data saved (41259 records). [2025-09-19T21:53:05.231021] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-19T21:53:05.231123] [INFO ] [MAIN ] Update Progress: 2203/2372 symbols completed. UTI took 35.0s. Estimated remaining: 22m 29s. Rate: 7.5 symbols/min [2025-09-19T21:53:05.401180] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:05.443314] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-19T21:53:05.460167] [DEBUG] [LOCAL ] UWMC: Loaded 53104 existing records from primary storage. [2025-09-19T21:53:05.460296] [INFO ] [MAIN ] UWMC: Loaded 53104 existing records. [2025-09-19T21:53:05.647294] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:05.661773] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-19T21:53:05.661897] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-19T21:53:05.662943] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T21:53:05.667610] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-19T21:53:05.668195] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-19T21:53:05.711956] [INFO ] [REMOTE ] UTF: Full fetch complete (40764 records). [2025-09-19T21:53:05.744951] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-19T21:53:06.462291] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-19T21:53:06.462498] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-19T21:53:06.459455] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:06.463796] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-19T21:53:06.473420] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-19T21:53:06.473038] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-19T21:53:06.498091] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T21:53:06.510626] [DEBUG] [LOCAL ] UTF: Trimmed 40764 records to 28882 (keeping 200 days of data) [2025-09-19T21:53:06.510501] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T21:53:06.710352] [DEBUG] [LOCAL ] UTF: Primary data saved (28882 records). [2025-09-19T21:53:06.710506] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-19T21:53:06.710624] [INFO ] [MAIN ] Update Progress: 2204/2372 symbols completed. UTF took 36.4s. Estimated remaining: 22m 20s. Rate: 7.5 symbols/min [2025-09-19T21:53:06.880122] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:06.890115] [DEBUG] [LOCAL ] UZD: Loaded 6388 existing records from primary storage. [2025-09-19T21:53:06.890216] [INFO ] [MAIN ] UZD: Loaded 6388 existing records. [2025-09-19T21:53:07.049304] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-19T21:53:07.078484] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:07.079511] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-19T21:53:07.079573] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-19T21:53:07.080019] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-19T21:53:07.080083] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-19T21:53:07.444005] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:07.843238] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-19T21:53:07.886414] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-19T21:53:08.442137] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T21:53:08.643267] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-19T21:53:08.700435] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T21:53:09.443271] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-19T21:53:10.243258] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-19T21:53:10.573585] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T21:53:10.619298] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-19T21:53:11.043344] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-19T21:53:11.335768] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T21:53:11.517785] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-19T21:53:11.843268] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-19T21:53:12.643326] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-19T21:53:12.766056] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T21:53:13.104473] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-19T21:53:13.443263] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-19T21:53:14.243262] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-19T21:53:14.699020] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T21:53:15.043277] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-19T21:53:15.382078] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T21:53:15.386971] [INFO ] [REMOTE ] UVE: Full fetch complete (29502 records). [2025-09-19T21:53:15.387068] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-19T21:53:15.785704] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-19T21:53:15.785793] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-19T21:53:15.786454] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-19T21:53:15.786494] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-19T21:53:15.787281] [DEBUG] [LOCAL ] UVE: Trimmed 29502 records to 22135 (keeping 200 days of data) [2025-09-19T21:53:15.856420] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-19T21:53:15.947104] [DEBUG] [LOCAL ] UVE: Primary data saved (22135 records). [2025-09-19T21:53:15.947279] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-19T21:53:15.947404] [INFO ] [MAIN ] Update Progress: 2205/2372 symbols completed. UVE took 27.4s. Estimated remaining: 22m 12s. Rate: 7.5 symbols/min [2025-09-19T21:53:16.137833] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:16.150290] [DEBUG] [LOCAL ] UZE: Loaded 7530 existing records from primary storage. [2025-09-19T21:53:16.150398] [INFO ] [MAIN ] UZE: Loaded 7530 existing records. [2025-09-19T21:53:16.339480] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:16.339928] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-19T21:53:16.339987] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-19T21:53:16.340929] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-19T21:53:16.340996] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-19T21:53:16.645122] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-19T21:53:16.748386] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:16.763753] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T21:53:16.777528] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-19T21:53:17.443321] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-19T21:53:18.243290] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-19T21:53:18.584728] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T21:53:18.600059] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-19T21:53:19.044726] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-19T21:53:19.045822] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T21:53:19.843276] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-19T21:53:20.391224] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T21:53:20.643313] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-19T21:53:20.741901] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T21:53:21.443300] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-19T21:53:21.917676] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-19T21:53:22.243327] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-19T21:53:22.994758] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-19T21:53:23.043339] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-19T21:53:23.102769] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-19T21:53:23.843270] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-19T21:53:23.863573] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-19T21:53:24.589887] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-19T21:53:24.643297] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-19T21:53:25.443325] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-19T21:53:25.928270] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-19T21:53:26.243331] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-19T21:53:27.043263] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-19T21:53:27.458433] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-19T21:53:27.520690] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-19T21:53:27.552636] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-19T21:53:27.843278] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-19T21:53:28.643268] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-19T21:53:29.443268] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-19T21:53:29.818964] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-19T21:53:29.889775] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T21:53:30.243248] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-19T21:53:30.803751] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-19T21:53:30.909108] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T21:53:30.910294] [INFO ] [REMOTE ] UZD: Full fetch complete (9442 records). [2025-09-19T21:53:30.910389] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-19T21:53:31.048407] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-19T21:53:31.293392] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-19T21:53:31.293502] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-19T21:53:31.293797] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-19T21:53:31.293871] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-19T21:53:31.294367] [DEBUG] [LOCAL ] UZD: Trimmed 9442 records to 6411 (keeping 200 days of data) [2025-09-19T21:53:31.332820] [DEBUG] [LOCAL ] UZD: Primary data saved (6411 records). [2025-09-19T21:53:31.332925] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-19T21:53:31.333006] [INFO ] [MAIN ] Update Progress: 2206/2372 symbols completed. UZD took 24.6s. Estimated remaining: 22m 5s. Rate: 7.5 symbols/min [2025-09-19T21:53:31.510055] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:31.519172] [DEBUG] [LOCAL ] UZF: Loaded 6526 existing records from primary storage. [2025-09-19T21:53:31.519288] [INFO ] [MAIN ] UZF: Loaded 6526 existing records. [2025-09-19T21:53:31.701681] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:31.701943] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-19T21:53:31.701991] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-19T21:53:31.702288] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-19T21:53:31.702348] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-19T21:53:31.862223] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-19T21:53:31.878455] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-19T21:53:32.105774] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:32.643264] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-19T21:53:33.443350] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-19T21:53:33.578585] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-19T21:53:33.849388] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T21:53:34.243286] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-19T21:53:34.358462] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T21:53:34.362225] [INFO ] [REMOTE ] UVV: Full fetch complete (29574 records). [2025-09-19T21:53:34.362548] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-19T21:53:34.766260] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-19T21:53:34.766372] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-19T21:53:34.766998] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-19T21:53:34.767061] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-19T21:53:34.767813] [DEBUG] [LOCAL ] UVV: Trimmed 29574 records to 22592 (keeping 200 days of data) [2025-09-19T21:53:34.903818] [DEBUG] [LOCAL ] UVV: Primary data saved (22592 records). [2025-09-19T21:53:34.903958] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-19T21:53:34.904055] [INFO ] [MAIN ] Update Progress: 2207/2372 symbols completed. UVV took 31.9s. Estimated remaining: 21m 57s. Rate: 7.5 symbols/min [2025-09-19T21:53:35.050638] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-19T21:53:35.078662] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:35.136865] [DEBUG] [LOCAL ] V: Loaded 54153 existing records from primary storage. [2025-09-19T21:53:35.137038] [INFO ] [MAIN ] V: Loaded 54153 existing records. [2025-09-19T21:53:35.319735] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:35.319975] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-19T21:53:35.320036] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-19T21:53:35.321319] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-19T21:53:35.321377] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-19T21:53:35.693113] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-19T21:53:35.698531] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:35.843250] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-19T21:53:36.432817] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T21:53:36.643283] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-19T21:53:36.669374] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T21:53:37.367913] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-19T21:53:37.443295] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-19T21:53:38.243280] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-19T21:53:38.896692] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-19T21:53:39.043349] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-19T21:53:39.843333] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-19T21:53:39.890441] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-19T21:53:39.972116] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-19T21:53:40.643254] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-19T21:53:40.920299] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T21:53:41.430488] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T21:53:41.443215] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-19T21:53:42.153096] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-19T21:53:42.243266] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-19T21:53:42.826358] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-19T21:53:43.043269] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-19T21:53:43.612363] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-19T21:53:43.843265] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-19T21:53:44.643271] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-19T21:53:45.443268] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-19T21:53:45.469139] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-19T21:53:45.471198] [INFO ] [REMOTE ] UZE: Full fetch complete (10210 records). [2025-09-19T21:53:45.471293] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-19T21:53:45.845111] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-19T21:53:45.845258] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-19T21:53:45.845545] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-19T21:53:45.845632] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-19T21:53:45.846573] [DEBUG] [LOCAL ] UZE: Trimmed 10210 records to 7573 (keeping 200 days of data) [2025-09-19T21:53:45.896241] [DEBUG] [LOCAL ] UZE: Primary data saved (7573 records). [2025-09-19T21:53:45.896529] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-19T21:53:45.896707] [INFO ] [MAIN ] Update Progress: 2208/2372 symbols completed. UZE took 29.9s. Estimated remaining: 21m 49s. Rate: 7.5 symbols/min [2025-09-19T21:53:46.035905] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-19T21:53:46.113448] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:46.147023] [DEBUG] [LOCAL ] VAC: Loaded 35090 existing records from primary storage. [2025-09-19T21:53:46.147192] [INFO ] [MAIN ] VAC: Loaded 35090 existing records. [2025-09-19T21:53:46.248354] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-19T21:53:46.332456] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:46.332735] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-19T21:53:46.332792] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-19T21:53:46.333620] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-19T21:53:46.333713] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-19T21:53:46.700985] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:47.043327] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-19T21:53:47.332321] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-19T21:53:47.635861] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-19T21:53:47.843263] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-19T21:53:47.936981] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-19T21:53:48.392968] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-19T21:53:48.394231] [INFO ] [REMOTE ] UZF: Full fetch complete (8762 records). [2025-09-19T21:53:48.394303] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-19T21:53:48.648446] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-19T21:53:48.791554] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-19T21:53:48.791637] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-19T21:53:48.791922] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-19T21:53:48.791963] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-19T21:53:48.792405] [DEBUG] [LOCAL ] UZF: Trimmed 8762 records to 6540 (keeping 200 days of data) [2025-09-19T21:53:48.833010] [DEBUG] [LOCAL ] UZF: Primary data saved (6540 records). [2025-09-19T21:53:48.833163] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-19T21:53:48.833251] [INFO ] [MAIN ] Update Progress: 2209/2372 symbols completed. UZF took 17.5s. Estimated remaining: 21m 41s. Rate: 7.5 symbols/min [2025-09-19T21:53:49.016639] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:49.071794] [DEBUG] [LOCAL ] VAL: Loaded 50908 existing records from primary storage. [2025-09-19T21:53:49.071973] [INFO ] [MAIN ] VAL: Loaded 50908 existing records. [2025-09-19T21:53:49.262355] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:49.262606] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-19T21:53:49.262709] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-19T21:53:49.263967] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-19T21:53:49.264030] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-19T21:53:49.451259] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-19T21:53:49.653301] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:50.065542] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T21:53:50.243287] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-19T21:53:51.043315] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-19T21:53:51.494104] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T21:53:51.798787] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-19T21:53:51.843268] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-19T21:53:52.643322] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-19T21:53:53.015275] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-19T21:53:53.023183] [INFO ] [REMOTE ] UWMC: Full fetch complete (75401 records). [2025-09-19T21:53:53.023314] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-19T21:53:53.452769] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-19T21:53:53.453167] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-19T21:53:53.454569] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-19T21:53:53.455779] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-19T21:53:53.455971] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-19T21:53:53.457904] [DEBUG] [LOCAL ] UWMC: Trimmed 75401 records to 53493 (keeping 200 days of data) [2025-09-19T21:53:53.668011] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-19T21:53:53.826407] [DEBUG] [LOCAL ] UWMC: Primary data saved (53493 records). [2025-09-19T21:53:53.826567] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-19T21:53:53.826702] [INFO ] [MAIN ] Update Progress: 2210/2372 symbols completed. UWMC took 48.6s. Estimated remaining: 21m 32s. Rate: 7.5 symbols/min [2025-09-19T21:53:54.010329] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:53:54.061994] [DEBUG] [LOCAL ] VALE: Loaded 54084 existing records from primary storage. [2025-09-19T21:53:54.062173] [INFO ] [MAIN ] VALE: Loaded 54084 existing records. [2025-09-19T21:53:54.243996] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-19T21:53:54.248458] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:53:54.249533] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-19T21:53:54.249599] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-19T21:53:54.250871] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-19T21:53:54.250934] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-19T21:53:54.619823] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:53:55.043329] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-19T21:53:55.234446] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-19T21:53:55.380808] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-19T21:53:55.611182] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T21:53:55.843260] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-19T21:53:56.643263] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-19T21:53:56.846239] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T21:53:56.937772] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-19T21:53:57.443284] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-19T21:53:58.243273] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-19T21:53:59.043308] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-19T21:53:59.279005] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-19T21:53:59.384974] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-19T21:53:59.422252] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T21:53:59.843273] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-19T21:54:00.577082] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T21:54:00.643223] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-19T21:54:01.443335] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-19T21:54:02.243253] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-19T21:54:02.891357] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-19T21:54:03.043290] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-19T21:54:03.082474] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (3.24 seconds). [2025-09-19T21:54:03.843325] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-19T21:54:04.903884] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-19T21:54:04.911828] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-19T21:54:05.019680] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (3.58 seconds). [2025-09-19T21:54:05.443259] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-19T21:54:05.729275] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-19T21:54:06.243340] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-19T21:54:06.506552] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-19T21:54:06.736118] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T21:54:07.043277] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-19T21:54:07.629422] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-19T21:54:07.822944] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-19T21:54:07.843222] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-19T21:54:08.643358] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-19T21:54:09.443284] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-19T21:54:09.708058] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-19T21:54:09.991468] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-19T21:54:10.243270] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-19T21:54:10.801667] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T21:54:10.906561] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T21:54:10.911748] [INFO ] [REMOTE ] VAC: Full fetch complete (47608 records). [2025-09-19T21:54:10.911872] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-19T21:54:11.058065] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-19T21:54:11.309744] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-19T21:54:11.309836] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-19T21:54:11.310737] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-19T21:54:11.310799] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-19T21:54:11.311992] [DEBUG] [LOCAL ] VAC: Trimmed 47608 records to 35334 (keeping 200 days of data) [2025-09-19T21:54:11.539082] [DEBUG] [LOCAL ] VAC: Primary data saved (35334 records). [2025-09-19T21:54:11.539365] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-19T21:54:11.539605] [INFO ] [MAIN ] Update Progress: 2211/2372 symbols completed. VAC took 25.6s. Estimated remaining: 21m 25s. Rate: 7.5 symbols/min [2025-09-19T21:54:11.712786] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:54:11.720076] [DEBUG] [LOCAL ] VATE: Loaded 5913 existing records from primary storage. [2025-09-19T21:54:11.720167] [INFO ] [MAIN ] VATE: Loaded 5913 existing records. [2025-09-19T21:54:11.858053] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-19T21:54:11.945584] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:54:11.945996] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-19T21:54:11.946051] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-19T21:54:11.946357] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-19T21:54:11.946417] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-19T21:54:12.308111] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:54:12.643278] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-19T21:54:12.817620] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-19T21:54:12.920711] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T21:54:13.375221] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-19T21:54:13.443288] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-19T21:54:14.243269] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-19T21:54:14.620730] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-19T21:54:15.043268] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-19T21:54:15.843264] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-19T21:54:15.902916] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T21:54:15.911266] [INFO ] [REMOTE ] V: Full fetch complete (77829 records). [2025-09-19T21:54:15.916353] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-19T21:54:15.921087] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-19T21:54:16.337156] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-19T21:54:16.337259] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-19T21:54:16.338424] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-19T21:54:16.338491] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-19T21:54:16.340166] [DEBUG] [LOCAL ] V: Trimmed 77829 records to 54543 (keeping 200 days of data) [2025-09-19T21:54:16.653735] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-19T21:54:16.710369] [DEBUG] [LOCAL ] V: Primary data saved (54543 records). [2025-09-19T21:54:16.710540] [INFO ] [MAIN ] V: Full history saved. [2025-09-19T21:54:16.711088] [INFO ] [MAIN ] Update Progress: 2212/2372 symbols completed. V took 41.8s. Estimated remaining: 21m 17s. Rate: 7.5 symbols/min [2025-09-19T21:54:16.846487] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-19T21:54:16.926799] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:54:16.937018] [DEBUG] [LOCAL ] VBF: Loaded 7200 existing records from primary storage. [2025-09-19T21:54:16.937170] [INFO ] [MAIN ] VBF: Loaded 7200 existing records. [2025-09-19T21:54:17.118058] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:54:17.118327] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-19T21:54:17.118375] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-19T21:54:17.118735] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-19T21:54:17.118794] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-19T21:54:17.448473] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-19T21:54:17.514205] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:54:17.762461] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T21:54:18.215344] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-19T21:54:18.243250] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-19T21:54:19.043290] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-19T21:54:19.158320] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T21:54:19.392536] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T21:54:19.843341] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-19T21:54:20.643339] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-19T21:54:21.060628] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T21:54:21.431931] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-19T21:54:21.443205] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-19T21:54:21.900594] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T21:54:22.199697] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-19T21:54:22.243294] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-19T21:54:22.990290] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T21:54:23.043272] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-19T21:54:23.843276] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-19T21:54:24.643266] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-19T21:54:24.717860] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T21:54:24.900805] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T21:54:24.908371] [INFO ] [REMOTE ] VAL: Full fetch complete (73268 records). [2025-09-19T21:54:24.908569] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-19T21:54:25.303096] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-19T21:54:25.303179] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-19T21:54:25.304274] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-19T21:54:25.304339] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-19T21:54:25.305808] [DEBUG] [LOCAL ] VAL: Trimmed 73268 records to 51276 (keeping 200 days of data) [2025-09-19T21:54:25.476969] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-19T21:54:25.612028] [DEBUG] [LOCAL ] VAL: Primary data saved (51276 records). [2025-09-19T21:54:25.612181] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-19T21:54:25.612269] [INFO ] [MAIN ] Update Progress: 2213/2372 symbols completed. VAL took 36.8s. Estimated remaining: 21m 9s. Rate: 7.5 symbols/min [2025-09-19T21:54:25.781154] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:54:25.795717] [DEBUG] [LOCAL ] VCV: Loaded 13530 existing records from primary storage. [2025-09-19T21:54:25.795839] [INFO ] [MAIN ] VCV: Loaded 13530 existing records. [2025-09-19T21:54:25.972367] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:54:25.972688] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-19T21:54:25.972745] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-19T21:54:25.973246] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-19T21:54:25.973305] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-19T21:54:26.248424] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-19T21:54:26.339000] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:54:26.423699] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T21:54:26.743014] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-19T21:54:26.751235] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-09-19T21:54:26.751395] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-19T21:54:27.058453] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-19T21:54:27.058290] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-19T21:54:27.162323] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-19T21:54:27.162443] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-19T21:54:27.163945] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-19T21:54:27.164086] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-19T21:54:27.166123] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 54474 (keeping 200 days of data) [2025-09-19T21:54:27.501490] [DEBUG] [LOCAL ] VALE: Primary data saved (54474 records). [2025-09-19T21:54:27.501662] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-19T21:54:27.501781] [INFO ] [MAIN ] Update Progress: 2214/2372 symbols completed. VALE took 33.7s. Estimated remaining: 21m 1s. Rate: 7.5 symbols/min [2025-09-19T21:54:27.671745] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:54:27.717610] [DEBUG] [LOCAL ] VEEV: Loaded 47866 existing records from primary storage. [2025-09-19T21:54:27.717782] [INFO ] [MAIN ] VEEV: Loaded 47866 existing records. [2025-09-19T21:54:27.855860] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-19T21:54:27.897237] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:54:27.897504] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-19T21:54:27.897554] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-19T21:54:27.898542] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-19T21:54:27.898604] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-19T21:54:28.128569] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T21:54:28.266207] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:54:28.643232] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-19T21:54:29.132704] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T21:54:29.443280] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-19T21:54:30.243227] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-19T21:54:30.550098] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-19T21:54:30.725587] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T21:54:31.043309] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-19T21:54:31.249434] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T21:54:31.534357] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-19T21:54:31.843265] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-19T21:54:32.643320] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-19T21:54:33.081274] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-19T21:54:33.421625] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-19T21:54:33.443276] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-19T21:54:34.243329] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-19T21:54:34.354094] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T21:54:34.356316] [INFO ] [REMOTE ] VATE: Full fetch complete (10540 records). [2025-09-19T21:54:34.356434] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-19T21:54:34.852970] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-19T21:54:34.853053] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-19T21:54:34.853300] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-19T21:54:34.853338] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-19T21:54:34.853810] [DEBUG] [LOCAL ] VATE: Trimmed 10540 records to 5992 (keeping 200 days of data) [2025-09-19T21:54:34.887446] [DEBUG] [LOCAL ] VATE: Primary data saved (5992 records). [2025-09-19T21:54:34.887587] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-19T21:54:34.887705] [INFO ] [MAIN ] Update Progress: 2215/2372 symbols completed. VATE took 23.3s. Estimated remaining: 20m 53s. Rate: 7.5 symbols/min [2025-09-19T21:54:35.052988] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-19T21:54:35.056216] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:54:35.073610] [DEBUG] [LOCAL ] VEL: Loaded 13087 existing records from primary storage. [2025-09-19T21:54:35.073773] [INFO ] [MAIN ] VEL: Loaded 13087 existing records. [2025-09-19T21:54:35.253837] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:54:35.254099] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-19T21:54:35.254149] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-19T21:54:35.254633] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-19T21:54:35.254748] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-19T21:54:35.630132] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:54:35.843259] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-19T21:54:36.017161] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T21:54:36.235469] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T21:54:36.607809] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T21:54:36.643220] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-19T21:54:37.443326] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-19T21:54:38.243305] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-19T21:54:38.532838] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-19T21:54:38.605751] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T21:54:38.923596] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-19T21:54:39.043298] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-19T21:54:39.843307] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-19T21:54:39.919466] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-19T21:54:40.643302] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-19T21:54:41.380495] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T21:54:41.443210] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-19T21:54:41.589966] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-19T21:54:42.243268] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-19T21:54:42.695137] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-19T21:54:43.043293] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-19T21:54:43.433901] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:54:43.843293] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-19T21:54:43.914566] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-19T21:54:44.413829] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-19T21:54:44.643267] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-19T21:54:45.443308] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-19T21:54:45.585397] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-19T21:54:46.063543] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-19T21:54:46.243258] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-19T21:54:47.030510] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-19T21:54:47.032102] [INFO ] [REMOTE ] VBF: Full fetch complete (10408 records). [2025-09-19T21:54:47.032176] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-19T21:54:47.048508] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-19T21:54:47.403244] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-19T21:54:47.403328] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-19T21:54:47.403571] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-19T21:54:47.403607] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-19T21:54:47.404068] [DEBUG] [LOCAL ] VBF: Trimmed 10408 records to 7212 (keeping 200 days of data) [2025-09-19T21:54:47.447990] [DEBUG] [LOCAL ] VBF: Primary data saved (7212 records). [2025-09-19T21:54:47.448089] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-19T21:54:47.448169] [INFO ] [MAIN ] Update Progress: 2216/2372 symbols completed. VBF took 30.7s. Estimated remaining: 20m 45s. Rate: 7.5 symbols/min [2025-09-19T21:54:47.622166] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:54:47.667597] [DEBUG] [LOCAL ] VET: Loaded 44645 existing records from primary storage. [2025-09-19T21:54:47.667778] [INFO ] [MAIN ] VET: Loaded 44645 existing records. [2025-09-19T21:54:47.848401] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-19T21:54:47.852680] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:54:47.854054] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-19T21:54:47.854157] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-19T21:54:47.855198] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-19T21:54:47.855271] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-19T21:54:48.032397] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T21:54:48.239949] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:54:48.643284] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-19T21:54:49.077998] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T21:54:49.443294] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-19T21:54:49.655276] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-19T21:54:50.243277] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-19T21:54:50.559939] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T21:54:51.043248] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-19T21:54:51.430030] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T21:54:51.843316] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-19T21:54:52.643262] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-19T21:54:53.015891] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T21:54:53.187314] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T21:54:53.443270] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-19T21:54:54.243402] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-19T21:54:54.402359] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-19T21:54:54.534476] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T21:54:55.043283] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-19T21:54:55.843268] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-19T21:54:56.009580] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-19T21:54:56.240561] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-19T21:54:56.643334] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-19T21:54:56.951479] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-19T21:54:57.443325] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-19T21:54:57.558090] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T21:54:57.560334] [INFO ] [REMOTE ] VEL: Full fetch complete (16559 records). [2025-09-19T21:54:57.560407] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-19T21:54:57.952887] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-19T21:54:57.952992] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-19T21:54:57.953678] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-19T21:54:57.953742] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-19T21:54:57.954506] [DEBUG] [LOCAL ] VEL: Trimmed 16559 records to 13150 (keeping 200 days of data) [2025-09-19T21:54:58.041836] [DEBUG] [LOCAL ] VEL: Primary data saved (13150 records). [2025-09-19T21:54:58.042051] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-19T21:54:58.042204] [INFO ] [MAIN ] Update Progress: 2217/2372 symbols completed. VEL took 23.2s. Estimated remaining: 20m 37s. Rate: 7.5 symbols/min [2025-09-19T21:54:58.224662] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:54:58.243318] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-19T21:54:58.300079] [DEBUG] [LOCAL ] VFC: Loaded 53999 existing records from primary storage. [2025-09-19T21:54:58.300303] [INFO ] [MAIN ] VFC: Loaded 53999 existing records. [2025-09-19T21:54:58.493350] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:54:58.493791] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-19T21:54:58.493854] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-19T21:54:58.497007] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-19T21:54:58.497077] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-19T21:54:58.894397] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:54:59.043367] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-19T21:54:59.324100] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-19T21:54:59.418285] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T21:54:59.843288] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-19T21:55:00.643281] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-19T21:55:00.768711] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T21:55:00.772382] [INFO ] [REMOTE ] VCV: Full fetch complete (19625 records). [2025-09-19T21:55:00.772466] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-19T21:55:01.149129] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-19T21:55:01.149435] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-19T21:55:01.150561] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-19T21:55:01.150705] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-19T21:55:01.151725] [DEBUG] [LOCAL ] VCV: Trimmed 19625 records to 13645 (keeping 200 days of data) [2025-09-19T21:55:01.250589] [DEBUG] [LOCAL ] VCV: Primary data saved (13645 records). [2025-09-19T21:55:01.250783] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-19T21:55:01.250978] [INFO ] [MAIN ] Update Progress: 2218/2372 symbols completed. VCV took 35.6s. Estimated remaining: 20m 29s. Rate: 7.5 symbols/min [2025-09-19T21:55:01.447422] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-19T21:55:01.464849] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-19T21:55:01.511061] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:55:01.512149] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-19T21:55:01.512209] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-19T21:55:01.512364] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-19T21:55:01.512409] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-19T21:55:01.512452] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-19T21:55:01.512501] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-19T21:55:01.915922] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:55:02.243321] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-19T21:55:02.388006] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T21:55:02.609106] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:02.609449] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-19T21:55:03.043265] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-19T21:55:03.558260] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-19T21:55:03.843288] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-19T21:55:04.505750] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-19T21:55:04.513796] [INFO ] [REMOTE ] VEEV: Full fetch complete (68621 records). [2025-09-19T21:55:04.513951] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-19T21:55:04.648427] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-19T21:55:04.941750] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-19T21:55:04.941858] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-19T21:55:04.943105] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-19T21:55:04.943235] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-19T21:55:04.945702] [DEBUG] [LOCAL ] VEEV: Trimmed 68621 records to 48195 (keeping 200 days of data) [2025-09-19T21:55:05.155553] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-19T21:55:05.274143] [DEBUG] [LOCAL ] VEEV: Primary data saved (48195 records). [2025-09-19T21:55:05.274340] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-19T21:55:05.274551] [INFO ] [MAIN ] Update Progress: 2219/2372 symbols completed. VEEV took 37.8s. Estimated remaining: 20m 20s. Rate: 7.5 symbols/min [2025-09-19T21:55:05.452295] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:55:05.448683] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-19T21:55:05.460873] [DEBUG] [LOCAL ] VGI: Loaded 5270 existing records from primary storage. [2025-09-19T21:55:05.461010] [INFO ] [MAIN ] VGI: Loaded 5270 existing records. [2025-09-19T21:55:05.652126] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:55:05.652430] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-19T21:55:05.652491] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-19T21:55:05.652748] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-19T21:55:05.652827] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-19T21:55:06.067314] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:55:06.243276] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-19T21:55:06.325915] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T21:55:06.671420] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-19T21:55:06.924484] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T21:55:07.043271] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-19T21:55:07.843276] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-19T21:55:08.643258] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-19T21:55:08.826284] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-19T21:55:09.443262] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-19T21:55:09.919000] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-19T21:55:10.243249] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-19T21:55:10.871272] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-19T21:55:11.043258] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-19T21:55:11.109430] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-19T21:55:11.240235] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T21:55:11.843264] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-19T21:55:12.643318] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-19T21:55:12.844695] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-19T21:55:13.051295] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-19T21:55:13.443261] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-19T21:55:14.243342] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-19T21:55:14.923313] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-19T21:55:15.043235] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-19T21:55:15.181001] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T21:55:15.843268] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-19T21:55:15.926358] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-19T21:55:16.643251] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-19T21:55:16.780455] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-19T21:55:17.326513] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T21:55:17.336126] [INFO ] [REMOTE ] VET: Full fetch complete (64304 records). [2025-09-19T21:55:17.336257] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-19T21:55:17.445597] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-19T21:55:17.749094] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-19T21:55:17.749193] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-19T21:55:17.750263] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-19T21:55:17.750329] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-19T21:55:17.751804] [DEBUG] [LOCAL ] VET: Trimmed 64304 records to 44937 (keeping 200 days of data) [2025-09-19T21:55:18.029005] [DEBUG] [LOCAL ] VET: Primary data saved (44937 records). [2025-09-19T21:55:18.029532] [INFO ] [MAIN ] VET: Full history saved. [2025-09-19T21:55:18.030359] [INFO ] [MAIN ] Update Progress: 2220/2372 symbols completed. VET took 30.6s. Estimated remaining: 20m 13s. Rate: 7.5 symbols/min [2025-09-19T21:55:18.201614] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:55:18.225978] [DEBUG] [LOCAL ] VGM: Loaded 18403 existing records from primary storage. [2025-09-19T21:55:18.226110] [INFO ] [MAIN ] VGM: Loaded 18403 existing records. [2025-09-19T21:55:18.248334] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-19T21:55:18.408825] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:55:18.409238] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-19T21:55:18.409301] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-19T21:55:18.409975] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-19T21:55:18.410036] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-19T21:55:18.776879] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:55:18.788568] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T21:55:18.920794] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-19T21:55:19.043215] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-19T21:55:19.128301] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T21:55:19.843265] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-19T21:55:20.493758] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T21:55:20.643347] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-19T21:55:20.767689] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-19T21:55:21.443329] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-19T21:55:22.243274] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-19T21:55:22.444281] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-19T21:55:22.912360] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-19T21:55:23.043255] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-19T21:55:23.843348] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-19T21:55:23.981944] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T21:55:24.263774] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-19T21:55:24.643278] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-19T21:55:25.412438] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-19T21:55:25.443260] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-19T21:55:26.243267] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-19T21:55:26.401621] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T21:55:27.043290] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-19T21:55:27.425595] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T21:55:27.550353] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T21:55:27.843324] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-19T21:55:28.643295] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-19T21:55:28.983337] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T21:55:29.396192] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T21:55:29.443302] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-19T21:55:29.839290] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-19T21:55:29.862775] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-19T21:55:29.870738] [INFO ] [REMOTE ] VFC: Full fetch complete (77587 records). [2025-09-19T21:55:29.870864] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-19T21:55:30.255190] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-19T21:55:30.282048] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-19T21:55:30.282145] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-19T21:55:30.283352] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-19T21:55:30.283428] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-19T21:55:30.288537] [DEBUG] [LOCAL ] VFC: Trimmed 77587 records to 54389 (keeping 200 days of data) [2025-09-19T21:55:30.654010] [DEBUG] [LOCAL ] VFC: Primary data saved (54389 records). [2025-09-19T21:55:30.654208] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-19T21:55:30.654362] [INFO ] [MAIN ] Update Progress: 2221/2372 symbols completed. VFC took 32.6s. Estimated remaining: 20m 5s. Rate: 7.5 symbols/min [2025-09-19T21:55:30.835369] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:55:30.835561] [DEBUG] [LOCAL ] VHC: No existing data file found in primary storage. [2025-09-19T21:55:30.835612] [WARN ] [MAIN ] VHC: No existing data found, performing full refresh instead. [2025-09-19T21:55:30.835770] [INFO ] [MAIN ] VHC: Wiping existing primary data before full refresh. [2025-09-19T21:55:30.835813] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-19T21:55:30.835858] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-19T21:55:30.835890] [INFO ] [MAIN ] VHC: Starting full primary refresh. [2025-09-19T21:55:31.048444] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-19T21:55:31.207352] [INFO ] [REMOTE ] VHC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:55:31.843262] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-19T21:55:32.125886] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-19T21:55:32.367134] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-19T21:55:32.375562] [INFO ] [REMOTE ] VG: Full fetch complete (63732 records). [2025-09-19T21:55:32.375794] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-19T21:55:32.584341] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-19T21:55:32.585286] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:55:32.585398] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:55:32.585589] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-19T21:55:32.585756] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-19T21:55:32.590213] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-19T21:55:32.590351] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-19T21:55:32.591329] [INFO ] [MAIN ] Update Progress: 2222/2372 symbols completed. VG took 31.3s. Estimated remaining: 19m 57s. Rate: 7.5 symbols/min [2025-09-19T21:55:32.591180] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T21:55:32.648445] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-19T21:55:32.790092] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:55:32.795948] [DEBUG] [LOCAL ] VHI: Loaded 3006 existing records from primary storage. [2025-09-19T21:55:32.796054] [INFO ] [MAIN ] VHI: Loaded 3006 existing records. [2025-09-19T21:55:32.978129] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:55:32.978427] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-19T21:55:32.978494] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-19T21:55:32.978884] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-19T21:55:32.978946] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-19T21:55:33.336170] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:55:33.443277] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-19T21:55:33.508610] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T21:55:34.242151] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-19T21:55:34.243584] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-19T21:55:35.043314] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-19T21:55:35.668179] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T21:55:35.843668] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-19T21:55:35.845107] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T21:55:35.848494] [INFO ] [REMOTE ] VGI: Full fetch complete (7764 records). [2025-09-19T21:55:35.848571] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-19T21:55:36.233497] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-19T21:55:36.233592] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-19T21:55:36.233839] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-19T21:55:36.233914] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-19T21:55:36.234493] [DEBUG] [LOCAL ] VGI: Trimmed 7764 records to 5317 (keeping 200 days of data) [2025-09-19T21:55:36.265618] [DEBUG] [LOCAL ] VGI: Primary data saved (5317 records). [2025-09-19T21:55:36.265778] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-19T21:55:36.265865] [INFO ] [MAIN ] Update Progress: 2223/2372 symbols completed. VGI took 31.0s. Estimated remaining: 19m 49s. Rate: 7.5 symbols/min [2025-09-19T21:55:36.438596] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:55:36.438849] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-19T21:55:36.438905] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-19T21:55:36.439045] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-19T21:55:36.439088] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-19T21:55:36.439128] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-19T21:55:36.439159] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-19T21:55:36.647632] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-19T21:55:36.741532] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-19T21:55:36.812903] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:55:37.443266] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-19T21:55:37.540000] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-19T21:55:37.672888] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:37.673212] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-19T21:55:38.243291] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-19T21:55:38.486766] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:38.487108] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-19T21:55:39.043272] [INFO ] [REMOTE ] VHC: Fetching primary data for 2024-12. [2025-09-19T21:55:39.784284] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-19T21:55:39.843238] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-01. [2025-09-19T21:55:40.480003] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-19T21:55:40.643342] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-19T21:55:41.026228] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-19T21:55:41.443297] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-02. [2025-09-19T21:55:41.987851] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-19T21:55:42.243323] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-19T21:55:43.043250] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-03. [2025-09-19T21:55:43.554000] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T21:55:43.843308] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-19T21:55:43.892821] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-19T21:55:44.603122] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-19T21:55:44.643215] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-19T21:55:45.443250] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-04. [2025-09-19T21:55:45.775464] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T21:55:46.078162] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-19T21:55:46.243290] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-19T21:55:46.471842] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:46.472157] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-19T21:55:47.043318] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-19T21:55:47.768203] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-19T21:55:47.843271] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-05. [2025-09-19T21:55:48.292758] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-19T21:55:48.643268] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-06. [2025-09-19T21:55:49.340364] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T21:55:49.443277] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-19T21:55:50.243243] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-19T21:55:50.465613] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:50.465980] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-19T21:55:50.625249] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T21:55:50.628884] [INFO ] [REMOTE ] VGM: Full fetch complete (26150 records). [2025-09-19T21:55:50.628966] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-19T21:55:50.998962] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-19T21:55:50.999073] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-19T21:55:50.999618] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-19T21:55:50.999689] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-19T21:55:51.000533] [DEBUG] [LOCAL ] VGM: Trimmed 26150 records to 18478 (keeping 200 days of data) [2025-09-19T21:55:51.046820] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-19T21:55:51.115234] [DEBUG] [LOCAL ] VGM: Primary data saved (18478 records). [2025-09-19T21:55:51.115369] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-19T21:55:51.115476] [INFO ] [MAIN ] Update Progress: 2224/2372 symbols completed. VGM took 33.1s. Estimated remaining: 19m 41s. Rate: 7.5 symbols/min [2025-09-19T21:55:51.286298] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:55:51.338719] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:51.339947] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-19T21:55:51.341275] [DEBUG] [LOCAL ] VICI: Loaded 54038 existing records from primary storage. [2025-09-19T21:55:51.341352] [INFO ] [MAIN ] VICI: Loaded 54038 existing records. [2025-09-19T21:55:51.520954] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:55:51.521185] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-19T21:55:51.521247] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-19T21:55:51.522793] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-19T21:55:51.522858] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-19T21:55:51.858817] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-19T21:55:51.905333] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:55:52.466361] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-19T21:55:52.643299] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-19T21:55:52.888030] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:52.888394] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-19T21:55:53.443263] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-19T21:55:54.243281] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-19T21:55:54.826802] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-19T21:55:55.043251] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-19T21:55:55.612312] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T21:55:55.843253] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-19T21:55:55.942309] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-19T21:55:56.087339] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:56.087746] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-19T21:55:56.643296] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-19T21:55:56.881118] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:55:56.881465] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-19T21:55:57.443269] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-19T21:55:58.243267] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-07. [2025-09-19T21:55:59.029695] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-19T21:55:59.043201] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-08. [2025-09-19T21:55:59.655877] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-19T21:55:59.658734] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T21:55:59.843268] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-19T21:56:00.597798] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-19T21:56:00.643223] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-19T21:56:01.229778] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-19T21:56:01.443273] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-19T21:56:02.243316] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-19T21:56:02.505415] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:56:02.505800] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-19T21:56:03.043289] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-19T21:56:03.692833] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-19T21:56:03.843262] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-19T21:56:04.018772] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-19T21:56:04.021742] [INFO ] [REMOTE ] VIA: Full fetch complete (1784 records). [2025-09-19T21:56:04.021870] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-19T21:56:04.213597] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 6 unique days, need 200 days [2025-09-19T21:56:04.213942] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:56:04.214028] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:56:04.214117] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-19T21:56:04.214256] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-19T21:56:04.214331] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-19T21:56:04.214435] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-19T21:56:04.214579] [INFO ] [MAIN ] Update Progress: 2225/2372 symbols completed. VIA took 27.9s. Estimated remaining: 19m 33s. Rate: 7.5 symbols/min [2025-09-19T21:56:04.396069] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:56:04.454988] [DEBUG] [LOCAL ] VIK: Loaded 52904 existing records from primary storage. [2025-09-19T21:56:04.455154] [INFO ] [MAIN ] VIK: Loaded 52904 existing records. [2025-09-19T21:56:04.648342] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-19T21:56:04.673483] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:56:04.673776] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-19T21:56:04.673830] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-19T21:56:04.675009] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-19T21:56:04.675073] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-19T21:56:05.044126] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:56:05.443282] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-19T21:56:05.447817] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-19T21:56:05.448827] [INFO ] [REMOTE ] VHI: Full fetch complete (4705 records). [2025-09-19T21:56:05.448899] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-19T21:56:05.806032] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-19T21:56:05.806116] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-19T21:56:05.806250] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-19T21:56:05.806290] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-19T21:56:05.806684] [DEBUG] [LOCAL ] VHI: Trimmed 4705 records to 3016 (keeping 200 days of data) [2025-09-19T21:56:05.825149] [DEBUG] [LOCAL ] VHI: Primary data saved (3016 records). [2025-09-19T21:56:05.825217] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-19T21:56:05.825290] [INFO ] [MAIN ] Update Progress: 2226/2372 symbols completed. VHI took 33.2s. Estimated remaining: 19m 25s. Rate: 7.5 symbols/min [2025-09-19T21:56:05.997701] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:56:06.037616] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T21:56:06.069451] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-19T21:56:06.070451] [INFO ] [REMOTE ] VHC: Full fetch complete (3741 records). [2025-09-19T21:56:06.070529] [DEBUG] [VALIDATOR ] VHC: Validating primary data. [2025-09-19T21:56:06.203018] [DEBUG] [LOCAL ] VIPS: Loaded 51777 existing records from primary storage. [2025-09-19T21:56:06.213438] [INFO ] [MAIN ] VIPS: Loaded 51777 existing records. [2025-09-19T21:56:06.248416] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-19T21:56:06.327263] [WARN ] [VALIDATOR ] VHC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-19T21:56:06.349887] [FATAL] [MAIN ] VHC: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:56:06.378188] [WARN ] [MAIN ] VHC: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:56:06.378556] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-19T21:56:06.389129] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-19T21:56:06.394324] [INFO ] [LOCAL ] VHC: Starting deletion of derivative data. [2025-09-19T21:56:06.399528] [DEBUG] [LOCAL ] VHC: No derivative data file found to delete. [2025-09-19T21:56:06.404767] [INFO ] [MAIN ] Update Progress: 2227/2372 symbols completed. VHC took 35.8s. Estimated remaining: 19m 16s. Rate: 7.5 symbols/min [2025-09-19T21:56:06.558883] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:56:06.574992] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-19T21:56:06.580179] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-19T21:56:06.627399] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-19T21:56:06.629342] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-19T21:56:06.630815] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:56:07.026634] [DEBUG] [LOCAL ] VIRT: Loaded 47404 existing records from primary storage. [2025-09-19T21:56:07.025187] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:56:07.027178] [INFO ] [MAIN ] VIRT: Loaded 47404 existing records. [2025-09-19T21:56:07.048915] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-19T21:56:07.214302] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:56:07.214565] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-19T21:56:07.214615] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-19T21:56:07.215845] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-19T21:56:07.215907] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-19T21:56:07.584160] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:56:07.843289] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-19T21:56:08.428790] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T21:56:08.643277] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-19T21:56:09.021591] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-19T21:56:09.443265] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-19T21:56:10.243245] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-19T21:56:10.293772] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-19T21:56:10.583889] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-19T21:56:10.877321] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-19T21:56:11.043255] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-19T21:56:11.541028] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T21:56:11.843282] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-19T21:56:12.643262] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-19T21:56:12.836413] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-19T21:56:13.443300] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-19T21:56:13.932445] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T21:56:14.243285] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-19T21:56:14.452758] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T21:56:15.043264] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-19T21:56:15.202137] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-19T21:56:15.843277] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-19T21:56:15.898397] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-19T21:56:16.342073] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T21:56:16.643271] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-19T21:56:17.443342] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-19T21:56:18.007480] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-19T21:56:18.243281] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-19T21:56:18.612886] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-19T21:56:18.734362] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T21:56:19.043284] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-19T21:56:19.843288] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-19T21:56:20.170998] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T21:56:20.355732] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T21:56:20.643317] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-19T21:56:21.443338] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-19T21:56:21.878480] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-19T21:56:22.052744] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T21:56:22.243328] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-19T21:56:23.043311] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-19T21:56:23.208302] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T21:56:23.843250] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-19T21:56:23.955819] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-19T21:56:24.653750] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-19T21:56:24.659741] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T21:56:25.321587] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-19T21:56:25.443268] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-19T21:56:26.243259] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-19T21:56:26.666838] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T21:56:27.043268] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-19T21:56:27.421128] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T21:56:27.843243] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-19T21:56:28.417199] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-19T21:56:28.643290] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-19T21:56:29.022386] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-19T21:56:29.443236] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-19T21:56:30.043184] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T21:56:30.080491] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-19T21:56:30.243297] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-19T21:56:30.390920] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-19T21:56:30.400607] [INFO ] [REMOTE ] VICI: Full fetch complete (77651 records). [2025-09-19T21:56:30.400818] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-19T21:56:30.806362] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-19T21:56:30.806464] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-19T21:56:30.807693] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-19T21:56:30.807765] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-19T21:56:30.809387] [DEBUG] [LOCAL ] VICI: Trimmed 77651 records to 54428 (keeping 200 days of data) [2025-09-19T21:56:31.043303] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-19T21:56:31.154298] [DEBUG] [LOCAL ] VICI: Primary data saved (54428 records). [2025-09-19T21:56:31.154459] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-19T21:56:31.154851] [INFO ] [MAIN ] Update Progress: 2228/2372 symbols completed. VICI took 40.0s. Estimated remaining: 19m 10s. Rate: 7.5 symbols/min [2025-09-19T21:56:31.328799] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:56:31.374300] [DEBUG] [LOCAL ] VIST: Loaded 46331 existing records from primary storage. [2025-09-19T21:56:31.374447] [INFO ] [MAIN ] VIST: Loaded 46331 existing records. [2025-09-19T21:56:31.551179] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:56:31.551447] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-19T21:56:31.551494] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-19T21:56:31.552487] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-19T21:56:31.552547] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-19T21:56:31.848468] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-19T21:56:31.907445] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:56:31.997204] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-19T21:56:32.004319] [INFO ] [REMOTE ] VIRT: Full fetch complete (66874 records). [2025-09-19T21:56:32.004439] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-19T21:56:32.399604] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-19T21:56:32.399722] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-19T21:56:32.400894] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-19T21:56:32.400960] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-19T21:56:32.402361] [DEBUG] [LOCAL ] VIRT: Trimmed 66874 records to 47718 (keeping 200 days of data) [2025-09-19T21:56:32.646857] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-19T21:56:32.703661] [DEBUG] [LOCAL ] VIRT: Primary data saved (47718 records). [2025-09-19T21:56:32.703813] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-19T21:56:32.703933] [INFO ] [MAIN ] Update Progress: 2229/2372 symbols completed. VIRT took 26.3s. Estimated remaining: 19m 1s. Rate: 7.5 symbols/min [2025-09-19T21:56:32.882588] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:56:32.925299] [DEBUG] [LOCAL ] VIV: Loaded 45797 existing records from primary storage. [2025-09-19T21:56:32.925486] [INFO ] [MAIN ] VIV: Loaded 45797 existing records. [2025-09-19T21:56:33.108911] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:56:33.109369] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-19T21:56:33.109474] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-19T21:56:33.110382] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-19T21:56:33.110443] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-19T21:56:33.457904] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T21:56:33.524461] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-19T21:56:33.523944] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:56:33.738620] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T21:56:33.852794] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-19T21:56:34.243300] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-19T21:56:35.043269] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-19T21:56:35.405102] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T21:56:35.412819] [INFO ] [REMOTE ] VIK: Full fetch complete (75869 records). [2025-09-19T21:56:35.412947] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-19T21:56:35.814246] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-19T21:56:35.814493] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-19T21:56:35.815785] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-19T21:56:35.825695] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-19T21:56:35.844435] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-19T21:56:35.844599] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-19T21:56:35.857094] [DEBUG] [LOCAL ] VIK: Trimmed 75869 records to 53290 (keeping 200 days of data) [2025-09-19T21:56:36.176945] [DEBUG] [LOCAL ] VIK: Primary data saved (53290 records). [2025-09-19T21:56:36.177170] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-19T21:56:36.177330] [INFO ] [MAIN ] Update Progress: 2230/2372 symbols completed. VIK took 32.0s. Estimated remaining: 18m 53s. Rate: 7.5 symbols/min [2025-09-19T21:56:36.357221] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:56:36.375867] [DEBUG] [LOCAL ] VKQ: Loaded 17670 existing records from primary storage. [2025-09-19T21:56:36.375995] [INFO ] [MAIN ] VKQ: Loaded 17670 existing records. [2025-09-19T21:56:36.559398] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:56:36.559693] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-19T21:56:36.559761] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-19T21:56:36.560368] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-19T21:56:36.560431] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-19T21:56:36.648419] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-19T21:56:36.946024] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:56:37.105666] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T21:56:37.397486] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-19T21:56:37.443245] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-19T21:56:38.243341] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-19T21:56:38.509822] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-19T21:56:38.517686] [INFO ] [REMOTE ] VIPS: Full fetch complete (74611 records). [2025-09-19T21:56:38.517846] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-19T21:56:38.810683] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T21:56:38.944246] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-19T21:56:38.944356] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-19T21:56:38.945637] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-19T21:56:38.945725] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-19T21:56:38.947433] [DEBUG] [LOCAL ] VIPS: Trimmed 74611 records to 52155 (keeping 200 days of data) [2025-09-19T21:56:39.044514] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-19T21:56:39.280859] [DEBUG] [LOCAL ] VIPS: Primary data saved (52155 records). [2025-09-19T21:56:39.281013] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-19T21:56:39.281115] [INFO ] [MAIN ] Update Progress: 2231/2372 symbols completed. VIPS took 33.5s. Estimated remaining: 18m 45s. Rate: 7.5 symbols/min [2025-09-19T21:56:39.457138] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:56:39.484839] [DEBUG] [LOCAL ] VLN: Loaded 28337 existing records from primary storage. [2025-09-19T21:56:39.484986] [INFO ] [MAIN ] VLN: Loaded 28337 existing records. [2025-09-19T21:56:39.667204] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:56:39.667481] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-19T21:56:39.667531] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-19T21:56:39.668164] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-19T21:56:39.668224] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-19T21:56:39.847360] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-19T21:56:40.034832] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:56:40.058736] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-19T21:56:40.472178] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T21:56:40.522905] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T21:56:40.643228] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-19T21:56:41.443267] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-19T21:56:42.243257] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-19T21:56:42.522282] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T21:56:42.540274] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T21:56:43.043271] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-19T21:56:43.843315] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-19T21:56:43.978987] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-19T21:56:44.060046] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-19T21:56:44.643254] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-19T21:56:45.029388] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T21:56:45.443252] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-19T21:56:45.840444] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-19T21:56:46.243267] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-19T21:56:47.043260] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-19T21:56:47.752112] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-19T21:56:47.843270] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-19T21:56:48.134465] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-19T21:56:48.643305] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-19T21:56:48.716803] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-19T21:56:49.234918] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-19T21:56:49.443304] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-19T21:56:50.243269] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-19T21:56:50.483697] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T21:56:50.564270] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-19T21:56:51.043321] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-19T21:56:51.114002] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T21:56:51.843268] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-19T21:56:52.224421] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T21:56:52.643238] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-19T21:56:53.025284] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-19T21:56:53.443267] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-19T21:56:54.243275] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-19T21:56:54.420591] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T21:56:54.869192] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-19T21:56:55.043235] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-19T21:56:55.532331] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-19T21:56:55.843275] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-19T21:56:56.643351] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-19T21:56:56.887280] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T21:56:56.975222] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T21:56:57.443305] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-19T21:56:57.995415] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T21:56:58.243277] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-19T21:56:59.043316] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-19T21:56:59.268174] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-19T21:56:59.337413] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T21:56:59.340757] [INFO ] [REMOTE ] VKQ: Full fetch complete (24502 records). [2025-09-19T21:56:59.340839] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-19T21:56:59.748872] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-19T21:56:59.748966] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-19T21:56:59.749478] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-19T21:56:59.749548] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-19T21:56:59.750417] [DEBUG] [LOCAL ] VKQ: Trimmed 24502 records to 17758 (keeping 200 days of data) [2025-09-19T21:56:59.843367] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-19T21:56:59.861492] [DEBUG] [LOCAL ] VKQ: Primary data saved (17758 records). [2025-09-19T21:56:59.861609] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-19T21:56:59.861733] [INFO ] [MAIN ] Update Progress: 2232/2372 symbols completed. VKQ took 23.7s. Estimated remaining: 18m 37s. Rate: 7.5 symbols/min [2025-09-19T21:57:00.051316] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:00.116080] [DEBUG] [LOCAL ] VLO: Loaded 53482 existing records from primary storage. [2025-09-19T21:57:00.116263] [INFO ] [MAIN ] VLO: Loaded 53482 existing records. [2025-09-19T21:57:00.302635] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:00.303398] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-19T21:57:00.303638] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-19T21:57:00.305151] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-19T21:57:00.305230] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-19T21:57:00.616527] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T21:57:00.644312] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-19T21:57:00.757148] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:01.394531] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-19T21:57:01.443318] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-19T21:57:02.243335] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-19T21:57:03.043299] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-19T21:57:03.565393] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-09-19T21:57:03.843283] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-19T21:57:04.574063] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-09-19T21:57:04.581851] [INFO ] [REMOTE ] VIST: Full fetch complete (66755 records). [2025-09-19T21:57:04.582040] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-19T21:57:05.014535] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-19T21:57:05.014638] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-19T21:57:05.015969] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-19T21:57:05.016034] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-19T21:57:05.020568] [DEBUG] [LOCAL ] VIST: Trimmed 66755 records to 46710 (keeping 200 days of data) [2025-09-19T21:57:05.269423] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T21:57:05.279602] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-19T21:57:05.345297] [DEBUG] [LOCAL ] VIST: Primary data saved (46710 records). [2025-09-19T21:57:05.345482] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-19T21:57:05.346671] [INFO ] [MAIN ] Update Progress: 2233/2372 symbols completed. VIST took 34.2s. Estimated remaining: 18m 29s. Rate: 7.5 symbols/min [2025-09-19T21:57:05.486428] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (3.24 seconds). [2025-09-19T21:57:05.498551] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-19T21:57:05.574180] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:05.601724] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-19T21:57:05.647376] [DEBUG] [LOCAL ] VLRS: Loaded 41361 existing records from primary storage. [2025-09-19T21:57:05.647551] [INFO ] [MAIN ] VLRS: Loaded 41361 existing records. [2025-09-19T21:57:05.836105] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:05.836456] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-19T21:57:05.836529] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-19T21:57:05.837718] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-19T21:57:05.837799] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-19T21:57:06.202129] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:06.243236] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-19T21:57:06.515066] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T21:57:07.043303] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-19T21:57:07.715507] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-19T21:57:07.843334] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-19T21:57:08.109951] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T21:57:08.643270] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-19T21:57:08.675267] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T21:57:08.684592] [INFO ] [REMOTE ] VIV: Full fetch complete (64873 records). [2025-09-19T21:57:08.684794] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-19T21:57:09.128804] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-19T21:57:09.128910] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-19T21:57:09.130182] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-19T21:57:09.130252] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-19T21:57:09.131817] [DEBUG] [LOCAL ] VIV: Trimmed 64873 records to 46060 (keeping 200 days of data) [2025-09-19T21:57:09.430242] [DEBUG] [LOCAL ] VIV: Primary data saved (46060 records). [2025-09-19T21:57:09.430470] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-19T21:57:09.430602] [INFO ] [MAIN ] Update Progress: 2234/2372 symbols completed. VIV took 36.7s. Estimated remaining: 18m 21s. Rate: 7.5 symbols/min [2025-09-19T21:57:09.463472] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-19T21:57:09.611428] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:09.645010] [DEBUG] [LOCAL ] VLT: Loaded 4732 existing records from primary storage. [2025-09-19T21:57:09.646502] [INFO ] [MAIN ] VLT: Loaded 4732 existing records. [2025-09-19T21:57:09.646393] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-19T21:57:09.834338] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:09.834625] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-19T21:57:09.834708] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-19T21:57:09.835022] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-19T21:57:09.835100] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-19T21:57:10.192443] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:10.243256] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-19T21:57:10.299020] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T21:57:10.681706] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-19T21:57:11.043265] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-19T21:57:11.843338] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-19T21:57:12.108715] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-19T21:57:12.643327] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-19T21:57:12.832325] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T21:57:13.392533] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-19T21:57:13.400250] [INFO ] [REMOTE ] VLN: Full fetch complete (43567 records). [2025-09-19T21:57:13.400386] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-19T21:57:13.448347] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-19T21:57:13.751147] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-19T21:57:13.823410] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-19T21:57:13.823525] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-19T21:57:13.824710] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-19T21:57:13.824813] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-19T21:57:13.826844] [DEBUG] [LOCAL ] VLN: Trimmed 43567 records to 28581 (keeping 200 days of data) [2025-09-19T21:57:14.012458] [DEBUG] [LOCAL ] VLN: Primary data saved (28581 records). [2025-09-19T21:57:14.012620] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-19T21:57:14.012799] [INFO ] [MAIN ] Update Progress: 2235/2372 symbols completed. VLN took 34.7s. Estimated remaining: 18m 13s. Rate: 7.5 symbols/min [2025-09-19T21:57:14.207332] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:14.244239] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-19T21:57:14.278508] [DEBUG] [LOCAL ] VLTO: Loaded 46408 existing records from primary storage. [2025-09-19T21:57:14.278756] [INFO ] [MAIN ] VLTO: Loaded 46408 existing records. [2025-09-19T21:57:14.561794] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:14.562085] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-19T21:57:14.562136] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-19T21:57:14.563164] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-19T21:57:14.563240] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-19T21:57:15.048497] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-19T21:57:15.149945] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:15.596021] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-19T21:57:15.843264] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-19T21:57:16.022777] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-19T21:57:16.612829] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-19T21:57:16.643246] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-19T21:57:16.862973] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-19T21:57:17.443257] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-19T21:57:17.542842] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-19T21:57:18.243264] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-19T21:57:18.782259] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-19T21:57:18.941426] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-19T21:57:19.043214] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-19T21:57:19.706155] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-19T21:57:19.843286] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-19T21:57:20.643250] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-19T21:57:21.443264] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-19T21:57:22.028804] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-19T21:57:22.243271] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-19T21:57:22.438786] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-19T21:57:22.471630] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T21:57:23.043268] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-19T21:57:23.843252] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-19T21:57:23.991692] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T21:57:24.435044] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-19T21:57:24.643282] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-19T21:57:25.443244] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-19T21:57:25.976104] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-19T21:57:26.243257] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-19T21:57:26.802629] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-19T21:57:26.843917] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-19T21:57:27.043258] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-19T21:57:27.711486] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-19T21:57:27.843268] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-19T21:57:28.643281] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-19T21:57:28.718065] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T21:57:28.719465] [INFO ] [REMOTE ] VLT: Full fetch complete (7516 records). [2025-09-19T21:57:28.719539] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-19T21:57:29.127346] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-19T21:57:29.143717] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-19T21:57:29.144352] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-19T21:57:29.144684] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-19T21:57:29.144797] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-19T21:57:29.146071] [DEBUG] [LOCAL ] VLT: Trimmed 7516 records to 4756 (keeping 200 days of data) [2025-09-19T21:57:29.182133] [DEBUG] [LOCAL ] VLT: Primary data saved (4756 records). [2025-09-19T21:57:29.182367] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-19T21:57:29.182571] [INFO ] [MAIN ] Update Progress: 2236/2372 symbols completed. VLT took 19.8s. Estimated remaining: 18m 5s. Rate: 7.5 symbols/min [2025-09-19T21:57:29.361678] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:29.416795] [DEBUG] [LOCAL ] VMC: Loaded 44373 existing records from primary storage. [2025-09-19T21:57:29.416947] [INFO ] [MAIN ] VMC: Loaded 44373 existing records. [2025-09-19T21:57:29.451400] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-19T21:57:29.607771] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:29.608040] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-19T21:57:29.608113] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-19T21:57:29.609163] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-19T21:57:29.609226] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-19T21:57:29.992480] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:30.251679] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-19T21:57:30.257916] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-19T21:57:31.043316] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-19T21:57:31.262311] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T21:57:31.843267] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-19T21:57:32.413481] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-19T21:57:32.643256] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-19T21:57:32.670213] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T21:57:33.443269] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-19T21:57:33.704861] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T21:57:34.079565] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-19T21:57:34.243337] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-19T21:57:35.043315] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-19T21:57:35.145713] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T21:57:35.727380] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-19T21:57:35.843254] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-19T21:57:36.301902] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-19T21:57:36.643234] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-19T21:57:36.755096] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-19T21:57:36.763199] [INFO ] [REMOTE ] VLO: Full fetch complete (76928 records). [2025-09-19T21:57:36.763348] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-19T21:57:37.187544] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-19T21:57:37.187704] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-19T21:57:37.189513] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-19T21:57:37.189602] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-19T21:57:37.191744] [DEBUG] [LOCAL ] VLO: Trimmed 76928 records to 53871 (keeping 200 days of data) [2025-09-19T21:57:37.443724] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-19T21:57:37.560420] [DEBUG] [LOCAL ] VLO: Primary data saved (53871 records). [2025-09-19T21:57:37.560572] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-19T21:57:37.563207] [INFO ] [MAIN ] Update Progress: 2237/2372 symbols completed. VLO took 37.7s. Estimated remaining: 17m 57s. Rate: 7.5 symbols/min [2025-09-19T21:57:38.243268] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-19T21:57:38.396904] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-19T21:57:39.043288] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-19T21:57:39.505605] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-19T21:57:39.535573] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-19T21:57:39.843263] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-19T21:57:40.483365] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T21:57:40.643242] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-19T21:57:41.236258] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T21:57:41.241596] [INFO ] [REMOTE ] VLRS: Full fetch complete (58906 records). [2025-09-19T21:57:41.241725] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-19T21:57:41.467056] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-19T21:57:41.628060] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-19T21:57:41.628140] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-19T21:57:41.629114] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-19T21:57:41.629177] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-19T21:57:41.630351] [DEBUG] [LOCAL ] VLRS: Trimmed 58906 records to 41690 (keeping 200 days of data) [2025-09-19T21:57:41.869484] [DEBUG] [LOCAL ] VLRS: Primary data saved (41690 records). [2025-09-19T21:57:41.869637] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-19T21:57:41.870041] [INFO ] [MAIN ] Update Progress: 2238/2372 symbols completed. VLRS took 36.5s. Estimated remaining: 17m 49s. Rate: 7.5 symbols/min [2025-09-19T21:57:42.612309] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T21:57:42.622338] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-19T21:57:42.745830] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T21:57:43.043298] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-19T21:57:43.943809] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T21:57:43.950871] [INFO ] [REMOTE ] VLTO: Full fetch complete (66720 records). [2025-09-19T21:57:43.950991] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-19T21:57:44.383338] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-19T21:57:44.383502] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-19T21:57:44.384796] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-19T21:57:44.384914] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-19T21:57:44.386431] [DEBUG] [LOCAL ] VLTO: Trimmed 66720 records to 46744 (keeping 200 days of data) [2025-09-19T21:57:44.508104] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T21:57:44.523031] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-19T21:57:44.722357] [DEBUG] [LOCAL ] VLTO: Primary data saved (46744 records). [2025-09-19T21:57:44.722547] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-19T21:57:44.722699] [INFO ] [MAIN ] Update Progress: 2239/2372 symbols completed. VLTO took 30.7s. Estimated remaining: 17m 41s. Rate: 7.5 symbols/min [2025-09-19T21:57:46.316376] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-19T21:57:46.325599] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-19T21:57:48.272101] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-19T21:57:48.281872] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-19T21:57:50.029464] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-19T21:57:50.040545] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-19T21:57:51.055026] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-19T21:57:51.060966] [INFO ] [REMOTE ] VMC: Full fetch complete (62591 records). [2025-09-19T21:57:51.061083] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-19T21:57:51.449098] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-19T21:57:51.449215] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-19T21:57:51.450265] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-19T21:57:51.450377] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-19T21:57:51.452234] [DEBUG] [LOCAL ] VMC: Trimmed 62591 records to 44671 (keeping 200 days of data) [2025-09-19T21:57:51.744113] [DEBUG] [LOCAL ] VMC: Primary data saved (44671 records). [2025-09-19T21:57:51.744272] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-19T21:57:51.744368] [INFO ] [MAIN ] Update Progress: 2240/2372 symbols completed. VMC took 22.6s. Estimated remaining: 17m 33s. Rate: 7.5 symbols/min [2025-09-19T21:57:52.455553] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:52.457299] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:52.460837] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:52.485292] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:57:52.505283] [DEBUG] [LOCAL ] VNCE: Loaded 6374 existing records from primary storage. [2025-09-19T21:57:52.505550] [INFO ] [MAIN ] VNCE: Loaded 6374 existing records. [2025-09-19T21:57:52.582205] [DEBUG] [LOCAL ] VMO: Loaded 21187 existing records from primary storage. [2025-09-19T21:57:52.614398] [INFO ] [MAIN ] VMO: Loaded 21187 existing records. [2025-09-19T21:57:52.631272] [DEBUG] [LOCAL ] VMI: Loaded 15650 existing records from primary storage. [2025-09-19T21:57:52.646821] [INFO ] [MAIN ] VMI: Loaded 15650 existing records. [2025-09-19T21:57:52.853066] [DEBUG] [LOCAL ] VNO: Loaded 49344 existing records from primary storage. [2025-09-19T21:57:52.925015] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:52.934129] [INFO ] [MAIN ] VNO: Loaded 49344 existing records. [2025-09-19T21:57:52.989142] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-19T21:57:53.027738] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-19T21:57:53.121811] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-19T21:57:53.195911] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-19T21:57:53.212612] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:53.204299] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:53.291793] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-19T21:57:53.291951] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-19T21:57:53.329136] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-19T21:57:53.348348] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-19T21:57:53.364542] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-19T21:57:53.459678] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-19T21:57:53.578320] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-19T21:57:53.610439] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-19T21:57:53.592413] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:57:53.668386] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-19T21:57:53.751795] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-19T21:57:53.904060] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-19T21:57:53.973728] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-19T21:57:54.436235] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:54.590550] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-19T21:57:54.688334] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:54.750965] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-19T21:57:54.776026] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:54.813181] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-19T21:57:54.908366] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:57:54.908777] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-19T21:57:56.006609] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-19T21:57:56.011026] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-19T21:57:56.081185] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T21:57:56.084289] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-19T21:57:56.150211] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T21:57:56.155634] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-19T21:57:56.779696] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T21:57:56.789600] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-19T21:57:56.901255] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-19T21:57:56.905912] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-19T21:57:57.510097] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T21:57:57.516799] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-19T21:57:57.577697] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T21:57:57.580758] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-19T21:57:58.066839] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-19T21:57:58.076679] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-19T21:57:58.111813] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T21:57:58.114638] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-19T21:57:58.206618] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T21:57:58.212229] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-19T21:57:58.754139] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T21:57:58.757599] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-19T21:57:58.762608] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-19T21:57:59.043295] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-19T21:57:59.251466] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T21:57:59.496312] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-19T21:57:59.843251] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-19T21:57:59.969526] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-19T21:57:59.981824] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-19T21:58:00.643246] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-19T21:58:01.443267] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-19T21:58:01.654491] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T21:58:01.693599] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-19T21:58:02.243264] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-19T21:58:02.983416] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T21:58:03.043246] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-19T21:58:03.843267] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-19T21:58:04.153123] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-19T21:58:04.457403] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-19T21:58:04.643287] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-19T21:58:04.806820] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-19T21:58:05.443227] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-19T21:58:05.924113] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T21:58:06.243266] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-19T21:58:06.931926] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-19T21:58:07.043289] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-19T21:58:07.300295] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-19T21:58:07.843260] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-19T21:58:08.261531] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-19T21:58:08.297203] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-19T21:58:08.643276] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-19T21:58:09.443273] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-19T21:58:09.791529] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T21:58:10.219505] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-19T21:58:10.243221] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-19T21:58:11.043234] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-19T21:58:11.539854] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T21:58:11.843296] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-19T21:58:12.643275] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-19T21:58:12.911003] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-19T21:58:13.017480] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-19T21:58:13.330639] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-19T21:58:13.443223] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-19T21:58:14.243276] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-19T21:58:14.732032] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T21:58:14.736621] [INFO ] [REMOTE ] VMO: Full fetch complete (31496 records). [2025-09-19T21:58:14.736745] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-19T21:58:15.050633] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-19T21:58:15.143694] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-19T21:58:15.143784] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-19T21:58:15.144539] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-19T21:58:15.144602] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-19T21:58:15.145363] [DEBUG] [LOCAL ] VMO: Trimmed 31496 records to 21300 (keeping 200 days of data) [2025-09-19T21:58:15.277806] [DEBUG] [LOCAL ] VMO: Primary data saved (21300 records). [2025-09-19T21:58:15.277941] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-19T21:58:15.278045] [INFO ] [MAIN ] Update Progress: 2241/2372 symbols completed. VMO took 23.5s. Estimated remaining: 17m 26s. Rate: 7.5 symbols/min [2025-09-19T21:58:15.461632] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T21:58:15.487577] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:58:15.488319] [INFO ] [REMOTE ] VMI: Full fetch complete (21180 records). [2025-09-19T21:58:15.489052] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-19T21:58:15.830918] [DEBUG] [LOCAL ] VNT: Loaded 44664 existing records from primary storage. [2025-09-19T21:58:15.836927] [INFO ] [MAIN ] VNT: Loaded 44664 existing records. [2025-09-19T21:58:15.868191] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-19T21:58:16.014054] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-19T21:58:16.052155] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-19T21:58:16.057403] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-19T21:58:16.063095] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-19T21:58:16.068300] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-19T21:58:16.105179] [DEBUG] [LOCAL ] VMI: Trimmed 21180 records to 15739 (keeping 200 days of data) [2025-09-19T21:58:16.128770] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:58:16.129136] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-19T21:58:16.129217] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-19T21:58:16.174887] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-19T21:58:16.183397] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-19T21:58:16.616159] [DEBUG] [LOCAL ] VMI: Primary data saved (15739 records). [2025-09-19T21:58:16.630066] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-19T21:58:16.629991] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:58:16.630461] [INFO ] [MAIN ] Update Progress: 2242/2372 symbols completed. VMI took 24.9s. Estimated remaining: 17m 17s. Rate: 7.5 symbols/min [2025-09-19T21:58:16.652739] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-19T21:58:16.846804] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:58:16.857049] [DEBUG] [LOCAL ] VOC: Loaded 9063 existing records from primary storage. [2025-09-19T21:58:16.857182] [INFO ] [MAIN ] VOC: Loaded 9063 existing records. [2025-09-19T21:58:17.035594] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:58:17.035898] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-19T21:58:17.035948] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-19T21:58:17.036332] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-19T21:58:17.036393] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-19T21:58:17.392849] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:58:17.443235] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-19T21:58:17.935566] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-19T21:58:18.243327] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-19T21:58:18.365287] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-19T21:58:18.839535] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-19T21:58:19.043265] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-19T21:58:19.724832] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-19T21:58:19.728349] [INFO ] [REMOTE ] VNCE: Full fetch complete (14566 records). [2025-09-19T21:58:19.728490] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-19T21:58:19.848454] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-19T21:58:20.099198] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-19T21:58:20.099287] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-19T21:58:20.099708] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-19T21:58:20.099772] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-19T21:58:20.100382] [DEBUG] [LOCAL ] VNCE: Trimmed 14566 records to 6697 (keeping 200 days of data) [2025-09-19T21:58:20.139857] [DEBUG] [LOCAL ] VNCE: Primary data saved (6697 records). [2025-09-19T21:58:20.140002] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-19T21:58:20.140098] [INFO ] [MAIN ] Update Progress: 2243/2372 symbols completed. VNCE took 28.4s. Estimated remaining: 17m 9s. Rate: 7.5 symbols/min [2025-09-19T21:58:20.329695] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:58:20.338699] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T21:58:20.386390] [DEBUG] [LOCAL ] VOYA: Loaded 43279 existing records from primary storage. [2025-09-19T21:58:20.386567] [INFO ] [MAIN ] VOYA: Loaded 43279 existing records. [2025-09-19T21:58:20.580996] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:58:20.581277] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-19T21:58:20.581338] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-19T21:58:20.582286] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-19T21:58:20.582350] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-19T21:58:20.648514] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-19T21:58:20.946155] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:58:21.443245] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-19T21:58:21.477725] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T21:58:22.243266] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-19T21:58:22.377862] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T21:58:23.043286] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-19T21:58:23.306808] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T21:58:23.379322] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T21:58:23.843277] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-19T21:58:24.371832] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T21:58:24.379564] [INFO ] [REMOTE ] VNO: Full fetch complete (70472 records). [2025-09-19T21:58:24.379739] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-19T21:58:24.650340] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-19T21:58:24.818662] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-19T21:58:24.819449] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-19T21:58:24.821011] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-19T21:58:24.819760] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-19T21:58:24.821195] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-19T21:58:24.825479] [DEBUG] [LOCAL ] VNO: Trimmed 70472 records to 49719 (keeping 200 days of data) [2025-09-19T21:58:25.125968] [DEBUG] [LOCAL ] VNO: Primary data saved (49719 records). [2025-09-19T21:58:25.126146] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-19T21:58:25.126269] [INFO ] [MAIN ] Update Progress: 2244/2372 symbols completed. VNO took 33.4s. Estimated remaining: 17m 1s. Rate: 7.5 symbols/min [2025-09-19T21:58:25.327369] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:58:25.327837] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-19T21:58:25.327901] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-19T21:58:25.328100] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-19T21:58:25.328152] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-19T21:58:25.328202] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-19T21:58:25.328240] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-19T21:58:25.448457] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-19T21:58:25.924147] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:58:26.243309] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-19T21:58:26.485989] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:58:26.486461] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-19T21:58:26.508196] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-19T21:58:26.645127] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-19T21:58:27.043333] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-19T21:58:27.843286] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-19T21:58:28.082210] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:58:28.082635] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-19T21:58:28.643307] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-19T21:58:28.953178] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T21:58:29.443315] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-19T21:58:30.243339] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-19T21:58:30.417017] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-19T21:58:30.759815] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-19T21:58:31.043293] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-19T21:58:31.231244] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-19T21:58:31.843269] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-19T21:58:32.643305] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-19T21:58:32.820393] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-19T21:58:33.217295] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T21:58:33.443264] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-19T21:58:33.800172] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T21:58:34.243276] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-19T21:58:34.897110] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-19T21:58:35.043269] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-19T21:58:35.843267] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-19T21:58:36.035777] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T21:58:36.085886] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:58:36.086204] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-19T21:58:36.191425] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-19T21:58:36.643335] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-19T21:58:37.443278] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-19T21:58:37.648717] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-19T21:58:37.680612] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:58:37.680975] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-19T21:58:38.243267] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-19T21:58:39.043368] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-19T21:58:39.352187] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:58:39.352531] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-19T21:58:39.843325] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-19T21:58:39.997893] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-19T21:58:40.643306] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-19T21:58:41.453621] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-19T21:58:41.456686] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T21:58:41.595559] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T21:58:42.243319] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-19T21:58:43.043260] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-19T21:58:43.184515] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-19T21:58:43.843260] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-19T21:58:43.879961] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T21:58:43.880339] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-19T21:58:44.100806] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T21:58:44.643258] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-19T21:58:45.127463] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-19T21:58:45.214084] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-19T21:58:45.215922] [INFO ] [REMOTE ] VOC: Full fetch complete (13222 records). [2025-09-19T21:58:45.216007] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-19T21:58:45.453502] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-19T21:58:45.617261] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-19T21:58:45.617364] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-19T21:58:45.617697] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-19T21:58:45.617757] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-19T21:58:45.618248] [DEBUG] [LOCAL ] VOC: Trimmed 13222 records to 9108 (keeping 200 days of data) [2025-09-19T21:58:45.672957] [DEBUG] [LOCAL ] VOC: Primary data saved (9108 records). [2025-09-19T21:58:45.673101] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-19T21:58:45.673216] [INFO ] [MAIN ] Update Progress: 2245/2372 symbols completed. VOC took 29.0s. Estimated remaining: 16m 54s. Rate: 7.5 symbols/min [2025-09-19T21:58:45.842819] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:58:45.861338] [DEBUG] [LOCAL ] VPG: Loaded 17345 existing records from primary storage. [2025-09-19T21:58:45.861476] [INFO ] [MAIN ] VPG: Loaded 17345 existing records. [2025-09-19T21:58:46.040474] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:58:46.040744] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-19T21:58:46.040802] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-19T21:58:46.041375] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-19T21:58:46.041438] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-19T21:58:46.253575] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-19T21:58:46.415004] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:58:47.043244] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-19T21:58:47.161207] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T21:58:47.409736] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T21:58:47.416402] [INFO ] [REMOTE ] VOYA: Full fetch complete (62109 records). [2025-09-19T21:58:47.416527] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-19T21:58:47.828424] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-19T21:58:47.828518] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-19T21:58:47.829549] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-19T21:58:47.829613] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-19T21:58:47.831047] [DEBUG] [LOCAL ] VOYA: Trimmed 62109 records to 43581 (keeping 200 days of data) [2025-09-19T21:58:47.886370] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-19T21:58:48.113281] [DEBUG] [LOCAL ] VOYA: Primary data saved (43581 records). [2025-09-19T21:58:48.113421] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-19T21:58:48.113506] [INFO ] [MAIN ] Update Progress: 2246/2372 symbols completed. VOYA took 28.0s. Estimated remaining: 16m 46s. Rate: 7.5 symbols/min [2025-09-19T21:58:48.298838] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:58:48.309513] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T21:58:48.319008] [DEBUG] [LOCAL ] VPV: Loaded 5405 existing records from primary storage. [2025-09-19T21:58:48.319122] [INFO ] [MAIN ] VPV: Loaded 5405 existing records. [2025-09-19T21:58:48.498278] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:58:48.498596] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-19T21:58:48.498678] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-19T21:58:48.499538] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-19T21:58:48.499626] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-19T21:58:48.653467] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-19T21:58:48.876536] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:58:49.431151] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-19T21:58:49.443952] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-19T21:58:49.446242] [INFO ] [REMOTE ] VNT: Full fetch complete (63552 records). [2025-09-19T21:58:49.447559] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-19T21:58:49.449107] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-19T21:58:49.856003] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-19T21:58:49.856109] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-19T21:58:49.857180] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-19T21:58:49.857245] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-19T21:58:49.858612] [DEBUG] [LOCAL ] VNT: Trimmed 63552 records to 44922 (keeping 200 days of data) [2025-09-19T21:58:50.144573] [DEBUG] [LOCAL ] VNT: Primary data saved (44922 records). [2025-09-19T21:58:50.144753] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-19T21:58:50.145741] [INFO ] [MAIN ] Update Progress: 2247/2372 symbols completed. VNT took 34.9s. Estimated remaining: 16m 37s. Rate: 7.5 symbols/min [2025-09-19T21:58:50.249379] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-19T21:58:50.325036] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:58:50.364256] [DEBUG] [LOCAL ] VRE: Loaded 35060 existing records from primary storage. [2025-09-19T21:58:50.364474] [INFO ] [MAIN ] VRE: Loaded 35060 existing records. [2025-09-19T21:58:50.549990] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:58:50.550288] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-19T21:58:50.550339] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-19T21:58:50.551368] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-19T21:58:50.551430] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-19T21:58:50.811106] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T21:58:50.936063] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:58:51.043249] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-19T21:58:51.390480] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-19T21:58:51.843283] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-19T21:58:52.166128] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-19T21:58:52.643282] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-19T21:58:53.443367] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-19T21:58:53.746871] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-19T21:58:53.882205] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T21:58:54.243261] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-19T21:58:54.865391] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-19T21:58:55.043319] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-19T21:58:55.596570] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-19T21:58:55.843258] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-19T21:58:56.473096] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-19T21:58:56.643281] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-19T21:58:57.105104] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T21:58:57.443316] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-19T21:58:57.796298] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-19T21:58:58.243296] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-19T21:58:59.043304] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-19T21:58:59.092676] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T21:58:59.843271] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-19T21:59:00.009324] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-19T21:59:00.031234] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T21:59:00.356546] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-19T21:59:00.643341] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-19T21:59:01.443271] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-19T21:59:01.554701] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-19T21:59:02.243286] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-19T21:59:02.992512] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-19T21:59:03.043231] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-19T21:59:03.315904] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T21:59:03.508936] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-19T21:59:03.843270] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-19T21:59:04.643258] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-19T21:59:05.024520] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T21:59:05.055822] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-19T21:59:05.443268] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-19T21:59:06.243267] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-19T21:59:07.043334] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-19T21:59:07.215948] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T21:59:07.222964] [INFO ] [REMOTE ] VOYG: Full fetch complete (22986 records). [2025-09-19T21:59:07.223172] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-19T21:59:07.238474] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-19T21:59:07.439412] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 70 unique days, need 200 days [2025-09-19T21:59:07.439896] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T21:59:07.439995] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T21:59:07.440094] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-19T21:59:07.440210] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-19T21:59:07.440287] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-19T21:59:07.440396] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-19T21:59:07.440508] [INFO ] [MAIN ] Update Progress: 2248/2372 symbols completed. VOYG took 42.3s. Estimated remaining: 16m 30s. Rate: 7.5 symbols/min [2025-09-19T21:59:07.628457] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:59:07.692095] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-09-19T21:59:07.692249] [INFO ] [MAIN ] VRT: Loaded 54143 existing records. [2025-09-19T21:59:07.849289] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-19T21:59:07.883436] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:59:07.889136] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T21:59:07.889462] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-19T21:59:07.891857] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-19T21:59:07.894141] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-19T21:59:07.894220] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-19T21:59:08.295376] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:59:08.442241] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T21:59:08.445382] [INFO ] [REMOTE ] VPG: Full fetch complete (23167 records). [2025-09-19T21:59:08.445493] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-19T21:59:08.648461] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-19T21:59:08.825719] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-19T21:59:08.825825] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-19T21:59:08.826398] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-19T21:59:08.826452] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-19T21:59:08.827384] [DEBUG] [LOCAL ] VPG: Trimmed 23167 records to 17438 (keeping 200 days of data) [2025-09-19T21:59:08.934634] [DEBUG] [LOCAL ] VPG: Primary data saved (17438 records). [2025-09-19T21:59:08.934819] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-19T21:59:08.934936] [INFO ] [MAIN ] Update Progress: 2249/2372 symbols completed. VPG took 23.3s. Estimated remaining: 16m 21s. Rate: 7.5 symbols/min [2025-09-19T21:59:09.121561] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:59:09.134692] [DEBUG] [LOCAL ] VRTS: Loaded 9119 existing records from primary storage. [2025-09-19T21:59:09.134841] [INFO ] [MAIN ] VRTS: Loaded 9119 existing records. [2025-09-19T21:59:09.311582] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:59:09.311874] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-19T21:59:09.311923] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-19T21:59:09.312344] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-19T21:59:09.312410] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-19T21:59:09.451588] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-19T21:59:09.678027] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:59:10.243267] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-19T21:59:10.319932] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T21:59:10.942849] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T21:59:11.043257] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-19T21:59:11.843360] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-19T21:59:11.850634] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-19T21:59:12.171515] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-19T21:59:12.322321] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-19T21:59:12.643241] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-19T21:59:13.443320] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-19T21:59:14.017130] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-19T21:59:14.018736] [INFO ] [REMOTE ] VPV: Full fetch complete (9400 records). [2025-09-19T21:59:14.018805] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-19T21:59:14.254412] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-19T21:59:14.381783] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-19T21:59:14.381863] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-19T21:59:14.382089] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-19T21:59:14.382127] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-19T21:59:14.382532] [DEBUG] [LOCAL ] VPV: Trimmed 9400 records to 5457 (keeping 200 days of data) [2025-09-19T21:59:14.418421] [DEBUG] [LOCAL ] VPV: Primary data saved (5457 records). [2025-09-19T21:59:14.418508] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-19T21:59:14.418632] [INFO ] [MAIN ] Update Progress: 2250/2372 symbols completed. VPV took 26.3s. Estimated remaining: 16m 13s. Rate: 7.5 symbols/min [2025-09-19T21:59:14.589790] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:59:14.651636] [DEBUG] [LOCAL ] VSCO: Loaded 53285 existing records from primary storage. [2025-09-19T21:59:14.651810] [INFO ] [MAIN ] VSCO: Loaded 53285 existing records. [2025-09-19T21:59:14.833283] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:59:14.833561] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-19T21:59:14.833610] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-19T21:59:14.834833] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-19T21:59:14.834895] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-19T21:59:15.051933] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-19T21:59:15.134703] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-19T21:59:15.204355] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:59:15.398244] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-09-19T21:59:15.843308] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-19T21:59:16.643337] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-19T21:59:17.066299] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T21:59:17.443263] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-19T21:59:18.243299] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-19T21:59:18.487082] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-19T21:59:18.558297] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-19T21:59:18.690474] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-19T21:59:19.043362] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-19T21:59:19.358201] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T21:59:19.843342] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-19T21:59:20.637042] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-19T21:59:20.643541] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-19T21:59:21.443318] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-19T21:59:21.461586] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-19T21:59:21.841451] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T21:59:22.243283] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-19T21:59:22.528253] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-19T21:59:22.537102] [INFO ] [REMOTE ] VRE: Full fetch complete (47764 records). [2025-09-19T21:59:22.537280] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-19T21:59:22.938443] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-19T21:59:22.938567] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-19T21:59:22.939566] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-19T21:59:22.939673] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-19T21:59:22.944393] [DEBUG] [LOCAL ] VRE: Trimmed 47764 records to 35333 (keeping 200 days of data) [2025-09-19T21:59:23.049123] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-19T21:59:23.175046] [DEBUG] [LOCAL ] VRE: Primary data saved (35333 records). [2025-09-19T21:59:23.175202] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-19T21:59:23.175408] [INFO ] [MAIN ] Update Progress: 2251/2372 symbols completed. VRE took 33.0s. Estimated remaining: 16m 5s. Rate: 7.5 symbols/min [2025-09-19T21:59:23.357354] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-19T21:59:23.360624] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:59:23.423851] [DEBUG] [LOCAL ] VSH: Loaded 49135 existing records from primary storage. [2025-09-19T21:59:23.424045] [INFO ] [MAIN ] VSH: Loaded 49135 existing records. [2025-09-19T21:59:23.641139] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:59:23.641500] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-19T21:59:23.641553] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-19T21:59:23.642730] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-19T21:59:23.642820] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-19T21:59:23.848430] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-19T21:59:24.064296] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:59:24.613951] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-19T21:59:24.643231] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-19T21:59:25.443293] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-19T21:59:25.978792] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-19T21:59:26.063495] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-09-19T21:59:26.243293] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-19T21:59:27.043287] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-19T21:59:27.118353] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T21:59:27.843373] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-19T21:59:28.285378] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T21:59:28.643322] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-19T21:59:29.088973] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-19T21:59:29.139961] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T21:59:29.204088] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-19T21:59:29.443273] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-19T21:59:30.243331] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-19T21:59:31.002169] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T21:59:31.003836] [INFO ] [REMOTE ] VRTS: Full fetch complete (11122 records). [2025-09-19T21:59:31.003907] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-19T21:59:31.048439] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-19T21:59:31.398453] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-19T21:59:31.398630] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-19T21:59:31.399113] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-19T21:59:31.399242] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-19T21:59:31.400550] [DEBUG] [LOCAL ] VRTS: Trimmed 11122 records to 9146 (keeping 200 days of data) [2025-09-19T21:59:31.504105] [DEBUG] [LOCAL ] VRTS: Primary data saved (9146 records). [2025-09-19T21:59:31.504955] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-19T21:59:31.508058] [INFO ] [MAIN ] Update Progress: 2252/2372 symbols completed. VRTS took 22.6s. Estimated remaining: 15m 57s. Rate: 7.5 symbols/min [2025-09-19T21:59:31.507791] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T21:59:31.690710] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:59:31.773526] [DEBUG] [LOCAL ] VST: Loaded 54110 existing records from primary storage. [2025-09-19T21:59:31.773728] [INFO ] [MAIN ] VST: Loaded 54110 existing records. [2025-09-19T21:59:31.851454] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-19T21:59:31.963868] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:59:31.964221] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-19T21:59:31.964311] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-19T21:59:31.965866] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-19T21:59:31.965928] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-19T21:59:32.326982] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:59:32.643304] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-19T21:59:32.925678] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T21:59:33.443335] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-19T21:59:34.249927] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-19T21:59:34.256199] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-19T21:59:34.759226] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T21:59:35.043267] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-19T21:59:35.393901] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-19T21:59:35.843265] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-19T21:59:36.310583] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-19T21:59:36.643286] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-19T21:59:37.443367] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-19T21:59:37.734396] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-19T21:59:37.776450] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T21:59:38.243244] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-19T21:59:38.349841] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T21:59:39.043311] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-19T21:59:39.843252] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-19T21:59:40.216284] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-09-19T21:59:40.474335] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T21:59:40.632705] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-19T21:59:40.644421] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-19T21:59:41.443327] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-19T21:59:41.717533] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-19T21:59:41.725913] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-09-19T21:59:41.726073] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-19T21:59:42.200143] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-19T21:59:42.200238] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-19T21:59:42.201397] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-19T21:59:42.201462] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-19T21:59:42.206124] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 54533 (keeping 200 days of data) [2025-09-19T21:59:42.277272] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-19T21:59:42.576114] [DEBUG] [LOCAL ] VRT: Primary data saved (54533 records). [2025-09-19T21:59:42.576618] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-19T21:59:42.576861] [INFO ] [MAIN ] Update Progress: 2253/2372 symbols completed. VRT took 35.1s. Estimated remaining: 15m 50s. Rate: 7.5 symbols/min [2025-09-19T21:59:42.751119] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:59:42.799772] [DEBUG] [LOCAL ] VSTS: Loaded 49379 existing records from primary storage. [2025-09-19T21:59:42.799945] [INFO ] [MAIN ] VSTS: Loaded 49379 existing records. [2025-09-19T21:59:42.985190] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:59:42.985498] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-19T21:59:42.985548] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-19T21:59:42.987021] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-19T21:59:42.987108] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-19T21:59:43.358254] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:59:43.358614] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-19T21:59:43.393750] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-19T21:59:43.575533] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T21:59:43.845215] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-19T21:59:43.848067] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T21:59:44.643265] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-19T21:59:45.358416] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T21:59:45.443242] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-19T21:59:46.034960] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-19T21:59:46.243261] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-19T21:59:46.858858] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T21:59:47.043306] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-19T21:59:47.208579] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-19T21:59:47.843263] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-19T21:59:48.235335] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T21:59:48.643255] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-19T21:59:48.933597] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T21:59:49.286530] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-19T21:59:49.443250] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-19T21:59:50.243306] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-19T21:59:51.043269] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-19T21:59:51.382830] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-19T21:59:51.451903] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T21:59:51.705995] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-19T21:59:51.843271] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-19T21:59:52.169448] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-19T21:59:52.176241] [INFO ] [REMOTE ] VSH: Full fetch complete (71412 records). [2025-09-19T21:59:52.176359] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-19T21:59:52.562392] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-19T21:59:52.562474] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-19T21:59:52.563569] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-19T21:59:52.563632] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-19T21:59:52.565083] [DEBUG] [LOCAL ] VSH: Trimmed 71412 records to 49479 (keeping 200 days of data) [2025-09-19T21:59:52.655869] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-19T21:59:52.871333] [DEBUG] [LOCAL ] VSH: Primary data saved (49479 records). [2025-09-19T21:59:52.871490] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-19T21:59:52.871986] [INFO ] [MAIN ] Update Progress: 2254/2372 symbols completed. VSH took 29.7s. Estimated remaining: 15m 42s. Rate: 7.5 symbols/min [2025-09-19T21:59:53.043715] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T21:59:53.087375] [DEBUG] [LOCAL ] VTEX: Loaded 43859 existing records from primary storage. [2025-09-19T21:59:53.087547] [INFO ] [MAIN ] VTEX: Loaded 43859 existing records. [2025-09-19T21:59:53.269592] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T21:59:53.269882] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-19T21:59:53.269931] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-19T21:59:53.270788] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-19T21:59:53.270852] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-19T21:59:53.453525] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-19T21:59:53.667568] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T21:59:54.243281] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-19T21:59:54.315097] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-19T21:59:54.663532] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-19T21:59:55.043318] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-19T21:59:55.643550] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T21:59:55.843266] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-19T21:59:55.891591] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T21:59:56.643254] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-19T21:59:57.410492] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-19T21:59:57.443213] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-19T21:59:57.538698] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T21:59:58.171132] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-19T21:59:58.243216] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-19T21:59:59.043314] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-19T21:59:59.843286] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-19T21:59:59.905706] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T22:00:00.059276] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-19T22:00:00.484211] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T22:00:00.492507] [INFO ] [REMOTE ] VSCO: Full fetch complete (76277 records). [2025-09-19T22:00:00.492706] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-19T22:00:00.652673] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-19T22:00:00.931910] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-19T22:00:00.932030] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-19T22:00:00.933216] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-19T22:00:00.933291] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-19T22:00:00.936160] [DEBUG] [LOCAL ] VSCO: Trimmed 76277 records to 53670 (keeping 200 days of data) [2025-09-19T22:00:01.279120] [DEBUG] [LOCAL ] VSCO: Primary data saved (53670 records). [2025-09-19T22:00:01.279311] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-19T22:00:01.279440] [INFO ] [MAIN ] Update Progress: 2255/2372 symbols completed. VSCO took 46.9s. Estimated remaining: 15m 34s. Rate: 7.5 symbols/min [2025-09-19T22:00:01.443589] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-19T22:00:01.475137] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:01.513818] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T22:00:01.580283] [DEBUG] [LOCAL ] VTLE: Loaded 49049 existing records from primary storage. [2025-09-19T22:00:01.580462] [INFO ] [MAIN ] VTLE: Loaded 49049 existing records. [2025-09-19T22:00:01.783337] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:01.783693] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-19T22:00:01.783785] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-19T22:00:01.785594] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-19T22:00:01.785696] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-19T22:00:02.218181] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:02.243275] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-19T22:00:02.947673] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T22:00:03.043294] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-19T22:00:03.843296] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-19T22:00:05.477921] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (3.23 seconds). [2025-09-19T22:00:05.488726] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-19T22:00:06.019408] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (4.58 seconds). [2025-09-19T22:00:06.032422] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-19T22:00:06.060384] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-19T22:00:06.243269] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-19T22:00:06.680414] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (3.64 seconds). [2025-09-19T22:00:06.791105] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-19T22:00:06.800050] [INFO ] [REMOTE ] VST: Full fetch complete (77806 records). [2025-09-19T22:00:06.800192] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-19T22:00:07.048942] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-19T22:00:07.216015] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-19T22:00:07.216106] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-19T22:00:07.217249] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-19T22:00:07.217312] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-19T22:00:07.218794] [DEBUG] [LOCAL ] VST: Trimmed 77806 records to 54500 (keeping 200 days of data) [2025-09-19T22:00:07.374315] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T22:00:07.534596] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T22:00:07.665812] [DEBUG] [LOCAL ] VST: Primary data saved (54500 records). [2025-09-19T22:00:07.665972] [INFO ] [MAIN ] VST: Full history saved. [2025-09-19T22:00:07.667047] [INFO ] [MAIN ] Update Progress: 2256/2372 symbols completed. VST took 36.2s. Estimated remaining: 15m 26s. Rate: 7.5 symbols/min [2025-09-19T22:00:07.834196] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:07.845849] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-19T22:00:07.854846] [DEBUG] [LOCAL ] VTMX: Loaded 17532 existing records from primary storage. [2025-09-19T22:00:07.854956] [INFO ] [MAIN ] VTMX: Loaded 17532 existing records. [2025-09-19T22:00:08.031682] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:08.031933] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-19T22:00:08.031982] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-19T22:00:08.032456] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-19T22:00:08.032515] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-19T22:00:08.393022] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:08.418169] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-19T22:00:08.643268] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-19T22:00:09.443316] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-19T22:00:09.786788] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T22:00:10.243273] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-19T22:00:10.413738] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-19T22:00:10.883695] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-19T22:00:11.043267] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-19T22:00:11.843293] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-19T22:00:11.961355] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-19T22:00:11.969226] [INFO ] [REMOTE ] VSTS: Full fetch complete (69918 records). [2025-09-19T22:00:11.969431] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-19T22:00:12.492290] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-19T22:00:12.492559] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-19T22:00:12.494372] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-19T22:00:12.494629] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-19T22:00:12.537537] [DEBUG] [LOCAL ] VSTS: Trimmed 69918 records to 49735 (keeping 200 days of data) [2025-09-19T22:00:12.537194] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-19T22:00:12.665948] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-19T22:00:12.967198] [DEBUG] [LOCAL ] VSTS: Primary data saved (49735 records). [2025-09-19T22:00:12.967376] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-19T22:00:12.967491] [INFO ] [MAIN ] Update Progress: 2257/2372 symbols completed. VSTS took 30.4s. Estimated remaining: 15m 18s. Rate: 7.5 symbols/min [2025-09-19T22:00:13.236432] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:13.266585] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T22:00:13.278908] [DEBUG] [LOCAL ] VTN: Loaded 7219 existing records from primary storage. [2025-09-19T22:00:13.279551] [INFO ] [MAIN ] VTN: Loaded 7219 existing records. [2025-09-19T22:00:13.450978] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-19T22:00:13.476420] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:13.476738] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-19T22:00:13.476811] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-19T22:00:13.477362] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-19T22:00:13.477436] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-19T22:00:13.832744] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:13.875805] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-19T22:00:14.243339] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-19T22:00:15.043307] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-19T22:00:15.843271] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-19T22:00:16.352697] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-09-19T22:00:16.469913] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-19T22:00:16.643259] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-19T22:00:17.187029] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T22:00:17.443325] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-19T22:00:17.632955] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-19T22:00:17.778869] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-19T22:00:18.119996] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-19T22:00:18.243286] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-19T22:00:18.949845] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-19T22:00:19.043268] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-19T22:00:19.843220] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-19T22:00:20.402568] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T22:00:20.643280] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-19T22:00:21.443251] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-19T22:00:21.779423] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T22:00:21.786332] [INFO ] [REMOTE ] VTEX: Full fetch complete (60716 records). [2025-09-19T22:00:21.786495] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-19T22:00:22.222835] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-19T22:00:22.223064] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-19T22:00:22.224108] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-19T22:00:22.224269] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-19T22:00:22.225600] [DEBUG] [LOCAL ] VTEX: Trimmed 60716 records to 44131 (keeping 200 days of data) [2025-09-19T22:00:22.282229] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-19T22:00:22.345545] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-19T22:00:22.512361] [DEBUG] [LOCAL ] VTEX: Primary data saved (44131 records). [2025-09-19T22:00:22.512489] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-19T22:00:22.512886] [INFO ] [MAIN ] Update Progress: 2258/2372 symbols completed. VTEX took 29.6s. Estimated remaining: 15m 10s. Rate: 7.5 symbols/min [2025-09-19T22:00:22.681838] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:22.704556] [DEBUG] [LOCAL ] VTOL: Loaded 20021 existing records from primary storage. [2025-09-19T22:00:22.704732] [INFO ] [MAIN ] VTOL: Loaded 20021 existing records. [2025-09-19T22:00:22.893477] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:22.905295] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-19T22:00:22.905939] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-19T22:00:22.906335] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T22:00:22.910660] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-19T22:00:22.911045] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-19T22:00:23.051727] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-19T22:00:23.271700] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:23.288601] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-19T22:00:23.843286] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-19T22:00:24.428036] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-19T22:00:24.643254] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-19T22:00:25.443324] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-19T22:00:25.676079] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-19T22:00:25.850846] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-19T22:00:26.243260] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-19T22:00:26.673601] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T22:00:27.043291] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-19T22:00:27.195528] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T22:00:27.843286] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-19T22:00:28.051904] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T22:00:28.643271] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-19T22:00:28.774816] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T22:00:28.777543] [INFO ] [REMOTE ] VTMX: Full fetch complete (26066 records). [2025-09-19T22:00:28.777637] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-19T22:00:29.167025] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-19T22:00:29.167109] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-19T22:00:29.167688] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-19T22:00:29.167764] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-19T22:00:29.168603] [DEBUG] [LOCAL ] VTMX: Trimmed 26066 records to 17636 (keeping 200 days of data) [2025-09-19T22:00:29.277386] [DEBUG] [LOCAL ] VTMX: Primary data saved (17636 records). [2025-09-19T22:00:29.277554] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-19T22:00:29.277693] [INFO ] [MAIN ] Update Progress: 2259/2372 symbols completed. VTMX took 21.6s. Estimated remaining: 15m 2s. Rate: 7.5 symbols/min [2025-09-19T22:00:29.455266] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:29.451167] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-19T22:00:29.517636] [DEBUG] [LOCAL ] VTR: Loaded 53219 existing records from primary storage. [2025-09-19T22:00:29.517849] [INFO ] [MAIN ] VTR: Loaded 53219 existing records. [2025-09-19T22:00:29.674329] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-19T22:00:29.719612] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:29.719899] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-19T22:00:29.719950] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-19T22:00:29.721287] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-19T22:00:29.721351] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-19T22:00:30.083634] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:30.243318] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-19T22:00:30.549823] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-19T22:00:31.043295] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-19T22:00:31.839211] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T22:00:31.839467] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-19T22:00:31.849781] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-19T22:00:32.643257] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-19T22:00:33.085589] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-19T22:00:33.443274] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-19T22:00:34.243270] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-19T22:00:34.543014] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-19T22:00:34.997766] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-19T22:00:35.043270] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-19T22:00:35.448711] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-19T22:00:35.807428] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T22:00:35.843210] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-19T22:00:35.982330] [DEBUG] [REMOTE ] VTR: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-19T22:00:35.982587] [WARN ] [REMOTE ] VTR: No data returned for month 2025-02 [2025-09-19T22:00:36.643305] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-19T22:00:37.443271] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-19T22:00:38.255198] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-19T22:00:38.261114] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T22:00:38.967349] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-19T22:00:38.991525] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T22:00:39.043223] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-19T22:00:39.843263] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-19T22:00:40.559491] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T22:00:40.643229] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-19T22:00:40.863917] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-19T22:00:41.443282] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-19T22:00:41.801599] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T22:00:41.808721] [INFO ] [REMOTE ] VTLE: Full fetch complete (68664 records). [2025-09-19T22:00:41.808860] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-19T22:00:42.201969] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-19T22:00:42.202061] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-19T22:00:42.203262] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-19T22:00:42.203329] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-19T22:00:42.204883] [DEBUG] [LOCAL ] VTLE: Trimmed 68664 records to 49395 (keeping 200 days of data) [2025-09-19T22:00:42.256668] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-19T22:00:42.427266] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-19T22:00:42.531573] [DEBUG] [LOCAL ] VTLE: Primary data saved (49395 records). [2025-09-19T22:00:42.531756] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-19T22:00:42.531866] [INFO ] [MAIN ] Update Progress: 2260/2372 symbols completed. VTLE took 41.3s. Estimated remaining: 14m 54s. Rate: 7.5 symbols/min [2025-09-19T22:00:42.704232] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:42.738344] [DEBUG] [LOCAL ] VTS: Loaded 30584 existing records from primary storage. [2025-09-19T22:00:42.738503] [INFO ] [MAIN ] VTS: Loaded 30584 existing records. [2025-09-19T22:00:42.930365] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:42.930673] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-19T22:00:42.930736] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-19T22:00:42.931486] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-19T22:00:42.931549] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-19T22:00:43.045218] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-19T22:00:43.319258] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:43.624521] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T22:00:43.635504] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-19T22:00:43.637520] [INFO ] [REMOTE ] VTN: Full fetch complete (11484 records). [2025-09-19T22:00:43.637596] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-19T22:00:43.848428] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-19T22:00:44.030061] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-19T22:00:44.030180] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-19T22:00:44.030531] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-19T22:00:44.030582] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-19T22:00:44.031172] [DEBUG] [LOCAL ] VTN: Trimmed 11484 records to 7254 (keeping 200 days of data) [2025-09-19T22:00:44.079726] [DEBUG] [LOCAL ] VTN: Primary data saved (7254 records). [2025-09-19T22:00:44.079866] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-19T22:00:44.079951] [INFO ] [MAIN ] Update Progress: 2261/2372 symbols completed. VTN took 31.1s. Estimated remaining: 14m 46s. Rate: 7.5 symbols/min [2025-09-19T22:00:44.253424] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:44.283496] [DEBUG] [LOCAL ] VVR: Loaded 30479 existing records from primary storage. [2025-09-19T22:00:44.283639] [INFO ] [MAIN ] VVR: Loaded 30479 existing records. [2025-09-19T22:00:44.473788] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:44.474324] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-19T22:00:44.474383] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-19T22:00:44.475391] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-19T22:00:44.475483] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-19T22:00:44.643625] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-19T22:00:44.885328] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:45.422712] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-19T22:00:45.443220] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-19T22:00:46.017620] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T22:00:46.243283] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-19T22:00:47.043278] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-19T22:00:47.300391] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T22:00:47.365802] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T22:00:47.843279] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-19T22:00:48.569282] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-19T22:00:48.643255] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-19T22:00:49.443270] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-19T22:00:49.731574] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-19T22:00:50.243305] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-19T22:00:50.319772] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-19T22:00:50.668061] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T22:00:51.043318] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-19T22:00:51.843254] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-19T22:00:52.345553] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T22:00:52.512753] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-19T22:00:52.643252] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-19T22:00:52.797813] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T22:00:53.443271] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-19T22:00:54.243280] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-19T22:00:54.534852] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-19T22:00:54.623887] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T22:00:54.884879] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-19T22:00:54.888011] [INFO ] [REMOTE ] VTOL: Full fetch complete (26151 records). [2025-09-19T22:00:54.888119] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-19T22:00:55.048389] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-19T22:00:55.287289] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-19T22:00:55.287382] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-19T22:00:55.288004] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-19T22:00:55.288084] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-19T22:00:55.288929] [DEBUG] [LOCAL ] VTOL: Trimmed 26151 records to 20110 (keeping 200 days of data) [2025-09-19T22:00:55.418499] [DEBUG] [LOCAL ] VTOL: Primary data saved (20110 records). [2025-09-19T22:00:55.418664] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-19T22:00:55.418788] [INFO ] [MAIN ] Update Progress: 2262/2372 symbols completed. VTOL took 32.9s. Estimated remaining: 14m 38s. Rate: 7.5 symbols/min [2025-09-19T22:00:55.601345] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:55.656351] [DEBUG] [LOCAL ] VVV: Loaded 50526 existing records from primary storage. [2025-09-19T22:00:55.656521] [INFO ] [MAIN ] VVV: Loaded 50526 existing records. [2025-09-19T22:00:55.833299] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:55.833587] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-19T22:00:55.833676] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-19T22:00:55.834851] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-19T22:00:55.834923] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-19T22:00:55.848405] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-19T22:00:56.236986] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:56.239272] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-19T22:00:56.248080] [INFO ] [REMOTE ] VTR: Full fetch complete (69046 records). [2025-09-19T22:00:56.248249] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-19T22:00:56.470857] [WARN ] [VALIDATOR ] VTR: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-19T22:00:56.471680] [FATAL] [MAIN ] VTR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T22:00:56.471772] [WARN ] [MAIN ] VTR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T22:00:56.471851] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-19T22:00:56.471961] [DEBUG] [LOCAL ] VTR: No primary data file found to delete. [2025-09-19T22:00:56.472065] [INFO ] [LOCAL ] VTR: Starting deletion of derivative data. [2025-09-19T22:00:56.472540] [DEBUG] [LOCAL ] VTR: Deleted derivative data file. [2025-09-19T22:00:56.474292] [INFO ] [MAIN ] Update Progress: 2263/2372 symbols completed. VTR took 27.2s. Estimated remaining: 14m 30s. Rate: 7.5 symbols/min [2025-09-19T22:00:56.658708] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:00:56.654675] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-19T22:00:56.675833] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-19T22:00:56.700242] [DEBUG] [LOCAL ] VVX: Loaded 23575 existing records from primary storage. [2025-09-19T22:00:56.700403] [INFO ] [MAIN ] VVX: Loaded 23575 existing records. [2025-09-19T22:00:56.889057] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:00:56.889313] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-19T22:00:56.889364] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-19T22:00:56.890098] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-19T22:00:56.890162] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-19T22:00:57.268938] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:00:57.443263] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-19T22:00:58.243270] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-19T22:00:58.663509] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-19T22:00:58.793230] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T22:00:59.043254] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-19T22:00:59.780003] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-19T22:00:59.843255] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-19T22:01:00.368410] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-19T22:01:00.643263] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-19T22:01:00.821138] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-19T22:01:01.443254] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-19T22:01:01.983481] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-19T22:01:02.243316] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-19T22:01:03.043328] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-19T22:01:03.314634] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T22:01:03.421288] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T22:01:03.843242] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-19T22:01:04.361491] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-19T22:01:04.643246] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-19T22:01:05.443292] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-19T22:01:05.700684] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T22:01:05.872370] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-19T22:01:06.243297] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-19T22:01:06.663591] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T22:01:07.043262] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-19T22:01:07.843248] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-19T22:01:08.256810] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T22:01:08.394595] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T22:01:08.643254] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-19T22:01:09.006111] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-19T22:01:09.443274] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-19T22:01:10.218755] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T22:01:10.243231] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-19T22:01:11.043277] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-19T22:01:11.079030] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T22:01:11.804955] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-19T22:01:11.843232] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-19T22:01:12.563594] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T22:01:12.643261] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-19T22:01:12.925884] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T22:01:13.443283] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-19T22:01:13.876190] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-19T22:01:14.243277] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-19T22:01:15.023957] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-19T22:01:15.043258] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-19T22:01:15.843272] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-19T22:01:16.234596] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-19T22:01:16.264596] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T22:01:16.643265] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-19T22:01:17.443313] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-19T22:01:17.468394] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T22:01:17.474350] [INFO ] [REMOTE ] VVR: Full fetch complete (45656 records). [2025-09-19T22:01:17.474512] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-19T22:01:17.877205] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-19T22:01:17.877314] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-19T22:01:17.878366] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-19T22:01:17.878446] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-19T22:01:17.879614] [DEBUG] [LOCAL ] VVR: Trimmed 45656 records to 30653 (keeping 200 days of data) [2025-09-19T22:01:18.086861] [DEBUG] [LOCAL ] VVR: Primary data saved (30653 records). [2025-09-19T22:01:18.087065] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-19T22:01:18.087301] [INFO ] [MAIN ] Update Progress: 2264/2372 symbols completed. VVR took 34.0s. Estimated remaining: 14m 22s. Rate: 7.5 symbols/min [2025-09-19T22:01:18.243903] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-19T22:01:18.279410] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:01:18.334180] [DEBUG] [LOCAL ] VYX: Loaded 49577 existing records from primary storage. [2025-09-19T22:01:18.334378] [INFO ] [MAIN ] VYX: Loaded 49577 existing records. [2025-09-19T22:01:18.527150] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:01:18.527745] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-19T22:01:18.527830] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-19T22:01:18.529057] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-19T22:01:18.529124] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-19T22:01:18.821923] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-19T22:01:18.987352] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:01:19.008402] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-19T22:01:19.043213] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-19T22:01:19.716172] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T22:01:19.722853] [INFO ] [REMOTE ] VTS: Full fetch complete (40560 records). [2025-09-19T22:01:19.723043] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-19T22:01:19.848405] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-19T22:01:20.148570] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-19T22:01:20.148730] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-19T22:01:20.150036] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-19T22:01:20.150146] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-19T22:01:20.154486] [DEBUG] [LOCAL ] VTS: Trimmed 40560 records to 30856 (keeping 200 days of data) [2025-09-19T22:01:20.368456] [DEBUG] [LOCAL ] VTS: Primary data saved (30856 records). [2025-09-19T22:01:20.368687] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-19T22:01:20.368941] [INFO ] [MAIN ] Update Progress: 2265/2372 symbols completed. VTS took 37.8s. Estimated remaining: 14m 14s. Rate: 7.5 symbols/min [2025-09-19T22:01:20.513121] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-19T22:01:20.573721] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:01:20.574565] [INFO ] [REMOTE ] VVX: Full fetch complete (33412 records). [2025-09-19T22:01:20.574677] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-19T22:01:20.648012] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-19T22:01:21.000383] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-09-19T22:01:21.007577] [INFO ] [MAIN ] VZ: Loaded 54181 existing records. [2025-09-19T22:01:21.065834] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-19T22:01:21.080399] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-19T22:01:21.091728] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-19T22:01:21.099156] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-19T22:01:21.156092] [DEBUG] [LOCAL ] VVX: Trimmed 33412 records to 23754 (keeping 200 days of data) [2025-09-19T22:01:21.279867] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:01:21.280171] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-19T22:01:21.280230] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-19T22:01:21.290597] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-19T22:01:21.291073] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-19T22:01:21.690905] [DEBUG] [LOCAL ] VVX: Primary data saved (23754 records). [2025-09-19T22:01:21.701481] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-19T22:01:21.701843] [INFO ] [MAIN ] Update Progress: 2266/2372 symbols completed. VVX took 25.2s. Estimated remaining: 14m 6s. Rate: 7.5 symbols/min [2025-09-19T22:01:21.790546] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:01:21.819515] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-19T22:01:21.956234] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:01:21.991953] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-19T22:01:22.035522] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T22:01:22.091226] [DEBUG] [LOCAL ] W: Loaded 53901 existing records from primary storage. [2025-09-19T22:01:22.091384] [INFO ] [MAIN ] W: Loaded 53901 existing records. [2025-09-19T22:01:22.246977] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-19T22:01:22.269327] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:01:22.269584] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-19T22:01:22.269633] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-19T22:01:22.270742] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-19T22:01:22.270801] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-19T22:01:22.642382] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:01:23.043324] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-19T22:01:23.843316] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-19T22:01:24.030248] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T22:01:24.641712] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-19T22:01:24.652190] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-19T22:01:24.689444] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-19T22:01:25.443322] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-19T22:01:25.805978] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T22:01:25.950524] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T22:01:26.243305] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-19T22:01:27.043309] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-19T22:01:27.843325] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-19T22:01:28.015767] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-19T22:01:28.235953] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-19T22:01:28.643251] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-19T22:01:28.951333] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T22:01:29.443326] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-19T22:01:29.876937] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T22:01:30.243315] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-19T22:01:30.489439] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-19T22:01:30.582235] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T22:01:30.591238] [INFO ] [REMOTE ] VVV: Full fetch complete (72249 records). [2025-09-19T22:01:30.591389] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-19T22:01:30.986268] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-19T22:01:30.986349] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-19T22:01:30.987471] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-19T22:01:30.987536] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-19T22:01:30.989104] [DEBUG] [LOCAL ] VVV: Trimmed 72249 records to 50881 (keeping 200 days of data) [2025-09-19T22:01:31.058097] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-19T22:01:31.311323] [DEBUG] [LOCAL ] VVV: Primary data saved (50881 records). [2025-09-19T22:01:31.311475] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-19T22:01:31.312398] [INFO ] [MAIN ] Update Progress: 2267/2372 symbols completed. VVV took 35.9s. Estimated remaining: 13m 58s. Rate: 7.5 symbols/min [2025-09-19T22:01:31.481239] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:01:31.532331] [DEBUG] [LOCAL ] WAB: Loaded 44728 existing records from primary storage. [2025-09-19T22:01:31.532477] [INFO ] [MAIN ] WAB: Loaded 44728 existing records. [2025-09-19T22:01:31.711215] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:01:31.711508] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-19T22:01:31.711557] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-19T22:01:31.712784] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-19T22:01:31.712848] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-19T22:01:31.848584] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-19T22:01:32.086741] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:01:32.289223] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-19T22:01:32.643247] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-19T22:01:32.971949] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-19T22:01:33.451208] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-19T22:01:33.475895] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-19T22:01:34.243323] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-19T22:01:34.657913] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T22:01:35.043302] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-19T22:01:35.631013] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-19T22:01:35.843287] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-19T22:01:36.507813] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-19T22:01:36.643282] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-19T22:01:37.443336] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-19T22:01:37.858159] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-19T22:01:37.940034] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T22:01:38.243316] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-19T22:01:39.043325] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-19T22:01:39.227344] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-19T22:01:39.479849] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-19T22:01:39.843276] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-19T22:01:40.643284] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-19T22:01:40.843187] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-19T22:01:40.879280] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T22:01:41.443231] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-19T22:01:41.582321] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-19T22:01:42.100143] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T22:01:42.243278] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-19T22:01:43.043327] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-19T22:01:43.455708] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T22:01:43.662422] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-19T22:01:43.843265] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-19T22:01:44.643255] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-19T22:01:45.275469] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T22:01:45.443228] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-19T22:01:46.091211] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-19T22:01:46.243225] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-19T22:01:46.526196] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-19T22:01:47.043320] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-19T22:01:47.599206] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T22:01:47.698768] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T22:01:47.843272] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-19T22:01:48.208351] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T22:01:48.215761] [INFO ] [REMOTE ] VYX: Full fetch complete (70290 records). [2025-09-19T22:01:48.215915] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-19T22:01:48.612417] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-19T22:01:48.612508] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-19T22:01:48.613587] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-19T22:01:48.613674] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-19T22:01:48.615121] [DEBUG] [LOCAL ] VYX: Trimmed 70290 records to 49925 (keeping 200 days of data) [2025-09-19T22:01:48.678835] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-19T22:01:48.930119] [DEBUG] [LOCAL ] VYX: Primary data saved (49925 records). [2025-09-19T22:01:48.930273] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-19T22:01:48.930380] [INFO ] [MAIN ] Update Progress: 2268/2372 symbols completed. VYX took 30.8s. Estimated remaining: 13m 50s. Rate: 7.5 symbols/min [2025-09-19T22:01:49.099466] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:01:49.145308] [DEBUG] [LOCAL ] WAL: Loaded 45891 existing records from primary storage. [2025-09-19T22:01:49.145474] [INFO ] [MAIN ] WAL: Loaded 45891 existing records. [2025-09-19T22:01:49.373714] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:01:49.374184] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-19T22:01:49.374251] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-19T22:01:49.375554] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-19T22:01:49.375615] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-19T22:01:49.445838] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-19T22:01:49.579751] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T22:01:49.788934] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:01:50.243269] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-19T22:01:51.043405] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-19T22:01:51.316804] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-19T22:01:51.732042] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-09-19T22:01:51.843256] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-19T22:01:52.291510] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-19T22:01:52.337210] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T22:01:52.643266] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-19T22:01:53.443284] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-19T22:01:53.851876] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T22:01:54.243277] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-19T22:01:54.451532] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-19T22:01:55.043285] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-19T22:01:55.286069] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T22:01:55.843270] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-19T22:01:55.975454] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T22:01:55.985387] [INFO ] [REMOTE ] WAB: Full fetch complete (64446 records). [2025-09-19T22:01:55.985572] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-19T22:01:56.399730] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-19T22:01:56.406589] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-19T22:01:56.419592] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-19T22:01:56.420999] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-19T22:01:56.420294] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-19T22:01:56.429335] [INFO ] [REMOTE ] W: Full fetch complete (77441 records). [2025-09-19T22:01:56.429605] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-19T22:01:56.429521] [DEBUG] [LOCAL ] WAB: Trimmed 64446 records to 45019 (keeping 200 days of data) [2025-09-19T22:01:56.646786] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-19T22:01:56.965106] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-19T22:01:56.966283] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-19T22:01:56.967785] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-19T22:01:56.968918] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-19T22:01:56.975560] [DEBUG] [LOCAL ] W: Trimmed 77441 records to 54290 (keeping 200 days of data) [2025-09-19T22:01:57.392948] [DEBUG] [LOCAL ] WAB: Primary data saved (45019 records). [2025-09-19T22:01:57.394977] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-19T22:01:57.395565] [INFO ] [MAIN ] Update Progress: 2269/2372 symbols completed. WAB took 26.1s. Estimated remaining: 13m 42s. Rate: 7.5 symbols/min [2025-09-19T22:01:57.590587] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:01:57.702179] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-19T22:01:57.725075] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-09-19T22:01:57.727517] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-19T22:01:57.811303] [DEBUG] [LOCAL ] W: Primary data saved (54290 records). [2025-09-19T22:01:57.848411] [INFO ] [MAIN ] W: Full history saved. [2025-09-19T22:01:57.831811] [DEBUG] [LOCAL ] WAT: Loaded 35393 existing records from primary storage. [2025-09-19T22:01:57.876710] [INFO ] [MAIN ] WAT: Loaded 35393 existing records. [2025-09-19T22:01:57.878240] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T22:01:57.873133] [INFO ] [MAIN ] Update Progress: 2270/2372 symbols completed. W took 36.2s. Estimated remaining: 13m 34s. Rate: 7.5 symbols/min [2025-09-19T22:01:58.012258] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-19T22:01:58.418239] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:01:58.408981] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:01:58.461409] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-19T22:01:58.461491] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-19T22:01:58.481489] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-19T22:01:58.481375] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-19T22:01:58.485345] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-19T22:01:58.485769] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-19T22:01:58.506883] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-19T22:01:58.501604] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-19T22:01:58.512271] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-19T22:01:58.512183] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-19T22:01:58.740026] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-19T22:01:58.771161] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-19T22:01:58.789755] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-19T22:01:58.789869] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-19T22:01:58.924686] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 54571 (keeping 200 days of data) [2025-09-19T22:01:59.435712] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:01:59.446941] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-19T22:01:59.526261] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:01:59.527439] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-19T22:01:59.749162] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:01:59.752705] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-19T22:01:59.761215] [DEBUG] [LOCAL ] VZ: Primary data saved (54571 records). [2025-09-19T22:01:59.761375] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-19T22:01:59.761481] [INFO ] [MAIN ] Update Progress: 2271/2372 symbols completed. VZ took 39.4s. Estimated remaining: 13m 26s. Rate: 7.5 symbols/min [2025-09-19T22:01:59.850319] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-09-19T22:01:59.931607] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:01:59.976798] [DEBUG] [LOCAL ] WBS: Loaded 49249 existing records from primary storage. [2025-09-19T22:01:59.976988] [INFO ] [MAIN ] WBS: Loaded 49249 existing records. [2025-09-19T22:02:00.128907] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:02:00.137990] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-09-19T22:02:00.161223] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:02:00.161604] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-19T22:02:00.161729] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-19T22:02:00.163141] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-19T22:02:00.163206] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-19T22:02:00.482126] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-19T22:02:00.575345] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:02:00.643217] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-19T22:02:01.110814] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-19T22:02:01.443280] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-19T22:02:02.243282] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-19T22:02:02.566232] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T22:02:03.043293] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-02. [2025-09-19T22:02:03.339162] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:02:03.339492] [WARN ] [REMOTE ] WBI: No data returned for month 2025-02 [2025-09-19T22:02:03.363984] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-19T22:02:03.401250] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-19T22:02:03.843262] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-19T22:02:04.643262] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-19T22:02:05.443243] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-03. [2025-09-19T22:02:05.539944] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T22:02:05.680595] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:02:05.680948] [WARN ] [REMOTE ] WBI: No data returned for month 2025-03 [2025-09-19T22:02:06.243263] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-04. [2025-09-19T22:02:06.452091] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-19T22:02:06.478891] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:02:06.479187] [WARN ] [REMOTE ] WBI: No data returned for month 2025-04 [2025-09-19T22:02:07.043271] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-19T22:02:07.843259] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-19T22:02:08.643262] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-19T22:02:08.916966] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-19T22:02:09.443268] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-05. [2025-09-19T22:02:09.469526] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-19T22:02:09.706829] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:02:09.707167] [WARN ] [REMOTE ] WBI: No data returned for month 2025-05 [2025-09-19T22:02:09.782349] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-19T22:02:10.243298] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-19T22:02:11.043288] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-06. [2025-09-19T22:02:11.525785] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:02:11.526181] [WARN ] [REMOTE ] WBI: No data returned for month 2025-06 [2025-09-19T22:02:11.843264] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-19T22:02:11.994548] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-19T22:02:12.643287] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-19T22:02:13.443273] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-07. [2025-09-19T22:02:13.634215] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T22:02:13.673868] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:02:13.674187] [WARN ] [REMOTE ] WBI: No data returned for month 2025-07 [2025-09-19T22:02:14.243295] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-08. [2025-09-19T22:02:14.309143] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-19T22:02:14.480252] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:02:14.480596] [WARN ] [REMOTE ] WBI: No data returned for month 2025-08 [2025-09-19T22:02:15.043279] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-09. [2025-09-19T22:02:15.711638] [INFO ] [REMOTE ] WBI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-19T22:02:15.713426] [INFO ] [REMOTE ] WBI: Full fetch complete (944 records). [2025-09-19T22:02:15.713496] [DEBUG] [VALIDATOR ] WBI: Validating primary data. [2025-09-19T22:02:15.858116] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-19T22:02:15.901825] [WARN ] [VALIDATOR ] WBI: Validation failed - insufficient historical data. Have 3 unique days, need 200 days [2025-09-19T22:02:15.902037] [FATAL] [MAIN ] WBI: Fetched primary data is invalid. Refusing to save it. [2025-09-19T22:02:15.902109] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to validation failure. [2025-09-19T22:02:15.902181] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-19T22:02:15.902249] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-19T22:02:15.902285] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-19T22:02:15.902325] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-19T22:02:15.902386] [INFO ] [MAIN ] Update Progress: 2272/2372 symbols completed. WBI took 18.0s. Estimated remaining: 13m 18s. Rate: 7.5 symbols/min [2025-09-19T22:02:16.080878] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:02:16.098766] [DEBUG] [LOCAL ] WBX: Loaded 13459 existing records from primary storage. [2025-09-19T22:02:16.098957] [INFO ] [MAIN ] WBX: Loaded 13459 existing records. [2025-09-19T22:02:16.278178] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:02:16.278474] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-19T22:02:16.278540] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-19T22:02:16.278988] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-19T22:02:16.279048] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-19T22:02:16.631515] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:02:16.643209] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-19T22:02:17.443312] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-19T22:02:17.526597] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-19T22:02:18.243325] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-19T22:02:18.586167] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T22:02:18.752091] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-19T22:02:19.043334] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-19T22:02:19.823482] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-19T22:02:19.843243] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-19T22:02:20.436436] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-19T22:02:20.643270] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-19T22:02:21.210011] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T22:02:21.443326] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-19T22:02:22.243353] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-19T22:02:22.642516] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-19T22:02:22.886635] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T22:02:22.894494] [INFO ] [REMOTE ] WAL: Full fetch complete (66316 records). [2025-09-19T22:02:22.894632] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-19T22:02:23.050275] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-19T22:02:23.331596] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-19T22:02:23.331815] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-19T22:02:23.333576] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-19T22:02:23.333798] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-19T22:02:23.358616] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-19T22:02:23.366300] [DEBUG] [LOCAL ] WAL: Trimmed 66316 records to 46225 (keeping 200 days of data) [2025-09-19T22:02:23.652154] [DEBUG] [LOCAL ] WAL: Primary data saved (46225 records). [2025-09-19T22:02:23.652290] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-19T22:02:23.652391] [INFO ] [MAIN ] Update Progress: 2273/2372 symbols completed. WAL took 34.7s. Estimated remaining: 13m 10s. Rate: 7.5 symbols/min [2025-09-19T22:02:23.831094] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:02:23.843349] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-19T22:02:23.873832] [DEBUG] [LOCAL ] WCC: Loaded 40584 existing records from primary storage. [2025-09-19T22:02:23.873961] [INFO ] [MAIN ] WCC: Loaded 40584 existing records. [2025-09-19T22:02:24.066788] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:02:24.067093] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-19T22:02:24.067153] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-19T22:02:24.068125] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-19T22:02:24.068187] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-19T22:02:24.437229] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:02:24.643253] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-19T22:02:25.124170] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-19T22:02:25.202396] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-19T22:02:25.443306] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-19T22:02:26.243264] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-19T22:02:26.343483] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-19T22:02:26.738081] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-19T22:02:26.743429] [INFO ] [REMOTE ] WAT: Full fetch complete (49867 records). [2025-09-19T22:02:26.743518] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-19T22:02:27.049806] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-19T22:02:27.131396] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-19T22:02:27.131489] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-19T22:02:27.132550] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-19T22:02:27.137898] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-19T22:02:27.148764] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T22:02:27.155460] [DEBUG] [LOCAL ] WAT: Trimmed 49867 records to 35678 (keeping 200 days of data) [2025-09-19T22:02:27.366639] [DEBUG] [LOCAL ] WAT: Primary data saved (35678 records). [2025-09-19T22:02:27.366800] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-19T22:02:27.367115] [INFO ] [MAIN ] Update Progress: 2274/2372 symbols completed. WAT took 30.0s. Estimated remaining: 13m 2s. Rate: 7.5 symbols/min [2025-09-19T22:02:27.535437] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:02:27.584690] [DEBUG] [LOCAL ] WCN: Loaded 48451 existing records from primary storage. [2025-09-19T22:02:27.584833] [INFO ] [MAIN ] WCN: Loaded 48451 existing records. [2025-09-19T22:02:27.760841] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:02:27.761088] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-19T22:02:27.761169] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-19T22:02:27.762425] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-19T22:02:27.762490] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-19T22:02:27.848488] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-19T22:02:28.130960] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:02:28.548674] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-19T22:02:28.612476] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-19T22:02:28.643228] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-19T22:02:29.360499] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-19T22:02:29.443224] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-19T22:02:30.243290] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-19T22:02:31.043286] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-19T22:02:31.224423] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-19T22:02:31.687918] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-19T22:02:31.843235] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-19T22:02:32.643325] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-19T22:02:32.736032] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T22:02:32.903284] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T22:02:33.443323] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-19T22:02:34.173776] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-19T22:02:34.243287] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-19T22:02:34.396262] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-19T22:02:34.891774] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-19T22:02:34.893011] [INFO ] [REMOTE ] WBX: Full fetch complete (26362 records). [2025-09-19T22:02:34.893087] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-19T22:02:35.051492] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-19T22:02:35.271004] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-19T22:02:35.271080] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-19T22:02:35.271660] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-19T22:02:35.271721] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-19T22:02:35.272376] [DEBUG] [LOCAL ] WBX: Trimmed 26362 records to 13473 (keeping 200 days of data) [2025-09-19T22:02:35.345103] [DEBUG] [LOCAL ] WBX: Primary data saved (13473 records). [2025-09-19T22:02:35.345244] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-19T22:02:35.345341] [INFO ] [MAIN ] Update Progress: 2275/2372 symbols completed. WBX took 19.4s. Estimated remaining: 12m 54s. Rate: 7.5 symbols/min [2025-09-19T22:02:35.522738] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:02:35.546021] [DEBUG] [LOCAL ] WD: Loaded 23701 existing records from primary storage. [2025-09-19T22:02:35.546162] [INFO ] [MAIN ] WD: Loaded 23701 existing records. [2025-09-19T22:02:35.722070] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:02:35.722395] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-19T22:02:35.722456] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-19T22:02:35.723042] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-19T22:02:35.723100] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-19T22:02:35.848427] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-19T22:02:36.078208] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:02:36.643269] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-19T22:02:36.878409] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T22:02:37.443290] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-19T22:02:37.861983] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-19T22:02:37.934682] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-19T22:02:38.243321] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-19T22:02:38.840409] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-19T22:02:39.043263] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-19T22:02:39.843271] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-19T22:02:40.159018] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-19T22:02:40.271247] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T22:02:40.643231] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-19T22:02:41.144152] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-19T22:02:41.443273] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-19T22:02:42.243375] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-19T22:02:42.536719] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-19T22:02:42.939752] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T22:02:43.043281] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-19T22:02:43.111234] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-19T22:02:43.843310] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-19T22:02:44.648426] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-19T22:02:44.666563] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-19T22:02:45.443281] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-19T22:02:45.807580] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-19T22:02:46.243259] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-19T22:02:46.465735] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T22:02:46.761562] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-19T22:02:47.043261] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-19T22:02:47.527551] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T22:02:47.534932] [INFO ] [REMOTE ] WBS: Full fetch complete (69324 records). [2025-09-19T22:02:47.535067] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-19T22:02:47.848338] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-19T22:02:47.938319] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-19T22:02:47.938416] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-19T22:02:47.939522] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-19T22:02:47.939594] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-19T22:02:47.941298] [DEBUG] [LOCAL ] WBS: Trimmed 69324 records to 49586 (keeping 200 days of data) [2025-09-19T22:02:48.251695] [DEBUG] [LOCAL ] WBS: Primary data saved (49586 records). [2025-09-19T22:02:48.251855] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-19T22:02:48.251962] [INFO ] [MAIN ] Update Progress: 2276/2372 symbols completed. WBS took 48.5s. Estimated remaining: 12m 46s. Rate: 7.5 symbols/min [2025-09-19T22:02:48.436147] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:02:48.453342] [DEBUG] [LOCAL ] WDH: Loaded 16529 existing records from primary storage. [2025-09-19T22:02:48.453470] [INFO ] [MAIN ] WDH: Loaded 16529 existing records. [2025-09-19T22:02:48.643490] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:02:48.643581] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-19T22:02:48.644887] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-19T22:02:48.644957] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-19T22:02:48.645437] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-19T22:02:48.645614] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-19T22:02:49.050398] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:02:49.169452] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-19T22:02:49.267547] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-19T22:02:49.443225] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-19T22:02:50.006505] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T22:02:50.243320] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-19T22:02:51.043298] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-19T22:02:51.518276] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-19T22:02:51.680846] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-19T22:02:51.696356] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-19T22:02:51.843261] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-19T22:02:52.643287] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-19T22:02:53.332412] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-19T22:02:53.443264] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-19T22:02:54.243302] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-19T22:02:54.312051] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T22:02:54.340456] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T22:02:55.043280] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-19T22:02:55.843297] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-19T22:02:55.942283] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T22:02:56.643225] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-19T22:02:56.941750] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T22:02:57.209991] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-19T22:02:57.443311] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-19T22:02:57.967042] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T22:02:57.972879] [INFO ] [REMOTE ] WCC: Full fetch complete (57667 records). [2025-09-19T22:02:57.972975] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-19T22:02:58.248430] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-19T22:02:58.376350] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-19T22:02:58.376505] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-19T22:02:58.377728] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-19T22:02:58.377805] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-19T22:02:58.379531] [DEBUG] [LOCAL ] WCC: Trimmed 57667 records to 40867 (keeping 200 days of data) [2025-09-19T22:02:58.639956] [DEBUG] [LOCAL ] WCC: Primary data saved (40867 records). [2025-09-19T22:02:58.640084] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-19T22:02:58.640165] [INFO ] [MAIN ] Update Progress: 2277/2372 symbols completed. WCC took 35.0s. Estimated remaining: 12m 38s. Rate: 7.5 symbols/min [2025-09-19T22:02:59.043232] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-19T22:02:59.228211] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T22:02:59.235917] [INFO ] [REMOTE ] WCN: Full fetch complete (69266 records). [2025-09-19T22:02:59.236108] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-19T22:02:59.631122] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-19T22:02:59.631359] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-19T22:02:59.632578] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-19T22:02:59.632708] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-19T22:02:59.639617] [DEBUG] [LOCAL ] WCN: Trimmed 69266 records to 48820 (keeping 200 days of data) [2025-09-19T22:02:59.648322] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T22:02:59.849952] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-19T22:02:59.983022] [DEBUG] [LOCAL ] WCN: Primary data saved (48820 records). [2025-09-19T22:02:59.983245] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-19T22:02:59.984479] [INFO ] [MAIN ] Update Progress: 2278/2372 symbols completed. WCN took 32.6s. Estimated remaining: 12m 30s. Rate: 7.5 symbols/min [2025-09-19T22:03:00.231735] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-19T22:03:00.643364] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-19T22:03:01.072210] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T22:03:01.076003] [INFO ] [REMOTE ] WD: Full fetch complete (32628 records). [2025-09-19T22:03:01.076095] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-19T22:03:01.487635] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-19T22:03:01.487758] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-19T22:03:01.488443] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-19T22:03:01.488483] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-19T22:03:01.489422] [DEBUG] [LOCAL ] WD: Trimmed 32628 records to 23877 (keeping 200 days of data) [2025-09-19T22:03:01.639383] [DEBUG] [LOCAL ] WD: Primary data saved (23877 records). [2025-09-19T22:03:01.639539] [INFO ] [MAIN ] WD: Full history saved. [2025-09-19T22:03:01.639631] [INFO ] [MAIN ] Update Progress: 2279/2372 symbols completed. WD took 26.3s. Estimated remaining: 12m 22s. Rate: 7.5 symbols/min [2025-09-19T22:03:01.837428] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T22:03:01.840489] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-19T22:03:04.070517] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-19T22:03:04.074875] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-19T22:03:05.192951] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-19T22:03:05.196572] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-19T22:03:06.205688] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-19T22:03:06.208434] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-19T22:03:07.105478] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-19T22:03:07.108898] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-19T22:03:08.167072] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-19T22:03:08.172716] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-19T22:03:09.396302] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T22:03:09.400735] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-19T22:03:10.793454] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-19T22:03:10.802302] [INFO ] [REMOTE ] WDH: Full fetch complete (22304 records). [2025-09-19T22:03:10.802527] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-19T22:03:11.361367] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-19T22:03:11.361473] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-19T22:03:11.362106] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-19T22:03:11.362173] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-19T22:03:11.363168] [DEBUG] [LOCAL ] WDH: Trimmed 22304 records to 16817 (keeping 200 days of data) [2025-09-19T22:03:11.464171] [DEBUG] [LOCAL ] WDH: Primary data saved (16817 records). [2025-09-19T22:03:11.464388] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-19T22:03:11.464492] [INFO ] [MAIN ] Update Progress: 2280/2372 symbols completed. WDH took 23.2s. Estimated remaining: 12m 14s. Rate: 7.5 symbols/min [2025-09-19T22:03:12.109912] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:12.212507] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:12.202155] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:12.234093] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:12.245739] [DEBUG] [LOCAL ] WEA: Loaded 7523 existing records from primary storage. [2025-09-19T22:03:12.245920] [INFO ] [MAIN ] WEA: Loaded 7523 existing records. [2025-09-19T22:03:12.408161] [DEBUG] [LOCAL ] WDI: Loaded 21478 existing records from primary storage. [2025-09-19T22:03:12.450784] [INFO ] [MAIN ] WDI: Loaded 21478 existing records. [2025-09-19T22:03:12.527831] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:12.581201] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-19T22:03:12.581131] [DEBUG] [LOCAL ] WEAV: Loaded 42365 existing records from primary storage. [2025-09-19T22:03:12.602723] [INFO ] [MAIN ] WEAV: Loaded 42365 existing records. [2025-09-19T22:03:12.602598] [DEBUG] [LOCAL ] WDS: Loaded 44163 existing records from primary storage. [2025-09-19T22:03:12.603023] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-19T22:03:12.608435] [INFO ] [MAIN ] WDS: Loaded 44163 existing records. [2025-09-19T22:03:12.608375] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-19T22:03:12.661399] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-19T22:03:13.059031] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:13.065429] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-19T22:03:13.088606] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-19T22:03:13.177789] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-19T22:03:13.242115] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:13.285806] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-19T22:03:13.269498] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-19T22:03:13.289161] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-19T22:03:13.332766] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-19T22:03:13.327545] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:13.358357] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-19T22:03:13.414451] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-19T22:03:13.516948] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-19T22:03:13.603134] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-19T22:03:13.632325] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-19T22:03:14.020895] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:14.118374] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-19T22:03:14.548567] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:14.564440] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-19T22:03:14.615174] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:14.615532] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-19T22:03:14.689583] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:14.689940] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-19T22:03:15.607894] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T22:03:15.609874] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-19T22:03:16.093470] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-19T22:03:16.099000] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-19T22:03:16.357349] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-19T22:03:16.366606] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-19T22:03:16.563618] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-19T22:03:16.574096] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-19T22:03:16.621158] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-19T22:03:16.623121] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-19T22:03:16.776060] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-19T22:03:16.781274] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-19T22:03:17.577305] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-19T22:03:17.579222] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-19T22:03:18.105175] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T22:03:18.112732] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-19T22:03:18.133613] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-19T22:03:18.135913] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-19T22:03:18.177627] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T22:03:18.187103] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-19T22:03:18.400543] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-19T22:03:18.410283] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-19T22:03:19.217294] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-19T22:03:19.219370] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-19T22:03:19.368003] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-19T22:03:19.495835] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-19T22:03:19.679293] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-19T22:03:19.843278] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-19T22:03:20.223153] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-19T22:03:20.643292] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-19T22:03:20.678425] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-19T22:03:21.443297] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-19T22:03:22.243368] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-19T22:03:22.295915] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-19T22:03:22.818887] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T22:03:23.043281] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-19T22:03:23.843305] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-19T22:03:23.932484] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T22:03:24.643268] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-19T22:03:24.824125] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-19T22:03:24.969458] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T22:03:25.373426] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-19T22:03:25.443236] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-19T22:03:26.243275] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-19T22:03:26.505435] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-19T22:03:26.783888] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-19T22:03:27.043265] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-19T22:03:27.843285] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-19T22:03:27.878447] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-19T22:03:27.881217] [INFO ] [REMOTE ] WEA: Full fetch complete (9968 records). [2025-09-19T22:03:27.881359] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-19T22:03:28.263275] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-19T22:03:28.263387] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-19T22:03:28.263846] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-19T22:03:28.263936] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-19T22:03:28.264942] [DEBUG] [LOCAL ] WEA: Trimmed 9968 records to 7581 (keeping 200 days of data) [2025-09-19T22:03:28.316658] [DEBUG] [LOCAL ] WEA: Primary data saved (7581 records). [2025-09-19T22:03:28.316795] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-19T22:03:28.316964] [INFO ] [MAIN ] Update Progress: 2281/2372 symbols completed. WEA took 16.9s. Estimated remaining: 12m 6s. Rate: 7.5 symbols/min [2025-09-19T22:03:28.489329] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:28.557924] [DEBUG] [LOCAL ] WEC: Loaded 52605 existing records from primary storage. [2025-09-19T22:03:28.558090] [INFO ] [MAIN ] WEC: Loaded 52605 existing records. [2025-09-19T22:03:28.648604] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-19T22:03:28.739812] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:28.740066] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-19T22:03:28.740114] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-19T22:03:28.741898] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-19T22:03:28.741970] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-19T22:03:29.106947] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:29.443298] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-19T22:03:29.633243] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-19T22:03:29.996778] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-19T22:03:30.243238] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-19T22:03:30.723234] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-19T22:03:31.043277] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-19T22:03:31.843284] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-19T22:03:32.492235] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-19T22:03:32.643267] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-19T22:03:33.090603] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-19T22:03:33.128940] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T22:03:33.443268] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-19T22:03:34.243272] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-19T22:03:34.855278] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-19T22:03:35.024408] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T22:03:35.043216] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-19T22:03:35.385270] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-19T22:03:35.389798] [INFO ] [REMOTE ] WDI: Full fetch complete (30854 records). [2025-09-19T22:03:35.389948] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-19T22:03:35.782388] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-19T22:03:35.782506] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-19T22:03:35.783980] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-19T22:03:35.784060] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-19T22:03:35.785158] [DEBUG] [LOCAL ] WDI: Trimmed 30854 records to 21570 (keeping 200 days of data) [2025-09-19T22:03:35.851710] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-19T22:03:35.938465] [DEBUG] [LOCAL ] WDI: Primary data saved (21570 records). [2025-09-19T22:03:35.938593] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-19T22:03:35.938754] [INFO ] [MAIN ] Update Progress: 2282/2372 symbols completed. WDI took 24.5s. Estimated remaining: 11m 58s. Rate: 7.5 symbols/min [2025-09-19T22:03:36.163548] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:36.225124] [DEBUG] [LOCAL ] WELL: Loaded 52746 existing records from primary storage. [2025-09-19T22:03:36.225271] [INFO ] [MAIN ] WELL: Loaded 52746 existing records. [2025-09-19T22:03:36.414724] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:36.414993] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-19T22:03:36.415044] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-19T22:03:36.416316] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-19T22:03:36.416379] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-19T22:03:36.657054] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-19T22:03:36.796699] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:36.905708] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-19T22:03:37.443272] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-19T22:03:37.813776] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-19T22:03:37.965336] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T22:03:38.243282] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-19T22:03:39.043276] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-19T22:03:39.546034] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T22:03:39.843264] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-19T22:03:40.271886] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T22:03:40.643325] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-19T22:03:40.748033] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T22:03:41.443280] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-19T22:03:41.907197] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T22:03:42.148360] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-19T22:03:42.243251] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-19T22:03:42.764161] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T22:03:43.043308] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-19T22:03:43.843297] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-19T22:03:44.272905] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-19T22:03:44.643236] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-19T22:03:44.723268] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T22:03:44.944394] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-19T22:03:45.443265] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-19T22:03:46.243265] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-19T22:03:46.745003] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-19T22:03:47.043265] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-19T22:03:47.232522] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T22:03:47.241506] [INFO ] [REMOTE ] WDS: Full fetch complete (64906 records). [2025-09-19T22:03:47.241677] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-19T22:03:47.659489] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-19T22:03:47.659630] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-19T22:03:47.660726] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-19T22:03:47.660880] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-19T22:03:47.662594] [DEBUG] [LOCAL ] WDS: Trimmed 64906 records to 44456 (keeping 200 days of data) [2025-09-19T22:03:47.862612] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-19T22:03:47.935136] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T22:03:48.002913] [DEBUG] [LOCAL ] WDS: Primary data saved (44456 records). [2025-09-19T22:03:48.003043] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-19T22:03:48.003428] [INFO ] [MAIN ] Update Progress: 2283/2372 symbols completed. WDS took 36.5s. Estimated remaining: 11m 50s. Rate: 7.5 symbols/min [2025-09-19T22:03:48.177435] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:48.198304] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T22:03:48.205255] [INFO ] [REMOTE ] WEAV: Full fetch complete (61613 records). [2025-09-19T22:03:48.205397] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-19T22:03:48.551891] [DEBUG] [LOCAL ] WES: Loaded 48435 existing records from primary storage. [2025-09-19T22:03:48.563271] [INFO ] [MAIN ] WES: Loaded 48435 existing records. [2025-09-19T22:03:48.655183] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-19T22:03:48.767051] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-19T22:03:48.778452] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-19T22:03:48.822196] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-19T22:03:48.849269] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-19T22:03:48.855490] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:48.855842] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-19T22:03:48.856135] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-19T22:03:48.856829] [DEBUG] [LOCAL ] WEAV: Trimmed 61613 records to 42702 (keeping 200 days of data) [2025-09-19T22:03:48.857790] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-19T22:03:48.857883] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-19T22:03:49.325864] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:49.443253] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-19T22:03:49.473046] [DEBUG] [LOCAL ] WEAV: Primary data saved (42702 records). [2025-09-19T22:03:49.473165] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-19T22:03:49.473300] [INFO ] [MAIN ] Update Progress: 2284/2372 symbols completed. WEAV took 38.0s. Estimated remaining: 11m 42s. Rate: 7.5 symbols/min [2025-09-19T22:03:49.641813] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:49.684370] [DEBUG] [LOCAL ] WEX: Loaded 35964 existing records from primary storage. [2025-09-19T22:03:49.684529] [INFO ] [MAIN ] WEX: Loaded 35964 existing records. [2025-09-19T22:03:49.862812] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:49.863078] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-19T22:03:49.863125] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-19T22:03:49.864073] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-19T22:03:49.864133] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-19T22:03:50.232444] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:50.248372] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-19T22:03:50.268323] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-19T22:03:50.969676] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-19T22:03:51.043234] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-19T22:03:51.074532] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-19T22:03:51.843282] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-19T22:03:51.862160] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T22:03:52.643277] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-19T22:03:53.154681] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-19T22:03:53.200219] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-19T22:03:53.443275] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-19T22:03:54.243298] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-19T22:03:54.702552] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-19T22:03:55.043283] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-19T22:03:55.338017] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T22:03:55.345729] [INFO ] [REMOTE ] WEC: Full fetch complete (75430 records). [2025-09-19T22:03:55.345862] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-19T22:03:55.681227] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-19T22:03:55.785946] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-19T22:03:55.786027] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-19T22:03:55.787179] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-19T22:03:55.787244] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-19T22:03:55.790229] [DEBUG] [LOCAL ] WEC: Trimmed 75430 records to 52982 (keeping 200 days of data) [2025-09-19T22:03:55.854748] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-19T22:03:56.138019] [DEBUG] [LOCAL ] WEC: Primary data saved (52982 records). [2025-09-19T22:03:56.138172] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-19T22:03:56.140466] [INFO ] [MAIN ] Update Progress: 2285/2372 symbols completed. WEC took 27.8s. Estimated remaining: 11m 34s. Rate: 7.5 symbols/min [2025-09-19T22:03:56.331367] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:03:56.358533] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-19T22:03:56.374776] [DEBUG] [LOCAL ] WF: Loaded 11177 existing records from primary storage. [2025-09-19T22:03:56.374923] [INFO ] [MAIN ] WF: Loaded 11177 existing records. [2025-09-19T22:03:56.566900] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:03:56.567228] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-19T22:03:56.567292] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-19T22:03:56.568067] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-19T22:03:56.568129] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-19T22:03:56.649391] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-19T22:03:56.955160] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:03:57.380565] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T22:03:57.443214] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-19T22:03:58.243313] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-19T22:03:58.334914] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-19T22:03:59.043247] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-19T22:03:59.499471] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-19T22:03:59.749091] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T22:03:59.843233] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-19T22:04:00.393664] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-19T22:04:00.643264] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-19T22:04:01.443285] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-19T22:04:02.000979] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-19T22:04:02.140606] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T22:04:02.243319] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-19T22:04:02.750558] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T22:04:03.043279] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-19T22:04:03.599597] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-19T22:04:03.843299] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-19T22:04:04.651248] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-19T22:04:04.655533] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T22:04:05.278240] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-19T22:04:05.443304] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-19T22:04:06.243264] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-19T22:04:06.487267] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T22:04:06.588723] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-19T22:04:07.043273] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-19T22:04:07.349506] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-19T22:04:07.843305] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-19T22:04:07.961258] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-19T22:04:08.643259] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-19T22:04:09.384826] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-19T22:04:09.443255] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-19T22:04:09.565695] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T22:04:09.575091] [INFO ] [REMOTE ] WELL: Full fetch complete (75715 records). [2025-09-19T22:04:09.575276] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-19T22:04:09.973176] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-19T22:04:09.973266] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-19T22:04:09.974428] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-19T22:04:09.974506] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-19T22:04:09.977940] [DEBUG] [LOCAL ] WELL: Trimmed 75715 records to 53136 (keeping 200 days of data) [2025-09-19T22:04:10.268516] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-19T22:04:10.318363] [DEBUG] [LOCAL ] WELL: Primary data saved (53136 records). [2025-09-19T22:04:10.318520] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-19T22:04:10.318620] [INFO ] [MAIN ] Update Progress: 2286/2372 symbols completed. WELL took 34.4s. Estimated remaining: 11m 26s. Rate: 7.5 symbols/min [2025-09-19T22:04:10.487554] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:04:10.543504] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-09-19T22:04:10.543683] [INFO ] [MAIN ] WFC: Loaded 54138 existing records. [2025-09-19T22:04:10.720981] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:04:10.721217] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-19T22:04:10.721264] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-19T22:04:10.722956] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-19T22:04:10.723017] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-19T22:04:11.064018] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-19T22:04:11.095538] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:04:11.128023] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T22:04:11.843338] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-19T22:04:11.876376] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T22:04:12.100715] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-19T22:04:12.643321] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-19T22:04:13.443281] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-19T22:04:14.054838] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T22:04:14.167596] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-19T22:04:14.243290] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-19T22:04:15.043264] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-19T22:04:15.780255] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T22:04:15.843270] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-19T22:04:16.006413] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-19T22:04:16.062005] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-19T22:04:16.069601] [INFO ] [REMOTE ] WES: Full fetch complete (69678 records). [2025-09-19T22:04:16.069792] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-19T22:04:16.469845] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-19T22:04:16.469982] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-19T22:04:16.471250] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-19T22:04:16.471316] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-19T22:04:16.472888] [DEBUG] [LOCAL ] WES: Trimmed 69678 records to 48807 (keeping 200 days of data) [2025-09-19T22:04:16.655427] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-19T22:04:16.787712] [DEBUG] [LOCAL ] WES: Primary data saved (48807 records). [2025-09-19T22:04:16.787860] [INFO ] [MAIN ] WES: Full history saved. [2025-09-19T22:04:16.788409] [INFO ] [MAIN ] Update Progress: 2287/2372 symbols completed. WES took 28.8s. Estimated remaining: 11m 18s. Rate: 7.5 symbols/min [2025-09-19T22:04:16.957994] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:04:16.983374] [DEBUG] [LOCAL ] WFG: Loaded 25332 existing records from primary storage. [2025-09-19T22:04:16.983504] [INFO ] [MAIN ] WFG: Loaded 25332 existing records. [2025-09-19T22:04:17.158768] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:04:17.159040] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-19T22:04:17.159100] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-19T22:04:17.159724] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-19T22:04:17.159783] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-19T22:04:17.444333] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-19T22:04:17.528750] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:04:17.541902] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T22:04:17.546618] [INFO ] [REMOTE ] WEX: Full fetch complete (50763 records). [2025-09-19T22:04:17.546766] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-19T22:04:17.926798] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-19T22:04:17.946242] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-19T22:04:17.946685] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-19T22:04:17.947726] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-19T22:04:17.947790] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-19T22:04:17.949199] [DEBUG] [LOCAL ] WEX: Trimmed 50763 records to 36192 (keeping 200 days of data) [2025-09-19T22:04:18.172539] [DEBUG] [LOCAL ] WEX: Primary data saved (36192 records). [2025-09-19T22:04:18.172726] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-19T22:04:18.172839] [INFO ] [MAIN ] Update Progress: 2288/2372 symbols completed. WEX took 28.7s. Estimated remaining: 11m 10s. Rate: 7.5 symbols/min [2025-09-19T22:04:18.248405] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-19T22:04:18.348217] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:04:18.385733] [DEBUG] [LOCAL ] WGO: Loaded 39934 existing records from primary storage. [2025-09-19T22:04:18.385894] [INFO ] [MAIN ] WGO: Loaded 39934 existing records. [2025-09-19T22:04:18.564232] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:04:18.564549] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-19T22:04:18.564599] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-19T22:04:18.565713] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-19T22:04:18.565776] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-19T22:04:18.918442] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:04:19.043260] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-19T22:04:19.547331] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T22:04:19.843244] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-19T22:04:19.888427] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-19T22:04:20.334887] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-19T22:04:20.349049] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-19T22:04:20.643300] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-19T22:04:21.443265] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-19T22:04:22.243249] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-19T22:04:22.730384] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-19T22:04:22.812293] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T22:04:23.043256] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-19T22:04:23.843268] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-19T22:04:24.022465] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T22:04:24.643274] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-19T22:04:24.772238] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-19T22:04:24.774239] [INFO ] [REMOTE ] WF: Full fetch complete (16888 records). [2025-09-19T22:04:24.774341] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-19T22:04:25.174940] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-19T22:04:25.175024] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-19T22:04:25.175416] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-19T22:04:25.175455] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-19T22:04:25.176030] [DEBUG] [LOCAL ] WF: Trimmed 16888 records to 11233 (keeping 200 days of data) [2025-09-19T22:04:25.252048] [DEBUG] [LOCAL ] WF: Primary data saved (11233 records). [2025-09-19T22:04:25.252205] [INFO ] [MAIN ] WF: Full history saved. [2025-09-19T22:04:25.252297] [INFO ] [MAIN ] Update Progress: 2289/2372 symbols completed. WF took 29.1s. Estimated remaining: 11m 2s. Rate: 7.5 symbols/min [2025-09-19T22:04:25.443311] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:04:25.443856] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-19T22:04:25.484021] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-19T22:04:25.534862] [DEBUG] [LOCAL ] WH: Loaded 46318 existing records from primary storage. [2025-09-19T22:04:25.535024] [INFO ] [MAIN ] WH: Loaded 46318 existing records. [2025-09-19T22:04:25.715807] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:04:25.716322] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-19T22:04:25.716562] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-19T22:04:25.717951] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-19T22:04:25.718053] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-19T22:04:25.854752] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-19T22:04:26.141549] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:04:26.243275] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-19T22:04:27.043286] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-19T22:04:27.043169] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-19T22:04:27.843285] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-19T22:04:28.643318] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-19T22:04:28.716079] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-19T22:04:28.742311] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-19T22:04:28.994621] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-19T22:04:29.443268] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-19T22:04:30.047904] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T22:04:30.243287] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-19T22:04:31.043296] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-19T22:04:31.378797] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-19T22:04:31.511067] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-19T22:04:31.843285] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-19T22:04:32.545303] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T22:04:32.643225] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-19T22:04:33.443308] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-19T22:04:33.821579] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-19T22:04:34.238316] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-19T22:04:34.244000] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-19T22:04:35.043319] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-19T22:04:35.575749] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T22:04:35.844901] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-19T22:04:35.843635] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-19T22:04:36.643289] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-19T22:04:36.927229] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T22:04:37.126106] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-19T22:04:37.443317] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-19T22:04:37.931771] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T22:04:38.243264] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-19T22:04:39.043319] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-19T22:04:39.843299] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-19T22:04:39.900660] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-19T22:04:39.928890] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-19T22:04:40.380578] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-19T22:04:40.643319] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-19T22:04:41.443295] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-19T22:04:41.604198] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-19T22:04:42.243345] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-19T22:04:42.543627] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T22:04:42.659300] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T22:04:43.043314] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-19T22:04:43.843331] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-19T22:04:43.941162] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-19T22:04:44.643324] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-19T22:04:45.037613] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T22:04:45.108751] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-19T22:04:45.443312] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-19T22:04:45.948305] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-19T22:04:45.954354] [INFO ] [REMOTE ] WGO: Full fetch complete (57303 records). [2025-09-19T22:04:45.954489] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-19T22:04:46.248526] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-19T22:04:46.362978] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-19T22:04:46.363066] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-19T22:04:46.364200] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-19T22:04:46.364267] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-19T22:04:46.366170] [DEBUG] [LOCAL ] WGO: Trimmed 57303 records to 40204 (keeping 200 days of data) [2025-09-19T22:04:46.624430] [DEBUG] [LOCAL ] WGO: Primary data saved (40204 records). [2025-09-19T22:04:46.624604] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-19T22:04:46.624781] [INFO ] [MAIN ] Update Progress: 2290/2372 symbols completed. WGO took 28.5s. Estimated remaining: 10m 55s. Rate: 7.5 symbols/min [2025-09-19T22:04:46.804569] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:04:46.844365] [DEBUG] [LOCAL ] WHD: Loaded 41111 existing records from primary storage. [2025-09-19T22:04:46.844533] [INFO ] [MAIN ] WHD: Loaded 41111 existing records. [2025-09-19T22:04:47.029007] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:04:47.029826] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-19T22:04:47.029929] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-19T22:04:47.031302] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-19T22:04:47.031366] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-19T22:04:47.062436] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-19T22:04:47.152985] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T22:04:47.430487] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:04:47.843333] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-19T22:04:47.981514] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-19T22:04:47.989462] [INFO ] [REMOTE ] WFC: Full fetch complete (77790 records). [2025-09-19T22:04:47.989590] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-19T22:04:48.336735] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-19T22:04:48.430754] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-19T22:04:48.430847] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-19T22:04:48.432213] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-19T22:04:48.432282] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-19T22:04:48.433900] [DEBUG] [LOCAL ] WFC: Trimmed 77790 records to 54528 (keeping 200 days of data) [2025-09-19T22:04:48.652536] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-19T22:04:48.788851] [DEBUG] [LOCAL ] WFC: Primary data saved (54528 records). [2025-09-19T22:04:48.789062] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-19T22:04:48.789191] [INFO ] [MAIN ] Update Progress: 2291/2372 symbols completed. WFC took 38.5s. Estimated remaining: 10m 46s. Rate: 7.5 symbols/min [2025-09-19T22:04:48.963491] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:04:48.971196] [DEBUG] [LOCAL ] WHG: Loaded 3438 existing records from primary storage. [2025-09-19T22:04:48.971331] [INFO ] [MAIN ] WHG: Loaded 3438 existing records. [2025-09-19T22:04:49.167864] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:04:49.168198] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-19T22:04:49.168359] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-19T22:04:49.168684] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-19T22:04:49.168757] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-19T22:04:49.279741] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-19T22:04:49.333214] [INFO ] [REMOTE ] WFG: Full fetch complete (35570 records). [2025-09-19T22:04:49.348255] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-19T22:04:49.459278] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-19T22:04:49.694235] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:04:49.950225] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-19T22:04:49.950309] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-19T22:04:49.951056] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-19T22:04:49.951117] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-19T22:04:49.951998] [DEBUG] [LOCAL ] WFG: Trimmed 35570 records to 25529 (keeping 200 days of data) [2025-09-19T22:04:50.106943] [DEBUG] [LOCAL ] WFG: Primary data saved (25529 records). [2025-09-19T22:04:50.107230] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-19T22:04:50.107365] [INFO ] [MAIN ] Update Progress: 2292/2372 symbols completed. WFG took 33.3s. Estimated remaining: 10m 38s. Rate: 7.5 symbols/min [2025-09-19T22:04:50.247979] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-19T22:04:50.286962] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:04:50.321834] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-19T22:04:50.374080] [DEBUG] [LOCAL ] WHR: Loaded 48527 existing records from primary storage. [2025-09-19T22:04:50.374242] [INFO ] [MAIN ] WHR: Loaded 48527 existing records. [2025-09-19T22:04:50.572171] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:04:50.572462] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-19T22:04:50.572519] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-19T22:04:50.573709] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-19T22:04:50.573785] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-19T22:04:50.957705] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:04:51.043234] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-19T22:04:51.122713] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-19T22:04:51.444598] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T22:04:51.843287] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-19T22:04:52.643294] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-19T22:04:52.798531] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T22:04:52.839275] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-19T22:04:53.443266] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-19T22:04:54.243275] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-19T22:04:54.303856] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-19T22:04:55.043292] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-19T22:04:55.484829] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T22:04:55.843266] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-19T22:04:56.020207] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-19T22:04:56.132125] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-19T22:04:56.643275] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-19T22:04:57.443344] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-19T22:04:57.752927] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-19T22:04:58.243299] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-19T22:04:58.500146] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-19T22:04:59.043236] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-19T22:04:59.151515] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-19T22:04:59.158639] [INFO ] [REMOTE ] WH: Full fetch complete (65065 records). [2025-09-19T22:04:59.158849] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-19T22:04:59.549944] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-19T22:04:59.550048] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-19T22:04:59.551125] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-19T22:04:59.551195] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-19T22:04:59.552754] [DEBUG] [LOCAL ] WH: Trimmed 65065 records to 46601 (keeping 200 days of data) [2025-09-19T22:04:59.845141] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-19T22:04:59.845039] [DEBUG] [LOCAL ] WH: Primary data saved (46601 records). [2025-09-19T22:04:59.846095] [INFO ] [MAIN ] WH: Full history saved. [2025-09-19T22:04:59.847321] [INFO ] [MAIN ] Update Progress: 2293/2372 symbols completed. WH took 34.6s. Estimated remaining: 10m 30s. Rate: 7.5 symbols/min [2025-09-19T22:05:00.023945] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:00.033030] [DEBUG] [LOCAL ] WIA: Loaded 4916 existing records from primary storage. [2025-09-19T22:05:00.033161] [INFO ] [MAIN ] WIA: Loaded 4916 existing records. [2025-09-19T22:05:00.214686] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:05:00.215063] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-19T22:05:00.215223] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-19T22:05:00.215510] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-19T22:05:00.215615] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-19T22:05:00.367475] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-19T22:05:00.612354] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:00.643227] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-19T22:05:00.960906] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-19T22:05:01.018637] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-19T22:05:01.443281] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-19T22:05:01.549967] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-19T22:05:02.228155] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-19T22:05:02.243217] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-19T22:05:02.976932] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-19T22:05:03.043253] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-19T22:05:03.843264] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-19T22:05:03.869536] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-19T22:05:04.643273] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-19T22:05:05.443276] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-19T22:05:06.043129] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-19T22:05:06.073883] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-19T22:05:06.243230] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-19T22:05:06.354967] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T22:05:07.043293] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-19T22:05:07.763336] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-19T22:05:07.848746] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-19T22:05:07.852049] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T22:05:08.643279] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-19T22:05:09.381278] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-19T22:05:09.443243] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-19T22:05:09.573572] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-19T22:05:10.243322] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-19T22:05:10.349975] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T22:05:11.043293] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-19T22:05:11.843268] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-19T22:05:12.155354] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-19T22:05:12.217687] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T22:05:12.585278] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-19T22:05:12.643215] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-19T22:05:12.984303] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-19T22:05:13.443320] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-19T22:05:14.243322] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-19T22:05:15.043239] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-19T22:05:15.172855] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-19T22:05:15.178849] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T22:05:15.843274] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-19T22:05:16.412044] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-19T22:05:16.413013] [INFO ] [REMOTE ] WHG: Full fetch complete (4714 records). [2025-09-19T22:05:16.413086] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-19T22:05:16.656073] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-19T22:05:16.777261] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-19T22:05:16.777348] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-19T22:05:16.777500] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-19T22:05:16.777537] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-19T22:05:16.777937] [DEBUG] [LOCAL ] WHG: Trimmed 4714 records to 3455 (keeping 200 days of data) [2025-09-19T22:05:16.799314] [DEBUG] [LOCAL ] WHG: Primary data saved (3455 records). [2025-09-19T22:05:16.799397] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-19T22:05:16.799473] [INFO ] [MAIN ] Update Progress: 2294/2372 symbols completed. WHG took 28.0s. Estimated remaining: 10m 23s. Rate: 7.5 symbols/min [2025-09-19T22:05:16.971387] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:16.985998] [DEBUG] [LOCAL ] WINN: Loaded 12035 existing records from primary storage. [2025-09-19T22:05:16.986139] [INFO ] [MAIN ] WINN: Loaded 12035 existing records. [2025-09-19T22:05:17.178614] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:05:17.179225] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-19T22:05:17.179367] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-19T22:05:17.180007] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-19T22:05:17.180074] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-19T22:05:17.443838] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-19T22:05:17.563040] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-19T22:05:17.576041] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-19T22:05:17.656890] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:18.243273] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-19T22:05:19.043269] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-19T22:05:19.196722] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-19T22:05:19.262187] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T22:05:19.843271] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-19T22:05:20.103023] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-19T22:05:20.643281] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-19T22:05:21.443278] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-19T22:05:22.202623] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-19T22:05:22.243294] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-19T22:05:22.289581] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T22:05:22.300361] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-19T22:05:22.302811] [INFO ] [REMOTE ] WHD: Full fetch complete (57140 records). [2025-09-19T22:05:22.303190] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-19T22:05:22.699257] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-19T22:05:22.699338] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-19T22:05:22.700324] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-19T22:05:22.700388] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-19T22:05:22.701693] [DEBUG] [LOCAL ] WHD: Trimmed 57140 records to 41385 (keeping 200 days of data) [2025-09-19T22:05:22.955780] [DEBUG] [LOCAL ] WHD: Primary data saved (41385 records). [2025-09-19T22:05:22.955920] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-19T22:05:22.956015] [INFO ] [MAIN ] Update Progress: 2295/2372 symbols completed. WHD took 36.3s. Estimated remaining: 10m 15s. Rate: 7.5 symbols/min [2025-09-19T22:05:23.048379] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-19T22:05:23.131054] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:23.180888] [DEBUG] [LOCAL ] WIT: Loaded 52651 existing records from primary storage. [2025-09-19T22:05:23.181062] [INFO ] [MAIN ] WIT: Loaded 52651 existing records. [2025-09-19T22:05:23.359205] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:05:23.359449] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-19T22:05:23.359497] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-19T22:05:23.360931] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-19T22:05:23.360993] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-19T22:05:23.721057] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:23.744974] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-19T22:05:23.747270] [INFO ] [REMOTE ] WIA: Full fetch complete (7340 records). [2025-09-19T22:05:23.747451] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-19T22:05:23.848678] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-19T22:05:23.874180] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-19T22:05:23.933600] [INFO ] [REMOTE ] WHR: Full fetch complete (68262 records). [2025-09-19T22:05:23.961942] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-19T22:05:24.336264] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-19T22:05:24.349846] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-19T22:05:24.368825] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-19T22:05:24.409438] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-19T22:05:24.448449] [DEBUG] [LOCAL ] WIA: Trimmed 7340 records to 4942 (keeping 200 days of data) [2025-09-19T22:05:24.609691] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-19T22:05:24.609793] [DEBUG] [LOCAL ] WIA: Primary data saved (4942 records). [2025-09-19T22:05:24.609978] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-19T22:05:24.609920] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-19T22:05:24.611279] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-19T22:05:24.611407] [INFO ] [MAIN ] Update Progress: 2296/2372 symbols completed. WIA took 24.8s. Estimated remaining: 10m 6s. Rate: 7.5 symbols/min [2025-09-19T22:05:24.611766] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-19T22:05:24.643705] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-19T22:05:24.717087] [DEBUG] [LOCAL ] WHR: Trimmed 68262 records to 48879 (keeping 200 days of data) [2025-09-19T22:05:24.898707] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:24.940120] [DEBUG] [LOCAL ] WIW: Loaded 21003 existing records from primary storage. [2025-09-19T22:05:24.941015] [INFO ] [MAIN ] WIW: Loaded 21003 existing records. [2025-09-19T22:05:25.072706] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-19T22:05:25.151708] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:05:25.154132] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-19T22:05:25.154874] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-19T22:05:25.155793] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-19T22:05:25.159307] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-19T22:05:25.448421] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-19T22:05:25.661003] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:25.732338] [DEBUG] [LOCAL ] WHR: Primary data saved (48879 records). [2025-09-19T22:05:25.732483] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-19T22:05:25.732574] [INFO ] [MAIN ] Update Progress: 2297/2372 symbols completed. WHR took 35.6s. Estimated remaining: 9m 58s. Rate: 7.5 symbols/min [2025-09-19T22:05:25.949553] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:25.984123] [DEBUG] [LOCAL ] WK: Loaded 36780 existing records from primary storage. [2025-09-19T22:05:25.984298] [INFO ] [MAIN ] WK: Loaded 36780 existing records. [2025-09-19T22:05:26.163843] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:05:26.164091] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-19T22:05:26.164139] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-19T22:05:26.165519] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-19T22:05:26.165772] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-19T22:05:26.253430] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-19T22:05:26.552498] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:26.554991] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-19T22:05:26.736288] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-19T22:05:27.043274] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-19T22:05:27.622382] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-19T22:05:27.843278] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-19T22:05:28.120192] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-19T22:05:28.643282] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-19T22:05:29.271955] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T22:05:29.443300] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-19T22:05:30.243236] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-19T22:05:30.349429] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-19T22:05:31.043260] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-19T22:05:31.430200] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-19T22:05:31.572878] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-19T22:05:31.843278] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-19T22:05:32.578816] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-19T22:05:32.643250] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-19T22:05:32.906728] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T22:05:33.443279] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-19T22:05:34.243259] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-19T22:05:34.368810] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T22:05:34.439464] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T22:05:35.043343] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-19T22:05:35.843251] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-19T22:05:36.081376] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-19T22:05:36.232152] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T22:05:36.643245] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-19T22:05:37.022288] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-19T22:05:37.443309] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-19T22:05:37.595401] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T22:05:38.243264] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-19T22:05:39.043294] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-19T22:05:39.134543] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T22:05:39.428853] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-19T22:05:39.843261] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-19T22:05:40.407111] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T22:05:40.643299] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-19T22:05:41.348602] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T22:05:41.443281] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-19T22:05:42.243335] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-19T22:05:42.740448] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-19T22:05:42.772009] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-19T22:05:43.043283] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-19T22:05:43.843313] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-19T22:05:43.923270] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T22:05:44.483041] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-19T22:05:44.546714] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-19T22:05:44.643341] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-19T22:05:45.443273] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-19T22:05:45.458468] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-19T22:05:46.243300] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-19T22:05:47.043326] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-19T22:05:47.163254] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T22:05:47.430133] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T22:05:47.678580] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-19T22:05:47.843245] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-19T22:05:48.643282] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-19T22:05:49.443247] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-19T22:05:49.804246] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-19T22:05:49.806354] [INFO ] [REMOTE ] WINN: Full fetch complete (17721 records). [2025-09-19T22:05:49.806434] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-19T22:05:50.208679] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-19T22:05:50.208905] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-19T22:05:50.209405] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-19T22:05:50.209503] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-19T22:05:50.210847] [DEBUG] [LOCAL ] WINN: Trimmed 17721 records to 12083 (keeping 200 days of data) [2025-09-19T22:05:50.259776] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-19T22:05:50.309426] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-19T22:05:50.339824] [DEBUG] [LOCAL ] WINN: Primary data saved (12083 records). [2025-09-19T22:05:50.339982] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-19T22:05:50.340120] [INFO ] [MAIN ] Update Progress: 2298/2372 symbols completed. WINN took 33.5s. Estimated remaining: 9m 51s. Rate: 7.5 symbols/min [2025-09-19T22:05:50.506902] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:50.548209] [DEBUG] [LOCAL ] WKC: Loaded 35580 existing records from primary storage. [2025-09-19T22:05:50.548379] [INFO ] [MAIN ] WKC: Loaded 35580 existing records. [2025-09-19T22:05:50.720847] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:05:50.721103] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-19T22:05:50.721151] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-19T22:05:50.722144] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-19T22:05:50.722216] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-19T22:05:51.050702] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-19T22:05:51.083246] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:51.441856] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-19T22:05:51.587153] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-19T22:05:51.843283] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-19T22:05:52.643278] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-19T22:05:53.036855] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T22:05:53.443271] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-19T22:05:53.503385] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-19T22:05:53.509426] [INFO ] [REMOTE ] WK: Full fetch complete (51887 records). [2025-09-19T22:05:53.509580] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-19T22:05:53.939701] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-19T22:05:53.939942] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-19T22:05:53.941110] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-19T22:05:53.941220] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-19T22:05:53.943084] [DEBUG] [LOCAL ] WK: Trimmed 51887 records to 37113 (keeping 200 days of data) [2025-09-19T22:05:53.958760] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-19T22:05:54.214092] [DEBUG] [LOCAL ] WK: Primary data saved (37113 records). [2025-09-19T22:05:54.214429] [INFO ] [MAIN ] WK: Full history saved. [2025-09-19T22:05:54.215566] [INFO ] [MAIN ] Update Progress: 2299/2372 symbols completed. WK took 28.5s. Estimated remaining: 9m 43s. Rate: 7.5 symbols/min [2025-09-19T22:05:54.249026] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-19T22:05:54.396914] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:54.457370] [DEBUG] [LOCAL ] WLK: Loaded 45575 existing records from primary storage. [2025-09-19T22:05:54.457520] [INFO ] [MAIN ] WLK: Loaded 45575 existing records. [2025-09-19T22:05:54.645310] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:05:54.645676] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-19T22:05:54.645751] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-19T22:05:54.647128] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-19T22:05:54.647226] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-19T22:05:55.028504] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:55.048583] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-19T22:05:55.063700] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-19T22:05:55.576133] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T22:05:55.582161] [INFO ] [REMOTE ] WIW: Full fetch complete (30601 records). [2025-09-19T22:05:55.582298] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-19T22:05:55.843257] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-19T22:05:55.980243] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-19T22:05:55.980328] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-19T22:05:55.981064] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-19T22:05:55.981128] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-19T22:05:55.983151] [DEBUG] [LOCAL ] WIW: Trimmed 30601 records to 21115 (keeping 200 days of data) [2025-09-19T22:05:56.129983] [DEBUG] [LOCAL ] WIW: Primary data saved (21115 records). [2025-09-19T22:05:56.130122] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-19T22:05:56.130238] [INFO ] [MAIN ] Update Progress: 2300/2372 symbols completed. WIW took 31.5s. Estimated remaining: 9m 34s. Rate: 7.5 symbols/min [2025-09-19T22:05:56.331385] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:56.341477] [DEBUG] [LOCAL ] WLKP: Loaded 6570 existing records from primary storage. [2025-09-19T22:05:56.341594] [INFO ] [MAIN ] WLKP: Loaded 6570 existing records. [2025-09-19T22:05:56.520721] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:05:56.521011] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-19T22:05:56.521060] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-19T22:05:56.521364] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-19T22:05:56.521438] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-19T22:05:56.646315] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-19T22:05:56.896019] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:56.920539] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-19T22:05:57.443321] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-19T22:05:57.669291] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T22:05:57.679619] [INFO ] [REMOTE ] WIT: Full fetch complete (75551 records). [2025-09-19T22:05:57.679805] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-19T22:05:58.105596] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-19T22:05:58.127169] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-19T22:05:58.129721] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-19T22:05:58.129048] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-19T22:05:58.136670] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-19T22:05:58.138312] [DEBUG] [LOCAL ] WIT: Trimmed 75551 records to 53032 (keeping 200 days of data) [2025-09-19T22:05:58.247297] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-19T22:05:58.369998] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-19T22:05:58.472914] [DEBUG] [LOCAL ] WIT: Primary data saved (53032 records). [2025-09-19T22:05:58.473072] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-19T22:05:58.473202] [INFO ] [MAIN ] Update Progress: 2301/2372 symbols completed. WIT took 35.5s. Estimated remaining: 9m 26s. Rate: 7.5 symbols/min [2025-09-19T22:05:58.643748] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:05:58.643961] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-19T22:05:58.643999] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-19T22:05:58.644180] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-19T22:05:58.644224] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-19T22:05:58.644265] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-19T22:05:58.644338] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-19T22:05:59.029899] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:05:59.043216] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-19T22:05:59.467881] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-19T22:05:59.843279] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-19T22:06:00.088959] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-19T22:06:00.643262] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-19T22:06:01.395985] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T22:06:01.443228] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-19T22:06:02.243225] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-19T22:06:02.805743] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-19T22:06:03.043270] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-19T22:06:03.843266] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-19T22:06:04.797672] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-19T22:06:04.798710] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-19T22:06:05.203701] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-19T22:06:05.374048] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (3.93 seconds). [2025-09-19T22:06:05.400805] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T22:06:05.443288] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-19T22:06:05.772558] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-19T22:06:05.898420] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-19T22:06:06.243341] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-19T22:06:06.952152] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-19T22:06:07.043283] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-19T22:06:07.843234] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-19T22:06:08.192822] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T22:06:08.643263] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-19T22:06:09.077358] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T22:06:09.095775] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-19T22:06:09.443354] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-19T22:06:10.243354] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-19T22:06:11.012475] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T22:06:11.043266] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-19T22:06:11.363461] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-19T22:06:11.843319] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-19T22:06:12.067854] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-19T22:06:12.370686] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-19T22:06:12.643292] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-19T22:06:13.443280] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-19T22:06:13.687170] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-19T22:06:14.243269] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-19T22:06:15.043320] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-19T22:06:15.270400] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-19T22:06:15.843259] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-19T22:06:16.335027] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (2.89 seconds). [2025-09-19T22:06:16.426000] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-19T22:06:16.643276] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-19T22:06:17.443304] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-19T22:06:17.724203] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T22:06:18.014668] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-19T22:06:18.238305] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-19T22:06:18.245153] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-19T22:06:19.043317] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-19T22:06:19.843328] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-19T22:06:19.944510] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-19T22:06:20.085334] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T22:06:20.643291] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-19T22:06:21.166584] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-19T22:06:21.443276] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-19T22:06:21.471146] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-19T22:06:21.754804] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-19T22:06:22.243355] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-19T22:06:23.015446] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-19T22:06:23.017339] [INFO ] [REMOTE ] WLKP: Full fetch complete (10143 records). [2025-09-19T22:06:23.017413] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-19T22:06:23.049739] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-19T22:06:23.402872] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-19T22:06:23.402964] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-19T22:06:23.403238] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-19T22:06:23.403323] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-19T22:06:23.403820] [DEBUG] [LOCAL ] WLKP: Trimmed 10143 records to 6645 (keeping 200 days of data) [2025-09-19T22:06:23.446125] [DEBUG] [LOCAL ] WLKP: Primary data saved (6645 records). [2025-09-19T22:06:23.446263] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-19T22:06:23.446353] [INFO ] [MAIN ] Update Progress: 2302/2372 symbols completed. WLKP took 27.3s. Estimated remaining: 9m 19s. Rate: 7.5 symbols/min [2025-09-19T22:06:23.629440] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:06:23.670446] [DEBUG] [LOCAL ] WLY: Loaded 30818 existing records from primary storage. [2025-09-19T22:06:23.670589] [INFO ] [MAIN ] WLY: Loaded 30818 existing records. [2025-09-19T22:06:23.848756] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-19T22:06:23.854341] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:06:23.855379] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-19T22:06:23.855432] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-19T22:06:23.856561] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-19T22:06:23.856670] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-19T22:06:24.227300] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:06:24.552416] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-19T22:06:24.559590] [INFO ] [REMOTE ] WKC: Full fetch complete (51498 records). [2025-09-19T22:06:24.559851] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-19T22:06:24.648520] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-19T22:06:24.957311] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-19T22:06:24.957405] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-19T22:06:24.958390] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-19T22:06:24.958456] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-19T22:06:24.959732] [DEBUG] [LOCAL ] WKC: Trimmed 51498 records to 35885 (keeping 200 days of data) [2025-09-19T22:06:25.212361] [DEBUG] [LOCAL ] WKC: Primary data saved (35885 records). [2025-09-19T22:06:25.212552] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-19T22:06:25.212693] [INFO ] [MAIN ] Update Progress: 2303/2372 symbols completed. WKC took 34.9s. Estimated remaining: 9m 11s. Rate: 7.5 symbols/min [2025-09-19T22:06:25.387624] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:06:25.422755] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T22:06:25.443235] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-19T22:06:25.484515] [DEBUG] [LOCAL ] WM: Loaded 51376 existing records from primary storage. [2025-09-19T22:06:25.484702] [INFO ] [MAIN ] WM: Loaded 51376 existing records. [2025-09-19T22:06:25.674366] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:06:25.674838] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-19T22:06:25.674948] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-19T22:06:25.682144] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-19T22:06:25.692765] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-19T22:06:25.739331] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-19T22:06:25.896757] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-19T22:06:25.964044] [INFO ] [REMOTE ] WLTG: Full fetch complete (1661 records). [2025-09-19T22:06:25.978139] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-19T22:06:26.248176] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:06:26.248260] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-19T22:06:26.295126] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T22:06:26.297142] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-19T22:06:26.297250] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-19T22:06:26.297333] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-19T22:06:26.297411] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-19T22:06:26.297460] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-19T22:06:26.297528] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-19T22:06:26.297636] [INFO ] [MAIN ] Update Progress: 2304/2372 symbols completed. WLTG took 27.8s. Estimated remaining: 9m 3s. Rate: 7.5 symbols/min [2025-09-19T22:06:26.470728] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:06:26.527967] [DEBUG] [LOCAL ] WMB: Loaded 54061 existing records from primary storage. [2025-09-19T22:06:26.528145] [INFO ] [MAIN ] WMB: Loaded 54061 existing records. [2025-09-19T22:06:26.708632] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:06:26.708897] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-19T22:06:26.708946] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-19T22:06:26.710307] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-19T22:06:26.710369] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-19T22:06:27.054036] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-19T22:06:27.098869] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:06:27.803208] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-19T22:06:27.843272] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-19T22:06:28.643290] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-19T22:06:28.991920] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T22:06:29.443274] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-19T22:06:29.719184] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T22:06:30.243317] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-19T22:06:30.883033] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-19T22:06:30.909376] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T22:06:31.043316] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-19T22:06:31.843288] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-19T22:06:32.424066] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T22:06:32.643320] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-19T22:06:32.716301] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-19T22:06:33.443362] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-19T22:06:33.615932] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-19T22:06:33.622561] [INFO ] [REMOTE ] WLK: Full fetch complete (62567 records). [2025-09-19T22:06:33.622713] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-19T22:06:34.004746] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-19T22:06:34.004836] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-19T22:06:34.005826] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-19T22:06:34.005904] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-19T22:06:34.007175] [DEBUG] [LOCAL ] WLK: Trimmed 62567 records to 45890 (keeping 200 days of data) [2025-09-19T22:06:34.246824] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-19T22:06:34.298331] [DEBUG] [LOCAL ] WLK: Primary data saved (45890 records). [2025-09-19T22:06:34.298487] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-19T22:06:34.299008] [INFO ] [MAIN ] Update Progress: 2305/2372 symbols completed. WLK took 40.1s. Estimated remaining: 8m 55s. Rate: 7.5 symbols/min [2025-09-19T22:06:34.477496] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:06:34.494493] [DEBUG] [LOCAL ] WMK: Loaded 14621 existing records from primary storage. [2025-09-19T22:06:34.494624] [INFO ] [MAIN ] WMK: Loaded 14621 existing records. [2025-09-19T22:06:34.674074] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-19T22:06:34.708100] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:06:34.708377] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-19T22:06:34.708509] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-19T22:06:34.709096] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-19T22:06:34.709182] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-19T22:06:35.044506] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-19T22:06:35.074726] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:06:35.105412] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-19T22:06:35.843295] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-19T22:06:36.535188] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T22:06:36.643315] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-19T22:06:36.723803] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T22:06:37.443273] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-19T22:06:37.612917] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-19T22:06:38.243251] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-19T22:06:38.313264] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T22:06:38.935752] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T22:06:38.949594] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-19T22:06:39.043224] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-19T22:06:39.843274] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-19T22:06:39.998530] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-19T22:06:40.643280] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-19T22:06:41.428898] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T22:06:41.443219] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-19T22:06:42.243266] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-19T22:06:42.673961] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-19T22:06:42.824548] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T22:06:43.043271] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-19T22:06:43.843250] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-19T22:06:44.371138] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-19T22:06:44.377124] [INFO ] [REMOTE ] WLY: Full fetch complete (43322 records). [2025-09-19T22:06:44.377283] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-19T22:06:44.652238] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-19T22:06:44.885840] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-19T22:06:44.886045] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-19T22:06:44.887086] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-19T22:06:44.889553] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-19T22:06:44.895103] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-19T22:06:44.911517] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T22:06:44.915513] [DEBUG] [LOCAL ] WLY: Trimmed 43322 records to 31011 (keeping 200 days of data) [2025-09-19T22:06:45.111453] [DEBUG] [LOCAL ] WLY: Primary data saved (31011 records). [2025-09-19T22:06:45.111626] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-19T22:06:45.111771] [INFO ] [MAIN ] Update Progress: 2306/2372 symbols completed. WLY took 21.7s. Estimated remaining: 8m 47s. Rate: 7.5 symbols/min [2025-09-19T22:06:45.282557] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:06:45.323395] [DEBUG] [LOCAL ] WMS: Loaded 39951 existing records from primary storage. [2025-09-19T22:06:45.323541] [INFO ] [MAIN ] WMS: Loaded 39951 existing records. [2025-09-19T22:06:45.448486] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-19T22:06:45.503349] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:06:45.503591] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-19T22:06:45.503663] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-19T22:06:45.504619] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-19T22:06:45.504704] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-19T22:06:45.859838] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:06:46.243288] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-19T22:06:46.541760] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-19T22:06:46.612148] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-19T22:06:47.043271] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-19T22:06:47.843323] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-19T22:06:48.481924] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-19T22:06:48.643267] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-19T22:06:48.980008] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-19T22:06:49.443236] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-19T22:06:50.124277] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-19T22:06:50.243274] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-19T22:06:50.702826] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-19T22:06:50.724488] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T22:06:51.043263] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-19T22:06:51.843266] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-19T22:06:52.423689] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-19T22:06:52.540234] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T22:06:52.632742] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-19T22:06:52.643207] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-19T22:06:53.443268] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-19T22:06:53.723888] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-19T22:06:54.243325] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-19T22:06:54.912126] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-19T22:06:55.043270] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-19T22:06:55.843278] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-19T22:06:55.901754] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T22:06:56.197257] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-19T22:06:56.643294] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-19T22:06:57.443278] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-19T22:06:57.868953] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-19T22:06:58.243341] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-19T22:06:58.809711] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T22:06:59.043247] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-19T22:06:59.157346] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-19T22:06:59.843261] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-19T22:06:59.919289] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T22:06:59.927453] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-09-19T22:06:59.927623] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-19T22:07:00.235912] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-19T22:07:00.382937] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-19T22:07:00.383032] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-19T22:07:00.384251] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-19T22:07:00.384352] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-19T22:07:00.385916] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 54451 (keeping 200 days of data) [2025-09-19T22:07:00.680301] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-19T22:07:00.740827] [DEBUG] [LOCAL ] WMB: Primary data saved (54451 records). [2025-09-19T22:07:00.741033] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-19T22:07:00.741223] [INFO ] [MAIN ] Update Progress: 2307/2372 symbols completed. WMB took 34.4s. Estimated remaining: 8m 39s. Rate: 7.5 symbols/min [2025-09-19T22:07:00.912352] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:07:00.965785] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-09-19T22:07:00.965951] [INFO ] [MAIN ] WMT: Loaded 54190 existing records. [2025-09-19T22:07:01.144016] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:07:01.144277] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-19T22:07:01.144383] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-19T22:07:01.145837] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-19T22:07:01.145898] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-19T22:07:01.458293] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-19T22:07:01.499998] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:07:01.637977] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T22:07:01.649973] [INFO ] [REMOTE ] WM: Full fetch complete (73646 records). [2025-09-19T22:07:01.650176] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-19T22:07:02.109344] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-19T22:07:02.109486] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-19T22:07:02.111344] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-19T22:07:02.111492] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-19T22:07:02.140357] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-19T22:07:02.149897] [DEBUG] [LOCAL ] WM: Trimmed 73646 records to 51728 (keeping 200 days of data) [2025-09-19T22:07:02.255635] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-19T22:07:02.642036] [DEBUG] [LOCAL ] WM: Primary data saved (51728 records). [2025-09-19T22:07:02.642227] [INFO ] [MAIN ] WM: Full history saved. [2025-09-19T22:07:02.642323] [INFO ] [MAIN ] Update Progress: 2308/2372 symbols completed. WM took 37.4s. Estimated remaining: 8m 31s. Rate: 7.5 symbols/min [2025-09-19T22:07:02.932206] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-19T22:07:02.935228] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:07:02.998941] [DEBUG] [LOCAL ] WNC: Loaded 40856 existing records from primary storage. [2025-09-19T22:07:02.999143] [INFO ] [MAIN ] WNC: Loaded 40856 existing records. [2025-09-19T22:07:03.043328] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-19T22:07:03.239228] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:07:03.239526] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-19T22:07:03.239577] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-19T22:07:03.240487] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-19T22:07:03.240551] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-19T22:07:03.628794] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:07:03.843224] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-19T22:07:04.077754] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-19T22:07:04.157254] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-19T22:07:04.160739] [INFO ] [REMOTE ] WMK: Full fetch complete (19249 records). [2025-09-19T22:07:04.160822] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-19T22:07:04.565588] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-19T22:07:04.565698] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-19T22:07:04.566182] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-19T22:07:04.566246] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-19T22:07:04.566913] [DEBUG] [LOCAL ] WMK: Trimmed 19249 records to 14783 (keeping 200 days of data) [2025-09-19T22:07:04.650794] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-19T22:07:04.666734] [DEBUG] [LOCAL ] WMK: Primary data saved (14783 records). [2025-09-19T22:07:04.666844] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-19T22:07:04.667182] [INFO ] [MAIN ] Update Progress: 2309/2372 symbols completed. WMK took 30.4s. Estimated remaining: 8m 23s. Rate: 7.5 symbols/min [2025-09-19T22:07:04.855093] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:07:04.902903] [DEBUG] [LOCAL ] WNS: Loaded 40016 existing records from primary storage. [2025-09-19T22:07:04.903084] [INFO ] [MAIN ] WNS: Loaded 40016 existing records. [2025-09-19T22:07:05.103853] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:07:05.104165] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-19T22:07:05.104224] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-19T22:07:05.105144] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-19T22:07:05.105209] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-19T22:07:05.453344] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-19T22:07:05.499044] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:07:05.520424] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-19T22:07:06.243268] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-19T22:07:06.667149] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T22:07:07.043283] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-19T22:07:07.741370] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-19T22:07:07.843240] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-19T22:07:08.486306] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (3.03 seconds). [2025-09-19T22:07:08.596436] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T22:07:08.643278] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-19T22:07:09.443340] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-19T22:07:09.619913] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-19T22:07:10.243292] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-19T22:07:10.282013] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-19T22:07:11.043333] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-19T22:07:11.258498] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T22:07:11.843289] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-19T22:07:11.909421] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-19T22:07:12.014233] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-19T22:07:12.643328] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-19T22:07:13.443307] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-19T22:07:13.891155] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-19T22:07:14.243281] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-19T22:07:14.285245] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T22:07:15.043306] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-19T22:07:15.422334] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-19T22:07:15.843271] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-19T22:07:16.643282] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-19T22:07:16.878545] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-19T22:07:16.917299] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-19T22:07:17.155310] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-19T22:07:17.443277] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-19T22:07:17.922815] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-19T22:07:17.929406] [INFO ] [REMOTE ] WMS: Full fetch complete (57283 records). [2025-09-19T22:07:17.929531] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-19T22:07:18.248478] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-19T22:07:18.335727] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-19T22:07:18.335818] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-19T22:07:18.336839] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-19T22:07:18.336900] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-19T22:07:18.338108] [DEBUG] [LOCAL ] WMS: Trimmed 57283 records to 40206 (keeping 200 days of data) [2025-09-19T22:07:18.599277] [DEBUG] [LOCAL ] WMS: Primary data saved (40206 records). [2025-09-19T22:07:18.599443] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-19T22:07:18.599616] [INFO ] [MAIN ] Update Progress: 2310/2372 symbols completed. WMS took 33.5s. Estimated remaining: 8m 15s. Rate: 7.5 symbols/min [2025-09-19T22:07:18.790539] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:07:18.850321] [DEBUG] [LOCAL ] WOLF: Loaded 53922 existing records from primary storage. [2025-09-19T22:07:18.850509] [INFO ] [MAIN ] WOLF: Loaded 53922 existing records. [2025-09-19T22:07:19.026287] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:07:19.026537] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-19T22:07:19.026585] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-19T22:07:19.027668] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-19T22:07:19.027732] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-19T22:07:19.058465] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-19T22:07:19.380954] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:07:19.843284] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-19T22:07:19.942223] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-19T22:07:20.397865] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-09-19T22:07:20.643282] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-19T22:07:20.897256] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T22:07:21.443274] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-19T22:07:22.198404] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-19T22:07:22.243231] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-19T22:07:22.265315] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T22:07:23.043330] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-19T22:07:23.843316] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-19T22:07:24.372476] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-19T22:07:24.643246] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-19T22:07:24.743402] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-19T22:07:24.797551] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-19T22:07:25.452314] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-19T22:07:25.457178] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T22:07:26.243335] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-19T22:07:27.043331] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-19T22:07:27.525741] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-09-19T22:07:27.843303] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-19T22:07:27.955175] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-19T22:07:28.015037] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T22:07:28.228017] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-19T22:07:28.643265] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-19T22:07:29.443267] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-19T22:07:30.243334] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-19T22:07:30.285744] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T22:07:30.503674] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-19T22:07:30.532995] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-19T22:07:30.538483] [INFO ] [REMOTE ] WNS: Full fetch complete (54770 records). [2025-09-19T22:07:30.538577] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-19T22:07:30.967131] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-19T22:07:30.967224] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-19T22:07:30.968205] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-19T22:07:30.968270] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-19T22:07:30.969550] [DEBUG] [LOCAL ] WNS: Trimmed 54770 records to 40320 (keeping 200 days of data) [2025-09-19T22:07:31.057050] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-19T22:07:31.223446] [DEBUG] [LOCAL ] WNS: Primary data saved (40320 records). [2025-09-19T22:07:31.223597] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-19T22:07:31.223716] [INFO ] [MAIN ] Update Progress: 2311/2372 symbols completed. WNS took 26.6s. Estimated remaining: 8m 7s. Rate: 7.5 symbols/min [2025-09-19T22:07:31.403699] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:07:31.429912] [DEBUG] [LOCAL ] WOR: Loaded 24959 existing records from primary storage. [2025-09-19T22:07:31.430063] [INFO ] [MAIN ] WOR: Loaded 24959 existing records. [2025-09-19T22:07:31.619009] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:07:31.619325] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-19T22:07:31.619383] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-19T22:07:31.620147] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-19T22:07:31.620206] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-19T22:07:31.857329] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-19T22:07:31.974413] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:07:32.643380] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-19T22:07:32.923830] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-19T22:07:33.276132] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-19T22:07:33.443249] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-19T22:07:33.918844] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T22:07:34.243303] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-19T22:07:34.310532] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-19T22:07:34.315283] [INFO ] [REMOTE ] WNC: Full fetch complete (57525 records). [2025-09-19T22:07:34.315469] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-19T22:07:34.703005] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-19T22:07:34.703097] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-19T22:07:34.704079] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-19T22:07:34.704143] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-19T22:07:34.705404] [DEBUG] [LOCAL ] WNC: Trimmed 57525 records to 41029 (keeping 200 days of data) [2025-09-19T22:07:34.946731] [DEBUG] [LOCAL ] WNC: Primary data saved (41029 records). [2025-09-19T22:07:34.946860] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-19T22:07:34.946954] [INFO ] [MAIN ] Update Progress: 2312/2372 symbols completed. WNC took 32.3s. Estimated remaining: 7m 59s. Rate: 7.5 symbols/min [2025-09-19T22:07:35.047318] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-19T22:07:35.153374] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:07:35.183729] [DEBUG] [LOCAL ] WOW: Loaded 30017 existing records from primary storage. [2025-09-19T22:07:35.183860] [INFO ] [MAIN ] WOW: Loaded 30017 existing records. [2025-09-19T22:07:35.362695] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:07:35.362981] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-19T22:07:35.363033] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-19T22:07:35.363802] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-19T22:07:35.363862] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-19T22:07:35.723961] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:07:35.779710] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-19T22:07:35.843254] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-19T22:07:36.131273] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-19T22:07:36.643234] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-19T22:07:37.130689] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T22:07:37.289240] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-19T22:07:37.297218] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-09-19T22:07:37.297357] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-19T22:07:37.448492] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-19T22:07:37.700116] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-19T22:07:37.700231] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-19T22:07:37.701524] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-19T22:07:37.701610] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-19T22:07:37.734499] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 54580 (keeping 200 days of data) [2025-09-19T22:07:37.735659] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-19T22:07:38.092865] [DEBUG] [LOCAL ] WMT: Primary data saved (54580 records). [2025-09-19T22:07:38.093017] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-19T22:07:38.093115] [INFO ] [MAIN ] Update Progress: 2313/2372 symbols completed. WMT took 37.4s. Estimated remaining: 7m 51s. Rate: 7.5 symbols/min [2025-09-19T22:07:38.258090] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-19T22:07:38.261582] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:07:38.311132] [DEBUG] [LOCAL ] WPC: Loaded 49108 existing records from primary storage. [2025-09-19T22:07:38.311284] [INFO ] [MAIN ] WPC: Loaded 49108 existing records. [2025-09-19T22:07:38.489410] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:07:38.489752] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-19T22:07:38.489814] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-19T22:07:38.490932] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-19T22:07:38.491001] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-19T22:07:38.862005] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:07:39.043283] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-19T22:07:39.071751] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-19T22:07:39.647362] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T22:07:39.843256] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-19T22:07:40.643232] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-19T22:07:40.730031] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-19T22:07:41.379976] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T22:07:41.448338] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-19T22:07:41.458803] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-19T22:07:42.243264] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-19T22:07:43.043298] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-19T22:07:43.479931] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T22:07:43.737274] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-19T22:07:43.843233] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-19T22:07:44.337736] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-19T22:07:44.643265] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-19T22:07:45.443278] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-19T22:07:46.243331] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-19T22:07:46.615531] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-19T22:07:46.781172] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-19T22:07:47.043237] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-19T22:07:47.196074] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-19T22:07:47.558806] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-19T22:07:47.843265] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-19T22:07:48.643278] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-19T22:07:49.448683] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-19T22:07:49.455381] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T22:07:49.632090] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-19T22:07:49.662528] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-19T22:07:50.243268] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-19T22:07:51.043266] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-19T22:07:51.321853] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T22:07:51.540370] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-19T22:07:51.791144] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-19T22:07:51.843253] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-19T22:07:52.643262] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-19T22:07:53.159557] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T22:07:53.162989] [INFO ] [REMOTE ] WOR: Full fetch complete (35605 records). [2025-09-19T22:07:53.163071] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-19T22:07:53.448568] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-19T22:07:53.558222] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-19T22:07:53.558313] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-19T22:07:53.559133] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-19T22:07:53.559196] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-19T22:07:53.560054] [DEBUG] [LOCAL ] WOR: Trimmed 35605 records to 25115 (keeping 200 days of data) [2025-09-19T22:07:53.724741] [DEBUG] [LOCAL ] WOR: Primary data saved (25115 records). [2025-09-19T22:07:53.724892] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-19T22:07:53.724982] [INFO ] [MAIN ] Update Progress: 2314/2372 symbols completed. WOR took 22.5s. Estimated remaining: 7m 43s. Rate: 7.5 symbols/min [2025-09-19T22:07:53.905033] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:07:53.961580] [DEBUG] [LOCAL ] WPM: Loaded 53099 existing records from primary storage. [2025-09-19T22:07:53.961784] [INFO ] [MAIN ] WPM: Loaded 53099 existing records. [2025-09-19T22:07:54.156207] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:07:54.156449] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-19T22:07:54.156498] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-19T22:07:54.157990] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-19T22:07:54.158051] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-19T22:07:54.248395] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-19T22:07:54.521139] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:07:54.991022] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-19T22:07:55.043276] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-19T22:07:55.574364] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-09-19T22:07:55.667549] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-19T22:07:55.843303] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-19T22:07:56.523092] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-19T22:07:56.643219] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-19T22:07:57.443300] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-19T22:07:57.913291] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-19T22:07:58.243272] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-19T22:07:58.414209] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-19T22:07:59.043270] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-19T22:07:59.323999] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-19T22:07:59.716423] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T22:07:59.843258] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-19T22:08:00.643285] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-19T22:08:00.957411] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T22:08:01.212455] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T22:08:01.443239] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-19T22:08:02.248557] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-19T22:08:02.251757] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T22:08:02.258993] [INFO ] [REMOTE ] WOW: Full fetch complete (41449 records). [2025-09-19T22:08:02.259091] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-19T22:08:02.638796] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-19T22:08:02.638890] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-19T22:08:02.639721] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-19T22:08:02.639786] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-19T22:08:02.640892] [DEBUG] [LOCAL ] WOW: Trimmed 41449 records to 30308 (keeping 200 days of data) [2025-09-19T22:08:02.814696] [DEBUG] [LOCAL ] WOW: Primary data saved (30308 records). [2025-09-19T22:08:02.814838] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-19T22:08:02.814955] [INFO ] [MAIN ] Update Progress: 2315/2372 symbols completed. WOW took 27.9s. Estimated remaining: 7m 35s. Rate: 7.5 symbols/min [2025-09-19T22:08:02.991680] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:08:03.035898] [DEBUG] [LOCAL ] WPP: Loaded 33871 existing records from primary storage. [2025-09-19T22:08:03.036077] [INFO ] [MAIN ] WPP: Loaded 33871 existing records. [2025-09-19T22:08:03.069239] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-19T22:08:03.217554] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:08:03.217851] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-19T22:08:03.217913] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-19T22:08:03.218676] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-19T22:08:03.218748] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-19T22:08:03.582975] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:08:03.611548] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-19T22:08:03.668911] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T22:08:03.843245] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-19T22:08:04.643267] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-19T22:08:05.007783] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-19T22:08:05.019353] [INFO ] [REMOTE ] WOLF: Full fetch complete (77599 records). [2025-09-19T22:08:05.019501] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-19T22:08:05.432602] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-19T22:08:05.432965] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-19T22:08:05.434773] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-19T22:08:05.434913] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-19T22:08:05.438465] [DEBUG] [LOCAL ] WOLF: Trimmed 77599 records to 54312 (keeping 200 days of data) [2025-09-19T22:08:05.452861] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-19T22:08:05.575244] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-19T22:08:05.816484] [DEBUG] [LOCAL ] WOLF: Primary data saved (54312 records). [2025-09-19T22:08:05.816622] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-19T22:08:05.818532] [INFO ] [MAIN ] Update Progress: 2316/2372 symbols completed. WOLF took 47.2s. Estimated remaining: 7m 27s. Rate: 7.5 symbols/min [2025-09-19T22:08:05.989013] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:08:06.041373] [DEBUG] [LOCAL ] WRB: Loaded 50994 existing records from primary storage. [2025-09-19T22:08:06.041536] [INFO ] [MAIN ] WRB: Loaded 50994 existing records. [2025-09-19T22:08:06.218105] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:08:06.218324] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-19T22:08:06.218372] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-19T22:08:06.219447] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-19T22:08:06.219517] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-19T22:08:06.255786] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-19T22:08:06.593221] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:08:06.627335] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-19T22:08:06.884174] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-19T22:08:07.043268] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-19T22:08:07.843266] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-19T22:08:08.599679] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-19T22:08:08.643254] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-19T22:08:08.670393] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-19T22:08:09.443304] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-19T22:08:09.759777] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-19T22:08:10.243248] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-19T22:08:10.794225] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T22:08:11.043252] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-19T22:08:11.173548] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-19T22:08:11.843277] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-19T22:08:12.075456] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T22:08:12.085943] [INFO ] [REMOTE ] WPC: Full fetch complete (71032 records). [2025-09-19T22:08:12.086073] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-19T22:08:12.532726] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-19T22:08:12.532826] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-19T22:08:12.533948] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-19T22:08:12.534012] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-19T22:08:12.535620] [DEBUG] [LOCAL ] WPC: Trimmed 71032 records to 49468 (keeping 200 days of data) [2025-09-19T22:08:12.643371] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-19T22:08:12.803085] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-19T22:08:12.892063] [DEBUG] [LOCAL ] WPC: Primary data saved (49468 records). [2025-09-19T22:08:12.892195] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-19T22:08:12.892290] [INFO ] [MAIN ] Update Progress: 2317/2372 symbols completed. WPC took 34.8s. Estimated remaining: 7m 19s. Rate: 7.5 symbols/min [2025-09-19T22:08:13.443293] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-19T22:08:13.873284] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-19T22:08:14.243247] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-19T22:08:14.285485] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-19T22:08:15.043267] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-19T22:08:15.273349] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T22:08:15.843285] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-19T22:08:15.925398] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T22:08:16.144968] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-19T22:08:16.643269] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-19T22:08:17.443274] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-19T22:08:17.519871] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-19T22:08:18.243295] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-19T22:08:18.733379] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-19T22:08:19.010719] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-19T22:08:19.043289] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-19T22:08:19.843252] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-19T22:08:19.989845] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-19T22:08:20.643338] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-19T22:08:20.684960] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-19T22:08:21.443268] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-19T22:08:22.047216] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-19T22:08:22.055220] [INFO ] [REMOTE ] WPM: Full fetch complete (75779 records). [2025-09-19T22:08:22.055379] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-19T22:08:22.464462] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-19T22:08:22.464767] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-19T22:08:22.466088] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-19T22:08:22.466212] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-19T22:08:22.467988] [DEBUG] [LOCAL ] WPM: Trimmed 75779 records to 53489 (keeping 200 days of data) [2025-09-19T22:08:22.636573] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-19T22:08:22.652346] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-19T22:08:22.862700] [DEBUG] [LOCAL ] WPM: Primary data saved (53489 records). [2025-09-19T22:08:22.862884] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-19T22:08:22.864084] [INFO ] [MAIN ] Update Progress: 2318/2372 symbols completed. WPM took 29.1s. Estimated remaining: 7m 11s. Rate: 7.5 symbols/min [2025-09-19T22:08:23.293369] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T22:08:23.302124] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-19T22:08:24.924629] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-19T22:08:24.935100] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-19T22:08:25.007637] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T22:08:25.015974] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-19T22:08:26.534711] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-19T22:08:26.543053] [INFO ] [REMOTE ] WPP: Full fetch complete (44782 records). [2025-09-19T22:08:26.543257] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-19T22:08:26.931082] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T22:08:26.995466] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-19T22:08:27.032700] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-19T22:08:27.032811] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-19T22:08:27.034095] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-19T22:08:27.034166] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-19T22:08:27.035425] [DEBUG] [LOCAL ] WPP: Trimmed 44782 records to 34181 (keeping 200 days of data) [2025-09-19T22:08:27.270425] [DEBUG] [LOCAL ] WPP: Primary data saved (34181 records). [2025-09-19T22:08:27.270606] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-19T22:08:27.270768] [INFO ] [MAIN ] Update Progress: 2319/2372 symbols completed. WPP took 24.5s. Estimated remaining: 7m 3s. Rate: 7.5 symbols/min [2025-09-19T22:08:28.122350] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-19T22:08:28.133160] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-19T22:08:29.032898] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-19T22:08:29.040516] [INFO ] [REMOTE ] WRB: Full fetch complete (73007 records). [2025-09-19T22:08:29.040699] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-19T22:08:29.441930] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-19T22:08:29.442056] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-19T22:08:29.443213] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-19T22:08:29.443278] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-19T22:08:29.444794] [DEBUG] [LOCAL ] WRB: Trimmed 73007 records to 51351 (keeping 200 days of data) [2025-09-19T22:08:29.775935] [DEBUG] [LOCAL ] WRB: Primary data saved (51351 records). [2025-09-19T22:08:29.776076] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-19T22:08:29.776886] [INFO ] [MAIN ] Update Progress: 2320/2372 symbols completed. WRB took 24.0s. Estimated remaining: 6m 55s. Rate: 7.5 symbols/min [2025-09-19T22:08:30.450586] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:08:30.419264] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:08:30.481705] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:08:30.502565] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:08:30.536570] [DEBUG] [LOCAL ] WS: Loaded 24126 existing records from primary storage. [2025-09-19T22:08:30.536832] [INFO ] [MAIN ] WS: Loaded 24126 existing records. [2025-09-19T22:08:30.648329] [DEBUG] [LOCAL ] WSO: Loaded 24862 existing records from primary storage. [2025-09-19T22:08:30.670096] [INFO ] [MAIN ] WSO: Loaded 24862 existing records. [2025-09-19T22:08:30.890127] [DEBUG] [LOCAL ] WSM: Loaded 50456 existing records from primary storage. [2025-09-19T22:08:30.891721] [INFO ] [MAIN ] WSM: Loaded 50456 existing records. [2025-09-19T22:08:30.926394] [DEBUG] [LOCAL ] WRBY: Loaded 51304 existing records from primary storage. [2025-09-19T22:08:30.964683] [INFO ] [MAIN ] WRBY: Loaded 51304 existing records. [2025-09-19T22:08:30.936050] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:08:31.043206] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-19T22:08:31.086146] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-19T22:08:31.206601] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:08:31.232200] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-19T22:08:31.253377] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-19T22:08:31.258736] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-19T22:08:31.276942] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-19T22:08:31.329942] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-19T22:08:31.373081] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-19T22:08:31.367823] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:08:31.531987] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-19T22:08:31.595735] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:08:31.574074] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-19T22:08:31.653487] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-19T22:08:31.671944] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-19T22:08:31.671918] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-19T22:08:31.675013] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-19T22:08:31.699607] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-19T22:08:31.788022] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-19T22:08:32.426817] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:08:32.473457] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-19T22:08:32.746513] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:08:32.766014] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-19T22:08:32.912061] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:08:32.926839] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-19T22:08:32.956354] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:08:32.956920] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-19T22:08:33.656842] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-19T22:08:33.663121] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-19T22:08:34.118158] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-19T22:08:34.122291] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-19T22:08:34.338412] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-19T22:08:34.349057] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-19T22:08:34.448914] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-19T22:08:34.459611] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-19T22:08:34.882958] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-19T22:08:34.887517] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-19T22:08:35.064317] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-19T22:08:35.070183] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-19T22:08:36.298683] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T22:08:36.309852] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-19T22:08:36.399516] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-19T22:08:36.405054] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-19T22:08:36.491970] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T22:08:36.573403] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-19T22:08:36.643228] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-19T22:08:37.443286] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-19T22:08:38.147185] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-19T22:08:38.208781] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-19T22:08:38.243233] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-19T22:08:38.457424] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-19T22:08:38.936383] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T22:08:39.043223] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-19T22:08:39.843299] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-19T22:08:40.297909] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T22:08:40.327076] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-19T22:08:40.643274] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-19T22:08:41.443251] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-19T22:08:41.855024] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-19T22:08:41.974170] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-19T22:08:42.243267] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-19T22:08:42.967722] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-19T22:08:43.043230] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-19T22:08:43.753237] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-19T22:08:43.843275] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-19T22:08:44.643291] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-19T22:08:45.212757] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-19T22:08:45.390566] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-19T22:08:45.443242] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-19T22:08:45.589369] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-19T22:08:46.243285] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-19T22:08:47.043296] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-19T22:08:47.489156] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-19T22:08:47.605125] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-19T22:08:47.843260] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-19T22:08:47.933276] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-19T22:08:48.643341] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-19T22:08:49.286447] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-19T22:08:49.443277] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-19T22:08:50.243285] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-19T22:08:50.634867] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-19T22:08:50.664293] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-19T22:08:51.043305] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-19T22:08:51.843318] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-19T22:08:52.339127] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-19T22:08:52.478165] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-19T22:08:52.483529] [INFO ] [REMOTE ] WSO: Full fetch complete (33691 records). [2025-09-19T22:08:52.483767] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-19T22:08:52.650151] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-19T22:08:52.920487] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-19T22:08:52.920623] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-19T22:08:52.921853] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-19T22:08:52.921935] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-19T22:08:52.923083] [DEBUG] [LOCAL ] WSO: Trimmed 33691 records to 25021 (keeping 200 days of data) [2025-09-19T22:08:53.100669] [DEBUG] [LOCAL ] WSO: Primary data saved (25021 records). [2025-09-19T22:08:53.100878] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-19T22:08:53.100996] [INFO ] [MAIN ] Update Progress: 2321/2372 symbols completed. WSO took 23.3s. Estimated remaining: 6m 47s. Rate: 7.5 symbols/min [2025-09-19T22:08:53.287942] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:08:53.320108] [DEBUG] [LOCAL ] WSR: Loaded 23770 existing records from primary storage. [2025-09-19T22:08:53.320331] [INFO ] [MAIN ] WSR: Loaded 23770 existing records. [2025-09-19T22:08:53.445679] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-19T22:08:53.518756] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:08:53.519730] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-19T22:08:53.519853] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-19T22:08:53.521429] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-19T22:08:53.536372] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-19T22:08:53.538208] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-19T22:08:53.744065] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T22:08:53.972151] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:08:54.243273] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-19T22:08:55.043378] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-19T22:08:55.497198] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-19T22:08:55.537119] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-19T22:08:55.541282] [INFO ] [REMOTE ] WS: Full fetch complete (36119 records). [2025-09-19T22:08:55.541392] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-19T22:08:55.846057] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-19T22:08:55.945469] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-19T22:08:55.945597] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-19T22:08:55.946807] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-19T22:08:55.946898] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-19T22:08:55.948419] [DEBUG] [LOCAL ] WS: Trimmed 36119 records to 24295 (keeping 200 days of data) [2025-09-19T22:08:56.113242] [DEBUG] [LOCAL ] WS: Primary data saved (24295 records). [2025-09-19T22:08:56.113449] [INFO ] [MAIN ] WS: Full history saved. [2025-09-19T22:08:56.113565] [INFO ] [MAIN ] Update Progress: 2322/2372 symbols completed. WS took 26.3s. Estimated remaining: 6m 39s. Rate: 7.5 symbols/min [2025-09-19T22:08:56.291744] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:08:56.339924] [DEBUG] [LOCAL ] WST: Loaded 38269 existing records from primary storage. [2025-09-19T22:08:56.340138] [INFO ] [MAIN ] WST: Loaded 38269 existing records. [2025-09-19T22:08:56.523661] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:08:56.523984] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-19T22:08:56.524036] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-19T22:08:56.525176] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-19T22:08:56.525239] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-19T22:08:56.647259] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-19T22:08:56.901045] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:08:56.944455] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-19T22:08:57.450313] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-19T22:08:57.457241] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-19T22:08:58.049316] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-19T22:08:58.243276] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-19T22:08:59.052735] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-19T22:08:59.054008] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-19T22:08:59.497324] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-19T22:08:59.843252] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-19T22:09:00.643225] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-19T22:09:01.190831] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-19T22:09:01.314839] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-19T22:09:01.443235] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-19T22:09:02.171477] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-19T22:09:02.178666] [INFO ] [REMOTE ] WSM: Full fetch complete (72330 records). [2025-09-19T22:09:02.178916] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-19T22:09:02.248416] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-19T22:09:02.633065] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-19T22:09:02.633316] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-19T22:09:02.634466] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-19T22:09:02.634629] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-19T22:09:02.637871] [DEBUG] [LOCAL ] WSM: Trimmed 72330 records to 50753 (keeping 200 days of data) [2025-09-19T22:09:02.758426] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-19T22:09:02.994335] [DEBUG] [LOCAL ] WSM: Primary data saved (50753 records). [2025-09-19T22:09:02.994492] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-19T22:09:02.994597] [INFO ] [MAIN ] Update Progress: 2323/2372 symbols completed. WSM took 33.2s. Estimated remaining: 6m 31s. Rate: 7.5 symbols/min [2025-09-19T22:09:03.050019] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-19T22:09:03.168915] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:09:03.214704] [DEBUG] [LOCAL ] WT: Loaded 47905 existing records from primary storage. [2025-09-19T22:09:03.214859] [INFO ] [MAIN ] WT: Loaded 47905 existing records. [2025-09-19T22:09:03.396201] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:09:03.396507] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-19T22:09:03.396558] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-19T22:09:03.397618] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-19T22:09:03.397726] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-19T22:09:03.763700] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:09:03.843255] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-19T22:09:04.335416] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-19T22:09:04.643353] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-19T22:09:05.445194] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-19T22:09:05.450515] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-19T22:09:05.743725] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-19T22:09:05.751143] [INFO ] [REMOTE ] WRBY: Full fetch complete (73311 records). [2025-09-19T22:09:05.751278] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-19T22:09:06.164932] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-19T22:09:06.165186] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-19T22:09:06.166342] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-19T22:09:06.166428] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-19T22:09:06.168112] [DEBUG] [LOCAL ] WRBY: Trimmed 73311 records to 51650 (keeping 200 days of data) [2025-09-19T22:09:06.190942] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-19T22:09:06.244975] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-19T22:09:06.393743] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-19T22:09:06.523972] [DEBUG] [LOCAL ] WRBY: Primary data saved (51650 records). [2025-09-19T22:09:06.524114] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-19T22:09:06.524203] [INFO ] [MAIN ] Update Progress: 2324/2372 symbols completed. WRBY took 36.7s. Estimated remaining: 6m 23s. Rate: 7.5 symbols/min [2025-09-19T22:09:06.695785] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:09:06.739010] [DEBUG] [LOCAL ] WTI: Loaded 44095 existing records from primary storage. [2025-09-19T22:09:06.739150] [INFO ] [MAIN ] WTI: Loaded 44095 existing records. [2025-09-19T22:09:06.923387] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:09:06.923702] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-19T22:09:06.923798] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-19T22:09:06.924809] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-19T22:09:06.924869] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-19T22:09:07.048395] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-19T22:09:07.304878] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:09:07.843274] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-19T22:09:08.174139] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-19T22:09:08.584585] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-19T22:09:08.643271] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-19T22:09:09.157931] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-19T22:09:09.443308] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-19T22:09:10.243329] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-19T22:09:10.346582] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T22:09:11.043271] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-19T22:09:11.414479] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-19T22:09:11.843285] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-19T22:09:11.861778] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T22:09:12.643267] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-19T22:09:12.865827] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-19T22:09:13.060490] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-19T22:09:13.443285] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-19T22:09:14.243275] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-19T22:09:14.295585] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-19T22:09:15.043283] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-19T22:09:15.843273] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-19T22:09:16.352351] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-09-19T22:09:16.643338] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-19T22:09:16.760162] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-19T22:09:16.956967] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T22:09:17.443331] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-19T22:09:17.670912] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T22:09:18.104145] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-19T22:09:18.108356] [INFO ] [REMOTE ] WSR: Full fetch complete (32847 records). [2025-09-19T22:09:18.108620] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-19T22:09:18.248384] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-19T22:09:18.502432] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-19T22:09:18.502589] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-19T22:09:18.503296] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-19T22:09:18.503371] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-19T22:09:18.504365] [DEBUG] [LOCAL ] WSR: Trimmed 32847 records to 23914 (keeping 200 days of data) [2025-09-19T22:09:18.653256] [DEBUG] [LOCAL ] WSR: Primary data saved (23914 records). [2025-09-19T22:09:18.653582] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-19T22:09:18.653831] [INFO ] [MAIN ] Update Progress: 2325/2372 symbols completed. WSR took 25.6s. Estimated remaining: 6m 15s. Rate: 7.5 symbols/min [2025-09-19T22:09:18.782422] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T22:09:18.863705] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:09:18.863903] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-19T22:09:18.863940] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-19T22:09:18.864094] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-19T22:09:18.864136] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-19T22:09:18.864176] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-19T22:09:18.864207] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-19T22:09:19.051743] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-19T22:09:19.225247] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:09:19.843288] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-19T22:09:20.101199] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-19T22:09:20.312535] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-19T22:09:20.643310] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-19T22:09:20.918175] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-19T22:09:21.037866] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-19T22:09:21.443294] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-19T22:09:22.243273] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-19T22:09:23.043335] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-19T22:09:23.309691] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-19T22:09:23.843304] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-19T22:09:24.085581] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T22:09:24.212458] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T22:09:24.258959] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-19T22:09:24.643340] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-19T22:09:25.127751] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-19T22:09:25.443307] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-19T22:09:26.243278] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-19T22:09:26.258031] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-19T22:09:27.043276] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-19T22:09:27.750125] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-19T22:09:27.843282] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-19T22:09:28.298445] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-19T22:09:28.643265] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-19T22:09:29.443288] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-19T22:09:29.560956] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-19T22:09:29.767620] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-19T22:09:30.243273] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-19T22:09:30.979155] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-19T22:09:30.984329] [INFO ] [REMOTE ] WST: Full fetch complete (53416 records). [2025-09-19T22:09:30.984433] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-19T22:09:31.050729] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-19T22:09:31.416600] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-19T22:09:31.416847] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-19T22:09:31.418021] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-19T22:09:31.418087] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-19T22:09:31.430284] [DEBUG] [LOCAL ] WST: Trimmed 53416 records to 38506 (keeping 200 days of data) [2025-09-19T22:09:31.449724] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-19T22:09:31.698794] [DEBUG] [LOCAL ] WST: Primary data saved (38506 records). [2025-09-19T22:09:31.698943] [INFO ] [MAIN ] WST: Full history saved. [2025-09-19T22:09:31.699372] [INFO ] [MAIN ] Update Progress: 2326/2372 symbols completed. WST took 35.6s. Estimated remaining: 6m 7s. Rate: 7.5 symbols/min [2025-09-19T22:09:31.858985] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-19T22:09:31.893417] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:09:31.945282] [DEBUG] [LOCAL ] WTRG: Loaded 51341 existing records from primary storage. [2025-09-19T22:09:31.945451] [INFO ] [MAIN ] WTRG: Loaded 51341 existing records. [2025-09-19T22:09:32.132597] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:09:32.132974] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-19T22:09:32.133036] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-19T22:09:32.134269] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-19T22:09:32.134356] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-19T22:09:32.495204] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:09:32.544331] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-19T22:09:32.643267] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-19T22:09:33.078934] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T22:09:33.086826] [INFO ] [REMOTE ] WT: Full fetch complete (69086 records). [2025-09-19T22:09:33.087030] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-19T22:09:33.443264] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-19T22:09:33.480235] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-19T22:09:33.480353] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-19T22:09:33.481467] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-19T22:09:33.481725] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-19T22:09:33.483116] [DEBUG] [LOCAL ] WT: Trimmed 69086 records to 48283 (keeping 200 days of data) [2025-09-19T22:09:33.779078] [DEBUG] [LOCAL ] WT: Primary data saved (48283 records). [2025-09-19T22:09:33.779280] [INFO ] [MAIN ] WT: Full history saved. [2025-09-19T22:09:33.779428] [INFO ] [MAIN ] Update Progress: 2327/2372 symbols completed. WT took 30.8s. Estimated remaining: 5m 59s. Rate: 7.5 symbols/min [2025-09-19T22:09:33.950783] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:09:33.970631] [DEBUG] [LOCAL ] WTS: Loaded 18888 existing records from primary storage. [2025-09-19T22:09:33.970779] [INFO ] [MAIN ] WTS: Loaded 18888 existing records. [2025-09-19T22:09:34.074455] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-19T22:09:34.153620] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:09:34.153865] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-19T22:09:34.153913] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-19T22:09:34.154514] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-19T22:09:34.154573] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-19T22:09:34.248418] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-19T22:09:34.526338] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:09:34.848855] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-19T22:09:34.865270] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-19T22:09:35.043277] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-19T22:09:35.633750] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-19T22:09:35.843229] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-19T22:09:36.471587] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-19T22:09:36.643265] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-19T22:09:37.033463] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-19T22:09:37.034797] [INFO ] [REMOTE ] WTM: Full fetch complete (2146 records). [2025-09-19T22:09:37.034875] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-19T22:09:37.233462] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-19T22:09:37.233740] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-19T22:09:37.233825] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-19T22:09:37.233899] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-19T22:09:37.233964] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-19T22:09:37.234002] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-19T22:09:37.234069] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-19T22:09:37.234150] [INFO ] [MAIN ] Update Progress: 2328/2372 symbols completed. WTM took 18.6s. Estimated remaining: 5m 51s. Rate: 7.5 symbols/min [2025-09-19T22:09:37.426133] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:09:37.443321] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-19T22:09:37.477855] [DEBUG] [LOCAL ] WTTR: Loaded 45470 existing records from primary storage. [2025-09-19T22:09:37.478015] [INFO ] [MAIN ] WTTR: Loaded 45470 existing records. [2025-09-19T22:09:37.675346] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:09:37.675634] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-19T22:09:37.675722] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-19T22:09:37.676711] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-19T22:09:37.676775] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-19T22:09:38.066318] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:09:38.243258] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-19T22:09:39.043267] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-19T22:09:39.343417] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-19T22:09:39.525506] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-19T22:09:39.843254] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-19T22:09:40.276872] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-19T22:09:40.643277] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-19T22:09:41.443293] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-19T22:09:42.020772] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-19T22:09:42.243273] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-19T22:09:42.362391] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-19T22:09:42.913147] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T22:09:43.043281] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-19T22:09:43.852683] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-19T22:09:43.855007] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T22:09:43.861801] [INFO ] [REMOTE ] WTI: Full fetch complete (64132 records). [2025-09-19T22:09:43.861964] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-19T22:09:44.300961] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-19T22:09:44.301049] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-19T22:09:44.302425] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-19T22:09:44.302491] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-19T22:09:44.304072] [DEBUG] [LOCAL ] WTI: Trimmed 64132 records to 44421 (keeping 200 days of data) [2025-09-19T22:09:44.584517] [DEBUG] [LOCAL ] WTI: Primary data saved (44421 records). [2025-09-19T22:09:44.584807] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-19T22:09:44.584931] [INFO ] [MAIN ] Update Progress: 2329/2372 symbols completed. WTI took 38.1s. Estimated remaining: 5m 43s. Rate: 7.5 symbols/min [2025-09-19T22:09:44.654720] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-19T22:09:44.771525] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:09:44.843346] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T22:09:44.855257] [DEBUG] [LOCAL ] WU: Loaded 53835 existing records from primary storage. [2025-09-19T22:09:44.855502] [INFO ] [MAIN ] WU: Loaded 53835 existing records. [2025-09-19T22:09:45.033226] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:09:45.033470] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-19T22:09:45.033521] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-19T22:09:45.034890] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-19T22:09:45.034953] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-19T22:09:45.342744] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-19T22:09:45.430348] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:09:45.443242] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-19T22:09:46.243229] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-19T22:09:46.363682] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-19T22:09:47.043282] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-19T22:09:47.581388] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-19T22:09:47.843254] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-19T22:09:48.198816] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-19T22:09:48.350273] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-19T22:09:48.643280] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-19T22:09:49.308579] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T22:09:49.443312] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-19T22:09:50.243267] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-19T22:09:50.578248] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-19T22:09:50.807427] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-19T22:09:51.043262] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-19T22:09:51.843269] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-19T22:09:52.185881] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T22:09:52.566594] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-19T22:09:52.643265] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-19T22:09:52.881422] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-19T22:09:53.443262] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-19T22:09:54.012255] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-19T22:09:54.243268] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-19T22:09:55.043278] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-19T22:09:55.739127] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-19T22:09:55.843299] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-19T22:09:55.902341] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-19T22:09:56.535930] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T22:09:56.643257] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-19T22:09:57.443253] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-19T22:09:57.688192] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-19T22:09:57.907384] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-19T22:09:58.243267] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-19T22:09:59.043336] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-19T22:09:59.392057] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-19T22:09:59.534807] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-19T22:09:59.843300] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-19T22:10:00.655494] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-19T22:10:00.662530] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-19T22:10:01.443313] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-19T22:10:01.914404] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-19T22:10:02.112454] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-19T22:10:02.243268] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-19T22:10:03.043291] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-19T22:10:03.582126] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-19T22:10:03.627013] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-19T22:10:03.843239] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-19T22:10:04.643316] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-19T22:10:05.231385] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-19T22:10:05.443274] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-19T22:10:05.686808] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T22:10:05.689361] [INFO ] [REMOTE ] WTS: Full fetch complete (26375 records). [2025-09-19T22:10:05.689442] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-19T22:10:06.083605] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-19T22:10:06.083867] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-19T22:10:06.084639] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-19T22:10:06.084876] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-19T22:10:06.086008] [DEBUG] [LOCAL ] WTS: Trimmed 26375 records to 18952 (keeping 200 days of data) [2025-09-19T22:10:06.201972] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-19T22:10:06.243384] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-19T22:10:06.254262] [DEBUG] [LOCAL ] WTS: Primary data saved (18952 records). [2025-09-19T22:10:06.254479] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-19T22:10:06.254636] [INFO ] [MAIN ] Update Progress: 2330/2372 symbols completed. WTS took 32.5s. Estimated remaining: 5m 35s. Rate: 7.5 symbols/min [2025-09-19T22:10:06.444431] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:10:06.498289] [DEBUG] [LOCAL ] WWW: Loaded 49510 existing records from primary storage. [2025-09-19T22:10:06.498471] [INFO ] [MAIN ] WWW: Loaded 49510 existing records. [2025-09-19T22:10:06.697769] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:10:06.698112] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-19T22:10:06.698195] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-19T22:10:06.699347] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-19T22:10:06.699419] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-19T22:10:07.046942] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-19T22:10:07.199659] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:10:07.249607] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-19T22:10:07.843333] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-19T22:10:07.932801] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-19T22:10:07.940212] [INFO ] [REMOTE ] WTTR: Full fetch complete (65569 records). [2025-09-19T22:10:07.940390] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-19T22:10:08.334681] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-19T22:10:08.334776] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-19T22:10:08.335858] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-19T22:10:08.335924] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-19T22:10:08.337364] [DEBUG] [LOCAL ] WTTR: Trimmed 65569 records to 45823 (keeping 200 days of data) [2025-09-19T22:10:08.617758] [DEBUG] [LOCAL ] WTTR: Primary data saved (45823 records). [2025-09-19T22:10:08.617899] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-19T22:10:08.619547] [INFO ] [MAIN ] Update Progress: 2331/2372 symbols completed. WTTR took 31.4s. Estimated remaining: 5m 27s. Rate: 7.5 symbols/min [2025-09-19T22:10:08.650839] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-19T22:10:08.803197] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:10:08.859746] [DEBUG] [LOCAL ] WY: Loaded 53503 existing records from primary storage. [2025-09-19T22:10:08.859925] [INFO ] [MAIN ] WY: Loaded 53503 existing records. [2025-09-19T22:10:09.051955] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:10:09.052419] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-19T22:10:09.052531] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-19T22:10:09.054216] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-19T22:10:09.054375] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-19T22:10:09.363512] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-19T22:10:09.451775] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-19T22:10:09.483839] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:10:09.724846] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-19T22:10:10.248355] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-19T22:10:10.264822] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-19T22:10:11.043333] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-19T22:10:11.604572] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-19T22:10:11.843265] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-19T22:10:12.260263] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T22:10:12.268289] [INFO ] [REMOTE ] WTRG: Full fetch complete (73210 records). [2025-09-19T22:10:12.290378] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-19T22:10:12.292068] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-19T22:10:12.648478] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-19T22:10:12.697826] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-19T22:10:12.697916] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-19T22:10:12.699078] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-19T22:10:12.699141] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-19T22:10:12.700660] [DEBUG] [LOCAL ] WTRG: Trimmed 73210 records to 51709 (keeping 200 days of data) [2025-09-19T22:10:13.025379] [DEBUG] [LOCAL ] WTRG: Primary data saved (51709 records). [2025-09-19T22:10:13.025516] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-19T22:10:13.026447] [INFO ] [MAIN ] Update Progress: 2332/2372 symbols completed. WTRG took 41.3s. Estimated remaining: 5m 19s. Rate: 7.5 symbols/min [2025-09-19T22:10:13.195346] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:10:13.226467] [DEBUG] [LOCAL ] XFLT: Loaded 30172 existing records from primary storage. [2025-09-19T22:10:13.226596] [INFO ] [MAIN ] XFLT: Loaded 30172 existing records. [2025-09-19T22:10:13.402698] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:10:13.402974] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-19T22:10:13.403028] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-19T22:10:13.403742] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-19T22:10:13.403801] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-19T22:10:13.466253] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-19T22:10:13.776149] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:10:13.907884] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-19T22:10:13.918903] [INFO ] [REMOTE ] WU: Full fetch complete (77315 records). [2025-09-19T22:10:13.919039] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-19T22:10:14.250762] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-19T22:10:14.311947] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-19T22:10:14.312025] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-19T22:10:14.313311] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-19T22:10:14.313376] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-19T22:10:14.315077] [DEBUG] [LOCAL ] WU: Trimmed 77315 records to 54225 (keeping 200 days of data) [2025-09-19T22:10:14.578522] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-19T22:10:14.681134] [DEBUG] [LOCAL ] WU: Primary data saved (54225 records). [2025-09-19T22:10:14.681274] [INFO ] [MAIN ] WU: Full history saved. [2025-09-19T22:10:14.681379] [INFO ] [MAIN ] Update Progress: 2333/2372 symbols completed. WU took 30.1s. Estimated remaining: 5m 11s. Rate: 7.5 symbols/min [2025-09-19T22:10:14.849872] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:10:14.893222] [DEBUG] [LOCAL ] XHR: Loaded 44783 existing records from primary storage. [2025-09-19T22:10:14.893390] [INFO ] [MAIN ] XHR: Loaded 44783 existing records. [2025-09-19T22:10:15.046050] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-19T22:10:15.077489] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:10:15.079110] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-19T22:10:15.079178] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-19T22:10:15.080192] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-19T22:10:15.080253] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-19T22:10:15.312157] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-19T22:10:15.506411] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:10:15.843285] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-19T22:10:16.106020] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-19T22:10:16.539553] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-19T22:10:16.643274] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-19T22:10:17.443315] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-19T22:10:17.590524] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-19T22:10:18.243320] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-19T22:10:18.645886] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-19T22:10:19.015764] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T22:10:19.043251] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-19T22:10:19.318315] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-19T22:10:19.843265] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-19T22:10:20.577402] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-19T22:10:20.643253] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-19T22:10:21.443289] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-19T22:10:21.573258] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-19T22:10:21.855790] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-19T22:10:22.243282] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-19T22:10:23.043311] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-19T22:10:23.180845] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-19T22:10:23.843355] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-19T22:10:23.902340] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T22:10:24.384252] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T22:10:24.643265] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-19T22:10:24.838820] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-19T22:10:25.443303] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-19T22:10:26.133466] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T22:10:26.243265] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-19T22:10:27.043329] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-19T22:10:27.379634] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-19T22:10:27.407973] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-19T22:10:27.843267] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-19T22:10:28.643289] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-19T22:10:28.897666] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T22:10:29.156844] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T22:10:29.443271] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-19T22:10:30.243278] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-19T22:10:30.704359] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-19T22:10:30.741008] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-19T22:10:31.043282] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-19T22:10:31.843277] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-19T22:10:32.142114] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-19T22:10:32.643268] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-19T22:10:32.715343] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-19T22:10:33.034583] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-19T22:10:33.443283] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-19T22:10:34.243290] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-19T22:10:34.617368] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-19T22:10:34.641697] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-19T22:10:34.646566] [INFO ] [REMOTE ] XFLT: Full fetch complete (44855 records). [2025-09-19T22:10:34.646751] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-19T22:10:35.050931] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-19T22:10:35.064828] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-19T22:10:35.064907] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-19T22:10:35.065955] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-19T22:10:35.066053] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-19T22:10:35.068545] [DEBUG] [LOCAL ] XFLT: Trimmed 44855 records to 30468 (keeping 200 days of data) [2025-09-19T22:10:35.253477] [DEBUG] [LOCAL ] XFLT: Primary data saved (30468 records). [2025-09-19T22:10:35.253626] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-19T22:10:35.253873] [INFO ] [MAIN ] Update Progress: 2334/2372 symbols completed. XFLT took 22.2s. Estimated remaining: 5m 3s. Rate: 7.5 symbols/min [2025-09-19T22:10:35.434215] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:10:35.434413] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-19T22:10:35.434461] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-19T22:10:35.434619] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-19T22:10:35.434697] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-19T22:10:35.434754] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-19T22:10:35.434817] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-19T22:10:35.830295] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:10:35.843253] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-19T22:10:36.004209] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-19T22:10:36.085136] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:10:36.085483] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-19T22:10:36.643260] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-19T22:10:36.980474] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:10:36.980816] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-19T22:10:37.007338] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T22:10:37.016721] [INFO ] [REMOTE ] WWW: Full fetch complete (69803 records). [2025-09-19T22:10:37.016885] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-19T22:10:37.415734] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-19T22:10:37.415824] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-19T22:10:37.416950] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-19T22:10:37.417013] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-19T22:10:37.423177] [DEBUG] [LOCAL ] WWW: Trimmed 69803 records to 49891 (keeping 200 days of data) [2025-09-19T22:10:37.492793] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-19T22:10:37.741779] [DEBUG] [LOCAL ] WWW: Primary data saved (49891 records). [2025-09-19T22:10:37.741922] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-19T22:10:37.742024] [INFO ] [MAIN ] Update Progress: 2335/2372 symbols completed. WWW took 31.5s. Estimated remaining: 4m 55s. Rate: 7.5 symbols/min [2025-09-19T22:10:37.915290] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:10:37.977017] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-09-19T22:10:37.977185] [INFO ] [MAIN ] XOM: Loaded 54183 existing records. [2025-09-19T22:10:38.152308] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:10:38.152684] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-19T22:10:38.152762] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-19T22:10:38.154283] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-19T22:10:38.154363] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-19T22:10:38.250590] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-19T22:10:38.511126] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:10:38.946306] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-19T22:10:39.043255] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-19T22:10:39.843248] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-19T22:10:40.435349] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-19T22:10:40.643252] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-19T22:10:41.443318] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-19T22:10:41.820943] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-19T22:10:41.921876] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-19T22:10:42.243266] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-19T22:10:42.615795] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-19T22:10:42.733761] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-19T22:10:43.043279] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-19T22:10:43.843271] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-19T22:10:44.643278] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-19T22:10:44.788206] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-19T22:10:45.240553] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T22:10:45.443269] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-19T22:10:46.243289] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-19T22:10:46.474896] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T22:10:47.043292] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-19T22:10:47.367226] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-19T22:10:47.375073] [INFO ] [REMOTE ] XHR: Full fetch complete (61601 records). [2025-09-19T22:10:47.375208] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-19T22:10:47.787944] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-19T22:10:47.807732] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-19T22:10:47.816535] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-19T22:10:47.816693] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-19T22:10:47.823399] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-19T22:10:47.823552] [DEBUG] [LOCAL ] XHR: Trimmed 61601 records to 45098 (keeping 200 days of data) [2025-09-19T22:10:47.843220] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-19T22:10:48.120868] [DEBUG] [LOCAL ] XHR: Primary data saved (45098 records). [2025-09-19T22:10:48.121011] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-19T22:10:48.121110] [INFO ] [MAIN ] Update Progress: 2336/2372 symbols completed. XHR took 33.4s. Estimated remaining: 4m 47s. Rate: 7.5 symbols/min [2025-09-19T22:10:48.294591] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:10:48.330184] [DEBUG] [LOCAL ] XPER: Loaded 29858 existing records from primary storage. [2025-09-19T22:10:48.330332] [INFO ] [MAIN ] XPER: Loaded 29858 existing records. [2025-09-19T22:10:48.515715] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:10:48.516118] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-19T22:10:48.516471] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-19T22:10:48.518004] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-19T22:10:48.518095] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-19T22:10:48.798721] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-19T22:10:48.847020] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-19T22:10:48.926957] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:10:49.443275] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-19T22:10:49.802410] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (7.56 seconds). [2025-09-19T22:10:50.243320] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-19T22:10:50.450685] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-19T22:10:51.043322] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-19T22:10:52.515758] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-19T22:10:52.521981] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-19T22:10:52.645304] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-19T22:10:52.655416] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-19T22:10:53.334341] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (5.49 seconds). [2025-09-19T22:10:53.443217] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-19T22:10:54.598365] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T22:10:54.609443] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-19T22:10:55.420093] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (6.57 seconds). [2025-09-19T22:10:55.429404] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-19T22:10:56.508062] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (3.99 seconds). [2025-09-19T22:10:56.514445] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-19T22:10:57.249006] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-19T22:10:57.258998] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-19T22:10:57.698333] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (4.26 seconds). [2025-09-19T22:10:57.706291] [INFO ] [REMOTE ] WY: Full fetch complete (76804 records). [2025-09-19T22:10:57.706436] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-19T22:10:58.120322] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-19T22:10:58.120485] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-19T22:10:58.121887] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-19T22:10:58.121972] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-19T22:10:58.201261] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-19T22:10:58.208687] [DEBUG] [LOCAL ] WY: Trimmed 76804 records to 53892 (keeping 200 days of data) [2025-09-19T22:10:58.209353] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-19T22:10:58.573713] [DEBUG] [LOCAL ] WY: Primary data saved (53892 records). [2025-09-19T22:10:58.573863] [INFO ] [MAIN ] WY: Full history saved. [2025-09-19T22:10:58.575034] [INFO ] [MAIN ] Update Progress: 2337/2372 symbols completed. WY took 50.0s. Estimated remaining: 4m 39s. Rate: 7.5 symbols/min [2025-09-19T22:10:58.749263] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:10:58.818010] [DEBUG] [LOCAL ] XPEV: Loaded 54033 existing records from primary storage. [2025-09-19T22:10:58.818157] [INFO ] [MAIN ] XPEV: Loaded 54033 existing records. [2025-09-19T22:10:59.047947] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (4.44 seconds). [2025-09-19T22:10:59.045366] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:10:59.060103] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-19T22:10:59.060485] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-19T22:10:59.061731] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-19T22:10:59.071485] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-19T22:10:59.077797] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-19T22:10:59.170073] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T22:10:59.211980] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-19T22:10:59.456947] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:10:59.504141] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-19T22:10:59.843345] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-19T22:11:00.643356] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-19T22:11:01.044097] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-19T22:11:01.051236] [INFO ] [REMOTE ] XIFR: Full fetch complete (53568 records). [2025-09-19T22:11:01.051410] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-19T22:11:01.248351] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 159 unique days, need 200 days [2025-09-19T22:11:01.249018] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-19T22:11:01.249093] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-19T22:11:01.249167] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-19T22:11:01.249234] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-19T22:11:01.249273] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-19T22:11:01.249329] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-19T22:11:01.249416] [INFO ] [MAIN ] Update Progress: 2338/2372 symbols completed. XIFR took 26.0s. Estimated remaining: 4m 31s. Rate: 7.5 symbols/min [2025-09-19T22:11:01.428418] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:11:01.449558] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-19T22:11:01.456475] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-19T22:11:01.506968] [DEBUG] [LOCAL ] XPO: Loaded 48679 existing records from primary storage. [2025-09-19T22:11:01.507160] [INFO ] [MAIN ] XPO: Loaded 48679 existing records. [2025-09-19T22:11:01.703889] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:11:01.704453] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-19T22:11:01.704669] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-19T22:11:01.705885] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-19T22:11:01.705954] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-19T22:11:02.071064] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-09-19T22:11:02.151325] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:11:02.243284] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-19T22:11:02.829726] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-19T22:11:03.043296] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-19T22:11:03.080850] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-19T22:11:03.843337] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-19T22:11:04.475448] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-19T22:11:04.601022] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-19T22:11:04.643217] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-19T22:11:05.443291] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-19T22:11:05.764285] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-19T22:11:06.243272] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-19T22:11:06.448987] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-19T22:11:07.043270] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-19T22:11:07.743455] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-19T22:11:07.843217] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-19T22:11:08.458778] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-19T22:11:08.600271] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-19T22:11:08.643219] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-19T22:11:09.443342] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-19T22:11:09.892389] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-19T22:11:10.243349] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-19T22:11:11.043281] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-19T22:11:11.342325] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-19T22:11:11.351202] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-09-19T22:11:11.351454] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-19T22:11:11.483340] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-19T22:11:11.805759] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-19T22:11:11.829301] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-19T22:11:11.837434] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-19T22:11:11.838886] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-19T22:11:11.839480] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-19T22:11:11.859198] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 54573 (keeping 200 days of data) [2025-09-19T22:11:11.852520] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-19T22:11:11.878172] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (3.23 seconds). [2025-09-19T22:11:12.239971] [DEBUG] [LOCAL ] XOM: Primary data saved (54573 records). [2025-09-19T22:11:12.240123] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-19T22:11:12.240275] [INFO ] [MAIN ] Update Progress: 2339/2372 symbols completed. XOM took 34.5s. Estimated remaining: 4m 23s. Rate: 7.5 symbols/min [2025-09-19T22:11:12.408276] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:11:12.450557] [DEBUG] [LOCAL ] XPOF: Loaded 39147 existing records from primary storage. [2025-09-19T22:11:12.450766] [INFO ] [MAIN ] XPOF: Loaded 39147 existing records. [2025-09-19T22:11:12.628111] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:11:12.628399] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-19T22:11:12.628467] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-19T22:11:12.629478] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-19T22:11:12.629540] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-19T22:11:12.649821] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-19T22:11:12.990200] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:11:13.002817] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T22:11:13.007578] [INFO ] [REMOTE ] XPER: Full fetch complete (43226 records). [2025-09-19T22:11:13.007691] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-19T22:11:13.402796] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-19T22:11:13.402876] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-19T22:11:13.403730] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-19T22:11:13.403792] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-19T22:11:13.404735] [DEBUG] [LOCAL ] XPER: Trimmed 43226 records to 30079 (keeping 200 days of data) [2025-09-19T22:11:13.449476] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-19T22:11:13.571706] [DEBUG] [LOCAL ] XPER: Primary data saved (30079 records). [2025-09-19T22:11:13.571840] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-19T22:11:13.571925] [INFO ] [MAIN ] Update Progress: 2340/2372 symbols completed. XPER took 25.5s. Estimated remaining: 4m 15s. Rate: 7.5 symbols/min [2025-09-19T22:11:13.741139] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:11:13.788216] [DEBUG] [LOCAL ] XPRO: Loaded 46557 existing records from primary storage. [2025-09-19T22:11:13.788394] [INFO ] [MAIN ] XPRO: Loaded 46557 existing records. [2025-09-19T22:11:13.964808] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:11:13.965081] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-19T22:11:13.965129] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-19T22:11:13.966062] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-19T22:11:13.966122] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-19T22:11:14.248568] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-19T22:11:14.338836] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:11:14.806954] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T22:11:15.043266] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-19T22:11:15.105818] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-19T22:11:15.419714] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-19T22:11:15.843322] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-19T22:11:16.377696] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-19T22:11:16.643275] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-19T22:11:17.427111] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-19T22:11:17.443211] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-19T22:11:18.243282] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-19T22:11:18.741076] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-19T22:11:18.802753] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-19T22:11:19.043274] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-19T22:11:19.843308] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-19T22:11:20.322706] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-19T22:11:20.488267] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-19T22:11:20.643259] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-19T22:11:21.443291] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-19T22:11:21.979682] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-19T22:11:22.243262] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-19T22:11:22.363394] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-19T22:11:22.498512] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-19T22:11:23.043298] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-19T22:11:23.843269] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-19T22:11:24.643275] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-19T22:11:24.839581] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-19T22:11:24.878418] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-19T22:11:25.443278] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-19T22:11:25.955501] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T22:11:26.243265] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-19T22:11:26.357415] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-19T22:11:27.043282] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-19T22:11:27.452560] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-19T22:11:27.843292] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-19T22:11:28.248619] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-19T22:11:28.542686] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-19T22:11:28.643264] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-19T22:11:29.443313] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-19T22:11:30.013577] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-19T22:11:30.243260] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-19T22:11:30.381362] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T22:11:31.043343] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-19T22:11:31.408683] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-19T22:11:31.843258] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-19T22:11:32.217904] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-19T22:11:32.643271] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-19T22:11:33.306356] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-19T22:11:33.443287] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-19T22:11:33.567295] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-19T22:11:33.575376] [INFO ] [REMOTE ] XPEV: Full fetch complete (77682 records). [2025-09-19T22:11:33.575523] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-19T22:11:33.970624] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-19T22:11:33.970743] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-19T22:11:33.971947] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-19T22:11:33.972012] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-19T22:11:33.973545] [DEBUG] [LOCAL ] XPEV: Trimmed 77682 records to 54422 (keeping 200 days of data) [2025-09-19T22:11:34.274834] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-19T22:11:34.331728] [DEBUG] [LOCAL ] XPEV: Primary data saved (54422 records). [2025-09-19T22:11:34.331887] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-19T22:11:34.332884] [INFO ] [MAIN ] Update Progress: 2341/2372 symbols completed. XPEV took 35.8s. Estimated remaining: 4m 7s. Rate: 7.5 symbols/min [2025-09-19T22:11:34.503191] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:11:34.533770] [DEBUG] [LOCAL ] XYF: Loaded 27857 existing records from primary storage. [2025-09-19T22:11:34.533911] [INFO ] [MAIN ] XYF: Loaded 27857 existing records. [2025-09-19T22:11:34.717534] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:11:34.717894] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-19T22:11:34.717963] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-19T22:11:34.718777] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-19T22:11:34.718840] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-19T22:11:35.119523] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-19T22:11:35.179873] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-19T22:11:35.182233] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-19T22:11:35.178883] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:11:35.439590] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-19T22:11:35.843262] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-19T22:11:36.600518] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-19T22:11:36.643298] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-19T22:11:37.026004] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-19T22:11:37.036103] [INFO ] [REMOTE ] XPO: Full fetch complete (70244 records). [2025-09-19T22:11:37.036260] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-19T22:11:37.430700] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-19T22:11:37.430816] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-19T22:11:37.432086] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-19T22:11:37.432175] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-19T22:11:37.433905] [DEBUG] [LOCAL ] XPO: Trimmed 70244 records to 48980 (keeping 200 days of data) [2025-09-19T22:11:37.485584] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-19T22:11:37.673022] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-19T22:11:37.749994] [DEBUG] [LOCAL ] XPO: Primary data saved (48980 records). [2025-09-19T22:11:37.750135] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-19T22:11:37.750506] [INFO ] [MAIN ] Update Progress: 2342/2372 symbols completed. XPO took 36.5s. Estimated remaining: 3m 59s. Rate: 7.5 symbols/min [2025-09-19T22:11:37.919512] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:11:37.969092] [DEBUG] [LOCAL ] XYL: Loaded 48586 existing records from primary storage. [2025-09-19T22:11:37.969236] [INFO ] [MAIN ] XYL: Loaded 48586 existing records. [2025-09-19T22:11:38.145450] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:11:38.145734] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-19T22:11:38.145789] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-19T22:11:38.146937] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-19T22:11:38.146997] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-19T22:11:38.248519] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-19T22:11:38.515961] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:11:39.043265] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-19T22:11:39.408409] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-19T22:11:39.843235] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-19T22:11:39.859333] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-19T22:11:39.864736] [INFO ] [REMOTE ] XPOF: Full fetch complete (52153 records). [2025-09-19T22:11:39.864844] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-19T22:11:40.250120] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-19T22:11:40.250209] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-19T22:11:40.251349] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-19T22:11:40.251496] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-19T22:11:40.260357] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T22:11:40.263787] [DEBUG] [LOCAL ] XPOF: Trimmed 52153 records to 39424 (keeping 200 days of data) [2025-09-19T22:11:40.491011] [DEBUG] [LOCAL ] XPOF: Primary data saved (39424 records). [2025-09-19T22:11:40.491244] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-19T22:11:40.491376] [INFO ] [MAIN ] Update Progress: 2343/2372 symbols completed. XPOF took 28.3s. Estimated remaining: 3m 51s. Rate: 7.5 symbols/min [2025-09-19T22:11:40.665434] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-19T22:11:40.669686] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:11:40.670932] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-19T22:11:40.670992] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-19T22:11:40.671147] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-19T22:11:40.671190] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-19T22:11:40.671232] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-19T22:11:40.671264] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-19T22:11:41.035908] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:11:41.443308] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-19T22:11:41.685636] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-19T22:11:42.044187] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-19T22:11:42.243296] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-19T22:11:42.476919] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-19T22:11:42.477272] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-19T22:11:43.023881] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-19T22:11:43.043213] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-19T22:11:43.843270] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-19T22:11:44.643330] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-19T22:11:44.940466] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T22:11:45.276989] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-19T22:11:45.443264] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-19T22:11:45.796526] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-19T22:11:45.803384] [INFO ] [REMOTE ] XPRO: Full fetch complete (66767 records). [2025-09-19T22:11:45.803503] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-19T22:11:46.201594] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-19T22:11:46.201720] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-19T22:11:46.202825] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-19T22:11:46.202891] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-19T22:11:46.204405] [DEBUG] [LOCAL ] XPRO: Trimmed 66767 records to 46874 (keeping 200 days of data) [2025-09-19T22:11:46.251412] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-19T22:11:46.482935] [DEBUG] [LOCAL ] XPRO: Primary data saved (46874 records). [2025-09-19T22:11:46.483141] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-19T22:11:46.483293] [INFO ] [MAIN ] Update Progress: 2344/2372 symbols completed. XPRO took 32.9s. Estimated remaining: 3m 43s. Rate: 7.5 symbols/min [2025-09-19T22:11:46.670137] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:11:46.706075] [DEBUG] [LOCAL ] YALA: Loaded 37536 existing records from primary storage. [2025-09-19T22:11:46.706226] [INFO ] [MAIN ] YALA: Loaded 37536 existing records. [2025-09-19T22:11:46.899948] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:11:46.900244] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-19T22:11:46.900305] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-19T22:11:46.901146] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-19T22:11:46.901220] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-19T22:11:47.052406] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-19T22:11:47.299075] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:11:47.330211] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-19T22:11:47.775110] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-19T22:11:47.843226] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-19T22:11:48.041470] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-19T22:11:48.643279] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-19T22:11:49.443339] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-19T22:11:50.245757] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-19T22:11:50.254460] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-19T22:11:50.320282] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-19T22:11:51.043875] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-19T22:11:51.049500] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T22:11:51.569722] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-19T22:11:51.843308] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-19T22:11:52.648698] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-19T22:11:52.668144] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-19T22:11:52.688384] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-19T22:11:53.443338] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-19T22:11:54.243310] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-19T22:11:54.639469] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-19T22:11:55.043252] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-19T22:11:55.199984] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-19T22:11:55.794833] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-19T22:11:55.843211] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-19T22:11:56.105493] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-19T22:11:56.643278] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-19T22:11:57.188209] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-19T22:11:57.191939] [INFO ] [REMOTE ] XYF: Full fetch complete (31184 records). [2025-09-19T22:11:57.192096] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-19T22:11:57.450445] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-19T22:11:57.568488] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-19T22:11:57.568603] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-19T22:11:57.569384] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-19T22:11:57.569440] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-19T22:11:57.570417] [DEBUG] [LOCAL ] XYF: Trimmed 31184 records to 28022 (keeping 200 days of data) [2025-09-19T22:11:57.733491] [DEBUG] [LOCAL ] XYF: Primary data saved (28022 records). [2025-09-19T22:11:57.733625] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-19T22:11:57.733757] [INFO ] [MAIN ] Update Progress: 2345/2372 symbols completed. XYF took 23.4s. Estimated remaining: 3m 35s. Rate: 7.5 symbols/min [2025-09-19T22:11:57.903800] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:11:57.947534] [DEBUG] [LOCAL ] YELP: Loaded 45701 existing records from primary storage. [2025-09-19T22:11:57.947698] [INFO ] [MAIN ] YELP: Loaded 45701 existing records. [2025-09-19T22:11:58.125676] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:11:58.125980] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-19T22:11:58.126038] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-19T22:11:58.126992] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-19T22:11:58.127054] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-19T22:11:58.248333] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-19T22:11:58.494281] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:11:58.521751] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-19T22:11:59.043295] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-19T22:11:59.563328] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-19T22:11:59.843307] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-19T22:12:00.643280] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-19T22:12:00.941568] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-19T22:12:01.059185] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-19T22:12:01.443279] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-19T22:12:01.624182] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-19T22:12:02.243266] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-19T22:12:02.754018] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-19T22:12:03.043306] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-19T22:12:03.843273] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-19T22:12:04.817756] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-19T22:12:04.827120] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-19T22:12:05.390283] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (3.95 seconds). [2025-09-19T22:12:05.443218] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-19T22:12:05.643431] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-19T22:12:05.836482] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-09-19T22:12:05.898912] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-19T22:12:06.243296] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-19T22:12:07.043284] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-19T22:12:07.843261] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-19T22:12:07.962348] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-19T22:12:08.006463] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-19T22:12:08.443542] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-19T22:12:08.643263] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-19T22:12:09.202077] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-19T22:12:09.443270] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-19T22:12:10.243255] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-19T22:12:10.505970] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-19T22:12:11.043311] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-19T22:12:11.843339] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-19T22:12:12.053906] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T22:12:12.189092] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-19T22:12:12.416220] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-19T22:12:12.424019] [INFO ] [REMOTE ] XYL: Full fetch complete (69942 records). [2025-09-19T22:12:12.424146] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-19T22:12:12.653717] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-19T22:12:12.868863] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-19T22:12:12.869018] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-19T22:12:12.870203] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-19T22:12:12.870316] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-19T22:12:12.892091] [DEBUG] [LOCAL ] XYL: Trimmed 69942 records to 48923 (keeping 200 days of data) [2025-09-19T22:12:12.892819] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-19T22:12:13.205555] [DEBUG] [LOCAL ] XYL: Primary data saved (48923 records). [2025-09-19T22:12:13.205726] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-19T22:12:13.206884] [INFO ] [MAIN ] Update Progress: 2346/2372 symbols completed. XYL took 35.5s. Estimated remaining: 3m 28s. Rate: 7.5 symbols/min [2025-09-19T22:12:13.373162] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:12:13.424544] [DEBUG] [LOCAL ] YETI: Loaded 52894 existing records from primary storage. [2025-09-19T22:12:13.424719] [INFO ] [MAIN ] YETI: Loaded 52894 existing records. [2025-09-19T22:12:13.455068] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-19T22:12:13.605261] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:12:13.605506] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-19T22:12:13.605555] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-19T22:12:13.606764] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-19T22:12:13.606826] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-19T22:12:13.993931] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:12:14.243272] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-19T22:12:14.785882] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-19T22:12:15.043273] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-19T22:12:15.338831] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-19T22:12:15.343606] [INFO ] [REMOTE ] YALA: Full fetch complete (46627 records). [2025-09-19T22:12:15.343736] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-19T22:12:15.719674] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-19T22:12:15.719772] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-19T22:12:15.720712] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-19T22:12:15.720775] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-19T22:12:15.721934] [DEBUG] [LOCAL ] YALA: Trimmed 46627 records to 37704 (keeping 200 days of data) [2025-09-19T22:12:15.876939] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-19T22:12:15.937715] [DEBUG] [LOCAL ] YALA: Primary data saved (37704 records). [2025-09-19T22:12:15.937839] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-19T22:12:15.937939] [INFO ] [MAIN ] Update Progress: 2347/2372 symbols completed. YALA took 29.5s. Estimated remaining: 3m 20s. Rate: 7.5 symbols/min [2025-09-19T22:12:16.116224] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:12:16.159704] [DEBUG] [LOCAL ] YEXT: Loaded 43747 existing records from primary storage. [2025-09-19T22:12:16.159876] [INFO ] [MAIN ] YEXT: Loaded 43747 existing records. [2025-09-19T22:12:16.340255] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:12:16.340520] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-19T22:12:16.340575] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-19T22:12:16.341477] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-19T22:12:16.341540] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-19T22:12:16.703698] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:12:16.704025] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-19T22:12:16.873625] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-19T22:12:17.143011] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-19T22:12:17.443323] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-19T22:12:18.243298] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-19T22:12:18.560926] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-19T22:12:18.726463] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-19T22:12:19.043294] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-19T22:12:19.184127] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T22:12:19.434894] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-19T22:12:19.442704] [INFO ] [REMOTE ] XYZ: Full fetch complete (65447 records). [2025-09-19T22:12:19.442822] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-19T22:12:19.639277] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-19T22:12:19.639945] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-19T22:12:19.640019] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-19T22:12:19.640091] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-19T22:12:19.640169] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-19T22:12:19.640232] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-19T22:12:19.640320] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-19T22:12:19.640426] [INFO ] [MAIN ] Update Progress: 2348/2372 symbols completed. XYZ took 39.1s. Estimated remaining: 3m 12s. Rate: 7.5 symbols/min [2025-09-19T22:12:19.810675] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:12:19.846953] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-19T22:12:19.870798] [DEBUG] [LOCAL ] YMM: Loaded 53095 existing records from primary storage. [2025-09-19T22:12:19.870936] [INFO ] [MAIN ] YMM: Loaded 53095 existing records. [2025-09-19T22:12:20.049620] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:12:20.049898] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-19T22:12:20.049954] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-19T22:12:20.051089] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-19T22:12:20.051149] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-19T22:12:20.418724] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:12:20.450976] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-19T22:12:20.643271] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-19T22:12:21.443296] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-19T22:12:21.801035] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-19T22:12:22.134716] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-19T22:12:22.243249] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-19T22:12:22.812627] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-19T22:12:23.043295] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-19T22:12:23.534222] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-19T22:12:23.843252] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-19T22:12:24.643268] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-19T22:12:24.748273] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-19T22:12:25.443228] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-19T22:12:25.556400] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T22:12:26.243280] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-19T22:12:27.048389] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-19T22:12:27.066858] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-19T22:12:27.620356] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-19T22:12:27.843262] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-19T22:12:28.124137] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-19T22:12:28.218385] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-19T22:12:28.226187] [INFO ] [REMOTE ] YELP: Full fetch complete (64169 records). [2025-09-19T22:12:28.226360] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-19T22:12:28.626730] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-19T22:12:28.626862] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-19T22:12:28.629033] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-19T22:12:28.629199] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-19T22:12:28.633750] [DEBUG] [LOCAL ] YELP: Trimmed 64169 records to 46049 (keeping 200 days of data) [2025-09-19T22:12:28.643272] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-19T22:12:28.928022] [DEBUG] [LOCAL ] YELP: Primary data saved (46049 records). [2025-09-19T22:12:28.928180] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-19T22:12:28.929661] [INFO ] [MAIN ] Update Progress: 2349/2372 symbols completed. YELP took 31.2s. Estimated remaining: 3m 4s. Rate: 7.5 symbols/min [2025-09-19T22:12:29.100982] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:12:29.158327] [DEBUG] [LOCAL ] YOU: Loaded 50326 existing records from primary storage. [2025-09-19T22:12:29.158500] [INFO ] [MAIN ] YOU: Loaded 50326 existing records. [2025-09-19T22:12:29.346112] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:12:29.346552] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-19T22:12:29.346621] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-19T22:12:29.347946] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-19T22:12:29.348112] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-19T22:12:29.448346] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-19T22:12:29.670289] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-19T22:12:29.763191] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:12:29.792793] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-19T22:12:30.243282] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-19T22:12:31.043291] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-19T22:12:31.672750] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T22:12:31.843310] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-19T22:12:32.643354] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-19T22:12:32.868676] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-19T22:12:32.932661] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-19T22:12:33.018333] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T22:12:33.443330] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-19T22:12:34.057487] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-19T22:12:34.243290] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-19T22:12:35.043278] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-19T22:12:35.297565] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-19T22:12:35.843263] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-19T22:12:36.144065] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-19T22:12:36.643257] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-19T22:12:36.723353] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-19T22:12:37.443320] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-19T22:12:37.690151] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-19T22:12:38.243309] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-19T22:12:38.308234] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-19T22:12:39.043271] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-19T22:12:39.389016] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-19T22:12:39.843255] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-19T22:12:40.061392] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T22:12:40.643276] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-19T22:12:41.155755] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-19T22:12:41.443287] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-19T22:12:41.990228] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T22:12:42.243264] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-19T22:12:42.425449] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-19T22:12:42.434032] [INFO ] [REMOTE ] YEXT: Full fetch complete (63520 records). [2025-09-19T22:12:42.434173] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-19T22:12:42.831506] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-19T22:12:42.831701] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-19T22:12:42.832798] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-19T22:12:42.832864] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-19T22:12:42.834293] [DEBUG] [LOCAL ] YEXT: Trimmed 63520 records to 44073 (keeping 200 days of data) [2025-09-19T22:12:43.043753] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-19T22:12:43.102614] [DEBUG] [LOCAL ] YEXT: Primary data saved (44073 records). [2025-09-19T22:12:43.102780] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-19T22:12:43.102891] [INFO ] [MAIN ] Update Progress: 2350/2372 symbols completed. YEXT took 27.2s. Estimated remaining: 2m 56s. Rate: 7.5 symbols/min [2025-09-19T22:12:43.277446] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:12:43.332337] [DEBUG] [LOCAL ] YPF: Loaded 50842 existing records from primary storage. [2025-09-19T22:12:43.332512] [INFO ] [MAIN ] YPF: Loaded 50842 existing records. [2025-09-19T22:12:43.533855] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:12:43.534515] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-19T22:12:43.534597] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-19T22:12:43.535856] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-19T22:12:43.535919] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-19T22:12:43.881194] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-19T22:12:43.941372] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-19T22:12:43.971266] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:12:44.007844] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-19T22:12:44.643252] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-19T22:12:45.236612] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-19T22:12:45.443288] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-19T22:12:45.564245] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-19T22:12:46.248444] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-19T22:12:46.278882] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-19T22:12:46.861156] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-19T22:12:47.043327] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-19T22:12:47.579781] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-19T22:12:47.843283] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-19T22:12:48.643272] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-19T22:12:49.069364] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-19T22:12:49.148468] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T22:12:49.443280] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-19T22:12:49.962022] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-19T22:12:49.974527] [INFO ] [REMOTE ] YMM: Full fetch complete (76460 records). [2025-09-19T22:12:49.975519] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-19T22:12:50.248460] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-19T22:12:50.372343] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-19T22:12:50.372446] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-19T22:12:50.373592] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-19T22:12:50.373678] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-19T22:12:50.375510] [DEBUG] [LOCAL ] YMM: Trimmed 76460 records to 53484 (keeping 200 days of data) [2025-09-19T22:12:50.711158] [DEBUG] [LOCAL ] YMM: Primary data saved (53484 records). [2025-09-19T22:12:50.711312] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-19T22:12:50.711401] [INFO ] [MAIN ] Update Progress: 2351/2372 symbols completed. YMM took 31.1s. Estimated remaining: 2m 48s. Rate: 7.5 symbols/min [2025-09-19T22:12:50.884355] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:12:50.898248] [DEBUG] [LOCAL ] YRD: Loaded 12743 existing records from primary storage. [2025-09-19T22:12:50.898421] [INFO ] [MAIN ] YRD: Loaded 12743 existing records. [2025-09-19T22:12:51.046180] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-19T22:12:51.087747] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:12:51.088059] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-19T22:12:51.088107] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-19T22:12:51.088723] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-19T22:12:51.088783] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-19T22:12:51.228426] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-19T22:12:51.485009] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:12:51.838977] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-19T22:12:51.849329] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-19T22:12:52.643316] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-19T22:12:52.837871] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-19T22:12:52.846044] [INFO ] [REMOTE ] YETI: Full fetch complete (75411 records). [2025-09-19T22:12:52.846207] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-19T22:12:53.260176] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-19T22:12:53.260273] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-19T22:12:53.261709] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-19T22:12:53.261791] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-19T22:12:53.263491] [DEBUG] [LOCAL ] YETI: Trimmed 75411 records to 53251 (keeping 200 days of data) [2025-09-19T22:12:53.391202] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-19T22:12:53.470260] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-19T22:12:53.629135] [DEBUG] [LOCAL ] YETI: Primary data saved (53251 records). [2025-09-19T22:12:53.629298] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-19T22:12:53.629788] [INFO ] [MAIN ] Update Progress: 2352/2372 symbols completed. YETI took 40.4s. Estimated remaining: 2m 40s. Rate: 7.5 symbols/min [2025-09-19T22:12:53.823553] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:12:53.856093] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-19T22:12:53.887080] [DEBUG] [LOCAL ] YSG: Loaded 24787 existing records from primary storage. [2025-09-19T22:12:53.887236] [INFO ] [MAIN ] YSG: Loaded 24787 existing records. [2025-09-19T22:12:54.069502] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:12:54.069803] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-19T22:12:54.069857] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-19T22:12:54.070763] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-19T22:12:54.070830] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-19T22:12:54.259998] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-19T22:12:54.479236] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:12:54.571396] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-19T22:12:55.043285] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-19T22:12:55.843262] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-19T22:12:56.421225] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-19T22:12:56.585453] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T22:12:56.643210] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-19T22:12:57.366242] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-19T22:12:57.443227] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-19T22:12:57.773725] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-19T22:12:58.243258] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-19T22:12:58.627141] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-19T22:12:59.043262] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-19T22:12:59.843271] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-19T22:13:00.008147] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-19T22:13:00.016885] [INFO ] [REMOTE ] YOU: Full fetch complete (72227 records). [2025-09-19T22:13:00.017005] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-19T22:13:00.417755] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-19T22:13:00.417948] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-19T22:13:00.419132] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-19T22:13:00.424432] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-19T22:13:00.431972] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-19T22:13:00.437233] [DEBUG] [LOCAL ] YOU: Trimmed 72227 records to 50675 (keeping 200 days of data) [2025-09-19T22:13:00.649811] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-19T22:13:00.751529] [DEBUG] [LOCAL ] YOU: Primary data saved (50675 records). [2025-09-19T22:13:00.751710] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-19T22:13:00.752666] [INFO ] [MAIN ] Update Progress: 2353/2372 symbols completed. YOU took 31.8s. Estimated remaining: 2m 32s. Rate: 7.5 symbols/min [2025-09-19T22:13:00.880820] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-19T22:13:00.937824] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:13:00.992827] [DEBUG] [LOCAL ] YUM: Loaded 51701 existing records from primary storage. [2025-09-19T22:13:00.993003] [INFO ] [MAIN ] YUM: Loaded 51701 existing records. [2025-09-19T22:13:01.179731] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:13:01.180162] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-19T22:13:01.180243] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-19T22:13:01.181490] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-19T22:13:01.181550] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-19T22:13:01.448435] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-19T22:13:01.589050] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:13:02.243274] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-19T22:13:02.782419] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-19T22:13:02.873718] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-19T22:13:03.043246] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-19T22:13:03.467490] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-19T22:13:03.843307] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-19T22:13:04.643322] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-19T22:13:04.992467] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-19T22:13:05.016091] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-19T22:13:05.247889] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-19T22:13:05.443293] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-19T22:13:06.243290] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-19T22:13:06.436214] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-19T22:13:07.043438] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-19T22:13:07.108226] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-19T22:13:07.843265] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-19T22:13:08.643320] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-19T22:13:08.782244] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-19T22:13:09.228349] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-19T22:13:09.443257] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-19T22:13:10.192716] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-19T22:13:10.243290] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-19T22:13:10.811185] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-19T22:13:11.043327] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-19T22:13:11.431218] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-19T22:13:11.843292] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-19T22:13:12.618188] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-19T22:13:12.643256] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-19T22:13:13.443303] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-19T22:13:13.721024] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-19T22:13:14.103972] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-19T22:13:14.243289] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-19T22:13:15.043309] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-19T22:13:15.114993] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-19T22:13:15.119132] [INFO ] [REMOTE ] YSG: Full fetch complete (32908 records). [2025-09-19T22:13:15.119214] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-19T22:13:15.535182] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-19T22:13:15.535524] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-19T22:13:15.536351] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-19T22:13:15.536446] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-19T22:13:15.537756] [DEBUG] [LOCAL ] YSG: Trimmed 32908 records to 24955 (keeping 200 days of data) [2025-09-19T22:13:15.657273] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-19T22:13:15.728108] [DEBUG] [LOCAL ] YSG: Primary data saved (24955 records). [2025-09-19T22:13:15.728276] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-19T22:13:15.728379] [INFO ] [MAIN ] Update Progress: 2354/2372 symbols completed. YSG took 22.1s. Estimated remaining: 2m 24s. Rate: 7.5 symbols/min [2025-09-19T22:13:15.848453] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-19T22:13:15.908056] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:13:15.961904] [DEBUG] [LOCAL ] YUMC: Loaded 53118 existing records from primary storage. [2025-09-19T22:13:15.962099] [INFO ] [MAIN ] YUMC: Loaded 53118 existing records. [2025-09-19T22:13:16.083411] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-19T22:13:16.115510] [INFO ] [REMOTE ] YRD: Full fetch complete (19437 records). [2025-09-19T22:13:16.137286] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-19T22:13:16.158456] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:13:16.230295] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-19T22:13:16.247753] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-19T22:13:16.277673] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-19T22:13:16.293227] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-19T22:13:16.648101] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-19T22:13:16.840668] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-19T22:13:16.851295] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-19T22:13:16.862559] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-19T22:13:16.862667] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-19T22:13:16.884888] [DEBUG] [LOCAL ] YRD: Trimmed 19437 records to 12830 (keeping 200 days of data) [2025-09-19T22:13:16.975262] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:13:17.022296] [DEBUG] [LOCAL ] YRD: Primary data saved (12830 records). [2025-09-19T22:13:17.022470] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-19T22:13:17.022568] [INFO ] [MAIN ] Update Progress: 2355/2372 symbols completed. YRD took 26.3s. Estimated remaining: 2m 16s. Rate: 7.5 symbols/min [2025-09-19T22:13:17.189496] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:13:17.243595] [DEBUG] [LOCAL ] ZBH: Loaded 51591 existing records from primary storage. [2025-09-19T22:13:17.243806] [INFO ] [MAIN ] ZBH: Loaded 51591 existing records. [2025-09-19T22:13:17.433835] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:13:17.434169] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-19T22:13:17.434225] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-19T22:13:17.435462] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-19T22:13:17.435538] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-19T22:13:17.468975] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-19T22:13:17.815770] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:13:17.846690] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T22:13:18.243254] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-19T22:13:18.973271] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-19T22:13:19.043280] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-19T22:13:19.456716] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-19T22:13:19.843278] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-19T22:13:20.149882] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-19T22:13:20.643303] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-19T22:13:21.195228] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-19T22:13:21.380074] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-19T22:13:21.443215] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-19T22:13:22.206113] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-19T22:13:22.243261] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-19T22:13:22.942263] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-19T22:13:23.043234] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-19T22:13:23.666671] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T22:13:23.843253] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-19T22:13:24.643268] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-19T22:13:24.892361] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-19T22:13:25.443319] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-19T22:13:26.062926] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-19T22:13:26.137766] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T22:13:26.145540] [INFO ] [REMOTE ] YPF: Full fetch complete (73516 records). [2025-09-19T22:13:26.145716] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-19T22:13:26.244959] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-19T22:13:26.550086] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-19T22:13:26.550237] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-19T22:13:26.551587] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-19T22:13:26.551679] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-19T22:13:26.553256] [DEBUG] [LOCAL ] YPF: Trimmed 73516 records to 51232 (keeping 200 days of data) [2025-09-19T22:13:26.867149] [DEBUG] [LOCAL ] YPF: Primary data saved (51232 records). [2025-09-19T22:13:26.867297] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-19T22:13:26.867406] [INFO ] [MAIN ] Update Progress: 2356/2372 symbols completed. YPF took 43.8s. Estimated remaining: 2m 8s. Rate: 7.5 symbols/min [2025-09-19T22:13:27.035875] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:13:27.045040] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-19T22:13:27.053886] [DEBUG] [LOCAL ] ZEPP: Loaded 16264 existing records from primary storage. [2025-09-19T22:13:27.054007] [INFO ] [MAIN ] ZEPP: Loaded 16264 existing records. [2025-09-19T22:13:27.235041] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:13:27.235392] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-19T22:13:27.235462] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-19T22:13:27.236027] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-19T22:13:27.236088] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-19T22:13:27.617176] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:13:27.647599] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-19T22:13:27.721456] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-19T22:13:27.843255] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-19T22:13:28.643280] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-19T22:13:29.188586] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-19T22:13:29.330372] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-19T22:13:29.332187] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-19T22:13:29.443274] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-19T22:13:30.017079] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-19T22:13:30.243273] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-19T22:13:31.043297] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-19T22:13:31.843291] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-19T22:13:32.037103] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-19T22:13:32.643323] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-19T22:13:32.982601] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-19T22:13:33.315931] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-19T22:13:33.443274] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-19T22:13:34.006590] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-19T22:13:34.243277] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-19T22:13:35.043270] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-19T22:13:35.381355] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-19T22:13:35.433360] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-19T22:13:35.843281] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-19T22:13:36.261227] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-19T22:13:36.584567] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-19T22:13:36.643269] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-19T22:13:37.081993] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-19T22:13:37.089909] [INFO ] [REMOTE ] YUM: Full fetch complete (74355 records). [2025-09-19T22:13:37.090054] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-19T22:13:37.448451] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-19T22:13:37.508582] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-19T22:13:37.508726] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-19T22:13:37.509974] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-19T22:13:37.510040] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-19T22:13:37.511559] [DEBUG] [LOCAL ] YUM: Trimmed 74355 records to 52076 (keeping 200 days of data) [2025-09-19T22:13:37.853575] [DEBUG] [LOCAL ] YUM: Primary data saved (52076 records). [2025-09-19T22:13:37.853765] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-19T22:13:37.853862] [INFO ] [MAIN ] Update Progress: 2357/2372 symbols completed. YUM took 37.1s. Estimated remaining: 1m 60s. Rate: 7.5 symbols/min [2025-09-19T22:13:38.243272] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-19T22:13:39.043280] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-19T22:13:39.448377] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-19T22:13:39.790515] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-19T22:13:39.843272] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-19T22:13:40.241705] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-19T22:13:40.642956] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-19T22:13:40.645072] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-19T22:13:41.443269] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-19T22:13:41.991900] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-19T22:13:42.243271] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-19T22:13:43.043321] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-19T22:13:43.503741] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-19T22:13:43.843318] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-19T22:13:44.067194] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T22:13:44.595933] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-19T22:13:44.643276] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-19T22:13:44.718863] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-19T22:13:44.726706] [INFO ] [REMOTE ] ZBH: Full fetch complete (73754 records). [2025-09-19T22:13:44.726866] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-19T22:13:45.129739] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-19T22:13:45.129853] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-19T22:13:45.131136] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-19T22:13:45.131230] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-19T22:13:45.132952] [DEBUG] [LOCAL ] ZBH: Trimmed 73754 records to 51968 (keeping 200 days of data) [2025-09-19T22:13:45.443869] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-19T22:13:45.466475] [DEBUG] [LOCAL ] ZBH: Primary data saved (51968 records). [2025-09-19T22:13:45.466606] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-19T22:13:45.466714] [INFO ] [MAIN ] Update Progress: 2358/2372 symbols completed. ZBH took 28.4s. Estimated remaining: 1m 52s. Rate: 7.5 symbols/min [2025-09-19T22:13:46.169021] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-19T22:13:46.243286] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-19T22:13:46.929917] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-19T22:13:46.935142] [INFO ] [REMOTE ] ZEPP: Full fetch complete (17732 records). [2025-09-19T22:13:46.935239] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-19T22:13:47.314745] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-19T22:13:47.314847] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-19T22:13:47.315239] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-19T22:13:47.315278] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-19T22:13:47.315934] [DEBUG] [LOCAL ] ZEPP: Trimmed 17732 records to 16473 (keeping 200 days of data) [2025-09-19T22:13:47.411622] [DEBUG] [LOCAL ] ZEPP: Primary data saved (16473 records). [2025-09-19T22:13:47.411797] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-19T22:13:47.411885] [INFO ] [MAIN ] Update Progress: 2359/2372 symbols completed. ZEPP took 20.5s. Estimated remaining: 1m 44s. Rate: 7.5 symbols/min [2025-09-19T22:13:48.205889] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-19T22:13:48.213837] [INFO ] [REMOTE ] YUMC: Full fetch complete (76104 records). [2025-09-19T22:13:48.213978] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-19T22:13:48.614839] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-19T22:13:48.614934] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-19T22:13:48.616089] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-19T22:13:48.616155] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-19T22:13:48.617709] [DEBUG] [LOCAL ] YUMC: Trimmed 76104 records to 53504 (keeping 200 days of data) [2025-09-19T22:13:48.961738] [DEBUG] [LOCAL ] YUMC: Primary data saved (53504 records). [2025-09-19T22:13:48.961977] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-19T22:13:48.962516] [INFO ] [MAIN ] Update Progress: 2360/2372 symbols completed. YUMC took 33.2s. Estimated remaining: 1m 36s. Rate: 7.5 symbols/min [2025-09-19T22:13:49.563246] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:13:49.546316] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:13:49.687802] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:13:49.713761] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:13:49.771283] [DEBUG] [LOCAL ] ZH: Loaded 27380 existing records from primary storage. [2025-09-19T22:13:49.771483] [INFO ] [MAIN ] ZH: Loaded 27380 existing records. [2025-09-19T22:13:49.925394] [DEBUG] [LOCAL ] ZETA: Loaded 53985 existing records from primary storage. [2025-09-19T22:13:49.931410] [INFO ] [MAIN ] ZETA: Loaded 53985 existing records. [2025-09-19T22:13:49.932329] [DEBUG] [LOCAL ] ZGN: Loaded 41220 existing records from primary storage. [2025-09-19T22:13:50.023388] [INFO ] [MAIN ] ZGN: Loaded 41220 existing records. [2025-09-19T22:13:50.116599] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:13:50.172164] [DEBUG] [LOCAL ] ZIM: Loaded 53941 existing records from primary storage. [2025-09-19T22:13:50.183003] [INFO ] [MAIN ] ZIM: Loaded 53941 existing records. [2025-09-19T22:13:50.216606] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-19T22:13:50.242521] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-19T22:13:50.395825] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:13:50.382207] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-19T22:13:50.411513] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-19T22:13:50.443727] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-19T22:13:50.472713] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-19T22:13:50.595752] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:13:50.606158] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-19T22:13:50.625763] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-19T22:13:50.745451] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-19T22:13:50.754468] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-19T22:13:50.772099] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:13:50.783911] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-19T22:13:50.831343] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-19T22:13:50.854693] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-19T22:13:50.854542] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-19T22:13:50.909994] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-19T22:13:50.977536] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-19T22:13:51.694903] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:13:51.720998] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-19T22:13:51.981829] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:13:52.021223] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-19T22:13:52.182701] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:13:52.195349] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-19T22:13:52.217177] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:13:52.217765] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-19T22:13:53.175822] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-19T22:13:53.181424] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-19T22:13:53.462485] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-19T22:13:53.470797] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-19T22:13:54.134166] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T22:13:54.138714] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-19T22:13:54.364136] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-19T22:13:54.375136] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-19T22:13:54.652004] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-19T22:13:54.662952] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-19T22:13:55.380164] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-19T22:13:55.388787] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-19T22:13:56.111724] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-19T22:13:56.119902] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-19T22:13:56.383119] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-19T22:13:56.390243] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-19T22:13:56.524871] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-19T22:13:56.643243] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-19T22:13:56.844088] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-19T22:13:57.443324] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-19T22:13:57.781527] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-19T22:13:57.889558] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-19T22:13:58.243330] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-19T22:13:58.512484] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-19T22:13:59.043306] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-19T22:13:59.713686] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-19T22:13:59.821162] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-19T22:13:59.843219] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-19T22:14:00.643336] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-19T22:14:00.978365] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-19T22:14:01.443312] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-19T22:14:01.670296] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-19T22:14:01.879809] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-19T22:14:02.243293] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-19T22:14:03.043305] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-19T22:14:03.253675] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-19T22:14:03.843243] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-19T22:14:04.297583] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-19T22:14:04.643265] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-19T22:14:05.197542] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-09-19T22:14:05.443237] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-19T22:14:06.199572] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-19T22:14:06.243218] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-19T22:14:06.300907] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-19T22:14:07.043265] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-19T22:14:07.565403] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-19T22:14:07.843307] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-19T22:14:08.225869] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-19T22:14:08.643244] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-19T22:14:08.741953] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-19T22:14:09.238582] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-19T22:14:09.443277] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-19T22:14:10.243265] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-19T22:14:10.981918] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-19T22:14:11.043277] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-19T22:14:11.549339] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-19T22:14:11.553901] [INFO ] [REMOTE ] ZH: Full fetch complete (39726 records). [2025-09-19T22:14:11.554033] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-19T22:14:11.853430] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-19T22:14:11.956037] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-19T22:14:11.956216] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-19T22:14:11.957052] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-19T22:14:11.957197] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-19T22:14:11.958592] [DEBUG] [LOCAL ] ZH: Trimmed 39726 records to 27557 (keeping 200 days of data) [2025-09-19T22:14:11.988470] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-19T22:14:12.149789] [DEBUG] [LOCAL ] ZH: Primary data saved (27557 records). [2025-09-19T22:14:12.149926] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-19T22:14:12.150015] [INFO ] [MAIN ] Update Progress: 2361/2372 symbols completed. ZH took 23.2s. Estimated remaining: 1m 28s. Rate: 7.5 symbols/min [2025-09-19T22:14:12.331048] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:14:12.353478] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-19T22:14:12.400613] [DEBUG] [LOCAL ] ZIP: Loaded 44909 existing records from primary storage. [2025-09-19T22:14:12.400779] [INFO ] [MAIN ] ZIP: Loaded 44909 existing records. [2025-09-19T22:14:12.575772] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:14:12.576038] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-19T22:14:12.576088] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-19T22:14:12.577234] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-19T22:14:12.577296] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-19T22:14:12.652749] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-19T22:14:12.933208] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:14:13.443319] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-19T22:14:14.243304] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-19T22:14:14.308995] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-19T22:14:15.043318] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-19T22:14:15.224042] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-19T22:14:15.308748] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-19T22:14:15.546830] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-19T22:14:15.843249] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-19T22:14:16.643299] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-19T22:14:17.445822] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-19T22:14:17.449083] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-19T22:14:17.522140] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-19T22:14:17.625464] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-19T22:14:18.243301] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-19T22:14:19.043310] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-19T22:14:19.843307] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-19T22:14:19.947116] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-19T22:14:19.956011] [INFO ] [REMOTE ] ZIM: Full fetch complete (77536 records). [2025-09-19T22:14:19.956158] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-19T22:14:20.383379] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-19T22:14:20.383519] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-19T22:14:20.385370] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-19T22:14:20.385506] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-19T22:14:20.427341] [DEBUG] [LOCAL ] ZIM: Trimmed 77536 records to 54331 (keeping 200 days of data) [2025-09-19T22:14:20.429321] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-19T22:14:20.656361] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-19T22:14:20.690161] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-19T22:14:20.711481] [INFO ] [REMOTE ] ZGN: Full fetch complete (58435 records). [2025-09-19T22:14:20.713224] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-19T22:14:21.210765] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-19T22:14:21.211272] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-19T22:14:21.212331] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-19T22:14:21.215026] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-19T22:14:21.220559] [DEBUG] [LOCAL ] ZGN: Trimmed 58435 records to 41448 (keeping 200 days of data) [2025-09-19T22:14:21.339786] [DEBUG] [LOCAL ] ZIM: Primary data saved (54331 records). [2025-09-19T22:14:21.341364] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-19T22:14:21.341767] [INFO ] [MAIN ] Update Progress: 2362/2372 symbols completed. ZIM took 32.4s. Estimated remaining: 1m 20s. Rate: 7.5 symbols/min [2025-09-19T22:14:21.615369] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:14:21.640930] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-19T22:14:21.658339] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-19T22:14:21.698194] [DEBUG] [LOCAL ] ZGN: Primary data saved (41448 records). [2025-09-19T22:14:21.698348] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-19T22:14:21.698457] [INFO ] [MAIN ] Update Progress: 2363/2372 symbols completed. ZGN took 32.7s. Estimated remaining: 1m 12s. Rate: 7.5 symbols/min [2025-09-19T22:14:21.829288] [DEBUG] [LOCAL ] ZK: Loaded 40457 existing records from primary storage. [2025-09-19T22:14:21.839686] [INFO ] [MAIN ] ZK: Loaded 40457 existing records. [2025-09-19T22:14:21.990781] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:14:22.079326] [DEBUG] [LOCAL ] ZKH: Loaded 8114 existing records from primary storage. [2025-09-19T22:14:22.079436] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:14:22.079734] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-19T22:14:22.079798] [INFO ] [MAIN ] ZKH: Loaded 8114 existing records. [2025-09-19T22:14:22.110750] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-19T22:14:22.154673] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-19T22:14:22.170053] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-19T22:14:22.411671] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:14:22.483876] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-19T22:14:22.511074] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-19T22:14:22.540133] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-19T22:14:22.542437] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-19T22:14:22.713838] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:14:22.726419] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-19T22:14:23.001040] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:14:23.043265] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-19T22:14:23.136850] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-19T22:14:23.144855] [INFO ] [REMOTE ] ZETA: Full fetch complete (77677 records). [2025-09-19T22:14:23.144987] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-19T22:14:23.521945] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-19T22:14:23.546486] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-19T22:14:23.546540] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-19T22:14:23.547710] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-19T22:14:23.547776] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-19T22:14:23.549196] [DEBUG] [LOCAL ] ZETA: Trimmed 77677 records to 54375 (keeping 200 days of data) [2025-09-19T22:14:23.807353] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-19T22:14:23.866689] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-19T22:14:23.919584] [DEBUG] [LOCAL ] ZETA: Primary data saved (54375 records). [2025-09-19T22:14:23.919732] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-19T22:14:23.921799] [INFO ] [MAIN ] Update Progress: 2364/2372 symbols completed. ZETA took 35.0s. Estimated remaining: 1m 4s. Rate: 7.5 symbols/min [2025-09-19T22:14:24.091461] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:14:24.118771] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T22:14:24.180191] [DEBUG] [LOCAL ] ZTO: Loaded 50566 existing records from primary storage. [2025-09-19T22:14:24.180389] [INFO ] [MAIN ] ZTO: Loaded 50566 existing records. [2025-09-19T22:14:24.358624] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:14:24.358899] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-19T22:14:24.358947] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-19T22:14:24.360147] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-19T22:14:24.360208] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-19T22:14:24.648384] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-19T22:14:24.716196] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:14:24.818937] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-19T22:14:25.443263] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-19T22:14:26.243307] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-19T22:14:26.404212] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-19T22:14:26.599609] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-19T22:14:27.043314] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-19T22:14:27.809271] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-19T22:14:27.843230] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-19T22:14:28.643265] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-19T22:14:28.935280] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-19T22:14:29.443275] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-19T22:14:29.587040] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-19T22:14:29.672035] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-19T22:14:30.243289] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-19T22:14:30.779428] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-19T22:14:31.043275] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-19T22:14:31.843294] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-19T22:14:32.344330] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-19T22:14:32.563834] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-19T22:14:32.643270] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-19T22:14:32.914739] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-19T22:14:33.204204] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-19T22:14:33.443272] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-19T22:14:34.141052] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-19T22:14:34.243271] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-19T22:14:35.043266] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-19T22:14:35.567392] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-19T22:14:35.843267] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-19T22:14:36.643262] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-19T22:14:36.742374] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-19T22:14:37.323971] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-19T22:14:37.443329] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-19T22:14:37.782573] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-19T22:14:38.243266] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-19T22:14:39.043262] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-19T22:14:39.121398] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-19T22:14:39.193550] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-19T22:14:39.843272] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-19T22:14:40.643276] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-19T22:14:40.701139] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-19T22:14:40.702874] [INFO ] [REMOTE ] ZKH: Full fetch complete (11850 records). [2025-09-19T22:14:40.702945] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-19T22:14:41.097084] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-19T22:14:41.110426] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-19T22:14:41.110830] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-19T22:14:41.116061] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-19T22:14:41.130046] [DEBUG] [LOCAL ] ZKH: Trimmed 11850 records to 8186 (keeping 200 days of data) [2025-09-19T22:14:41.132596] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-19T22:14:41.194990] [DEBUG] [LOCAL ] ZKH: Primary data saved (8186 records). [2025-09-19T22:14:41.195181] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-19T22:14:41.195371] [INFO ] [MAIN ] Update Progress: 2365/2372 symbols completed. ZKH took 19.5s. Estimated remaining: 55.9s. Rate: 7.5 symbols/min [2025-09-19T22:14:41.366857] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:14:41.385733] [DEBUG] [LOCAL ] ZTR: Loaded 16956 existing records from primary storage. [2025-09-19T22:14:41.385868] [INFO ] [MAIN ] ZTR: Loaded 16956 existing records. [2025-09-19T22:14:41.448608] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-19T22:14:41.578128] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:14:41.578461] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-19T22:14:41.578540] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-19T22:14:41.579029] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-19T22:14:41.579122] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-19T22:14:41.972951] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:14:42.243310] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-19T22:14:42.695976] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-19T22:14:43.043269] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-19T22:14:43.265817] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-19T22:14:43.411040] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-19T22:14:43.843336] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-19T22:14:44.624200] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-19T22:14:44.643233] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-19T22:14:45.420441] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-19T22:14:45.434399] [INFO ] [REMOTE ] ZIP: Full fetch complete (59131 records). [2025-09-19T22:14:45.434751] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-19T22:14:45.449249] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-19T22:14:45.861730] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-19T22:14:45.861835] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-19T22:14:45.862885] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-19T22:14:45.862980] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-19T22:14:45.864753] [DEBUG] [LOCAL ] ZIP: Trimmed 59131 records to 45168 (keeping 200 days of data) [2025-09-19T22:14:46.150086] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-19T22:14:46.196737] [DEBUG] [LOCAL ] ZIP: Primary data saved (45168 records). [2025-09-19T22:14:46.196886] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-19T22:14:46.197041] [INFO ] [MAIN ] Update Progress: 2366/2372 symbols completed. ZIP took 34.0s. Estimated remaining: 47.9s. Rate: 7.5 symbols/min [2025-09-19T22:14:46.254588] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-19T22:14:46.405575] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:14:46.477838] [DEBUG] [LOCAL ] ZTS: Loaded 53375 existing records from primary storage. [2025-09-19T22:14:46.478186] [INFO ] [MAIN ] ZTS: Loaded 53375 existing records. [2025-09-19T22:14:46.684267] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:14:46.684557] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-19T22:14:46.684609] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-19T22:14:46.685921] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-19T22:14:46.685997] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-19T22:14:47.048367] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-19T22:14:47.118604] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:14:47.191896] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-19T22:14:47.513175] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-19T22:14:47.843258] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-19T22:14:48.342091] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-19T22:14:48.643247] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-19T22:14:49.443305] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-19T22:14:49.869678] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-19T22:14:50.243260] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-19T22:14:50.899845] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-19T22:14:51.043255] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-19T22:14:51.154050] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-19T22:14:51.676498] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-19T22:14:51.843294] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-19T22:14:52.648517] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-19T22:14:52.685620] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-19T22:14:53.443271] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-19T22:14:53.992226] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-19T22:14:54.068138] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-19T22:14:54.243295] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-19T22:14:54.626454] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-19T22:14:54.633859] [INFO ] [REMOTE ] ZK: Full fetch complete (57415 records). [2025-09-19T22:14:54.633968] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-19T22:14:55.016921] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-19T22:14:55.017006] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-19T22:14:55.018011] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-19T22:14:55.018073] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-19T22:14:55.019311] [DEBUG] [LOCAL ] ZK: Trimmed 57415 records to 40821 (keeping 200 days of data) [2025-09-19T22:14:55.083329] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-19T22:14:55.300733] [DEBUG] [LOCAL ] ZK: Primary data saved (40821 records). [2025-09-19T22:14:55.301017] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-19T22:14:55.302021] [INFO ] [MAIN ] Update Progress: 2367/2372 symbols completed. ZK took 34.0s. Estimated remaining: 39.9s. Rate: 7.5 symbols/min [2025-09-19T22:14:55.475295] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:14:55.495770] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-19T22:14:55.504910] [INFO ] [REMOTE ] ZTO: Full fetch complete (73200 records). [2025-09-19T22:14:55.505049] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-19T22:14:55.715157] [DEBUG] [LOCAL ] ZVIA: Loaded 35635 existing records from primary storage. [2025-09-19T22:14:55.769089] [INFO ] [MAIN ] ZVIA: Loaded 35635 existing records. [2025-09-19T22:14:55.851198] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-19T22:14:56.129098] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:14:56.144582] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-19T22:14:56.145316] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-19T22:14:56.165660] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-19T22:14:56.180843] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-19T22:14:56.199606] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-19T22:14:56.235763] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-19T22:14:56.269002] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-19T22:14:56.274220] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-19T22:14:56.336595] [DEBUG] [LOCAL ] ZTO: Trimmed 73200 records to 50870 (keeping 200 days of data) [2025-09-19T22:14:56.610402] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-19T22:14:56.676198] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-19T22:14:56.675384] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:14:56.890917] [DEBUG] [LOCAL ] ZTO: Primary data saved (50870 records). [2025-09-19T22:14:56.891076] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-19T22:14:56.891923] [INFO ] [MAIN ] Update Progress: 2368/2372 symbols completed. ZTO took 33.0s. Estimated remaining: 31.9s. Rate: 7.5 symbols/min [2025-09-19T22:14:57.060184] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-11 to 2025-09-19. [2025-09-19T22:14:57.109710] [DEBUG] [LOCAL ] ZWS: Loaded 42869 existing records from primary storage. [2025-09-19T22:14:57.109924] [INFO ] [MAIN ] ZWS: Loaded 42869 existing records. [2025-09-19T22:14:57.285757] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-03, but need from 2024-12-02 for 200 day retention. Performing full refresh. [2025-09-19T22:14:57.286003] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-19T22:14:57.286051] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-19T22:14:57.287143] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-19T22:14:57.287202] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-19T22:14:57.467678] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-19T22:14:57.650583] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-02 to 2025-09-19 (requires 10 months of data pull). [2025-09-19T22:14:57.870259] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-19T22:14:57.946697] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-19T22:14:58.243246] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-19T22:14:58.858035] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-19T22:14:59.043323] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-19T22:14:59.843285] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-19T22:15:00.510850] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-19T22:15:00.643300] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-19T22:15:00.813407] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-19T22:15:00.897321] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-19T22:15:01.443281] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-19T22:15:02.243285] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-19T22:15:02.520095] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-19T22:15:02.846452] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-19T22:15:03.043271] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-19T22:15:03.843256] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-19T22:15:04.643278] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-19T22:15:05.310629] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (3.07 seconds). [2025-09-19T22:15:05.443237] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-19T22:15:05.510008] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-19T22:15:05.530296] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-19T22:15:06.243280] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-19T22:15:06.373579] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-19T22:15:07.043282] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-19T22:15:07.540152] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-19T22:15:07.671599] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-19T22:15:07.843259] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-19T22:15:08.649566] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-19T22:15:08.651147] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-19T22:15:09.066159] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-19T22:15:09.443281] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-19T22:15:09.684530] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-19T22:15:09.687625] [INFO ] [REMOTE ] ZTR: Full fetch complete (26979 records). [2025-09-19T22:15:09.687732] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-19T22:15:10.063685] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-19T22:15:10.064002] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-19T22:15:10.064591] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-19T22:15:10.064674] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-19T22:15:10.065732] [DEBUG] [LOCAL ] ZTR: Trimmed 26979 records to 17033 (keeping 200 days of data) [2025-09-19T22:15:10.179789] [DEBUG] [LOCAL ] ZTR: Primary data saved (17033 records). [2025-09-19T22:15:10.179937] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-19T22:15:10.180042] [INFO ] [MAIN ] Update Progress: 2369/2372 symbols completed. ZTR took 29.0s. Estimated remaining: 23.9s. Rate: 7.5 symbols/min [2025-09-19T22:15:10.243295] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-19T22:15:11.043273] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-19T22:15:11.086780] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-19T22:15:11.843289] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-19T22:15:12.323543] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-19T22:15:12.643264] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-19T22:15:12.926302] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-19T22:15:13.443381] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-19T22:15:14.202028] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-19T22:15:14.243215] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-19T22:15:15.419353] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-19T22:15:15.431463] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-19T22:15:16.255887] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-19T22:15:16.266355] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-19T22:15:16.715381] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-19T22:15:16.723102] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-19T22:15:17.454035] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-19T22:15:17.465440] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-19T22:15:17.998778] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-19T22:15:18.243274] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-19T22:15:18.404736] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-19T22:15:18.412956] [INFO ] [REMOTE ] ZTS: Full fetch complete (76688 records). [2025-09-19T22:15:18.413227] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-19T22:15:18.587279] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-19T22:15:18.855171] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-19T22:15:18.855254] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-19T22:15:18.856446] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-19T22:15:18.856511] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-19T22:15:18.857960] [DEBUG] [LOCAL ] ZTS: Trimmed 76688 records to 53760 (keeping 200 days of data) [2025-09-19T22:15:19.049860] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-19T22:15:19.207726] [DEBUG] [LOCAL ] ZTS: Primary data saved (53760 records). [2025-09-19T22:15:19.207889] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-19T22:15:19.207979] [INFO ] [MAIN ] Update Progress: 2370/2372 symbols completed. ZTS took 33.0s. Estimated remaining: 16.0s. Rate: 7.5 symbols/min [2025-09-19T22:15:19.932417] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-19T22:15:19.940258] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-19T22:15:20.587056] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-19T22:15:20.643227] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-19T22:15:21.183325] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-19T22:15:21.443334] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-19T22:15:21.604979] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-19T22:15:21.610568] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52464 records). [2025-09-19T22:15:21.610732] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-19T22:15:22.002145] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-19T22:15:22.002251] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-19T22:15:22.003223] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-19T22:15:22.003293] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-19T22:15:22.004452] [DEBUG] [LOCAL ] ZVIA: Trimmed 52464 records to 35851 (keeping 200 days of data) [2025-09-19T22:15:22.208133] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35851 records). [2025-09-19T22:15:22.208300] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-19T22:15:22.208401] [INFO ] [MAIN ] Update Progress: 2371/2372 symbols completed. ZVIA took 26.9s. Estimated remaining: 8.0s. Rate: 7.5 symbols/min [2025-09-19T22:15:23.160557] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-19T22:15:23.173836] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-19T22:15:24.390595] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-19T22:15:24.397371] [INFO ] [REMOTE ] ZWS: Full fetch complete (61873 records). [2025-09-19T22:15:24.397548] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-19T22:15:24.811199] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-19T22:15:24.811312] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-19T22:15:24.812429] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-19T22:15:24.812493] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-19T22:15:24.813869] [DEBUG] [LOCAL ] ZWS: Trimmed 61873 records to 43136 (keeping 200 days of data) [2025-09-19T22:15:25.097476] [DEBUG] [LOCAL ] ZWS: Primary data saved (43136 records). [2025-09-19T22:15:25.097611] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-19T22:15:25.097744] [INFO ] [MAIN ] Update Progress: 2372/2372 symbols completed. ZWS took 28.2s. Estimated remaining: 0.0s. Rate: 7.5 symbols/min [2025-09-19T22:15:25.099841] [INFO ] [MAIN ] Parallel update completed in 5h 15m 21s [2025-09-19T22:15:25.100168] [WARN ] [MAIN ] Failed symbols (279): AAM, AACT, AAMI, AAUC, AAP, AAT, AD, ADC, AEM, AEE... [2025-09-19T22:15:25.100228] [INFO ] [MAIN ] Update success rate: 88.2% (2093/2372 symbols) [2025-09-19T22:15:25.881487] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2093/2372 @ 88.24%)' [2025-09-19T22:15:25.882623] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-19T22:15:25.883076] [INFO ] [STATE ] Last completion updated: 2025-09-19T22:15:25.882742 [2025-09-19T22:15:25.883370] [WARN ] [STATE ] State set to: RUNNING [2025-09-19T22:15:25.883455] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-19T22:15:25.883612] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-19T22:15:25.883712] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-19T22:15:25.886089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-19T22:15:25.886489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-19T22:15:25.886910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-19T22:15:25.887222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-19T22:15:25.887563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-19T22:15:25.887870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-19T22:15:25.888244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-19T22:15:25.888579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-19T22:15:25.888931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-19T22:15:25.889262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-19T22:15:25.889597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-19T22:15:25.890029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-19T22:15:25.890371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-19T22:15:25.890829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-19T22:15:25.891142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-19T22:15:25.891475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-19T22:15:25.891793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-19T22:15:25.892106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-19T22:15:25.892545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-19T22:15:25.892949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-19T22:15:25.893284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-19T22:15:25.893623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-19T22:15:25.894124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-19T22:15:25.894462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-19T22:15:25.894818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-19T22:15:25.895139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-19T22:15:25.895358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-19T22:15:25.895688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-19T22:15:25.896030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-19T22:15:25.896319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-19T22:15:25.896718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-19T22:15:25.897008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-19T22:15:25.897329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-19T22:15:25.897521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-19T22:15:25.897842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-19T22:15:25.898069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-19T22:15:25.898364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-19T22:15:25.898733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-19T22:15:25.899140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-19T22:15:25.899393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-19T22:15:25.899856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-19T22:15:25.900076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-19T22:15:25.900315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-19T22:15:25.900579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-19T22:15:25.900812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-19T22:15:25.901043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-19T22:15:25.901406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-19T22:15:25.901664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-19T22:15:25.901948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-19T22:15:25.902192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-19T22:15:25.902450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-19T22:15:25.902763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-19T22:15:25.903004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-19T22:15:25.903234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-19T22:15:25.903560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-19T22:15:25.903898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-19T22:15:25.904126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-19T22:15:25.904366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-19T22:15:25.904672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-19T22:15:25.904906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-19T22:15:25.905146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-19T22:15:25.905376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-19T22:15:25.905596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-19T22:15:25.905873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-19T22:15:25.906069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-19T22:15:25.906339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-19T22:15:25.906601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-19T22:15:25.906874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-19T22:15:25.907133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-19T22:15:25.907384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-19T22:15:25.907762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-19T22:15:25.908194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-19T22:15:25.908457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-19T22:15:25.908764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-19T22:15:25.909051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-19T22:15:25.909289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-19T22:15:25.909516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-19T22:15:25.909788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-19T22:15:25.909986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-19T22:15:25.910215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-19T22:15:25.910461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-19T22:15:25.910763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-19T22:15:25.910953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-19T22:15:25.911302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-19T22:15:25.911511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-19T22:15:25.911890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-19T22:15:25.912122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-19T22:15:25.912385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-19T22:15:25.912582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-19T22:15:25.912865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-19T22:15:25.913096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-19T22:15:25.913290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-19T22:15:25.913493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-19T22:15:25.913824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-19T22:15:25.913993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-19T22:15:25.914195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-19T22:15:25.914501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-19T22:15:25.914718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-19T22:15:25.914979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-19T22:15:25.915197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-19T22:15:25.915505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-19T22:15:25.916031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-19T22:15:25.916394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-19T22:15:25.916674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-19T22:15:25.916939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-19T22:15:25.917319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-19T22:15:25.917490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-19T22:15:25.917698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-19T22:15:25.917956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-19T22:15:25.918143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-19T22:15:25.918312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-19T22:15:25.918592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-19T22:15:25.918834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-19T22:15:25.919075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-19T22:15:25.919332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-19T22:15:25.919696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-19T22:15:25.919924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-19T22:15:25.920146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-19T22:15:25.920357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-19T22:15:25.920582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-19T22:15:25.920843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-19T22:15:25.921064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-19T22:15:25.921277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-19T22:15:25.921547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-19T22:15:25.921746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-19T22:15:25.921945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-19T22:15:25.922160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-19T22:15:25.922451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-19T22:15:25.922762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-19T22:15:25.923033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-19T22:15:25.923248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-19T22:15:25.923459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-19T22:15:25.923915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-19T22:15:25.924150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-19T22:15:25.924364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-19T22:15:25.924619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-19T22:15:25.924933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-19T22:15:25.925174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-19T22:15:25.925453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-19T22:15:25.925682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-19T22:15:25.925935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-19T22:15:25.926141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-19T22:15:25.926332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-19T22:15:25.926549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-19T22:15:25.926763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-19T22:15:25.927026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-19T22:15:25.927303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-19T22:15:25.927500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-19T22:15:25.928011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-19T22:15:25.928237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-19T22:15:25.928404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-19T22:15:25.928638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-19T22:15:25.928895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-19T22:15:25.929191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-19T22:15:25.929435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-19T22:15:25.929718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-19T22:15:25.929901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-19T22:15:25.930180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-19T22:15:25.930347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-19T22:15:25.930635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-19T22:15:25.930944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-19T22:15:25.931164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-19T22:15:25.931402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-19T22:15:25.931609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-19T22:15:25.931974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-19T22:15:25.932159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-19T22:15:25.932368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-19T22:15:25.932677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-19T22:15:25.932863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-19T22:15:25.933085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-19T22:15:25.933276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-19T22:15:25.933449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-19T22:15:25.933626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-19T22:15:25.933823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-19T22:15:25.934013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-19T22:15:25.934236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-19T22:15:25.934441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-19T22:15:25.934639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-19T22:15:25.934853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-19T22:15:25.935241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-19T22:15:25.935488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-19T22:15:25.935736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-19T22:15:25.935906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-19T22:15:25.936083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-19T22:15:25.936294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-19T22:15:25.936467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-19T22:15:25.936673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-19T22:15:25.936903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-19T22:15:25.937121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-19T22:15:25.937383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-19T22:15:25.937543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-19T22:15:25.937786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-19T22:15:25.938009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-19T22:15:25.938240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-19T22:15:25.938436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-19T22:15:25.938689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-19T22:15:25.938937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-19T22:15:25.939105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-19T22:15:25.939367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-19T22:15:25.939610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-19T22:15:25.939866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-19T22:15:25.940093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-19T22:15:25.940306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-19T22:15:25.940571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-19T22:15:25.940837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-19T22:15:25.941054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-19T22:15:25.941268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-19T22:15:25.941509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-19T22:15:25.941722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-19T22:15:25.941866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-19T22:15:25.942057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-19T22:15:25.942295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-19T22:15:25.942476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-19T22:15:25.942766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-19T22:15:25.942956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-19T22:15:25.943154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-19T22:15:25.943355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-19T22:15:25.943558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-19T22:15:25.943947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-19T22:15:25.944166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-19T22:15:25.944342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-19T22:15:25.944617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-19T22:15:25.944892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-19T22:15:25.945089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-19T22:15:25.945295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-19T22:15:25.945509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-19T22:15:25.945778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-19T22:15:25.946034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-19T22:15:25.946232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-19T22:15:25.946441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-19T22:15:25.946686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-19T22:15:25.946892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-19T22:15:25.947094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-19T22:15:25.947312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-19T22:15:25.947488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-19T22:15:25.947754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-19T22:15:25.948006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-19T22:15:25.948251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-19T22:15:25.948522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-19T22:15:25.948726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-19T22:15:25.948936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-19T22:15:25.949151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-19T22:15:25.949362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-19T22:15:25.949526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-19T22:15:25.949722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-19T22:15:25.949933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-19T22:15:25.950256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-19T22:15:25.950458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-19T22:15:25.950637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-19T22:15:25.950837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-19T22:15:25.951111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-19T22:15:25.951349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-19T22:15:25.951675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-19T22:15:25.951890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-19T22:15:25.952099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-19T22:15:25.952284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-19T22:15:25.952465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-19T22:15:25.952636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-19T22:15:25.953012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-19T22:15:25.953246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-19T22:15:25.953438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-19T22:15:25.953674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-19T22:15:25.953851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-19T22:15:25.954081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-19T22:15:25.954365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-19T22:15:25.954588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-19T22:15:25.954819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-19T22:15:25.955002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-09-19T22:15:25.955253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-19T22:15:25.955459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-19T22:15:25.955695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-19T22:15:25.955876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-19T22:15:25.956092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-19T22:15:25.956306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-19T22:15:25.956475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-19T22:15:25.956708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-19T22:15:25.956919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-19T22:15:25.957121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-19T22:15:25.957328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-19T22:15:25.957544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-19T22:15:25.957747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-19T22:15:25.957938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-19T22:15:25.958137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-19T22:15:25.958308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-19T22:15:25.958468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-19T22:15:25.958678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-19T22:15:25.958973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-19T22:15:25.959175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-19T22:15:25.959372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-19T22:15:25.959575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-19T22:15:25.959825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-19T22:15:25.960013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-19T22:15:25.960183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-19T22:15:25.960400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-19T22:15:25.960588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-19T22:15:25.960861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-19T22:15:25.961148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-19T22:15:25.961335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-19T22:15:25.961526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-19T22:15:25.961748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-19T22:15:25.961964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-19T22:15:25.962156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-19T22:15:25.962302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-19T22:15:25.962457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-19T22:15:25.962661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-19T22:15:25.962861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-19T22:15:25.963093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-19T22:15:25.963265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-19T22:15:25.963429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-19T22:15:25.963594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-19T22:15:25.963825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-19T22:15:25.964023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-19T22:15:25.964222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-19T22:15:25.964406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-19T22:15:25.964608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-19T22:15:25.964926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-19T22:15:25.965118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-19T22:15:25.965322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-19T22:15:25.965606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-19T22:15:25.965851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-19T22:15:25.966088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-19T22:15:25.966267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-19T22:15:25.966454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-19T22:15:25.966633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-19T22:15:25.966852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-19T22:15:25.967017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-19T22:15:25.967204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-19T22:15:25.967627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-19T22:15:25.967849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-19T22:15:25.968052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-19T22:15:25.968242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-19T22:15:25.968465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-19T22:15:25.968627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-19T22:15:25.968934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-19T22:15:25.969111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-19T22:15:25.969334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-19T22:15:25.969572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-19T22:15:25.969772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-19T22:15:25.969937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-19T22:15:25.970125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-19T22:15:25.970347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-19T22:15:25.970546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-19T22:15:25.970715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-19T22:15:25.970929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-19T22:15:25.971126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-19T22:15:25.971322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-19T22:15:25.971482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-19T22:15:25.971631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-19T22:15:25.971830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-19T22:15:25.972033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-19T22:15:25.972244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-19T22:15:25.972471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-19T22:15:25.972662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-19T22:15:25.972851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-19T22:15:25.973088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-19T22:15:25.973247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-19T22:15:25.973408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-19T22:15:25.973617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-19T22:15:25.973848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-19T22:15:25.974048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-19T22:15:25.974249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-19T22:15:25.974445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-19T22:15:25.974763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-19T22:15:25.974925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-19T22:15:25.975106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-19T22:15:25.975298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-19T22:15:25.975461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-19T22:15:25.975681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-19T22:15:25.975879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-19T22:15:25.976085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-19T22:15:25.976276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-19T22:15:25.976512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-09-19T22:15:25.976851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-19T22:15:25.977023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-19T22:15:25.977198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-19T22:15:25.977371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-19T22:15:25.977561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-19T22:15:25.977776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-19T22:15:25.977959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-19T22:15:25.978156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-19T22:15:25.978337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-19T22:15:25.978498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-19T22:15:25.978766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-19T22:15:25.978948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-09-19T22:15:25.979143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-19T22:15:25.979306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-19T22:15:25.979488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-19T22:15:25.979687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-19T22:15:25.979858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-19T22:15:25.980041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-19T22:15:25.980262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-19T22:15:25.980452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-19T22:15:25.980610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-19T22:15:25.980835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-19T22:15:25.981207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-19T22:15:25.981386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-19T22:15:25.981556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-19T22:15:25.981744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-19T22:15:25.981900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-19T22:15:25.982083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-19T22:15:25.982260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-19T22:15:25.982420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-19T22:15:25.982620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-19T22:15:25.982808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-19T22:15:25.983008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-19T22:15:25.983174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-19T22:15:25.983374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-19T22:15:25.983556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-19T22:15:25.983772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-19T22:15:25.983965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-19T22:15:25.984174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-19T22:15:25.984354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-19T22:15:25.984538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-19T22:15:25.984832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-19T22:15:25.985002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-19T22:15:25.985181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-19T22:15:25.985341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-19T22:15:25.985507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-19T22:15:25.985717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-19T22:15:25.985920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-19T22:15:25.986154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-19T22:15:25.986337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-19T22:15:25.986509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-19T22:15:25.986710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-19T22:15:25.986869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-19T22:15:25.987063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-19T22:15:25.987274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-19T22:15:25.987489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-19T22:15:25.987714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-19T22:15:25.987890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-19T22:15:25.988076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-19T22:15:25.988259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-19T22:15:25.988466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-19T22:15:25.988638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-19T22:15:25.988914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-19T22:15:25.989184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-19T22:15:25.989425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-19T22:15:25.989629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-19T22:15:25.989814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-19T22:15:25.990009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-19T22:15:25.990180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-19T22:15:25.990396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-19T22:15:25.990581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-19T22:15:25.990849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-19T22:15:25.991036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-19T22:15:25.991185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-19T22:15:25.991343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-19T22:15:25.991488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-19T22:15:25.991671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-19T22:15:25.991854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-19T22:15:25.992013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-19T22:15:25.992180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-19T22:15:25.992346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-19T22:15:25.992541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-19T22:15:25.992722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-19T22:15:25.992902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-19T22:15:25.993060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-19T22:15:25.993220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-19T22:15:25.993395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-19T22:15:25.993594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-19T22:15:25.993782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-19T22:15:25.993989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-19T22:15:25.994156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-19T22:15:25.994421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-19T22:15:25.994606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-19T22:15:25.994803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-19T22:15:25.994957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-19T22:15:25.995120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-19T22:15:25.995298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-19T22:15:25.995471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-19T22:15:25.995619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-19T22:15:25.995862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-19T22:15:25.996197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-19T22:15:25.996388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-19T22:15:25.996557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-19T22:15:25.996932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-19T22:15:25.997091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-19T22:15:25.997269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-19T22:15:25.997669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-19T22:15:25.997880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-19T22:15:25.998064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-19T22:15:25.998251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-19T22:15:25.998440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-19T22:15:25.998628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-19T22:15:25.998815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-19T22:15:25.998996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-19T22:15:25.999162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-19T22:15:25.999351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-19T22:15:25.999505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-19T22:15:25.999719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-19T22:15:25.999899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-19T22:15:26.000110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-19T22:15:26.000277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-19T22:15:26.000450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-19T22:15:26.000627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-19T22:15:26.000825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-19T22:15:26.001019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-19T22:15:26.001192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-19T22:15:26.001361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-19T22:15:26.001560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-19T22:15:26.001730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-19T22:15:26.001888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-19T22:15:26.002051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-19T22:15:26.002231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-19T22:15:26.002397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-19T22:15:26.002554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-19T22:15:26.002706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-19T22:15:26.002849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-19T22:15:26.003010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-19T22:15:26.003216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-19T22:15:26.003484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-19T22:15:26.003719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-19T22:15:26.003926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-19T22:15:26.004074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-19T22:15:26.004339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-19T22:15:26.004545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-19T22:15:26.004784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-19T22:15:26.004933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-19T22:15:26.005086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-19T22:15:26.005291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-19T22:15:26.005489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-19T22:15:26.005703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-19T22:15:26.005904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-19T22:15:26.006076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-19T22:15:26.006268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-19T22:15:26.006433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-19T22:15:26.006610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-19T22:15:26.006788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-19T22:15:26.006947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-19T22:15:26.007137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-19T22:15:26.007281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-19T22:15:26.007427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-19T22:15:26.007597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-19T22:15:26.007814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-19T22:15:26.007969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-19T22:15:26.008135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-19T22:15:26.008309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-19T22:15:26.008449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-19T22:15:26.008607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-19T22:15:26.008904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-19T22:15:26.009060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-19T22:15:26.009229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-19T22:15:26.009395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-19T22:15:26.009553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-19T22:15:26.009788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-19T22:15:26.009949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-19T22:15:26.010127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-19T22:15:26.010283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-19T22:15:26.010408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-19T22:15:26.010572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-19T22:15:26.010716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-19T22:15:26.010962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-19T22:15:26.011109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-19T22:15:26.011282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-19T22:15:26.011462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-19T22:15:26.011630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-19T22:15:26.011811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-19T22:15:26.011966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-19T22:15:26.012146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-19T22:15:26.012302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-19T22:15:26.012467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-19T22:15:26.012638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-19T22:15:26.012865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-19T22:15:26.013034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-19T22:15:26.013181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-19T22:15:26.013352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-19T22:15:26.013521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-19T22:15:26.013692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-19T22:15:26.013846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-19T22:15:26.013996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-19T22:15:26.014187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-19T22:15:26.014361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-19T22:15:26.014563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-19T22:15:26.014777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-19T22:15:26.015005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-19T22:15:26.015166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-19T22:15:26.015357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-19T22:15:26.015511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-19T22:15:26.015686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-19T22:15:26.015868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-19T22:15:26.016026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-19T22:15:26.016169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-19T22:15:26.016319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-19T22:15:26.016481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-19T22:15:26.016885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-19T22:15:26.017063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-19T22:15:26.017244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-19T22:15:26.017436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-19T22:15:26.017630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-19T22:15:26.017826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-19T22:15:26.017985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-19T22:15:26.018136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-19T22:15:26.018309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-19T22:15:26.018476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-19T22:15:26.018620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-19T22:15:26.018811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-19T22:15:26.018951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-19T22:15:26.019118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-19T22:15:26.019399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-19T22:15:26.019550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-19T22:15:26.019732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-19T22:15:26.019919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-19T22:15:26.020073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-19T22:15:26.020240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-19T22:15:26.020411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-19T22:15:26.020572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-19T22:15:26.020757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-19T22:15:26.020921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-19T22:15:26.021076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-19T22:15:26.021242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-19T22:15:26.021392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-19T22:15:26.021549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-19T22:15:26.021757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-19T22:15:26.021913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-19T22:15:26.022069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-19T22:15:26.022220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-19T22:15:26.022432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-19T22:15:26.022574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-19T22:15:26.022780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-19T22:15:26.022955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-19T22:15:26.023113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-19T22:15:26.023289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-19T22:15:26.023447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-19T22:15:26.023589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-19T22:15:26.023799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-19T22:15:26.023961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-19T22:15:26.024117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-19T22:15:26.024261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-19T22:15:26.024455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-19T22:15:26.024621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-19T22:15:26.024842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-19T22:15:26.024999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-19T22:15:26.025160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-19T22:15:26.025383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-19T22:15:26.025552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-19T22:15:26.025724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-19T22:15:26.025876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-19T22:15:26.026049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-19T22:15:26.026202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-19T22:15:26.026368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-19T22:15:26.026522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-19T22:15:26.026815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-19T22:15:26.026997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-19T22:15:26.027152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-19T22:15:26.027287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-19T22:15:26.027480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-19T22:15:26.027618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-19T22:15:26.027830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-19T22:15:26.027999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-19T22:15:26.028164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-19T22:15:26.028337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-19T22:15:26.028489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-19T22:15:26.028665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-19T22:15:26.028826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-19T22:15:26.029001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-19T22:15:26.029249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-19T22:15:26.029412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-19T22:15:26.029568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-19T22:15:26.029768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-19T22:15:26.029951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-19T22:15:26.030101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-19T22:15:26.030228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-19T22:15:26.030367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-19T22:15:26.030513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-19T22:15:26.030698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-19T22:15:26.030905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-19T22:15:26.031050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-19T22:15:26.031219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-19T22:15:26.031374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-19T22:15:26.031518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-19T22:15:26.031635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-19T22:15:26.031861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-19T22:15:26.032019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-19T22:15:26.032192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-19T22:15:26.032346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-19T22:15:26.032521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-19T22:15:26.032835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-19T22:15:26.033075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-19T22:15:26.033235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-19T22:15:26.033380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-19T22:15:26.033719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-19T22:15:26.033895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-19T22:15:26.034047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-19T22:15:26.034213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-19T22:15:26.034389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-19T22:15:26.034555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-19T22:15:26.034767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-19T22:15:26.034908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-19T22:15:26.035089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-19T22:15:26.035261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-19T22:15:26.035485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-19T22:15:26.035684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-19T22:15:26.035833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-19T22:15:26.035983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-19T22:15:26.036134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-19T22:15:26.036279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-19T22:15:26.036448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-19T22:15:26.036632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-19T22:15:26.036793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-19T22:15:26.036954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-19T22:15:26.037090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-19T22:15:26.037239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-19T22:15:26.037411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-19T22:15:26.037564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-19T22:15:26.037812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-19T22:15:26.037959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-19T22:15:26.038119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-19T22:15:26.038296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-19T22:15:26.038478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-19T22:15:26.038672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-19T22:15:26.038852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-19T22:15:26.039037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-19T22:15:26.039186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-19T22:15:26.039374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-19T22:15:26.039532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-19T22:15:26.039723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-19T22:15:26.039868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-19T22:15:26.040014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-19T22:15:26.040160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-19T22:15:26.040315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-19T22:15:26.040456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-19T22:15:26.040768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-19T22:15:26.040929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-19T22:15:26.041091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-19T22:15:26.041234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-19T22:15:26.041377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-19T22:15:26.041618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-19T22:15:26.041841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-19T22:15:26.042021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-19T22:15:26.042146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-19T22:15:26.042285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-19T22:15:26.042450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-19T22:15:26.042620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-19T22:15:26.042807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-19T22:15:26.042955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-19T22:15:26.043141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-19T22:15:26.043335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-19T22:15:26.043501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-19T22:15:26.043683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-19T22:15:26.043844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-19T22:15:26.044001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-19T22:15:26.044158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-19T22:15:26.044323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-19T22:15:26.044509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-19T22:15:26.044636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-19T22:15:26.044810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-19T22:15:26.045005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-19T22:15:26.045161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-19T22:15:26.045323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-19T22:15:26.045487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-19T22:15:26.045810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-19T22:15:26.045961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-19T22:15:26.046135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-19T22:15:26.046284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-19T22:15:26.046443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-19T22:15:26.046599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-19T22:15:26.046826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-09-19T22:15:26.046991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-19T22:15:26.047120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-19T22:15:26.047272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-19T22:15:26.047435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-19T22:15:26.047597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-19T22:15:26.047925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-19T22:15:26.048094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-19T22:15:26.048311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-19T22:15:26.048476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-19T22:15:26.048817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-19T22:15:26.048996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-19T22:15:26.049187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-19T22:15:26.049354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-19T22:15:26.049511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-19T22:15:26.049674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-19T22:15:26.049838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-19T22:15:26.050023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-19T22:15:26.050192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-19T22:15:26.050393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-19T22:15:26.050553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-19T22:15:26.050753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-19T22:15:26.050961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-19T22:15:26.051119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-19T22:15:26.051278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-19T22:15:26.051468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-19T22:15:26.051607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-19T22:15:26.051793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-19T22:15:26.051990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-19T22:15:26.052145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-19T22:15:26.052301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-19T22:15:26.052474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-19T22:15:26.052631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-19T22:15:26.052931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-19T22:15:26.053081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-09-19T22:15:26.053260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-19T22:15:26.053415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-19T22:15:26.053579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-19T22:15:26.053767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-19T22:15:26.053934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-19T22:15:26.054083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-19T22:15:26.054260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-19T22:15:26.054458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-19T22:15:26.054601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-19T22:15:26.054788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-19T22:15:26.054952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-19T22:15:26.055115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-19T22:15:26.055299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-19T22:15:26.055522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-19T22:15:26.055723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-19T22:15:26.055874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-19T22:15:26.056101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-19T22:15:26.056241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-19T22:15:26.056424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-19T22:15:26.056638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-19T22:15:26.056908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-19T22:15:26.057060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-19T22:15:26.057309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-19T22:15:26.057456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-19T22:15:26.057632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-19T22:15:26.057820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-19T22:15:26.057958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-19T22:15:26.058120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-19T22:15:26.058258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-19T22:15:26.058410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-19T22:15:26.058578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-19T22:15:26.058752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-19T22:15:26.058933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-19T22:15:26.059085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-19T22:15:26.059211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-19T22:15:26.059370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-19T22:15:26.059513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-19T22:15:26.059707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-19T22:15:26.059907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-19T22:15:26.060041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-19T22:15:26.060323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-19T22:15:26.060467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KO.csv [2025-09-19T22:15:26.060621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-19T22:15:26.060887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-19T22:15:26.061039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-19T22:15:26.061215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-19T22:15:26.061377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-19T22:15:26.061531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-19T22:15:26.061740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-19T22:15:26.061933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-19T22:15:26.062105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-19T22:15:26.062279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-19T22:15:26.062438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-19T22:15:26.062603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-19T22:15:26.062800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-19T22:15:26.062988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-19T22:15:26.063169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-19T22:15:26.063340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-19T22:15:26.063495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-19T22:15:26.063713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-19T22:15:26.063847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-19T22:15:26.064010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-19T22:15:26.064177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-19T22:15:26.064319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-19T22:15:26.064494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-19T22:15:26.064672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-19T22:15:26.064848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-19T22:15:26.065001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-19T22:15:26.065156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-19T22:15:26.065325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-19T22:15:26.065479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-19T22:15:26.065631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-19T22:15:26.065801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-19T22:15:26.065918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-19T22:15:26.066110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-19T22:15:26.066290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-19T22:15:26.066437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-19T22:15:26.066590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-19T22:15:26.066784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-19T22:15:26.066973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-19T22:15:26.067124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-19T22:15:26.067290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-19T22:15:26.067467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-19T22:15:26.067593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-19T22:15:26.067758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-19T22:15:26.067916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-19T22:15:26.068084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-19T22:15:26.068248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-19T22:15:26.068530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-19T22:15:26.068736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-19T22:15:26.068874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-19T22:15:26.069007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-19T22:15:26.069134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-19T22:15:26.069263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-19T22:15:26.069438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-19T22:15:26.069589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-19T22:15:26.069763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-19T22:15:26.069921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-19T22:15:26.070066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-19T22:15:26.070194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-19T22:15:26.070338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-19T22:15:26.070479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-19T22:15:26.070613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-19T22:15:26.070793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-19T22:15:26.070938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-19T22:15:26.071122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-19T22:15:26.071267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-19T22:15:26.071434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-19T22:15:26.071592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-19T22:15:26.071777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-19T22:15:26.071927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-19T22:15:26.072071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-19T22:15:26.072209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-19T22:15:26.072459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-19T22:15:26.072571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-19T22:15:26.072746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-19T22:15:26.072903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-09-19T22:15:26.073068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-19T22:15:26.073208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-19T22:15:26.073362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-19T22:15:26.073506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-19T22:15:26.073662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-19T22:15:26.073822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-19T22:15:26.073983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-19T22:15:26.074132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-19T22:15:26.074306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-19T22:15:26.074573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-19T22:15:26.074794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-19T22:15:26.074964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-19T22:15:26.075103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-19T22:15:26.075250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-19T22:15:26.075613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-19T22:15:26.075781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-19T22:15:26.075931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-19T22:15:26.076094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-19T22:15:26.076258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-19T22:15:26.076433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-19T22:15:26.076570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-19T22:15:26.076864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-19T22:15:26.077008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-19T22:15:26.077146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-19T22:15:26.077299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-19T22:15:26.077445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-19T22:15:26.077600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-19T22:15:26.077790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-19T22:15:26.077927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-19T22:15:26.078075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-19T22:15:26.078255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-19T22:15:26.078427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-19T22:15:26.078570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-19T22:15:26.078734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-19T22:15:26.078901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-19T22:15:26.079050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-19T22:15:26.079221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-19T22:15:26.079365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-19T22:15:26.079505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-19T22:15:26.079678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-19T22:15:26.079829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-19T22:15:26.080121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-19T22:15:26.080273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-19T22:15:26.080405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-19T22:15:26.080539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-19T22:15:26.080702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-19T22:15:26.080845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-19T22:15:26.081013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-19T22:15:26.081160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-19T22:15:26.081306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-19T22:15:26.081482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-19T22:15:26.081660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-19T22:15:26.081809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-19T22:15:26.081963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-19T22:15:26.082132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-19T22:15:26.082251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-19T22:15:26.082379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-19T22:15:26.082541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-19T22:15:26.082699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-19T22:15:26.082862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-19T22:15:26.082997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-19T22:15:26.083139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-19T22:15:26.083292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-19T22:15:26.083451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-19T22:15:26.083609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-19T22:15:26.083807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-19T22:15:26.083956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-19T22:15:26.084130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-19T22:15:26.084294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-19T22:15:26.084475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-19T22:15:26.084616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-19T22:15:26.084911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-19T22:15:26.085058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-19T22:15:26.085204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-19T22:15:26.085369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-19T22:15:26.085517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-19T22:15:26.085692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-19T22:15:26.085836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-19T22:15:26.085986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-19T22:15:26.086150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-19T22:15:26.086342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-19T22:15:26.086501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-19T22:15:26.086638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-19T22:15:26.086828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-19T22:15:26.086975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-19T22:15:26.087131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-19T22:15:26.087283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-19T22:15:26.087521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-19T22:15:26.087698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-19T22:15:26.087863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-19T22:15:26.088024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-19T22:15:26.088180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-19T22:15:26.088325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-19T22:15:26.088470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-19T22:15:26.088622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-19T22:15:26.088906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-19T22:15:26.089084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-19T22:15:26.089223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-19T22:15:26.089368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-19T22:15:26.089532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-19T22:15:26.089717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-19T22:15:26.089880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-19T22:15:26.090040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-19T22:15:26.090226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-19T22:15:26.090479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-19T22:15:26.090658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-19T22:15:26.090843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-19T22:15:26.091012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-19T22:15:26.091155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-19T22:15:26.091276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-19T22:15:26.091421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-19T22:15:26.091565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-19T22:15:26.091740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-19T22:15:26.091878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-19T22:15:26.092035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-19T22:15:26.092173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-19T22:15:26.092331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-19T22:15:26.092474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-19T22:15:26.092609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-19T22:15:26.092843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-19T22:15:26.093001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-19T22:15:26.093159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-19T22:15:26.093316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-19T22:15:26.093459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-19T22:15:26.093656] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-19T22:15:26.093814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-19T22:15:26.093954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-19T22:15:26.094121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-19T22:15:26.094279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-19T22:15:26.094479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-19T22:15:26.094668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-19T22:15:26.094815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-19T22:15:26.094957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-19T22:15:26.095116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-19T22:15:26.095255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-19T22:15:26.095379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-19T22:15:26.095529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-19T22:15:26.095708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-19T22:15:26.095880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-19T22:15:26.096004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-19T22:15:26.096273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-19T22:15:26.096413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-19T22:15:26.096529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-19T22:15:26.096675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-19T22:15:26.096829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-19T22:15:26.096983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-19T22:15:26.097136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-19T22:15:26.097281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-19T22:15:26.097429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-19T22:15:26.097558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-19T22:15:26.097706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-19T22:15:26.097875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-19T22:15:26.098081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-19T22:15:26.098224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-19T22:15:26.098391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-19T22:15:26.098531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-19T22:15:26.098697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-19T22:15:26.098836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-19T22:15:26.098980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-19T22:15:26.099146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-19T22:15:26.099310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-19T22:15:26.099439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-19T22:15:26.099589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-19T22:15:26.099761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-19T22:15:26.099906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-19T22:15:26.100032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-19T22:15:26.100181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-19T22:15:26.100334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-19T22:15:26.100471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-19T22:15:26.100616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-19T22:15:26.100824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-19T22:15:26.100992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-19T22:15:26.101145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-19T22:15:26.101309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-19T22:15:26.101453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-19T22:15:26.101613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-19T22:15:26.101831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-19T22:15:26.101992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-19T22:15:26.102131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-19T22:15:26.102299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-19T22:15:26.102426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-19T22:15:26.102576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-19T22:15:26.102817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-19T22:15:26.102953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-19T22:15:26.103121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-19T22:15:26.103439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-19T22:15:26.103586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-19T22:15:26.103865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-19T22:15:26.104034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-19T22:15:26.104185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-19T22:15:26.104340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-19T22:15:26.104540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-19T22:15:26.104705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-19T22:15:26.104881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-19T22:15:26.105059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-19T22:15:26.105282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-19T22:15:26.105446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-19T22:15:26.105606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-19T22:15:26.105801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-19T22:15:26.105958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-19T22:15:26.106142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-19T22:15:26.106288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-19T22:15:26.106457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-19T22:15:26.106697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-19T22:15:26.106863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-19T22:15:26.107015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-19T22:15:26.107173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-19T22:15:26.107313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-19T22:15:26.107492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-19T22:15:26.107688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-19T22:15:26.108086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-19T22:15:26.108231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-19T22:15:26.108410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-19T22:15:26.108558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-19T22:15:26.108813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-19T22:15:26.108966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-19T22:15:26.109120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-19T22:15:26.109267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-19T22:15:26.109439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-19T22:15:26.109599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-19T22:15:26.109763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-19T22:15:26.109912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-19T22:15:26.110108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-19T22:15:26.110274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-19T22:15:26.110405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-19T22:15:26.110519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-19T22:15:26.110703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-19T22:15:26.110860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-19T22:15:26.111008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-19T22:15:26.111155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-19T22:15:26.111381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-19T22:15:26.111721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-19T22:15:26.111898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-19T22:15:26.112129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-19T22:15:26.112285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-19T22:15:26.112430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-19T22:15:26.112572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-19T22:15:26.112753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-19T22:15:26.112971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-19T22:15:26.113146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-19T22:15:26.113304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-19T22:15:26.113449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-19T22:15:26.113599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-19T22:15:26.113809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-19T22:15:26.113948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-19T22:15:26.114104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-19T22:15:26.114248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-19T22:15:26.114435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-19T22:15:26.114588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-19T22:15:26.114763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-19T22:15:26.114935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-19T22:15:26.115118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-19T22:15:26.115299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-19T22:15:26.115465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-19T22:15:26.115627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-19T22:15:26.115807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-19T22:15:26.115993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-19T22:15:26.116138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-19T22:15:26.116271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-19T22:15:26.116384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-19T22:15:26.116516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-19T22:15:26.116684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-19T22:15:26.116812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-19T22:15:26.116991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-19T22:15:26.117165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-19T22:15:26.117335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-19T22:15:26.117946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-19T22:15:26.118104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-19T22:15:26.118260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-19T22:15:26.118422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-19T22:15:26.118581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-19T22:15:26.118739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-19T22:15:26.118907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-19T22:15:26.119049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-19T22:15:26.119210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-19T22:15:26.119375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-19T22:15:26.119525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-19T22:15:26.119715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-19T22:15:26.119862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-19T22:15:26.120020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-19T22:15:26.120172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-19T22:15:26.120353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-19T22:15:26.120520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-19T22:15:26.120713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-19T22:15:26.120947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-19T22:15:26.121169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-19T22:15:26.121303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-19T22:15:26.121427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-19T22:15:26.121573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-19T22:15:26.121743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-19T22:15:26.121872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-19T22:15:26.121994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-19T22:15:26.122134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-19T22:15:26.122340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-19T22:15:26.122523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-19T22:15:26.122686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-19T22:15:26.122829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-19T22:15:26.123001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-19T22:15:26.123187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-19T22:15:26.123346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-19T22:15:26.123512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-19T22:15:26.123696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-19T22:15:26.123851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-19T22:15:26.123996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-19T22:15:26.124156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-19T22:15:26.124301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-19T22:15:26.124492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-19T22:15:26.124634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-19T22:15:26.124845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-19T22:15:26.124988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-19T22:15:26.125166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-19T22:15:26.125327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-19T22:15:26.125474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-19T22:15:26.125898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-19T22:15:26.126055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-19T22:15:26.126243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-19T22:15:26.126373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-19T22:15:26.126506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-19T22:15:26.126669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-19T22:15:26.126831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-19T22:15:26.126982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-19T22:15:26.127143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-19T22:15:26.127279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-19T22:15:26.127408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-19T22:15:26.127547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-19T22:15:26.127707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-19T22:15:26.127861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-19T22:15:26.128008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-19T22:15:26.128161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-19T22:15:26.128324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-19T22:15:26.128467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-19T22:15:26.128625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-19T22:15:26.128820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-19T22:15:26.128986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-19T22:15:26.129147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-19T22:15:26.129297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-09-19T22:15:26.129452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-19T22:15:26.129600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-19T22:15:26.129774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-19T22:15:26.129948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-19T22:15:26.130153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-19T22:15:26.130297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-19T22:15:26.130427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-19T22:15:26.130560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-19T22:15:26.130736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-19T22:15:26.130916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-19T22:15:26.131056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-19T22:15:26.131197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-19T22:15:26.131363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-19T22:15:26.131510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-19T22:15:26.131681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-19T22:15:26.131820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-19T22:15:26.131964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-19T22:15:26.132134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-19T22:15:26.132307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-19T22:15:26.132460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-19T22:15:26.132765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-19T22:15:26.132922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-19T22:15:26.133075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-19T22:15:26.133208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-19T22:15:26.133339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-19T22:15:26.133487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-19T22:15:26.133795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-19T22:15:26.133999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-19T22:15:26.134172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-19T22:15:26.134282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-19T22:15:26.134476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-19T22:15:26.134626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-19T22:15:26.134807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-19T22:15:26.134960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-19T22:15:26.135098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-19T22:15:26.135227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-19T22:15:26.135410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-19T22:15:26.135572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-19T22:15:26.135752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-19T22:15:26.135920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-19T22:15:26.136079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-19T22:15:26.136245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-19T22:15:26.136425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-19T22:15:26.136591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-19T22:15:26.136770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-19T22:15:26.136890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-19T22:15:26.137042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-19T22:15:26.137213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-19T22:15:26.137377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-19T22:15:26.137555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-19T22:15:26.137738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-19T22:15:26.137903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-19T22:15:26.138046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-19T22:15:26.138199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-19T22:15:26.138356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-19T22:15:26.138532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-19T22:15:26.138755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-19T22:15:26.138934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-19T22:15:26.139164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-19T22:15:26.139289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-19T22:15:26.139428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-19T22:15:26.139567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-19T22:15:26.139729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-19T22:15:26.139907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-19T22:15:26.140059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-19T22:15:26.140210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-19T22:15:26.140355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-19T22:15:26.140505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-19T22:15:26.140674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-19T22:15:26.140822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-19T22:15:26.140987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-19T22:15:26.141122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-19T22:15:26.141486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-19T22:15:26.141622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-19T22:15:26.141908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-19T22:15:26.142058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-19T22:15:26.142197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-19T22:15:26.142358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-19T22:15:26.142576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-19T22:15:26.142728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-19T22:15:26.142885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-19T22:15:26.143055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-19T22:15:26.143204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-19T22:15:26.143373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPI.csv [2025-09-19T22:15:26.143706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-19T22:15:26.143882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-19T22:15:26.144028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-19T22:15:26.144165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-19T22:15:26.144318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-19T22:15:26.144496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-19T22:15:26.144631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-19T22:15:26.144852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-19T22:15:26.144982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-19T22:15:26.145139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-19T22:15:26.145305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-19T22:15:26.145426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-19T22:15:26.145527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-19T22:15:26.145619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-19T22:15:26.145778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-19T22:15:26.145958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-19T22:15:26.146087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-19T22:15:26.146227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-19T22:15:26.146380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-19T22:15:26.146519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-19T22:15:26.146704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-19T22:15:26.146846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-19T22:15:26.146983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-19T22:15:26.147134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-19T22:15:26.147291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-19T22:15:26.147432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-19T22:15:26.147574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-19T22:15:26.147724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-19T22:15:26.147895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-19T22:15:26.148071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-19T22:15:26.148226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-19T22:15:26.148383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-19T22:15:26.148529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-19T22:15:26.148720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-19T22:15:26.148916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-19T22:15:26.149072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-19T22:15:26.149244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-19T22:15:26.149405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-19T22:15:26.149563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-19T22:15:26.149882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-19T22:15:26.150016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-19T22:15:26.150150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-19T22:15:26.150317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-19T22:15:26.150476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-19T22:15:26.150619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-19T22:15:26.150785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-19T22:15:26.150908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-19T22:15:26.151029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-19T22:15:26.151208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-19T22:15:26.151361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-19T22:15:26.151516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-19T22:15:26.151798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-19T22:15:26.151952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-19T22:15:26.152135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-19T22:15:26.152277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-19T22:15:26.152405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-19T22:15:26.152533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-19T22:15:26.152721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-19T22:15:26.152858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-19T22:15:26.153010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-19T22:15:26.153160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-19T22:15:26.153300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-19T22:15:26.153463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-19T22:15:26.153629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-19T22:15:26.153798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-19T22:15:26.153925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-19T22:15:26.154025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-19T22:15:26.154146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-19T22:15:26.154288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-19T22:15:26.154454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-19T22:15:26.154573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-19T22:15:26.154711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-19T22:15:26.154859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-19T22:15:26.155026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-19T22:15:26.155182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-19T22:15:26.155325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-19T22:15:26.155488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-19T22:15:26.155664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-19T22:15:26.155822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-19T22:15:26.155965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-19T22:15:26.156104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-19T22:15:26.156279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-19T22:15:26.156419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-19T22:15:26.156575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-19T22:15:26.156987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-19T22:15:26.157150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-19T22:15:26.157357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-19T22:15:26.157530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-19T22:15:26.157820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-19T22:15:26.157952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-19T22:15:26.158092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-19T22:15:26.158249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-19T22:15:26.158406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-19T22:15:26.158533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-19T22:15:26.158673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-19T22:15:26.158830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-19T22:15:26.158978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-19T22:15:26.159125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-19T22:15:26.159281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-19T22:15:26.159420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-19T22:15:26.159572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-19T22:15:26.159733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-19T22:15:26.159875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-19T22:15:26.160029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-19T22:15:26.160176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-19T22:15:26.160321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-19T22:15:26.160471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-19T22:15:26.160635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-19T22:15:26.160860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-19T22:15:26.161009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-19T22:15:26.161148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-19T22:15:26.161293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-19T22:15:26.161446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-19T22:15:26.161600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-19T22:15:26.161769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-19T22:15:26.161924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-19T22:15:26.162044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-19T22:15:26.162168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-19T22:15:26.162302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-19T22:15:26.162452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-19T22:15:26.162598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-19T22:15:26.162823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-19T22:15:26.162984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-19T22:15:26.163129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-19T22:15:26.163272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-19T22:15:26.163400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-19T22:15:26.163533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-19T22:15:26.163701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-19T22:15:26.163839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-19T22:15:26.163989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-19T22:15:26.164110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-19T22:15:26.164220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-19T22:15:26.164364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-19T22:15:26.164555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-19T22:15:26.164738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-19T22:15:26.164878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-19T22:15:26.165016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-19T22:15:26.165162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-19T22:15:26.165332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-19T22:15:26.165481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-19T22:15:26.165629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-19T22:15:26.165902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-19T22:15:26.166023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-19T22:15:26.166158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-19T22:15:26.166301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-19T22:15:26.166426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-19T22:15:26.166737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-19T22:15:26.166888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-19T22:15:26.167029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-19T22:15:26.167177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-19T22:15:26.167310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-19T22:15:26.167428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-19T22:15:26.167542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-19T22:15:26.167709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-19T22:15:26.167876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-19T22:15:26.168013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-19T22:15:26.168157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-19T22:15:26.168326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-19T22:15:26.168456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-19T22:15:26.168603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-19T22:15:26.168774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-19T22:15:26.168919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-19T22:15:26.169050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-19T22:15:26.169150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-19T22:15:26.169284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-19T22:15:26.169441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-19T22:15:26.169591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-19T22:15:26.169764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-19T22:15:26.169908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-19T22:15:26.170060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-19T22:15:26.170207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-19T22:15:26.170365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-19T22:15:26.170507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-19T22:15:26.170703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-19T22:15:26.170849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-19T22:15:26.170978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-19T22:15:26.171126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-19T22:15:26.171276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-19T22:15:26.171411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-19T22:15:26.171533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-19T22:15:26.171700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-19T22:15:26.171841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-19T22:15:26.172007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-19T22:15:26.172142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-19T22:15:26.172301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-19T22:15:26.172705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-19T22:15:26.172856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-19T22:15:26.173001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-19T22:15:26.173146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-19T22:15:26.173307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-19T22:15:26.173471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-19T22:15:26.173608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-19T22:15:26.173907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-19T22:15:26.174045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-19T22:15:26.174207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-19T22:15:26.174617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-19T22:15:26.174795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-19T22:15:26.174963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-19T22:15:26.175090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-19T22:15:26.175226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-19T22:15:26.175394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-19T22:15:26.175518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-19T22:15:26.175675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-19T22:15:26.175873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-19T22:15:26.176035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-19T22:15:26.176163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-19T22:15:26.176280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-19T22:15:26.176431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-19T22:15:26.176570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-19T22:15:26.176754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-19T22:15:26.176896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-19T22:15:26.177046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-19T22:15:26.177205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-19T22:15:26.177347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-19T22:15:26.177505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-19T22:15:26.177675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-19T22:15:26.177832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-19T22:15:26.177982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-19T22:15:26.178152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-19T22:15:26.178307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-19T22:15:26.178463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-19T22:15:26.178606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-19T22:15:26.178762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-19T22:15:26.178896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-19T22:15:26.179014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-19T22:15:26.179137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-19T22:15:26.179300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-19T22:15:26.179411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-19T22:15:26.179597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-19T22:15:26.179765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-19T22:15:26.179933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-19T22:15:26.180076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-19T22:15:26.180265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-19T22:15:26.180409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-19T22:15:26.180552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-19T22:15:26.180720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-19T22:15:26.180876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-19T22:15:26.181036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-19T22:15:26.181175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-19T22:15:26.181331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-19T22:15:26.181466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-19T22:15:26.181614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-19T22:15:26.181916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-19T22:15:26.182072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-19T22:15:26.182216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-19T22:15:26.182483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-19T22:15:26.182620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-19T22:15:26.182778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-19T22:15:26.182912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-19T22:15:26.183067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-19T22:15:26.183205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-19T22:15:26.183344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-19T22:15:26.183483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-19T22:15:26.183612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-19T22:15:26.183756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-19T22:15:26.183893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-19T22:15:26.184039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-19T22:15:26.184184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-19T22:15:26.184358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-19T22:15:26.184564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-19T22:15:26.184755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-19T22:15:26.184888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-19T22:15:26.185038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-19T22:15:26.185167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-19T22:15:26.185315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-19T22:15:26.185471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-19T22:15:26.185609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-19T22:15:26.185891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-19T22:15:26.186011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-19T22:15:26.186139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-19T22:15:26.186290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-19T22:15:26.186415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-19T22:15:26.186555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-19T22:15:26.186951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-19T22:15:26.187109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-19T22:15:26.187236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-19T22:15:26.187368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-19T22:15:26.187529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-19T22:15:26.187729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-19T22:15:26.187886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-19T22:15:26.188028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-19T22:15:26.188175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-19T22:15:26.188303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-19T22:15:26.188405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-19T22:15:26.188519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-19T22:15:26.188698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-19T22:15:26.188850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-19T22:15:26.188989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-19T22:15:26.189111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-19T22:15:26.189221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-19T22:15:26.189346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-19T22:15:26.189458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-19T22:15:26.189625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-19T22:15:26.189805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-19T22:15:26.189938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-19T22:15:26.190052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-09-19T22:15:26.190176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-19T22:15:26.190276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-19T22:15:26.190367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-19T22:15:26.190525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-19T22:15:26.190702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-19T22:15:26.190844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-19T22:15:26.190988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-19T22:15:26.191112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-19T22:15:26.191243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-19T22:15:26.191429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-19T22:15:26.191554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-19T22:15:26.191706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-19T22:15:26.191881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-19T22:15:26.192031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-19T22:15:26.192174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-19T22:15:26.192329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-19T22:15:26.192479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-19T22:15:26.192623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-19T22:15:26.192815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-19T22:15:26.192974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-19T22:15:26.193095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-19T22:15:26.193233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-19T22:15:26.193360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-19T22:15:26.193490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-19T22:15:26.193615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-19T22:15:26.193864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-19T22:15:26.193997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-19T22:15:26.194123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-19T22:15:26.194245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-19T22:15:26.194409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-19T22:15:26.194715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-19T22:15:26.194876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-19T22:15:26.195014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-19T22:15:26.195181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-19T22:15:26.195306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-19T22:15:26.195410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-19T22:15:26.195541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-19T22:15:26.195705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-19T22:15:26.195850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-19T22:15:26.195998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-19T22:15:26.196149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-19T22:15:26.196300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-19T22:15:26.196417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-19T22:15:26.196537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-19T22:15:26.196703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-19T22:15:26.196859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-19T22:15:26.196995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-19T22:15:26.197132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-19T22:15:26.197281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-19T22:15:26.197424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-19T22:15:26.197572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-19T22:15:26.197723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-19T22:15:26.197875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-19T22:15:26.198040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-19T22:15:26.198212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-19T22:15:26.198343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-19T22:15:26.198499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-19T22:15:26.198704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-19T22:15:26.198886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-19T22:15:26.199024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-19T22:15:26.199167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-19T22:15:26.199331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-19T22:15:26.199585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-19T22:15:26.199748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-19T22:15:26.199873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-19T22:15:26.199997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-19T22:15:26.200134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-19T22:15:26.200268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-19T22:15:26.200417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-19T22:15:26.200536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-19T22:15:26.200693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-19T22:15:26.200841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-19T22:15:26.200998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-19T22:15:26.201121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-09-19T22:15:26.201429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-19T22:15:26.201560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-19T22:15:26.201750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-19T22:15:26.201897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-19T22:15:26.202038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-19T22:15:26.202161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-19T22:15:26.202291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-19T22:15:26.202448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-19T22:15:26.202590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-19T22:15:26.202767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-19T22:15:26.202906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-19T22:15:26.203045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-19T22:15:26.203192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-19T22:15:26.203323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-19T22:15:26.203447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-19T22:15:26.203578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-19T22:15:26.203709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-19T22:15:26.203860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-19T22:15:26.204016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-19T22:15:26.204150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-19T22:15:26.204283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-19T22:15:26.207977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-19T22:15:26.208227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-19T22:15:26.208362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-19T22:15:26.208505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-19T22:15:26.208675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-19T22:15:26.208801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-19T22:15:26.208944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-09-19T22:15:26.209085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-19T22:15:26.209233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-19T22:15:26.209383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-19T22:15:26.209534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-19T22:15:26.209696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-19T22:15:26.209863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-19T22:15:26.210007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-19T22:15:26.210149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-19T22:15:26.210295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-19T22:15:26.210409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-19T22:15:26.210526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-19T22:15:26.210675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-19T22:15:26.210818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-19T22:15:26.210935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-19T22:15:26.211247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-19T22:15:26.211382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-19T22:15:26.211500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-19T22:15:26.211595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-19T22:15:26.211726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-19T22:15:26.211870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-19T22:15:26.212049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-19T22:15:26.212197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-19T22:15:26.212355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-19T22:15:26.212497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-19T22:15:26.212799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-19T22:15:26.212945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-19T22:15:26.213070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-19T22:15:26.213185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-19T22:15:26.213332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-19T22:15:26.213470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-19T22:15:26.213606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-19T22:15:26.213782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-19T22:15:26.213954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-19T22:15:26.214102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-19T22:15:26.214303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-19T22:15:26.214469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-19T22:15:26.214628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-19T22:15:26.214823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-19T22:15:26.214973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-19T22:15:26.215124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-19T22:15:26.215258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-19T22:15:26.215400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-19T22:15:26.215559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-19T22:15:26.215783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-19T22:15:26.215925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-19T22:15:26.216056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-19T22:15:26.216182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-19T22:15:26.216338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-19T22:15:26.216493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-19T22:15:26.216678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-19T22:15:26.216821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-19T22:15:26.216945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-19T22:15:26.217101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-19T22:15:26.217371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-19T22:15:26.217524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-19T22:15:26.217690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-19T22:15:26.217837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-19T22:15:26.218003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-19T22:15:26.218154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-19T22:15:26.218317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-19T22:15:26.218467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-19T22:15:26.218631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-19T22:15:26.218805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-19T22:15:26.218930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-19T22:15:26.219058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-19T22:15:26.219182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-19T22:15:26.219285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-19T22:15:26.219536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-19T22:15:26.219728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-19T22:15:26.219880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-19T22:15:26.220045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-19T22:15:26.220209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-19T22:15:26.220369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-19T22:15:26.220491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-19T22:15:26.220632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-19T22:15:26.220953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-19T22:15:26.221078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-19T22:15:26.221208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-19T22:15:26.221361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-19T22:15:26.221519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-19T22:15:26.221687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-19T22:15:26.222027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-19T22:15:26.222176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-19T22:15:26.222310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-19T22:15:26.222444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-19T22:15:26.222598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-19T22:15:26.222771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-19T22:15:26.222920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-19T22:15:26.223071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-19T22:15:26.223331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-19T22:15:26.223469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-19T22:15:26.223583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-19T22:15:26.223764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-19T22:15:26.223913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-19T22:15:26.224051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-19T22:15:26.224200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-19T22:15:26.224411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-19T22:15:26.224568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-19T22:15:26.224716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-19T22:15:26.224876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-19T22:15:26.225030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-19T22:15:26.225172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-19T22:15:26.225323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-19T22:15:26.225442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-19T22:15:26.225559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-19T22:15:26.225763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-19T22:15:26.225891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-19T22:15:26.226021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-19T22:15:26.226185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-19T22:15:26.226340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-19T22:15:26.226480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-19T22:15:26.226659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-19T22:15:26.226801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-09-19T22:15:26.226977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-19T22:15:26.227136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-19T22:15:26.227290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-19T22:15:26.227532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-19T22:15:26.227708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-19T22:15:26.227874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-19T22:15:26.228004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-19T22:15:26.228128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-19T22:15:26.228250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-19T22:15:26.228351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-19T22:15:26.228466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-19T22:15:26.228590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-19T22:15:26.228805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-19T22:15:26.228956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-19T22:15:26.229098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-19T22:15:26.229220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-19T22:15:26.229362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-19T22:15:26.229501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-19T22:15:26.229677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-19T22:15:26.229812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-19T22:15:26.229949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-19T22:15:26.230089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-19T22:15:26.230236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-19T22:15:26.230367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-19T22:15:26.230513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-19T22:15:26.230677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-19T22:15:26.230802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-19T22:15:26.230918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-19T22:15:26.231064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-19T22:15:26.231227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-19T22:15:26.231376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-19T22:15:26.231713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-19T22:15:26.231863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-19T22:15:26.232023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-19T22:15:26.232180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-19T22:15:26.232336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-19T22:15:26.232476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-19T22:15:26.232609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-19T22:15:26.232862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-19T22:15:26.232986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-19T22:15:26.233134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-19T22:15:26.233295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-19T22:15:26.233468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-19T22:15:26.233594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-19T22:15:26.233724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-19T22:15:26.233850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-19T22:15:26.233981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-19T22:15:26.234111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-19T22:15:26.234215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-19T22:15:26.234328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-19T22:15:26.234512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-19T22:15:26.234670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-19T22:15:26.234832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-19T22:15:26.234993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-19T22:15:26.235172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-19T22:15:26.235314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-19T22:15:26.235464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-19T22:15:26.235617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-19T22:15:26.235804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-19T22:15:26.235972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-19T22:15:26.236116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-19T22:15:26.236245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-19T22:15:26.236346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-19T22:15:26.236476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-19T22:15:26.236600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-19T22:15:26.236739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-19T22:15:26.236903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-19T22:15:26.237039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-19T22:15:26.237151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-19T22:15:26.237284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-19T22:15:26.237420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-19T22:15:26.237582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-19T22:15:26.237798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-19T22:15:26.238002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-19T22:15:26.238104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-19T22:15:26.238219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-19T22:15:26.238361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-19T22:15:26.238489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-19T22:15:26.238590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-19T22:15:26.238721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-19T22:15:26.238870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-19T22:15:26.239023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-19T22:15:26.239187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-19T22:15:26.239343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-19T22:15:26.239493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-19T22:15:26.239613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-19T22:15:26.239802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-19T22:15:26.239952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-19T22:15:26.240104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-19T22:15:26.240281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-19T22:15:26.240408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-19T22:15:26.240875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-19T22:15:26.241032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-19T22:15:26.241176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-19T22:15:26.241335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-19T22:15:26.241483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-19T22:15:26.241665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-19T22:15:26.241822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-19T22:15:26.241948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-19T22:15:26.242069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-19T22:15:26.242240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-19T22:15:26.242365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-19T22:15:26.242475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-19T22:15:26.242575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-19T22:15:26.242708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-19T22:15:26.242894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-19T22:15:26.243016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-19T22:15:26.243352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-19T22:15:26.243479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-19T22:15:26.243606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-19T22:15:26.243815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-19T22:15:26.243965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-19T22:15:26.244089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-19T22:15:26.244208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-19T22:15:26.244327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-19T22:15:26.244473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-19T22:15:26.244622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-19T22:15:26.244791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-19T22:15:26.244915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-19T22:15:26.245025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-19T22:15:26.245182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-19T22:15:26.245313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-19T22:15:26.245426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-19T22:15:26.245550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-19T22:15:26.245705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-19T22:15:26.246040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-19T22:15:26.246193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-19T22:15:26.246309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-19T22:15:26.246409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-19T22:15:26.246538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-19T22:15:26.246707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-19T22:15:26.246863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-19T22:15:26.247012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-19T22:15:26.247138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-19T22:15:26.247238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-19T22:15:26.247367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-19T22:15:26.247508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-19T22:15:26.247627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-19T22:15:26.247804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-19T22:15:26.247986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-19T22:15:26.248139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-19T22:15:26.248282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-19T22:15:26.248439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-19T22:15:26.248602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-19T22:15:26.248842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-19T22:15:26.248997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-19T22:15:26.249139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-19T22:15:26.249291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-19T22:15:26.249459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-19T22:15:26.249599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-19T22:15:26.249747] [INFO ] [LOCAL ] Deleted 1989 derivative data files. [2025-09-19T22:15:26.249811] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-19T22:15:26.251922] [INFO ] [LOCAL ] Found 2093 symbols with primary data. [2025-09-19T22:15:26.252230] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2093 symbols [2025-09-19T22:15:26.253845] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:26.253197] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:26.254221] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:26.290092] [DEBUG] [LOCAL ] AB: Loaded 29406 existing records from primary storage. [2025-09-19T22:15:26.290309] [INFO ] [MAIN ] AB: Loaded 29406 primary data records. [2025-09-19T22:15:26.511551] [DEBUG] [LOCAL ] AA: Loaded 54365 existing records from primary storage. [2025-09-19T22:15:26.510850] [DEBUG] [LOCAL ] A: Loaded 51608 existing records from primary storage. [2025-09-19T22:15:26.511821] [INFO ] [MAIN ] AA: Loaded 54365 primary data records. [2025-09-19T22:15:26.539186] [INFO ] [MAIN ] A: Loaded 51608 primary data records. [2025-09-19T22:15:27.373480] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:27.374603] [INFO ] [MAIN ] AB: Generated 1820 derivative records from 29406 primary records. [2025-09-19T22:15:27.374855] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-19T22:15:27.396276] [DEBUG] [LOCAL ] AB: Derivative data saved (1820 records). [2025-09-19T22:15:27.408878] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-19T22:15:27.410759] [INFO ] [MAIN ] Derivative Progress: 1/2093 symbols completed. AB took 1.2s. Estimated remaining: 40m 24s. Rate: 51.8 symbols/min [2025-09-19T22:15:27.411174] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:27.412033] [INFO ] [MAIN ] AA: Generated 1820 derivative records from 54365 primary records. [2025-09-19T22:15:27.413313] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-19T22:15:27.413482] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:27.440973] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:27.442188] [INFO ] [MAIN ] A: Generated 1820 derivative records from 51608 primary records. [2025-09-19T22:15:27.442572] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-19T22:15:27.458134] [DEBUG] [LOCAL ] AA: Derivative data saved (1820 records). [2025-09-19T22:15:27.458773] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-19T22:15:27.461305] [INFO ] [MAIN ] Derivative Progress: 2/2093 symbols completed. AA took 1.2s. Estimated remaining: 21m 4s. Rate: 99.2 symbols/min [2025-09-19T22:15:27.462033] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:27.466055] [DEBUG] [LOCAL ] A: Derivative data saved (1820 records). [2025-09-19T22:15:27.466187] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-19T22:15:27.469017] [INFO ] [MAIN ] Derivative Progress: 3/2093 symbols completed. A took 1.2s. Estimated remaining: 14m 8s. Rate: 147.9 symbols/min [2025-09-19T22:15:27.469402] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:27.510269] [DEBUG] [LOCAL ] ABCB: Loaded 31310 existing records from primary storage. [2025-09-19T22:15:27.511082] [INFO ] [MAIN ] ABCB: Loaded 31310 primary data records. [2025-09-19T22:15:27.609334] [DEBUG] [LOCAL ] ABBV: Loaded 54467 existing records from primary storage. [2025-09-19T22:15:27.632194] [INFO ] [MAIN ] ABBV: Loaded 54467 primary data records. [2025-09-19T22:15:27.985245] [DEBUG] [LOCAL ] ABEV: Loaded 54050 existing records from primary storage. [2025-09-19T22:15:28.000344] [INFO ] [MAIN ] ABEV: Loaded 54050 primary data records. [2025-09-19T22:15:28.580243] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:28.581764] [INFO ] [MAIN ] ABCB: Generated 1820 derivative records from 31310 primary records. [2025-09-19T22:15:28.581874] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-19T22:15:28.599734] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1820 records). [2025-09-19T22:15:28.600082] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-19T22:15:28.601964] [INFO ] [MAIN ] Derivative Progress: 4/2093 symbols completed. ABCB took 1.1s. Estimated remaining: 20m 27s. Rate: 102.1 symbols/min [2025-09-19T22:15:28.603617] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:28.621324] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:28.622098] [INFO ] [MAIN ] ABBV: Generated 1820 derivative records from 54467 primary records. [2025-09-19T22:15:28.622294] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-19T22:15:28.644502] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1820 records). [2025-09-19T22:15:28.644625] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-19T22:15:28.647552] [INFO ] [MAIN ] Derivative Progress: 5/2093 symbols completed. ABBV took 1.2s. Estimated remaining: 16m 40s. Rate: 125.2 symbols/min [2025-09-19T22:15:28.648805] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:28.669614] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:28.670174] [DEBUG] [LOCAL ] ABG: Loaded 19221 existing records from primary storage. [2025-09-19T22:15:28.670893] [INFO ] [MAIN ] ABEV: Generated 1820 derivative records from 54050 primary records. [2025-09-19T22:15:28.670976] [INFO ] [MAIN ] ABG: Loaded 19221 primary data records. [2025-09-19T22:15:28.692075] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-19T22:15:28.900802] [DEBUG] [LOCAL ] ABM: Loaded 32750 existing records from primary storage. [2025-09-19T22:15:28.901435] [INFO ] [MAIN ] ABM: Loaded 32750 primary data records. [2025-09-19T22:15:28.979725] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1820 records). [2025-09-19T22:15:29.043073] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-19T22:15:29.067234] [INFO ] [MAIN ] Derivative Progress: 6/2093 symbols completed. ABEV took 1.6s. Estimated remaining: 16m 19s. Rate: 127.9 symbols/min [2025-09-19T22:15:29.083689] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:29.419185] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:29.420095] [INFO ] [MAIN ] ABG: Generated 1820 derivative records from 19221 primary records. [2025-09-19T22:15:29.420243] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-19T22:15:29.454842] [DEBUG] [LOCAL ] ABG: Derivative data saved (1820 records). [2025-09-19T22:15:29.455008] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-19T22:15:29.457092] [INFO ] [MAIN ] Derivative Progress: 7/2093 symbols completed. ABG took 0.9s. Estimated remaining: 15m 55s. Rate: 131.0 symbols/min [2025-09-19T22:15:29.458297] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:29.475277] [DEBUG] [LOCAL ] ABR: Loaded 52915 existing records from primary storage. [2025-09-19T22:15:29.476500] [INFO ] [MAIN ] ABR: Loaded 52915 primary data records. [2025-09-19T22:15:29.581928] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:29.593189] [INFO ] [MAIN ] ABM: Generated 1820 derivative records from 32750 primary records. [2025-09-19T22:15:29.599066] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-19T22:15:29.818274] [DEBUG] [LOCAL ] ABM: Derivative data saved (1820 records). [2025-09-19T22:15:29.819225] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-19T22:15:29.835728] [INFO ] [MAIN ] Derivative Progress: 8/2093 symbols completed. ABM took 1.2s. Estimated remaining: 15m 34s. Rate: 133.9 symbols/min [2025-09-19T22:15:29.837857] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:29.839137] [DEBUG] [LOCAL ] ABT: Loaded 54400 existing records from primary storage. [2025-09-19T22:15:29.840692] [INFO ] [MAIN ] ABT: Loaded 54400 primary data records. [2025-09-19T22:15:30.174249] [DEBUG] [LOCAL ] ACA: Loaded 24626 existing records from primary storage. [2025-09-19T22:15:30.176229] [INFO ] [MAIN ] ACA: Loaded 24626 primary data records. [2025-09-19T22:15:30.257295] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:30.299575] [INFO ] [MAIN ] ABR: Generated 1820 derivative records from 52915 primary records. [2025-09-19T22:15:30.299853] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-19T22:15:30.427571] [DEBUG] [LOCAL ] ABR: Derivative data saved (1820 records). [2025-09-19T22:15:30.567954] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-19T22:15:30.579668] [INFO ] [MAIN ] Derivative Progress: 9/2093 symbols completed. ABR took 1.5s. Estimated remaining: 16m 42s. Rate: 124.8 symbols/min [2025-09-19T22:15:30.581366] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:30.602919] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:30.604255] [INFO ] [MAIN ] ABT: Generated 1820 derivative records from 54400 primary records. [2025-09-19T22:15:30.605030] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-19T22:15:30.626846] [DEBUG] [LOCAL ] ABT: Derivative data saved (1820 records). [2025-09-19T22:15:30.627141] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-19T22:15:30.629443] [INFO ] [MAIN ] Derivative Progress: 10/2093 symbols completed. ABT took 1.2s. Estimated remaining: 15m 12s. Rate: 137.1 symbols/min [2025-09-19T22:15:30.630073] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:30.661161] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:30.673198] [INFO ] [MAIN ] ACA: Generated 1820 derivative records from 24626 primary records. [2025-09-19T22:15:30.673439] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-19T22:15:30.675183] [DEBUG] [LOCAL ] ACCO: Loaded 38568 existing records from primary storage. [2025-09-19T22:15:30.682782] [INFO ] [MAIN ] ACCO: Loaded 38568 primary data records. [2025-09-19T22:15:30.792286] [DEBUG] [LOCAL ] ACEL: Loaded 27839 existing records from primary storage. [2025-09-19T22:15:30.803242] [INFO ] [MAIN ] ACEL: Loaded 27839 primary data records. [2025-09-19T22:15:30.869530] [DEBUG] [LOCAL ] ACA: Derivative data saved (1820 records). [2025-09-19T22:15:30.918054] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-19T22:15:30.938627] [INFO ] [MAIN ] Derivative Progress: 11/2093 symbols completed. ACA took 1.1s. Estimated remaining: 14m 47s. Rate: 140.8 symbols/min [2025-09-19T22:15:30.970037] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:31.414011] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:31.432217] [INFO ] [MAIN ] ACCO: Generated 1820 derivative records from 38568 primary records. [2025-09-19T22:15:31.431057] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-09-19T22:15:31.433672] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-19T22:15:31.434677] [INFO ] [MAIN ] ACHR: Loaded 54598 primary data records. [2025-09-19T22:15:31.521452] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:31.550280] [INFO ] [MAIN ] ACEL: Generated 1820 derivative records from 27839 primary records. [2025-09-19T22:15:31.549162] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1820 records). [2025-09-19T22:15:31.558246] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-19T22:15:31.559457] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-19T22:15:31.566687] [INFO ] [MAIN ] Derivative Progress: 12/2093 symbols completed. ACCO took 1.0s. Estimated remaining: 15m 22s. Rate: 135.5 symbols/min [2025-09-19T22:15:31.581975] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:31.694745] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1820 records). [2025-09-19T22:15:31.695103] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-19T22:15:31.697237] [INFO ] [MAIN ] Derivative Progress: 13/2093 symbols completed. ACEL took 1.1s. Estimated remaining: 14m 31s. Rate: 143.2 symbols/min [2025-09-19T22:15:31.894301] [DEBUG] [LOCAL ] ACI: Loaded 54052 existing records from primary storage. [2025-09-19T22:15:31.894703] [INFO ] [MAIN ] ACI: Loaded 54052 primary data records. [2025-09-19T22:15:31.912431] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:31.956348] [INFO ] [MAIN ] ACHR: Generated 1820 derivative records from 54598 primary records. [2025-09-19T22:15:31.983729] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-19T22:15:32.084579] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1820 records). [2025-09-19T22:15:32.119554] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-19T22:15:32.122248] [INFO ] [MAIN ] Derivative Progress: 14/2093 symbols completed. ACHR took 1.2s. Estimated remaining: 14m 32s. Rate: 143.1 symbols/min [2025-09-19T22:15:32.270796] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:32.271537] [INFO ] [MAIN ] ACI: Generated 1820 derivative records from 54052 primary records. [2025-09-19T22:15:32.271600] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-19T22:15:32.287119] [DEBUG] [LOCAL ] ACI: Derivative data saved (1820 records). [2025-09-19T22:15:32.287185] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-19T22:15:32.289143] [INFO ] [MAIN ] Derivative Progress: 15/2093 symbols completed. ACI took 0.7s. Estimated remaining: 13m 56s. Rate: 149.1 symbols/min [2025-09-19T22:15:32.289880] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:32.290627] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:32.291021] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:32.337374] [DEBUG] [LOCAL ] ACP: Loaded 31749 existing records from primary storage. [2025-09-19T22:15:32.337551] [INFO ] [MAIN ] ACP: Loaded 31749 primary data records. [2025-09-19T22:15:32.491011] [DEBUG] [LOCAL ] ACM: Loaded 43847 existing records from primary storage. [2025-09-19T22:15:32.496793] [INFO ] [MAIN ] ACM: Loaded 43847 primary data records. [2025-09-19T22:15:32.530010] [DEBUG] [LOCAL ] ACN: Loaded 54199 existing records from primary storage. [2025-09-19T22:15:32.630079] [INFO ] [MAIN ] ACN: Loaded 54199 primary data records. [2025-09-19T22:15:33.371865] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:33.372944] [INFO ] [MAIN ] ACP: Generated 1820 derivative records from 31749 primary records. [2025-09-19T22:15:33.373601] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-19T22:15:33.394290] [DEBUG] [LOCAL ] ACP: Derivative data saved (1820 records). [2025-09-19T22:15:33.394532] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-19T22:15:33.396466] [INFO ] [MAIN ] Derivative Progress: 16/2093 symbols completed. ACP took 1.1s. Estimated remaining: 15m 27s. Rate: 134.4 symbols/min [2025-09-19T22:15:33.396965] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:33.413550] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:33.414713] [INFO ] [MAIN ] ACM: Generated 1820 derivative records from 43847 primary records. [2025-09-19T22:15:33.416690] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-19T22:15:33.430871] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:33.439542] [INFO ] [MAIN ] ACN: Generated 1820 derivative records from 54199 primary records. [2025-09-19T22:15:33.446675] [DEBUG] [LOCAL ] ACR: Loaded 6555 existing records from primary storage. [2025-09-19T22:15:33.450120] [INFO ] [MAIN ] ACR: Loaded 6555 primary data records. [2025-09-19T22:15:33.462921] [DEBUG] [LOCAL ] ACM: Derivative data saved (1820 records). [2025-09-19T22:15:33.462998] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-19T22:15:33.495779] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-19T22:15:33.517983] [INFO ] [MAIN ] Derivative Progress: 17/2093 symbols completed. ACM took 1.2s. Estimated remaining: 14m 47s. Rate: 140.4 symbols/min [2025-09-19T22:15:33.540743] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:33.862949] [DEBUG] [LOCAL ] ACN: Derivative data saved (1820 records). [2025-09-19T22:15:33.863868] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-19T22:15:33.866961] [INFO ] [MAIN ] Derivative Progress: 18/2093 symbols completed. ACN took 1.6s. Estimated remaining: 14m 38s. Rate: 141.8 symbols/min [2025-09-19T22:15:33.867400] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:33.883441] [DEBUG] [LOCAL ] ACRE: Loaded 34131 existing records from primary storage. [2025-09-19T22:15:33.884174] [INFO ] [MAIN ] ACRE: Loaded 34131 primary data records. [2025-09-19T22:15:33.924899] [DEBUG] [LOCAL ] ACV: Loaded 7006 existing records from primary storage. [2025-09-19T22:15:33.969862] [INFO ] [MAIN ] ACV: Loaded 7006 primary data records. [2025-09-19T22:15:34.540953] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:34.542490] [INFO ] [MAIN ] ACR: Generated 1820 derivative records from 6555 primary records. [2025-09-19T22:15:34.542696] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-19T22:15:34.564161] [DEBUG] [LOCAL ] ACR: Derivative data saved (1820 records). [2025-09-19T22:15:34.564604] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-19T22:15:34.566637] [INFO ] [MAIN ] Derivative Progress: 19/2093 symbols completed. ACR took 1.2s. Estimated remaining: 15m 8s. Rate: 137.1 symbols/min [2025-09-19T22:15:34.569178] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:34.588928] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:34.590026] [INFO ] [MAIN ] ACRE: Generated 1820 derivative records from 34131 primary records. [2025-09-19T22:15:34.590306] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-19T22:15:34.623399] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:34.625675] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1820 records). [2025-09-19T22:15:34.625261] [INFO ] [MAIN ] ACV: Generated 1820 derivative records from 7006 primary records. [2025-09-19T22:15:34.625904] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-19T22:15:34.625999] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-19T22:15:34.628625] [INFO ] [MAIN ] Derivative Progress: 20/2093 symbols completed. ACRE took 1.1s. Estimated remaining: 14m 28s. Rate: 143.3 symbols/min [2025-09-19T22:15:34.629088] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:34.645908] [DEBUG] [LOCAL ] ACV: Derivative data saved (1820 records). [2025-09-19T22:15:34.657002] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-19T22:15:34.659753] [INFO ] [MAIN ] Derivative Progress: 21/2093 symbols completed. ACV took 0.8s. Estimated remaining: 13m 50s. Rate: 149.9 symbols/min [2025-09-19T22:15:34.660192] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:34.682548] [DEBUG] [LOCAL ] ACVA: Loaded 50110 existing records from primary storage. [2025-09-19T22:15:34.682860] [INFO ] [MAIN ] ACVA: Loaded 50110 primary data records. [2025-09-19T22:15:34.808378] [DEBUG] [LOCAL ] ADCT: Loaded 34128 existing records from primary storage. [2025-09-19T22:15:34.821980] [INFO ] [MAIN ] ADCT: Loaded 34128 primary data records. [2025-09-19T22:15:35.154799] [DEBUG] [LOCAL ] ADM: Loaded 54176 existing records from primary storage. [2025-09-19T22:15:35.161064] [INFO ] [MAIN ] ADM: Loaded 54176 primary data records. [2025-09-19T22:15:35.741433] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:35.742615] [INFO ] [MAIN ] ACVA: Generated 1820 derivative records from 50110 primary records. [2025-09-19T22:15:35.743288] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-19T22:15:35.777183] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:35.778684] [INFO ] [MAIN ] ADCT: Generated 1820 derivative records from 34128 primary records. [2025-09-19T22:15:35.780360] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1820 records). [2025-09-19T22:15:35.780595] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-19T22:15:35.780516] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-19T22:15:35.783980] [INFO ] [MAIN ] Derivative Progress: 22/2093 symbols completed. ACVA took 1.2s. Estimated remaining: 14m 57s. Rate: 138.5 symbols/min [2025-09-19T22:15:35.786362] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:35.816749] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1820 records). [2025-09-19T22:15:35.817482] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:35.817700] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-19T22:15:35.819782] [INFO ] [MAIN ] Derivative Progress: 23/2093 symbols completed. ADCT took 1.2s. Estimated remaining: 14m 21s. Rate: 144.2 symbols/min [2025-09-19T22:15:35.820558] [INFO ] [MAIN ] ADM: Generated 1820 derivative records from 54176 primary records. [2025-09-19T22:15:35.820769] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-19T22:15:35.821384] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:35.838860] [DEBUG] [LOCAL ] ADM: Derivative data saved (1820 records). [2025-09-19T22:15:35.838982] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-19T22:15:35.841240] [INFO ] [MAIN ] Derivative Progress: 24/2093 symbols completed. ADM took 1.2s. Estimated remaining: 13m 47s. Rate: 150.2 symbols/min [2025-09-19T22:15:35.841711] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:35.899754] [DEBUG] [LOCAL ] ADX: Loaded 28540 existing records from primary storage. [2025-09-19T22:15:35.913237] [INFO ] [MAIN ] ADX: Loaded 28540 primary data records. [2025-09-19T22:15:35.953052] [DEBUG] [LOCAL ] ADNT: Loaded 48333 existing records from primary storage. [2025-09-19T22:15:35.974619] [INFO ] [MAIN ] ADNT: Loaded 48333 primary data records. [2025-09-19T22:15:36.061876] [DEBUG] [LOCAL ] ADT: Loaded 54231 existing records from primary storage. [2025-09-19T22:15:36.079363] [INFO ] [MAIN ] ADT: Loaded 54231 primary data records. [2025-09-19T22:15:36.929200] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:36.931830] [INFO ] [MAIN ] ADX: Generated 1820 derivative records from 28540 primary records. [2025-09-19T22:15:36.932068] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-19T22:15:36.976304] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:36.977862] [DEBUG] [LOCAL ] ADX: Derivative data saved (1820 records). [2025-09-19T22:15:36.978170] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:36.978296] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-19T22:15:36.979161] [INFO ] [MAIN ] ADNT: Generated 1820 derivative records from 48333 primary records. [2025-09-19T22:15:36.980050] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-19T22:15:36.979985] [INFO ] [MAIN ] ADT: Generated 1820 derivative records from 54231 primary records. [2025-09-19T22:15:36.982944] [INFO ] [MAIN ] Derivative Progress: 25/2093 symbols completed. ADX took 1.1s. Estimated remaining: 14m 48s. Rate: 139.8 symbols/min [2025-09-19T22:15:36.984115] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-19T22:15:36.984478] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:37.014789] [DEBUG] [LOCAL ] ADT: Derivative data saved (1820 records). [2025-09-19T22:15:37.017126] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-19T22:15:37.019306] [INFO ] [MAIN ] Derivative Progress: 26/2093 symbols completed. ADT took 1.2s. Estimated remaining: 14m 16s. Rate: 144.9 symbols/min [2025-09-19T22:15:37.020180] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:37.025921] [DEBUG] [LOCAL ] AEFC: Loaded 8763 existing records from primary storage. [2025-09-19T22:15:37.026456] [INFO ] [MAIN ] AEFC: Loaded 8763 primary data records. [2025-09-19T22:15:37.083925] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1820 records). [2025-09-19T22:15:37.107987] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-19T22:15:37.135091] [INFO ] [MAIN ] Derivative Progress: 27/2093 symbols completed. ADNT took 1.3s. Estimated remaining: 13m 53s. Rate: 148.9 symbols/min [2025-09-19T22:15:37.139405] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:37.372334] [DEBUG] [LOCAL ] AEG: Loaded 50293 existing records from primary storage. [2025-09-19T22:15:37.372953] [INFO ] [MAIN ] AEG: Loaded 50293 primary data records. [2025-09-19T22:15:37.681980] [DEBUG] [LOCAL ] AEO: Loaded 54337 existing records from primary storage. [2025-09-19T22:15:37.762186] [INFO ] [MAIN ] AEO: Loaded 54337 primary data records. [2025-09-19T22:15:37.912277] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:37.978881] [INFO ] [MAIN ] AEFC: Generated 1820 derivative records from 8763 primary records. [2025-09-19T22:15:38.102914] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-19T22:15:38.123129] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1820 records). [2025-09-19T22:15:38.123679] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-19T22:15:38.125869] [INFO ] [MAIN ] Derivative Progress: 28/2093 symbols completed. AEFC took 1.1s. Estimated remaining: 14m 36s. Rate: 141.5 symbols/min [2025-09-19T22:15:38.143699] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:38.144448] [INFO ] [MAIN ] AEG: Generated 1820 derivative records from 50293 primary records. [2025-09-19T22:15:38.144608] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-19T22:15:38.163694] [DEBUG] [LOCAL ] AEG: Derivative data saved (1820 records). [2025-09-19T22:15:38.163888] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-19T22:15:38.166098] [INFO ] [MAIN ] Derivative Progress: 29/2093 symbols completed. AEG took 1.1s. Estimated remaining: 14m 8s. Rate: 146.0 symbols/min [2025-09-19T22:15:38.178434] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:38.179028] [INFO ] [MAIN ] AEO: Generated 1820 derivative records from 54337 primary records. [2025-09-19T22:15:38.179088] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-19T22:15:38.194511] [DEBUG] [LOCAL ] AEO: Derivative data saved (1820 records). [2025-09-19T22:15:38.194570] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-19T22:15:38.197156] [INFO ] [MAIN ] Derivative Progress: 30/2093 symbols completed. AEO took 1.1s. Estimated remaining: 13m 41s. Rate: 150.7 symbols/min [2025-09-19T22:15:38.197728] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:38.197845] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:38.198580] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:38.264282] [DEBUG] [LOCAL ] AES: Loaded 54454 existing records from primary storage. [2025-09-19T22:15:38.264751] [INFO ] [MAIN ] AES: Loaded 54454 primary data records. [2025-09-19T22:15:38.426892] [DEBUG] [LOCAL ] AESI: Loaded 50259 existing records from primary storage. [2025-09-19T22:15:38.432701] [DEBUG] [LOCAL ] AER: Loaded 49562 existing records from primary storage. [2025-09-19T22:15:38.460458] [INFO ] [MAIN ] AESI: Loaded 50259 primary data records. [2025-09-19T22:15:38.489933] [INFO ] [MAIN ] AER: Loaded 49562 primary data records. [2025-09-19T22:15:39.261048] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:39.262292] [INFO ] [MAIN ] AES: Generated 1820 derivative records from 54454 primary records. [2025-09-19T22:15:39.262461] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-19T22:15:39.284305] [DEBUG] [LOCAL ] AES: Derivative data saved (1820 records). [2025-09-19T22:15:39.284551] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-19T22:15:39.286521] [INFO ] [MAIN ] Derivative Progress: 31/2093 symbols completed. AES took 1.1s. Estimated remaining: 14m 27s. Rate: 142.7 symbols/min [2025-09-19T22:15:39.287076] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:39.300327] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:39.301187] [INFO ] [MAIN ] AER: Generated 1820 derivative records from 49562 primary records. [2025-09-19T22:15:39.301465] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-19T22:15:39.326562] [DEBUG] [LOCAL ] AER: Derivative data saved (1820 records). [2025-09-19T22:15:39.327605] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-19T22:15:39.335412] [INFO ] [MAIN ] Derivative Progress: 32/2093 symbols completed. AER took 1.1s. Estimated remaining: 14m 3s. Rate: 146.8 symbols/min [2025-09-19T22:15:39.348266] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:39.343472] [DEBUG] [LOCAL ] AFB: Loaded 11692 existing records from primary storage. [2025-09-19T22:15:39.349100] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:39.349383] [INFO ] [MAIN ] AFB: Loaded 11692 primary data records. [2025-09-19T22:15:39.350124] [INFO ] [MAIN ] AESI: Generated 1820 derivative records from 50259 primary records. [2025-09-19T22:15:39.371535] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-19T22:15:39.537955] [DEBUG] [LOCAL ] AESI: Derivative data saved (1820 records). [2025-09-19T22:15:39.560131] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-19T22:15:39.598754] [INFO ] [MAIN ] Derivative Progress: 33/2093 symbols completed. AESI took 1.4s. Estimated remaining: 13m 53s. Rate: 148.4 symbols/min [2025-09-19T22:15:39.684232] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:39.695258] [DEBUG] [LOCAL ] AFG: Loaded 33259 existing records from primary storage. [2025-09-19T22:15:39.695958] [INFO ] [MAIN ] AFG: Loaded 33259 primary data records. [2025-09-19T22:15:39.755747] [DEBUG] [LOCAL ] AFGD: Loaded 1913 existing records from primary storage. [2025-09-19T22:15:39.777981] [INFO ] [MAIN ] AFGD: Loaded 1913 primary data records. [2025-09-19T22:15:40.379328] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:40.381225] [INFO ] [MAIN ] AFB: Generated 1820 derivative records from 11692 primary records. [2025-09-19T22:15:40.381356] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-19T22:15:40.402088] [DEBUG] [LOCAL ] AFB: Derivative data saved (1820 records). [2025-09-19T22:15:40.402367] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-19T22:15:40.404432] [INFO ] [MAIN ] Derivative Progress: 34/2093 symbols completed. AFB took 1.1s. Estimated remaining: 14m 17s. Rate: 144.1 symbols/min [2025-09-19T22:15:40.405015] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:40.411240] [DEBUG] [LOCAL ] AFGE: Loaded 2548 existing records from primary storage. [2025-09-19T22:15:40.411612] [INFO ] [MAIN ] AFGE: Loaded 2548 primary data records. [2025-09-19T22:15:40.546851] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:40.553597] [INFO ] [MAIN ] AFG: Generated 1820 derivative records from 33259 primary records. [2025-09-19T22:15:40.547507] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:40.563921] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-19T22:15:40.593784] [INFO ] [MAIN ] AFGD: Generated 1820 derivative records from 1913 primary records. [2025-09-19T22:15:40.636348] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-19T22:15:40.780681] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1820 records). [2025-09-19T22:15:40.783012] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-19T22:15:40.785393] [INFO ] [MAIN ] Derivative Progress: 35/2093 symbols completed. AFGD took 1.1s. Estimated remaining: 14m 15s. Rate: 144.5 symbols/min [2025-09-19T22:15:40.786072] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:40.790059] [DEBUG] [LOCAL ] AFG: Derivative data saved (1820 records). [2025-09-19T22:15:40.790676] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-19T22:15:40.793634] [INFO ] [MAIN ] Derivative Progress: 36/2093 symbols completed. AFG took 1.5s. Estimated remaining: 13m 51s. Rate: 148.5 symbols/min [2025-09-19T22:15:40.794079] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:40.816585] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-19T22:15:40.817334] [INFO ] [MAIN ] AFGE: Generated 1818 derivative records from 2548 primary records. [2025-09-19T22:15:40.817430] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-19T22:15:40.840620] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1818 records). [2025-09-19T22:15:40.840822] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-19T22:15:40.843313] [INFO ] [MAIN ] Derivative Progress: 37/2093 symbols completed. AFGE took 0.4s. Estimated remaining: 13m 31s. Rate: 152.1 symbols/min [2025-09-19T22:15:40.843811] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:40.899495] [DEBUG] [LOCAL ] AFL: Loaded 53927 existing records from primary storage. [2025-09-19T22:15:40.917049] [INFO ] [MAIN ] AFL: Loaded 53927 primary data records. [2025-09-19T22:15:40.949979] [DEBUG] [LOCAL ] AG: Loaded 54421 existing records from primary storage. [2025-09-19T22:15:41.000469] [INFO ] [MAIN ] AG: Loaded 54421 primary data records. [2025-09-19T22:15:41.198499] [DEBUG] [LOCAL ] AGCO: Loaded 43447 existing records from primary storage. [2025-09-19T22:15:41.360391] [INFO ] [MAIN ] AGCO: Loaded 43447 primary data records. [2025-09-19T22:15:41.921003] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:41.922544] [INFO ] [MAIN ] AFL: Generated 1820 derivative records from 53927 primary records. [2025-09-19T22:15:41.922833] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-19T22:15:41.953915] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:41.955536] [INFO ] [MAIN ] AG: Generated 1820 derivative records from 54421 primary records. [2025-09-19T22:15:41.956046] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-19T22:15:41.973887] [DEBUG] [LOCAL ] AFL: Derivative data saved (1820 records). [2025-09-19T22:15:41.975052] [DEBUG] [LOCAL ] AG: Derivative data saved (1820 records). [2025-09-19T22:15:41.975146] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-19T22:15:41.975250] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-19T22:15:41.977383] [INFO ] [MAIN ] Derivative Progress: 38/2093 symbols completed. AG took 1.2s. Estimated remaining: 14m 10s. Rate: 145.0 symbols/min [2025-09-19T22:15:41.980179] [INFO ] [MAIN ] Derivative Progress: 39/2093 symbols completed. AFL took 1.2s. Estimated remaining: 13m 48s. Rate: 148.8 symbols/min [2025-09-19T22:15:41.977665] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:41.981878] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:41.998425] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:41.999260] [INFO ] [MAIN ] AGCO: Generated 1820 derivative records from 43447 primary records. [2025-09-19T22:15:41.999324] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-19T22:15:42.026535] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1820 records). [2025-09-19T22:15:42.027085] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-19T22:15:42.026869] [DEBUG] [LOCAL ] AGD: Loaded 17845 existing records from primary storage. [2025-09-19T22:15:42.029610] [INFO ] [MAIN ] Derivative Progress: 40/2093 symbols completed. AGCO took 1.2s. Estimated remaining: 13m 30s. Rate: 152.1 symbols/min [2025-09-19T22:15:42.029805] [INFO ] [MAIN ] AGD: Loaded 17845 primary data records. [2025-09-19T22:15:42.041684] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:42.376133] [DEBUG] [LOCAL ] AGI: Loaded 54192 existing records from primary storage. [2025-09-19T22:15:42.377461] [INFO ] [MAIN ] AGI: Loaded 54192 primary data records. [2025-09-19T22:15:42.505115] [DEBUG] [LOCAL ] AGL: Loaded 53174 existing records from primary storage. [2025-09-19T22:15:42.544866] [INFO ] [MAIN ] AGL: Loaded 53174 primary data records. [2025-09-19T22:15:43.029242] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:43.030191] [INFO ] [MAIN ] AGD: Generated 1820 derivative records from 17845 primary records. [2025-09-19T22:15:43.030435] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-19T22:15:43.051282] [DEBUG] [LOCAL ] AGD: Derivative data saved (1820 records). [2025-09-19T22:15:43.051838] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-19T22:15:43.054086] [INFO ] [MAIN ] Derivative Progress: 41/2093 symbols completed. AGD took 1.1s. Estimated remaining: 14m 1s. Rate: 146.4 symbols/min [2025-09-19T22:15:43.054576] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:43.077551] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:43.078357] [INFO ] [MAIN ] AGI: Generated 1820 derivative records from 54192 primary records. [2025-09-19T22:15:43.078503] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-19T22:15:43.093051] [DEBUG] [LOCAL ] AGM: Loaded 9993 existing records from primary storage. [2025-09-19T22:15:43.096363] [INFO ] [MAIN ] AGM: Loaded 9993 primary data records. [2025-09-19T22:15:43.210707] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:43.223367] [INFO ] [MAIN ] AGL: Generated 1820 derivative records from 53174 primary records. [2025-09-19T22:15:43.224370] [DEBUG] [LOCAL ] AGI: Derivative data saved (1820 records). [2025-09-19T22:15:43.224793] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-19T22:15:43.224597] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-19T22:15:43.227584] [INFO ] [MAIN ] Derivative Progress: 42/2093 symbols completed. AGI took 1.2s. Estimated remaining: 13m 49s. Rate: 148.4 symbols/min [2025-09-19T22:15:43.244449] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:43.326706] [DEBUG] [LOCAL ] AGL: Derivative data saved (1820 records). [2025-09-19T22:15:43.326863] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-19T22:15:43.442761] [INFO ] [MAIN ] Derivative Progress: 43/2093 symbols completed. AGL took 1.4s. Estimated remaining: 13m 40s. Rate: 150.1 symbols/min [2025-09-19T22:15:43.476483] [DEBUG] [LOCAL ] AGO: Loaded 28590 existing records from primary storage. [2025-09-19T22:15:43.476987] [INFO ] [MAIN ] AGO: Loaded 28590 primary data records. [2025-09-19T22:15:43.660528] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:43.690921] [INFO ] [MAIN ] AGM: Generated 1820 derivative records from 9993 primary records. [2025-09-19T22:15:43.691114] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-19T22:15:43.888139] [DEBUG] [LOCAL ] AGM: Derivative data saved (1820 records). [2025-09-19T22:15:43.888663] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-19T22:15:43.890793] [INFO ] [MAIN ] Derivative Progress: 44/2093 symbols completed. AGM took 0.8s. Estimated remaining: 13m 41s. Rate: 149.7 symbols/min [2025-09-19T22:15:43.911869] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:43.912534] [INFO ] [MAIN ] AGO: Generated 1820 derivative records from 28590 primary records. [2025-09-19T22:15:43.912598] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-19T22:15:43.928836] [DEBUG] [LOCAL ] AGO: Derivative data saved (1820 records). [2025-09-19T22:15:43.928901] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-19T22:15:43.931182] [INFO ] [MAIN ] Derivative Progress: 45/2093 symbols completed. AGO took 0.7s. Estimated remaining: 13m 25s. Rate: 152.7 symbols/min [2025-09-19T22:15:43.932090] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:43.932147] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:43.933033] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:43.992337] [DEBUG] [LOCAL ] AGRO: Loaded 34460 existing records from primary storage. [2025-09-19T22:15:44.005431] [INFO ] [MAIN ] AGRO: Loaded 34460 primary data records. [2025-09-19T22:15:44.006086] [DEBUG] [LOCAL ] AHH: Loaded 42133 existing records from primary storage. [2025-09-19T22:15:44.006349] [INFO ] [MAIN ] AHH: Loaded 42133 primary data records. [2025-09-19T22:15:44.018254] [DEBUG] [LOCAL ] AGX: Loaded 34119 existing records from primary storage. [2025-09-19T22:15:44.018463] [INFO ] [MAIN ] AGX: Loaded 34119 primary data records. [2025-09-19T22:15:45.031974] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:45.033311] [INFO ] [MAIN ] AGRO: Generated 1820 derivative records from 34460 primary records. [2025-09-19T22:15:45.034366] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-19T22:15:45.068554] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1820 records). [2025-09-19T22:15:45.068963] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-19T22:15:45.068869] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:45.084007] [INFO ] [MAIN ] AHH: Generated 1820 derivative records from 42133 primary records. [2025-09-19T22:15:45.071020] [INFO ] [MAIN ] Derivative Progress: 46/2093 symbols completed. AGRO took 1.1s. Estimated remaining: 13m 57s. Rate: 146.7 symbols/min [2025-09-19T22:15:45.084578] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:45.084193] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-19T22:15:45.086329] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:45.087245] [INFO ] [MAIN ] AGX: Generated 1820 derivative records from 34119 primary records. [2025-09-19T22:15:45.087349] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-19T22:15:45.116047] [DEBUG] [LOCAL ] AGX: Derivative data saved (1820 records). [2025-09-19T22:15:45.119688] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-19T22:15:45.122453] [INFO ] [MAIN ] Derivative Progress: 47/2093 symbols completed. AGX took 1.2s. Estimated remaining: 13m 41s. Rate: 149.4 symbols/min [2025-09-19T22:15:45.123726] [DEBUG] [LOCAL ] AHH: Derivative data saved (1820 records). [2025-09-19T22:15:45.123868] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:45.124075] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-19T22:15:45.126769] [INFO ] [MAIN ] Derivative Progress: 48/2093 symbols completed. AHH took 1.2s. Estimated remaining: 13m 24s. Rate: 152.6 symbols/min [2025-09-19T22:15:45.127312] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:45.136879] [DEBUG] [LOCAL ] AHT: Loaded 6046 existing records from primary storage. [2025-09-19T22:15:45.137051] [INFO ] [MAIN ] AHT: Loaded 6046 primary data records. [2025-09-19T22:15:45.528028] [DEBUG] [LOCAL ] AHR: Loaded 50104 existing records from primary storage. [2025-09-19T22:15:45.528498] [INFO ] [MAIN ] AHR: Loaded 50104 primary data records. [2025-09-19T22:15:45.648844] [DEBUG] [LOCAL ] AI: Loaded 54529 existing records from primary storage. [2025-09-19T22:15:45.687330] [INFO ] [MAIN ] AI: Loaded 54529 primary data records. [2025-09-19T22:15:46.153622] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:46.192079] [INFO ] [MAIN ] AHT: Generated 1820 derivative records from 6046 primary records. [2025-09-19T22:15:46.205093] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-19T22:15:46.526976] [DEBUG] [LOCAL ] AHT: Derivative data saved (1820 records). [2025-09-19T22:15:46.543261] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-19T22:15:46.546916] [INFO ] [MAIN ] Derivative Progress: 49/2093 symbols completed. AHT took 1.4s. Estimated remaining: 14m 7s. Rate: 144.9 symbols/min [2025-09-19T22:15:46.548164] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:46.579690] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:15:46.580912] [INFO ] [MAIN ] AHR: Generated 1819 derivative records from 50104 primary records. [2025-09-19T22:15:46.581524] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-19T22:15:46.610496] [DEBUG] [LOCAL ] AHR: Derivative data saved (1819 records). [2025-09-19T22:15:46.610734] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-19T22:15:46.613123] [INFO ] [MAIN ] Derivative Progress: 50/2093 symbols completed. AHR took 1.5s. Estimated remaining: 13m 52s. Rate: 147.3 symbols/min [2025-09-19T22:15:46.614753] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:46.656531] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:46.657709] [INFO ] [MAIN ] AI: Generated 1820 derivative records from 54529 primary records. [2025-09-19T22:15:46.657810] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-19T22:15:46.690380] [DEBUG] [LOCAL ] AI: Derivative data saved (1820 records). [2025-09-19T22:15:46.690808] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-19T22:15:46.694535] [INFO ] [MAIN ] Derivative Progress: 51/2093 symbols completed. AI took 1.6s. Estimated remaining: 13m 39s. Rate: 149.7 symbols/min [2025-09-19T22:15:46.694926] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:46.715602] [DEBUG] [LOCAL ] AIG: Loaded 54257 existing records from primary storage. [2025-09-19T22:15:46.723979] [INFO ] [MAIN ] AIG: Loaded 54257 primary data records. [2025-09-19T22:15:46.724552] [DEBUG] [LOCAL ] AIN: Loaded 24971 existing records from primary storage. [2025-09-19T22:15:46.729930] [INFO ] [MAIN ] AIN: Loaded 24971 primary data records. [2025-09-19T22:15:46.895213] [DEBUG] [LOCAL ] AIO: Loaded 13548 existing records from primary storage. [2025-09-19T22:15:46.932160] [INFO ] [MAIN ] AIO: Loaded 13548 primary data records. [2025-09-19T22:15:47.768278] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:47.769561] [INFO ] [MAIN ] AIG: Generated 1820 derivative records from 54257 primary records. [2025-09-19T22:15:47.769694] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-19T22:15:47.788514] [DEBUG] [LOCAL ] AIG: Derivative data saved (1820 records). [2025-09-19T22:15:47.788797] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-19T22:15:47.790874] [INFO ] [MAIN ] Derivative Progress: 52/2093 symbols completed. AIG took 1.2s. Estimated remaining: 14m 5s. Rate: 144.9 symbols/min [2025-09-19T22:15:47.793607] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:47.809756] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:47.810590] [INFO ] [MAIN ] AIN: Generated 1820 derivative records from 24971 primary records. [2025-09-19T22:15:47.810793] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-19T22:15:47.830757] [DEBUG] [LOCAL ] AIN: Derivative data saved (1820 records). [2025-09-19T22:15:47.830909] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-19T22:15:47.833638] [INFO ] [MAIN ] Derivative Progress: 53/2093 symbols completed. AIN took 1.2s. Estimated remaining: 13m 51s. Rate: 147.3 symbols/min [2025-09-19T22:15:47.841772] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:47.855252] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:47.856018] [INFO ] [MAIN ] AIO: Generated 1820 derivative records from 13548 primary records. [2025-09-19T22:15:47.856246] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-19T22:15:47.881083] [DEBUG] [LOCAL ] AIT: Loaded 28788 existing records from primary storage. [2025-09-19T22:15:47.882185] [INFO ] [MAIN ] AIT: Loaded 28788 primary data records. [2025-09-19T22:15:47.915211] [DEBUG] [LOCAL ] AIO: Derivative data saved (1820 records). [2025-09-19T22:15:47.972804] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-19T22:15:47.990697] [INFO ] [MAIN ] Derivative Progress: 54/2093 symbols completed. AIO took 1.3s. Estimated remaining: 13m 41s. Rate: 149.0 symbols/min [2025-09-19T22:15:48.013070] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:48.114465] [DEBUG] [LOCAL ] AIV: Loaded 40790 existing records from primary storage. [2025-09-19T22:15:48.228779] [INFO ] [MAIN ] AIV: Loaded 40790 primary data records. [2025-09-19T22:15:48.414300] [DEBUG] [LOCAL ] AIZ: Loaded 30801 existing records from primary storage. [2025-09-19T22:15:48.417780] [INFO ] [MAIN ] AIZ: Loaded 30801 primary data records. [2025-09-19T22:15:48.784830] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:48.929909] [INFO ] [MAIN ] AIT: Generated 1820 derivative records from 28788 primary records. [2025-09-19T22:15:48.938785] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-19T22:15:48.970131] [DEBUG] [LOCAL ] AIT: Derivative data saved (1820 records). [2025-09-19T22:15:48.970681] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-19T22:15:48.973245] [INFO ] [MAIN ] Derivative Progress: 55/2093 symbols completed. AIT took 1.2s. Estimated remaining: 14m 2s. Rate: 145.2 symbols/min [2025-09-19T22:15:48.975028] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:48.996803] [DEBUG] [LOCAL ] AIZN: Loaded 4012 existing records from primary storage. [2025-09-19T22:15:48.993887] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:48.997191] [INFO ] [MAIN ] AIZN: Loaded 4012 primary data records. [2025-09-19T22:15:48.997889] [INFO ] [MAIN ] AIV: Generated 1820 derivative records from 40790 primary records. [2025-09-19T22:15:49.029407] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-19T22:15:49.188987] [DEBUG] [LOCAL ] AIV: Derivative data saved (1820 records). [2025-09-19T22:15:49.248151] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-19T22:15:49.249030] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:49.251232] [INFO ] [MAIN ] Derivative Progress: 56/2093 symbols completed. AIV took 1.4s. Estimated remaining: 13m 57s. Rate: 146.1 symbols/min [2025-09-19T22:15:49.252049] [INFO ] [MAIN ] AIZ: Generated 1820 derivative records from 30801 primary records. [2025-09-19T22:15:49.374114] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-19T22:15:49.374204] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:49.395458] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1820 records). [2025-09-19T22:15:49.395731] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-19T22:15:49.398203] [INFO ] [MAIN ] Derivative Progress: 57/2093 symbols completed. AIZ took 1.4s. Estimated remaining: 13m 47s. Rate: 147.8 symbols/min [2025-09-19T22:15:49.399089] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:49.439458] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:49.440427] [INFO ] [MAIN ] AIZN: Generated 1820 derivative records from 4012 primary records. [2025-09-19T22:15:49.440499] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-19T22:15:49.470212] [DEBUG] [LOCAL ] AJG: Loaded 47861 existing records from primary storage. [2025-09-19T22:15:49.481586] [INFO ] [MAIN ] AJG: Loaded 47861 primary data records. [2025-09-19T22:15:49.482463] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1820 records). [2025-09-19T22:15:49.539969] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-19T22:15:49.569500] [INFO ] [MAIN ] Derivative Progress: 58/2093 symbols completed. AIZN took 0.6s. Estimated remaining: 13m 38s. Rate: 149.2 symbols/min [2025-09-19T22:15:49.609123] [DEBUG] [LOCAL ] AKR: Loaded 46371 existing records from primary storage. [2025-09-19T22:15:49.609335] [INFO ] [MAIN ] AKR: Loaded 46371 primary data records. [2025-09-19T22:15:50.161205] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:50.162227] [INFO ] [MAIN ] AJG: Generated 1820 derivative records from 47861 primary records. [2025-09-19T22:15:50.162379] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-19T22:15:50.192101] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:50.193388] [INFO ] [MAIN ] AKR: Generated 1820 derivative records from 46371 primary records. [2025-09-19T22:15:50.193702] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-19T22:15:50.195056] [DEBUG] [LOCAL ] AJG: Derivative data saved (1820 records). [2025-09-19T22:15:50.195134] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-19T22:15:50.197253] [INFO ] [MAIN ] Derivative Progress: 59/2093 symbols completed. AJG took 0.8s. Estimated remaining: 13m 46s. Rate: 147.8 symbols/min [2025-09-19T22:15:50.212722] [DEBUG] [LOCAL ] AKR: Derivative data saved (1820 records). [2025-09-19T22:15:50.212791] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-19T22:15:50.214954] [INFO ] [MAIN ] Derivative Progress: 60/2093 symbols completed. AKR took 0.8s. Estimated remaining: 13m 32s. Rate: 150.2 symbols/min [2025-09-19T22:15:50.215476] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:50.215707] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:50.215592] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:50.334553] [DEBUG] [LOCAL ] ALC: Loaded 51559 existing records from primary storage. [2025-09-19T22:15:50.336637] [INFO ] [MAIN ] ALC: Loaded 51559 primary data records. [2025-09-19T22:15:50.338295] [DEBUG] [LOCAL ] ALB: Loaded 54006 existing records from primary storage. [2025-09-19T22:15:50.360335] [DEBUG] [LOCAL ] AL: Loaded 44621 existing records from primary storage. [2025-09-19T22:15:50.382509] [INFO ] [MAIN ] ALB: Loaded 54006 primary data records. [2025-09-19T22:15:50.394632] [INFO ] [MAIN ] AL: Loaded 44621 primary data records. [2025-09-19T22:15:51.318919] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:51.334207] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:51.335858] [INFO ] [MAIN ] AL: Generated 1820 derivative records from 44621 primary records. [2025-09-19T22:15:51.328144] [INFO ] [MAIN ] ALC: Generated 1820 derivative records from 51559 primary records. [2025-09-19T22:15:51.336153] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-19T22:15:51.336303] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-19T22:15:51.360094] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:51.371518] [INFO ] [MAIN ] ALB: Generated 1820 derivative records from 54006 primary records. [2025-09-19T22:15:51.375913] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-19T22:15:51.399436] [DEBUG] [LOCAL ] ALC: Derivative data saved (1820 records). [2025-09-19T22:15:51.400489] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-19T22:15:51.399351] [DEBUG] [LOCAL ] AL: Derivative data saved (1820 records). [2025-09-19T22:15:51.401562] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-19T22:15:51.406549] [INFO ] [MAIN ] Derivative Progress: 61/2093 symbols completed. ALC took 1.2s. Estimated remaining: 13m 58s. Rate: 145.5 symbols/min [2025-09-19T22:15:51.409634] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:51.409560] [INFO ] [MAIN ] Derivative Progress: 62/2093 symbols completed. AL took 1.2s. Estimated remaining: 13m 44s. Rate: 147.9 symbols/min [2025-09-19T22:15:51.410525] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:51.411111] [DEBUG] [LOCAL ] ALB: Derivative data saved (1820 records). [2025-09-19T22:15:51.411604] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-19T22:15:51.414996] [INFO ] [MAIN ] Derivative Progress: 63/2093 symbols completed. ALB took 1.2s. Estimated remaining: 13m 31s. Rate: 150.2 symbols/min [2025-09-19T22:15:51.415561] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:51.432456] [DEBUG] [LOCAL ] ALG: Loaded 10840 existing records from primary storage. [2025-09-19T22:15:51.432745] [INFO ] [MAIN ] ALG: Loaded 10840 primary data records. [2025-09-19T22:15:51.539937] [DEBUG] [LOCAL ] ALE: Loaded 30622 existing records from primary storage. [2025-09-19T22:15:51.545638] [INFO ] [MAIN ] ALE: Loaded 30622 primary data records. [2025-09-19T22:15:51.665103] [DEBUG] [LOCAL ] ALEX: Loaded 32090 existing records from primary storage. [2025-09-19T22:15:51.703035] [INFO ] [MAIN ] ALEX: Loaded 32090 primary data records. [2025-09-19T22:15:52.469292] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:52.471075] [INFO ] [MAIN ] ALG: Generated 1820 derivative records from 10840 primary records. [2025-09-19T22:15:52.471284] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-19T22:15:52.500820] [DEBUG] [LOCAL ] ALG: Derivative data saved (1820 records). [2025-09-19T22:15:52.501286] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-19T22:15:52.503230] [INFO ] [MAIN ] Derivative Progress: 64/2093 symbols completed. ALG took 1.1s. Estimated remaining: 13m 52s. Rate: 146.3 symbols/min [2025-09-19T22:15:52.501138] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:52.504113] [INFO ] [MAIN ] ALE: Generated 1820 derivative records from 30622 primary records. [2025-09-19T22:15:52.504761] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:52.504413] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-19T22:15:52.522923] [DEBUG] [LOCAL ] ALE: Derivative data saved (1820 records). [2025-09-19T22:15:52.524049] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-19T22:15:52.527188] [INFO ] [MAIN ] Derivative Progress: 65/2093 symbols completed. ALE took 1.1s. Estimated remaining: 13m 40s. Rate: 148.4 symbols/min [2025-09-19T22:15:52.527867] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:52.542328] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:52.543248] [INFO ] [MAIN ] ALEX: Generated 1820 derivative records from 32090 primary records. [2025-09-19T22:15:52.543413] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-19T22:15:52.577810] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1820 records). [2025-09-19T22:15:52.578079] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-19T22:15:52.580194] [INFO ] [MAIN ] Derivative Progress: 66/2093 symbols completed. ALEX took 1.2s. Estimated remaining: 13m 29s. Rate: 150.4 symbols/min [2025-09-19T22:15:52.580827] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:52.600585] [DEBUG] [LOCAL ] ALIT: Loaded 53499 existing records from primary storage. [2025-09-19T22:15:52.600868] [INFO ] [MAIN ] ALIT: Loaded 53499 primary data records. [2025-09-19T22:15:52.938546] [DEBUG] [LOCAL ] ALK: Loaded 53840 existing records from primary storage. [2025-09-19T22:15:52.939485] [INFO ] [MAIN ] ALK: Loaded 53840 primary data records. [2025-09-19T22:15:53.055579] [DEBUG] [LOCAL ] ALL: Loaded 50961 existing records from primary storage. [2025-09-19T22:15:53.059118] [INFO ] [MAIN ] ALL: Loaded 50961 primary data records. [2025-09-19T22:15:53.607972] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:53.608745] [INFO ] [MAIN ] ALIT: Generated 1820 derivative records from 53499 primary records. [2025-09-19T22:15:53.608928] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-19T22:15:53.627758] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1820 records). [2025-09-19T22:15:53.628074] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-19T22:15:53.630459] [INFO ] [MAIN ] Derivative Progress: 67/2093 symbols completed. ALIT took 1.1s. Estimated remaining: 13m 48s. Rate: 146.8 symbols/min [2025-09-19T22:15:53.631729] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:53.652996] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:53.654072] [INFO ] [MAIN ] ALK: Generated 1820 derivative records from 53840 primary records. [2025-09-19T22:15:53.654729] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-19T22:15:53.674723] [DEBUG] [LOCAL ] ALK: Derivative data saved (1820 records). [2025-09-19T22:15:53.676747] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-19T22:15:53.678917] [INFO ] [MAIN ] Derivative Progress: 68/2093 symbols completed. ALK took 1.2s. Estimated remaining: 13m 37s. Rate: 148.8 symbols/min [2025-09-19T22:15:53.679700] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:53.703514] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:53.704947] [INFO ] [MAIN ] ALL: Generated 1820 derivative records from 50961 primary records. [2025-09-19T22:15:53.705231] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-19T22:15:53.738592] [DEBUG] [LOCAL ] ALLE: Loaded 46000 existing records from primary storage. [2025-09-19T22:15:53.737818] [DEBUG] [LOCAL ] ALL: Derivative data saved (1820 records). [2025-09-19T22:15:53.738837] [INFO ] [MAIN ] ALLE: Loaded 46000 primary data records. [2025-09-19T22:15:53.739010] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-19T22:15:53.753451] [INFO ] [MAIN ] Derivative Progress: 69/2093 symbols completed. ALL took 1.2s. Estimated remaining: 13m 27s. Rate: 150.5 symbols/min [2025-09-19T22:15:53.773883] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:54.074363] [DEBUG] [LOCAL ] ALLY: Loaded 53994 existing records from primary storage. [2025-09-19T22:15:54.084023] [INFO ] [MAIN ] ALLY: Loaded 53994 primary data records. [2025-09-19T22:15:54.248082] [DEBUG] [LOCAL ] ALSN: Loaded 44026 existing records from primary storage. [2025-09-19T22:15:54.307561] [INFO ] [MAIN ] ALSN: Loaded 44026 primary data records. [2025-09-19T22:15:54.811371] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:54.812590] [INFO ] [MAIN ] ALLE: Generated 1820 derivative records from 46000 primary records. [2025-09-19T22:15:54.813728] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-19T22:15:54.847153] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1820 records). [2025-09-19T22:15:54.847855] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-19T22:15:54.850142] [INFO ] [MAIN ] Derivative Progress: 70/2093 symbols completed. ALLE took 1.2s. Estimated remaining: 13m 46s. Rate: 146.9 symbols/min [2025-09-19T22:15:54.850688] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:54.866119] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:54.867344] [INFO ] [MAIN ] ALLY: Generated 1820 derivative records from 53994 primary records. [2025-09-19T22:15:54.867736] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-19T22:15:54.885736] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1820 records). [2025-09-19T22:15:54.885901] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-19T22:15:54.888560] [INFO ] [MAIN ] Derivative Progress: 71/2093 symbols completed. ALLY took 1.2s. Estimated remaining: 13m 36s. Rate: 148.8 symbols/min [2025-09-19T22:15:54.889150] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:54.912862] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:54.913614] [INFO ] [MAIN ] ALSN: Generated 1820 derivative records from 44026 primary records. [2025-09-19T22:15:54.914341] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-19T22:15:54.924749] [DEBUG] [LOCAL ] ALTG: Loaded 24604 existing records from primary storage. [2025-09-19T22:15:54.941013] [INFO ] [MAIN ] ALTG: Loaded 24604 primary data records. [2025-09-19T22:15:54.949990] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1820 records). [2025-09-19T22:15:54.955270] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-19T22:15:54.968210] [DEBUG] [LOCAL ] ALUR: Loaded 11223 existing records from primary storage. [2025-09-19T22:15:55.005512] [INFO ] [MAIN ] Derivative Progress: 72/2093 symbols completed. ALSN took 1.2s. Estimated remaining: 13m 27s. Rate: 150.2 symbols/min [2025-09-19T22:15:55.022735] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:55.013548] [INFO ] [MAIN ] ALUR: Loaded 11223 primary data records. [2025-09-19T22:15:55.593184] [DEBUG] [LOCAL ] ALV: Loaded 43481 existing records from primary storage. [2025-09-19T22:15:55.593440] [INFO ] [MAIN ] ALV: Loaded 43481 primary data records. [2025-09-19T22:15:55.931565] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:55.932537] [INFO ] [MAIN ] ALTG: Generated 1820 derivative records from 24604 primary records. [2025-09-19T22:15:55.932843] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-19T22:15:55.953460] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1820 records). [2025-09-19T22:15:55.953903] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-19T22:15:55.956523] [INFO ] [MAIN ] Derivative Progress: 73/2093 symbols completed. ALTG took 1.1s. Estimated remaining: 13m 42s. Rate: 147.5 symbols/min [2025-09-19T22:15:55.969670] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:15:55.970608] [INFO ] [MAIN ] ALUR: Generated 1819 derivative records from 11223 primary records. [2025-09-19T22:15:55.970704] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-19T22:15:55.987148] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1819 records). [2025-09-19T22:15:55.987443] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-19T22:15:55.989781] [INFO ] [MAIN ] Derivative Progress: 74/2093 symbols completed. ALUR took 1.1s. Estimated remaining: 13m 31s. Rate: 149.3 symbols/min [2025-09-19T22:15:56.006125] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:56.006688] [INFO ] [MAIN ] ALV: Generated 1820 derivative records from 43481 primary records. [2025-09-19T22:15:56.006750] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-19T22:15:56.022966] [DEBUG] [LOCAL ] ALV: Derivative data saved (1820 records). [2025-09-19T22:15:56.023034] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-19T22:15:56.025459] [INFO ] [MAIN ] Derivative Progress: 75/2093 symbols completed. ALV took 1.0s. Estimated remaining: 13m 21s. Rate: 151.1 symbols/min [2025-09-19T22:15:56.026013] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:56.026179] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:56.026238] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:56.036628] [DEBUG] [LOCAL ] ALX: Loaded 5880 existing records from primary storage. [2025-09-19T22:15:56.036778] [INFO ] [MAIN ] ALX: Loaded 5880 primary data records. [2025-09-19T22:15:56.371603] [DEBUG] [LOCAL ] AMBC: Loaded 38086 existing records from primary storage. [2025-09-19T22:15:56.371901] [INFO ] [MAIN ] AMBC: Loaded 38086 primary data records. [2025-09-19T22:15:56.492266] [DEBUG] [LOCAL ] AM: Loaded 52944 existing records from primary storage. [2025-09-19T22:15:56.492462] [INFO ] [MAIN ] AM: Loaded 52944 primary data records. [2025-09-19T22:15:57.036454] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:57.037525] [INFO ] [MAIN ] ALX: Generated 1820 derivative records from 5880 primary records. [2025-09-19T22:15:57.037741] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-19T22:15:57.056549] [DEBUG] [LOCAL ] ALX: Derivative data saved (1820 records). [2025-09-19T22:15:57.057121] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-19T22:15:57.059248] [INFO ] [MAIN ] Derivative Progress: 76/2093 symbols completed. ALX took 1.0s. Estimated remaining: 13m 38s. Rate: 148.0 symbols/min [2025-09-19T22:15:57.059549] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:57.079326] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:15:57.080277] [INFO ] [MAIN ] AMBC: Generated 1819 derivative records from 38086 primary records. [2025-09-19T22:15:57.080460] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-19T22:15:57.098047] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1819 records). [2025-09-19T22:15:57.098689] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-19T22:15:57.100733] [INFO ] [MAIN ] Derivative Progress: 77/2093 symbols completed. AMBC took 1.1s. Estimated remaining: 13m 28s. Rate: 149.8 symbols/min [2025-09-19T22:15:57.101377] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:57.125822] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:57.126542] [INFO ] [MAIN ] AM: Generated 1820 derivative records from 52944 primary records. [2025-09-19T22:15:57.126768] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-19T22:15:57.154875] [DEBUG] [LOCAL ] AMBP: Loaded 46014 existing records from primary storage. [2025-09-19T22:15:57.156927] [DEBUG] [LOCAL ] AM: Derivative data saved (1820 records). [2025-09-19T22:15:57.157198] [INFO ] [MAIN ] AMBP: Loaded 46014 primary data records. [2025-09-19T22:15:57.157445] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-19T22:15:57.181002] [INFO ] [MAIN ] Derivative Progress: 78/2093 symbols completed. AM took 1.2s. Estimated remaining: 13m 19s. Rate: 151.3 symbols/min [2025-09-19T22:15:57.202581] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:57.509424] [DEBUG] [LOCAL ] AMC: Loaded 54537 existing records from primary storage. [2025-09-19T22:15:57.509712] [INFO ] [MAIN ] AMC: Loaded 54537 primary data records. [2025-09-19T22:15:57.860581] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-09-19T22:15:57.861058] [INFO ] [MAIN ] AMCR: Loaded 54449 primary data records. [2025-09-19T22:15:58.187225] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:58.196732] [INFO ] [MAIN ] AMBP: Generated 1820 derivative records from 46014 primary records. [2025-09-19T22:15:58.197178] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-19T22:15:58.219469] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1820 records). [2025-09-19T22:15:58.220045] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-19T22:15:58.228304] [INFO ] [MAIN ] Derivative Progress: 79/2093 symbols completed. AMBP took 1.2s. Estimated remaining: 13m 35s. Rate: 148.2 symbols/min [2025-09-19T22:15:58.241696] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:58.243848] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:58.244986] [INFO ] [MAIN ] AMC: Generated 1820 derivative records from 54537 primary records. [2025-09-19T22:15:58.245270] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-19T22:15:58.262803] [DEBUG] [LOCAL ] AMC: Derivative data saved (1820 records). [2025-09-19T22:15:58.263003] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-19T22:15:58.265582] [INFO ] [MAIN ] Derivative Progress: 80/2093 symbols completed. AMC took 1.2s. Estimated remaining: 13m 26s. Rate: 149.9 symbols/min [2025-09-19T22:15:58.266896] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:58.282443] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:58.283259] [INFO ] [MAIN ] AMCR: Generated 1820 derivative records from 54449 primary records. [2025-09-19T22:15:58.283442] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-19T22:15:58.300357] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1820 records). [2025-09-19T22:15:58.300477] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-19T22:15:58.302555] [INFO ] [MAIN ] Derivative Progress: 81/2093 symbols completed. AMCR took 1.1s. Estimated remaining: 13m 16s. Rate: 151.6 symbols/min [2025-09-19T22:15:58.302934] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:58.350229] [DEBUG] [LOCAL ] AME: Loaded 49312 existing records from primary storage. [2025-09-19T22:15:58.350449] [INFO ] [MAIN ] AME: Loaded 49312 primary data records. [2025-09-19T22:15:58.506802] [DEBUG] [LOCAL ] AMH: Loaded 52456 existing records from primary storage. [2025-09-19T22:15:58.546832] [INFO ] [MAIN ] AMH: Loaded 52456 primary data records. [2025-09-19T22:15:58.564554] [DEBUG] [LOCAL ] AMN: Loaded 42768 existing records from primary storage. [2025-09-19T22:15:58.570421] [INFO ] [MAIN ] AMN: Loaded 42768 primary data records. [2025-09-19T22:15:59.376555] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:59.377476] [INFO ] [MAIN ] AME: Generated 1820 derivative records from 49312 primary records. [2025-09-19T22:15:59.377767] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-19T22:15:59.396482] [DEBUG] [LOCAL ] AME: Derivative data saved (1820 records). [2025-09-19T22:15:59.398710] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-19T22:15:59.401551] [INFO ] [MAIN ] Derivative Progress: 82/2093 symbols completed. AME took 1.2s. Estimated remaining: 13m 33s. Rate: 148.4 symbols/min [2025-09-19T22:15:59.401973] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:59.415683] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:59.416498] [INFO ] [MAIN ] AMN: Generated 1820 derivative records from 42768 primary records. [2025-09-19T22:15:59.416753] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-19T22:15:59.448855] [DEBUG] [LOCAL ] AMN: Derivative data saved (1820 records). [2025-09-19T22:15:59.449145] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-19T22:15:59.451354] [INFO ] [MAIN ] Derivative Progress: 83/2093 symbols completed. AMN took 1.1s. Estimated remaining: 13m 24s. Rate: 150.0 symbols/min [2025-09-19T22:15:59.451929] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:59.452279] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:15:59.453062] [INFO ] [MAIN ] AMH: Generated 1820 derivative records from 52456 primary records. [2025-09-19T22:15:59.453232] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-19T22:15:59.479078] [DEBUG] [LOCAL ] AMH: Derivative data saved (1820 records). [2025-09-19T22:15:59.479278] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-19T22:15:59.482237] [INFO ] [MAIN ] Derivative Progress: 84/2093 symbols completed. AMH took 1.2s. Estimated remaining: 13m 15s. Rate: 151.7 symbols/min [2025-09-19T22:15:59.482735] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:15:59.496207] [DEBUG] [LOCAL ] AMP: Loaded 33358 existing records from primary storage. [2025-09-19T22:15:59.496441] [INFO ] [MAIN ] AMP: Loaded 33358 primary data records. [2025-09-19T22:15:59.850187] [DEBUG] [LOCAL ] AMPX: Loaded 52848 existing records from primary storage. [2025-09-19T22:15:59.850791] [DEBUG] [LOCAL ] AMPY: Loaded 37926 existing records from primary storage. [2025-09-19T22:15:59.850981] [INFO ] [MAIN ] AMPY: Loaded 37926 primary data records. [2025-09-19T22:15:59.851057] [INFO ] [MAIN ] AMPX: Loaded 52848 primary data records. [2025-09-19T22:16:00.569116] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:00.570156] [INFO ] [MAIN ] AMP: Generated 1820 derivative records from 33358 primary records. [2025-09-19T22:16:00.570492] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-19T22:16:00.588366] [DEBUG] [LOCAL ] AMP: Derivative data saved (1820 records). [2025-09-19T22:16:00.588947] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-19T22:16:00.591035] [INFO ] [MAIN ] Derivative Progress: 85/2093 symbols completed. AMP took 1.2s. Estimated remaining: 13m 31s. Rate: 148.5 symbols/min [2025-09-19T22:16:00.591636] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:00.609470] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:00.610287] [INFO ] [MAIN ] AMPY: Generated 1820 derivative records from 37926 primary records. [2025-09-19T22:16:00.610508] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-19T22:16:00.629717] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1820 records). [2025-09-19T22:16:00.642218] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-19T22:16:00.644288] [INFO ] [MAIN ] Derivative Progress: 86/2093 symbols completed. AMPY took 1.2s. Estimated remaining: 13m 23s. Rate: 150.0 symbols/min [2025-09-19T22:16:00.645154] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:00.644563] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:00.646127] [INFO ] [MAIN ] AMPX: Generated 1820 derivative records from 52848 primary records. [2025-09-19T22:16:00.653576] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-19T22:16:00.670342] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1820 records). [2025-09-19T22:16:00.679229] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-19T22:16:00.681571] [INFO ] [MAIN ] Derivative Progress: 87/2093 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 14s. Rate: 151.6 symbols/min [2025-09-19T22:16:00.682048] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:00.682940] [DEBUG] [LOCAL ] AMR: Loaded 29761 existing records from primary storage. [2025-09-19T22:16:00.683216] [INFO ] [MAIN ] AMR: Loaded 29761 primary data records. [2025-09-19T22:16:00.873558] [DEBUG] [LOCAL ] AMRC: Loaded 39283 existing records from primary storage. [2025-09-19T22:16:00.894116] [INFO ] [MAIN ] AMRC: Loaded 39283 primary data records. [2025-09-19T22:16:01.178211] [DEBUG] [LOCAL ] AMT: Loaded 53223 existing records from primary storage. [2025-09-19T22:16:01.198779] [INFO ] [MAIN ] AMT: Loaded 53223 primary data records. [2025-09-19T22:16:01.718987] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:01.720175] [INFO ] [MAIN ] AMR: Generated 1820 derivative records from 29761 primary records. [2025-09-19T22:16:01.720511] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-19T22:16:01.738544] [DEBUG] [LOCAL ] AMR: Derivative data saved (1820 records). [2025-09-19T22:16:01.739182] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-19T22:16:01.741250] [INFO ] [MAIN ] Derivative Progress: 88/2093 symbols completed. AMR took 1.1s. Estimated remaining: 13m 29s. Rate: 148.8 symbols/min [2025-09-19T22:16:01.759224] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:01.760371] [INFO ] [MAIN ] AMRC: Generated 1820 derivative records from 39283 primary records. [2025-09-19T22:16:01.760482] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-19T22:16:01.778284] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1820 records). [2025-09-19T22:16:01.778599] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-19T22:16:01.780761] [INFO ] [MAIN ] Derivative Progress: 89/2093 symbols completed. AMRC took 1.1s. Estimated remaining: 13m 20s. Rate: 150.3 symbols/min [2025-09-19T22:16:01.796446] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:01.797055] [INFO ] [MAIN ] AMT: Generated 1820 derivative records from 53223 primary records. [2025-09-19T22:16:01.797116] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-19T22:16:01.813297] [DEBUG] [LOCAL ] AMT: Derivative data saved (1820 records). [2025-09-19T22:16:01.813361] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-19T22:16:01.817810] [INFO ] [MAIN ] Derivative Progress: 90/2093 symbols completed. AMT took 1.1s. Estimated remaining: 13m 12s. Rate: 151.8 symbols/min [2025-09-19T22:16:01.819099] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:01.819804] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:01.819707] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:01.827468] [DEBUG] [LOCAL ] AMTD: Loaded 3591 existing records from primary storage. [2025-09-19T22:16:01.827631] [INFO ] [MAIN ] AMTD: Loaded 3591 primary data records. [2025-09-19T22:16:01.957595] [DEBUG] [LOCAL ] AMTB: Loaded 20984 existing records from primary storage. [2025-09-19T22:16:01.961988] [INFO ] [MAIN ] AMTB: Loaded 20984 primary data records. [2025-09-19T22:16:02.304997] [DEBUG] [LOCAL ] AMTM: Loaded 51512 existing records from primary storage. [2025-09-19T22:16:02.330581] [INFO ] [MAIN ] AMTM: Loaded 51512 primary data records. [2025-09-19T22:16:02.893202] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:02.895278] [INFO ] [MAIN ] AMTD: Generated 1820 derivative records from 3591 primary records. [2025-09-19T22:16:02.896447] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-19T22:16:02.913119] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1820 records). [2025-09-19T22:16:02.913409] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-19T22:16:02.918988] [INFO ] [MAIN ] Derivative Progress: 91/2093 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 27s. Rate: 148.9 symbols/min [2025-09-19T22:16:02.920325] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:02.938397] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:02.943548] [INFO ] [MAIN ] AMTB: Generated 1820 derivative records from 20984 primary records. [2025-09-19T22:16:02.943824] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-19T22:16:02.973318] [DEBUG] [LOCAL ] AMWL: Loaded 8803 existing records from primary storage. [2025-09-19T22:16:02.976409] [INFO ] [MAIN ] AMWL: Loaded 8803 primary data records. [2025-09-19T22:16:02.976265] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:02.978269] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1820 records). [2025-09-19T22:16:02.979088] [INFO ] [MAIN ] AMTM: Generated 1820 derivative records from 51512 primary records. [2025-09-19T22:16:02.984354] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-19T22:16:02.984479] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-19T22:16:02.994307] [INFO ] [MAIN ] Derivative Progress: 92/2093 symbols completed. AMTB took 1.2s. Estimated remaining: 13m 19s. Rate: 150.2 symbols/min [2025-09-19T22:16:03.014625] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:03.093353] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1820 records). [2025-09-19T22:16:03.104974] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-19T22:16:03.107666] [INFO ] [MAIN ] Derivative Progress: 93/2093 symbols completed. AMTM took 1.3s. Estimated remaining: 13m 13s. Rate: 151.4 symbols/min [2025-09-19T22:16:03.113310] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:03.351512] [DEBUG] [LOCAL ] AMX: Loaded 49778 existing records from primary storage. [2025-09-19T22:16:03.352004] [INFO ] [MAIN ] AMX: Loaded 49778 primary data records. [2025-09-19T22:16:03.401471] [DEBUG] [LOCAL ] AN: Loaded 33301 existing records from primary storage. [2025-09-19T22:16:03.414416] [INFO ] [MAIN ] AN: Loaded 33301 primary data records. [2025-09-19T22:16:03.633204] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:03.667473] [INFO ] [MAIN ] AMWL: Generated 1820 derivative records from 8803 primary records. [2025-09-19T22:16:03.721540] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-19T22:16:04.020748] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1820 records). [2025-09-19T22:16:04.021031] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-19T22:16:04.024030] [INFO ] [MAIN ] Derivative Progress: 94/2093 symbols completed. AMWL took 1.1s. Estimated remaining: 13m 23s. Rate: 149.3 symbols/min [2025-09-19T22:16:04.025046] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:04.057562] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:04.058675] [INFO ] [MAIN ] AMX: Generated 1820 derivative records from 49778 primary records. [2025-09-19T22:16:04.066424] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-19T22:16:04.072840] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:04.084791] [INFO ] [MAIN ] AN: Generated 1820 derivative records from 33301 primary records. [2025-09-19T22:16:04.100475] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-19T22:16:04.108527] [DEBUG] [LOCAL ] AMX: Derivative data saved (1820 records). [2025-09-19T22:16:04.109169] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-19T22:16:04.111552] [INFO ] [MAIN ] Derivative Progress: 95/2093 symbols completed. AMX took 1.1s. Estimated remaining: 13m 16s. Rate: 150.6 symbols/min [2025-09-19T22:16:04.124283] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:04.127949] [DEBUG] [LOCAL ] AN: Derivative data saved (1820 records). [2025-09-19T22:16:04.129242] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-19T22:16:04.131600] [INFO ] [MAIN ] Derivative Progress: 96/2093 symbols completed. AN took 1.0s. Estimated remaining: 13m 8s. Rate: 152.1 symbols/min [2025-09-19T22:16:04.146284] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:04.147851] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-09-19T22:16:04.148230] [INFO ] [MAIN ] ANET: Loaded 54546 primary data records. [2025-09-19T22:16:04.317376] [DEBUG] [LOCAL ] ANRO: Loaded 20526 existing records from primary storage. [2025-09-19T22:16:04.458606] [INFO ] [MAIN ] ANRO: Loaded 20526 primary data records. [2025-09-19T22:16:04.670066] [DEBUG] [LOCAL ] ANF: Loaded 53051 existing records from primary storage. [2025-09-19T22:16:04.716716] [INFO ] [MAIN ] ANF: Loaded 53051 primary data records. [2025-09-19T22:16:05.039806] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:05.062713] [INFO ] [MAIN ] ANET: Generated 1820 derivative records from 54546 primary records. [2025-09-19T22:16:05.166325] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-19T22:16:05.199550] [DEBUG] [LOCAL ] ANET: Derivative data saved (1820 records). [2025-09-19T22:16:05.200628] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-19T22:16:05.203580] [INFO ] [MAIN ] Derivative Progress: 97/2093 symbols completed. ANET took 1.2s. Estimated remaining: 13m 22s. Rate: 149.4 symbols/min [2025-09-19T22:16:05.204695] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:05.223221] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:05.223961] [INFO ] [MAIN ] ANRO: Generated 1820 derivative records from 20526 primary records. [2025-09-19T22:16:05.224106] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-19T22:16:05.241305] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1820 records). [2025-09-19T22:16:05.247751] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-19T22:16:05.249971] [INFO ] [MAIN ] Derivative Progress: 98/2093 symbols completed. ANRO took 1.1s. Estimated remaining: 13m 14s. Rate: 150.8 symbols/min [2025-09-19T22:16:05.250570] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:05.263978] [DEBUG] [LOCAL ] ANVS: Loaded 23662 existing records from primary storage. [2025-09-19T22:16:05.269435] [INFO ] [MAIN ] ANVS: Loaded 23662 primary data records. [2025-09-19T22:16:05.279121] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:05.292415] [INFO ] [MAIN ] ANF: Generated 1820 derivative records from 53051 primary records. [2025-09-19T22:16:05.303275] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-19T22:16:05.429076] [DEBUG] [LOCAL ] AOD: Loaded 30803 existing records from primary storage. [2025-09-19T22:16:05.428437] [DEBUG] [LOCAL ] ANF: Derivative data saved (1820 records). [2025-09-19T22:16:05.429996] [INFO ] [MAIN ] AOD: Loaded 30803 primary data records. [2025-09-19T22:16:05.429896] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-19T22:16:05.453406] [INFO ] [MAIN ] Derivative Progress: 99/2093 symbols completed. ANF took 1.3s. Estimated remaining: 13m 10s. Rate: 151.5 symbols/min [2025-09-19T22:16:05.512443] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:05.951061] [DEBUG] [LOCAL ] AOMR: Loaded 17257 existing records from primary storage. [2025-09-19T22:16:05.964516] [INFO ] [MAIN ] AOMR: Loaded 17257 primary data records. [2025-09-19T22:16:06.326917] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:06.330949] [INFO ] [MAIN ] ANVS: Generated 1820 derivative records from 23662 primary records. [2025-09-19T22:16:06.331588] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-19T22:16:06.349962] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1820 records). [2025-09-19T22:16:06.352541] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-19T22:16:06.355703] [INFO ] [MAIN ] Derivative Progress: 100/2093 symbols completed. ANVS took 1.2s. Estimated remaining: 13m 19s. Rate: 149.6 symbols/min [2025-09-19T22:16:06.357043] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:06.372131] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:06.373034] [INFO ] [MAIN ] AOD: Generated 1820 derivative records from 30803 primary records. [2025-09-19T22:16:06.373242] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-19T22:16:06.394750] [DEBUG] [LOCAL ] AOD: Derivative data saved (1820 records). [2025-09-19T22:16:06.395175] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-19T22:16:06.397515] [INFO ] [MAIN ] Derivative Progress: 101/2093 symbols completed. AOD took 1.1s. Estimated remaining: 13m 12s. Rate: 151.0 symbols/min [2025-09-19T22:16:06.405636] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:06.412620] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:06.413931] [INFO ] [MAIN ] AOMR: Generated 1820 derivative records from 17257 primary records. [2025-09-19T22:16:06.414124] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-19T22:16:06.430620] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1820 records). [2025-09-19T22:16:06.430874] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-19T22:16:06.433161] [INFO ] [MAIN ] Derivative Progress: 102/2093 symbols completed. AOMR took 0.9s. Estimated remaining: 13m 4s. Rate: 152.3 symbols/min [2025-09-19T22:16:06.433535] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:06.473513] [DEBUG] [LOCAL ] AON: Loaded 46389 existing records from primary storage. [2025-09-19T22:16:06.473767] [INFO ] [MAIN ] AON: Loaded 46389 primary data records. [2025-09-19T22:16:06.546633] [DEBUG] [LOCAL ] AORT: Loaded 30407 existing records from primary storage. [2025-09-19T22:16:06.563712] [INFO ] [MAIN ] AORT: Loaded 30407 primary data records. [2025-09-19T22:16:07.018773] [DEBUG] [LOCAL ] AOS: Loaded 50129 existing records from primary storage. [2025-09-19T22:16:07.035268] [INFO ] [MAIN ] AOS: Loaded 50129 primary data records. [2025-09-19T22:16:07.564947] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:07.566384] [INFO ] [MAIN ] AON: Generated 1820 derivative records from 46389 primary records. [2025-09-19T22:16:07.579801] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:07.579442] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-19T22:16:07.581266] [INFO ] [MAIN ] AORT: Generated 1820 derivative records from 30407 primary records. [2025-09-19T22:16:07.582144] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-19T22:16:07.615438] [DEBUG] [LOCAL ] AON: Derivative data saved (1820 records). [2025-09-19T22:16:07.618890] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-19T22:16:07.618598] [DEBUG] [LOCAL ] AORT: Derivative data saved (1820 records). [2025-09-19T22:16:07.634030] [INFO ] [MAIN ] Derivative Progress: 103/2093 symbols completed. AON took 1.3s. Estimated remaining: 13m 20s. Rate: 149.3 symbols/min [2025-09-19T22:16:07.619196] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-19T22:16:07.636850] [INFO ] [MAIN ] Derivative Progress: 104/2093 symbols completed. AORT took 1.2s. Estimated remaining: 13m 11s. Rate: 150.8 symbols/min [2025-09-19T22:16:07.637570] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:07.638229] [INFO ] [MAIN ] AOS: Generated 1820 derivative records from 50129 primary records. [2025-09-19T22:16:07.638291] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-19T22:16:07.653531] [DEBUG] [LOCAL ] AOS: Derivative data saved (1820 records). [2025-09-19T22:16:07.653592] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-19T22:16:07.656095] [INFO ] [MAIN ] Derivative Progress: 105/2093 symbols completed. AOS took 1.2s. Estimated remaining: 13m 4s. Rate: 152.2 symbols/min [2025-09-19T22:16:07.657027] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:07.656831] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:07.656913] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:07.669106] [DEBUG] [LOCAL ] AP: Loaded 6911 existing records from primary storage. [2025-09-19T22:16:07.669324] [INFO ] [MAIN ] AP: Loaded 6911 primary data records. [2025-09-19T22:16:08.020917] [DEBUG] [LOCAL ] APAM: Loaded 37305 existing records from primary storage. [2025-09-19T22:16:08.040026] [INFO ] [MAIN ] APAM: Loaded 37305 primary data records. [2025-09-19T22:16:08.041165] [DEBUG] [LOCAL ] APD: Loaded 46133 existing records from primary storage. [2025-09-19T22:16:08.079997] [INFO ] [MAIN ] APD: Loaded 46133 primary data records. [2025-09-19T22:16:08.774821] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:08.776449] [INFO ] [MAIN ] AP: Generated 1820 derivative records from 6911 primary records. [2025-09-19T22:16:08.778727] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-19T22:16:08.795280] [DEBUG] [LOCAL ] AP: Derivative data saved (1820 records). [2025-09-19T22:16:08.796251] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-19T22:16:08.798462] [INFO ] [MAIN ] Derivative Progress: 106/2093 symbols completed. AP took 1.1s. Estimated remaining: 13m 18s. Rate: 149.5 symbols/min [2025-09-19T22:16:08.799078] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:08.828319] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:08.833326] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:08.834735] [INFO ] [MAIN ] APD: Generated 1820 derivative records from 46133 primary records. [2025-09-19T22:16:08.834111] [INFO ] [MAIN ] APAM: Generated 1820 derivative records from 37305 primary records. [2025-09-19T22:16:08.834965] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-19T22:16:08.834824] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-19T22:16:08.866639] [DEBUG] [LOCAL ] APD: Derivative data saved (1820 records). [2025-09-19T22:16:08.867703] [DEBUG] [LOCAL ] APAM: Derivative data saved (1820 records). [2025-09-19T22:16:08.867791] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-19T22:16:08.867912] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-19T22:16:08.870154] [INFO ] [MAIN ] Derivative Progress: 107/2093 symbols completed. APD took 1.2s. Estimated remaining: 13m 11s. Rate: 150.6 symbols/min [2025-09-19T22:16:08.872865] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:08.872955] [INFO ] [MAIN ] Derivative Progress: 108/2093 symbols completed. APAM took 1.2s. Estimated remaining: 13m 3s. Rate: 152.0 symbols/min [2025-09-19T22:16:08.873475] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:08.911746] [DEBUG] [LOCAL ] APG: Loaded 51009 existing records from primary storage. [2025-09-19T22:16:08.911970] [INFO ] [MAIN ] APG: Loaded 51009 primary data records. [2025-09-19T22:16:09.256775] [DEBUG] [LOCAL ] APO: Loaded 54162 existing records from primary storage. [2025-09-19T22:16:09.281558] [INFO ] [MAIN ] APO: Loaded 54162 primary data records. [2025-09-19T22:16:09.282352] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-09-19T22:16:09.282462] [INFO ] [MAIN ] APH: Loaded 54471 primary data records. [2025-09-19T22:16:09.928582] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:09.930232] [INFO ] [MAIN ] APG: Generated 1820 derivative records from 51009 primary records. [2025-09-19T22:16:09.931545] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-19T22:16:09.953235] [DEBUG] [LOCAL ] APG: Derivative data saved (1820 records). [2025-09-19T22:16:09.953782] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-19T22:16:09.956719] [INFO ] [MAIN ] Derivative Progress: 109/2093 symbols completed. APG took 1.2s. Estimated remaining: 13m 16s. Rate: 149.6 symbols/min [2025-09-19T22:16:09.957584] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:09.980185] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:09.981468] [INFO ] [MAIN ] APH: Generated 1820 derivative records from 54471 primary records. [2025-09-19T22:16:09.994369] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-19T22:16:09.998773] [DEBUG] [LOCAL ] APOS: Loaded 7543 existing records from primary storage. [2025-09-19T22:16:09.999439] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:10.001016] [INFO ] [MAIN ] APO: Generated 1820 derivative records from 54162 primary records. [2025-09-19T22:16:09.999819] [INFO ] [MAIN ] APOS: Loaded 7543 primary data records. [2025-09-19T22:16:10.001449] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-19T22:16:10.127540] [DEBUG] [LOCAL ] APH: Derivative data saved (1820 records). [2025-09-19T22:16:10.149520] [DEBUG] [LOCAL ] APO: Derivative data saved (1820 records). [2025-09-19T22:16:10.149628] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-19T22:16:10.152027] [INFO ] [MAIN ] Derivative Progress: 110/2093 symbols completed. APH took 1.3s. Estimated remaining: 13m 11s. Rate: 150.3 symbols/min [2025-09-19T22:16:10.152315] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:10.149772] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-19T22:16:10.154559] [INFO ] [MAIN ] Derivative Progress: 111/2093 symbols completed. APO took 1.3s. Estimated remaining: 13m 4s. Rate: 151.7 symbols/min [2025-09-19T22:16:10.165698] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:10.334683] [DEBUG] [LOCAL ] AQNB: Loaded 4281 existing records from primary storage. [2025-09-19T22:16:10.351111] [INFO ] [MAIN ] AQNB: Loaded 4281 primary data records. [2025-09-19T22:16:10.743551] [DEBUG] [LOCAL ] AQN: Loaded 52736 existing records from primary storage. [2025-09-19T22:16:10.744134] [INFO ] [MAIN ] AQN: Loaded 52736 primary data records. [2025-09-19T22:16:11.063485] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:11.064519] [INFO ] [MAIN ] APOS: Generated 1820 derivative records from 7543 primary records. [2025-09-19T22:16:11.065533] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-19T22:16:11.082810] [DEBUG] [LOCAL ] APOS: Derivative data saved (1820 records). [2025-09-19T22:16:11.083332] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-19T22:16:11.086363] [INFO ] [MAIN ] Derivative Progress: 112/2093 symbols completed. APOS took 1.1s. Estimated remaining: 13m 13s. Rate: 149.9 symbols/min [2025-09-19T22:16:11.086697] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:11.103184] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-19T22:16:11.103904] [INFO ] [MAIN ] AQNB: Generated 1818 derivative records from 4281 primary records. [2025-09-19T22:16:11.104074] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-19T22:16:11.119361] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1818 records). [2025-09-19T22:16:11.119565] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-19T22:16:11.121933] [INFO ] [MAIN ] Derivative Progress: 113/2093 symbols completed. AQNB took 1.0s. Estimated remaining: 13m 6s. Rate: 151.1 symbols/min [2025-09-19T22:16:11.122246] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:11.138936] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:11.139754] [INFO ] [MAIN ] AQN: Generated 1820 derivative records from 52736 primary records. [2025-09-19T22:16:11.139859] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-19T22:16:11.155947] [DEBUG] [LOCAL ] AQN: Derivative data saved (1820 records). [2025-09-19T22:16:11.156091] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-19T22:16:11.158481] [INFO ] [MAIN ] Derivative Progress: 114/2093 symbols completed. AQN took 1.0s. Estimated remaining: 12m 60s. Rate: 152.3 symbols/min [2025-09-19T22:16:11.158913] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:11.205674] [DEBUG] [LOCAL ] AR: Loaded 54365 existing records from primary storage. [2025-09-19T22:16:11.205934] [INFO ] [MAIN ] AR: Loaded 54365 primary data records. [2025-09-19T22:16:11.242925] [DEBUG] [LOCAL ] ARDC: Loaded 14872 existing records from primary storage. [2025-09-19T22:16:11.267253] [INFO ] [MAIN ] ARDC: Loaded 14872 primary data records. [2025-09-19T22:16:11.361946] [DEBUG] [LOCAL ] ARCO: Loaded 45295 existing records from primary storage. [2025-09-19T22:16:11.411594] [INFO ] [MAIN ] ARCO: Loaded 45295 primary data records. [2025-09-19T22:16:12.165503] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:12.166778] [INFO ] [MAIN ] AR: Generated 1820 derivative records from 54365 primary records. [2025-09-19T22:16:12.167002] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-19T22:16:12.187116] [DEBUG] [LOCAL ] AR: Derivative data saved (1820 records). [2025-09-19T22:16:12.188773] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-19T22:16:12.190835] [INFO ] [MAIN ] Derivative Progress: 115/2093 symbols completed. AR took 1.1s. Estimated remaining: 13m 10s. Rate: 150.2 symbols/min [2025-09-19T22:16:12.205969] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:12.214081] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:12.219546] [INFO ] [MAIN ] ARDC: Generated 1820 derivative records from 14872 primary records. [2025-09-19T22:16:12.219862] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-19T22:16:12.220744] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:12.221895] [INFO ] [MAIN ] ARCO: Generated 1820 derivative records from 45295 primary records. [2025-09-19T22:16:12.222351] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-19T22:16:12.251294] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1820 records). [2025-09-19T22:16:12.253335] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-19T22:16:12.254432] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1820 records). [2025-09-19T22:16:12.257438] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-19T22:16:12.257272] [INFO ] [MAIN ] Derivative Progress: 116/2093 symbols completed. ARDC took 1.1s. Estimated remaining: 13m 4s. Rate: 151.3 symbols/min [2025-09-19T22:16:12.257782] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:12.268235] [INFO ] [MAIN ] Derivative Progress: 117/2093 symbols completed. ARCO took 1.1s. Estimated remaining: 12m 57s. Rate: 152.6 symbols/min [2025-09-19T22:16:12.269345] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:12.284508] [DEBUG] [LOCAL ] ARDT: Loaded 29081 existing records from primary storage. [2025-09-19T22:16:12.284778] [INFO ] [MAIN ] ARDT: Loaded 29081 primary data records. [2025-09-19T22:16:12.647217] [DEBUG] [LOCAL ] ARE: Loaded 51282 existing records from primary storage. [2025-09-19T22:16:12.662050] [INFO ] [MAIN ] ARE: Loaded 51282 primary data records. [2025-09-19T22:16:12.681539] [DEBUG] [LOCAL ] ARES: Loaded 50464 existing records from primary storage. [2025-09-19T22:16:12.719759] [INFO ] [MAIN ] ARES: Loaded 50464 primary data records. [2025-09-19T22:16:13.365118] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:13.366074] [INFO ] [MAIN ] ARDT: Generated 1820 derivative records from 29081 primary records. [2025-09-19T22:16:13.366323] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-19T22:16:13.386842] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1820 records). [2025-09-19T22:16:13.387186] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-19T22:16:13.390082] [INFO ] [MAIN ] Derivative Progress: 118/2093 symbols completed. ARDT took 1.2s. Estimated remaining: 13m 9s. Rate: 150.2 symbols/min [2025-09-19T22:16:13.428404] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:13.428152] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:13.429225] [INFO ] [MAIN ] ARE: Generated 1820 derivative records from 51282 primary records. [2025-09-19T22:16:13.429896] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-19T22:16:13.429839] [INFO ] [MAIN ] ARES: Generated 1820 derivative records from 50464 primary records. [2025-09-19T22:16:13.429987] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-19T22:16:13.459776] [DEBUG] [LOCAL ] ARES: Derivative data saved (1820 records). [2025-09-19T22:16:13.462204] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-19T22:16:13.462603] [DEBUG] [LOCAL ] ARE: Derivative data saved (1820 records). [2025-09-19T22:16:13.464993] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-19T22:16:13.464907] [INFO ] [MAIN ] Derivative Progress: 119/2093 symbols completed. ARES took 1.2s. Estimated remaining: 13m 3s. Rate: 151.2 symbols/min [2025-09-19T22:16:13.467236] [INFO ] [MAIN ] Derivative Progress: 120/2093 symbols completed. ARE took 1.2s. Estimated remaining: 12m 56s. Rate: 152.5 symbols/min [2025-09-19T22:16:13.467751] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:13.467897] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:13.468175] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:13.533073] [DEBUG] [LOCAL ] ARIS: Loaded 42669 existing records from primary storage. [2025-09-19T22:16:13.533421] [INFO ] [MAIN ] ARIS: Loaded 42669 primary data records. [2025-09-19T22:16:13.592622] [DEBUG] [LOCAL ] ARI: Loaded 43976 existing records from primary storage. [2025-09-19T22:16:13.655705] [DEBUG] [LOCAL ] ARLO: Loaded 44833 existing records from primary storage. [2025-09-19T22:16:13.639080] [INFO ] [MAIN ] ARI: Loaded 43976 primary data records. [2025-09-19T22:16:13.663503] [INFO ] [MAIN ] ARLO: Loaded 44833 primary data records. [2025-09-19T22:16:14.524681] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:14.525620] [INFO ] [MAIN ] ARIS: Generated 1820 derivative records from 42669 primary records. [2025-09-19T22:16:14.525790] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-19T22:16:14.561528] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:14.555462] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1820 records). [2025-09-19T22:16:14.562330] [INFO ] [MAIN ] ARI: Generated 1820 derivative records from 43976 primary records. [2025-09-19T22:16:14.562550] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-19T22:16:14.561701] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-19T22:16:14.588941] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:14.588524] [INFO ] [MAIN ] Derivative Progress: 121/2093 symbols completed. ARIS took 1.1s. Estimated remaining: 13m 8s. Rate: 150.2 symbols/min [2025-09-19T22:16:14.590024] [INFO ] [MAIN ] ARLO: Generated 1820 derivative records from 44833 primary records. [2025-09-19T22:16:14.590465] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:14.590375] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-19T22:16:14.595036] [DEBUG] [LOCAL ] ARI: Derivative data saved (1820 records). [2025-09-19T22:16:14.595394] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-19T22:16:14.605183] [INFO ] [MAIN ] Derivative Progress: 122/2093 symbols completed. ARI took 1.1s. Estimated remaining: 13m 1s. Rate: 151.4 symbols/min [2025-09-19T22:16:14.609260] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:14.614311] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1820 records). [2025-09-19T22:16:14.614544] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-19T22:16:14.617080] [INFO ] [MAIN ] Derivative Progress: 123/2093 symbols completed. ARLO took 1.1s. Estimated remaining: 12m 55s. Rate: 152.6 symbols/min [2025-09-19T22:16:14.617415] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:14.701074] [DEBUG] [LOCAL ] AROC: Loaded 49755 existing records from primary storage. [2025-09-19T22:16:14.701363] [INFO ] [MAIN ] AROC: Loaded 49755 primary data records. [2025-09-19T22:16:14.834513] [DEBUG] [LOCAL ] ARMK: Loaded 51064 existing records from primary storage. [2025-09-19T22:16:14.846088] [DEBUG] [LOCAL ] ARR: Loaded 52797 existing records from primary storage. [2025-09-19T22:16:14.840297] [INFO ] [MAIN ] ARMK: Loaded 51064 primary data records. [2025-09-19T22:16:14.851403] [INFO ] [MAIN ] ARR: Loaded 52797 primary data records. [2025-09-19T22:16:15.741839] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:15.742918] [INFO ] [MAIN ] AROC: Generated 1820 derivative records from 49755 primary records. [2025-09-19T22:16:15.743082] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-19T22:16:15.762522] [DEBUG] [LOCAL ] AROC: Derivative data saved (1820 records). [2025-09-19T22:16:15.763619] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-19T22:16:15.767374] [INFO ] [MAIN ] Derivative Progress: 124/2093 symbols completed. AROC took 1.2s. Estimated remaining: 13m 6s. Rate: 150.3 symbols/min [2025-09-19T22:16:15.768133] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:15.781352] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:15.783401] [INFO ] [MAIN ] ARR: Generated 1820 derivative records from 52797 primary records. [2025-09-19T22:16:15.783671] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-19T22:16:15.803136] [DEBUG] [LOCAL ] ARR: Derivative data saved (1820 records). [2025-09-19T22:16:15.803485] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-19T22:16:15.806163] [INFO ] [MAIN ] Derivative Progress: 125/2093 symbols completed. ARR took 1.2s. Estimated remaining: 13m 0s. Rate: 151.3 symbols/min [2025-09-19T22:16:15.819004] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:15.819811] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:15.820772] [INFO ] [MAIN ] ARMK: Generated 1820 derivative records from 51064 primary records. [2025-09-19T22:16:15.821006] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-19T22:16:15.837561] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1820 records). [2025-09-19T22:16:15.838725] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-19T22:16:15.841092] [INFO ] [MAIN ] Derivative Progress: 126/2093 symbols completed. ARMK took 1.3s. Estimated remaining: 12m 54s. Rate: 152.5 symbols/min [2025-09-19T22:16:15.845831] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:15.853087] [DEBUG] [LOCAL ] ASA: Loaded 13682 existing records from primary storage. [2025-09-19T22:16:15.853377] [INFO ] [MAIN ] ASA: Loaded 13682 primary data records. [2025-09-19T22:16:16.028995] [DEBUG] [LOCAL ] AS: Loaded 53846 existing records from primary storage. [2025-09-19T22:16:16.063858] [INFO ] [MAIN ] AS: Loaded 53846 primary data records. [2025-09-19T22:16:16.433845] [DEBUG] [LOCAL ] ASAN: Loaded 53526 existing records from primary storage. [2025-09-19T22:16:16.434665] [INFO ] [MAIN ] ASAN: Loaded 53526 primary data records. [2025-09-19T22:16:16.956296] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:16.957419] [INFO ] [MAIN ] ASA: Generated 1820 derivative records from 13682 primary records. [2025-09-19T22:16:16.957743] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-19T22:16:16.996017] [DEBUG] [LOCAL ] ASA: Derivative data saved (1820 records). [2025-09-19T22:16:16.996742] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-19T22:16:16.997039] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:17.000545] [INFO ] [MAIN ] Derivative Progress: 127/2093 symbols completed. ASA took 1.2s. Estimated remaining: 13m 6s. Rate: 150.2 symbols/min [2025-09-19T22:16:16.998071] [INFO ] [MAIN ] AS: Generated 1820 derivative records from 53846 primary records. [2025-09-19T22:16:17.000984] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:17.001302] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-19T22:16:17.022986] [DEBUG] [LOCAL ] AS: Derivative data saved (1820 records). [2025-09-19T22:16:17.023940] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-19T22:16:17.026959] [INFO ] [MAIN ] Derivative Progress: 128/2093 symbols completed. AS took 1.3s. Estimated remaining: 12m 59s. Rate: 151.3 symbols/min [2025-09-19T22:16:17.027484] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:17.041161] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:17.043093] [INFO ] [MAIN ] ASAN: Generated 1820 derivative records from 53526 primary records. [2025-09-19T22:16:17.043223] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-19T22:16:17.046868] [DEBUG] [LOCAL ] ASBA: Loaded 3461 existing records from primary storage. [2025-09-19T22:16:17.047253] [INFO ] [MAIN ] ASBA: Loaded 3461 primary data records. [2025-09-19T22:16:17.236914] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1820 records). [2025-09-19T22:16:17.263411] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-19T22:16:17.272101] [INFO ] [MAIN ] Derivative Progress: 129/2093 symbols completed. ASAN took 1.4s. Estimated remaining: 12m 57s. Rate: 151.7 symbols/min [2025-09-19T22:16:17.286534] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:17.409527] [DEBUG] [LOCAL ] ASB: Loaded 50356 existing records from primary storage. [2025-09-19T22:16:17.410619] [INFO ] [MAIN ] ASB: Loaded 50356 primary data records. [2025-09-19T22:16:17.762304] [DEBUG] [LOCAL ] ASC: Loaded 38686 existing records from primary storage. [2025-09-19T22:16:17.774771] [INFO ] [MAIN ] ASC: Loaded 38686 primary data records. [2025-09-19T22:16:17.776072] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:17.812408] [INFO ] [MAIN ] ASBA: Generated 1820 derivative records from 3461 primary records. [2025-09-19T22:16:17.837121] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-19T22:16:17.891487] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1820 records). [2025-09-19T22:16:17.891899] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-19T22:16:17.905364] [INFO ] [MAIN ] Derivative Progress: 130/2093 symbols completed. ASBA took 0.9s. Estimated remaining: 12m 60s. Rate: 151.0 symbols/min [2025-09-19T22:16:17.906047] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:18.132961] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:18.141779] [INFO ] [MAIN ] ASB: Generated 1820 derivative records from 50356 primary records. [2025-09-19T22:16:18.142056] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-19T22:16:18.142474] [DEBUG] [LOCAL ] ASG: Loaded 21328 existing records from primary storage. [2025-09-19T22:16:18.143191] [INFO ] [MAIN ] ASG: Loaded 21328 primary data records. [2025-09-19T22:16:18.226749] [DEBUG] [LOCAL ] ASB: Derivative data saved (1820 records). [2025-09-19T22:16:18.239040] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-19T22:16:18.241632] [INFO ] [MAIN ] Derivative Progress: 131/2093 symbols completed. ASB took 1.2s. Estimated remaining: 12m 59s. Rate: 151.2 symbols/min [2025-09-19T22:16:18.242144] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:18.497886] [DEBUG] [LOCAL ] ASGI: Loaded 22591 existing records from primary storage. [2025-09-19T22:16:18.511150] [INFO ] [MAIN ] ASGI: Loaded 22591 primary data records. [2025-09-19T22:16:18.512026] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:18.545807] [INFO ] [MAIN ] ASC: Generated 1820 derivative records from 38686 primary records. [2025-09-19T22:16:18.579465] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-19T22:16:18.657423] [DEBUG] [LOCAL ] ASC: Derivative data saved (1820 records). [2025-09-19T22:16:18.675596] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-19T22:16:18.710498] [INFO ] [MAIN ] Derivative Progress: 132/2093 symbols completed. ASC took 1.4s. Estimated remaining: 12m 59s. Rate: 151.0 symbols/min [2025-09-19T22:16:18.875783] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:18.889921] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:18.890570] [INFO ] [MAIN ] ASG: Generated 1820 derivative records from 21328 primary records. [2025-09-19T22:16:18.890685] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-19T22:16:18.908547] [DEBUG] [LOCAL ] ASG: Derivative data saved (1820 records). [2025-09-19T22:16:18.909316] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-19T22:16:18.911526] [INFO ] [MAIN ] Derivative Progress: 133/2093 symbols completed. ASG took 1.0s. Estimated remaining: 12m 56s. Rate: 151.5 symbols/min [2025-09-19T22:16:18.933592] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:18.942845] [INFO ] [MAIN ] ASGI: Generated 1820 derivative records from 22591 primary records. [2025-09-19T22:16:18.942990] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-19T22:16:18.967961] [DEBUG] [LOCAL ] ASGN: Loaded 36601 existing records from primary storage. [2025-09-19T22:16:18.968508] [INFO ] [MAIN ] ASGN: Loaded 36601 primary data records. [2025-09-19T22:16:19.044324] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1820 records). [2025-09-19T22:16:19.060225] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-19T22:16:19.070540] [INFO ] [MAIN ] Derivative Progress: 134/2093 symbols completed. ASGI took 0.8s. Estimated remaining: 12m 52s. Rate: 152.2 symbols/min [2025-09-19T22:16:19.284838] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:19.285488] [INFO ] [MAIN ] ASGN: Generated 1820 derivative records from 36601 primary records. [2025-09-19T22:16:19.285550] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-19T22:16:19.300785] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1820 records). [2025-09-19T22:16:19.300873] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-19T22:16:19.303295] [INFO ] [MAIN ] Derivative Progress: 135/2093 symbols completed. ASGN took 0.5s. Estimated remaining: 12m 49s. Rate: 152.7 symbols/min [2025-09-19T22:16:19.304192] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:19.304860] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:19.304763] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:19.318943] [DEBUG] [LOCAL ] ASR: Loaded 9307 existing records from primary storage. [2025-09-19T22:16:19.319150] [INFO ] [MAIN ] ASR: Loaded 9307 primary data records. [2025-09-19T22:16:19.692869] [DEBUG] [LOCAL ] ASH: Loaded 38526 existing records from primary storage. [2025-09-19T22:16:19.693872] [DEBUG] [LOCAL ] ASPN: Loaded 50351 existing records from primary storage. [2025-09-19T22:16:19.693088] [INFO ] [MAIN ] ASH: Loaded 38526 primary data records. [2025-09-19T22:16:19.694171] [INFO ] [MAIN ] ASPN: Loaded 50351 primary data records. [2025-09-19T22:16:20.381561] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:20.383275] [INFO ] [MAIN ] ASR: Generated 1820 derivative records from 9307 primary records. [2025-09-19T22:16:20.383909] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-19T22:16:20.409945] [DEBUG] [LOCAL ] ASR: Derivative data saved (1820 records). [2025-09-19T22:16:20.410219] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-19T22:16:20.412703] [INFO ] [MAIN ] Derivative Progress: 136/2093 symbols completed. ASR took 1.1s. Estimated remaining: 12m 59s. Rate: 150.7 symbols/min [2025-09-19T22:16:20.413279] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:20.431061] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:20.431874] [INFO ] [MAIN ] ASH: Generated 1820 derivative records from 38526 primary records. [2025-09-19T22:16:20.432106] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-19T22:16:20.451749] [DEBUG] [LOCAL ] ASH: Derivative data saved (1820 records). [2025-09-19T22:16:20.465134] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-19T22:16:20.467470] [INFO ] [MAIN ] Derivative Progress: 137/2093 symbols completed. ASH took 1.2s. Estimated remaining: 12m 54s. Rate: 151.6 symbols/min [2025-09-19T22:16:20.468207] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:20.468675] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:20.469930] [INFO ] [MAIN ] ASPN: Generated 1820 derivative records from 50351 primary records. [2025-09-19T22:16:20.470109] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-19T22:16:20.487054] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1820 records). [2025-09-19T22:16:20.487224] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-19T22:16:20.489942] [INFO ] [MAIN ] Derivative Progress: 138/2093 symbols completed. ASPN took 1.2s. Estimated remaining: 12m 48s. Rate: 152.7 symbols/min [2025-09-19T22:16:20.504120] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:20.530405] [DEBUG] [LOCAL ] ASX: Loaded 53698 existing records from primary storage. [2025-09-19T22:16:20.530689] [INFO ] [MAIN ] ASX: Loaded 53698 primary data records. [2025-09-19T22:16:20.724999] [DEBUG] [LOCAL ] ATEN: Loaded 40681 existing records from primary storage. [2025-09-19T22:16:20.743488] [INFO ] [MAIN ] ATEN: Loaded 40681 primary data records. [2025-09-19T22:16:20.905713] [DEBUG] [LOCAL ] ATGE: Loaded 32625 existing records from primary storage. [2025-09-19T22:16:20.948747] [INFO ] [MAIN ] ATGE: Loaded 32625 primary data records. [2025-09-19T22:16:21.569156] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:21.570185] [INFO ] [MAIN ] ASX: Generated 1820 derivative records from 53698 primary records. [2025-09-19T22:16:21.570386] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-19T22:16:21.589033] [DEBUG] [LOCAL ] ASX: Derivative data saved (1820 records). [2025-09-19T22:16:21.589211] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-19T22:16:21.591553] [INFO ] [MAIN ] Derivative Progress: 139/2093 symbols completed. ASX took 1.2s. Estimated remaining: 12m 58s. Rate: 150.7 symbols/min [2025-09-19T22:16:21.592002] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:21.610295] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:21.611431] [INFO ] [MAIN ] ATEN: Generated 1820 derivative records from 40681 primary records. [2025-09-19T22:16:21.611672] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-19T22:16:21.652998] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1820 records). [2025-09-19T22:16:21.652206] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:21.653218] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-19T22:16:21.657053] [INFO ] [MAIN ] ATGE: Generated 1820 derivative records from 32625 primary records. [2025-09-19T22:16:21.656062] [INFO ] [MAIN ] Derivative Progress: 140/2093 symbols completed. ATEN took 1.2s. Estimated remaining: 12m 53s. Rate: 151.6 symbols/min [2025-09-19T22:16:21.657283] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-19T22:16:21.657963] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:21.689938] [DEBUG] [LOCAL ] ATHM: Loaded 33480 existing records from primary storage. [2025-09-19T22:16:21.690866] [INFO ] [MAIN ] ATHM: Loaded 33480 primary data records. [2025-09-19T22:16:21.763170] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1820 records). [2025-09-19T22:16:21.768469] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-19T22:16:21.798788] [INFO ] [MAIN ] Derivative Progress: 141/2093 symbols completed. ATGE took 1.3s. Estimated remaining: 12m 49s. Rate: 152.3 symbols/min [2025-09-19T22:16:21.807031] [DEBUG] [LOCAL ] ATHS: Loaded 7291 existing records from primary storage. [2025-09-19T22:16:21.812017] [INFO ] [MAIN ] ATHS: Loaded 7291 primary data records. [2025-09-19T22:16:21.812130] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:22.338005] [DEBUG] [LOCAL ] ATKR: Loaded 36395 existing records from primary storage. [2025-09-19T22:16:22.338360] [INFO ] [MAIN ] ATKR: Loaded 36395 primary data records. [2025-09-19T22:16:22.682932] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:22.696165] [INFO ] [MAIN ] ATHM: Generated 1820 derivative records from 33480 primary records. [2025-09-19T22:16:22.696389] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-19T22:16:22.697053] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:22.698191] [INFO ] [MAIN ] ATHS: Generated 1820 derivative records from 7291 primary records. [2025-09-19T22:16:22.699078] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-19T22:16:22.716027] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1820 records). [2025-09-19T22:16:22.722795] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-19T22:16:22.731609] [INFO ] [MAIN ] Derivative Progress: 142/2093 symbols completed. ATHM took 1.1s. Estimated remaining: 12m 56s. Rate: 150.9 symbols/min [2025-09-19T22:16:22.732528] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1820 records). [2025-09-19T22:16:22.732768] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:22.732971] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-19T22:16:22.735798] [INFO ] [MAIN ] Derivative Progress: 143/2093 symbols completed. ATHS took 1.1s. Estimated remaining: 12m 50s. Rate: 151.9 symbols/min [2025-09-19T22:16:22.736169] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:22.757923] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:22.758807] [INFO ] [MAIN ] ATKR: Generated 1820 derivative records from 36395 primary records. [2025-09-19T22:16:22.759018] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-19T22:16:22.790440] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1820 records). [2025-09-19T22:16:22.790569] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-19T22:16:22.793086] [INFO ] [MAIN ] Derivative Progress: 144/2093 symbols completed. ATKR took 1.0s. Estimated remaining: 12m 45s. Rate: 152.8 symbols/min [2025-09-19T22:16:22.793365] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:22.817815] [DEBUG] [LOCAL ] ATMU: Loaded 40306 existing records from primary storage. [2025-09-19T22:16:22.818098] [INFO ] [MAIN ] ATMU: Loaded 40306 primary data records. [2025-09-19T22:16:22.944255] [DEBUG] [LOCAL ] ATO: Loaded 42708 existing records from primary storage. [2025-09-19T22:16:22.955326] [INFO ] [MAIN ] ATO: Loaded 42708 primary data records. [2025-09-19T22:16:23.047206] [DEBUG] [LOCAL ] ATR: Loaded 30949 existing records from primary storage. [2025-09-19T22:16:23.125028] [INFO ] [MAIN ] ATR: Loaded 30949 primary data records. [2025-09-19T22:16:23.838627] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:23.839789] [INFO ] [MAIN ] ATMU: Generated 1820 derivative records from 40306 primary records. [2025-09-19T22:16:23.840082] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-19T22:16:23.860404] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1820 records). [2025-09-19T22:16:23.861876] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-19T22:16:23.864797] [INFO ] [MAIN ] Derivative Progress: 145/2093 symbols completed. ATMU took 1.1s. Estimated remaining: 12m 54s. Rate: 151.0 symbols/min [2025-09-19T22:16:23.867217] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:23.883000] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:23.883810] [INFO ] [MAIN ] ATO: Generated 1820 derivative records from 42708 primary records. [2025-09-19T22:16:23.884064] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-19T22:16:23.904055] [DEBUG] [LOCAL ] ATO: Derivative data saved (1820 records). [2025-09-19T22:16:23.904343] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-19T22:16:23.914573] [INFO ] [MAIN ] Derivative Progress: 146/2093 symbols completed. ATO took 1.2s. Estimated remaining: 12m 49s. Rate: 151.9 symbols/min [2025-09-19T22:16:23.924831] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:23.926343] [INFO ] [MAIN ] ATR: Generated 1820 derivative records from 30949 primary records. [2025-09-19T22:16:23.926501] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-19T22:16:23.925112] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:23.944816] [DEBUG] [LOCAL ] ATS: Loaded 18502 existing records from primary storage. [2025-09-19T22:16:23.947526] [INFO ] [MAIN ] ATS: Loaded 18502 primary data records. [2025-09-19T22:16:23.973124] [DEBUG] [LOCAL ] ATR: Derivative data saved (1820 records). [2025-09-19T22:16:24.007026] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-19T22:16:24.023323] [INFO ] [MAIN ] Derivative Progress: 147/2093 symbols completed. ATR took 1.2s. Estimated remaining: 12m 45s. Rate: 152.7 symbols/min [2025-09-19T22:16:24.035259] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:24.301917] [DEBUG] [LOCAL ] ATUS: Loaded 49936 existing records from primary storage. [2025-09-19T22:16:24.302512] [INFO ] [MAIN ] ATUS: Loaded 49936 primary data records. [2025-09-19T22:16:24.437831] [DEBUG] [LOCAL ] AU: Loaded 53682 existing records from primary storage. [2025-09-19T22:16:24.439872] [INFO ] [MAIN ] AU: Loaded 53682 primary data records. [2025-09-19T22:16:24.574841] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:24.747324] [INFO ] [MAIN ] ATS: Generated 1820 derivative records from 18502 primary records. [2025-09-19T22:16:24.769448] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-19T22:16:24.876852] [DEBUG] [LOCAL ] ATS: Derivative data saved (1820 records). [2025-09-19T22:16:25.042958] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-19T22:16:25.054909] [INFO ] [MAIN ] Derivative Progress: 148/2093 symbols completed. ATS took 1.2s. Estimated remaining: 12m 53s. Rate: 151.0 symbols/min [2025-09-19T22:16:25.079298] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:25.080192] [INFO ] [MAIN ] ATUS: Generated 1820 derivative records from 49936 primary records. [2025-09-19T22:16:25.080343] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-19T22:16:25.111144] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:25.112370] [INFO ] [MAIN ] AU: Generated 1820 derivative records from 53682 primary records. [2025-09-19T22:16:25.112627] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-19T22:16:25.113258] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1820 records). [2025-09-19T22:16:25.114103] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-19T22:16:25.116092] [INFO ] [MAIN ] Derivative Progress: 149/2093 symbols completed. ATUS took 1.2s. Estimated remaining: 12m 48s. Rate: 151.9 symbols/min [2025-09-19T22:16:25.131726] [DEBUG] [LOCAL ] AU: Derivative data saved (1820 records). [2025-09-19T22:16:25.131823] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-19T22:16:25.134482] [INFO ] [MAIN ] Derivative Progress: 150/2093 symbols completed. AU took 1.1s. Estimated remaining: 12m 43s. Rate: 152.8 symbols/min [2025-09-19T22:16:25.135177] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:25.135093] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:25.136239] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:25.150219] [DEBUG] [LOCAL ] AVAL: Loaded 9642 existing records from primary storage. [2025-09-19T22:16:25.150512] [INFO ] [MAIN ] AVAL: Loaded 9642 primary data records. [2025-09-19T22:16:25.265596] [DEBUG] [LOCAL ] AVD: Loaded 23590 existing records from primary storage. [2025-09-19T22:16:25.287153] [INFO ] [MAIN ] AVD: Loaded 23590 primary data records. [2025-09-19T22:16:25.425707] [DEBUG] [LOCAL ] AVA: Loaded 40280 existing records from primary storage. [2025-09-19T22:16:25.463391] [INFO ] [MAIN ] AVA: Loaded 40280 primary data records. [2025-09-19T22:16:26.188442] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:26.189710] [INFO ] [MAIN ] AVAL: Generated 1820 derivative records from 9642 primary records. [2025-09-19T22:16:26.189996] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-19T22:16:26.210474] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1820 records). [2025-09-19T22:16:26.223278] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-19T22:16:26.225896] [INFO ] [MAIN ] Derivative Progress: 151/2093 symbols completed. AVAL took 1.1s. Estimated remaining: 12m 51s. Rate: 151.1 symbols/min [2025-09-19T22:16:26.226565] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:26.227739] [INFO ] [MAIN ] AVD: Generated 1820 derivative records from 23590 primary records. [2025-09-19T22:16:26.228872] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-19T22:16:26.228746] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:26.258439] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:26.260033] [INFO ] [MAIN ] AVA: Generated 1820 derivative records from 40280 primary records. [2025-09-19T22:16:26.260386] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-19T22:16:26.280811] [DEBUG] [LOCAL ] AVD: Derivative data saved (1820 records). [2025-09-19T22:16:26.290429] [DEBUG] [LOCAL ] AVA: Derivative data saved (1820 records). [2025-09-19T22:16:26.291287] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-19T22:16:26.290502] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-19T22:16:26.296602] [DEBUG] [LOCAL ] AVK: Loaded 18451 existing records from primary storage. [2025-09-19T22:16:26.293598] [INFO ] [MAIN ] Derivative Progress: 152/2093 symbols completed. AVA took 1.2s. Estimated remaining: 12m 47s. Rate: 151.9 symbols/min [2025-09-19T22:16:26.297087] [INFO ] [MAIN ] AVK: Loaded 18451 primary data records. [2025-09-19T22:16:26.296980] [INFO ] [MAIN ] Derivative Progress: 153/2093 symbols completed. AVD took 1.2s. Estimated remaining: 12m 41s. Rate: 152.9 symbols/min [2025-09-19T22:16:26.296923] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:26.328527] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:26.618291] [DEBUG] [LOCAL ] AVNS: Loaded 34169 existing records from primary storage. [2025-09-19T22:16:26.618429] [INFO ] [MAIN ] AVNS: Loaded 34169 primary data records. [2025-09-19T22:16:27.016946] [DEBUG] [LOCAL ] AVTR: Loaded 54351 existing records from primary storage. [2025-09-19T22:16:27.018404] [INFO ] [MAIN ] AVTR: Loaded 54351 primary data records. [2025-09-19T22:16:27.248101] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:27.361269] [INFO ] [MAIN ] AVK: Generated 1820 derivative records from 18451 primary records. [2025-09-19T22:16:27.376370] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-19T22:16:27.411761] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:27.413569] [INFO ] [MAIN ] AVNS: Generated 1820 derivative records from 34169 primary records. [2025-09-19T22:16:27.413979] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-19T22:16:27.417614] [DEBUG] [LOCAL ] AVK: Derivative data saved (1820 records). [2025-09-19T22:16:27.428860] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-19T22:16:27.432148] [INFO ] [MAIN ] Derivative Progress: 154/2093 symbols completed. AVK took 1.2s. Estimated remaining: 12m 50s. Rate: 151.0 symbols/min [2025-09-19T22:16:27.436880] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1820 records). [2025-09-19T22:16:27.437134] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-19T22:16:27.437195] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:27.440490] [INFO ] [MAIN ] Derivative Progress: 155/2093 symbols completed. AVNS took 1.1s. Estimated remaining: 12m 45s. Rate: 152.0 symbols/min [2025-09-19T22:16:27.441507] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:27.461973] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:27.462744] [INFO ] [MAIN ] AVTR: Generated 1820 derivative records from 54351 primary records. [2025-09-19T22:16:27.462897] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-19T22:16:27.487144] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1820 records). [2025-09-19T22:16:27.487337] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-19T22:16:27.489628] [INFO ] [MAIN ] Derivative Progress: 156/2093 symbols completed. AVTR took 1.2s. Estimated remaining: 12m 40s. Rate: 152.8 symbols/min [2025-09-19T22:16:27.490161] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:27.509468] [DEBUG] [LOCAL ] AWF: Loaded 24565 existing records from primary storage. [2025-09-19T22:16:27.509770] [INFO ] [MAIN ] AWF: Loaded 24565 primary data records. [2025-09-19T22:16:27.637397] [DEBUG] [LOCAL ] AVY: Loaded 38393 existing records from primary storage. [2025-09-19T22:16:27.701343] [DEBUG] [LOCAL ] AWI: Loaded 26546 existing records from primary storage. [2025-09-19T22:16:27.690833] [INFO ] [MAIN ] AVY: Loaded 38393 primary data records. [2025-09-19T22:16:27.763731] [INFO ] [MAIN ] AWI: Loaded 26546 primary data records. [2025-09-19T22:16:28.521747] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:28.523767] [INFO ] [MAIN ] AWF: Generated 1820 derivative records from 24565 primary records. [2025-09-19T22:16:28.524152] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-19T22:16:28.545027] [DEBUG] [LOCAL ] AWF: Derivative data saved (1820 records). [2025-09-19T22:16:28.545386] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-19T22:16:28.560203] [INFO ] [MAIN ] Derivative Progress: 157/2093 symbols completed. AWF took 1.1s. Estimated remaining: 12m 48s. Rate: 151.2 symbols/min [2025-09-19T22:16:28.560846] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:28.561242] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:28.562097] [INFO ] [MAIN ] AVY: Generated 1820 derivative records from 38393 primary records. [2025-09-19T22:16:28.564174] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-19T22:16:28.593538] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:28.595825] [INFO ] [MAIN ] AWI: Generated 1820 derivative records from 26546 primary records. [2025-09-19T22:16:28.596984] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-19T22:16:28.608495] [DEBUG] [LOCAL ] AVY: Derivative data saved (1820 records). [2025-09-19T22:16:28.611527] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-19T22:16:28.614306] [INFO ] [MAIN ] Derivative Progress: 158/2093 symbols completed. AVY took 1.2s. Estimated remaining: 12m 44s. Rate: 152.0 symbols/min [2025-09-19T22:16:28.617918] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:28.621091] [DEBUG] [LOCAL ] AWI: Derivative data saved (1820 records). [2025-09-19T22:16:28.621223] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-19T22:16:28.623858] [INFO ] [MAIN ] Derivative Progress: 159/2093 symbols completed. AWI took 1.1s. Estimated remaining: 12m 39s. Rate: 153.0 symbols/min [2025-09-19T22:16:28.624743] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:28.662491] [DEBUG] [LOCAL ] AWR: Loaded 22805 existing records from primary storage. [2025-09-19T22:16:28.670635] [INFO ] [MAIN ] AWR: Loaded 22805 primary data records. [2025-09-19T22:16:28.695324] [DEBUG] [LOCAL ] AWP: Loaded 22526 existing records from primary storage. [2025-09-19T22:16:28.722419] [INFO ] [MAIN ] AWP: Loaded 22526 primary data records. [2025-09-19T22:16:28.755043] [DEBUG] [LOCAL ] AWK: Loaded 49612 existing records from primary storage. [2025-09-19T22:16:28.779733] [INFO ] [MAIN ] AWK: Loaded 49612 primary data records. [2025-09-19T22:16:29.734964] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:29.735824] [INFO ] [MAIN ] AWR: Generated 1820 derivative records from 22805 primary records. [2025-09-19T22:16:29.736136] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-19T22:16:29.778709] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:29.784599] [INFO ] [MAIN ] AWP: Generated 1820 derivative records from 22526 primary records. [2025-09-19T22:16:29.784874] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-19T22:16:29.785894] [DEBUG] [LOCAL ] AWR: Derivative data saved (1820 records). [2025-09-19T22:16:29.786279] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:29.786378] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-19T22:16:29.790199] [INFO ] [MAIN ] AWK: Generated 1820 derivative records from 49612 primary records. [2025-09-19T22:16:29.788441] [INFO ] [MAIN ] Derivative Progress: 160/2093 symbols completed. AWR took 1.2s. Estimated remaining: 12m 48s. Rate: 151.1 symbols/min [2025-09-19T22:16:29.790516] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-19T22:16:29.802547] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:29.819725] [DEBUG] [LOCAL ] AWP: Derivative data saved (1820 records). [2025-09-19T22:16:29.821177] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-19T22:16:29.824331] [INFO ] [MAIN ] Derivative Progress: 161/2093 symbols completed. AWP took 1.2s. Estimated remaining: 12m 43s. Rate: 152.0 symbols/min [2025-09-19T22:16:29.826215] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:29.828374] [DEBUG] [LOCAL ] AWK: Derivative data saved (1820 records). [2025-09-19T22:16:29.828614] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-19T22:16:29.831610] [INFO ] [MAIN ] Derivative Progress: 162/2093 symbols completed. AWK took 1.3s. Estimated remaining: 12m 38s. Rate: 152.9 symbols/min [2025-09-19T22:16:29.834946] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:29.858944] [DEBUG] [LOCAL ] AX: Loaded 29273 existing records from primary storage. [2025-09-19T22:16:29.859144] [INFO ] [MAIN ] AX: Loaded 29273 primary data records. [2025-09-19T22:16:30.072048] [DEBUG] [LOCAL ] AXL: Loaded 51287 existing records from primary storage. [2025-09-19T22:16:30.095500] [INFO ] [MAIN ] AXL: Loaded 51287 primary data records. [2025-09-19T22:16:30.325907] [DEBUG] [LOCAL ] AXP: Loaded 54046 existing records from primary storage. [2025-09-19T22:16:30.338217] [INFO ] [MAIN ] AXP: Loaded 54046 primary data records. [2025-09-19T22:16:30.934746] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:30.936617] [INFO ] [MAIN ] AX: Generated 1820 derivative records from 29273 primary records. [2025-09-19T22:16:30.937038] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-19T22:16:30.957452] [DEBUG] [LOCAL ] AX: Derivative data saved (1820 records). [2025-09-19T22:16:30.957853] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-19T22:16:30.961130] [INFO ] [MAIN ] Derivative Progress: 163/2093 symbols completed. AX took 1.2s. Estimated remaining: 12m 46s. Rate: 151.1 symbols/min [2025-09-19T22:16:30.978796] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:30.979789] [INFO ] [MAIN ] AXL: Generated 1820 derivative records from 51287 primary records. [2025-09-19T22:16:30.979970] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-19T22:16:30.997311] [DEBUG] [LOCAL ] AXL: Derivative data saved (1820 records). [2025-09-19T22:16:30.998379] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-19T22:16:31.000525] [INFO ] [MAIN ] Derivative Progress: 164/2093 symbols completed. AXL took 1.2s. Estimated remaining: 12m 42s. Rate: 152.0 symbols/min [2025-09-19T22:16:31.014837] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:31.015505] [INFO ] [MAIN ] AXP: Generated 1820 derivative records from 54046 primary records. [2025-09-19T22:16:31.015569] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-19T22:16:31.031400] [DEBUG] [LOCAL ] AXP: Derivative data saved (1820 records). [2025-09-19T22:16:31.031469] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-19T22:16:31.034802] [INFO ] [MAIN ] Derivative Progress: 165/2093 symbols completed. AXP took 1.2s. Estimated remaining: 12m 37s. Rate: 152.8 symbols/min [2025-09-19T22:16:31.035448] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:31.035865] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:31.035815] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:31.042999] [DEBUG] [LOCAL ] AXR: Loaded 3219 existing records from primary storage. [2025-09-19T22:16:31.043268] [INFO ] [MAIN ] AXR: Loaded 3219 primary data records. [2025-09-19T22:16:31.335413] [DEBUG] [LOCAL ] AXS: Loaded 38897 existing records from primary storage. [2025-09-19T22:16:31.434488] [INFO ] [MAIN ] AXS: Loaded 38897 primary data records. [2025-09-19T22:16:31.507456] [DEBUG] [LOCAL ] AXTA: Loaded 52811 existing records from primary storage. [2025-09-19T22:16:31.516060] [INFO ] [MAIN ] AXTA: Loaded 52811 primary data records. [2025-09-19T22:16:32.102271] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:16:32.103560] [INFO ] [MAIN ] AXR: Generated 1819 derivative records from 3219 primary records. [2025-09-19T22:16:32.103979] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-19T22:16:32.121415] [DEBUG] [LOCAL ] AXR: Derivative data saved (1819 records). [2025-09-19T22:16:32.122023] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-19T22:16:32.124109] [INFO ] [MAIN ] Derivative Progress: 166/2093 symbols completed. AXR took 1.1s. Estimated remaining: 12m 45s. Rate: 151.2 symbols/min [2025-09-19T22:16:32.124441] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:32.143299] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:32.144155] [INFO ] [MAIN ] AXS: Generated 1820 derivative records from 38897 primary records. [2025-09-19T22:16:32.144342] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-19T22:16:32.178735] [DEBUG] [LOCAL ] AXS: Derivative data saved (1820 records). [2025-09-19T22:16:32.183772] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-19T22:16:32.186197] [INFO ] [MAIN ] Derivative Progress: 167/2093 symbols completed. AXS took 1.2s. Estimated remaining: 12m 40s. Rate: 152.0 symbols/min [2025-09-19T22:16:32.186584] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:32.186926] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:32.188158] [INFO ] [MAIN ] AXTA: Generated 1820 derivative records from 52811 primary records. [2025-09-19T22:16:32.188350] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-19T22:16:32.216623] [DEBUG] [LOCAL ] AYI: Loaded 25858 existing records from primary storage. [2025-09-19T22:16:32.215921] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1820 records). [2025-09-19T22:16:32.216803] [INFO ] [MAIN ] AYI: Loaded 25858 primary data records. [2025-09-19T22:16:32.222193] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-19T22:16:32.231730] [INFO ] [MAIN ] Derivative Progress: 168/2093 symbols completed. AXTA took 1.2s. Estimated remaining: 12m 36s. Rate: 152.8 symbols/min [2025-09-19T22:16:32.252330] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:32.301990] [DEBUG] [LOCAL ] AZO: Loaded 11785 existing records from primary storage. [2025-09-19T22:16:32.318369] [INFO ] [MAIN ] AZO: Loaded 11785 primary data records. [2025-09-19T22:16:32.692547] [DEBUG] [LOCAL ] AZZ: Loaded 22536 existing records from primary storage. [2025-09-19T22:16:32.727891] [INFO ] [MAIN ] AZZ: Loaded 22536 primary data records. [2025-09-19T22:16:33.285811] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:33.287010] [INFO ] [MAIN ] AYI: Generated 1820 derivative records from 25858 primary records. [2025-09-19T22:16:33.287185] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-19T22:16:33.324048] [DEBUG] [LOCAL ] AYI: Derivative data saved (1820 records). [2025-09-19T22:16:33.324229] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-19T22:16:33.322967] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:33.326429] [INFO ] [MAIN ] Derivative Progress: 169/2093 symbols completed. AYI took 1.2s. Estimated remaining: 12m 44s. Rate: 151.2 symbols/min [2025-09-19T22:16:33.328023] [INFO ] [MAIN ] AZO: Generated 1820 derivative records from 11785 primary records. [2025-09-19T22:16:33.326993] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:33.328615] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-19T22:16:33.347330] [DEBUG] [LOCAL ] AZO: Derivative data saved (1820 records). [2025-09-19T22:16:33.348480] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-19T22:16:33.352684] [INFO ] [MAIN ] Derivative Progress: 170/2093 symbols completed. AZO took 1.2s. Estimated remaining: 12m 39s. Rate: 152.0 symbols/min [2025-09-19T22:16:33.353603] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:33.366738] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:33.367507] [INFO ] [MAIN ] AZZ: Generated 1820 derivative records from 22536 primary records. [2025-09-19T22:16:33.367714] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-19T22:16:33.384904] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1820 records). [2025-09-19T22:16:33.385171] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-19T22:16:33.387832] [INFO ] [MAIN ] Derivative Progress: 171/2093 symbols completed. AZZ took 1.1s. Estimated remaining: 12m 35s. Rate: 152.8 symbols/min [2025-09-19T22:16:33.388211] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:33.447442] [DEBUG] [LOCAL ] BA: Loaded 54571 existing records from primary storage. [2025-09-19T22:16:33.447746] [INFO ] [MAIN ] BA: Loaded 54571 primary data records. [2025-09-19T22:16:33.592269] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-09-19T22:16:33.592863] [INFO ] [MAIN ] BABA: Loaded 54600 primary data records. [2025-09-19T22:16:33.756368] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-09-19T22:16:33.793908] [INFO ] [MAIN ] BAC: Loaded 54588 primary data records. [2025-09-19T22:16:34.520488] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:34.521558] [INFO ] [MAIN ] BA: Generated 1820 derivative records from 54571 primary records. [2025-09-19T22:16:34.521801] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-19T22:16:34.557900] [DEBUG] [LOCAL ] BA: Derivative data saved (1820 records). [2025-09-19T22:16:34.557806] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:34.558199] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-19T22:16:34.559541] [INFO ] [MAIN ] BABA: Generated 1820 derivative records from 54600 primary records. [2025-09-19T22:16:34.559930] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-19T22:16:34.562688] [INFO ] [MAIN ] Derivative Progress: 172/2093 symbols completed. BA took 1.2s. Estimated remaining: 12m 43s. Rate: 151.1 symbols/min [2025-09-19T22:16:34.563877] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:34.599090] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:34.600180] [DEBUG] [LOCAL ] BABA: Derivative data saved (1820 records). [2025-09-19T22:16:34.601223] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-19T22:16:34.600962] [INFO ] [MAIN ] BAC: Generated 1820 derivative records from 54588 primary records. [2025-09-19T22:16:34.601365] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-19T22:16:34.604350] [INFO ] [MAIN ] Derivative Progress: 173/2093 symbols completed. BABA took 1.3s. Estimated remaining: 12m 39s. Rate: 151.9 symbols/min [2025-09-19T22:16:34.604780] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:34.625928] [DEBUG] [LOCAL ] BAC: Derivative data saved (1820 records). [2025-09-19T22:16:34.626153] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-19T22:16:34.628871] [INFO ] [MAIN ] Derivative Progress: 174/2093 symbols completed. BAC took 1.2s. Estimated remaining: 12m 34s. Rate: 152.7 symbols/min [2025-09-19T22:16:34.629238] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:34.692970] [DEBUG] [LOCAL ] BAH: Loaded 52533 existing records from primary storage. [2025-09-19T22:16:34.707244] [INFO ] [MAIN ] BAH: Loaded 52533 primary data records. [2025-09-19T22:16:34.840274] [DEBUG] [LOCAL ] BALL: Loaded 52602 existing records from primary storage. [2025-09-19T22:16:34.846328] [INFO ] [MAIN ] BALL: Loaded 52602 primary data records. [2025-09-19T22:16:34.847808] [DEBUG] [LOCAL ] BAM: Loaded 52787 existing records from primary storage. [2025-09-19T22:16:34.848526] [INFO ] [MAIN ] BAM: Loaded 52787 primary data records. [2025-09-19T22:16:35.752736] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:35.755106] [INFO ] [MAIN ] BAH: Generated 1820 derivative records from 52533 primary records. [2025-09-19T22:16:35.756218] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-19T22:16:35.783022] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:35.785579] [INFO ] [MAIN ] BALL: Generated 1820 derivative records from 52602 primary records. [2025-09-19T22:16:35.788128] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-19T22:16:35.791869] [DEBUG] [LOCAL ] BAH: Derivative data saved (1820 records). [2025-09-19T22:16:35.792051] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-19T22:16:35.794303] [INFO ] [MAIN ] Derivative Progress: 175/2093 symbols completed. BAH took 1.2s. Estimated remaining: 12m 42s. Rate: 151.0 symbols/min [2025-09-19T22:16:35.794708] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:35.819362] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:35.823660] [DEBUG] [LOCAL ] BALL: Derivative data saved (1820 records). [2025-09-19T22:16:35.824715] [INFO ] [MAIN ] BAM: Generated 1820 derivative records from 52787 primary records. [2025-09-19T22:16:35.824805] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-19T22:16:35.824906] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-19T22:16:35.827538] [INFO ] [MAIN ] Derivative Progress: 176/2093 symbols completed. BALL took 1.2s. Estimated remaining: 12m 38s. Rate: 151.8 symbols/min [2025-09-19T22:16:35.828367] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:35.852596] [DEBUG] [LOCAL ] BAM: Derivative data saved (1820 records). [2025-09-19T22:16:35.852790] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-19T22:16:35.856772] [INFO ] [MAIN ] Derivative Progress: 177/2093 symbols completed. BAM took 1.2s. Estimated remaining: 12m 33s. Rate: 152.6 symbols/min [2025-09-19T22:16:35.857187] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:35.868160] [DEBUG] [LOCAL ] BAP: Loaded 26919 existing records from primary storage. [2025-09-19T22:16:35.868296] [INFO ] [MAIN ] BAP: Loaded 26919 primary data records. [2025-09-19T22:16:36.068082] [DEBUG] [LOCAL ] BARK: Loaded 39179 existing records from primary storage. [2025-09-19T22:16:36.087883] [INFO ] [MAIN ] BARK: Loaded 39179 primary data records. [2025-09-19T22:16:36.409067] [DEBUG] [LOCAL ] BAX: Loaded 54268 existing records from primary storage. [2025-09-19T22:16:36.427062] [INFO ] [MAIN ] BAX: Loaded 54268 primary data records. [2025-09-19T22:16:36.878391] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:36.879766] [INFO ] [MAIN ] BAP: Generated 1820 derivative records from 26919 primary records. [2025-09-19T22:16:36.880181] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-19T22:16:36.915058] [DEBUG] [LOCAL ] BAP: Derivative data saved (1820 records). [2025-09-19T22:16:36.915467] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:36.916371] [INFO ] [MAIN ] BARK: Generated 1820 derivative records from 39179 primary records. [2025-09-19T22:16:36.915668] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-19T22:16:36.916719] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-19T22:16:36.918682] [INFO ] [MAIN ] Derivative Progress: 178/2093 symbols completed. BAP took 1.1s. Estimated remaining: 12m 40s. Rate: 151.1 symbols/min [2025-09-19T22:16:36.938069] [DEBUG] [LOCAL ] BARK: Derivative data saved (1820 records). [2025-09-19T22:16:36.938347] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-19T22:16:36.941111] [INFO ] [MAIN ] Derivative Progress: 179/2093 symbols completed. BARK took 1.1s. Estimated remaining: 12m 36s. Rate: 151.9 symbols/min [2025-09-19T22:16:36.954757] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:36.955425] [INFO ] [MAIN ] BAX: Generated 1820 derivative records from 54268 primary records. [2025-09-19T22:16:36.955489] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-19T22:16:36.971891] [DEBUG] [LOCAL ] BAX: Derivative data saved (1820 records). [2025-09-19T22:16:36.971968] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-19T22:16:36.974563] [INFO ] [MAIN ] Derivative Progress: 180/2093 symbols completed. BAX took 1.1s. Estimated remaining: 12m 32s. Rate: 152.7 symbols/min [2025-09-19T22:16:36.975295] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:36.975170] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:36.976064] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:37.049197] [DEBUG] [LOCAL ] BBAR: Loaded 41690 existing records from primary storage. [2025-09-19T22:16:37.064173] [INFO ] [MAIN ] BBAR: Loaded 41690 primary data records. [2025-09-19T22:16:37.071014] [DEBUG] [LOCAL ] BB: Loaded 53703 existing records from primary storage. [2025-09-19T22:16:37.101630] [INFO ] [MAIN ] BB: Loaded 53703 primary data records. [2025-09-19T22:16:37.131779] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-09-19T22:16:37.165574] [INFO ] [MAIN ] BBAI: Loaded 54600 primary data records. [2025-09-19T22:16:38.095168] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:38.096112] [INFO ] [MAIN ] BB: Generated 1820 derivative records from 53703 primary records. [2025-09-19T22:16:38.096206] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-19T22:16:38.126299] [DEBUG] [LOCAL ] BB: Derivative data saved (1820 records). [2025-09-19T22:16:38.143718] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:38.138806] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-19T22:16:38.146127] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:38.145763] [INFO ] [MAIN ] Derivative Progress: 181/2093 symbols completed. BB took 1.2s. Estimated remaining: 12m 39s. Rate: 151.1 symbols/min [2025-09-19T22:16:38.147070] [INFO ] [MAIN ] BBAI: Generated 1820 derivative records from 54600 primary records. [2025-09-19T22:16:38.147312] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-19T22:16:38.147998] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:38.148957] [INFO ] [MAIN ] BBAR: Generated 1820 derivative records from 41690 primary records. [2025-09-19T22:16:38.149487] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-19T22:16:38.179414] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1820 records). [2025-09-19T22:16:38.181147] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-19T22:16:38.185351] [INFO ] [MAIN ] Derivative Progress: 182/2093 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 35s. Rate: 151.8 symbols/min [2025-09-19T22:16:38.186857] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1820 records). [2025-09-19T22:16:38.187062] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-19T22:16:38.186105] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:38.190179] [INFO ] [MAIN ] Derivative Progress: 183/2093 symbols completed. BBAR took 1.2s. Estimated remaining: 12m 31s. Rate: 152.6 symbols/min [2025-09-19T22:16:38.191036] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:38.199918] [DEBUG] [LOCAL ] BBDO: Loaded 5129 existing records from primary storage. [2025-09-19T22:16:38.200061] [INFO ] [MAIN ] BBDO: Loaded 5129 primary data records. [2025-09-19T22:16:38.421544] [DEBUG] [LOCAL ] BBD: Loaded 53954 existing records from primary storage. [2025-09-19T22:16:38.457741] [DEBUG] [LOCAL ] BBDC: Loaded 33965 existing records from primary storage. [2025-09-19T22:16:38.463541] [INFO ] [MAIN ] BBDC: Loaded 33965 primary data records. [2025-09-19T22:16:38.458016] [INFO ] [MAIN ] BBD: Loaded 53954 primary data records. [2025-09-19T22:16:39.531683] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:39.533474] [INFO ] [MAIN ] BBDO: Generated 1820 derivative records from 5129 primary records. [2025-09-19T22:16:39.534368] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-19T22:16:39.575377] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1820 records). [2025-09-19T22:16:39.575985] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:39.577076] [INFO ] [MAIN ] BBDC: Generated 1820 derivative records from 33965 primary records. [2025-09-19T22:16:39.577509] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-19T22:16:39.578012] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-19T22:16:39.580638] [INFO ] [MAIN ] Derivative Progress: 184/2093 symbols completed. BBDO took 1.4s. Estimated remaining: 12m 41s. Rate: 150.6 symbols/min [2025-09-19T22:16:39.593081] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:39.603138] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1820 records). [2025-09-19T22:16:39.603368] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-19T22:16:39.606290] [INFO ] [MAIN ] Derivative Progress: 185/2093 symbols completed. BBDC took 1.4s. Estimated remaining: 12m 37s. Rate: 151.3 symbols/min [2025-09-19T22:16:39.607047] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:39.628150] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:39.628955] [INFO ] [MAIN ] BBD: Generated 1820 derivative records from 53954 primary records. [2025-09-19T22:16:39.629172] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-19T22:16:39.656928] [DEBUG] [LOCAL ] BBN: Loaded 18292 existing records from primary storage. [2025-09-19T22:16:39.662524] [INFO ] [MAIN ] BBN: Loaded 18292 primary data records. [2025-09-19T22:16:39.662006] [DEBUG] [LOCAL ] BBU: Loaded 4115 existing records from primary storage. [2025-09-19T22:16:39.663733] [INFO ] [MAIN ] BBU: Loaded 4115 primary data records. [2025-09-19T22:16:39.842473] [DEBUG] [LOCAL ] BBD: Derivative data saved (1820 records). [2025-09-19T22:16:39.887800] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-19T22:16:39.891083] [INFO ] [MAIN ] Derivative Progress: 186/2093 symbols completed. BBD took 1.7s. Estimated remaining: 12m 35s. Rate: 151.5 symbols/min [2025-09-19T22:16:39.896579] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:40.309188] [DEBUG] [LOCAL ] BBUC: Loaded 13440 existing records from primary storage. [2025-09-19T22:16:40.337077] [INFO ] [MAIN ] BBUC: Loaded 13440 primary data records. [2025-09-19T22:16:40.671907] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:16:40.685193] [INFO ] [MAIN ] BBU: Generated 1819 derivative records from 4115 primary records. [2025-09-19T22:16:40.686035] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:40.685669] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-19T22:16:40.689565] [INFO ] [MAIN ] BBN: Generated 1820 derivative records from 18292 primary records. [2025-09-19T22:16:40.689830] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-19T22:16:40.719495] [DEBUG] [LOCAL ] BBU: Derivative data saved (1819 records). [2025-09-19T22:16:40.723532] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-19T22:16:40.727136] [INFO ] [MAIN ] Derivative Progress: 187/2093 symbols completed. BBU took 1.1s. Estimated remaining: 12m 39s. Rate: 150.7 symbols/min [2025-09-19T22:16:40.731222] [DEBUG] [LOCAL ] BBN: Derivative data saved (1820 records). [2025-09-19T22:16:40.731368] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-19T22:16:40.733523] [INFO ] [MAIN ] Derivative Progress: 188/2093 symbols completed. BBN took 1.1s. Estimated remaining: 12m 35s. Rate: 151.4 symbols/min [2025-09-19T22:16:40.734261] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:40.734618] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:40.752970] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:40.753795] [INFO ] [MAIN ] BBUC: Generated 1820 derivative records from 13440 primary records. [2025-09-19T22:16:40.753891] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-19T22:16:40.770340] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1820 records). [2025-09-19T22:16:40.770689] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-19T22:16:40.780971] [INFO ] [MAIN ] Derivative Progress: 189/2093 symbols completed. BBUC took 0.9s. Estimated remaining: 12m 31s. Rate: 152.2 symbols/min [2025-09-19T22:16:40.781367] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:40.795295] [DEBUG] [LOCAL ] BBW: Loaded 26896 existing records from primary storage. [2025-09-19T22:16:40.795462] [INFO ] [MAIN ] BBW: Loaded 26896 primary data records. [2025-09-19T22:16:41.131004] [DEBUG] [LOCAL ] BBVA: Loaded 50331 existing records from primary storage. [2025-09-19T22:16:41.131393] [INFO ] [MAIN ] BBVA: Loaded 50331 primary data records. [2025-09-19T22:16:41.257202] [DEBUG] [LOCAL ] BBWI: Loaded 54354 existing records from primary storage. [2025-09-19T22:16:41.263567] [INFO ] [MAIN ] BBWI: Loaded 54354 primary data records. [2025-09-19T22:16:41.829592] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:41.831091] [INFO ] [MAIN ] BBW: Generated 1820 derivative records from 26896 primary records. [2025-09-19T22:16:41.831523] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-19T22:16:41.852161] [DEBUG] [LOCAL ] BBW: Derivative data saved (1820 records). [2025-09-19T22:16:41.853291] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-19T22:16:41.856429] [INFO ] [MAIN ] Derivative Progress: 190/2093 symbols completed. BBW took 1.1s. Estimated remaining: 12m 37s. Rate: 150.8 symbols/min [2025-09-19T22:16:41.856896] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:41.871733] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:41.872559] [INFO ] [MAIN ] BBVA: Generated 1820 derivative records from 50331 primary records. [2025-09-19T22:16:41.872743] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-19T22:16:41.901876] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:41.904126] [INFO ] [MAIN ] BBWI: Generated 1820 derivative records from 54354 primary records. [2025-09-19T22:16:41.904798] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-19T22:16:41.919482] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1820 records). [2025-09-19T22:16:41.923793] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1820 records). [2025-09-19T22:16:41.923982] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-19T22:16:41.924061] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-19T22:16:41.925979] [INFO ] [MAIN ] Derivative Progress: 191/2093 symbols completed. BBVA took 1.2s. Estimated remaining: 12m 34s. Rate: 151.4 symbols/min [2025-09-19T22:16:41.928911] [INFO ] [MAIN ] Derivative Progress: 192/2093 symbols completed. BBWI took 1.1s. Estimated remaining: 12m 29s. Rate: 152.2 symbols/min [2025-09-19T22:16:41.928967] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:41.929203] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:41.975252] [DEBUG] [LOCAL ] BBY: Loaded 54263 existing records from primary storage. [2025-09-19T22:16:41.975558] [INFO ] [MAIN ] BBY: Loaded 54263 primary data records. [2025-09-19T22:16:42.095905] [DEBUG] [LOCAL ] BCC: Loaded 28900 existing records from primary storage. [2025-09-19T22:16:42.126993] [INFO ] [MAIN ] BCC: Loaded 28900 primary data records. [2025-09-19T22:16:42.190280] [DEBUG] [LOCAL ] BCAT: Loaded 35198 existing records from primary storage. [2025-09-19T22:16:42.227973] [INFO ] [MAIN ] BCAT: Loaded 35198 primary data records. [2025-09-19T22:16:42.942387] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:42.943545] [INFO ] [MAIN ] BBY: Generated 1820 derivative records from 54263 primary records. [2025-09-19T22:16:42.943841] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-19T22:16:42.964356] [DEBUG] [LOCAL ] BBY: Derivative data saved (1820 records). [2025-09-19T22:16:42.964791] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-19T22:16:42.967288] [INFO ] [MAIN ] Derivative Progress: 193/2093 symbols completed. BBY took 1.1s. Estimated remaining: 12m 35s. Rate: 150.9 symbols/min [2025-09-19T22:16:42.986531] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:42.987365] [INFO ] [MAIN ] BCC: Generated 1820 derivative records from 28900 primary records. [2025-09-19T22:16:42.987467] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-19T22:16:43.015423] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:43.016879] [INFO ] [MAIN ] BCAT: Generated 1820 derivative records from 35198 primary records. [2025-09-19T22:16:43.017767] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-19T22:16:43.019909] [DEBUG] [LOCAL ] BCC: Derivative data saved (1820 records). [2025-09-19T22:16:43.020202] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-19T22:16:43.022585] [INFO ] [MAIN ] Derivative Progress: 194/2093 symbols completed. BCC took 1.1s. Estimated remaining: 12m 31s. Rate: 151.6 symbols/min [2025-09-19T22:16:43.038799] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1820 records). [2025-09-19T22:16:43.038932] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-19T22:16:43.041900] [INFO ] [MAIN ] Derivative Progress: 195/2093 symbols completed. BCAT took 1.1s. Estimated remaining: 12m 27s. Rate: 152.4 symbols/min [2025-09-19T22:16:43.042463] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:43.042744] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:43.042887] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:43.094326] [DEBUG] [LOCAL ] BCO: Loaded 26929 existing records from primary storage. [2025-09-19T22:16:43.093581] [DEBUG] [LOCAL ] BCH: Loaded 30018 existing records from primary storage. [2025-09-19T22:16:43.094570] [INFO ] [MAIN ] BCH: Loaded 30018 primary data records. [2025-09-19T22:16:43.094713] [INFO ] [MAIN ] BCO: Loaded 26929 primary data records. [2025-09-19T22:16:43.766755] [DEBUG] [LOCAL ] BCE: Loaded 53142 existing records from primary storage. [2025-09-19T22:16:43.767029] [INFO ] [MAIN ] BCE: Loaded 53142 primary data records. [2025-09-19T22:16:44.110305] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:44.113036] [INFO ] [MAIN ] BCH: Generated 1820 derivative records from 30018 primary records. [2025-09-19T22:16:44.114347] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-19T22:16:44.128097] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:44.136178] [INFO ] [MAIN ] BCO: Generated 1820 derivative records from 26929 primary records. [2025-09-19T22:16:44.136417] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-19T22:16:44.160615] [DEBUG] [LOCAL ] BCO: Derivative data saved (1820 records). [2025-09-19T22:16:44.160795] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-19T22:16:44.163464] [INFO ] [MAIN ] Derivative Progress: 196/2093 symbols completed. BCO took 1.1s. Estimated remaining: 12m 34s. Rate: 150.9 symbols/min [2025-09-19T22:16:44.164202] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:44.165705] [DEBUG] [LOCAL ] BCH: Derivative data saved (1820 records). [2025-09-19T22:16:44.165842] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-19T22:16:44.168086] [INFO ] [MAIN ] Derivative Progress: 197/2093 symbols completed. BCH took 1.1s. Estimated remaining: 12m 30s. Rate: 151.7 symbols/min [2025-09-19T22:16:44.168420] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:44.186890] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:44.187907] [INFO ] [MAIN ] BCE: Generated 1820 derivative records from 53142 primary records. [2025-09-19T22:16:44.188056] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-19T22:16:44.206285] [DEBUG] [LOCAL ] BCE: Derivative data saved (1820 records). [2025-09-19T22:16:44.206408] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-19T22:16:44.209397] [INFO ] [MAIN ] Derivative Progress: 198/2093 symbols completed. BCE took 1.2s. Estimated remaining: 12m 26s. Rate: 152.4 symbols/min [2025-09-19T22:16:44.215986] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:44.241060] [DEBUG] [LOCAL ] BCSF: Loaded 28369 existing records from primary storage. [2025-09-19T22:16:44.258292] [INFO ] [MAIN ] BCSF: Loaded 28369 primary data records. [2025-09-19T22:16:44.356817] [DEBUG] [LOCAL ] BCX: Loaded 22297 existing records from primary storage. [2025-09-19T22:16:44.394806] [INFO ] [MAIN ] BCX: Loaded 22297 primary data records. [2025-09-19T22:16:44.407086] [DEBUG] [LOCAL ] BCS: Loaded 54253 existing records from primary storage. [2025-09-19T22:16:44.442825] [INFO ] [MAIN ] BCS: Loaded 54253 primary data records. [2025-09-19T22:16:45.246209] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:45.247485] [INFO ] [MAIN ] BCSF: Generated 1820 derivative records from 28369 primary records. [2025-09-19T22:16:45.248626] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-19T22:16:45.281965] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:45.283186] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1820 records). [2025-09-19T22:16:45.285614] [INFO ] [MAIN ] BCX: Generated 1820 derivative records from 22297 primary records. [2025-09-19T22:16:45.284192] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-19T22:16:45.285949] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-19T22:16:45.288075] [INFO ] [MAIN ] Derivative Progress: 199/2093 symbols completed. BCSF took 1.1s. Estimated remaining: 12m 32s. Rate: 151.1 symbols/min [2025-09-19T22:16:45.301078] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:45.302524] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:45.303465] [INFO ] [MAIN ] BCS: Generated 1820 derivative records from 54253 primary records. [2025-09-19T22:16:45.310683] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-19T22:16:45.335822] [DEBUG] [LOCAL ] BCS: Derivative data saved (1820 records). [2025-09-19T22:16:45.336901] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-19T22:16:45.340106] [INFO ] [MAIN ] Derivative Progress: 200/2093 symbols completed. BCS took 1.2s. Estimated remaining: 12m 29s. Rate: 151.7 symbols/min [2025-09-19T22:16:45.340895] [DEBUG] [LOCAL ] BCX: Derivative data saved (1820 records). [2025-09-19T22:16:45.341155] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:45.341221] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-19T22:16:45.353053] [INFO ] [MAIN ] Derivative Progress: 201/2093 symbols completed. BCX took 1.1s. Estimated remaining: 12m 25s. Rate: 152.5 symbols/min [2025-09-19T22:16:45.353435] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:45.367000] [DEBUG] [LOCAL ] BDC: Loaded 25371 existing records from primary storage. [2025-09-19T22:16:45.367310] [INFO ] [MAIN ] BDC: Loaded 25371 primary data records. [2025-09-19T22:16:45.599881] [DEBUG] [LOCAL ] BDJ: Loaded 29626 existing records from primary storage. [2025-09-19T22:16:45.720914] [DEBUG] [LOCAL ] BDN: Loaded 48364 existing records from primary storage. [2025-09-19T22:16:45.720229] [INFO ] [MAIN ] BDJ: Loaded 29626 primary data records. [2025-09-19T22:16:45.721243] [INFO ] [MAIN ] BDN: Loaded 48364 primary data records. [2025-09-19T22:16:46.401287] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:46.402343] [INFO ] [MAIN ] BDC: Generated 1820 derivative records from 25371 primary records. [2025-09-19T22:16:46.402602] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-19T22:16:46.426754] [DEBUG] [LOCAL ] BDC: Derivative data saved (1820 records). [2025-09-19T22:16:46.428443] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-19T22:16:46.430907] [INFO ] [MAIN ] Derivative Progress: 202/2093 symbols completed. BDC took 1.1s. Estimated remaining: 12m 31s. Rate: 151.2 symbols/min [2025-09-19T22:16:46.444579] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:46.458250] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:46.456627] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:46.459039] [INFO ] [MAIN ] BDN: Generated 1820 derivative records from 48364 primary records. [2025-09-19T22:16:46.459224] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-19T22:16:46.457939] [INFO ] [MAIN ] BDJ: Generated 1820 derivative records from 29626 primary records. [2025-09-19T22:16:46.459378] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-19T22:16:46.492509] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1820 records). [2025-09-19T22:16:46.491627] [DEBUG] [LOCAL ] BDN: Derivative data saved (1820 records). [2025-09-19T22:16:46.492694] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-19T22:16:46.492749] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-19T22:16:46.495058] [INFO ] [MAIN ] Derivative Progress: 203/2093 symbols completed. BDJ took 1.2s. Estimated remaining: 12m 27s. Rate: 151.8 symbols/min [2025-09-19T22:16:46.499165] [INFO ] [MAIN ] Derivative Progress: 204/2093 symbols completed. BDN took 1.1s. Estimated remaining: 12m 23s. Rate: 152.5 symbols/min [2025-09-19T22:16:46.499569] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:46.499080] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:46.595600] [DEBUG] [LOCAL ] BDX: Loaded 53259 existing records from primary storage. [2025-09-19T22:16:46.596667] [INFO ] [MAIN ] BDX: Loaded 53259 primary data records. [2025-09-19T22:16:46.596531] [DEBUG] [LOCAL ] BE: Loaded 54433 existing records from primary storage. [2025-09-19T22:16:46.608375] [INFO ] [MAIN ] BE: Loaded 54433 primary data records. [2025-09-19T22:16:46.828883] [DEBUG] [LOCAL ] BEKE: Loaded 54042 existing records from primary storage. [2025-09-19T22:16:46.829915] [INFO ] [MAIN ] BEKE: Loaded 54042 primary data records. [2025-09-19T22:16:47.605736] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:47.619422] [INFO ] [MAIN ] BE: Generated 1820 derivative records from 54433 primary records. [2025-09-19T22:16:47.619680] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-19T22:16:47.621157] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:47.630208] [INFO ] [MAIN ] BDX: Generated 1820 derivative records from 53259 primary records. [2025-09-19T22:16:47.635231] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-19T22:16:47.650679] [DEBUG] [LOCAL ] BE: Derivative data saved (1820 records). [2025-09-19T22:16:47.661912] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-19T22:16:47.669099] [INFO ] [MAIN ] Derivative Progress: 205/2093 symbols completed. BE took 1.2s. Estimated remaining: 12m 30s. Rate: 151.1 symbols/min [2025-09-19T22:16:47.671085] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:47.671907] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:47.673296] [INFO ] [MAIN ] BEKE: Generated 1820 derivative records from 54042 primary records. [2025-09-19T22:16:47.673681] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-19T22:16:47.691972] [DEBUG] [LOCAL ] BDX: Derivative data saved (1820 records). [2025-09-19T22:16:47.692551] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-19T22:16:47.694824] [INFO ] [MAIN ] Derivative Progress: 206/2093 symbols completed. BDX took 1.3s. Estimated remaining: 12m 26s. Rate: 151.8 symbols/min [2025-09-19T22:16:47.695400] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:47.701047] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1820 records). [2025-09-19T22:16:47.701234] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-19T22:16:47.704434] [INFO ] [MAIN ] Derivative Progress: 207/2093 symbols completed. BEKE took 1.2s. Estimated remaining: 12m 22s. Rate: 152.5 symbols/min [2025-09-19T22:16:47.704771] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:47.767822] [DEBUG] [LOCAL ] BEN: Loaded 53847 existing records from primary storage. [2025-09-19T22:16:47.768033] [INFO ] [MAIN ] BEN: Loaded 53847 primary data records. [2025-09-19T22:16:47.780909] [DEBUG] [LOCAL ] BEP: Loaded 39400 existing records from primary storage. [2025-09-19T22:16:47.808832] [INFO ] [MAIN ] BEP: Loaded 39400 primary data records. [2025-09-19T22:16:48.040550] [DEBUG] [LOCAL ] BEPC: Loaded 47318 existing records from primary storage. [2025-09-19T22:16:48.080230] [INFO ] [MAIN ] BEPC: Loaded 47318 primary data records. [2025-09-19T22:16:48.833556] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:48.836223] [INFO ] [MAIN ] BEN: Generated 1820 derivative records from 53847 primary records. [2025-09-19T22:16:48.836453] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-19T22:16:48.869773] [DEBUG] [LOCAL ] BEN: Derivative data saved (1820 records). [2025-09-19T22:16:48.870037] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-19T22:16:48.868444] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:48.872453] [INFO ] [MAIN ] Derivative Progress: 208/2093 symbols completed. BEN took 1.2s. Estimated remaining: 12m 29s. Rate: 151.1 symbols/min [2025-09-19T22:16:48.873978] [INFO ] [MAIN ] BEP: Generated 1820 derivative records from 39400 primary records. [2025-09-19T22:16:48.874323] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-19T22:16:48.892666] [DEBUG] [LOCAL ] BEP: Derivative data saved (1820 records). [2025-09-19T22:16:48.893615] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-19T22:16:48.896853] [INFO ] [MAIN ] Derivative Progress: 209/2093 symbols completed. BEP took 1.2s. Estimated remaining: 12m 25s. Rate: 151.7 symbols/min [2025-09-19T22:16:48.909713] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:48.910279] [INFO ] [MAIN ] BEPC: Generated 1820 derivative records from 47318 primary records. [2025-09-19T22:16:48.910338] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-19T22:16:48.925482] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1820 records). [2025-09-19T22:16:48.925549] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-19T22:16:48.928316] [INFO ] [MAIN ] Derivative Progress: 210/2093 symbols completed. BEPC took 1.2s. Estimated remaining: 12m 21s. Rate: 152.4 symbols/min [2025-09-19T22:16:48.929215] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:48.929072] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:48.929484] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:48.937507] [DEBUG] [LOCAL ] BEPJ: Loaded 3320 existing records from primary storage. [2025-09-19T22:16:48.938981] [INFO ] [MAIN ] BEPJ: Loaded 3320 primary data records. [2025-09-19T22:16:48.978284] [DEBUG] [LOCAL ] BEPI: Loaded 3470 existing records from primary storage. [2025-09-19T22:16:49.017409] [INFO ] [MAIN ] BEPI: Loaded 3470 primary data records. [2025-09-19T22:16:49.017310] [DEBUG] [LOCAL ] BEPH: Loaded 5269 existing records from primary storage. [2025-09-19T22:16:49.026763] [INFO ] [MAIN ] BEPH: Loaded 5269 primary data records. [2025-09-19T22:16:49.970665] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:16:49.971434] [INFO ] [MAIN ] BEPJ: Generated 1819 derivative records from 3320 primary records. [2025-09-19T22:16:49.971624] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-19T22:16:50.005859] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1819 records). [2025-09-19T22:16:50.006472] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:50.006626] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-19T22:16:50.014790] [INFO ] [MAIN ] BEPH: Generated 1820 derivative records from 5269 primary records. [2025-09-19T22:16:50.019586] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-19T22:16:50.021606] [INFO ] [MAIN ] Derivative Progress: 211/2093 symbols completed. BEPJ took 1.1s. Estimated remaining: 12m 27s. Rate: 151.1 symbols/min [2025-09-19T22:16:50.022752] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:50.022851] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:50.023927] [INFO ] [MAIN ] BEPI: Generated 1820 derivative records from 3470 primary records. [2025-09-19T22:16:50.024360] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-19T22:16:50.055095] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1820 records). [2025-09-19T22:16:50.055214] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-19T22:16:50.057986] [INFO ] [MAIN ] Derivative Progress: 212/2093 symbols completed. BEPH took 1.1s. Estimated remaining: 12m 24s. Rate: 151.8 symbols/min [2025-09-19T22:16:50.054946] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1820 records). [2025-09-19T22:16:50.058407] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:50.058207] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-19T22:16:50.061730] [INFO ] [MAIN ] Derivative Progress: 213/2093 symbols completed. BEPI took 1.1s. Estimated remaining: 12m 20s. Rate: 152.5 symbols/min [2025-09-19T22:16:50.062206] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:50.091825] [DEBUG] [LOCAL ] BFK: Loaded 14286 existing records from primary storage. [2025-09-19T22:16:50.102057] [INFO ] [MAIN ] BFK: Loaded 14286 primary data records. [2025-09-19T22:16:50.134316] [DEBUG] [LOCAL ] BFAM: Loaded 33457 existing records from primary storage. [2025-09-19T22:16:50.182456] [INFO ] [MAIN ] BFAM: Loaded 33457 primary data records. [2025-09-19T22:16:50.434115] [DEBUG] [LOCAL ] BFH: Loaded 42563 existing records from primary storage. [2025-09-19T22:16:50.566698] [INFO ] [MAIN ] BFH: Loaded 42563 primary data records. [2025-09-19T22:16:51.052086] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:51.053377] [INFO ] [MAIN ] BFK: Generated 1820 derivative records from 14286 primary records. [2025-09-19T22:16:51.053602] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-19T22:16:51.086101] [DEBUG] [LOCAL ] BFK: Derivative data saved (1820 records). [2025-09-19T22:16:51.086706] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-19T22:16:51.089323] [INFO ] [MAIN ] Derivative Progress: 214/2093 symbols completed. BFK took 1.0s. Estimated remaining: 12m 25s. Rate: 151.3 symbols/min [2025-09-19T22:16:51.087024] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:51.090981] [INFO ] [MAIN ] BFAM: Generated 1820 derivative records from 33457 primary records. [2025-09-19T22:16:51.090038] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:51.091541] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-19T22:16:51.110223] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1820 records). [2025-09-19T22:16:51.110473] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-19T22:16:51.112754] [INFO ] [MAIN ] Derivative Progress: 215/2093 symbols completed. BFAM took 1.1s. Estimated remaining: 12m 21s. Rate: 152.0 symbols/min [2025-09-19T22:16:51.114340] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:51.131125] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:51.132147] [INFO ] [MAIN ] BFH: Generated 1820 derivative records from 42563 primary records. [2025-09-19T22:16:51.132381] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-19T22:16:51.152334] [DEBUG] [LOCAL ] BFS: Loaded 9166 existing records from primary storage. [2025-09-19T22:16:51.152856] [INFO ] [MAIN ] BFS: Loaded 9166 primary data records. [2025-09-19T22:16:51.222551] [DEBUG] [LOCAL ] BFH: Derivative data saved (1820 records). [2025-09-19T22:16:51.245717] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-19T22:16:51.261627] [INFO ] [MAIN ] Derivative Progress: 216/2093 symbols completed. BFH took 1.2s. Estimated remaining: 12m 19s. Rate: 152.5 symbols/min [2025-09-19T22:16:51.281014] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:51.301388] [DEBUG] [LOCAL ] BFLY: Loaded 52606 existing records from primary storage. [2025-09-19T22:16:51.323316] [INFO ] [MAIN ] BFLY: Loaded 52606 primary data records. [2025-09-19T22:16:51.583262] [DEBUG] [LOCAL ] BFZ: Loaded 11653 existing records from primary storage. [2025-09-19T22:16:51.616467] [INFO ] [MAIN ] BFZ: Loaded 11653 primary data records. [2025-09-19T22:16:52.220965] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:52.223126] [INFO ] [MAIN ] BFS: Generated 1820 derivative records from 9166 primary records. [2025-09-19T22:16:52.223299] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-19T22:16:52.252359] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:52.258748] [INFO ] [MAIN ] BFLY: Generated 1820 derivative records from 52606 primary records. [2025-09-19T22:16:52.257894] [DEBUG] [LOCAL ] BFS: Derivative data saved (1820 records). [2025-09-19T22:16:52.259007] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-19T22:16:52.259324] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-19T22:16:52.263158] [INFO ] [MAIN ] Derivative Progress: 217/2093 symbols completed. BFS took 1.1s. Estimated remaining: 12m 24s. Rate: 151.4 symbols/min [2025-09-19T22:16:52.263993] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:52.281590] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1820 records). [2025-09-19T22:16:52.281712] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-19T22:16:52.284157] [INFO ] [MAIN ] Derivative Progress: 218/2093 symbols completed. BFLY took 1.2s. Estimated remaining: 12m 20s. Rate: 152.0 symbols/min [2025-09-19T22:16:52.284545] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:52.301464] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:52.302352] [INFO ] [MAIN ] BFZ: Generated 1820 derivative records from 11653 primary records. [2025-09-19T22:16:52.302537] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-19T22:16:52.324450] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1820 records). [2025-09-19T22:16:52.330572] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-19T22:16:52.333605] [INFO ] [MAIN ] Derivative Progress: 219/2093 symbols completed. BFZ took 1.1s. Estimated remaining: 12m 17s. Rate: 152.6 symbols/min [2025-09-19T22:16:52.334020] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:52.334567] [DEBUG] [LOCAL ] BGB: Loaded 17835 existing records from primary storage. [2025-09-19T22:16:52.335150] [INFO ] [MAIN ] BGB: Loaded 17835 primary data records. [2025-09-19T22:16:52.531757] [DEBUG] [LOCAL ] BGH: Loaded 16671 existing records from primary storage. [2025-09-19T22:16:52.555374] [DEBUG] [LOCAL ] BG: Loaded 51108 existing records from primary storage. [2025-09-19T22:16:52.554192] [INFO ] [MAIN ] BGH: Loaded 16671 primary data records. [2025-09-19T22:16:52.555594] [INFO ] [MAIN ] BG: Loaded 51108 primary data records. [2025-09-19T22:16:53.343807] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:53.346225] [INFO ] [MAIN ] BGB: Generated 1820 derivative records from 17835 primary records. [2025-09-19T22:16:53.346498] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-19T22:16:53.369584] [DEBUG] [LOCAL ] BGB: Derivative data saved (1820 records). [2025-09-19T22:16:53.371286] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-19T22:16:53.374250] [INFO ] [MAIN ] Derivative Progress: 220/2093 symbols completed. BGB took 1.1s. Estimated remaining: 12m 22s. Rate: 151.5 symbols/min [2025-09-19T22:16:53.375035] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:53.397031] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:53.402591] [INFO ] [MAIN ] BG: Generated 1820 derivative records from 51108 primary records. [2025-09-19T22:16:53.402897] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:53.403106] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-19T22:16:53.403687] [INFO ] [MAIN ] BGH: Generated 1820 derivative records from 16671 primary records. [2025-09-19T22:16:53.404464] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-19T22:16:53.439457] [DEBUG] [LOCAL ] BG: Derivative data saved (1820 records). [2025-09-19T22:16:53.439382] [DEBUG] [LOCAL ] BGH: Derivative data saved (1820 records). [2025-09-19T22:16:53.444815] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-19T22:16:53.445135] [DEBUG] [LOCAL ] BGR: Loaded 13798 existing records from primary storage. [2025-09-19T22:16:53.445338] [INFO ] [MAIN ] BGR: Loaded 13798 primary data records. [2025-09-19T22:16:53.445194] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-19T22:16:53.453147] [INFO ] [MAIN ] Derivative Progress: 221/2093 symbols completed. BG took 1.2s. Estimated remaining: 12m 19s. Rate: 152.1 symbols/min [2025-09-19T22:16:53.462590] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:53.455957] [INFO ] [MAIN ] Derivative Progress: 222/2093 symbols completed. BGH took 1.1s. Estimated remaining: 12m 15s. Rate: 152.7 symbols/min [2025-09-19T22:16:53.482635] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:53.563315] [DEBUG] [LOCAL ] BGSF: Loaded 6327 existing records from primary storage. [2025-09-19T22:16:53.569143] [INFO ] [MAIN ] BGSF: Loaded 6327 primary data records. [2025-09-19T22:16:54.143271] [DEBUG] [LOCAL ] BGS: Loaded 51172 existing records from primary storage. [2025-09-19T22:16:54.143627] [INFO ] [MAIN ] BGS: Loaded 51172 primary data records. [2025-09-19T22:16:54.480808] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:54.482933] [INFO ] [MAIN ] BGR: Generated 1820 derivative records from 13798 primary records. [2025-09-19T22:16:54.484859] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-19T22:16:54.504259] [DEBUG] [LOCAL ] BGR: Derivative data saved (1820 records). [2025-09-19T22:16:54.516954] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-19T22:16:54.521088] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:54.520584] [INFO ] [MAIN ] Derivative Progress: 223/2093 symbols completed. BGR took 1.1s. Estimated remaining: 12m 20s. Rate: 151.6 symbols/min [2025-09-19T22:16:54.522133] [INFO ] [MAIN ] BGSF: Generated 1820 derivative records from 6327 primary records. [2025-09-19T22:16:54.522471] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-19T22:16:54.537184] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1820 records). [2025-09-19T22:16:54.537377] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-19T22:16:54.539881] [INFO ] [MAIN ] Derivative Progress: 224/2093 symbols completed. BGSF took 1.1s. Estimated remaining: 12m 17s. Rate: 152.2 symbols/min [2025-09-19T22:16:54.555453] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:54.556317] [INFO ] [MAIN ] BGS: Generated 1820 derivative records from 51172 primary records. [2025-09-19T22:16:54.556395] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-19T22:16:54.573118] [DEBUG] [LOCAL ] BGS: Derivative data saved (1820 records). [2025-09-19T22:16:54.573182] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-19T22:16:54.575598] [INFO ] [MAIN ] Derivative Progress: 225/2093 symbols completed. BGS took 1.1s. Estimated remaining: 12m 13s. Rate: 152.8 symbols/min [2025-09-19T22:16:54.576386] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:54.576180] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:54.576229] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:54.589987] [DEBUG] [LOCAL ] BGX: Loaded 10987 existing records from primary storage. [2025-09-19T22:16:54.590118] [INFO ] [MAIN ] BGX: Loaded 10987 primary data records. [2025-09-19T22:16:54.723101] [DEBUG] [LOCAL ] BGY: Loaded 23356 existing records from primary storage. [2025-09-19T22:16:54.718994] [DEBUG] [LOCAL ] BGT: Loaded 16885 existing records from primary storage. [2025-09-19T22:16:54.723352] [INFO ] [MAIN ] BGY: Loaded 23356 primary data records. [2025-09-19T22:16:54.723284] [INFO ] [MAIN ] BGT: Loaded 16885 primary data records. [2025-09-19T22:16:55.558393] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:55.559343] [INFO ] [MAIN ] BGX: Generated 1820 derivative records from 10987 primary records. [2025-09-19T22:16:55.559544] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-19T22:16:55.604145] [DEBUG] [LOCAL ] BGX: Derivative data saved (1820 records). [2025-09-19T22:16:55.605246] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:55.604803] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:55.606550] [INFO ] [MAIN ] BGT: Generated 1820 derivative records from 16885 primary records. [2025-09-19T22:16:55.605976] [INFO ] [MAIN ] BGY: Generated 1820 derivative records from 23356 primary records. [2025-09-19T22:16:55.606725] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-19T22:16:55.606838] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-19T22:16:55.606634] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-19T22:16:55.610254] [INFO ] [MAIN ] Derivative Progress: 226/2093 symbols completed. BGX took 1.0s. Estimated remaining: 12m 18s. Rate: 151.7 symbols/min [2025-09-19T22:16:55.628272] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:55.638731] [DEBUG] [LOCAL ] BGY: Derivative data saved (1820 records). [2025-09-19T22:16:55.639917] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-19T22:16:55.643062] [INFO ] [MAIN ] Derivative Progress: 227/2093 symbols completed. BGY took 1.1s. Estimated remaining: 12m 15s. Rate: 152.4 symbols/min [2025-09-19T22:16:55.643603] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:55.644148] [DEBUG] [LOCAL ] BGT: Derivative data saved (1820 records). [2025-09-19T22:16:55.644431] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-19T22:16:55.647387] [INFO ] [MAIN ] Derivative Progress: 228/2093 symbols completed. BGT took 1.1s. Estimated remaining: 12m 11s. Rate: 153.0 symbols/min [2025-09-19T22:16:55.647873] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:55.664149] [DEBUG] [LOCAL ] BH: Loaded 15496 existing records from primary storage. [2025-09-19T22:16:55.664280] [INFO ] [MAIN ] BH: Loaded 15496 primary data records. [2025-09-19T22:16:55.840285] [DEBUG] [LOCAL ] BHE: Loaded 25840 existing records from primary storage. [2025-09-19T22:16:55.856684] [INFO ] [MAIN ] BHE: Loaded 25840 primary data records. [2025-09-19T22:16:55.953554] [DEBUG] [LOCAL ] BHC: Loaded 47463 existing records from primary storage. [2025-09-19T22:16:55.979905] [INFO ] [MAIN ] BHC: Loaded 47463 primary data records. [2025-09-19T22:16:56.685545] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:56.687019] [INFO ] [MAIN ] BH: Generated 1820 derivative records from 15496 primary records. [2025-09-19T22:16:56.689721] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-19T22:16:56.720964] [DEBUG] [LOCAL ] BH: Derivative data saved (1820 records). [2025-09-19T22:16:56.721120] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-19T22:16:56.723353] [INFO ] [MAIN ] Derivative Progress: 229/2093 symbols completed. BH took 1.1s. Estimated remaining: 12m 16s. Rate: 151.9 symbols/min [2025-09-19T22:16:56.719283] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:56.724780] [INFO ] [MAIN ] BHE: Generated 1820 derivative records from 25840 primary records. [2025-09-19T22:16:56.724921] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-19T22:16:56.723948] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:56.751022] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:16:56.753034] [INFO ] [MAIN ] BHC: Generated 1819 derivative records from 47463 primary records. [2025-09-19T22:16:56.755147] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-19T22:16:56.757090] [DEBUG] [LOCAL ] BHE: Derivative data saved (1820 records). [2025-09-19T22:16:56.757171] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-19T22:16:56.759602] [INFO ] [MAIN ] Derivative Progress: 230/2093 symbols completed. BHE took 1.1s. Estimated remaining: 12m 13s. Rate: 152.5 symbols/min [2025-09-19T22:16:56.760132] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:56.784345] [DEBUG] [LOCAL ] BHC: Derivative data saved (1819 records). [2025-09-19T22:16:56.784507] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-19T22:16:56.787541] [INFO ] [MAIN ] Derivative Progress: 231/2093 symbols completed. BHC took 1.1s. Estimated remaining: 12m 10s. Rate: 153.1 symbols/min [2025-09-19T22:16:56.787955] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:56.796784] [DEBUG] [LOCAL ] BHK: Loaded 22707 existing records from primary storage. [2025-09-19T22:16:56.797085] [INFO ] [MAIN ] BHK: Loaded 22707 primary data records. [2025-09-19T22:16:56.920110] [DEBUG] [LOCAL ] BHR: Loaded 21774 existing records from primary storage. [2025-09-19T22:16:56.930922] [INFO ] [MAIN ] BHR: Loaded 21774 primary data records. [2025-09-19T22:16:57.277403] [DEBUG] [LOCAL ] BHP: Loaded 54166 existing records from primary storage. [2025-09-19T22:16:57.283314] [INFO ] [MAIN ] BHP: Loaded 54166 primary data records. [2025-09-19T22:16:57.900873] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:57.902627] [INFO ] [MAIN ] BHK: Generated 1820 derivative records from 22707 primary records. [2025-09-19T22:16:57.902932] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-19T22:16:57.922161] [DEBUG] [LOCAL ] BHK: Derivative data saved (1820 records). [2025-09-19T22:16:57.922402] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-19T22:16:57.926114] [INFO ] [MAIN ] Derivative Progress: 232/2093 symbols completed. BHK took 1.2s. Estimated remaining: 12m 15s. Rate: 151.8 symbols/min [2025-09-19T22:16:57.929413] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:57.943484] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:57.944335] [INFO ] [MAIN ] BHR: Generated 1820 derivative records from 21774 primary records. [2025-09-19T22:16:57.944545] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-19T22:16:57.965246] [DEBUG] [LOCAL ] BHR: Derivative data saved (1820 records). [2025-09-19T22:16:57.965431] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-19T22:16:57.968006] [INFO ] [MAIN ] Derivative Progress: 233/2093 symbols completed. BHR took 1.2s. Estimated remaining: 12m 12s. Rate: 152.4 symbols/min [2025-09-19T22:16:57.968351] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:57.983308] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:57.984759] [INFO ] [MAIN ] BHP: Generated 1820 derivative records from 54166 primary records. [2025-09-19T22:16:57.985000] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-19T22:16:58.016109] [DEBUG] [LOCAL ] BHP: Derivative data saved (1820 records). [2025-09-19T22:16:58.016340] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-19T22:16:58.019132] [INFO ] [MAIN ] Derivative Progress: 234/2093 symbols completed. BHP took 1.3s. Estimated remaining: 12m 9s. Rate: 153.0 symbols/min [2025-09-19T22:16:58.019615] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:58.039355] [DEBUG] [LOCAL ] BIO: Loaded 26070 existing records from primary storage. [2025-09-19T22:16:58.039805] [INFO ] [MAIN ] BIO: Loaded 26070 primary data records. [2025-09-19T22:16:58.132269] [DEBUG] [LOCAL ] BHVN: Loaded 50308 existing records from primary storage. [2025-09-19T22:16:58.143528] [INFO ] [MAIN ] BHVN: Loaded 50308 primary data records. [2025-09-19T22:16:58.471846] [DEBUG] [LOCAL ] BIP: Loaded 40386 existing records from primary storage. [2025-09-19T22:16:58.485562] [INFO ] [MAIN ] BIP: Loaded 40386 primary data records. [2025-09-19T22:16:59.043820] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:59.046174] [INFO ] [MAIN ] BIO: Generated 1820 derivative records from 26070 primary records. [2025-09-19T22:16:59.047076] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-19T22:16:59.075220] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:59.076602] [INFO ] [MAIN ] BHVN: Generated 1820 derivative records from 50308 primary records. [2025-09-19T22:16:59.078247] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-19T22:16:59.080726] [DEBUG] [LOCAL ] BIO: Derivative data saved (1820 records). [2025-09-19T22:16:59.088092] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-19T22:16:59.091252] [INFO ] [MAIN ] Derivative Progress: 235/2093 symbols completed. BIO took 1.1s. Estimated remaining: 12m 14s. Rate: 151.9 symbols/min [2025-09-19T22:16:59.091801] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:59.100374] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1820 records). [2025-09-19T22:16:59.100494] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-19T22:16:59.104133] [INFO ] [MAIN ] Derivative Progress: 236/2093 symbols completed. BHVN took 1.2s. Estimated remaining: 12m 11s. Rate: 152.5 symbols/min [2025-09-19T22:16:59.104862] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:59.123238] [DEBUG] [LOCAL ] BIPH: Loaded 2654 existing records from primary storage. [2025-09-19T22:16:59.123635] [INFO ] [MAIN ] BIPH: Loaded 2654 primary data records. [2025-09-19T22:16:59.123538] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:16:59.135916] [INFO ] [MAIN ] BIP: Generated 1820 derivative records from 40386 primary records. [2025-09-19T22:16:59.146156] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-19T22:16:59.254225] [DEBUG] [LOCAL ] BIP: Derivative data saved (1820 records). [2025-09-19T22:16:59.254592] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-19T22:16:59.257874] [INFO ] [MAIN ] Derivative Progress: 237/2093 symbols completed. BIP took 1.2s. Estimated remaining: 12m 8s. Rate: 152.9 symbols/min [2025-09-19T22:16:59.275200] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:16:59.406562] [DEBUG] [LOCAL ] BIPC: Loaded 42343 existing records from primary storage. [2025-09-19T22:16:59.466021] [INFO ] [MAIN ] BIPC: Loaded 42343 primary data records. [2025-09-19T22:16:59.469128] [DEBUG] [LOCAL ] BIPI: Loaded 3466 existing records from primary storage. [2025-09-19T22:16:59.469529] [INFO ] [MAIN ] BIPI: Loaded 3466 primary data records. [2025-09-19T22:17:00.166931] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:17:00.168383] [INFO ] [MAIN ] BIPH: Generated 1819 derivative records from 2654 primary records. [2025-09-19T22:17:00.168699] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-19T22:17:00.184815] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1819 records). [2025-09-19T22:17:00.185129] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-19T22:17:00.187322] [INFO ] [MAIN ] Derivative Progress: 238/2093 symbols completed. BIPH took 1.1s. Estimated remaining: 12m 12s. Rate: 152.0 symbols/min [2025-09-19T22:17:00.209258] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:00.210309] [INFO ] [MAIN ] BIPC: Generated 1820 derivative records from 42343 primary records. [2025-09-19T22:17:00.210512] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-19T22:17:00.231813] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:00.236635] [INFO ] [MAIN ] BIPI: Generated 1820 derivative records from 3466 primary records. [2025-09-19T22:17:00.237450] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-19T22:17:00.248010] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1820 records). [2025-09-19T22:17:00.249248] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-19T22:17:00.252113] [INFO ] [MAIN ] Derivative Progress: 239/2093 symbols completed. BIPC took 1.2s. Estimated remaining: 12m 9s. Rate: 152.6 symbols/min [2025-09-19T22:17:00.258329] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1820 records). [2025-09-19T22:17:00.258398] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-19T22:17:00.261091] [INFO ] [MAIN ] Derivative Progress: 240/2093 symbols completed. BIPI took 1.0s. Estimated remaining: 12m 6s. Rate: 153.2 symbols/min [2025-09-19T22:17:00.261730] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:00.261982] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:00.261845] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:00.268450] [DEBUG] [LOCAL ] BIPJ: Loaded 2913 existing records from primary storage. [2025-09-19T22:17:00.268816] [INFO ] [MAIN ] BIPJ: Loaded 2913 primary data records. [2025-09-19T22:17:00.387237] [DEBUG] [LOCAL ] BIT: Loaded 22461 existing records from primary storage. [2025-09-19T22:17:00.402924] [INFO ] [MAIN ] BIT: Loaded 22461 primary data records. [2025-09-19T22:17:00.731138] [DEBUG] [LOCAL ] BIRK: Loaded 51561 existing records from primary storage. [2025-09-19T22:17:00.747590] [INFO ] [MAIN ] BIRK: Loaded 51561 primary data records. [2025-09-19T22:17:01.265436] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-09-19T22:17:01.266667] [INFO ] [MAIN ] BIPJ: Generated 1817 derivative records from 2913 primary records. [2025-09-19T22:17:01.266778] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-19T22:17:01.284704] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1817 records). [2025-09-19T22:17:01.284843] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-19T22:17:01.287225] [INFO ] [MAIN ] Derivative Progress: 241/2093 symbols completed. BIPJ took 1.0s. Estimated remaining: 12m 10s. Rate: 152.2 symbols/min [2025-09-19T22:17:01.288143] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:01.311557] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:01.314893] [INFO ] [MAIN ] BIT: Generated 1820 derivative records from 22461 primary records. [2025-09-19T22:17:01.315097] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-19T22:17:01.339109] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:01.344009] [INFO ] [MAIN ] BIRK: Generated 1820 derivative records from 51561 primary records. [2025-09-19T22:17:01.347785] [DEBUG] [LOCAL ] BIT: Derivative data saved (1820 records). [2025-09-19T22:17:01.347957] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-19T22:17:01.348174] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-19T22:17:01.351431] [INFO ] [MAIN ] Derivative Progress: 242/2093 symbols completed. BIT took 1.1s. Estimated remaining: 12m 7s. Rate: 152.7 symbols/min [2025-09-19T22:17:01.352370] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:01.370118] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1820 records). [2025-09-19T22:17:01.370259] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-19T22:17:01.373367] [INFO ] [MAIN ] Derivative Progress: 243/2093 symbols completed. BIRK took 1.1s. Estimated remaining: 12m 4s. Rate: 153.3 symbols/min [2025-09-19T22:17:01.373921] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:01.412607] [DEBUG] [LOCAL ] BJ: Loaded 52202 existing records from primary storage. [2025-09-19T22:17:01.412935] [INFO ] [MAIN ] BJ: Loaded 52202 primary data records. [2025-09-19T22:17:01.616852] [DEBUG] [LOCAL ] BKD: Loaded 50838 existing records from primary storage. [2025-09-19T22:17:01.744703] [INFO ] [MAIN ] BKD: Loaded 50838 primary data records. [2025-09-19T22:17:01.820448] [DEBUG] [LOCAL ] BK: Loaded 54345 existing records from primary storage. [2025-09-19T22:17:01.862963] [INFO ] [MAIN ] BK: Loaded 54345 primary data records. [2025-09-19T22:17:02.445950] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:02.447420] [INFO ] [MAIN ] BJ: Generated 1820 derivative records from 52202 primary records. [2025-09-19T22:17:02.447760] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-19T22:17:02.469398] [DEBUG] [LOCAL ] BJ: Derivative data saved (1820 records). [2025-09-19T22:17:02.469694] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-19T22:17:02.472338] [INFO ] [MAIN ] Derivative Progress: 244/2093 symbols completed. BJ took 1.2s. Estimated remaining: 12m 9s. Rate: 152.2 symbols/min [2025-09-19T22:17:02.472672] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:02.491625] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:02.492840] [INFO ] [MAIN ] BKD: Generated 1820 derivative records from 50838 primary records. [2025-09-19T22:17:02.493295] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-19T22:17:02.526964] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:02.537601] [INFO ] [MAIN ] BK: Generated 1820 derivative records from 54345 primary records. [2025-09-19T22:17:02.536564] [DEBUG] [LOCAL ] BKD: Derivative data saved (1820 records). [2025-09-19T22:17:02.537805] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-19T22:17:02.538617] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-19T22:17:02.541224] [INFO ] [MAIN ] Derivative Progress: 245/2093 symbols completed. BKD took 1.2s. Estimated remaining: 12m 6s. Rate: 152.7 symbols/min [2025-09-19T22:17:02.549257] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:02.557844] [DEBUG] [LOCAL ] BK: Derivative data saved (1820 records). [2025-09-19T22:17:02.558331] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-19T22:17:02.561628] [INFO ] [MAIN ] Derivative Progress: 246/2093 symbols completed. BK took 1.2s. Estimated remaining: 12m 3s. Rate: 153.3 symbols/min [2025-09-19T22:17:02.572602] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:02.573740] [DEBUG] [LOCAL ] BKE: Loaded 35441 existing records from primary storage. [2025-09-19T22:17:02.573914] [INFO ] [MAIN ] BKE: Loaded 35441 primary data records. [2025-09-19T22:17:02.911765] [DEBUG] [LOCAL ] BKKT: Loaded 34629 existing records from primary storage. [2025-09-19T22:17:02.912360] [INFO ] [MAIN ] BKKT: Loaded 34629 primary data records. [2025-09-19T22:17:02.992880] [DEBUG] [LOCAL ] BKH: Loaded 37246 existing records from primary storage. [2025-09-19T22:17:03.006587] [INFO ] [MAIN ] BKH: Loaded 37246 primary data records. [2025-09-19T22:17:03.560842] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:03.561834] [INFO ] [MAIN ] BKE: Generated 1820 derivative records from 35441 primary records. [2025-09-19T22:17:03.562022] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-19T22:17:03.582421] [DEBUG] [LOCAL ] BKE: Derivative data saved (1820 records). [2025-09-19T22:17:03.582574] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-19T22:17:03.585091] [INFO ] [MAIN ] Derivative Progress: 247/2093 symbols completed. BKE took 1.1s. Estimated remaining: 12m 7s. Rate: 152.3 symbols/min [2025-09-19T22:17:03.585492] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:03.604942] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:03.605797] [INFO ] [MAIN ] BKKT: Generated 1820 derivative records from 34629 primary records. [2025-09-19T22:17:03.606122] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-19T22:17:03.627906] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1820 records). [2025-09-19T22:17:03.628384] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-19T22:17:03.628214] [DEBUG] [LOCAL ] BKN: Loaded 7752 existing records from primary storage. [2025-09-19T22:17:03.633389] [INFO ] [MAIN ] Derivative Progress: 248/2093 symbols completed. BKKT took 1.1s. Estimated remaining: 12m 4s. Rate: 152.8 symbols/min [2025-09-19T22:17:03.634379] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:03.629363] [INFO ] [MAIN ] BKN: Loaded 7752 primary data records. [2025-09-19T22:17:03.713712] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:03.726825] [INFO ] [MAIN ] BKH: Generated 1820 derivative records from 37246 primary records. [2025-09-19T22:17:03.754251] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-19T22:17:03.866980] [DEBUG] [LOCAL ] BKH: Derivative data saved (1820 records). [2025-09-19T22:17:04.027540] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-19T22:17:04.031839] [INFO ] [MAIN ] Derivative Progress: 249/2093 symbols completed. BKH took 1.5s. Estimated remaining: 12m 4s. Rate: 152.8 symbols/min [2025-09-19T22:17:04.034151] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:04.051828] [DEBUG] [LOCAL ] BKSY: Loaded 49065 existing records from primary storage. [2025-09-19T22:17:04.052597] [INFO ] [MAIN ] BKSY: Loaded 49065 primary data records. [2025-09-19T22:17:04.399822] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:04.401248] [INFO ] [MAIN ] BKN: Generated 1820 derivative records from 7752 primary records. [2025-09-19T22:17:04.401513] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-19T22:17:04.430312] [DEBUG] [LOCAL ] BKU: Loaded 42752 existing records from primary storage. [2025-09-19T22:17:04.431392] [INFO ] [MAIN ] BKU: Loaded 42752 primary data records. [2025-09-19T22:17:04.472217] [DEBUG] [LOCAL ] BKN: Derivative data saved (1820 records). [2025-09-19T22:17:04.492492] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-19T22:17:04.521336] [INFO ] [MAIN ] Derivative Progress: 250/2093 symbols completed. BKN took 0.9s. Estimated remaining: 12m 4s. Rate: 152.6 symbols/min [2025-09-19T22:17:04.545452] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:04.788280] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:04.790345] [INFO ] [MAIN ] BKSY: Generated 1820 derivative records from 49065 primary records. [2025-09-19T22:17:04.790628] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-19T22:17:04.791540] [DEBUG] [LOCAL ] BKV: Loaded 30602 existing records from primary storage. [2025-09-19T22:17:04.792509] [INFO ] [MAIN ] BKV: Loaded 30602 primary data records. [2025-09-19T22:17:04.891514] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1820 records). [2025-09-19T22:17:04.897010] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-19T22:17:04.906191] [INFO ] [MAIN ] Derivative Progress: 251/2093 symbols completed. BKSY took 1.3s. Estimated remaining: 12m 4s. Rate: 152.7 symbols/min [2025-09-19T22:17:04.918534] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:05.141234] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:05.152255] [INFO ] [MAIN ] BKU: Generated 1820 derivative records from 42752 primary records. [2025-09-19T22:17:05.152779] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-19T22:17:05.171588] [DEBUG] [LOCAL ] BKU: Derivative data saved (1820 records). [2025-09-19T22:17:05.183125] [DEBUG] [LOCAL ] BLCO: Loaded 36678 existing records from primary storage. [2025-09-19T22:17:05.182096] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-19T22:17:05.185481] [INFO ] [MAIN ] Derivative Progress: 252/2093 symbols completed. BKU took 1.2s. Estimated remaining: 12m 3s. Rate: 152.8 symbols/min [2025-09-19T22:17:05.186117] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:05.186215] [INFO ] [MAIN ] BLCO: Loaded 36678 primary data records. [2025-09-19T22:17:05.346188] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:05.406759] [INFO ] [MAIN ] BKV: Generated 1820 derivative records from 30602 primary records. [2025-09-19T22:17:05.414209] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-19T22:17:05.415001] [DEBUG] [LOCAL ] BLD: Loaded 28606 existing records from primary storage. [2025-09-19T22:17:05.536490] [INFO ] [MAIN ] BLD: Loaded 28606 primary data records. [2025-09-19T22:17:05.608208] [DEBUG] [LOCAL ] BKV: Derivative data saved (1820 records). [2025-09-19T22:17:05.621528] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-19T22:17:05.638669] [INFO ] [MAIN ] Derivative Progress: 253/2093 symbols completed. BKV took 1.1s. Estimated remaining: 12m 3s. Rate: 152.7 symbols/min [2025-09-19T22:17:05.955834] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:05.956764] [INFO ] [MAIN ] BLCO: Generated 1820 derivative records from 36678 primary records. [2025-09-19T22:17:05.957855] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-19T22:17:05.975748] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1820 records). [2025-09-19T22:17:05.976231] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-19T22:17:05.978766] [INFO ] [MAIN ] Derivative Progress: 254/2093 symbols completed. BLCO took 1.1s. Estimated remaining: 12m 2s. Rate: 152.8 symbols/min [2025-09-19T22:17:05.999221] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:05.999891] [INFO ] [MAIN ] BLD: Generated 1820 derivative records from 28606 primary records. [2025-09-19T22:17:05.999952] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-19T22:17:06.015855] [DEBUG] [LOCAL ] BLD: Derivative data saved (1820 records). [2025-09-19T22:17:06.015918] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-19T22:17:06.018927] [INFO ] [MAIN ] Derivative Progress: 255/2093 symbols completed. BLD took 0.8s. Estimated remaining: 11m 59s. Rate: 153.4 symbols/min [2025-09-19T22:17:06.019754] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:06.020169] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:06.019827] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:06.038157] [DEBUG] [LOCAL ] BLE: Loaded 14973 existing records from primary storage. [2025-09-19T22:17:06.038282] [INFO ] [MAIN ] BLE: Loaded 14973 primary data records. [2025-09-19T22:17:06.281970] [DEBUG] [LOCAL ] BLK: Loaded 35876 existing records from primary storage. [2025-09-19T22:17:06.385898] [INFO ] [MAIN ] BLK: Loaded 35876 primary data records. [2025-09-19T22:17:06.400934] [DEBUG] [LOCAL ] BLDR: Loaded 52400 existing records from primary storage. [2025-09-19T22:17:06.422474] [INFO ] [MAIN ] BLDR: Loaded 52400 primary data records. [2025-09-19T22:17:07.066321] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:07.067569] [INFO ] [MAIN ] BLE: Generated 1820 derivative records from 14973 primary records. [2025-09-19T22:17:07.068305] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-19T22:17:07.088808] [DEBUG] [LOCAL ] BLE: Derivative data saved (1820 records). [2025-09-19T22:17:07.089270] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-19T22:17:07.091668] [INFO ] [MAIN ] Derivative Progress: 256/2093 symbols completed. BLE took 1.1s. Estimated remaining: 12m 4s. Rate: 152.3 symbols/min [2025-09-19T22:17:07.092403] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:07.110423] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:07.115221] [INFO ] [MAIN ] BLDR: Generated 1820 derivative records from 52400 primary records. [2025-09-19T22:17:07.118223] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-19T22:17:07.124537] [DEBUG] [LOCAL ] BLW: Loaded 13093 existing records from primary storage. [2025-09-19T22:17:07.132394] [INFO ] [MAIN ] BLW: Loaded 13093 primary data records. [2025-09-19T22:17:07.185449] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1820 records). [2025-09-19T22:17:07.190756] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-19T22:17:07.171860] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:07.220658] [INFO ] [MAIN ] Derivative Progress: 257/2093 symbols completed. BLDR took 1.2s. Estimated remaining: 12m 1s. Rate: 152.7 symbols/min [2025-09-19T22:17:07.248892] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:07.238245] [INFO ] [MAIN ] BLK: Generated 1820 derivative records from 35876 primary records. [2025-09-19T22:17:07.261363] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-19T22:17:07.497242] [DEBUG] [LOCAL ] BLX: Loaded 16264 existing records from primary storage. [2025-09-19T22:17:07.498358] [DEBUG] [LOCAL ] BLK: Derivative data saved (1820 records). [2025-09-19T22:17:07.499323] [INFO ] [MAIN ] BLX: Loaded 16264 primary data records. [2025-09-19T22:17:07.499522] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-19T22:17:07.507178] [INFO ] [MAIN ] Derivative Progress: 258/2093 symbols completed. BLK took 1.5s. Estimated remaining: 12m 0s. Rate: 152.9 symbols/min [2025-09-19T22:17:07.529808] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:07.884091] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:07.885447] [INFO ] [MAIN ] BLW: Generated 1820 derivative records from 13093 primary records. [2025-09-19T22:17:07.885812] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-19T22:17:07.912415] [DEBUG] [LOCAL ] BMA: Loaded 35145 existing records from primary storage. [2025-09-19T22:17:07.912998] [INFO ] [MAIN ] BMA: Loaded 35145 primary data records. [2025-09-19T22:17:07.958952] [DEBUG] [LOCAL ] BLW: Derivative data saved (1820 records). [2025-09-19T22:17:07.975808] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-19T22:17:07.983886] [INFO ] [MAIN ] Derivative Progress: 259/2093 symbols completed. BLW took 0.9s. Estimated remaining: 12m 0s. Rate: 152.8 symbols/min [2025-09-19T22:17:07.989466] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:08.104371] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:08.129594] [INFO ] [MAIN ] BLX: Generated 1820 derivative records from 16264 primary records. [2025-09-19T22:17:08.233735] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-19T22:17:08.252360] [DEBUG] [LOCAL ] BME: Loaded 11052 existing records from primary storage. [2025-09-19T22:17:08.254040] [INFO ] [MAIN ] BME: Loaded 11052 primary data records. [2025-09-19T22:17:08.336852] [DEBUG] [LOCAL ] BLX: Derivative data saved (1820 records). [2025-09-19T22:17:08.360915] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-19T22:17:08.377520] [INFO ] [MAIN ] Derivative Progress: 260/2093 symbols completed. BLX took 1.1s. Estimated remaining: 11m 60s. Rate: 152.8 symbols/min [2025-09-19T22:17:08.387691] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:08.610860] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:08.619854] [INFO ] [MAIN ] BMA: Generated 1820 derivative records from 35145 primary records. [2025-09-19T22:17:08.620348] [DEBUG] [LOCAL ] BMEZ: Loaded 26566 existing records from primary storage. [2025-09-19T22:17:08.620456] [INFO ] [MAIN ] BMEZ: Loaded 26566 primary data records. [2025-09-19T22:17:08.620598] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-19T22:17:08.741076] [DEBUG] [LOCAL ] BMA: Derivative data saved (1820 records). [2025-09-19T22:17:08.750461] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-19T22:17:08.768544] [INFO ] [MAIN ] Derivative Progress: 261/2093 symbols completed. BMA took 1.3s. Estimated remaining: 11m 60s. Rate: 152.8 symbols/min [2025-09-19T22:17:08.803749] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:08.982488] [DEBUG] [LOCAL ] BMN: Loaded 2604 existing records from primary storage. [2025-09-19T22:17:08.982961] [INFO ] [MAIN ] BMN: Loaded 2604 primary data records. [2025-09-19T22:17:09.004979] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:09.013976] [INFO ] [MAIN ] BME: Generated 1820 derivative records from 11052 primary records. [2025-09-19T22:17:09.024707] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-19T22:17:09.130840] [DEBUG] [LOCAL ] BME: Derivative data saved (1820 records). [2025-09-19T22:17:09.131793] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-19T22:17:09.138582] [INFO ] [MAIN ] Derivative Progress: 262/2093 symbols completed. BME took 1.1s. Estimated remaining: 11m 59s. Rate: 152.8 symbols/min [2025-09-19T22:17:09.150114] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:09.372128] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:09.373402] [INFO ] [MAIN ] BMEZ: Generated 1820 derivative records from 26566 primary records. [2025-09-19T22:17:09.373717] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-19T22:17:09.403792] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1820 records). [2025-09-19T22:17:09.403992] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-19T22:17:09.406677] [INFO ] [MAIN ] Derivative Progress: 263/2093 symbols completed. BMEZ took 1.0s. Estimated remaining: 11m 58s. Rate: 153.0 symbols/min [2025-09-19T22:17:09.407234] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:09.425467] [DEBUG] [LOCAL ] BMO: Loaded 42068 existing records from primary storage. [2025-09-19T22:17:09.438694] [INFO ] [MAIN ] BMO: Loaded 42068 primary data records. [2025-09-19T22:17:09.444560] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:09.462946] [INFO ] [MAIN ] BMN: Generated 1820 derivative records from 2604 primary records. [2025-09-19T22:17:09.510357] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-19T22:17:09.570883] [DEBUG] [LOCAL ] BMN: Derivative data saved (1820 records). [2025-09-19T22:17:09.571099] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-19T22:17:09.574064] [INFO ] [MAIN ] Derivative Progress: 264/2093 symbols completed. BMN took 0.8s. Estimated remaining: 11m 56s. Rate: 153.3 symbols/min [2025-09-19T22:17:09.585184] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:09.860782] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-09-19T22:17:09.861056] [INFO ] [MAIN ] BMY: Loaded 54537 primary data records. [2025-09-19T22:17:10.234382] [DEBUG] [LOCAL ] BN: Loaded 53777 existing records from primary storage. [2025-09-19T22:17:10.234934] [INFO ] [MAIN ] BN: Loaded 53777 primary data records. [2025-09-19T22:17:10.390933] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:10.421956] [INFO ] [MAIN ] BMO: Generated 1820 derivative records from 42068 primary records. [2025-09-19T22:17:10.451716] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-19T22:17:10.592421] [DEBUG] [LOCAL ] BMO: Derivative data saved (1820 records). [2025-09-19T22:17:10.593229] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-19T22:17:10.597111] [INFO ] [MAIN ] Derivative Progress: 265/2093 symbols completed. BMO took 1.4s. Estimated remaining: 11m 60s. Rate: 152.4 symbols/min [2025-09-19T22:17:10.599421] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:10.614327] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:10.616105] [INFO ] [MAIN ] BMY: Generated 1820 derivative records from 54537 primary records. [2025-09-19T22:17:10.616237] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-19T22:17:10.642186] [DEBUG] [LOCAL ] BMY: Derivative data saved (1820 records). [2025-09-19T22:17:10.642321] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-19T22:17:10.644669] [INFO ] [MAIN ] Derivative Progress: 266/2093 symbols completed. BMY took 1.2s. Estimated remaining: 11m 57s. Rate: 152.9 symbols/min [2025-09-19T22:17:10.645157] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:10.671148] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:10.673610] [INFO ] [MAIN ] BN: Generated 1820 derivative records from 53777 primary records. [2025-09-19T22:17:10.671836] [DEBUG] [LOCAL ] BNED: Loaded 30481 existing records from primary storage. [2025-09-19T22:17:10.673784] [INFO ] [MAIN ] BNED: Loaded 30481 primary data records. [2025-09-19T22:17:10.673904] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-19T22:17:10.720350] [DEBUG] [LOCAL ] BNH: Loaded 4881 existing records from primary storage. [2025-09-19T22:17:10.725701] [INFO ] [MAIN ] BNH: Loaded 4881 primary data records. [2025-09-19T22:17:10.838438] [DEBUG] [LOCAL ] BN: Derivative data saved (1820 records). [2025-09-19T22:17:10.866605] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-19T22:17:10.891488] [INFO ] [MAIN ] Derivative Progress: 267/2093 symbols completed. BN took 1.3s. Estimated remaining: 11m 56s. Rate: 153.1 symbols/min [2025-09-19T22:17:10.891904] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:11.186568] [DEBUG] [LOCAL ] BNJ: Loaded 2658 existing records from primary storage. [2025-09-19T22:17:11.186833] [INFO ] [MAIN ] BNJ: Loaded 2658 primary data records. [2025-09-19T22:17:11.674488] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:11.673985] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:11.676288] [INFO ] [MAIN ] BNH: Generated 1820 derivative records from 4881 primary records. [2025-09-19T22:17:11.675495] [INFO ] [MAIN ] BNED: Generated 1820 derivative records from 30481 primary records. [2025-09-19T22:17:11.676539] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-19T22:17:11.676406] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-19T22:17:11.712875] [DEBUG] [LOCAL ] BNED: Derivative data saved (1820 records). [2025-09-19T22:17:11.713059] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-19T22:17:11.715483] [INFO ] [MAIN ] Derivative Progress: 268/2093 symbols completed. BNED took 1.1s. Estimated remaining: 11m 58s. Rate: 152.5 symbols/min [2025-09-19T22:17:11.721918] [DEBUG] [LOCAL ] BNH: Derivative data saved (1820 records). [2025-09-19T22:17:11.722160] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-19T22:17:11.725219] [INFO ] [MAIN ] Derivative Progress: 269/2093 symbols completed. BNH took 1.1s. Estimated remaining: 11m 55s. Rate: 153.0 symbols/min [2025-09-19T22:17:11.740486] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:11.741181] [INFO ] [MAIN ] BNJ: Generated 1820 derivative records from 2658 primary records. [2025-09-19T22:17:11.741243] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-19T22:17:11.755086] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1820 records). [2025-09-19T22:17:11.755148] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-19T22:17:11.757953] [INFO ] [MAIN ] Derivative Progress: 270/2093 symbols completed. BNJ took 0.9s. Estimated remaining: 11m 52s. Rate: 153.5 symbols/min [2025-09-19T22:17:11.758549] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:11.758735] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:11.759114] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:11.766602] [DEBUG] [LOCAL ] BNT: Loaded 3487 existing records from primary storage. [2025-09-19T22:17:11.766856] [INFO ] [MAIN ] BNT: Loaded 3487 primary data records. [2025-09-19T22:17:12.138395] [DEBUG] [LOCAL ] BNL: Loaded 47607 existing records from primary storage. [2025-09-19T22:17:12.153857] [DEBUG] [LOCAL ] BNS: Loaded 52257 existing records from primary storage. [2025-09-19T22:17:12.154449] [INFO ] [MAIN ] BNS: Loaded 52257 primary data records. [2025-09-19T22:17:12.154574] [INFO ] [MAIN ] BNL: Loaded 47607 primary data records. [2025-09-19T22:17:12.787814] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:12.788973] [INFO ] [MAIN ] BNT: Generated 1820 derivative records from 3487 primary records. [2025-09-19T22:17:12.789186] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-19T22:17:12.812165] [DEBUG] [LOCAL ] BNT: Derivative data saved (1820 records). [2025-09-19T22:17:12.812436] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-19T22:17:12.816090] [INFO ] [MAIN ] Derivative Progress: 271/2093 symbols completed. BNT took 1.1s. Estimated remaining: 11m 56s. Rate: 152.6 symbols/min [2025-09-19T22:17:12.816879] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:12.831928] [DEBUG] [LOCAL ] BNY: Loaded 7500 existing records from primary storage. [2025-09-19T22:17:12.832343] [INFO ] [MAIN ] BNY: Loaded 7500 primary data records. [2025-09-19T22:17:12.917322] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:12.937145] [INFO ] [MAIN ] BNS: Generated 1820 derivative records from 52257 primary records. [2025-09-19T22:17:12.937236] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-19T22:17:12.964911] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:12.984039] [INFO ] [MAIN ] BNL: Generated 1820 derivative records from 47607 primary records. [2025-09-19T22:17:12.993282] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-19T22:17:13.013526] [DEBUG] [LOCAL ] BNS: Derivative data saved (1820 records). [2025-09-19T22:17:13.020242] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-19T22:17:13.022677] [INFO ] [MAIN ] Derivative Progress: 272/2093 symbols completed. BNS took 1.3s. Estimated remaining: 11m 55s. Rate: 152.9 symbols/min [2025-09-19T22:17:13.023403] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:13.245679] [DEBUG] [LOCAL ] BNL: Derivative data saved (1820 records). [2025-09-19T22:17:13.252694] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-19T22:17:13.252557] [DEBUG] [LOCAL ] BOC: Loaded 18648 existing records from primary storage. [2025-09-19T22:17:13.255678] [INFO ] [MAIN ] Derivative Progress: 273/2093 symbols completed. BNL took 1.5s. Estimated remaining: 11m 53s. Rate: 153.1 symbols/min [2025-09-19T22:17:13.256015] [INFO ] [MAIN ] BOC: Loaded 18648 primary data records. [2025-09-19T22:17:13.256670] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:13.446050] [DEBUG] [LOCAL ] BOE: Loaded 17919 existing records from primary storage. [2025-09-19T22:17:13.467047] [INFO ] [MAIN ] BOE: Loaded 17919 primary data records. [2025-09-19T22:17:13.759786] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:13.796595] [INFO ] [MAIN ] BNY: Generated 1820 derivative records from 7500 primary records. [2025-09-19T22:17:13.797601] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-19T22:17:13.988792] [DEBUG] [LOCAL ] BNY: Derivative data saved (1820 records). [2025-09-19T22:17:13.989807] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-19T22:17:13.992365] [INFO ] [MAIN ] Derivative Progress: 274/2093 symbols completed. BNY took 1.2s. Estimated remaining: 11m 55s. Rate: 152.6 symbols/min [2025-09-19T22:17:13.993058] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:14.013213] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:14.014107] [INFO ] [MAIN ] BOC: Generated 1820 derivative records from 18648 primary records. [2025-09-19T22:17:14.014388] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-19T22:17:14.040114] [DEBUG] [LOCAL ] BOC: Derivative data saved (1820 records). [2025-09-19T22:17:14.040560] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-19T22:17:14.043111] [INFO ] [MAIN ] Derivative Progress: 275/2093 symbols completed. BOC took 1.0s. Estimated remaining: 11m 53s. Rate: 153.1 symbols/min [2025-09-19T22:17:14.044638] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:14.060907] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:14.070578] [INFO ] [MAIN ] BOE: Generated 1820 derivative records from 17919 primary records. [2025-09-19T22:17:14.070854] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-19T22:17:14.072119] [DEBUG] [LOCAL ] BOH: Loaded 32007 existing records from primary storage. [2025-09-19T22:17:14.072497] [INFO ] [MAIN ] BOH: Loaded 32007 primary data records. [2025-09-19T22:17:14.278515] [DEBUG] [LOCAL ] BOE: Derivative data saved (1820 records). [2025-09-19T22:17:14.278723] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-19T22:17:14.305795] [INFO ] [MAIN ] Derivative Progress: 276/2093 symbols completed. BOE took 1.0s. Estimated remaining: 11m 51s. Rate: 153.3 symbols/min [2025-09-19T22:17:14.408862] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:14.409724] [DEBUG] [LOCAL ] BOND: Loaded 32694 existing records from primary storage. [2025-09-19T22:17:14.410390] [INFO ] [MAIN ] BOND: Loaded 32694 primary data records. [2025-09-19T22:17:14.754094] [DEBUG] [LOCAL ] BOOT: Loaded 41895 existing records from primary storage. [2025-09-19T22:17:14.759993] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:14.759686] [INFO ] [MAIN ] BOOT: Loaded 41895 primary data records. [2025-09-19T22:17:14.760863] [INFO ] [MAIN ] BOH: Generated 1820 derivative records from 32007 primary records. [2025-09-19T22:17:14.794926] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-19T22:17:14.886859] [DEBUG] [LOCAL ] BOH: Derivative data saved (1820 records). [2025-09-19T22:17:14.907987] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-19T22:17:14.910566] [INFO ] [MAIN ] Derivative Progress: 277/2093 symbols completed. BOH took 0.9s. Estimated remaining: 11m 52s. Rate: 153.0 symbols/min [2025-09-19T22:17:14.930091] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:15.110304] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:17:15.111128] [INFO ] [MAIN ] BOND: Generated 1819 derivative records from 32694 primary records. [2025-09-19T22:17:15.111351] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-19T22:17:15.130005] [DEBUG] [LOCAL ] BOND: Derivative data saved (1819 records). [2025-09-19T22:17:15.130732] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-19T22:17:15.133271] [INFO ] [MAIN ] Derivative Progress: 278/2093 symbols completed. BOND took 1.1s. Estimated remaining: 11m 51s. Rate: 153.2 symbols/min [2025-09-19T22:17:15.133585] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:15.171740] [DEBUG] [LOCAL ] BOX: Loaded 51127 existing records from primary storage. [2025-09-19T22:17:15.171966] [INFO ] [MAIN ] BOX: Loaded 51127 primary data records. [2025-09-19T22:17:15.222723] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:15.256604] [INFO ] [MAIN ] BOOT: Generated 1820 derivative records from 41895 primary records. [2025-09-19T22:17:15.289340] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-19T22:17:15.517507] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1820 records). [2025-09-19T22:17:15.517941] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-19T22:17:15.537973] [INFO ] [MAIN ] Derivative Progress: 279/2093 symbols completed. BOOT took 1.1s. Estimated remaining: 11m 51s. Rate: 153.2 symbols/min [2025-09-19T22:17:15.541157] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:15.542828] [DEBUG] [LOCAL ] BP: Loaded 54491 existing records from primary storage. [2025-09-19T22:17:15.543174] [INFO ] [MAIN ] BP: Loaded 54491 primary data records. [2025-09-19T22:17:15.920598] [DEBUG] [LOCAL ] BR: Loaded 35370 existing records from primary storage. [2025-09-19T22:17:15.921609] [INFO ] [MAIN ] BR: Loaded 35370 primary data records. [2025-09-19T22:17:16.197326] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:16.253929] [INFO ] [MAIN ] BOX: Generated 1820 derivative records from 51127 primary records. [2025-09-19T22:17:16.254283] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-19T22:17:16.290493] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:16.292339] [INFO ] [MAIN ] BP: Generated 1820 derivative records from 54491 primary records. [2025-09-19T22:17:16.292686] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-19T22:17:16.294156] [DEBUG] [LOCAL ] BOX: Derivative data saved (1820 records). [2025-09-19T22:17:16.294686] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-19T22:17:16.298887] [INFO ] [MAIN ] Derivative Progress: 280/2093 symbols completed. BOX took 1.4s. Estimated remaining: 11m 53s. Rate: 152.7 symbols/min [2025-09-19T22:17:16.300370] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:16.318145] [DEBUG] [LOCAL ] BP: Derivative data saved (1820 records). [2025-09-19T22:17:16.319187] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-19T22:17:16.321372] [INFO ] [MAIN ] Derivative Progress: 281/2093 symbols completed. BP took 1.2s. Estimated remaining: 11m 50s. Rate: 153.2 symbols/min [2025-09-19T22:17:16.323175] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:16.338119] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:16.338814] [INFO ] [MAIN ] BR: Generated 1820 derivative records from 35370 primary records. [2025-09-19T22:17:16.338919] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-19T22:17:16.360118] [DEBUG] [LOCAL ] BR: Derivative data saved (1820 records). [2025-09-19T22:17:16.360282] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-19T22:17:16.362841] [INFO ] [MAIN ] Derivative Progress: 282/2093 symbols completed. BR took 0.8s. Estimated remaining: 11m 47s. Rate: 153.7 symbols/min [2025-09-19T22:17:16.363244] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:16.385639] [DEBUG] [LOCAL ] BRC: Loaded 20122 existing records from primary storage. [2025-09-19T22:17:16.385857] [INFO ] [MAIN ] BRC: Loaded 20122 primary data records. [2025-09-19T22:17:16.544874] [DEBUG] [LOCAL ] BRBR: Loaded 51940 existing records from primary storage. [2025-09-19T22:17:16.602724] [INFO ] [MAIN ] BRBR: Loaded 51940 primary data records. [2025-09-19T22:17:16.764545] [DEBUG] [LOCAL ] BRCC: Loaded 41163 existing records from primary storage. [2025-09-19T22:17:16.810859] [INFO ] [MAIN ] BRCC: Loaded 41163 primary data records. [2025-09-19T22:17:17.409557] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:17.410778] [INFO ] [MAIN ] BRC: Generated 1820 derivative records from 20122 primary records. [2025-09-19T22:17:17.411004] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-19T22:17:17.448023] [DEBUG] [LOCAL ] BRC: Derivative data saved (1820 records). [2025-09-19T22:17:17.448370] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:17.449371] [INFO ] [MAIN ] BRBR: Generated 1820 derivative records from 51940 primary records. [2025-09-19T22:17:17.448568] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-19T22:17:17.452111] [INFO ] [MAIN ] Derivative Progress: 283/2093 symbols completed. BRC took 1.1s. Estimated remaining: 11m 51s. Rate: 152.7 symbols/min [2025-09-19T22:17:17.453386] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-19T22:17:17.481605] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:17.482918] [INFO ] [MAIN ] BRCC: Generated 1820 derivative records from 41163 primary records. [2025-09-19T22:17:17.483384] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-19T22:17:17.497160] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1820 records). [2025-09-19T22:17:17.497998] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-19T22:17:17.503035] [INFO ] [MAIN ] Derivative Progress: 284/2093 symbols completed. BRBR took 1.2s. Estimated remaining: 11m 49s. Rate: 153.2 symbols/min [2025-09-19T22:17:17.504097] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1820 records). [2025-09-19T22:17:17.504170] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-19T22:17:17.507202] [INFO ] [MAIN ] Derivative Progress: 285/2093 symbols completed. BRCC took 1.1s. Estimated remaining: 11m 46s. Rate: 153.7 symbols/min [2025-09-19T22:17:17.508017] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:17.507940] [INFO ] [MAIN ] BRFS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:17.508528] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:17.579937] [DEBUG] [LOCAL ] BRFS: Loaded 41644 existing records from primary storage. [2025-09-19T22:17:17.596170] [INFO ] [MAIN ] BRFS: Loaded 41644 primary data records. [2025-09-19T22:17:17.622875] [DEBUG] [LOCAL ] BROS: Loaded 54061 existing records from primary storage. [2025-09-19T22:17:17.643716] [INFO ] [MAIN ] BROS: Loaded 54061 primary data records. [2025-09-19T22:17:17.693525] [DEBUG] [LOCAL ] BRO: Loaded 52689 existing records from primary storage. [2025-09-19T22:17:17.714587] [INFO ] [MAIN ] BRO: Loaded 52689 primary data records. [2025-09-19T22:17:18.683249] [DEBUG] [MAIN ] BRFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:18.683881] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:18.685215] [INFO ] [MAIN ] BRFS: Generated 1820 derivative records from 41644 primary records. [2025-09-19T22:17:18.686288] [INFO ] [MAIN ] BROS: Generated 1820 derivative records from 54061 primary records. [2025-09-19T22:17:18.686426] [DEBUG] [LOCAL ] BRFS: Saving derivative data. [2025-09-19T22:17:18.687437] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-19T22:17:18.688459] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:18.699033] [INFO ] [MAIN ] BRO: Generated 1820 derivative records from 52689 primary records. [2025-09-19T22:17:18.699130] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-19T22:17:18.725697] [DEBUG] [LOCAL ] BRFS: Derivative data saved (1820 records). [2025-09-19T22:17:18.727746] [INFO ] [MAIN ] BRFS: Successfully saved derivative data. [2025-09-19T22:17:18.738308] [INFO ] [MAIN ] Derivative Progress: 286/2093 symbols completed. BRFS took 1.2s. Estimated remaining: 11m 51s. Rate: 152.6 symbols/min [2025-09-19T22:17:18.740398] [DEBUG] [LOCAL ] BRO: Derivative data saved (1820 records). [2025-09-19T22:17:18.742472] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-19T22:17:18.740925] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:18.742382] [DEBUG] [LOCAL ] BROS: Derivative data saved (1820 records). [2025-09-19T22:17:18.745435] [INFO ] [MAIN ] Derivative Progress: 287/2093 symbols completed. BRO took 1.2s. Estimated remaining: 11m 48s. Rate: 153.1 symbols/min [2025-09-19T22:17:18.745885] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-19T22:17:18.746088] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:18.748310] [INFO ] [MAIN ] Derivative Progress: 288/2093 symbols completed. BROS took 1.2s. Estimated remaining: 11m 45s. Rate: 153.6 symbols/min [2025-09-19T22:17:18.748662] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:18.757299] [DEBUG] [LOCAL ] BRT: Loaded 4924 existing records from primary storage. [2025-09-19T22:17:18.757447] [INFO ] [MAIN ] BRT: Loaded 4924 primary data records. [2025-09-19T22:17:18.941191] [DEBUG] [LOCAL ] BRW: Loaded 19506 existing records from primary storage. [2025-09-19T22:17:18.949182] [INFO ] [MAIN ] BRW: Loaded 19506 primary data records. [2025-09-19T22:17:19.170043] [DEBUG] [LOCAL ] BRSP: Loaded 37505 existing records from primary storage. [2025-09-19T22:17:19.183526] [INFO ] [MAIN ] BRSP: Loaded 37505 primary data records. [2025-09-19T22:17:19.765515] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:19.766592] [INFO ] [MAIN ] BRT: Generated 1820 derivative records from 4924 primary records. [2025-09-19T22:17:19.766987] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-19T22:17:19.784775] [DEBUG] [LOCAL ] BRT: Derivative data saved (1820 records). [2025-09-19T22:17:19.785063] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-19T22:17:19.787136] [INFO ] [MAIN ] Derivative Progress: 289/2093 symbols completed. BRT took 1.0s. Estimated remaining: 11m 49s. Rate: 152.7 symbols/min [2025-09-19T22:17:19.787569] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:19.809050] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:19.809857] [INFO ] [MAIN ] BRW: Generated 1820 derivative records from 19506 primary records. [2025-09-19T22:17:19.810186] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-19T22:17:19.831613] [DEBUG] [LOCAL ] BRW: Derivative data saved (1820 records). [2025-09-19T22:17:19.845163] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-19T22:17:19.847933] [INFO ] [MAIN ] Derivative Progress: 290/2093 symbols completed. BRW took 1.1s. Estimated remaining: 11m 46s. Rate: 153.2 symbols/min [2025-09-19T22:17:19.848721] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:19.848598] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:19.850107] [INFO ] [MAIN ] BRSP: Generated 1820 derivative records from 37505 primary records. [2025-09-19T22:17:19.850361] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-19T22:17:19.867393] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1820 records). [2025-09-19T22:17:19.867731] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-19T22:17:19.884474] [INFO ] [MAIN ] Derivative Progress: 291/2093 symbols completed. BRSP took 1.1s. Estimated remaining: 11m 44s. Rate: 153.7 symbols/min [2025-09-19T22:17:19.884939] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:19.914434] [DEBUG] [LOCAL ] BRX: Loaded 52569 existing records from primary storage. [2025-09-19T22:17:19.914738] [INFO ] [MAIN ] BRX: Loaded 52569 primary data records. [2025-09-19T22:17:20.047251] [DEBUG] [LOCAL ] BSAC: Loaded 33535 existing records from primary storage. [2025-09-19T22:17:20.068102] [INFO ] [MAIN ] BSAC: Loaded 33535 primary data records. [2025-09-19T22:17:20.198999] [DEBUG] [LOCAL ] BSBR: Loaded 35603 existing records from primary storage. [2025-09-19T22:17:20.372491] [INFO ] [MAIN ] BSBR: Loaded 35603 primary data records. [2025-09-19T22:17:20.969478] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:20.970748] [INFO ] [MAIN ] BRX: Generated 1820 derivative records from 52569 primary records. [2025-09-19T22:17:20.971298] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-19T22:17:20.990358] [DEBUG] [LOCAL ] BRX: Derivative data saved (1820 records). [2025-09-19T22:17:20.990636] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-19T22:17:20.992760] [INFO ] [MAIN ] Derivative Progress: 292/2093 symbols completed. BRX took 1.2s. Estimated remaining: 11m 48s. Rate: 152.7 symbols/min [2025-09-19T22:17:20.993477] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:21.014352] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:21.015265] [INFO ] [MAIN ] BSAC: Generated 1820 derivative records from 33535 primary records. [2025-09-19T22:17:21.015356] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-19T22:17:21.038267] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1820 records). [2025-09-19T22:17:21.036279] [DEBUG] [LOCAL ] BSL: Loaded 8186 existing records from primary storage. [2025-09-19T22:17:21.038393] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-19T22:17:21.040946] [INFO ] [MAIN ] Derivative Progress: 293/2093 symbols completed. BSAC took 1.2s. Estimated remaining: 11m 45s. Rate: 153.2 symbols/min [2025-09-19T22:17:21.041325] [INFO ] [MAIN ] BSL: Loaded 8186 primary data records. [2025-09-19T22:17:21.046874] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:21.111797] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:21.143639] [INFO ] [MAIN ] BSBR: Generated 1820 derivative records from 35603 primary records. [2025-09-19T22:17:21.149343] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-19T22:17:21.235397] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1820 records). [2025-09-19T22:17:21.244079] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-19T22:17:21.381949] [INFO ] [MAIN ] Derivative Progress: 294/2093 symbols completed. BSBR took 1.5s. Estimated remaining: 11m 44s. Rate: 153.2 symbols/min [2025-09-19T22:17:21.389292] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:21.416695] [DEBUG] [LOCAL ] BSM: Loaded 33095 existing records from primary storage. [2025-09-19T22:17:21.417092] [INFO ] [MAIN ] BSM: Loaded 33095 primary data records. [2025-09-19T22:17:21.544360] [DEBUG] [LOCAL ] BSTZ: Loaded 25410 existing records from primary storage. [2025-09-19T22:17:21.544876] [INFO ] [MAIN ] BSTZ: Loaded 25410 primary data records. [2025-09-19T22:17:21.896833] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:21.908187] [INFO ] [MAIN ] BSL: Generated 1820 derivative records from 8186 primary records. [2025-09-19T22:17:21.939542] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-19T22:17:22.143760] [DEBUG] [LOCAL ] BSL: Derivative data saved (1820 records). [2025-09-19T22:17:22.144634] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-19T22:17:22.146606] [INFO ] [MAIN ] Derivative Progress: 295/2093 symbols completed. BSL took 1.2s. Estimated remaining: 11m 46s. Rate: 152.7 symbols/min [2025-09-19T22:17:22.148098] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:22.171795] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:22.175482] [INFO ] [MAIN ] BSM: Generated 1820 derivative records from 33095 primary records. [2025-09-19T22:17:22.175714] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-19T22:17:22.192527] [DEBUG] [LOCAL ] BSM: Derivative data saved (1820 records). [2025-09-19T22:17:22.192730] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-19T22:17:22.195071] [INFO ] [MAIN ] Derivative Progress: 296/2093 symbols completed. BSM took 1.2s. Estimated remaining: 11m 44s. Rate: 153.2 symbols/min [2025-09-19T22:17:22.195490] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:22.218377] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:22.233408] [INFO ] [MAIN ] BSTZ: Generated 1820 derivative records from 25410 primary records. [2025-09-19T22:17:22.233542] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-19T22:17:22.237892] [DEBUG] [LOCAL ] BTA: Loaded 5358 existing records from primary storage. [2025-09-19T22:17:22.237962] [INFO ] [MAIN ] BTA: Loaded 5358 primary data records. [2025-09-19T22:17:22.318634] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1820 records). [2025-09-19T22:17:22.336001] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-19T22:17:22.344311] [INFO ] [MAIN ] Derivative Progress: 297/2093 symbols completed. BSTZ took 1.0s. Estimated remaining: 11m 42s. Rate: 153.5 symbols/min [2025-09-19T22:17:22.359739] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:22.377967] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-09-19T22:17:22.378186] [INFO ] [MAIN ] BSX: Loaded 54468 primary data records. [2025-09-19T22:17:22.557839] [DEBUG] [LOCAL ] BTCM: Loaded 14565 existing records from primary storage. [2025-09-19T22:17:22.678928] [INFO ] [MAIN ] BTCM: Loaded 14565 primary data records. [2025-09-19T22:17:23.242556] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:23.247415] [INFO ] [MAIN ] BTA: Generated 1820 derivative records from 5358 primary records. [2025-09-19T22:17:23.247866] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-19T22:17:23.268589] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:23.277003] [INFO ] [MAIN ] BSX: Generated 1820 derivative records from 54468 primary records. [2025-09-19T22:17:23.277717] [DEBUG] [LOCAL ] BTA: Derivative data saved (1820 records). [2025-09-19T22:17:23.277978] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-19T22:17:23.280113] [INFO ] [MAIN ] Derivative Progress: 298/2093 symbols completed. BTA took 1.1s. Estimated remaining: 11m 45s. Rate: 152.8 symbols/min [2025-09-19T22:17:23.280545] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-19T22:17:23.299817] [DEBUG] [LOCAL ] BSX: Derivative data saved (1820 records). [2025-09-19T22:17:23.300012] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-19T22:17:23.302535] [INFO ] [MAIN ] Derivative Progress: 299/2093 symbols completed. BSX took 1.2s. Estimated remaining: 11m 42s. Rate: 153.3 symbols/min [2025-09-19T22:17:23.315026] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:23.315906] [INFO ] [MAIN ] BTCM: Generated 1820 derivative records from 14565 primary records. [2025-09-19T22:17:23.315969] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-19T22:17:23.330535] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1820 records). [2025-09-19T22:17:23.330594] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-19T22:17:23.333272] [INFO ] [MAIN ] Derivative Progress: 300/2093 symbols completed. BTCM took 1.0s. Estimated remaining: 11m 40s. Rate: 153.7 symbols/min [2025-09-19T22:17:23.334235] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:23.334316] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:23.334083] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:23.346994] [DEBUG] [LOCAL ] BTO: Loaded 9175 existing records from primary storage. [2025-09-19T22:17:23.347131] [INFO ] [MAIN ] BTO: Loaded 9175 primary data records. [2025-09-19T22:17:23.737549] [DEBUG] [LOCAL ] BTE: Loaded 53527 existing records from primary storage. [2025-09-19T22:17:23.752691] [INFO ] [MAIN ] BTE: Loaded 53527 primary data records. [2025-09-19T22:17:23.777262] [DEBUG] [LOCAL ] BTI: Loaded 54332 existing records from primary storage. [2025-09-19T22:17:23.783165] [INFO ] [MAIN ] BTI: Loaded 54332 primary data records. [2025-09-19T22:17:24.490912] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:24.491579] [INFO ] [MAIN ] BTO: Generated 1820 derivative records from 9175 primary records. [2025-09-19T22:17:24.491673] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-19T22:17:24.510877] [DEBUG] [LOCAL ] BTO: Derivative data saved (1820 records). [2025-09-19T22:17:24.511133] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-19T22:17:24.513903] [INFO ] [MAIN ] Derivative Progress: 301/2093 symbols completed. BTO took 1.2s. Estimated remaining: 11m 44s. Rate: 152.7 symbols/min [2025-09-19T22:17:24.515112] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:24.551999] [DEBUG] [LOCAL ] BTT: Loaded 16323 existing records from primary storage. [2025-09-19T22:17:24.551594] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:24.552854] [INFO ] [MAIN ] BTE: Generated 1820 derivative records from 53527 primary records. [2025-09-19T22:17:24.553070] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-19T22:17:24.553141] [INFO ] [MAIN ] BTT: Loaded 16323 primary data records. [2025-09-19T22:17:24.604123] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:24.616281] [INFO ] [MAIN ] BTI: Generated 1820 derivative records from 54332 primary records. [2025-09-19T22:17:24.623666] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-19T22:17:24.709298] [DEBUG] [LOCAL ] BTE: Derivative data saved (1820 records). [2025-09-19T22:17:24.715032] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-19T22:17:24.718454] [INFO ] [MAIN ] Derivative Progress: 302/2093 symbols completed. BTE took 1.4s. Estimated remaining: 11m 43s. Rate: 153.0 symbols/min [2025-09-19T22:17:24.734995] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:24.790896] [DEBUG] [LOCAL ] BTI: Derivative data saved (1820 records). [2025-09-19T22:17:24.791077] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-19T22:17:24.794080] [INFO ] [MAIN ] Derivative Progress: 303/2093 symbols completed. BTI took 1.5s. Estimated remaining: 11m 40s. Rate: 153.4 symbols/min [2025-09-19T22:17:24.866947] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:24.940301] [DEBUG] [LOCAL ] BTZ: Loaded 23355 existing records from primary storage. [2025-09-19T22:17:24.941235] [INFO ] [MAIN ] BTZ: Loaded 23355 primary data records. [2025-09-19T22:17:25.036225] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:25.061054] [INFO ] [MAIN ] BTT: Generated 1820 derivative records from 16323 primary records. [2025-09-19T22:17:25.093318] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-19T22:17:25.120468] [DEBUG] [LOCAL ] BTU: Loaded 54082 existing records from primary storage. [2025-09-19T22:17:25.143709] [INFO ] [MAIN ] BTU: Loaded 54082 primary data records. [2025-09-19T22:17:25.434196] [DEBUG] [LOCAL ] BTT: Derivative data saved (1820 records). [2025-09-19T22:17:25.449871] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-19T22:17:25.457364] [INFO ] [MAIN ] Derivative Progress: 304/2093 symbols completed. BTT took 0.9s. Estimated remaining: 11m 42s. Rate: 153.0 symbols/min [2025-09-19T22:17:25.478627] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:25.654040] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:25.654976] [INFO ] [MAIN ] BTZ: Generated 1820 derivative records from 23355 primary records. [2025-09-19T22:17:25.655182] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-19T22:17:25.672556] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1820 records). [2025-09-19T22:17:25.689602] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-19T22:17:25.693020] [INFO ] [MAIN ] Derivative Progress: 305/2093 symbols completed. BTZ took 0.8s. Estimated remaining: 11m 40s. Rate: 153.2 symbols/min [2025-09-19T22:17:25.693429] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:25.707383] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:25.708115] [INFO ] [MAIN ] BTU: Generated 1820 derivative records from 54082 primary records. [2025-09-19T22:17:25.708184] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-19T22:17:25.743370] [DEBUG] [LOCAL ] BTU: Derivative data saved (1820 records). [2025-09-19T22:17:25.742680] [DEBUG] [LOCAL ] BUD: Loaded 53535 existing records from primary storage. [2025-09-19T22:17:25.743528] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-19T22:17:25.745686] [INFO ] [MAIN ] BUD: Loaded 53535 primary data records. [2025-09-19T22:17:25.745569] [INFO ] [MAIN ] Derivative Progress: 306/2093 symbols completed. BTU took 1.0s. Estimated remaining: 11m 38s. Rate: 153.6 symbols/min [2025-09-19T22:17:25.761769] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:25.750533] [DEBUG] [LOCAL ] BUI: Loaded 11660 existing records from primary storage. [2025-09-19T22:17:25.771728] [INFO ] [MAIN ] BUI: Loaded 11660 primary data records. [2025-09-19T22:17:26.429502] [DEBUG] [LOCAL ] BUR: Loaded 45780 existing records from primary storage. [2025-09-19T22:17:26.430223] [INFO ] [MAIN ] BUR: Loaded 45780 primary data records. [2025-09-19T22:17:26.779984] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:26.794482] [INFO ] [MAIN ] BUI: Generated 1820 derivative records from 11660 primary records. [2025-09-19T22:17:26.795384] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-19T22:17:26.796225] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:26.797951] [INFO ] [MAIN ] BUD: Generated 1820 derivative records from 53535 primary records. [2025-09-19T22:17:26.798300] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-19T22:17:26.823345] [DEBUG] [LOCAL ] BUI: Derivative data saved (1820 records). [2025-09-19T22:17:26.823591] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-19T22:17:26.828274] [INFO ] [MAIN ] Derivative Progress: 307/2093 symbols completed. BUI took 1.1s. Estimated remaining: 11m 41s. Rate: 152.8 symbols/min [2025-09-19T22:17:26.832711] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:26.834812] [DEBUG] [LOCAL ] BUD: Derivative data saved (1820 records). [2025-09-19T22:17:26.835048] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-19T22:17:26.837610] [INFO ] [MAIN ] Derivative Progress: 308/2093 symbols completed. BUD took 1.4s. Estimated remaining: 11m 39s. Rate: 153.3 symbols/min [2025-09-19T22:17:26.838133] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:26.860796] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:26.861543] [INFO ] [MAIN ] BUR: Generated 1820 derivative records from 45780 primary records. [2025-09-19T22:17:26.861693] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-19T22:17:26.884120] [DEBUG] [LOCAL ] BUR: Derivative data saved (1820 records). [2025-09-19T22:17:26.884264] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-19T22:17:26.886959] [INFO ] [MAIN ] Derivative Progress: 309/2093 symbols completed. BUR took 1.1s. Estimated remaining: 11m 36s. Rate: 153.7 symbols/min [2025-09-19T22:17:26.880917] [DEBUG] [LOCAL ] BUXX: Loaded 15425 existing records from primary storage. [2025-09-19T22:17:26.887385] [INFO ] [MAIN ] BUXX: Loaded 15425 primary data records. [2025-09-19T22:17:26.887669] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:27.103223] [DEBUG] [LOCAL ] BURL: Loaded 47179 existing records from primary storage. [2025-09-19T22:17:27.220682] [INFO ] [MAIN ] BURL: Loaded 47179 primary data records. [2025-09-19T22:17:27.329178] [DEBUG] [LOCAL ] BV: Loaded 39305 existing records from primary storage. [2025-09-19T22:17:27.337176] [INFO ] [MAIN ] BV: Loaded 39305 primary data records. [2025-09-19T22:17:27.876392] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:17:27.877472] [INFO ] [MAIN ] BUXX: Generated 1819 derivative records from 15425 primary records. [2025-09-19T22:17:27.877566] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-19T22:17:27.899155] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1819 records). [2025-09-19T22:17:27.899406] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-19T22:17:27.901519] [INFO ] [MAIN ] Derivative Progress: 310/2093 symbols completed. BUXX took 1.1s. Estimated remaining: 11m 40s. Rate: 152.9 symbols/min [2025-09-19T22:17:27.901800] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:27.922960] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:27.923831] [INFO ] [MAIN ] BURL: Generated 1820 derivative records from 47179 primary records. [2025-09-19T22:17:27.923914] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-19T22:17:27.950978] [DEBUG] [LOCAL ] BURL: Derivative data saved (1820 records). [2025-09-19T22:17:27.956458] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-19T22:17:27.956308] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:27.959162] [INFO ] [MAIN ] Derivative Progress: 311/2093 symbols completed. BURL took 1.1s. Estimated remaining: 11m 37s. Rate: 153.3 symbols/min [2025-09-19T22:17:27.960030] [INFO ] [MAIN ] BV: Generated 1820 derivative records from 39305 primary records. [2025-09-19T22:17:27.960320] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:27.960600] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-19T22:17:28.000766] [DEBUG] [LOCAL ] BV: Derivative data saved (1820 records). [2025-09-19T22:17:28.000927] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-19T22:17:28.003485] [INFO ] [MAIN ] Derivative Progress: 312/2093 symbols completed. BV took 1.1s. Estimated remaining: 11m 35s. Rate: 153.8 symbols/min [2025-09-19T22:17:28.004856] [DEBUG] [LOCAL ] BVN: Loaded 44243 existing records from primary storage. [2025-09-19T22:17:28.005289] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:28.005391] [INFO ] [MAIN ] BVN: Loaded 44243 primary data records. [2025-09-19T22:17:28.350296] [DEBUG] [LOCAL ] BW: Loaded 40158 existing records from primary storage. [2025-09-19T22:17:28.351055] [INFO ] [MAIN ] BW: Loaded 40158 primary data records. [2025-09-19T22:17:28.523901] [DEBUG] [LOCAL ] BWA: Loaded 53029 existing records from primary storage. [2025-09-19T22:17:28.561723] [INFO ] [MAIN ] BWA: Loaded 53029 primary data records. [2025-09-19T22:17:28.921282] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:29.030522] [INFO ] [MAIN ] BVN: Generated 1820 derivative records from 44243 primary records. [2025-09-19T22:17:29.046269] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-19T22:17:29.066493] [DEBUG] [LOCAL ] BVN: Derivative data saved (1820 records). [2025-09-19T22:17:29.066717] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-19T22:17:29.070855] [INFO ] [MAIN ] Derivative Progress: 313/2093 symbols completed. BVN took 1.2s. Estimated remaining: 11m 38s. Rate: 152.9 symbols/min [2025-09-19T22:17:29.091375] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:29.092244] [INFO ] [MAIN ] BW: Generated 1820 derivative records from 40158 primary records. [2025-09-19T22:17:29.092395] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-19T22:17:29.110843] [DEBUG] [LOCAL ] BW: Derivative data saved (1820 records). [2025-09-19T22:17:29.111292] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-19T22:17:29.113511] [INFO ] [MAIN ] Derivative Progress: 314/2093 symbols completed. BW took 1.2s. Estimated remaining: 11m 36s. Rate: 153.3 symbols/min [2025-09-19T22:17:29.137060] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:29.137789] [INFO ] [MAIN ] BWA: Generated 1820 derivative records from 53029 primary records. [2025-09-19T22:17:29.137852] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-19T22:17:29.153711] [DEBUG] [LOCAL ] BWA: Derivative data saved (1820 records). [2025-09-19T22:17:29.153773] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-19T22:17:29.156761] [INFO ] [MAIN ] Derivative Progress: 315/2093 symbols completed. BWA took 1.2s. Estimated remaining: 11m 34s. Rate: 153.8 symbols/min [2025-09-19T22:17:29.157517] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:29.157690] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:29.157849] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:29.175353] [DEBUG] [LOCAL ] BWMX: Loaded 7670 existing records from primary storage. [2025-09-19T22:17:29.175513] [INFO ] [MAIN ] BWMX: Loaded 7670 primary data records. [2025-09-19T22:17:29.280934] [DEBUG] [LOCAL ] BWG: Loaded 12521 existing records from primary storage. [2025-09-19T22:17:29.295840] [INFO ] [MAIN ] BWG: Loaded 12521 primary data records. [2025-09-19T22:17:29.465549] [DEBUG] [LOCAL ] BWLP: Loaded 33422 existing records from primary storage. [2025-09-19T22:17:29.499042] [INFO ] [MAIN ] BWLP: Loaded 33422 primary data records. [2025-09-19T22:17:30.204700] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:30.205703] [INFO ] [MAIN ] BWMX: Generated 1820 derivative records from 7670 primary records. [2025-09-19T22:17:30.205887] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-19T22:17:30.227127] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:30.228166] [INFO ] [MAIN ] BWG: Generated 1820 derivative records from 12521 primary records. [2025-09-19T22:17:30.234979] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-19T22:17:30.236630] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1820 records). [2025-09-19T22:17:30.237021] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-19T22:17:30.246780] [INFO ] [MAIN ] Derivative Progress: 316/2093 symbols completed. BWMX took 1.1s. Estimated remaining: 11m 37s. Rate: 152.9 symbols/min [2025-09-19T22:17:30.254089] [DEBUG] [LOCAL ] BWG: Derivative data saved (1820 records). [2025-09-19T22:17:30.254301] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-19T22:17:30.252989] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:30.257467] [INFO ] [MAIN ] Derivative Progress: 317/2093 symbols completed. BWG took 1.1s. Estimated remaining: 11m 35s. Rate: 153.4 symbols/min [2025-09-19T22:17:30.258302] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:30.267181] [DEBUG] [LOCAL ] BWSN: Loaded 5145 existing records from primary storage. [2025-09-19T22:17:30.267359] [INFO ] [MAIN ] BWSN: Loaded 5145 primary data records. [2025-09-19T22:17:30.323770] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:30.336417] [INFO ] [MAIN ] BWLP: Generated 1820 derivative records from 33422 primary records. [2025-09-19T22:17:30.336593] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-19T22:17:30.440853] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1820 records). [2025-09-19T22:17:30.458421] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-19T22:17:30.478436] [INFO ] [MAIN ] Derivative Progress: 318/2093 symbols completed. BWLP took 1.3s. Estimated remaining: 11m 33s. Rate: 153.6 symbols/min [2025-09-19T22:17:30.612869] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:30.635699] [DEBUG] [LOCAL ] BWXT: Loaded 47373 existing records from primary storage. [2025-09-19T22:17:30.636104] [INFO ] [MAIN ] BWXT: Loaded 47373 primary data records. [2025-09-19T22:17:30.859914] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:30.994864] [INFO ] [MAIN ] BWSN: Generated 1820 derivative records from 5145 primary records. [2025-09-19T22:17:30.995135] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-19T22:17:30.996324] [DEBUG] [LOCAL ] BX: Loaded 54281 existing records from primary storage. [2025-09-19T22:17:30.998220] [INFO ] [MAIN ] BX: Loaded 54281 primary data records. [2025-09-19T22:17:31.083091] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1820 records). [2025-09-19T22:17:31.107321] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-19T22:17:31.117560] [INFO ] [MAIN ] Derivative Progress: 319/2093 symbols completed. BWSN took 0.9s. Estimated remaining: 11m 34s. Rate: 153.3 symbols/min [2025-09-19T22:17:31.130412] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:31.339901] [DEBUG] [LOCAL ] BXC: Loaded 13833 existing records from primary storage. [2025-09-19T22:17:31.340618] [INFO ] [MAIN ] BXC: Loaded 13833 primary data records. [2025-09-19T22:17:31.549685] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:31.550779] [INFO ] [MAIN ] BWXT: Generated 1820 derivative records from 47373 primary records. [2025-09-19T22:17:31.657426] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-19T22:17:31.690229] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1820 records). [2025-09-19T22:17:31.691056] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-19T22:17:31.693533] [INFO ] [MAIN ] Derivative Progress: 320/2093 symbols completed. BWXT took 1.4s. Estimated remaining: 11m 35s. Rate: 153.1 symbols/min [2025-09-19T22:17:31.694122] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:31.714503] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:31.715333] [INFO ] [MAIN ] BX: Generated 1820 derivative records from 54281 primary records. [2025-09-19T22:17:31.715471] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-19T22:17:31.749074] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:31.749763] [DEBUG] [LOCAL ] BX: Derivative data saved (1820 records). [2025-09-19T22:17:31.761094] [INFO ] [MAIN ] BXC: Generated 1820 derivative records from 13833 primary records. [2025-09-19T22:17:31.761218] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-19T22:17:31.763561] [INFO ] [MAIN ] Derivative Progress: 321/2093 symbols completed. BX took 1.2s. Estimated remaining: 11m 33s. Rate: 153.5 symbols/min [2025-09-19T22:17:31.763803] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-19T22:17:31.765036] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:31.796342] [DEBUG] [LOCAL ] BXC: Derivative data saved (1820 records). [2025-09-19T22:17:31.796480] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-19T22:17:31.795206] [DEBUG] [LOCAL ] BXMT: Loaded 47995 existing records from primary storage. [2025-09-19T22:17:31.800080] [INFO ] [MAIN ] Derivative Progress: 322/2093 symbols completed. BXC took 0.7s. Estimated remaining: 11m 31s. Rate: 153.9 symbols/min [2025-09-19T22:17:31.805253] [INFO ] [MAIN ] BXMT: Loaded 47995 primary data records. [2025-09-19T22:17:31.805999] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:31.891843] [DEBUG] [LOCAL ] BXMX: Loaded 19972 existing records from primary storage. [2025-09-19T22:17:31.914510] [INFO ] [MAIN ] BXMX: Loaded 19972 primary data records. [2025-09-19T22:17:32.492541] [DEBUG] [LOCAL ] BXP: Loaded 50587 existing records from primary storage. [2025-09-19T22:17:32.506576] [INFO ] [MAIN ] BXP: Loaded 50587 primary data records. [2025-09-19T22:17:32.856631] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:32.858069] [INFO ] [MAIN ] BXMT: Generated 1820 derivative records from 47995 primary records. [2025-09-19T22:17:32.858172] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-19T22:17:32.889681] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:32.892288] [INFO ] [MAIN ] BXMX: Generated 1820 derivative records from 19972 primary records. [2025-09-19T22:17:32.893030] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-19T22:17:32.895461] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1820 records). [2025-09-19T22:17:32.895977] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-19T22:17:32.905793] [INFO ] [MAIN ] Derivative Progress: 323/2093 symbols completed. BXMT took 1.2s. Estimated remaining: 11m 34s. Rate: 153.0 symbols/min [2025-09-19T22:17:32.910308] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:32.915297] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1820 records). [2025-09-19T22:17:32.916406] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-19T22:17:32.919869] [INFO ] [MAIN ] Derivative Progress: 324/2093 symbols completed. BXMX took 1.2s. Estimated remaining: 11m 32s. Rate: 153.5 symbols/min [2025-09-19T22:17:32.920915] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:32.935476] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:32.936258] [INFO ] [MAIN ] BXP: Generated 1820 derivative records from 50587 primary records. [2025-09-19T22:17:32.936414] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-19T22:17:32.953036] [DEBUG] [LOCAL ] BXP: Derivative data saved (1820 records). [2025-09-19T22:17:32.953172] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-19T22:17:32.955478] [INFO ] [MAIN ] Derivative Progress: 325/2093 symbols completed. BXP took 1.1s. Estimated remaining: 11m 29s. Rate: 153.9 symbols/min [2025-09-19T22:17:32.956117] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:32.972183] [DEBUG] [LOCAL ] BY: Loaded 21803 existing records from primary storage. [2025-09-19T22:17:32.972402] [INFO ] [MAIN ] BY: Loaded 21803 primary data records. [2025-09-19T22:17:33.311256] [DEBUG] [LOCAL ] BXSL: Loaded 48143 existing records from primary storage. [2025-09-19T22:17:33.312035] [INFO ] [MAIN ] BXSL: Loaded 48143 primary data records. [2025-09-19T22:17:33.383354] [DEBUG] [LOCAL ] BYD: Loaded 46035 existing records from primary storage. [2025-09-19T22:17:33.391465] [INFO ] [MAIN ] BYD: Loaded 46035 primary data records. [2025-09-19T22:17:34.035417] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:34.036889] [INFO ] [MAIN ] BY: Generated 1820 derivative records from 21803 primary records. [2025-09-19T22:17:34.037133] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-19T22:17:34.058528] [DEBUG] [LOCAL ] BY: Derivative data saved (1820 records). [2025-09-19T22:17:34.059811] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-19T22:17:34.062946] [INFO ] [MAIN ] Derivative Progress: 326/2093 symbols completed. BY took 1.1s. Estimated remaining: 11m 33s. Rate: 153.0 symbols/min [2025-09-19T22:17:34.063272] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:34.080070] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:34.081096] [INFO ] [MAIN ] BXSL: Generated 1820 derivative records from 48143 primary records. [2025-09-19T22:17:34.081286] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-19T22:17:34.094749] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:34.095942] [INFO ] [MAIN ] BYD: Generated 1820 derivative records from 46035 primary records. [2025-09-19T22:17:34.096057] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-19T22:17:34.132516] [DEBUG] [LOCAL ] BYM: Loaded 12414 existing records from primary storage. [2025-09-19T22:17:34.132928] [INFO ] [MAIN ] BYM: Loaded 12414 primary data records. [2025-09-19T22:17:34.135068] [DEBUG] [LOCAL ] BYD: Derivative data saved (1820 records). [2025-09-19T22:17:34.147480] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1820 records). [2025-09-19T22:17:34.135707] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-19T22:17:34.147636] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-19T22:17:34.169671] [INFO ] [MAIN ] Derivative Progress: 327/2093 symbols completed. BXSL took 1.3s. Estimated remaining: 11m 31s. Rate: 153.4 symbols/min [2025-09-19T22:17:34.184974] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:34.197395] [INFO ] [MAIN ] Derivative Progress: 328/2093 symbols completed. BYD took 1.2s. Estimated remaining: 11m 28s. Rate: 153.8 symbols/min [2025-09-19T22:17:34.483433] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-09-19T22:17:34.495910] [INFO ] [MAIN ] C: Loaded 54521 primary data records. [2025-09-19T22:17:34.496208] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:34.497015] [INFO ] [MAIN ] BYM: Generated 1820 derivative records from 12414 primary records. [2025-09-19T22:17:34.529064] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-19T22:17:34.673239] [DEBUG] [LOCAL ] BYM: Derivative data saved (1820 records). [2025-09-19T22:17:34.688067] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-19T22:17:34.690037] [INFO ] [MAIN ] Derivative Progress: 329/2093 symbols completed. BYM took 0.6s. Estimated remaining: 11m 29s. Rate: 153.7 symbols/min [2025-09-19T22:17:34.829523] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:34.830189] [INFO ] [MAIN ] C: Generated 1820 derivative records from 54521 primary records. [2025-09-19T22:17:34.830258] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-19T22:17:34.845914] [DEBUG] [LOCAL ] C: Derivative data saved (1820 records). [2025-09-19T22:17:34.845978] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-19T22:17:34.848092] [INFO ] [MAIN ] Derivative Progress: 330/2093 symbols completed. C took 0.7s. Estimated remaining: 11m 27s. Rate: 154.0 symbols/min [2025-09-19T22:17:34.848730] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:34.849327] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:34.849466] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:34.883256] [DEBUG] [LOCAL ] CABO: Loaded 17935 existing records from primary storage. [2025-09-19T22:17:34.883735] [DEBUG] [LOCAL ] CAAP: Loaded 19495 existing records from primary storage. [2025-09-19T22:17:34.884028] [INFO ] [MAIN ] CABO: Loaded 17935 primary data records. [2025-09-19T22:17:34.884107] [INFO ] [MAIN ] CAAP: Loaded 19495 primary data records. [2025-09-19T22:17:35.106079] [DEBUG] [LOCAL ] CACI: Loaded 26262 existing records from primary storage. [2025-09-19T22:17:35.110209] [INFO ] [MAIN ] CACI: Loaded 26262 primary data records. [2025-09-19T22:17:35.856195] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:35.866476] [INFO ] [MAIN ] CABO: Generated 1820 derivative records from 17935 primary records. [2025-09-19T22:17:35.867264] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-19T22:17:35.872791] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:17:35.874542] [INFO ] [MAIN ] CACI: Generated 1819 derivative records from 26262 primary records. [2025-09-19T22:17:35.887378] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-19T22:17:35.897736] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:35.908613] [INFO ] [MAIN ] CAAP: Generated 1820 derivative records from 19495 primary records. [2025-09-19T22:17:35.910746] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-19T22:17:35.934197] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1820 records). [2025-09-19T22:17:35.934602] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-19T22:17:35.937398] [INFO ] [MAIN ] Derivative Progress: 331/2093 symbols completed. CAAP took 1.1s. Estimated remaining: 11m 30s. Rate: 153.1 symbols/min [2025-09-19T22:17:35.938972] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:35.940172] [DEBUG] [LOCAL ] CABO: Derivative data saved (1820 records). [2025-09-19T22:17:35.940747] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-19T22:17:35.942964] [INFO ] [MAIN ] Derivative Progress: 332/2093 symbols completed. CABO took 1.1s. Estimated remaining: 11m 28s. Rate: 153.6 symbols/min [2025-09-19T22:17:35.943382] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:35.945821] [DEBUG] [LOCAL ] CACI: Derivative data saved (1819 records). [2025-09-19T22:17:35.945902] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-19T22:17:35.948616] [INFO ] [MAIN ] Derivative Progress: 333/2093 symbols completed. CACI took 1.1s. Estimated remaining: 11m 25s. Rate: 154.1 symbols/min [2025-09-19T22:17:35.950272] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:35.954047] [DEBUG] [LOCAL ] CAF: Loaded 3481 existing records from primary storage. [2025-09-19T22:17:35.954543] [INFO ] [MAIN ] CAF: Loaded 3481 primary data records. [2025-09-19T22:17:36.313833] [DEBUG] [LOCAL ] CAE: Loaded 39492 existing records from primary storage. [2025-09-19T22:17:36.314247] [INFO ] [MAIN ] CAE: Loaded 39492 primary data records. [2025-09-19T22:17:36.438389] [DEBUG] [LOCAL ] CAG: Loaded 54438 existing records from primary storage. [2025-09-19T22:17:36.438677] [INFO ] [MAIN ] CAG: Loaded 54438 primary data records. [2025-09-19T22:17:36.983779] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:36.985390] [INFO ] [MAIN ] CAF: Generated 1820 derivative records from 3481 primary records. [2025-09-19T22:17:36.985764] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-19T22:17:37.002865] [DEBUG] [LOCAL ] CAF: Derivative data saved (1820 records). [2025-09-19T22:17:37.004312] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-19T22:17:37.006497] [INFO ] [MAIN ] Derivative Progress: 334/2093 symbols completed. CAF took 1.1s. Estimated remaining: 11m 29s. Rate: 153.3 symbols/min [2025-09-19T22:17:37.009204] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:37.025318] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:37.026343] [INFO ] [MAIN ] CAE: Generated 1820 derivative records from 39492 primary records. [2025-09-19T22:17:37.026570] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-19T22:17:37.050240] [DEBUG] [LOCAL ] CAE: Derivative data saved (1820 records). [2025-09-19T22:17:37.050489] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-19T22:17:37.052585] [INFO ] [MAIN ] Derivative Progress: 335/2093 symbols completed. CAE took 1.1s. Estimated remaining: 11m 26s. Rate: 153.7 symbols/min [2025-09-19T22:17:37.053064] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:37.066798] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:37.067593] [INFO ] [MAIN ] CAG: Generated 1820 derivative records from 54438 primary records. [2025-09-19T22:17:37.067810] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-19T22:17:37.086914] [DEBUG] [LOCAL ] CAG: Derivative data saved (1820 records). [2025-09-19T22:17:37.100493] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-19T22:17:37.103985] [INFO ] [MAIN ] Derivative Progress: 336/2093 symbols completed. CAG took 1.2s. Estimated remaining: 11m 24s. Rate: 154.1 symbols/min [2025-09-19T22:17:37.104463] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:37.130302] [DEBUG] [LOCAL ] CAH: Loaded 52263 existing records from primary storage. [2025-09-19T22:17:37.140782] [INFO ] [MAIN ] CAH: Loaded 52263 primary data records. [2025-09-19T22:17:37.271277] [DEBUG] [LOCAL ] CAL: Loaded 43947 existing records from primary storage. [2025-09-19T22:17:37.285310] [INFO ] [MAIN ] CAL: Loaded 43947 primary data records. [2025-09-19T22:17:37.297144] [DEBUG] [LOCAL ] CALX: Loaded 39339 existing records from primary storage. [2025-09-19T22:17:37.332579] [INFO ] [MAIN ] CALX: Loaded 39339 primary data records. [2025-09-19T22:17:38.161424] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:38.162440] [INFO ] [MAIN ] CAH: Generated 1820 derivative records from 52263 primary records. [2025-09-19T22:17:38.162559] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-19T22:17:38.199058] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:38.199939] [INFO ] [MAIN ] CAL: Generated 1820 derivative records from 43947 primary records. [2025-09-19T22:17:38.199148] [DEBUG] [LOCAL ] CAH: Derivative data saved (1820 records). [2025-09-19T22:17:38.200034] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-19T22:17:38.200162] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-19T22:17:38.214007] [INFO ] [MAIN ] Derivative Progress: 337/2093 symbols completed. CAH took 1.2s. Estimated remaining: 11m 28s. Rate: 153.2 symbols/min [2025-09-19T22:17:38.215503] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:38.216511] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:38.229111] [INFO ] [MAIN ] CALX: Generated 1820 derivative records from 39339 primary records. [2025-09-19T22:17:38.231045] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-19T22:17:38.234966] [DEBUG] [LOCAL ] CAL: Derivative data saved (1820 records). [2025-09-19T22:17:38.242964] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-19T22:17:38.245433] [INFO ] [MAIN ] Derivative Progress: 338/2093 symbols completed. CAL took 1.2s. Estimated remaining: 11m 25s. Rate: 153.6 symbols/min [2025-09-19T22:17:38.251089] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:38.253311] [DEBUG] [LOCAL ] CALX: Derivative data saved (1820 records). [2025-09-19T22:17:38.253462] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-19T22:17:38.256039] [INFO ] [MAIN ] Derivative Progress: 339/2093 symbols completed. CALX took 1.2s. Estimated remaining: 11m 23s. Rate: 154.1 symbols/min [2025-09-19T22:17:38.256475] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:38.278052] [DEBUG] [LOCAL ] CANG: Loaded 27140 existing records from primary storage. [2025-09-19T22:17:38.278195] [INFO ] [MAIN ] CANG: Loaded 27140 primary data records. [2025-09-19T22:17:38.648676] [DEBUG] [LOCAL ] CARS: Loaded 41029 existing records from primary storage. [2025-09-19T22:17:38.664302] [INFO ] [MAIN ] CARS: Loaded 41029 primary data records. [2025-09-19T22:17:38.678135] [DEBUG] [LOCAL ] CARR: Loaded 54375 existing records from primary storage. [2025-09-19T22:17:38.702100] [INFO ] [MAIN ] CARR: Loaded 54375 primary data records. [2025-09-19T22:17:39.357628] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:39.359607] [INFO ] [MAIN ] CANG: Generated 1820 derivative records from 27140 primary records. [2025-09-19T22:17:39.359996] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-19T22:17:39.378237] [DEBUG] [LOCAL ] CANG: Derivative data saved (1820 records). [2025-09-19T22:17:39.378424] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-19T22:17:39.380861] [INFO ] [MAIN ] Derivative Progress: 340/2093 symbols completed. CANG took 1.2s. Estimated remaining: 11m 26s. Rate: 153.2 symbols/min [2025-09-19T22:17:39.381978] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:39.413313] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:39.420112] [INFO ] [MAIN ] CARS: Generated 1820 derivative records from 41029 primary records. [2025-09-19T22:17:39.419288] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:39.420938] [INFO ] [MAIN ] CARR: Generated 1820 derivative records from 54375 primary records. [2025-09-19T22:17:39.420299] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-19T22:17:39.421145] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-19T22:17:39.451572] [DEBUG] [LOCAL ] CARR: Derivative data saved (1820 records). [2025-09-19T22:17:39.451928] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-19T22:17:39.453181] [DEBUG] [LOCAL ] CARS: Derivative data saved (1820 records). [2025-09-19T22:17:39.453417] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-19T22:17:39.455849] [INFO ] [MAIN ] Derivative Progress: 341/2093 symbols completed. CARR took 1.2s. Estimated remaining: 11m 24s. Rate: 153.6 symbols/min [2025-09-19T22:17:39.458169] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:39.458279] [INFO ] [MAIN ] Derivative Progress: 342/2093 symbols completed. CARS took 1.2s. Estimated remaining: 11m 22s. Rate: 154.0 symbols/min [2025-09-19T22:17:39.459071] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:39.467700] [DEBUG] [LOCAL ] CATO: Loaded 7531 existing records from primary storage. [2025-09-19T22:17:39.467807] [INFO ] [MAIN ] CATO: Loaded 7531 primary data records. [2025-09-19T22:17:39.698027] [DEBUG] [LOCAL ] CAT: Loaded 53709 existing records from primary storage. [2025-09-19T22:17:39.707700] [INFO ] [MAIN ] CAT: Loaded 53709 primary data records. [2025-09-19T22:17:39.948388] [DEBUG] [LOCAL ] CAVA: Loaded 54332 existing records from primary storage. [2025-09-19T22:17:39.954904] [INFO ] [MAIN ] CAVA: Loaded 54332 primary data records. [2025-09-19T22:17:40.508284] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:40.509145] [INFO ] [MAIN ] CATO: Generated 1820 derivative records from 7531 primary records. [2025-09-19T22:17:40.509407] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-19T22:17:40.528295] [DEBUG] [LOCAL ] CATO: Derivative data saved (1820 records). [2025-09-19T22:17:40.529091] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-19T22:17:40.531511] [INFO ] [MAIN ] Derivative Progress: 343/2093 symbols completed. CATO took 1.1s. Estimated remaining: 11m 25s. Rate: 153.3 symbols/min [2025-09-19T22:17:40.551846] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:40.552604] [INFO ] [MAIN ] CAT: Generated 1820 derivative records from 53709 primary records. [2025-09-19T22:17:40.552713] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-19T22:17:40.571367] [DEBUG] [LOCAL ] CAT: Derivative data saved (1820 records). [2025-09-19T22:17:40.583405] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-19T22:17:40.586333] [INFO ] [MAIN ] Derivative Progress: 344/2093 symbols completed. CAT took 1.2s. Estimated remaining: 11m 23s. Rate: 153.6 symbols/min [2025-09-19T22:17:40.586714] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:40.587516] [INFO ] [MAIN ] CAVA: Generated 1820 derivative records from 54332 primary records. [2025-09-19T22:17:40.587578] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-19T22:17:40.603667] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1820 records). [2025-09-19T22:17:40.603776] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-19T22:17:40.607600] [INFO ] [MAIN ] Derivative Progress: 345/2093 symbols completed. CAVA took 1.1s. Estimated remaining: 11m 21s. Rate: 154.1 symbols/min [2025-09-19T22:17:40.608442] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:40.608261] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:40.608636] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:40.623123] [DEBUG] [LOCAL ] CBAN: Loaded 11389 existing records from primary storage. [2025-09-19T22:17:40.623254] [INFO ] [MAIN ] CBAN: Loaded 11389 primary data records. [2025-09-19T22:17:40.719868] [DEBUG] [LOCAL ] CBL: Loaded 17100 existing records from primary storage. [2025-09-19T22:17:40.746330] [INFO ] [MAIN ] CBL: Loaded 17100 primary data records. [2025-09-19T22:17:41.084378] [DEBUG] [LOCAL ] CB: Loaded 50868 existing records from primary storage. [2025-09-19T22:17:41.101017] [INFO ] [MAIN ] CB: Loaded 50868 primary data records. [2025-09-19T22:17:41.614431] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:41.615865] [INFO ] [MAIN ] CBAN: Generated 1820 derivative records from 11389 primary records. [2025-09-19T22:17:41.616754] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-19T22:17:41.644689] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:41.648994] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1820 records). [2025-09-19T22:17:41.649927] [INFO ] [MAIN ] CBL: Generated 1820 derivative records from 17100 primary records. [2025-09-19T22:17:41.650085] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-19T22:17:41.650402] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-19T22:17:41.652850] [INFO ] [MAIN ] Derivative Progress: 346/2093 symbols completed. CBAN took 1.0s. Estimated remaining: 11m 24s. Rate: 153.3 symbols/min [2025-09-19T22:17:41.653523] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:41.672271] [DEBUG] [LOCAL ] CBL: Derivative data saved (1820 records). [2025-09-19T22:17:41.672542] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-19T22:17:41.674760] [INFO ] [MAIN ] Derivative Progress: 347/2093 symbols completed. CBL took 1.1s. Estimated remaining: 11m 21s. Rate: 153.7 symbols/min [2025-09-19T22:17:41.675180] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:41.688205] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:41.691380] [DEBUG] [LOCAL ] CBNA: Loaded 2982 existing records from primary storage. [2025-09-19T22:17:41.691467] [INFO ] [MAIN ] CBNA: Loaded 2982 primary data records. [2025-09-19T22:17:41.691123] [INFO ] [MAIN ] CB: Generated 1820 derivative records from 50868 primary records. [2025-09-19T22:17:41.691551] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-19T22:17:41.818794] [DEBUG] [LOCAL ] CB: Derivative data saved (1820 records). [2025-09-19T22:17:41.829279] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-19T22:17:41.842840] [INFO ] [MAIN ] Derivative Progress: 348/2093 symbols completed. CB took 1.2s. Estimated remaining: 11m 20s. Rate: 154.0 symbols/min [2025-09-19T22:17:41.922036] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:42.089778] [DEBUG] [LOCAL ] CBRE: Loaded 51439 existing records from primary storage. [2025-09-19T22:17:42.089994] [INFO ] [MAIN ] CBRE: Loaded 51439 primary data records. [2025-09-19T22:17:42.260365] [DEBUG] [LOCAL ] CBT: Loaded 31844 existing records from primary storage. [2025-09-19T22:17:42.273004] [INFO ] [MAIN ] CBT: Loaded 31844 primary data records. [2025-09-19T22:17:42.538518] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:17:42.582215] [INFO ] [MAIN ] CBNA: Generated 1819 derivative records from 2982 primary records. [2025-09-19T22:17:42.590582] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-19T22:17:42.745185] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1819 records). [2025-09-19T22:17:42.745556] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-19T22:17:42.747577] [INFO ] [MAIN ] Derivative Progress: 349/2093 symbols completed. CBNA took 1.1s. Estimated remaining: 11m 22s. Rate: 153.4 symbols/min [2025-09-19T22:17:42.748869] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:42.769798] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:42.770739] [INFO ] [MAIN ] CBRE: Generated 1820 derivative records from 51439 primary records. [2025-09-19T22:17:42.771004] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-19T22:17:42.793170] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1820 records). [2025-09-19T22:17:42.799841] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-19T22:17:42.802505] [INFO ] [MAIN ] Derivative Progress: 350/2093 symbols completed. CBRE took 1.1s. Estimated remaining: 11m 20s. Rate: 153.8 symbols/min [2025-09-19T22:17:42.804203] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:42.805446] [DEBUG] [LOCAL ] CBU: Loaded 23402 existing records from primary storage. [2025-09-19T22:17:42.805634] [INFO ] [MAIN ] CBU: Loaded 23402 primary data records. [2025-09-19T22:17:42.935416] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:42.977698] [INFO ] [MAIN ] CBT: Generated 1820 derivative records from 31844 primary records. [2025-09-19T22:17:42.999767] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-19T22:17:43.030627] [DEBUG] [LOCAL ] CBZ: Loaded 33900 existing records from primary storage. [2025-09-19T22:17:43.161330] [INFO ] [MAIN ] CBZ: Loaded 33900 primary data records. [2025-09-19T22:17:43.276316] [DEBUG] [LOCAL ] CBT: Derivative data saved (1820 records). [2025-09-19T22:17:43.292380] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-19T22:17:43.295398] [INFO ] [MAIN ] Derivative Progress: 351/2093 symbols completed. CBT took 1.4s. Estimated remaining: 11m 20s. Rate: 153.7 symbols/min [2025-09-19T22:17:43.464819] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:43.496917] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:43.498024] [INFO ] [MAIN ] CBU: Generated 1820 derivative records from 23402 primary records. [2025-09-19T22:17:43.498129] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-19T22:17:43.520231] [DEBUG] [LOCAL ] CBU: Derivative data saved (1820 records). [2025-09-19T22:17:43.520531] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-19T22:17:43.522747] [INFO ] [MAIN ] Derivative Progress: 352/2093 symbols completed. CBU took 0.8s. Estimated remaining: 11m 19s. Rate: 153.9 symbols/min [2025-09-19T22:17:43.523260] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:43.554827] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:43.555566] [INFO ] [MAIN ] CBZ: Generated 1820 derivative records from 33900 primary records. [2025-09-19T22:17:43.555710] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-19T22:17:43.572427] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1820 records). [2025-09-19T22:17:43.573392] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-19T22:17:43.591020] [INFO ] [MAIN ] Derivative Progress: 353/2093 symbols completed. CBZ took 0.8s. Estimated remaining: 11m 17s. Rate: 154.2 symbols/min [2025-09-19T22:17:43.592571] [DEBUG] [LOCAL ] CC: Loaded 53812 existing records from primary storage. [2025-09-19T22:17:43.592807] [INFO ] [MAIN ] CC: Loaded 53812 primary data records. [2025-09-19T22:17:43.592752] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:43.769761] [DEBUG] [LOCAL ] CCIF: Loaded 15474 existing records from primary storage. [2025-09-19T22:17:43.775975] [INFO ] [MAIN ] CCIF: Loaded 15474 primary data records. [2025-09-19T22:17:43.815704] [DEBUG] [LOCAL ] CCI: Loaded 53934 existing records from primary storage. [2025-09-19T22:17:43.821109] [INFO ] [MAIN ] CCI: Loaded 53934 primary data records. [2025-09-19T22:17:44.632126] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:44.633101] [INFO ] [MAIN ] CC: Generated 1820 derivative records from 53812 primary records. [2025-09-19T22:17:44.633201] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-19T22:17:44.651975] [DEBUG] [LOCAL ] CC: Derivative data saved (1820 records). [2025-09-19T22:17:44.652244] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-19T22:17:44.654704] [INFO ] [MAIN ] Derivative Progress: 354/2093 symbols completed. CC took 1.2s. Estimated remaining: 11m 20s. Rate: 153.5 symbols/min [2025-09-19T22:17:44.654957] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:44.670747] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:44.671760] [INFO ] [MAIN ] CCIF: Generated 1820 derivative records from 15474 primary records. [2025-09-19T22:17:44.671997] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-19T22:17:44.689400] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:44.690971] [INFO ] [MAIN ] CCI: Generated 1820 derivative records from 53934 primary records. [2025-09-19T22:17:44.691068] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-19T22:17:44.722923] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1820 records). [2025-09-19T22:17:44.723111] [DEBUG] [LOCAL ] CCI: Derivative data saved (1820 records). [2025-09-19T22:17:44.723290] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-19T22:17:44.723382] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-19T22:17:44.726039] [INFO ] [MAIN ] Derivative Progress: 355/2093 symbols completed. CCIF took 1.1s. Estimated remaining: 11m 18s. Rate: 153.8 symbols/min [2025-09-19T22:17:44.726312] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:44.730043] [INFO ] [MAIN ] Derivative Progress: 356/2093 symbols completed. CCI took 1.2s. Estimated remaining: 11m 16s. Rate: 154.2 symbols/min [2025-09-19T22:17:44.730827] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:44.771351] [DEBUG] [LOCAL ] CCJ: Loaded 54455 existing records from primary storage. [2025-09-19T22:17:44.771555] [INFO ] [MAIN ] CCJ: Loaded 54455 primary data records. [2025-09-19T22:17:45.100213] [DEBUG] [LOCAL ] CCK: Loaded 47277 existing records from primary storage. [2025-09-19T22:17:45.109207] [INFO ] [MAIN ] CCK: Loaded 47277 primary data records. [2025-09-19T22:17:45.182593] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-09-19T22:17:45.197189] [INFO ] [MAIN ] CCL: Loaded 54580 primary data records. [2025-09-19T22:17:45.780668] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:45.781910] [INFO ] [MAIN ] CCJ: Generated 1820 derivative records from 54455 primary records. [2025-09-19T22:17:45.782080] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-19T22:17:45.806331] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1820 records). [2025-09-19T22:17:45.806823] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-19T22:17:45.809216] [INFO ] [MAIN ] Derivative Progress: 357/2093 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 19s. Rate: 153.5 symbols/min [2025-09-19T22:17:45.809960] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:45.824690] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:45.825559] [INFO ] [MAIN ] CCK: Generated 1820 derivative records from 47277 primary records. [2025-09-19T22:17:45.825716] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-19T22:17:45.847096] [DEBUG] [LOCAL ] CCK: Derivative data saved (1820 records). [2025-09-19T22:17:45.847278] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-19T22:17:45.849616] [INFO ] [MAIN ] Derivative Progress: 358/2093 symbols completed. CCK took 1.1s. Estimated remaining: 11m 17s. Rate: 153.9 symbols/min [2025-09-19T22:17:45.864588] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:45.865674] [INFO ] [MAIN ] CCL: Generated 1820 derivative records from 54580 primary records. [2025-09-19T22:17:45.865757] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-19T22:17:45.895311] [DEBUG] [LOCAL ] CCL: Derivative data saved (1820 records). [2025-09-19T22:17:45.895476] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-19T22:17:45.899719] [INFO ] [MAIN ] Derivative Progress: 359/2093 symbols completed. CCL took 1.2s. Estimated remaining: 11m 15s. Rate: 154.2 symbols/min [2025-09-19T22:17:45.915318] [DEBUG] [LOCAL ] CCO: Loaded 48252 existing records from primary storage. [2025-09-19T22:17:45.915492] [INFO ] [MAIN ] CCO: Loaded 48252 primary data records. [2025-09-19T22:17:46.255008] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:46.255624] [INFO ] [MAIN ] CCO: Generated 1820 derivative records from 48252 primary records. [2025-09-19T22:17:46.255710] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-19T22:17:46.271363] [DEBUG] [LOCAL ] CCO: Derivative data saved (1820 records). [2025-09-19T22:17:46.271429] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-19T22:17:46.273519] [INFO ] [MAIN ] Derivative Progress: 360/2093 symbols completed. CCO took 0.5s. Estimated remaining: 11m 14s. Rate: 154.3 symbols/min [2025-09-19T22:17:46.274189] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:46.274304] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:46.274084] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:46.292412] [DEBUG] [LOCAL ] CCRD: Loaded 9103 existing records from primary storage. [2025-09-19T22:17:46.292668] [INFO ] [MAIN ] CCRD: Loaded 9103 primary data records. [2025-09-19T22:17:46.423300] [DEBUG] [LOCAL ] CCU: Loaded 24340 existing records from primary storage. [2025-09-19T22:17:46.442891] [INFO ] [MAIN ] CCU: Loaded 24340 primary data records. [2025-09-19T22:17:46.453586] [DEBUG] [LOCAL ] CCS: Loaded 31164 existing records from primary storage. [2025-09-19T22:17:46.489072] [INFO ] [MAIN ] CCS: Loaded 31164 primary data records. [2025-09-19T22:17:47.283609] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:47.284978] [INFO ] [MAIN ] CCRD: Generated 1820 derivative records from 9103 primary records. [2025-09-19T22:17:47.285666] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-19T22:17:47.303468] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1820 records). [2025-09-19T22:17:47.303712] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-19T22:17:47.305771] [INFO ] [MAIN ] Derivative Progress: 361/2093 symbols completed. CCRD took 1.0s. Estimated remaining: 11m 17s. Rate: 153.6 symbols/min [2025-09-19T22:17:47.306036] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:47.333831] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:47.339095] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:47.339888] [INFO ] [MAIN ] CCS: Generated 1820 derivative records from 31164 primary records. [2025-09-19T22:17:47.340098] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-19T22:17:47.341870] [INFO ] [MAIN ] CCU: Generated 1820 derivative records from 24340 primary records. [2025-09-19T22:17:47.341967] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-19T22:17:47.366993] [DEBUG] [LOCAL ] CCS: Derivative data saved (1820 records). [2025-09-19T22:17:47.371749] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-19T22:17:47.374161] [DEBUG] [LOCAL ] CCU: Derivative data saved (1820 records). [2025-09-19T22:17:47.376681] [INFO ] [MAIN ] Derivative Progress: 362/2093 symbols completed. CCS took 1.1s. Estimated remaining: 11m 15s. Rate: 153.9 symbols/min [2025-09-19T22:17:47.377263] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-19T22:17:47.377207] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:47.380108] [INFO ] [MAIN ] Derivative Progress: 363/2093 symbols completed. CCU took 1.1s. Estimated remaining: 11m 13s. Rate: 154.3 symbols/min [2025-09-19T22:17:47.380665] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:47.406412] [DEBUG] [LOCAL ] CDLR: Loaded 10376 existing records from primary storage. [2025-09-19T22:17:47.406587] [INFO ] [MAIN ] CDLR: Loaded 10376 primary data records. [2025-09-19T22:17:47.534363] [DEBUG] [LOCAL ] CDE: Loaded 54421 existing records from primary storage. [2025-09-19T22:17:47.560119] [INFO ] [MAIN ] CDE: Loaded 54421 primary data records. [2025-09-19T22:17:47.862429] [DEBUG] [LOCAL ] CDP: Loaded 43402 existing records from primary storage. [2025-09-19T22:17:47.868881] [INFO ] [MAIN ] CDP: Loaded 43402 primary data records. [2025-09-19T22:17:48.432606] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:48.433756] [INFO ] [MAIN ] CDLR: Generated 1820 derivative records from 10376 primary records. [2025-09-19T22:17:48.433942] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-19T22:17:48.455030] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1820 records). [2025-09-19T22:17:48.467493] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-19T22:17:48.470690] [INFO ] [MAIN ] Derivative Progress: 364/2093 symbols completed. CDLR took 1.1s. Estimated remaining: 11m 16s. Rate: 153.6 symbols/min [2025-09-19T22:17:48.470978] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:48.468496] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:48.472123] [INFO ] [MAIN ] CDE: Generated 1820 derivative records from 54421 primary records. [2025-09-19T22:17:48.472394] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-19T22:17:48.491212] [DEBUG] [LOCAL ] CDE: Derivative data saved (1820 records). [2025-09-19T22:17:48.492302] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-19T22:17:48.495951] [INFO ] [MAIN ] Derivative Progress: 365/2093 symbols completed. CDE took 1.2s. Estimated remaining: 11m 13s. Rate: 154.0 symbols/min [2025-09-19T22:17:48.496326] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:48.509835] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:48.518165] [INFO ] [MAIN ] CDP: Generated 1820 derivative records from 43402 primary records. [2025-09-19T22:17:48.518446] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-19T22:17:48.541969] [DEBUG] [LOCAL ] CDRE: Loaded 25538 existing records from primary storage. [2025-09-19T22:17:48.543118] [INFO ] [MAIN ] CDRE: Loaded 25538 primary data records. [2025-09-19T22:17:48.566047] [DEBUG] [LOCAL ] CDP: Derivative data saved (1820 records). [2025-09-19T22:17:48.577100] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-19T22:17:48.580012] [INFO ] [MAIN ] Derivative Progress: 366/2093 symbols completed. CDP took 1.2s. Estimated remaining: 11m 12s. Rate: 154.3 symbols/min [2025-09-19T22:17:48.580322] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:48.729352] [DEBUG] [LOCAL ] CEE: Loaded 7099 existing records from primary storage. [2025-09-19T22:17:48.755791] [INFO ] [MAIN ] CEE: Loaded 7099 primary data records. [2025-09-19T22:17:49.007760] [DEBUG] [LOCAL ] CE: Loaded 52344 existing records from primary storage. [2025-09-19T22:17:49.029121] [INFO ] [MAIN ] CE: Loaded 52344 primary data records. [2025-09-19T22:17:49.543204] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:49.544575] [INFO ] [MAIN ] CDRE: Generated 1820 derivative records from 25538 primary records. [2025-09-19T22:17:49.544704] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-19T22:17:49.563717] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1820 records). [2025-09-19T22:17:49.565063] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-19T22:17:49.567374] [INFO ] [MAIN ] Derivative Progress: 367/2093 symbols completed. CDRE took 1.1s. Estimated remaining: 11m 14s. Rate: 153.6 symbols/min [2025-09-19T22:17:49.569281] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:49.588397] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:49.589774] [INFO ] [MAIN ] CEE: Generated 1820 derivative records from 7099 primary records. [2025-09-19T22:17:49.591850] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-19T22:17:49.629443] [DEBUG] [LOCAL ] CEE: Derivative data saved (1820 records). [2025-09-19T22:17:49.629684] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-19T22:17:49.621273] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:49.632009] [INFO ] [MAIN ] Derivative Progress: 368/2093 symbols completed. CEE took 1.1s. Estimated remaining: 11m 12s. Rate: 154.0 symbols/min [2025-09-19T22:17:49.632922] [INFO ] [MAIN ] CE: Generated 1820 derivative records from 52344 primary records. [2025-09-19T22:17:49.633294] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-19T22:17:49.634290] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:49.650576] [DEBUG] [LOCAL ] CE: Derivative data saved (1820 records). [2025-09-19T22:17:49.658445] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-19T22:17:49.661536] [INFO ] [MAIN ] Derivative Progress: 369/2093 symbols completed. CE took 1.2s. Estimated remaining: 11m 10s. Rate: 154.4 symbols/min [2025-09-19T22:17:49.662390] [DEBUG] [LOCAL ] CEPU: Loaded 26208 existing records from primary storage. [2025-09-19T22:17:49.662769] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:49.662860] [INFO ] [MAIN ] CEPU: Loaded 26208 primary data records. [2025-09-19T22:17:50.045179] [DEBUG] [LOCAL ] CF: Loaded 53014 existing records from primary storage. [2025-09-19T22:17:50.045917] [INFO ] [MAIN ] CF: Loaded 53014 primary data records. [2025-09-19T22:17:50.149556] [DEBUG] [LOCAL ] CFG: Loaded 54404 existing records from primary storage. [2025-09-19T22:17:50.168157] [INFO ] [MAIN ] CFG: Loaded 54404 primary data records. [2025-09-19T22:17:50.701397] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:50.702945] [INFO ] [MAIN ] CEPU: Generated 1820 derivative records from 26208 primary records. [2025-09-19T22:17:50.703571] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-19T22:17:50.723603] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1820 records). [2025-09-19T22:17:50.723989] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-19T22:17:50.726265] [INFO ] [MAIN ] Derivative Progress: 370/2093 symbols completed. CEPU took 1.2s. Estimated remaining: 11m 13s. Rate: 153.7 symbols/min [2025-09-19T22:17:50.727708] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:50.748137] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:50.748997] [INFO ] [MAIN ] CF: Generated 1820 derivative records from 53014 primary records. [2025-09-19T22:17:50.749107] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-19T22:17:50.772688] [DEBUG] [LOCAL ] CF: Derivative data saved (1820 records). [2025-09-19T22:17:50.782161] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-19T22:17:50.798683] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:50.798099] [INFO ] [MAIN ] Derivative Progress: 371/2093 symbols completed. CF took 1.2s. Estimated remaining: 11m 11s. Rate: 154.0 symbols/min [2025-09-19T22:17:50.799925] [INFO ] [MAIN ] CFG: Generated 1820 derivative records from 54404 primary records. [2025-09-19T22:17:50.800065] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-19T22:17:50.800013] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:50.818559] [DEBUG] [LOCAL ] CFG: Derivative data saved (1820 records). [2025-09-19T22:17:50.828084] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-19T22:17:50.833608] [INFO ] [MAIN ] Derivative Progress: 372/2093 symbols completed. CFG took 1.2s. Estimated remaining: 11m 9s. Rate: 154.4 symbols/min [2025-09-19T22:17:50.834131] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:50.835799] [DEBUG] [LOCAL ] CFR: Loaded 34170 existing records from primary storage. [2025-09-19T22:17:50.836355] [INFO ] [MAIN ] CFR: Loaded 34170 primary data records. [2025-09-19T22:17:51.062603] [DEBUG] [LOCAL ] CHCT: Loaded 24496 existing records from primary storage. [2025-09-19T22:17:51.120902] [INFO ] [MAIN ] CHCT: Loaded 24496 primary data records. [2025-09-19T22:17:51.292556] [DEBUG] [LOCAL ] CGAU: Loaded 43183 existing records from primary storage. [2025-09-19T22:17:51.314267] [INFO ] [MAIN ] CGAU: Loaded 43183 primary data records. [2025-09-19T22:17:52.142551] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:52.144835] [INFO ] [MAIN ] CFR: Generated 1820 derivative records from 34170 primary records. [2025-09-19T22:17:52.145209] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-19T22:17:52.166695] [DEBUG] [LOCAL ] CFR: Derivative data saved (1820 records). [2025-09-19T22:17:52.167055] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-19T22:17:52.169544] [INFO ] [MAIN ] Derivative Progress: 373/2093 symbols completed. CFR took 1.4s. Estimated remaining: 11m 13s. Rate: 153.4 symbols/min [2025-09-19T22:17:52.197608] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:52.198683] [INFO ] [MAIN ] CHCT: Generated 1820 derivative records from 24496 primary records. [2025-09-19T22:17:52.198912] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-19T22:17:52.221328] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:52.225994] [INFO ] [MAIN ] CGAU: Generated 1820 derivative records from 43183 primary records. [2025-09-19T22:17:52.228598] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-19T22:17:52.238781] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1820 records). [2025-09-19T22:17:52.238895] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-19T22:17:52.241283] [INFO ] [MAIN ] Derivative Progress: 374/2093 symbols completed. CHCT took 1.4s. Estimated remaining: 11m 11s. Rate: 153.7 symbols/min [2025-09-19T22:17:52.248855] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1820 records). [2025-09-19T22:17:52.248919] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-19T22:17:52.251793] [INFO ] [MAIN ] Derivative Progress: 375/2093 symbols completed. CGAU took 1.5s. Estimated remaining: 11m 9s. Rate: 154.1 symbols/min [2025-09-19T22:17:52.252455] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:52.252884] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:52.252515] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:52.277382] [DEBUG] [LOCAL ] CHE: Loaded 14825 existing records from primary storage. [2025-09-19T22:17:52.277629] [INFO ] [MAIN ] CHE: Loaded 14825 primary data records. [2025-09-19T22:17:52.663095] [DEBUG] [LOCAL ] CHD: Loaded 52750 existing records from primary storage. [2025-09-19T22:17:52.662423] [DEBUG] [LOCAL ] CHGG: Loaded 48526 existing records from primary storage. [2025-09-19T22:17:52.663301] [INFO ] [MAIN ] CHD: Loaded 52750 primary data records. [2025-09-19T22:17:52.672031] [INFO ] [MAIN ] CHGG: Loaded 48526 primary data records. [2025-09-19T22:17:53.303722] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:53.304854] [INFO ] [MAIN ] CHE: Generated 1820 derivative records from 14825 primary records. [2025-09-19T22:17:53.305025] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-19T22:17:53.322676] [DEBUG] [LOCAL ] CHE: Derivative data saved (1820 records). [2025-09-19T22:17:53.322961] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-19T22:17:53.325353] [INFO ] [MAIN ] Derivative Progress: 376/2093 symbols completed. CHE took 1.1s. Estimated remaining: 11m 12s. Rate: 153.4 symbols/min [2025-09-19T22:17:53.325739] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:53.343257] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:53.344010] [INFO ] [MAIN ] CHD: Generated 1820 derivative records from 52750 primary records. [2025-09-19T22:17:53.344216] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-19T22:17:53.362929] [DEBUG] [LOCAL ] CHD: Derivative data saved (1820 records). [2025-09-19T22:17:53.374705] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-19T22:17:53.377914] [INFO ] [MAIN ] Derivative Progress: 377/2093 symbols completed. CHD took 1.1s. Estimated remaining: 11m 10s. Rate: 153.7 symbols/min [2025-09-19T22:17:53.378900] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:53.379169] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:53.388636] [INFO ] [MAIN ] CHGG: Generated 1820 derivative records from 48526 primary records. [2025-09-19T22:17:53.388912] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-19T22:17:53.406051] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1820 records). [2025-09-19T22:17:53.414390] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-19T22:17:53.417902] [INFO ] [MAIN ] Derivative Progress: 378/2093 symbols completed. CHGG took 1.2s. Estimated remaining: 11m 8s. Rate: 154.1 symbols/min [2025-09-19T22:17:53.418367] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:53.419191] [DEBUG] [LOCAL ] CHH: Loaded 32806 existing records from primary storage. [2025-09-19T22:17:53.419594] [INFO ] [MAIN ] CHH: Loaded 32806 primary data records. [2025-09-19T22:17:53.515056] [DEBUG] [LOCAL ] CHN: Loaded 4871 existing records from primary storage. [2025-09-19T22:17:53.515218] [INFO ] [MAIN ] CHN: Loaded 4871 primary data records. [2025-09-19T22:17:53.616694] [DEBUG] [LOCAL ] CHMI: Loaded 22354 existing records from primary storage. [2025-09-19T22:17:53.634516] [INFO ] [MAIN ] CHMI: Loaded 22354 primary data records. [2025-09-19T22:17:54.449835] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:54.452156] [INFO ] [MAIN ] CHH: Generated 1820 derivative records from 32806 primary records. [2025-09-19T22:17:54.452469] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-19T22:17:54.479594] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:54.481687] [INFO ] [MAIN ] CHN: Generated 1820 derivative records from 4871 primary records. [2025-09-19T22:17:54.482634] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-19T22:17:54.509973] [DEBUG] [LOCAL ] CHH: Derivative data saved (1820 records). [2025-09-19T22:17:54.506889] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:54.514892] [INFO ] [MAIN ] CHMI: Generated 1820 derivative records from 22354 primary records. [2025-09-19T22:17:54.513483] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-19T22:17:54.514042] [DEBUG] [LOCAL ] CHN: Derivative data saved (1820 records). [2025-09-19T22:17:54.517167] [INFO ] [MAIN ] Derivative Progress: 379/2093 symbols completed. CHH took 1.2s. Estimated remaining: 11m 11s. Rate: 153.4 symbols/min [2025-09-19T22:17:54.515072] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-19T22:17:54.515154] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-19T22:17:54.519961] [INFO ] [MAIN ] Derivative Progress: 380/2093 symbols completed. CHN took 1.1s. Estimated remaining: 11m 8s. Rate: 153.8 symbols/min [2025-09-19T22:17:54.517551] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:54.521190] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:54.537419] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1820 records). [2025-09-19T22:17:54.537683] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-19T22:17:54.540513] [INFO ] [MAIN ] Derivative Progress: 381/2093 symbols completed. CHMI took 1.2s. Estimated remaining: 11m 6s. Rate: 154.2 symbols/min [2025-09-19T22:17:54.540853] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:54.559897] [DEBUG] [LOCAL ] CHT: Loaded 19987 existing records from primary storage. [2025-09-19T22:17:54.560108] [INFO ] [MAIN ] CHT: Loaded 19987 primary data records. [2025-09-19T22:17:54.901982] [DEBUG] [LOCAL ] CHPT: Loaded 50321 existing records from primary storage. [2025-09-19T22:17:54.902752] [INFO ] [MAIN ] CHPT: Loaded 50321 primary data records. [2025-09-19T22:17:55.029570] [DEBUG] [LOCAL ] CHWY: Loaded 54405 existing records from primary storage. [2025-09-19T22:17:55.029889] [INFO ] [MAIN ] CHWY: Loaded 54405 primary data records. [2025-09-19T22:17:55.554234] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:55.560570] [INFO ] [MAIN ] CHT: Generated 1820 derivative records from 19987 primary records. [2025-09-19T22:17:55.561072] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-19T22:17:55.598323] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:55.599066] [INFO ] [MAIN ] CHPT: Generated 1820 derivative records from 50321 primary records. [2025-09-19T22:17:55.598038] [DEBUG] [LOCAL ] CHT: Derivative data saved (1820 records). [2025-09-19T22:17:55.599213] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-19T22:17:55.602080] [INFO ] [MAIN ] Derivative Progress: 382/2093 symbols completed. CHT took 1.1s. Estimated remaining: 11m 9s. Rate: 153.5 symbols/min [2025-09-19T22:17:55.602349] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-19T22:17:55.603403] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:55.635602] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1820 records). [2025-09-19T22:17:55.636130] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:55.636273] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-19T22:17:55.640028] [INFO ] [MAIN ] CHWY: Generated 1820 derivative records from 54405 primary records. [2025-09-19T22:17:55.638974] [INFO ] [MAIN ] Derivative Progress: 383/2093 symbols completed. CHPT took 1.1s. Estimated remaining: 11m 7s. Rate: 153.8 symbols/min [2025-09-19T22:17:55.640153] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-19T22:17:55.641016] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:55.662921] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1820 records). [2025-09-19T22:17:55.663082] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-19T22:17:55.666704] [INFO ] [MAIN ] Derivative Progress: 384/2093 symbols completed. CHWY took 1.1s. Estimated remaining: 11m 5s. Rate: 154.2 symbols/min [2025-09-19T22:17:55.667060] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:55.679721] [DEBUG] [LOCAL ] CIA: Loaded 17081 existing records from primary storage. [2025-09-19T22:17:55.679853] [INFO ] [MAIN ] CIA: Loaded 17081 primary data records. [2025-09-19T22:17:56.028507] [DEBUG] [LOCAL ] CI: Loaded 50689 existing records from primary storage. [2025-09-19T22:17:56.029058] [DEBUG] [LOCAL ] CIB: Loaded 31593 existing records from primary storage. [2025-09-19T22:17:56.029269] [INFO ] [MAIN ] CIB: Loaded 31593 primary data records. [2025-09-19T22:17:56.029390] [INFO ] [MAIN ] CI: Loaded 50689 primary data records. [2025-09-19T22:17:56.701986] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:56.703738] [INFO ] [MAIN ] CIA: Generated 1820 derivative records from 17081 primary records. [2025-09-19T22:17:56.704585] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-19T22:17:56.727902] [DEBUG] [LOCAL ] CIA: Derivative data saved (1820 records). [2025-09-19T22:17:56.728489] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-19T22:17:56.742816] [INFO ] [MAIN ] Derivative Progress: 385/2093 symbols completed. CIA took 1.1s. Estimated remaining: 11m 8s. Rate: 153.5 symbols/min [2025-09-19T22:17:56.743454] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:56.744772] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:56.745726] [INFO ] [MAIN ] CI: Generated 1820 derivative records from 50689 primary records. [2025-09-19T22:17:56.745927] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-19T22:17:56.765470] [DEBUG] [LOCAL ] CI: Derivative data saved (1820 records). [2025-09-19T22:17:56.765793] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-19T22:17:56.768245] [INFO ] [MAIN ] Derivative Progress: 386/2093 symbols completed. CI took 1.2s. Estimated remaining: 11m 6s. Rate: 153.9 symbols/min [2025-09-19T22:17:56.768616] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:56.783204] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:56.784091] [INFO ] [MAIN ] CIB: Generated 1820 derivative records from 31593 primary records. [2025-09-19T22:17:56.785422] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-19T22:17:56.801286] [DEBUG] [LOCAL ] CIF: Loaded 4566 existing records from primary storage. [2025-09-19T22:17:56.805008] [INFO ] [MAIN ] CIF: Loaded 4566 primary data records. [2025-09-19T22:17:56.843053] [DEBUG] [LOCAL ] CIB: Derivative data saved (1820 records). [2025-09-19T22:17:56.861827] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-19T22:17:56.864463] [INFO ] [MAIN ] Derivative Progress: 387/2093 symbols completed. CIB took 1.2s. Estimated remaining: 11m 4s. Rate: 154.2 symbols/min [2025-09-19T22:17:56.908518] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:57.138504] [DEBUG] [LOCAL ] CIEN: Loaded 52866 existing records from primary storage. [2025-09-19T22:17:57.138808] [INFO ] [MAIN ] CIEN: Loaded 52866 primary data records. [2025-09-19T22:17:57.374633] [DEBUG] [LOCAL ] CIG: Loaded 44306 existing records from primary storage. [2025-09-19T22:17:57.489287] [INFO ] [MAIN ] CIG: Loaded 44306 primary data records. [2025-09-19T22:17:57.812537] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:57.822560] [INFO ] [MAIN ] CIF: Generated 1820 derivative records from 4566 primary records. [2025-09-19T22:17:57.822715] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-19T22:17:57.839561] [DEBUG] [LOCAL ] CIF: Derivative data saved (1820 records). [2025-09-19T22:17:57.840104] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-19T22:17:57.843003] [INFO ] [MAIN ] Derivative Progress: 388/2093 symbols completed. CIF took 1.1s. Estimated remaining: 11m 6s. Rate: 153.6 symbols/min [2025-09-19T22:17:57.860283] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:57.861300] [INFO ] [MAIN ] CIEN: Generated 1820 derivative records from 52866 primary records. [2025-09-19T22:17:57.861402] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-19T22:17:57.880870] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1820 records). [2025-09-19T22:17:57.880996] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-19T22:17:57.883710] [INFO ] [MAIN ] Derivative Progress: 389/2093 symbols completed. CIEN took 1.1s. Estimated remaining: 11m 4s. Rate: 153.9 symbols/min [2025-09-19T22:17:57.896550] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:57.897275] [INFO ] [MAIN ] CIG: Generated 1820 derivative records from 44306 primary records. [2025-09-19T22:17:57.897338] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-19T22:17:57.913612] [DEBUG] [LOCAL ] CIG: Derivative data saved (1820 records). [2025-09-19T22:17:57.913734] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-19T22:17:57.916410] [INFO ] [MAIN ] Derivative Progress: 390/2093 symbols completed. CIG took 1.0s. Estimated remaining: 11m 2s. Rate: 154.3 symbols/min [2025-09-19T22:17:57.917248] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:57.917309] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:57.917079] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:57.923769] [DEBUG] [LOCAL ] CIMN: Loaded 2690 existing records from primary storage. [2025-09-19T22:17:57.924082] [INFO ] [MAIN ] CIMN: Loaded 2690 primary data records. [2025-09-19T22:17:58.047835] [DEBUG] [LOCAL ] CII: Loaded 16086 existing records from primary storage. [2025-09-19T22:17:58.058418] [INFO ] [MAIN ] CII: Loaded 16086 primary data records. [2025-09-19T22:17:58.402390] [DEBUG] [LOCAL ] CIM: Loaded 37728 existing records from primary storage. [2025-09-19T22:17:58.409105] [INFO ] [MAIN ] CIM: Loaded 37728 primary data records. [2025-09-19T22:17:58.944260] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:58.945722] [INFO ] [MAIN ] CIMN: Generated 1820 derivative records from 2690 primary records. [2025-09-19T22:17:58.946136] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-19T22:17:58.973402] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1820 records). [2025-09-19T22:17:58.979516] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-19T22:17:58.981788] [INFO ] [MAIN ] Derivative Progress: 391/2093 symbols completed. CIMN took 1.1s. Estimated remaining: 11m 5s. Rate: 153.6 symbols/min [2025-09-19T22:17:58.982556] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:58.982297] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:58.984259] [INFO ] [MAIN ] CII: Generated 1820 derivative records from 16086 primary records. [2025-09-19T22:17:58.984849] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-19T22:17:59.003220] [DEBUG] [LOCAL ] CII: Derivative data saved (1820 records). [2025-09-19T22:17:59.003412] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-19T22:17:59.006067] [INFO ] [MAIN ] Derivative Progress: 392/2093 symbols completed. CII took 1.1s. Estimated remaining: 11m 3s. Rate: 154.0 symbols/min [2025-09-19T22:17:59.011441] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:59.033842] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:59.035240] [DEBUG] [LOCAL ] CINT: Loaded 18486 existing records from primary storage. [2025-09-19T22:17:59.036135] [INFO ] [MAIN ] CIM: Generated 1820 derivative records from 37728 primary records. [2025-09-19T22:17:59.036233] [INFO ] [MAIN ] CINT: Loaded 18486 primary data records. [2025-09-19T22:17:59.036286] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-19T22:17:59.161111] [DEBUG] [LOCAL ] CIO: Loaded 20269 existing records from primary storage. [2025-09-19T22:17:59.175616] [INFO ] [MAIN ] CIO: Loaded 20269 primary data records. [2025-09-19T22:17:59.245280] [DEBUG] [LOCAL ] CIM: Derivative data saved (1820 records). [2025-09-19T22:17:59.296310] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-19T22:17:59.518699] [INFO ] [MAIN ] Derivative Progress: 393/2093 symbols completed. CIM took 1.6s. Estimated remaining: 11m 3s. Rate: 153.8 symbols/min [2025-09-19T22:17:59.527863] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:17:59.760757] [DEBUG] [LOCAL ] CION: Loaded 29804 existing records from primary storage. [2025-09-19T22:17:59.761042] [INFO ] [MAIN ] CION: Loaded 29804 primary data records. [2025-09-19T22:17:59.890573] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:17:59.891442] [INFO ] [MAIN ] CINT: Generated 1820 derivative records from 18486 primary records. [2025-09-19T22:17:59.891808] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-19T22:17:59.969922] [DEBUG] [LOCAL ] CINT: Derivative data saved (1820 records). [2025-09-19T22:17:59.972909] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-19T22:17:59.998830] [INFO ] [MAIN ] Derivative Progress: 394/2093 symbols completed. CINT took 1.0s. Estimated remaining: 11m 3s. Rate: 153.8 symbols/min [2025-09-19T22:18:00.118302] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:00.137564] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:00.138834] [INFO ] [MAIN ] CIO: Generated 1820 derivative records from 20269 primary records. [2025-09-19T22:18:00.138969] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-19T22:18:00.157664] [DEBUG] [LOCAL ] CIO: Derivative data saved (1820 records). [2025-09-19T22:18:00.157779] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-19T22:18:00.160295] [INFO ] [MAIN ] Derivative Progress: 395/2093 symbols completed. CIO took 1.2s. Estimated remaining: 11m 2s. Rate: 154.0 symbols/min [2025-09-19T22:18:00.162007] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:00.195967] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:00.196894] [INFO ] [MAIN ] CION: Generated 1820 derivative records from 29804 primary records. [2025-09-19T22:18:00.197076] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-19T22:18:00.234773] [DEBUG] [LOCAL ] CION: Derivative data saved (1820 records). [2025-09-19T22:18:00.246069] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-19T22:18:00.248482] [INFO ] [MAIN ] Derivative Progress: 396/2093 symbols completed. CION took 0.7s. Estimated remaining: 10m 60s. Rate: 154.3 symbols/min [2025-09-19T22:18:00.250106] [DEBUG] [LOCAL ] CLB: Loaded 33774 existing records from primary storage. [2025-09-19T22:18:00.250390] [INFO ] [MAIN ] CLB: Loaded 33774 primary data records. [2025-09-19T22:18:00.250264] [DEBUG] [LOCAL ] CL: Loaded 54424 existing records from primary storage. [2025-09-19T22:18:00.262406] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:00.279011] [INFO ] [MAIN ] CL: Loaded 54424 primary data records. [2025-09-19T22:18:00.532093] [DEBUG] [LOCAL ] CLCO: Loaded 13627 existing records from primary storage. [2025-09-19T22:18:00.537806] [INFO ] [MAIN ] CLCO: Loaded 13627 primary data records. [2025-09-19T22:18:01.290098] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:01.299118] [INFO ] [MAIN ] CLB: Generated 1820 derivative records from 33774 primary records. [2025-09-19T22:18:01.303467] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-19T22:18:01.308381] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:01.320793] [INFO ] [MAIN ] CL: Generated 1820 derivative records from 54424 primary records. [2025-09-19T22:18:01.325218] [DEBUG] [LOCAL ] CLB: Derivative data saved (1820 records). [2025-09-19T22:18:01.325285] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-19T22:18:01.326341] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-19T22:18:01.340909] [INFO ] [MAIN ] Derivative Progress: 397/2093 symbols completed. CLB took 1.2s. Estimated remaining: 11m 3s. Rate: 153.6 symbols/min [2025-09-19T22:18:01.341614] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:01.350510] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:01.351401] [INFO ] [MAIN ] CLCO: Generated 1820 derivative records from 13627 primary records. [2025-09-19T22:18:01.355843] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-19T22:18:01.371675] [DEBUG] [LOCAL ] CL: Derivative data saved (1820 records). [2025-09-19T22:18:01.372316] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-19T22:18:01.374958] [INFO ] [MAIN ] Derivative Progress: 398/2093 symbols completed. CL took 1.3s. Estimated remaining: 11m 1s. Rate: 153.9 symbols/min [2025-09-19T22:18:01.376380] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:01.380418] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1820 records). [2025-09-19T22:18:01.380528] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-19T22:18:01.383261] [INFO ] [MAIN ] Derivative Progress: 399/2093 symbols completed. CLCO took 1.1s. Estimated remaining: 10m 59s. Rate: 154.3 symbols/min [2025-09-19T22:18:01.383604] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:01.402953] [DEBUG] [LOCAL ] CLPR: Loaded 11738 existing records from primary storage. [2025-09-19T22:18:01.403192] [INFO ] [MAIN ] CLPR: Loaded 11738 primary data records. [2025-09-19T22:18:01.502069] [DEBUG] [LOCAL ] CLDT: Loaded 26615 existing records from primary storage. [2025-09-19T22:18:01.523802] [INFO ] [MAIN ] CLDT: Loaded 26615 primary data records. [2025-09-19T22:18:02.076475] [DEBUG] [LOCAL ] CLS: Loaded 54422 existing records from primary storage. [2025-09-19T22:18:02.092507] [INFO ] [MAIN ] CLS: Loaded 54422 primary data records. [2025-09-19T22:18:02.512152] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:02.513407] [INFO ] [MAIN ] CLPR: Generated 1820 derivative records from 11738 primary records. [2025-09-19T22:18:02.513528] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-19T22:18:02.543873] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:02.546216] [INFO ] [MAIN ] CLDT: Generated 1820 derivative records from 26615 primary records. [2025-09-19T22:18:02.547076] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-19T22:18:02.567771] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1820 records). [2025-09-19T22:18:02.568475] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1820 records). [2025-09-19T22:18:02.568835] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-19T22:18:02.568771] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-19T22:18:02.571284] [INFO ] [MAIN ] Derivative Progress: 400/2093 symbols completed. CLDT took 1.2s. Estimated remaining: 11m 2s. Rate: 153.5 symbols/min [2025-09-19T22:18:02.574063] [INFO ] [MAIN ] Derivative Progress: 401/2093 symbols completed. CLPR took 1.2s. Estimated remaining: 10m 60s. Rate: 153.9 symbols/min [2025-09-19T22:18:02.574550] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:02.575057] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:02.593529] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:02.594478] [INFO ] [MAIN ] CLS: Generated 1820 derivative records from 54422 primary records. [2025-09-19T22:18:02.594546] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-19T22:18:02.611435] [DEBUG] [LOCAL ] CLS: Derivative data saved (1820 records). [2025-09-19T22:18:02.611623] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-19T22:18:02.614455] [INFO ] [MAIN ] Derivative Progress: 402/2093 symbols completed. CLS took 1.2s. Estimated remaining: 10m 58s. Rate: 154.3 symbols/min [2025-09-19T22:18:02.614855] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:02.674103] [DEBUG] [LOCAL ] CLVT: Loaded 52761 existing records from primary storage. [2025-09-19T22:18:02.674357] [INFO ] [MAIN ] CLVT: Loaded 52761 primary data records. [2025-09-19T22:18:02.753755] [DEBUG] [LOCAL ] CLX: Loaded 52158 existing records from primary storage. [2025-09-19T22:18:02.771007] [INFO ] [MAIN ] CLX: Loaded 52158 primary data records. [2025-09-19T22:18:03.128821] [DEBUG] [LOCAL ] CMA: Loaded 51012 existing records from primary storage. [2025-09-19T22:18:03.133490] [INFO ] [MAIN ] CMA: Loaded 51012 primary data records. [2025-09-19T22:18:03.655188] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:03.656040] [INFO ] [MAIN ] CLVT: Generated 1820 derivative records from 52761 primary records. [2025-09-19T22:18:03.656208] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-19T22:18:03.672993] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1820 records). [2025-09-19T22:18:03.673292] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-19T22:18:03.675516] [INFO ] [MAIN ] Derivative Progress: 403/2093 symbols completed. CLVT took 1.1s. Estimated remaining: 11m 0s. Rate: 153.6 symbols/min [2025-09-19T22:18:03.691100] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:03.691848] [INFO ] [MAIN ] CLX: Generated 1820 derivative records from 52158 primary records. [2025-09-19T22:18:03.692570] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-19T22:18:03.720228] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:03.722018] [DEBUG] [LOCAL ] CLX: Derivative data saved (1820 records). [2025-09-19T22:18:03.722615] [INFO ] [MAIN ] CMA: Generated 1820 derivative records from 51012 primary records. [2025-09-19T22:18:03.722716] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-19T22:18:03.722788] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-19T22:18:03.726109] [INFO ] [MAIN ] Derivative Progress: 404/2093 symbols completed. CLX took 1.2s. Estimated remaining: 10m 58s. Rate: 153.9 symbols/min [2025-09-19T22:18:03.740959] [DEBUG] [LOCAL ] CMA: Derivative data saved (1820 records). [2025-09-19T22:18:03.741019] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-19T22:18:03.744143] [INFO ] [MAIN ] Derivative Progress: 405/2093 symbols completed. CMA took 1.1s. Estimated remaining: 10m 56s. Rate: 154.3 symbols/min [2025-09-19T22:18:03.744827] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:03.744984] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:03.745448] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:03.754524] [DEBUG] [LOCAL ] CMCM: Loaded 4718 existing records from primary storage. [2025-09-19T22:18:03.754723] [INFO ] [MAIN ] CMCM: Loaded 4718 primary data records. [2025-09-19T22:18:03.880299] [DEBUG] [LOCAL ] CMBT: Loaded 21759 existing records from primary storage. [2025-09-19T22:18:03.899959] [INFO ] [MAIN ] CMBT: Loaded 21759 primary data records. [2025-09-19T22:18:04.189136] [DEBUG] [LOCAL ] CMC: Loaded 46515 existing records from primary storage. [2025-09-19T22:18:04.189432] [INFO ] [MAIN ] CMC: Loaded 46515 primary data records. [2025-09-19T22:18:04.756252] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:04.758173] [INFO ] [MAIN ] CMCM: Generated 1820 derivative records from 4718 primary records. [2025-09-19T22:18:04.758513] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-19T22:18:04.773422] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1820 records). [2025-09-19T22:18:04.773702] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-19T22:18:04.777042] [INFO ] [MAIN ] Derivative Progress: 406/2093 symbols completed. CMCM took 1.0s. Estimated remaining: 10m 59s. Rate: 153.7 symbols/min [2025-09-19T22:18:04.778912] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:04.794683] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:04.796041] [INFO ] [MAIN ] CMBT: Generated 1820 derivative records from 21759 primary records. [2025-09-19T22:18:04.796189] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-19T22:18:04.820337] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:04.822159] [INFO ] [MAIN ] CMC: Generated 1820 derivative records from 46515 primary records. [2025-09-19T22:18:04.822274] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-19T22:18:04.835069] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1820 records). [2025-09-19T22:18:04.838769] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-19T22:18:04.841909] [INFO ] [MAIN ] Derivative Progress: 407/2093 symbols completed. CMBT took 1.1s. Estimated remaining: 10m 57s. Rate: 154.0 symbols/min [2025-09-19T22:18:04.843230] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:04.845571] [DEBUG] [LOCAL ] CMC: Derivative data saved (1820 records). [2025-09-19T22:18:04.854665] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-19T22:18:04.857709] [INFO ] [MAIN ] Derivative Progress: 408/2093 symbols completed. CMC took 1.1s. Estimated remaining: 10m 55s. Rate: 154.3 symbols/min [2025-09-19T22:18:04.858178] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:04.874976] [DEBUG] [LOCAL ] CMI: Loaded 42606 existing records from primary storage. [2025-09-19T22:18:04.875274] [INFO ] [MAIN ] CMI: Loaded 42606 primary data records. [2025-09-19T22:18:05.173720] [DEBUG] [LOCAL ] CMP: Loaded 37120 existing records from primary storage. [2025-09-19T22:18:05.201007] [DEBUG] [LOCAL ] CMRE: Loaded 36224 existing records from primary storage. [2025-09-19T22:18:05.209940] [INFO ] [MAIN ] CMP: Loaded 37120 primary data records. [2025-09-19T22:18:05.209878] [INFO ] [MAIN ] CMRE: Loaded 36224 primary data records. [2025-09-19T22:18:05.851395] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:05.852618] [INFO ] [MAIN ] CMI: Generated 1820 derivative records from 42606 primary records. [2025-09-19T22:18:05.852851] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-19T22:18:05.872327] [DEBUG] [LOCAL ] CMI: Derivative data saved (1820 records). [2025-09-19T22:18:05.872473] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-19T22:18:05.875587] [INFO ] [MAIN ] Derivative Progress: 409/2093 symbols completed. CMI took 1.1s. Estimated remaining: 10m 57s. Rate: 153.7 symbols/min [2025-09-19T22:18:05.876502] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:05.893928] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:05.894779] [INFO ] [MAIN ] CMRE: Generated 1820 derivative records from 36224 primary records. [2025-09-19T22:18:05.895831] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-19T22:18:05.924999] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:05.928064] [INFO ] [MAIN ] CMP: Generated 1820 derivative records from 37120 primary records. [2025-09-19T22:18:05.928379] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-19T22:18:05.928857] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1820 records). [2025-09-19T22:18:05.929468] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-19T22:18:05.931620] [INFO ] [MAIN ] Derivative Progress: 410/2093 symbols completed. CMRE took 1.1s. Estimated remaining: 10m 55s. Rate: 154.1 symbols/min [2025-09-19T22:18:05.932011] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:05.952823] [DEBUG] [LOCAL ] CMSA: Loaded 3404 existing records from primary storage. [2025-09-19T22:18:05.953914] [INFO ] [MAIN ] CMSA: Loaded 3404 primary data records. [2025-09-19T22:18:05.965380] [DEBUG] [LOCAL ] CMP: Derivative data saved (1820 records). [2025-09-19T22:18:05.991586] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-19T22:18:06.023810] [INFO ] [MAIN ] Derivative Progress: 411/2093 symbols completed. CMP took 1.2s. Estimated remaining: 10m 54s. Rate: 154.3 symbols/min [2025-09-19T22:18:06.077954] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:06.175281] [DEBUG] [LOCAL ] CMSC: Loaded 5184 existing records from primary storage. [2025-09-19T22:18:06.175527] [INFO ] [MAIN ] CMSC: Loaded 5184 primary data records. [2025-09-19T22:18:06.322189] [DEBUG] [LOCAL ] CMS: Loaded 53419 existing records from primary storage. [2025-09-19T22:18:06.343574] [INFO ] [MAIN ] CMS: Loaded 53419 primary data records. [2025-09-19T22:18:06.955956] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:18:06.957975] [INFO ] [MAIN ] CMSA: Generated 1819 derivative records from 3404 primary records. [2025-09-19T22:18:06.958142] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-19T22:18:06.975585] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1819 records). [2025-09-19T22:18:06.976674] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-19T22:18:06.980437] [INFO ] [MAIN ] Derivative Progress: 412/2093 symbols completed. CMSA took 1.0s. Estimated remaining: 10m 56s. Rate: 153.8 symbols/min [2025-09-19T22:18:06.982837] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:07.003755] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:07.009515] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:07.009297] [INFO ] [MAIN ] CMSC: Generated 1820 derivative records from 5184 primary records. [2025-09-19T22:18:07.010240] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-19T22:18:07.010134] [INFO ] [MAIN ] CMS: Generated 1820 derivative records from 53419 primary records. [2025-09-19T22:18:07.013136] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-19T22:18:07.030823] [DEBUG] [LOCAL ] CMSD: Loaded 8242 existing records from primary storage. [2025-09-19T22:18:07.031577] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1820 records). [2025-09-19T22:18:07.031742] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-19T22:18:07.034335] [INFO ] [MAIN ] Derivative Progress: 413/2093 symbols completed. CMSC took 1.0s. Estimated remaining: 10m 54s. Rate: 154.1 symbols/min [2025-09-19T22:18:07.031839] [INFO ] [MAIN ] CMSD: Loaded 8242 primary data records. [2025-09-19T22:18:07.034620] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:07.219237] [DEBUG] [LOCAL ] CMS: Derivative data saved (1820 records). [2025-09-19T22:18:07.244968] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-19T22:18:07.248081] [INFO ] [MAIN ] Derivative Progress: 414/2093 symbols completed. CMS took 1.4s. Estimated remaining: 10m 53s. Rate: 154.3 symbols/min [2025-09-19T22:18:07.248505] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:07.378883] [DEBUG] [LOCAL ] CMTG: Loaded 38290 existing records from primary storage. [2025-09-19T22:18:07.379529] [INFO ] [MAIN ] CMTG: Loaded 38290 primary data records. [2025-09-19T22:18:07.461744] [DEBUG] [LOCAL ] CMU: Loaded 7451 existing records from primary storage. [2025-09-19T22:18:07.485883] [INFO ] [MAIN ] CMU: Loaded 7451 primary data records. [2025-09-19T22:18:08.002061] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:08.003287] [INFO ] [MAIN ] CMSD: Generated 1820 derivative records from 8242 primary records. [2025-09-19T22:18:08.003623] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-19T22:18:08.022497] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1820 records). [2025-09-19T22:18:08.023198] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-19T22:18:08.025568] [INFO ] [MAIN ] Derivative Progress: 415/2093 symbols completed. CMSD took 1.0s. Estimated remaining: 10m 54s. Rate: 153.9 symbols/min [2025-09-19T22:18:08.026341] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:08.060582] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:08.070022] [INFO ] [MAIN ] CMU: Generated 1820 derivative records from 7451 primary records. [2025-09-19T22:18:08.070442] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-19T22:18:08.071502] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:08.073184] [INFO ] [MAIN ] CMTG: Generated 1820 derivative records from 38290 primary records. [2025-09-19T22:18:08.073621] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-19T22:18:08.122342] [DEBUG] [LOCAL ] CNA: Loaded 33238 existing records from primary storage. [2025-09-19T22:18:08.124444] [INFO ] [MAIN ] CNA: Loaded 33238 primary data records. [2025-09-19T22:18:08.126487] [DEBUG] [LOCAL ] CMU: Derivative data saved (1820 records). [2025-09-19T22:18:08.148579] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-19T22:18:08.164809] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1820 records). [2025-09-19T22:18:08.199756] [INFO ] [MAIN ] Derivative Progress: 416/2093 symbols completed. CMU took 1.0s. Estimated remaining: 10m 53s. Rate: 154.1 symbols/min [2025-09-19T22:18:08.191938] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-19T22:18:08.216564] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:08.235117] [INFO ] [MAIN ] Derivative Progress: 417/2093 symbols completed. CMTG took 1.2s. Estimated remaining: 10m 51s. Rate: 154.5 symbols/min [2025-09-19T22:18:08.239367] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:08.322386] [DEBUG] [LOCAL ] CNF: Loaded 10887 existing records from primary storage. [2025-09-19T22:18:08.465017] [INFO ] [MAIN ] CNF: Loaded 10887 primary data records. [2025-09-19T22:18:08.815406] [DEBUG] [LOCAL ] CNI: Loaded 52411 existing records from primary storage. [2025-09-19T22:18:08.816260] [INFO ] [MAIN ] CNI: Loaded 52411 primary data records. [2025-09-19T22:18:08.928615] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:08.940903] [INFO ] [MAIN ] CNA: Generated 1820 derivative records from 33238 primary records. [2025-09-19T22:18:08.952156] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-19T22:18:09.053736] [DEBUG] [LOCAL ] CNA: Derivative data saved (1820 records). [2025-09-19T22:18:09.167629] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-19T22:18:09.185076] [INFO ] [MAIN ] Derivative Progress: 418/2093 symbols completed. CNA took 1.2s. Estimated remaining: 10m 53s. Rate: 153.9 symbols/min [2025-09-19T22:18:09.199752] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:18:09.202700] [INFO ] [MAIN ] CNF: Generated 1819 derivative records from 10887 primary records. [2025-09-19T22:18:09.203031] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-19T22:18:09.226594] [DEBUG] [LOCAL ] CNF: Derivative data saved (1819 records). [2025-09-19T22:18:09.227156] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-19T22:18:09.231011] [INFO ] [MAIN ] Derivative Progress: 419/2093 symbols completed. CNF took 1.0s. Estimated remaining: 10m 51s. Rate: 154.3 symbols/min [2025-09-19T22:18:09.248995] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:09.249836] [INFO ] [MAIN ] CNI: Generated 1820 derivative records from 52411 primary records. [2025-09-19T22:18:09.249901] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-19T22:18:09.265944] [DEBUG] [LOCAL ] CNI: Derivative data saved (1820 records). [2025-09-19T22:18:09.266097] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-19T22:18:09.268700] [INFO ] [MAIN ] Derivative Progress: 420/2093 symbols completed. CNI took 1.0s. Estimated remaining: 10m 49s. Rate: 154.6 symbols/min [2025-09-19T22:18:09.269696] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:09.269891] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:09.270077] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:09.326736] [DEBUG] [LOCAL ] CNMD: Loaded 33083 existing records from primary storage. [2025-09-19T22:18:09.326941] [INFO ] [MAIN ] CNMD: Loaded 33083 primary data records. [2025-09-19T22:18:09.505373] [DEBUG] [LOCAL ] CNM: Loaded 51723 existing records from primary storage. [2025-09-19T22:18:09.506500] [DEBUG] [LOCAL ] CNK: Loaded 53688 existing records from primary storage. [2025-09-19T22:18:09.517444] [INFO ] [MAIN ] CNK: Loaded 53688 primary data records. [2025-09-19T22:18:09.506916] [INFO ] [MAIN ] CNM: Loaded 51723 primary data records. [2025-09-19T22:18:10.381825] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:10.383604] [INFO ] [MAIN ] CNMD: Generated 1820 derivative records from 33083 primary records. [2025-09-19T22:18:10.384505] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-19T22:18:10.399227] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:10.407725] [INFO ] [MAIN ] CNK: Generated 1820 derivative records from 53688 primary records. [2025-09-19T22:18:10.417543] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-19T22:18:10.438728] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:10.449810] [INFO ] [MAIN ] CNM: Generated 1820 derivative records from 51723 primary records. [2025-09-19T22:18:10.449934] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1820 records). [2025-09-19T22:18:10.450172] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-19T22:18:10.450530] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-19T22:18:10.454387] [DEBUG] [LOCAL ] CNK: Derivative data saved (1820 records). [2025-09-19T22:18:10.454598] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-19T22:18:10.457025] [INFO ] [MAIN ] Derivative Progress: 421/2093 symbols completed. CNMD took 1.2s. Estimated remaining: 10m 52s. Rate: 153.8 symbols/min [2025-09-19T22:18:10.461298] [INFO ] [MAIN ] Derivative Progress: 422/2093 symbols completed. CNK took 1.2s. Estimated remaining: 10m 50s. Rate: 154.2 symbols/min [2025-09-19T22:18:10.461621] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:10.461226] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:10.483994] [DEBUG] [LOCAL ] CNM: Derivative data saved (1820 records). [2025-09-19T22:18:10.484161] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-19T22:18:10.487474] [INFO ] [MAIN ] Derivative Progress: 423/2093 symbols completed. CNM took 1.2s. Estimated remaining: 10m 48s. Rate: 154.5 symbols/min [2025-09-19T22:18:10.488119] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:10.540771] [DEBUG] [LOCAL ] CNO: Loaded 42229 existing records from primary storage. [2025-09-19T22:18:10.541023] [INFO ] [MAIN ] CNO: Loaded 42229 primary data records. [2025-09-19T22:18:10.675213] [DEBUG] [LOCAL ] CNNE: Loaded 37488 existing records from primary storage. [2025-09-19T22:18:10.696981] [INFO ] [MAIN ] CNNE: Loaded 37488 primary data records. [2025-09-19T22:18:10.774898] [DEBUG] [LOCAL ] CNQ: Loaded 54362 existing records from primary storage. [2025-09-19T22:18:10.912740] [INFO ] [MAIN ] CNQ: Loaded 54362 primary data records. [2025-09-19T22:18:11.529775] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:11.530816] [INFO ] [MAIN ] CNO: Generated 1820 derivative records from 42229 primary records. [2025-09-19T22:18:11.531043] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-19T22:18:11.551781] [DEBUG] [LOCAL ] CNO: Derivative data saved (1820 records). [2025-09-19T22:18:11.551935] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-19T22:18:11.554061] [INFO ] [MAIN ] Derivative Progress: 424/2093 symbols completed. CNO took 1.1s. Estimated remaining: 10m 51s. Rate: 153.9 symbols/min [2025-09-19T22:18:11.555072] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:11.594749] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:11.601519] [INFO ] [MAIN ] CNQ: Generated 1820 derivative records from 54362 primary records. [2025-09-19T22:18:11.600506] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:11.601756] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-19T22:18:11.602446] [INFO ] [MAIN ] CNNE: Generated 1820 derivative records from 37488 primary records. [2025-09-19T22:18:11.603371] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-19T22:18:11.631138] [DEBUG] [LOCAL ] CNS: Loaded 21458 existing records from primary storage. [2025-09-19T22:18:11.631606] [INFO ] [MAIN ] CNS: Loaded 21458 primary data records. [2025-09-19T22:18:11.652216] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1820 records). [2025-09-19T22:18:11.662696] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-19T22:18:11.676899] [INFO ] [MAIN ] Derivative Progress: 425/2093 symbols completed. CNNE took 1.2s. Estimated remaining: 10m 49s. Rate: 154.1 symbols/min [2025-09-19T22:18:11.712145] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:11.755165] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1820 records). [2025-09-19T22:18:11.761401] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-19T22:18:11.784477] [INFO ] [MAIN ] Derivative Progress: 426/2093 symbols completed. CNQ took 1.3s. Estimated remaining: 10m 48s. Rate: 154.4 symbols/min [2025-09-19T22:18:11.822086] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:12.065932] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:12.067357] [INFO ] [MAIN ] CNS: Generated 1820 derivative records from 21458 primary records. [2025-09-19T22:18:12.066542] [DEBUG] [LOCAL ] CODI: Loaded 40123 existing records from primary storage. [2025-09-19T22:18:12.065490] [DEBUG] [LOCAL ] CNX: Loaded 52136 existing records from primary storage. [2025-09-19T22:18:12.067743] [INFO ] [MAIN ] CNX: Loaded 52136 primary data records. [2025-09-19T22:18:12.067853] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-19T22:18:12.067546] [INFO ] [MAIN ] CODI: Loaded 40123 primary data records. [2025-09-19T22:18:12.218427] [DEBUG] [LOCAL ] CNS: Derivative data saved (1820 records). [2025-09-19T22:18:12.223746] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-19T22:18:12.245102] [INFO ] [MAIN ] Derivative Progress: 427/2093 symbols completed. CNS took 0.7s. Estimated remaining: 10m 48s. Rate: 154.3 symbols/min [2025-09-19T22:18:12.306164] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:12.805212] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:12.806256] [INFO ] [MAIN ] CODI: Generated 1820 derivative records from 40123 primary records. [2025-09-19T22:18:12.806768] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-19T22:18:12.833523] [DEBUG] [LOCAL ] COF: Loaded 54390 existing records from primary storage. [2025-09-19T22:18:12.833847] [INFO ] [MAIN ] COF: Loaded 54390 primary data records. [2025-09-19T22:18:12.838627] [DEBUG] [LOCAL ] CODI: Derivative data saved (1820 records). [2025-09-19T22:18:12.875262] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-19T22:18:12.877519] [INFO ] [MAIN ] Derivative Progress: 428/2093 symbols completed. CODI took 1.1s. Estimated remaining: 10m 48s. Rate: 154.1 symbols/min [2025-09-19T22:18:12.895913] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:12.967031] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:13.001670] [INFO ] [MAIN ] CNX: Generated 1820 derivative records from 52136 primary records. [2025-09-19T22:18:13.034405] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-19T22:18:13.175338] [DEBUG] [LOCAL ] CNX: Derivative data saved (1820 records). [2025-09-19T22:18:13.175686] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-19T22:18:13.177687] [INFO ] [MAIN ] Derivative Progress: 429/2093 symbols completed. CNX took 1.5s. Estimated remaining: 10m 47s. Rate: 154.2 symbols/min [2025-09-19T22:18:13.178087] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:13.233420] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:13.235936] [INFO ] [MAIN ] COF: Generated 1820 derivative records from 54390 primary records. [2025-09-19T22:18:13.234822] [DEBUG] [LOCAL ] COHR: Loaded 54145 existing records from primary storage. [2025-09-19T22:18:13.236280] [INFO ] [MAIN ] COHR: Loaded 54145 primary data records. [2025-09-19T22:18:13.236505] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-19T22:18:13.359206] [DEBUG] [LOCAL ] COF: Derivative data saved (1820 records). [2025-09-19T22:18:13.370397] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-19T22:18:13.383879] [INFO ] [MAIN ] Derivative Progress: 430/2093 symbols completed. COF took 1.1s. Estimated remaining: 10m 46s. Rate: 154.4 symbols/min [2025-09-19T22:18:13.400494] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:13.468105] [DEBUG] [LOCAL ] COLD: Loaded 52669 existing records from primary storage. [2025-09-19T22:18:13.576134] [INFO ] [MAIN ] COLD: Loaded 52669 primary data records. [2025-09-19T22:18:13.931849] [DEBUG] [LOCAL ] CON: Loaded 39527 existing records from primary storage. [2025-09-19T22:18:13.933178] [INFO ] [MAIN ] CON: Loaded 39527 primary data records. [2025-09-19T22:18:14.089148] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:14.130069] [INFO ] [MAIN ] COHR: Generated 1820 derivative records from 54145 primary records. [2025-09-19T22:18:14.154965] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-19T22:18:14.353465] [DEBUG] [LOCAL ] COHR: Derivative data saved (1820 records). [2025-09-19T22:18:14.353841] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-19T22:18:14.356556] [INFO ] [MAIN ] Derivative Progress: 431/2093 symbols completed. COHR took 1.5s. Estimated remaining: 10m 48s. Rate: 153.8 symbols/min [2025-09-19T22:18:14.357845] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:14.379469] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:14.380476] [INFO ] [MAIN ] COLD: Generated 1820 derivative records from 52669 primary records. [2025-09-19T22:18:14.381950] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-19T22:18:14.405928] [DEBUG] [LOCAL ] COLD: Derivative data saved (1820 records). [2025-09-19T22:18:14.406144] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-19T22:18:14.408385] [INFO ] [MAIN ] Derivative Progress: 432/2093 symbols completed. COLD took 1.2s. Estimated remaining: 10m 47s. Rate: 154.1 symbols/min [2025-09-19T22:18:14.409291] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:14.421516] [DEBUG] [LOCAL ] COOK: Loaded 24488 existing records from primary storage. [2025-09-19T22:18:14.423702] [INFO ] [MAIN ] COOK: Loaded 24488 primary data records. [2025-09-19T22:18:14.474542] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:14.509085] [INFO ] [MAIN ] CON: Generated 1820 derivative records from 39527 primary records. [2025-09-19T22:18:14.509209] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-19T22:18:14.646720] [DEBUG] [LOCAL ] CON: Derivative data saved (1820 records). [2025-09-19T22:18:14.647067] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-19T22:18:14.649853] [INFO ] [MAIN ] Derivative Progress: 433/2093 symbols completed. CON took 1.2s. Estimated remaining: 10m 46s. Rate: 154.3 symbols/min [2025-09-19T22:18:14.818782] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-09-19T22:18:14.819231] [INFO ] [MAIN ] COP: Loaded 54507 primary data records. [2025-09-19T22:18:15.025330] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:15.032507] [INFO ] [MAIN ] COOK: Generated 1820 derivative records from 24488 primary records. [2025-09-19T22:18:15.147009] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-19T22:18:15.176530] [DEBUG] [LOCAL ] COOK: Derivative data saved (1820 records). [2025-09-19T22:18:15.177281] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-19T22:18:15.179781] [INFO ] [MAIN ] Derivative Progress: 434/2093 symbols completed. COOK took 0.8s. Estimated remaining: 10m 46s. Rate: 154.1 symbols/min [2025-09-19T22:18:15.205590] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:15.206634] [INFO ] [MAIN ] COP: Generated 1820 derivative records from 54507 primary records. [2025-09-19T22:18:15.206729] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-19T22:18:15.223772] [DEBUG] [LOCAL ] COP: Derivative data saved (1820 records). [2025-09-19T22:18:15.223938] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-19T22:18:15.227289] [INFO ] [MAIN ] Derivative Progress: 435/2093 symbols completed. COP took 0.8s. Estimated remaining: 10m 44s. Rate: 154.5 symbols/min [2025-09-19T22:18:15.228249] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:15.228741] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:15.228517] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:15.311868] [DEBUG] [LOCAL ] COR: Loaded 48035 existing records from primary storage. [2025-09-19T22:18:15.312114] [INFO ] [MAIN ] COR: Loaded 48035 primary data records. [2025-09-19T22:18:15.454747] [DEBUG] [LOCAL ] CP: Loaded 54068 existing records from primary storage. [2025-09-19T22:18:15.454984] [INFO ] [MAIN ] CP: Loaded 54068 primary data records. [2025-09-19T22:18:15.453831] [DEBUG] [LOCAL ] COTY: Loaded 54037 existing records from primary storage. [2025-09-19T22:18:15.466171] [INFO ] [MAIN ] COTY: Loaded 54037 primary data records. [2025-09-19T22:18:16.378870] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:16.379955] [INFO ] [MAIN ] COR: Generated 1820 derivative records from 48035 primary records. [2025-09-19T22:18:16.380186] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-19T22:18:16.400504] [DEBUG] [LOCAL ] COR: Derivative data saved (1820 records). [2025-09-19T22:18:16.402630] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-19T22:18:16.404629] [INFO ] [MAIN ] Derivative Progress: 436/2093 symbols completed. COR took 1.2s. Estimated remaining: 10m 47s. Rate: 153.7 symbols/min [2025-09-19T22:18:16.404917] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:16.422229] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:16.436523] [INFO ] [MAIN ] CP: Generated 1820 derivative records from 54068 primary records. [2025-09-19T22:18:16.436970] [DEBUG] [MAIN ] COTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:16.437212] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-19T22:18:16.438917] [INFO ] [MAIN ] COTY: Generated 1820 derivative records from 54037 primary records. [2025-09-19T22:18:16.439314] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-19T22:18:16.475929] [DEBUG] [LOCAL ] CP: Derivative data saved (1820 records). [2025-09-19T22:18:16.477808] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-19T22:18:16.480716] [INFO ] [MAIN ] Derivative Progress: 437/2093 symbols completed. CP took 1.3s. Estimated remaining: 10m 45s. Rate: 154.0 symbols/min [2025-09-19T22:18:16.481892] [DEBUG] [LOCAL ] COTY: Derivative data saved (1820 records). [2025-09-19T22:18:16.482391] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:16.482512] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-19T22:18:16.485556] [INFO ] [MAIN ] Derivative Progress: 438/2093 symbols completed. COTY took 1.3s. Estimated remaining: 10m 43s. Rate: 154.4 symbols/min [2025-09-19T22:18:16.485957] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:16.496815] [DEBUG] [LOCAL ] CPA: Loaded 29453 existing records from primary storage. [2025-09-19T22:18:16.497062] [INFO ] [MAIN ] CPA: Loaded 29453 primary data records. [2025-09-19T22:18:16.621555] [DEBUG] [LOCAL ] CPK: Loaded 13398 existing records from primary storage. [2025-09-19T22:18:16.637583] [INFO ] [MAIN ] CPK: Loaded 13398 primary data records. [2025-09-19T22:18:16.643239] [DEBUG] [LOCAL ] CPF: Loaded 15847 existing records from primary storage. [2025-09-19T22:18:16.683937] [INFO ] [MAIN ] CPF: Loaded 15847 primary data records. [2025-09-19T22:18:17.467094] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:17.468148] [INFO ] [MAIN ] CPA: Generated 1820 derivative records from 29453 primary records. [2025-09-19T22:18:17.468712] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-19T22:18:17.502810] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:17.511937] [INFO ] [MAIN ] CPK: Generated 1820 derivative records from 13398 primary records. [2025-09-19T22:18:17.517162] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-19T22:18:17.520585] [DEBUG] [LOCAL ] CPA: Derivative data saved (1820 records). [2025-09-19T22:18:17.519838] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:17.527949] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-19T22:18:17.529886] [INFO ] [MAIN ] Derivative Progress: 439/2093 symbols completed. CPA took 1.1s. Estimated remaining: 10m 45s. Rate: 153.8 symbols/min [2025-09-19T22:18:17.532147] [INFO ] [MAIN ] CPF: Generated 1820 derivative records from 15847 primary records. [2025-09-19T22:18:17.536533] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-19T22:18:17.535207] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:17.539693] [DEBUG] [LOCAL ] CPK: Derivative data saved (1820 records). [2025-09-19T22:18:17.540672] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-19T22:18:17.543243] [INFO ] [MAIN ] Derivative Progress: 440/2093 symbols completed. CPK took 1.1s. Estimated remaining: 10m 44s. Rate: 154.1 symbols/min [2025-09-19T22:18:17.543830] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:17.560485] [DEBUG] [LOCAL ] CPF: Derivative data saved (1820 records). [2025-09-19T22:18:17.560623] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-19T22:18:17.563086] [INFO ] [MAIN ] Derivative Progress: 441/2093 symbols completed. CPF took 1.1s. Estimated remaining: 10m 42s. Rate: 154.5 symbols/min [2025-09-19T22:18:17.563553] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:17.594113] [DEBUG] [LOCAL ] CPS: Loaded 26671 existing records from primary storage. [2025-09-19T22:18:17.594256] [INFO ] [MAIN ] CPS: Loaded 26671 primary data records. [2025-09-19T22:18:17.754549] [DEBUG] [LOCAL ] CPNG: Loaded 54451 existing records from primary storage. [2025-09-19T22:18:17.760344] [INFO ] [MAIN ] CPNG: Loaded 54451 primary data records. [2025-09-19T22:18:17.891238] [DEBUG] [LOCAL ] CPT: Loaded 45047 existing records from primary storage. [2025-09-19T22:18:17.917069] [INFO ] [MAIN ] CPT: Loaded 45047 primary data records. [2025-09-19T22:18:18.711375] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:18.727473] [INFO ] [MAIN ] CPS: Generated 1820 derivative records from 26671 primary records. [2025-09-19T22:18:18.727741] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-19T22:18:18.729421] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:18.738112] [INFO ] [MAIN ] CPNG: Generated 1820 derivative records from 54451 primary records. [2025-09-19T22:18:18.738382] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-19T22:18:18.759371] [DEBUG] [LOCAL ] CPS: Derivative data saved (1820 records). [2025-09-19T22:18:18.764243] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-19T22:18:18.766342] [INFO ] [MAIN ] Derivative Progress: 442/2093 symbols completed. CPS took 1.2s. Estimated remaining: 10m 44s. Rate: 153.7 symbols/min [2025-09-19T22:18:18.781542] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1820 records). [2025-09-19T22:18:18.781779] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:18.782240] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:18.782467] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-19T22:18:18.786238] [INFO ] [MAIN ] Derivative Progress: 443/2093 symbols completed. CPNG took 1.3s. Estimated remaining: 10m 43s. Rate: 154.1 symbols/min [2025-09-19T22:18:18.783386] [INFO ] [MAIN ] CPT: Generated 1820 derivative records from 45047 primary records. [2025-09-19T22:18:18.787621] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:18.787356] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-19T22:18:18.810875] [DEBUG] [LOCAL ] CPT: Derivative data saved (1820 records). [2025-09-19T22:18:18.810945] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-19T22:18:18.813191] [INFO ] [MAIN ] Derivative Progress: 444/2093 symbols completed. CPT took 1.2s. Estimated remaining: 10m 41s. Rate: 154.4 symbols/min [2025-09-19T22:18:18.813532] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:18.830502] [DEBUG] [LOCAL ] CQP: Loaded 20282 existing records from primary storage. [2025-09-19T22:18:18.830762] [INFO ] [MAIN ] CQP: Loaded 20282 primary data records. [2025-09-19T22:18:18.920593] [DEBUG] [LOCAL ] CR: Loaded 25083 existing records from primary storage. [2025-09-19T22:18:18.942747] [INFO ] [MAIN ] CR: Loaded 25083 primary data records. [2025-09-19T22:18:19.299599] [DEBUG] [LOCAL ] CRBG: Loaded 53112 existing records from primary storage. [2025-09-19T22:18:19.333525] [INFO ] [MAIN ] CRBG: Loaded 53112 primary data records. [2025-09-19T22:18:19.812700] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:19.815258] [INFO ] [MAIN ] CQP: Generated 1820 derivative records from 20282 primary records. [2025-09-19T22:18:19.815608] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-19T22:18:19.834988] [DEBUG] [LOCAL ] CQP: Derivative data saved (1820 records). [2025-09-19T22:18:19.835192] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-19T22:18:19.837295] [INFO ] [MAIN ] Derivative Progress: 445/2093 symbols completed. CQP took 1.1s. Estimated remaining: 10m 43s. Rate: 153.8 symbols/min [2025-09-19T22:18:19.850351] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:19.851265] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:19.852253] [INFO ] [MAIN ] CR: Generated 1820 derivative records from 25083 primary records. [2025-09-19T22:18:19.852443] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-19T22:18:19.882480] [DEBUG] [LOCAL ] CR: Derivative data saved (1820 records). [2025-09-19T22:18:19.887702] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-19T22:18:19.887911] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:19.888666] [INFO ] [MAIN ] CRBG: Generated 1820 derivative records from 53112 primary records. [2025-09-19T22:18:19.891099] [INFO ] [MAIN ] Derivative Progress: 446/2093 symbols completed. CR took 1.1s. Estimated remaining: 10m 41s. Rate: 154.1 symbols/min [2025-09-19T22:18:19.888763] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-19T22:18:19.892116] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:19.909280] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1820 records). [2025-09-19T22:18:19.909456] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-19T22:18:19.911692] [INFO ] [MAIN ] Derivative Progress: 447/2093 symbols completed. CRBG took 1.1s. Estimated remaining: 10m 39s. Rate: 154.4 symbols/min [2025-09-19T22:18:19.912051] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:19.950810] [DEBUG] [LOCAL ] CRGY: Loaded 53297 existing records from primary storage. [2025-09-19T22:18:19.951012] [INFO ] [MAIN ] CRGY: Loaded 53297 primary data records. [2025-09-19T22:18:20.303668] [DEBUG] [LOCAL ] CRH: Loaded 54250 existing records from primary storage. [2025-09-19T22:18:20.303920] [INFO ] [MAIN ] CRH: Loaded 54250 primary data records. [2025-09-19T22:18:20.304777] [DEBUG] [LOCAL ] CRI: Loaded 50689 existing records from primary storage. [2025-09-19T22:18:20.310711] [INFO ] [MAIN ] CRI: Loaded 50689 primary data records. [2025-09-19T22:18:20.965441] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:20.966991] [INFO ] [MAIN ] CRGY: Generated 1820 derivative records from 53297 primary records. [2025-09-19T22:18:20.967140] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-19T22:18:20.988693] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1820 records). [2025-09-19T22:18:20.989010] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-19T22:18:20.991807] [INFO ] [MAIN ] Derivative Progress: 448/2093 symbols completed. CRGY took 1.2s. Estimated remaining: 10m 42s. Rate: 153.8 symbols/min [2025-09-19T22:18:21.013216] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:21.015734] [INFO ] [MAIN ] CRI: Generated 1820 derivative records from 50689 primary records. [2025-09-19T22:18:21.016005] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-19T22:18:21.042793] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:21.045352] [INFO ] [MAIN ] CRH: Generated 1820 derivative records from 54250 primary records. [2025-09-19T22:18:21.046688] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-19T22:18:21.048507] [DEBUG] [LOCAL ] CRI: Derivative data saved (1820 records). [2025-09-19T22:18:21.048963] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-19T22:18:21.051345] [INFO ] [MAIN ] Derivative Progress: 449/2093 symbols completed. CRI took 1.1s. Estimated remaining: 10m 40s. Rate: 154.1 symbols/min [2025-09-19T22:18:21.067350] [DEBUG] [LOCAL ] CRH: Derivative data saved (1820 records). [2025-09-19T22:18:21.067469] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-19T22:18:21.069926] [INFO ] [MAIN ] Derivative Progress: 450/2093 symbols completed. CRH took 1.2s. Estimated remaining: 10m 38s. Rate: 154.4 symbols/min [2025-09-19T22:18:21.070466] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:21.070755] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:21.070698] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:21.156045] [DEBUG] [LOCAL ] CRS: Loaded 44213 existing records from primary storage. [2025-09-19T22:18:21.157376] [INFO ] [MAIN ] CRS: Loaded 44213 primary data records. [2025-09-19T22:18:21.179703] [DEBUG] [LOCAL ] CRK: Loaded 52887 existing records from primary storage. [2025-09-19T22:18:21.223609] [INFO ] [MAIN ] CRK: Loaded 52887 primary data records. [2025-09-19T22:18:21.296766] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-09-19T22:18:21.330602] [INFO ] [MAIN ] CRM: Loaded 54550 primary data records. [2025-09-19T22:18:22.156943] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:22.158084] [INFO ] [MAIN ] CRK: Generated 1820 derivative records from 52887 primary records. [2025-09-19T22:18:22.158262] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-19T22:18:22.183211] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:22.185059] [INFO ] [MAIN ] CRS: Generated 1820 derivative records from 44213 primary records. [2025-09-19T22:18:22.185466] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-19T22:18:22.203333] [DEBUG] [LOCAL ] CRK: Derivative data saved (1820 records). [2025-09-19T22:18:22.204294] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-19T22:18:22.208456] [INFO ] [MAIN ] Derivative Progress: 451/2093 symbols completed. CRK took 1.1s. Estimated remaining: 10m 41s. Rate: 153.8 symbols/min [2025-09-19T22:18:22.209218] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:22.210521] [DEBUG] [LOCAL ] CRS: Derivative data saved (1820 records). [2025-09-19T22:18:22.210771] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-19T22:18:22.212963] [INFO ] [MAIN ] Derivative Progress: 452/2093 symbols completed. CRS took 1.1s. Estimated remaining: 10m 39s. Rate: 154.1 symbols/min [2025-09-19T22:18:22.221045] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:22.226803] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:22.227478] [INFO ] [MAIN ] CRM: Generated 1820 derivative records from 54550 primary records. [2025-09-19T22:18:22.227684] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-19T22:18:22.247548] [DEBUG] [LOCAL ] CRT: Loaded 4969 existing records from primary storage. [2025-09-19T22:18:22.248885] [INFO ] [MAIN ] CRT: Loaded 4969 primary data records. [2025-09-19T22:18:22.248956] [DEBUG] [LOCAL ] CRM: Derivative data saved (1820 records). [2025-09-19T22:18:22.249042] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-19T22:18:22.272805] [INFO ] [MAIN ] Derivative Progress: 453/2093 symbols completed. CRM took 1.2s. Estimated remaining: 10m 37s. Rate: 154.4 symbols/min [2025-09-19T22:18:22.308393] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:22.616462] [DEBUG] [LOCAL ] CSR: Loaded 12588 existing records from primary storage. [2025-09-19T22:18:22.616766] [INFO ] [MAIN ] CSR: Loaded 12588 primary data records. [2025-09-19T22:18:22.629405] [DEBUG] [LOCAL ] CSAN: Loaded 42602 existing records from primary storage. [2025-09-19T22:18:22.656176] [INFO ] [MAIN ] CSAN: Loaded 42602 primary data records. [2025-09-19T22:18:23.270481] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:23.273716] [INFO ] [MAIN ] CRT: Generated 1820 derivative records from 4969 primary records. [2025-09-19T22:18:23.274040] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-19T22:18:23.291631] [DEBUG] [LOCAL ] CRT: Derivative data saved (1820 records). [2025-09-19T22:18:23.292137] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-19T22:18:23.294120] [INFO ] [MAIN ] Derivative Progress: 454/2093 symbols completed. CRT took 1.1s. Estimated remaining: 10m 39s. Rate: 153.9 symbols/min [2025-09-19T22:18:23.294722] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:23.321906] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:23.327538] [INFO ] [MAIN ] CSR: Generated 1820 derivative records from 12588 primary records. [2025-09-19T22:18:23.327841] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-19T22:18:23.328072] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:23.328779] [INFO ] [MAIN ] CSAN: Generated 1820 derivative records from 42602 primary records. [2025-09-19T22:18:23.329510] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-19T22:18:23.357710] [DEBUG] [LOCAL ] CSR: Derivative data saved (1820 records). [2025-09-19T22:18:23.358407] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-19T22:18:23.361465] [INFO ] [MAIN ] Derivative Progress: 455/2093 symbols completed. CSR took 1.1s. Estimated remaining: 10m 38s. Rate: 154.1 symbols/min [2025-09-19T22:18:23.362257] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:23.376588] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1820 records). [2025-09-19T22:18:23.376792] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-19T22:18:23.379362] [INFO ] [MAIN ] Derivative Progress: 456/2093 symbols completed. CSAN took 1.2s. Estimated remaining: 10m 36s. Rate: 154.5 symbols/min [2025-09-19T22:18:23.379779] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:23.392970] [DEBUG] [LOCAL ] CSV: Loaded 13335 existing records from primary storage. [2025-09-19T22:18:23.393757] [INFO ] [MAIN ] CSV: Loaded 13335 primary data records. [2025-09-19T22:18:23.433732] [DEBUG] [LOCAL ] CTBB: Loaded 7337 existing records from primary storage. [2025-09-19T22:18:23.454559] [INFO ] [MAIN ] CTBB: Loaded 7337 primary data records. [2025-09-19T22:18:23.488236] [DEBUG] [LOCAL ] CSTM: Loaded 48510 existing records from primary storage. [2025-09-19T22:18:23.547554] [INFO ] [MAIN ] CSTM: Loaded 48510 primary data records. [2025-09-19T22:18:24.432602] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:24.433511] [INFO ] [MAIN ] CSV: Generated 1820 derivative records from 13335 primary records. [2025-09-19T22:18:24.433626] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-19T22:18:24.454794] [DEBUG] [LOCAL ] CSV: Derivative data saved (1820 records). [2025-09-19T22:18:24.481999] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:24.481607] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:24.482804] [INFO ] [MAIN ] CSTM: Generated 1820 derivative records from 48510 primary records. [2025-09-19T22:18:24.481726] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-19T22:18:24.482900] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-19T22:18:24.484902] [INFO ] [MAIN ] Derivative Progress: 457/2093 symbols completed. CSV took 1.1s. Estimated remaining: 10m 38s. Rate: 153.8 symbols/min [2025-09-19T22:18:24.485925] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:24.485805] [INFO ] [MAIN ] CTBB: Generated 1820 derivative records from 7337 primary records. [2025-09-19T22:18:24.486967] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-19T22:18:24.522841] [DEBUG] [LOCAL ] CTDD: Loaded 5937 existing records from primary storage. [2025-09-19T22:18:24.518326] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1820 records). [2025-09-19T22:18:24.523341] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-19T22:18:24.523010] [INFO ] [MAIN ] CTDD: Loaded 5937 primary data records. [2025-09-19T22:18:24.531590] [INFO ] [MAIN ] Derivative Progress: 458/2093 symbols completed. CSTM took 1.2s. Estimated remaining: 10m 36s. Rate: 154.1 symbols/min [2025-09-19T22:18:24.531953] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:24.539725] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1820 records). [2025-09-19T22:18:24.560892] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-19T22:18:24.588288] [INFO ] [MAIN ] Derivative Progress: 459/2093 symbols completed. CTBB took 1.2s. Estimated remaining: 10m 35s. Rate: 154.4 symbols/min [2025-09-19T22:18:24.608262] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:24.873305] [DEBUG] [LOCAL ] CTO: Loaded 28928 existing records from primary storage. [2025-09-19T22:18:24.873730] [INFO ] [MAIN ] CTO: Loaded 28928 primary data records. [2025-09-19T22:18:25.214768] [DEBUG] [LOCAL ] CTRA: Loaded 54429 existing records from primary storage. [2025-09-19T22:18:25.215311] [INFO ] [MAIN ] CTRA: Loaded 54429 primary data records. [2025-09-19T22:18:25.525942] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:18:25.540593] [INFO ] [MAIN ] CTDD: Generated 1819 derivative records from 5937 primary records. [2025-09-19T22:18:25.541622] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-19T22:18:25.560302] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1819 records). [2025-09-19T22:18:25.563828] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-19T22:18:25.566218] [INFO ] [MAIN ] Derivative Progress: 460/2093 symbols completed. CTDD took 1.1s. Estimated remaining: 10m 37s. Rate: 153.9 symbols/min [2025-09-19T22:18:25.567101] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:25.582610] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:25.583527] [INFO ] [MAIN ] CTO: Generated 1820 derivative records from 28928 primary records. [2025-09-19T22:18:25.583715] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-19T22:18:25.602889] [DEBUG] [LOCAL ] CTO: Derivative data saved (1820 records). [2025-09-19T22:18:25.603088] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-19T22:18:25.605548] [INFO ] [MAIN ] Derivative Progress: 461/2093 symbols completed. CTO took 1.1s. Estimated remaining: 10m 35s. Rate: 154.2 symbols/min [2025-09-19T22:18:25.606239] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:25.622904] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:25.623600] [INFO ] [MAIN ] CTRA: Generated 1820 derivative records from 54429 primary records. [2025-09-19T22:18:25.623694] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-19T22:18:25.653061] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1820 records). [2025-09-19T22:18:25.653313] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-19T22:18:25.655955] [INFO ] [MAIN ] Derivative Progress: 462/2093 symbols completed. CTRA took 1.1s. Estimated remaining: 10m 33s. Rate: 154.5 symbols/min [2025-09-19T22:18:25.656319] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:25.701424] [DEBUG] [LOCAL ] CTRI: Loaded 38053 existing records from primary storage. [2025-09-19T22:18:25.701742] [INFO ] [MAIN ] CTRI: Loaded 38053 primary data records. [2025-09-19T22:18:25.702783] [DEBUG] [LOCAL ] CTRE: Loaded 49948 existing records from primary storage. [2025-09-19T22:18:25.720551] [INFO ] [MAIN ] CTRE: Loaded 49948 primary data records. [2025-09-19T22:18:25.730805] [DEBUG] [LOCAL ] CTS: Loaded 19657 existing records from primary storage. [2025-09-19T22:18:25.757898] [INFO ] [MAIN ] CTS: Loaded 19657 primary data records. [2025-09-19T22:18:26.729988] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:26.730917] [INFO ] [MAIN ] CTRI: Generated 1820 derivative records from 38053 primary records. [2025-09-19T22:18:26.731015] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-19T22:18:26.754171] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1820 records). [2025-09-19T22:18:26.754551] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-19T22:18:26.757009] [INFO ] [MAIN ] Derivative Progress: 463/2093 symbols completed. CTRI took 1.2s. Estimated remaining: 10m 35s. Rate: 153.9 symbols/min [2025-09-19T22:18:26.782274] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:26.783247] [INFO ] [MAIN ] CTRE: Generated 1820 derivative records from 49948 primary records. [2025-09-19T22:18:26.783419] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:26.783535] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-19T22:18:26.784145] [INFO ] [MAIN ] CTS: Generated 1820 derivative records from 19657 primary records. [2025-09-19T22:18:26.784612] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-19T22:18:26.814203] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1820 records). [2025-09-19T22:18:26.814860] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-19T22:18:26.818267] [INFO ] [MAIN ] Derivative Progress: 464/2093 symbols completed. CTRE took 1.3s. Estimated remaining: 10m 34s. Rate: 154.2 symbols/min [2025-09-19T22:18:26.821583] [DEBUG] [LOCAL ] CTS: Derivative data saved (1820 records). [2025-09-19T22:18:26.821694] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-19T22:18:26.824044] [INFO ] [MAIN ] Derivative Progress: 465/2093 symbols completed. CTS took 1.2s. Estimated remaining: 10m 32s. Rate: 154.5 symbols/min [2025-09-19T22:18:26.824924] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:26.824804] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:26.824736] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:26.855356] [DEBUG] [LOCAL ] CUBI: Loaded 27721 existing records from primary storage. [2025-09-19T22:18:26.855491] [INFO ] [MAIN ] CUBI: Loaded 27721 primary data records. [2025-09-19T22:18:27.122792] [DEBUG] [LOCAL ] CUBE: Loaded 51502 existing records from primary storage. [2025-09-19T22:18:27.222020] [DEBUG] [LOCAL ] CUK: Loaded 51795 existing records from primary storage. [2025-09-19T22:18:27.212406] [INFO ] [MAIN ] CUBE: Loaded 51502 primary data records. [2025-09-19T22:18:27.222976] [INFO ] [MAIN ] CUK: Loaded 51795 primary data records. [2025-09-19T22:18:27.855206] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:27.856364] [INFO ] [MAIN ] CUBI: Generated 1820 derivative records from 27721 primary records. [2025-09-19T22:18:27.856486] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-19T22:18:27.876842] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1820 records). [2025-09-19T22:18:27.877122] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-19T22:18:27.879236] [INFO ] [MAIN ] Derivative Progress: 466/2093 symbols completed. CUBI took 1.1s. Estimated remaining: 10m 34s. Rate: 153.9 symbols/min [2025-09-19T22:18:27.880075] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:27.888668] [DEBUG] [LOCAL ] CULP: Loaded 3165 existing records from primary storage. [2025-09-19T22:18:27.889111] [INFO ] [MAIN ] CULP: Loaded 3165 primary data records. [2025-09-19T22:18:27.902584] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:27.904038] [INFO ] [MAIN ] CUBE: Generated 1820 derivative records from 51502 primary records. [2025-09-19T22:18:27.910737] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-19T22:18:28.011792] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:28.028554] [INFO ] [MAIN ] CUK: Generated 1820 derivative records from 51795 primary records. [2025-09-19T22:18:28.037305] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-19T22:18:28.103101] [DEBUG] [LOCAL ] CUK: Derivative data saved (1820 records). [2025-09-19T22:18:28.112216] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-19T22:18:28.147577] [INFO ] [MAIN ] Derivative Progress: 467/2093 symbols completed. CUK took 1.3s. Estimated remaining: 10m 33s. Rate: 154.0 symbols/min [2025-09-19T22:18:28.147750] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1820 records). [2025-09-19T22:18:28.147909] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-19T22:18:28.148119] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:28.152998] [INFO ] [MAIN ] Derivative Progress: 468/2093 symbols completed. CUBE took 1.3s. Estimated remaining: 10m 32s. Rate: 154.4 symbols/min [2025-09-19T22:18:28.273218] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:28.335717] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:28.327085] [DEBUG] [LOCAL ] CURV: Loaded 27076 existing records from primary storage. [2025-09-19T22:18:28.336603] [INFO ] [MAIN ] CURV: Loaded 27076 primary data records. [2025-09-19T22:18:28.337344] [INFO ] [MAIN ] CULP: Generated 1820 derivative records from 3165 primary records. [2025-09-19T22:18:28.337460] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-19T22:18:28.338440] [DEBUG] [LOCAL ] CURB: Loaded 33552 existing records from primary storage. [2025-09-19T22:18:28.338880] [INFO ] [MAIN ] CURB: Loaded 33552 primary data records. [2025-09-19T22:18:28.450667] [DEBUG] [LOCAL ] CULP: Derivative data saved (1820 records). [2025-09-19T22:18:28.452753] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-19T22:18:28.454788] [INFO ] [MAIN ] Derivative Progress: 469/2093 symbols completed. CULP took 0.6s. Estimated remaining: 10m 31s. Rate: 154.4 symbols/min [2025-09-19T22:18:28.466981] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:29.027712] [DEBUG] [LOCAL ] CUZ: Loaded 50074 existing records from primary storage. [2025-09-19T22:18:29.028278] [INFO ] [MAIN ] CUZ: Loaded 50074 primary data records. [2025-09-19T22:18:29.234267] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:29.349846] [INFO ] [MAIN ] CURB: Generated 1820 derivative records from 33552 primary records. [2025-09-19T22:18:29.359453] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-19T22:18:29.375513] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:29.384687] [INFO ] [MAIN ] CURV: Generated 1820 derivative records from 27076 primary records. [2025-09-19T22:18:29.389154] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-19T22:18:29.395852] [DEBUG] [LOCAL ] CURB: Derivative data saved (1820 records). [2025-09-19T22:18:29.396561] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-19T22:18:29.399183] [INFO ] [MAIN ] Derivative Progress: 470/2093 symbols completed. CURB took 1.3s. Estimated remaining: 10m 32s. Rate: 154.0 symbols/min [2025-09-19T22:18:29.399974] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:29.418323] [DEBUG] [LOCAL ] CURV: Derivative data saved (1820 records). [2025-09-19T22:18:29.418602] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-19T22:18:29.420789] [INFO ] [MAIN ] Derivative Progress: 471/2093 symbols completed. CURV took 1.3s. Estimated remaining: 10m 31s. Rate: 154.3 symbols/min [2025-09-19T22:18:29.422023] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:29.460360] [DEBUG] [LOCAL ] CVEO: Loaded 15767 existing records from primary storage. [2025-09-19T22:18:29.460921] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:29.461155] [INFO ] [MAIN ] CVEO: Loaded 15767 primary data records. [2025-09-19T22:18:29.462164] [INFO ] [MAIN ] CUZ: Generated 1820 derivative records from 50074 primary records. [2025-09-19T22:18:29.467580] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-19T22:18:29.698336] [DEBUG] [LOCAL ] CVE: Loaded 54337 existing records from primary storage. [2025-09-19T22:18:29.717337] [INFO ] [MAIN ] CVE: Loaded 54337 primary data records. [2025-09-19T22:18:29.724778] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1820 records). [2025-09-19T22:18:29.725076] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-19T22:18:29.885899] [INFO ] [MAIN ] Derivative Progress: 472/2093 symbols completed. CUZ took 1.4s. Estimated remaining: 10m 31s. Rate: 154.2 symbols/min [2025-09-19T22:18:29.931483] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:30.215106] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:30.217203] [INFO ] [MAIN ] CVEO: Generated 1820 derivative records from 15767 primary records. [2025-09-19T22:18:30.217590] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-19T22:18:30.237769] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1820 records). [2025-09-19T22:18:30.251159] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-19T22:18:30.253393] [INFO ] [MAIN ] Derivative Progress: 473/2093 symbols completed. CVEO took 0.8s. Estimated remaining: 10m 30s. Rate: 154.2 symbols/min [2025-09-19T22:18:30.255792] [DEBUG] [LOCAL ] CVI: Loaded 47141 existing records from primary storage. [2025-09-19T22:18:30.256085] [INFO ] [MAIN ] CVI: Loaded 47141 primary data records. [2025-09-19T22:18:30.255997] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:30.359270] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:30.382563] [INFO ] [MAIN ] CVE: Generated 1820 derivative records from 54337 primary records. [2025-09-19T22:18:30.382840] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-19T22:18:30.437568] [DEBUG] [LOCAL ] CVLG: Loaded 15662 existing records from primary storage. [2025-09-19T22:18:30.471777] [INFO ] [MAIN ] CVLG: Loaded 15662 primary data records. [2025-09-19T22:18:30.779354] [DEBUG] [LOCAL ] CVE: Derivative data saved (1820 records). [2025-09-19T22:18:30.814247] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-19T22:18:30.816966] [INFO ] [MAIN ] Derivative Progress: 474/2093 symbols completed. CVE took 1.4s. Estimated remaining: 10m 30s. Rate: 154.1 symbols/min [2025-09-19T22:18:30.849219] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:30.996359] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:30.997255] [INFO ] [MAIN ] CVI: Generated 1820 derivative records from 47141 primary records. [2025-09-19T22:18:30.997616] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-19T22:18:31.016238] [DEBUG] [LOCAL ] CVI: Derivative data saved (1820 records). [2025-09-19T22:18:31.017945] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-19T22:18:31.020139] [INFO ] [MAIN ] Derivative Progress: 475/2093 symbols completed. CVI took 1.1s. Estimated remaining: 10m 29s. Rate: 154.2 symbols/min [2025-09-19T22:18:31.020455] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:31.047955] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:31.048870] [INFO ] [MAIN ] CVLG: Generated 1820 derivative records from 15662 primary records. [2025-09-19T22:18:31.049021] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-19T22:18:31.082247] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1820 records). [2025-09-19T22:18:31.081792] [DEBUG] [LOCAL ] CVNA: Loaded 53831 existing records from primary storage. [2025-09-19T22:18:31.082391] [INFO ] [MAIN ] CVNA: Loaded 53831 primary data records. [2025-09-19T22:18:31.082589] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-19T22:18:31.105829] [INFO ] [MAIN ] Derivative Progress: 476/2093 symbols completed. CVLG took 0.9s. Estimated remaining: 10m 28s. Rate: 154.5 symbols/min [2025-09-19T22:18:31.165201] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:31.411274] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-09-19T22:18:31.411514] [INFO ] [MAIN ] CVX: Loaded 54540 primary data records. [2025-09-19T22:18:31.750314] [DEBUG] [LOCAL ] CWAN: Loaded 53159 existing records from primary storage. [2025-09-19T22:18:31.751252] [INFO ] [MAIN ] CWAN: Loaded 53159 primary data records. [2025-09-19T22:18:32.062855] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:32.072961] [INFO ] [MAIN ] CVNA: Generated 1820 derivative records from 53831 primary records. [2025-09-19T22:18:32.073243] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-19T22:18:32.107059] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1820 records). [2025-09-19T22:18:32.107598] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-19T22:18:32.109817] [INFO ] [MAIN ] Derivative Progress: 477/2093 symbols completed. CVNA took 1.3s. Estimated remaining: 10m 30s. Rate: 154.0 symbols/min [2025-09-19T22:18:32.107520] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:32.110976] [INFO ] [MAIN ] CVX: Generated 1820 derivative records from 54540 primary records. [2025-09-19T22:18:32.110078] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:32.111077] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-19T22:18:32.132970] [DEBUG] [LOCAL ] CVX: Derivative data saved (1820 records). [2025-09-19T22:18:32.133112] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-19T22:18:32.135490] [INFO ] [MAIN ] Derivative Progress: 478/2093 symbols completed. CVX took 1.1s. Estimated remaining: 10m 28s. Rate: 154.3 symbols/min [2025-09-19T22:18:32.151935] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:32.152948] [INFO ] [MAIN ] CWAN: Generated 1820 derivative records from 53159 primary records. [2025-09-19T22:18:32.153024] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-19T22:18:32.178470] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1820 records). [2025-09-19T22:18:32.178632] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-19T22:18:32.180834] [INFO ] [MAIN ] Derivative Progress: 479/2093 symbols completed. CWAN took 1.0s. Estimated remaining: 10m 26s. Rate: 154.6 symbols/min [2025-09-19T22:18:32.196926] [DEBUG] [LOCAL ] CWEN: Loaded 45721 existing records from primary storage. [2025-09-19T22:18:32.197039] [INFO ] [MAIN ] CWEN: Loaded 45721 primary data records. [2025-09-19T22:18:32.533307] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:32.533941] [INFO ] [MAIN ] CWEN: Generated 1820 derivative records from 45721 primary records. [2025-09-19T22:18:32.534056] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-19T22:18:32.549473] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1820 records). [2025-09-19T22:18:32.549534] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-19T22:18:32.551543] [INFO ] [MAIN ] Derivative Progress: 480/2093 symbols completed. CWEN took 0.4s. Estimated remaining: 10m 26s. Rate: 154.6 symbols/min [2025-09-19T22:18:32.552560] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:32.552305] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:32.553026] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:32.583999] [DEBUG] [LOCAL ] CWT: Loaded 28363 existing records from primary storage. [2025-09-19T22:18:32.584210] [INFO ] [MAIN ] CWT: Loaded 28363 primary data records. [2025-09-19T22:18:32.747409] [DEBUG] [LOCAL ] CWK: Loaded 50153 existing records from primary storage. [2025-09-19T22:18:32.782175] [INFO ] [MAIN ] CWK: Loaded 50153 primary data records. [2025-09-19T22:18:32.850581] [DEBUG] [LOCAL ] CWH: Loaded 52176 existing records from primary storage. [2025-09-19T22:18:32.862597] [INFO ] [MAIN ] CWH: Loaded 52176 primary data records. [2025-09-19T22:18:33.597546] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:33.598673] [INFO ] [MAIN ] CWT: Generated 1820 derivative records from 28363 primary records. [2025-09-19T22:18:33.599117] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-19T22:18:33.616781] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:33.633508] [INFO ] [MAIN ] CWK: Generated 1820 derivative records from 50153 primary records. [2025-09-19T22:18:33.642760] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-19T22:18:33.644280] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:33.646438] [INFO ] [MAIN ] CWH: Generated 1820 derivative records from 52176 primary records. [2025-09-19T22:18:33.646819] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-19T22:18:33.662843] [DEBUG] [LOCAL ] CWT: Derivative data saved (1820 records). [2025-09-19T22:18:33.671967] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-19T22:18:33.674282] [INFO ] [MAIN ] Derivative Progress: 481/2093 symbols completed. CWT took 1.1s. Estimated remaining: 10m 28s. Rate: 154.0 symbols/min [2025-09-19T22:18:33.678494] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:33.685695] [DEBUG] [LOCAL ] CWH: Derivative data saved (1820 records). [2025-09-19T22:18:33.685839] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-19T22:18:33.688984] [INFO ] [MAIN ] Derivative Progress: 482/2093 symbols completed. CWH took 1.1s. Estimated remaining: 10m 26s. Rate: 154.3 symbols/min [2025-09-19T22:18:33.689618] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:33.691970] [DEBUG] [LOCAL ] CWK: Derivative data saved (1820 records). [2025-09-19T22:18:33.692218] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-19T22:18:33.694488] [INFO ] [MAIN ] Derivative Progress: 483/2093 symbols completed. CWK took 1.1s. Estimated remaining: 10m 25s. Rate: 154.6 symbols/min [2025-09-19T22:18:33.694899] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:33.703118] [DEBUG] [LOCAL ] CXE: Loaded 7323 existing records from primary storage. [2025-09-19T22:18:33.704759] [INFO ] [MAIN ] CXE: Loaded 7323 primary data records. [2025-09-19T22:18:33.761161] [DEBUG] [LOCAL ] CXH: Loaded 4458 existing records from primary storage. [2025-09-19T22:18:33.777856] [INFO ] [MAIN ] CXH: Loaded 4458 primary data records. [2025-09-19T22:18:34.016113] [DEBUG] [LOCAL ] CX: Loaded 53611 existing records from primary storage. [2025-09-19T22:18:34.068391] [INFO ] [MAIN ] CX: Loaded 53611 primary data records. [2025-09-19T22:18:34.785206] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:34.799703] [INFO ] [MAIN ] CXH: Generated 1820 derivative records from 4458 primary records. [2025-09-19T22:18:34.798809] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:34.799918] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-19T22:18:34.801755] [INFO ] [MAIN ] CXE: Generated 1820 derivative records from 7323 primary records. [2025-09-19T22:18:34.802288] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-19T22:18:34.829294] [DEBUG] [LOCAL ] CXH: Derivative data saved (1820 records). [2025-09-19T22:18:34.829686] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-19T22:18:34.831892] [INFO ] [MAIN ] Derivative Progress: 484/2093 symbols completed. CXH took 1.1s. Estimated remaining: 10m 27s. Rate: 154.0 symbols/min [2025-09-19T22:18:34.834686] [DEBUG] [LOCAL ] CXE: Derivative data saved (1820 records). [2025-09-19T22:18:34.835002] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:34.836196] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-19T22:18:34.839822] [INFO ] [MAIN ] Derivative Progress: 485/2093 symbols completed. CXE took 1.2s. Estimated remaining: 10m 25s. Rate: 154.3 symbols/min [2025-09-19T22:18:34.841044] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:34.855165] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:34.856019] [INFO ] [MAIN ] CX: Generated 1820 derivative records from 53611 primary records. [2025-09-19T22:18:34.856133] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-19T22:18:34.872555] [DEBUG] [LOCAL ] CX: Derivative data saved (1820 records). [2025-09-19T22:18:34.872819] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-19T22:18:34.876708] [INFO ] [MAIN ] Derivative Progress: 486/2093 symbols completed. CX took 1.2s. Estimated remaining: 10m 24s. Rate: 154.6 symbols/min [2025-09-19T22:18:34.877104] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:34.931594] [DEBUG] [LOCAL ] CXT: Loaded 31548 existing records from primary storage. [2025-09-19T22:18:34.931801] [INFO ] [MAIN ] CXT: Loaded 31548 primary data records. [2025-09-19T22:18:34.932997] [DEBUG] [LOCAL ] CXM: Loaded 48705 existing records from primary storage. [2025-09-19T22:18:34.974887] [INFO ] [MAIN ] CXM: Loaded 48705 primary data records. [2025-09-19T22:18:35.274816] [DEBUG] [LOCAL ] CXW: Loaded 45182 existing records from primary storage. [2025-09-19T22:18:35.335773] [INFO ] [MAIN ] CXW: Loaded 45182 primary data records. [2025-09-19T22:18:35.932229] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:35.933278] [INFO ] [MAIN ] CXT: Generated 1820 derivative records from 31548 primary records. [2025-09-19T22:18:35.931844] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:35.933891] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-19T22:18:35.937027] [INFO ] [MAIN ] CXM: Generated 1820 derivative records from 48705 primary records. [2025-09-19T22:18:35.948963] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-19T22:18:35.969753] [DEBUG] [LOCAL ] CXT: Derivative data saved (1820 records). [2025-09-19T22:18:35.970423] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-19T22:18:35.973562] [DEBUG] [LOCAL ] CXM: Derivative data saved (1820 records). [2025-09-19T22:18:35.973463] [INFO ] [MAIN ] Derivative Progress: 487/2093 symbols completed. CXT took 1.1s. Estimated remaining: 10m 26s. Rate: 154.0 symbols/min [2025-09-19T22:18:35.974480] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:35.974000] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-19T22:18:35.977496] [INFO ] [MAIN ] Derivative Progress: 488/2093 symbols completed. CXM took 1.1s. Estimated remaining: 10m 24s. Rate: 154.3 symbols/min [2025-09-19T22:18:35.979067] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:35.996247] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:35.997007] [INFO ] [MAIN ] CXW: Generated 1820 derivative records from 45182 primary records. [2025-09-19T22:18:35.997126] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-19T22:18:36.013730] [DEBUG] [LOCAL ] CXW: Derivative data saved (1820 records). [2025-09-19T22:18:36.013959] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-19T22:18:36.016404] [INFO ] [MAIN ] Derivative Progress: 489/2093 symbols completed. CXW took 1.1s. Estimated remaining: 10m 22s. Rate: 154.6 symbols/min [2025-09-19T22:18:36.024876] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:36.037784] [DEBUG] [LOCAL ] CYD: Loaded 27385 existing records from primary storage. [2025-09-19T22:18:36.037940] [INFO ] [MAIN ] CYD: Loaded 27385 primary data records. [2025-09-19T22:18:36.248091] [DEBUG] [LOCAL ] CYH: Loaded 48687 existing records from primary storage. [2025-09-19T22:18:36.275240] [INFO ] [MAIN ] CYH: Loaded 48687 primary data records. [2025-09-19T22:18:36.467974] [DEBUG] [LOCAL ] D: Loaded 54427 existing records from primary storage. [2025-09-19T22:18:36.486374] [INFO ] [MAIN ] D: Loaded 54427 primary data records. [2025-09-19T22:18:37.121780] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:37.123343] [INFO ] [MAIN ] CYD: Generated 1820 derivative records from 27385 primary records. [2025-09-19T22:18:37.123564] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-19T22:18:37.150287] [DEBUG] [LOCAL ] CYD: Derivative data saved (1820 records). [2025-09-19T22:18:37.152108] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-19T22:18:37.154982] [INFO ] [MAIN ] Derivative Progress: 490/2093 symbols completed. CYD took 1.2s. Estimated remaining: 10m 25s. Rate: 154.0 symbols/min [2025-09-19T22:18:37.155704] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:37.169818] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:37.170868] [INFO ] [MAIN ] CYH: Generated 1820 derivative records from 48687 primary records. [2025-09-19T22:18:37.171139] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-19T22:18:37.193982] [DEBUG] [LOCAL ] CYH: Derivative data saved (1820 records). [2025-09-19T22:18:37.206811] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-19T22:18:37.207327] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:37.212100] [DEBUG] [LOCAL ] DAC: Loaded 12959 existing records from primary storage. [2025-09-19T22:18:37.216392] [INFO ] [MAIN ] Derivative Progress: 491/2093 symbols completed. CYH took 1.2s. Estimated remaining: 10m 23s. Rate: 154.3 symbols/min [2025-09-19T22:18:37.212842] [INFO ] [MAIN ] D: Generated 1820 derivative records from 54427 primary records. [2025-09-19T22:18:37.212913] [INFO ] [MAIN ] DAC: Loaded 12959 primary data records. [2025-09-19T22:18:37.216686] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:37.216843] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-19T22:18:37.370703] [DEBUG] [LOCAL ] D: Derivative data saved (1820 records). [2025-09-19T22:18:37.370874] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-19T22:18:37.378891] [INFO ] [MAIN ] Derivative Progress: 492/2093 symbols completed. D took 1.4s. Estimated remaining: 10m 22s. Rate: 154.5 symbols/min [2025-09-19T22:18:37.389508] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:37.605896] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-09-19T22:18:37.607140] [INFO ] [MAIN ] DAL: Loaded 54533 primary data records. [2025-09-19T22:18:37.851056] [DEBUG] [LOCAL ] DAN: Loaded 49741 existing records from primary storage. [2025-09-19T22:18:37.873363] [INFO ] [MAIN ] DAN: Loaded 49741 primary data records. [2025-09-19T22:18:38.209998] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:38.217483] [INFO ] [MAIN ] DAC: Generated 1820 derivative records from 12959 primary records. [2025-09-19T22:18:38.337290] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-19T22:18:38.377822] [DEBUG] [LOCAL ] DAC: Derivative data saved (1820 records). [2025-09-19T22:18:38.378217] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-19T22:18:38.378507] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:38.379273] [INFO ] [MAIN ] DAL: Generated 1820 derivative records from 54533 primary records. [2025-09-19T22:18:38.381819] [INFO ] [MAIN ] Derivative Progress: 493/2093 symbols completed. DAC took 1.2s. Estimated remaining: 10m 24s. Rate: 154.0 symbols/min [2025-09-19T22:18:38.381903] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-19T22:18:38.400138] [DEBUG] [LOCAL ] DAL: Derivative data saved (1820 records). [2025-09-19T22:18:38.400251] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-19T22:18:38.402419] [INFO ] [MAIN ] Derivative Progress: 494/2093 symbols completed. DAL took 1.2s. Estimated remaining: 10m 22s. Rate: 154.3 symbols/min [2025-09-19T22:18:38.418553] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:38.419151] [INFO ] [MAIN ] DAN: Generated 1820 derivative records from 49741 primary records. [2025-09-19T22:18:38.419212] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-19T22:18:38.434866] [DEBUG] [LOCAL ] DAN: Derivative data saved (1820 records). [2025-09-19T22:18:38.434925] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-19T22:18:38.437418] [INFO ] [MAIN ] Derivative Progress: 495/2093 symbols completed. DAN took 1.0s. Estimated remaining: 10m 20s. Rate: 154.5 symbols/min [2025-09-19T22:18:38.438288] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:38.438134] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:38.438427] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:38.465689] [DEBUG] [LOCAL ] DAO: Loaded 21932 existing records from primary storage. [2025-09-19T22:18:38.474402] [INFO ] [MAIN ] DAO: Loaded 21932 primary data records. [2025-09-19T22:18:38.628000] [DEBUG] [LOCAL ] DAVA: Loaded 41022 existing records from primary storage. [2025-09-19T22:18:38.639084] [INFO ] [MAIN ] DAVA: Loaded 41022 primary data records. [2025-09-19T22:18:38.650201] [DEBUG] [LOCAL ] DAR: Loaded 52611 existing records from primary storage. [2025-09-19T22:18:38.690273] [INFO ] [MAIN ] DAR: Loaded 52611 primary data records. [2025-09-19T22:18:39.497225] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:39.499371] [INFO ] [MAIN ] DAO: Generated 1820 derivative records from 21932 primary records. [2025-09-19T22:18:39.499583] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-19T22:18:39.534149] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:39.536236] [INFO ] [MAIN ] DAVA: Generated 1820 derivative records from 41022 primary records. [2025-09-19T22:18:39.537325] [DEBUG] [LOCAL ] DAO: Derivative data saved (1820 records). [2025-09-19T22:18:39.538295] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-19T22:18:39.538405] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-19T22:18:39.542017] [INFO ] [MAIN ] Derivative Progress: 496/2093 symbols completed. DAO took 1.1s. Estimated remaining: 10m 22s. Rate: 154.0 symbols/min [2025-09-19T22:18:39.543252] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:39.569112] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:39.571734] [INFO ] [MAIN ] DAR: Generated 1820 derivative records from 52611 primary records. [2025-09-19T22:18:39.572270] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-19T22:18:39.574976] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1820 records). [2025-09-19T22:18:39.575122] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-19T22:18:39.586040] [INFO ] [MAIN ] Derivative Progress: 497/2093 symbols completed. DAVA took 1.1s. Estimated remaining: 10m 21s. Rate: 154.2 symbols/min [2025-09-19T22:18:39.593628] [DEBUG] [LOCAL ] DAR: Derivative data saved (1820 records). [2025-09-19T22:18:39.592559] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:39.593872] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-19T22:18:39.597250] [INFO ] [MAIN ] Derivative Progress: 498/2093 symbols completed. DAR took 1.2s. Estimated remaining: 10m 19s. Rate: 154.5 symbols/min [2025-09-19T22:18:39.597728] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:39.682777] [DEBUG] [LOCAL ] DAY: Loaded 50756 existing records from primary storage. [2025-09-19T22:18:39.683117] [INFO ] [MAIN ] DAY: Loaded 50756 primary data records. [2025-09-19T22:18:39.703927] [DEBUG] [LOCAL ] DB: Loaded 53423 existing records from primary storage. [2025-09-19T22:18:39.697983] [DEBUG] [LOCAL ] DBI: Loaded 45867 existing records from primary storage. [2025-09-19T22:18:39.710369] [INFO ] [MAIN ] DBI: Loaded 45867 primary data records. [2025-09-19T22:18:39.719860] [INFO ] [MAIN ] DB: Loaded 53423 primary data records. [2025-09-19T22:18:40.713814] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:40.718246] [INFO ] [MAIN ] DAY: Generated 1820 derivative records from 50756 primary records. [2025-09-19T22:18:40.719383] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-19T22:18:40.753846] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:40.757842] [INFO ] [MAIN ] DBI: Generated 1820 derivative records from 45867 primary records. [2025-09-19T22:18:40.757944] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-19T22:18:40.756845] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:40.759062] [INFO ] [MAIN ] DB: Generated 1820 derivative records from 53423 primary records. [2025-09-19T22:18:40.760702] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-19T22:18:40.790560] [DEBUG] [LOCAL ] DBI: Derivative data saved (1820 records). [2025-09-19T22:18:40.791137] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-19T22:18:40.794850] [INFO ] [MAIN ] Derivative Progress: 499/2093 symbols completed. DBI took 1.2s. Estimated remaining: 10m 21s. Rate: 153.9 symbols/min [2025-09-19T22:18:40.795973] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:40.798246] [DEBUG] [LOCAL ] DAY: Derivative data saved (1820 records). [2025-09-19T22:18:40.798877] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-19T22:18:40.800961] [INFO ] [MAIN ] Derivative Progress: 500/2093 symbols completed. DAY took 1.3s. Estimated remaining: 10m 20s. Rate: 154.2 symbols/min [2025-09-19T22:18:40.802184] [DEBUG] [LOCAL ] DB: Derivative data saved (1820 records). [2025-09-19T22:18:40.802350] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:40.802571] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-19T22:18:40.805157] [INFO ] [MAIN ] Derivative Progress: 501/2093 symbols completed. DB took 1.2s. Estimated remaining: 10m 18s. Rate: 154.5 symbols/min [2025-09-19T22:18:40.805485] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:40.815204] [DEBUG] [LOCAL ] DBL: Loaded 9154 existing records from primary storage. [2025-09-19T22:18:40.815333] [INFO ] [MAIN ] DBL: Loaded 9154 primary data records. [2025-09-19T22:18:41.175335] [DEBUG] [LOCAL ] DCI: Loaded 38302 existing records from primary storage. [2025-09-19T22:18:41.189410] [INFO ] [MAIN ] DCI: Loaded 38302 primary data records. [2025-09-19T22:18:41.190307] [DEBUG] [LOCAL ] DBRG: Loaded 50570 existing records from primary storage. [2025-09-19T22:18:41.195563] [INFO ] [MAIN ] DBRG: Loaded 50570 primary data records. [2025-09-19T22:18:41.836563] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:41.837887] [INFO ] [MAIN ] DBL: Generated 1820 derivative records from 9154 primary records. [2025-09-19T22:18:41.838148] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-19T22:18:41.856505] [DEBUG] [LOCAL ] DBL: Derivative data saved (1820 records). [2025-09-19T22:18:41.857330] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-19T22:18:41.860203] [INFO ] [MAIN ] Derivative Progress: 502/2093 symbols completed. DBL took 1.1s. Estimated remaining: 10m 20s. Rate: 154.0 symbols/min [2025-09-19T22:18:41.860755] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:41.886024] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:41.887073] [INFO ] [MAIN ] DBRG: Generated 1820 derivative records from 50570 primary records. [2025-09-19T22:18:41.887318] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-19T22:18:41.907035] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:41.907671] [DEBUG] [LOCAL ] DCO: Loaded 13827 existing records from primary storage. [2025-09-19T22:18:41.915414] [INFO ] [MAIN ] DCO: Loaded 13827 primary data records. [2025-09-19T22:18:41.921468] [INFO ] [MAIN ] DCI: Generated 1820 derivative records from 38302 primary records. [2025-09-19T22:18:41.940801] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-19T22:18:42.043803] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1820 records). [2025-09-19T22:18:42.043719] [DEBUG] [LOCAL ] DCI: Derivative data saved (1820 records). [2025-09-19T22:18:42.054346] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-19T22:18:42.054297] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-19T22:18:42.056728] [INFO ] [MAIN ] Derivative Progress: 503/2093 symbols completed. DBRG took 1.3s. Estimated remaining: 10m 19s. Rate: 154.1 symbols/min [2025-09-19T22:18:42.088016] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:42.091773] [INFO ] [MAIN ] Derivative Progress: 504/2093 symbols completed. DCI took 1.3s. Estimated remaining: 10m 17s. Rate: 154.4 symbols/min [2025-09-19T22:18:42.106671] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:42.302277] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:42.303199] [INFO ] [MAIN ] DCO: Generated 1820 derivative records from 13827 primary records. [2025-09-19T22:18:42.303410] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-19T22:18:42.335439] [DEBUG] [LOCAL ] DCO: Derivative data saved (1820 records). [2025-09-19T22:18:42.350015] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-19T22:18:42.352444] [INFO ] [MAIN ] Derivative Progress: 505/2093 symbols completed. DCO took 0.5s. Estimated remaining: 10m 17s. Rate: 154.5 symbols/min [2025-09-19T22:18:42.352943] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:42.355511] [DEBUG] [LOCAL ] DDD: Loaded 51576 existing records from primary storage. [2025-09-19T22:18:42.356167] [INFO ] [MAIN ] DDD: Loaded 51576 primary data records. [2025-09-19T22:18:42.433291] [DEBUG] [LOCAL ] DD: Loaded 53571 existing records from primary storage. [2025-09-19T22:18:42.447621] [INFO ] [MAIN ] DD: Loaded 53571 primary data records. [2025-09-19T22:18:42.907295] [DEBUG] [LOCAL ] DDL: Loaded 36967 existing records from primary storage. [2025-09-19T22:18:42.907472] [INFO ] [MAIN ] DDL: Loaded 36967 primary data records. [2025-09-19T22:18:43.428362] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:43.430486] [INFO ] [MAIN ] DDD: Generated 1820 derivative records from 51576 primary records. [2025-09-19T22:18:43.431276] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-19T22:18:43.463069] [DEBUG] [LOCAL ] DDD: Derivative data saved (1820 records). [2025-09-19T22:18:43.460040] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:18:43.464121] [INFO ] [MAIN ] DD: Generated 1819 derivative records from 53571 primary records. [2025-09-19T22:18:43.464553] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-19T22:18:43.464333] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-19T22:18:43.466599] [INFO ] [MAIN ] Derivative Progress: 506/2093 symbols completed. DDD took 1.4s. Estimated remaining: 10m 19s. Rate: 153.9 symbols/min [2025-09-19T22:18:43.467796] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:43.486987] [DEBUG] [LOCAL ] DD: Derivative data saved (1819 records). [2025-09-19T22:18:43.487185] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-19T22:18:43.489247] [INFO ] [MAIN ] Derivative Progress: 507/2093 symbols completed. DD took 1.4s. Estimated remaining: 10m 17s. Rate: 154.2 symbols/min [2025-09-19T22:18:43.489677] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:43.503120] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:43.503876] [INFO ] [MAIN ] DDL: Generated 1820 derivative records from 36967 primary records. [2025-09-19T22:18:43.504093] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-19T22:18:43.526290] [DEBUG] [LOCAL ] DDT: Loaded 2112 existing records from primary storage. [2025-09-19T22:18:43.526614] [INFO ] [MAIN ] DDT: Loaded 2112 primary data records. [2025-09-19T22:18:43.533059] [DEBUG] [LOCAL ] DDL: Derivative data saved (1820 records). [2025-09-19T22:18:43.533560] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-19T22:18:43.547913] [INFO ] [MAIN ] Derivative Progress: 508/2093 symbols completed. DDL took 1.2s. Estimated remaining: 10m 16s. Rate: 154.5 symbols/min [2025-09-19T22:18:43.558034] [DEBUG] [LOCAL ] DDS: Loaded 13658 existing records from primary storage. [2025-09-19T22:18:43.615187] [INFO ] [MAIN ] DDS: Loaded 13658 primary data records. [2025-09-19T22:18:44.186334] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:44.188666] [INFO ] [MAIN ] DDT: Generated 1820 derivative records from 2112 primary records. [2025-09-19T22:18:44.188857] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-19T22:18:44.208381] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:44.209123] [INFO ] [MAIN ] DDS: Generated 1820 derivative records from 13658 primary records. [2025-09-19T22:18:44.213680] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-19T22:18:44.217213] [DEBUG] [LOCAL ] DDT: Derivative data saved (1820 records). [2025-09-19T22:18:44.217508] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-19T22:18:44.219621] [INFO ] [MAIN ] Derivative Progress: 509/2093 symbols completed. DDT took 0.7s. Estimated remaining: 10m 16s. Rate: 154.3 symbols/min [2025-09-19T22:18:44.234876] [DEBUG] [LOCAL ] DDS: Derivative data saved (1820 records). [2025-09-19T22:18:44.234945] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-19T22:18:44.237300] [INFO ] [MAIN ] Derivative Progress: 510/2093 symbols completed. DDS took 0.8s. Estimated remaining: 10m 15s. Rate: 154.6 symbols/min [2025-09-19T22:18:44.238013] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:44.238201] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:44.238411] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:44.315695] [DEBUG] [LOCAL ] DEC: Loaded 31645 existing records from primary storage. [2025-09-19T22:18:44.330680] [INFO ] [MAIN ] DEC: Loaded 31645 primary data records. [2025-09-19T22:18:44.329169] [DEBUG] [LOCAL ] DEA: Loaded 42365 existing records from primary storage. [2025-09-19T22:18:44.331142] [INFO ] [MAIN ] DEA: Loaded 42365 primary data records. [2025-09-19T22:18:44.336955] [DEBUG] [LOCAL ] DE: Loaded 48509 existing records from primary storage. [2025-09-19T22:18:44.378441] [INFO ] [MAIN ] DE: Loaded 48509 primary data records. [2025-09-19T22:18:45.575618] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:45.583602] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:45.585208] [INFO ] [MAIN ] DE: Generated 1820 derivative records from 48509 primary records. [2025-09-19T22:18:45.585672] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-19T22:18:45.586739] [INFO ] [MAIN ] DEC: Generated 1820 derivative records from 31645 primary records. [2025-09-19T22:18:45.586869] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-19T22:18:45.653095] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:45.654180] [DEBUG] [LOCAL ] DEC: Derivative data saved (1820 records). [2025-09-19T22:18:45.655394] [INFO ] [MAIN ] DEA: Generated 1820 derivative records from 42365 primary records. [2025-09-19T22:18:45.661038] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-19T22:18:45.654377] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-19T22:18:45.660941] [DEBUG] [LOCAL ] DE: Derivative data saved (1820 records). [2025-09-19T22:18:45.662622] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-19T22:18:45.666300] [INFO ] [MAIN ] Derivative Progress: 511/2093 symbols completed. DE took 1.4s. Estimated remaining: 10m 17s. Rate: 153.8 symbols/min [2025-09-19T22:18:45.669403] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:45.679801] [INFO ] [MAIN ] Derivative Progress: 512/2093 symbols completed. DEC took 1.4s. Estimated remaining: 10m 16s. Rate: 154.0 symbols/min [2025-09-19T22:18:45.685637] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:45.693016] [DEBUG] [LOCAL ] DEA: Derivative data saved (1820 records). [2025-09-19T22:18:45.693454] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-19T22:18:45.697037] [INFO ] [MAIN ] Derivative Progress: 513/2093 symbols completed. DEA took 1.5s. Estimated remaining: 10m 14s. Rate: 154.3 symbols/min [2025-09-19T22:18:45.697637] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:45.824980] [DEBUG] [LOCAL ] DEI: Loaded 49247 existing records from primary storage. [2025-09-19T22:18:45.825264] [INFO ] [MAIN ] DEI: Loaded 49247 primary data records. [2025-09-19T22:18:45.838965] [DEBUG] [LOCAL ] DECK: Loaded 54084 existing records from primary storage. [2025-09-19T22:18:45.858368] [INFO ] [MAIN ] DECK: Loaded 54084 primary data records. [2025-09-19T22:18:45.991268] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-09-19T22:18:46.101178] [INFO ] [MAIN ] DELL: Loaded 54515 primary data records. [2025-09-19T22:18:46.867219] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:46.868071] [INFO ] [MAIN ] DECK: Generated 1820 derivative records from 54084 primary records. [2025-09-19T22:18:46.866757] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:46.868250] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-19T22:18:46.869367] [INFO ] [MAIN ] DEI: Generated 1820 derivative records from 49247 primary records. [2025-09-19T22:18:46.870151] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-19T22:18:46.901888] [DEBUG] [LOCAL ] DEI: Derivative data saved (1820 records). [2025-09-19T22:18:46.905010] [DEBUG] [LOCAL ] DECK: Derivative data saved (1820 records). [2025-09-19T22:18:46.905917] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-19T22:18:46.906569] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-19T22:18:46.908444] [INFO ] [MAIN ] Derivative Progress: 514/2093 symbols completed. DECK took 1.2s. Estimated remaining: 10m 16s. Rate: 153.7 symbols/min [2025-09-19T22:18:46.911516] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:46.911566] [INFO ] [MAIN ] Derivative Progress: 515/2093 symbols completed. DEI took 1.2s. Estimated remaining: 10m 15s. Rate: 154.0 symbols/min [2025-09-19T22:18:46.912396] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:46.926027] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:46.926833] [INFO ] [MAIN ] DELL: Generated 1820 derivative records from 54515 primary records. [2025-09-19T22:18:46.926935] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-19T22:18:46.943350] [DEBUG] [LOCAL ] DELL: Derivative data saved (1820 records). [2025-09-19T22:18:46.943473] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-19T22:18:46.945910] [INFO ] [MAIN ] Derivative Progress: 516/2093 symbols completed. DELL took 1.2s. Estimated remaining: 10m 13s. Rate: 154.3 symbols/min [2025-09-19T22:18:46.946217] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:46.968042] [DEBUG] [LOCAL ] DFIN: Loaded 23906 existing records from primary storage. [2025-09-19T22:18:46.976741] [INFO ] [MAIN ] DFIN: Loaded 23906 primary data records. [2025-09-19T22:18:47.008766] [DEBUG] [LOCAL ] DFP: Loaded 11926 existing records from primary storage. [2025-09-19T22:18:47.032354] [INFO ] [MAIN ] DFP: Loaded 11926 primary data records. [2025-09-19T22:18:47.127025] [DEBUG] [LOCAL ] DFH: Loaded 33560 existing records from primary storage. [2025-09-19T22:18:47.181379] [INFO ] [MAIN ] DFH: Loaded 33560 primary data records. [2025-09-19T22:18:47.997001] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:47.996428] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:47.998118] [INFO ] [MAIN ] DFIN: Generated 1820 derivative records from 23906 primary records. [2025-09-19T22:18:47.999062] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-19T22:18:47.999991] [INFO ] [MAIN ] DFP: Generated 1820 derivative records from 11926 primary records. [2025-09-19T22:18:48.001460] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-19T22:18:48.047823] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1820 records). [2025-09-19T22:18:48.048136] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:48.043329] [DEBUG] [LOCAL ] DFP: Derivative data saved (1820 records). [2025-09-19T22:18:48.049075] [INFO ] [MAIN ] DFH: Generated 1820 derivative records from 33560 primary records. [2025-09-19T22:18:48.049199] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-19T22:18:48.051851] [INFO ] [MAIN ] Derivative Progress: 517/2093 symbols completed. DFP took 1.1s. Estimated remaining: 10m 15s. Rate: 153.7 symbols/min [2025-09-19T22:18:48.049283] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-19T22:18:48.052413] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:48.052031] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-19T22:18:48.055967] [INFO ] [MAIN ] Derivative Progress: 518/2093 symbols completed. DFIN took 1.1s. Estimated remaining: 10m 14s. Rate: 154.0 symbols/min [2025-09-19T22:18:48.056453] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:48.072837] [DEBUG] [LOCAL ] DFH: Derivative data saved (1820 records). [2025-09-19T22:18:48.073019] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-19T22:18:48.075912] [INFO ] [MAIN ] Derivative Progress: 519/2093 symbols completed. DFH took 1.2s. Estimated remaining: 10m 12s. Rate: 154.3 symbols/min [2025-09-19T22:18:48.076361] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:48.149605] [DEBUG] [LOCAL ] DGX: Loaded 46056 existing records from primary storage. [2025-09-19T22:18:48.149850] [INFO ] [MAIN ] DGX: Loaded 46056 primary data records. [2025-09-19T22:18:48.256576] [DEBUG] [LOCAL ] DG: Loaded 54085 existing records from primary storage. [2025-09-19T22:18:48.278763] [INFO ] [MAIN ] DG: Loaded 54085 primary data records. [2025-09-19T22:18:48.304306] [DEBUG] [LOCAL ] DHR: Loaded 54147 existing records from primary storage. [2025-09-19T22:18:48.332765] [INFO ] [MAIN ] DHR: Loaded 54147 primary data records. [2025-09-19T22:18:49.183666] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:49.185329] [INFO ] [MAIN ] DGX: Generated 1820 derivative records from 46056 primary records. [2025-09-19T22:18:49.186161] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-19T22:18:49.216501] [DEBUG] [LOCAL ] DGX: Derivative data saved (1820 records). [2025-09-19T22:18:49.218191] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-19T22:18:49.217492] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:49.220104] [INFO ] [MAIN ] Derivative Progress: 520/2093 symbols completed. DGX took 1.2s. Estimated remaining: 10m 14s. Rate: 153.7 symbols/min [2025-09-19T22:18:49.221070] [INFO ] [MAIN ] DG: Generated 1820 derivative records from 54085 primary records. [2025-09-19T22:18:49.221368] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-19T22:18:49.221329] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:49.242288] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:49.244196] [INFO ] [MAIN ] DHR: Generated 1820 derivative records from 54147 primary records. [2025-09-19T22:18:49.250733] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-19T22:18:49.252863] [DEBUG] [LOCAL ] DG: Derivative data saved (1820 records). [2025-09-19T22:18:49.253195] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-19T22:18:49.263155] [INFO ] [MAIN ] Derivative Progress: 521/2093 symbols completed. DG took 1.2s. Estimated remaining: 10m 13s. Rate: 154.0 symbols/min [2025-09-19T22:18:49.267100] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:49.271604] [DEBUG] [LOCAL ] DHR: Derivative data saved (1820 records). [2025-09-19T22:18:49.272068] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-19T22:18:49.274605] [INFO ] [MAIN ] Derivative Progress: 522/2093 symbols completed. DHR took 1.2s. Estimated remaining: 10m 11s. Rate: 154.3 symbols/min [2025-09-19T22:18:49.274934] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:49.315017] [DEBUG] [LOCAL ] DIN: Loaded 38019 existing records from primary storage. [2025-09-19T22:18:49.315251] [INFO ] [MAIN ] DIN: Loaded 38019 primary data records. [2025-09-19T22:18:49.486879] [DEBUG] [LOCAL ] DINO: Loaded 53743 existing records from primary storage. [2025-09-19T22:18:49.540158] [INFO ] [MAIN ] DINO: Loaded 53743 primary data records. [2025-09-19T22:18:49.732298] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-09-19T22:18:49.747126] [INFO ] [MAIN ] DIS: Loaded 54568 primary data records. [2025-09-19T22:18:50.321046] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:50.321891] [INFO ] [MAIN ] DIN: Generated 1820 derivative records from 38019 primary records. [2025-09-19T22:18:50.322342] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-19T22:18:50.339555] [DEBUG] [LOCAL ] DIN: Derivative data saved (1820 records). [2025-09-19T22:18:50.339765] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-19T22:18:50.341802] [INFO ] [MAIN ] Derivative Progress: 523/2093 symbols completed. DIN took 1.1s. Estimated remaining: 10m 13s. Rate: 153.8 symbols/min [2025-09-19T22:18:50.359138] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:50.360040] [INFO ] [MAIN ] DINO: Generated 1820 derivative records from 53743 primary records. [2025-09-19T22:18:50.360142] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-19T22:18:50.392542] [DEBUG] [LOCAL ] DINO: Derivative data saved (1820 records). [2025-09-19T22:18:50.392943] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-19T22:18:50.392813] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:50.396186] [INFO ] [MAIN ] Derivative Progress: 524/2093 symbols completed. DINO took 1.1s. Estimated remaining: 10m 11s. Rate: 154.0 symbols/min [2025-09-19T22:18:50.396345] [INFO ] [MAIN ] DIS: Generated 1820 derivative records from 54568 primary records. [2025-09-19T22:18:50.396745] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-19T22:18:50.413433] [DEBUG] [LOCAL ] DIS: Derivative data saved (1820 records). [2025-09-19T22:18:50.413507] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-19T22:18:50.416175] [INFO ] [MAIN ] Derivative Progress: 525/2093 symbols completed. DIS took 1.1s. Estimated remaining: 10m 10s. Rate: 154.3 symbols/min [2025-09-19T22:18:50.416971] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:50.417157] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:50.417081] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:50.442562] [DEBUG] [LOCAL ] DKL: Loaded 19705 existing records from primary storage. [2025-09-19T22:18:50.442776] [INFO ] [MAIN ] DKL: Loaded 19705 primary data records. [2025-09-19T22:18:50.679203] [DEBUG] [LOCAL ] DK: Loaded 50194 existing records from primary storage. [2025-09-19T22:18:50.672067] [DEBUG] [LOCAL ] DKS: Loaded 50730 existing records from primary storage. [2025-09-19T22:18:50.679523] [INFO ] [MAIN ] DK: Loaded 50194 primary data records. [2025-09-19T22:18:50.679710] [INFO ] [MAIN ] DKS: Loaded 50730 primary data records. [2025-09-19T22:18:51.529203] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:51.530732] [INFO ] [MAIN ] DKL: Generated 1820 derivative records from 19705 primary records. [2025-09-19T22:18:51.530985] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-19T22:18:51.549314] [DEBUG] [LOCAL ] DKL: Derivative data saved (1820 records). [2025-09-19T22:18:51.549501] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-19T22:18:51.553354] [INFO ] [MAIN ] Derivative Progress: 526/2093 symbols completed. DKL took 1.1s. Estimated remaining: 10m 12s. Rate: 153.7 symbols/min [2025-09-19T22:18:51.554118] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:51.574000] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:51.586895] [INFO ] [MAIN ] DKS: Generated 1820 derivative records from 50730 primary records. [2025-09-19T22:18:51.587241] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-19T22:18:51.587493] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:51.588478] [INFO ] [MAIN ] DK: Generated 1820 derivative records from 50194 primary records. [2025-09-19T22:18:51.589143] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-19T22:18:51.617277] [DEBUG] [LOCAL ] DKS: Derivative data saved (1820 records). [2025-09-19T22:18:51.618005] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-19T22:18:51.626490] [INFO ] [MAIN ] Derivative Progress: 527/2093 symbols completed. DKS took 1.2s. Estimated remaining: 10m 10s. Rate: 154.0 symbols/min [2025-09-19T22:18:51.628692] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:51.628352] [DEBUG] [LOCAL ] DK: Derivative data saved (1820 records). [2025-09-19T22:18:51.628831] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-19T22:18:51.633145] [INFO ] [MAIN ] Derivative Progress: 528/2093 symbols completed. DK took 1.2s. Estimated remaining: 10m 9s. Rate: 154.2 symbols/min [2025-09-19T22:18:51.633814] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:51.661627] [DEBUG] [LOCAL ] DLNG: Loaded 6395 existing records from primary storage. [2025-09-19T22:18:51.658024] [DEBUG] [LOCAL ] DLB: Loaded 32772 existing records from primary storage. [2025-09-19T22:18:51.662024] [INFO ] [MAIN ] DLNG: Loaded 6395 primary data records. [2025-09-19T22:18:51.662134] [INFO ] [MAIN ] DLB: Loaded 32772 primary data records. [2025-09-19T22:18:52.207189] [DEBUG] [LOCAL ] DLR: Loaded 51987 existing records from primary storage. [2025-09-19T22:18:52.207424] [INFO ] [MAIN ] DLR: Loaded 51987 primary data records. [2025-09-19T22:18:52.685167] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:52.686100] [INFO ] [MAIN ] DLNG: Generated 1820 derivative records from 6395 primary records. [2025-09-19T22:18:52.686696] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-19T22:18:52.718898] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:52.718218] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1820 records). [2025-09-19T22:18:52.719101] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-19T22:18:52.719843] [INFO ] [MAIN ] DLB: Generated 1820 derivative records from 32772 primary records. [2025-09-19T22:18:52.722421] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-19T22:18:52.722162] [INFO ] [MAIN ] Derivative Progress: 529/2093 symbols completed. DLNG took 1.1s. Estimated remaining: 10m 10s. Rate: 153.7 symbols/min [2025-09-19T22:18:52.722842] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:52.741336] [DEBUG] [LOCAL ] DLB: Derivative data saved (1820 records). [2025-09-19T22:18:52.741580] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-19T22:18:52.744027] [INFO ] [MAIN ] Derivative Progress: 530/2093 symbols completed. DLB took 1.2s. Estimated remaining: 10m 9s. Rate: 154.0 symbols/min [2025-09-19T22:18:52.744603] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:52.762338] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:52.763230] [INFO ] [MAIN ] DLR: Generated 1820 derivative records from 51987 primary records. [2025-09-19T22:18:52.763393] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-19T22:18:52.797448] [DEBUG] [LOCAL ] DLR: Derivative data saved (1820 records). [2025-09-19T22:18:52.797598] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-19T22:18:52.807951] [DEBUG] [LOCAL ] DLY: Loaded 19696 existing records from primary storage. [2025-09-19T22:18:52.808139] [INFO ] [MAIN ] DLY: Loaded 19696 primary data records. [2025-09-19T22:18:52.811146] [INFO ] [MAIN ] Derivative Progress: 531/2093 symbols completed. DLR took 1.2s. Estimated remaining: 10m 8s. Rate: 154.2 symbols/min [2025-09-19T22:18:52.811837] [DEBUG] [LOCAL ] DLX: Loaded 29746 existing records from primary storage. [2025-09-19T22:18:52.812043] [INFO ] [MAIN ] DLX: Loaded 29746 primary data records. [2025-09-19T22:18:52.812318] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:53.038083] [DEBUG] [LOCAL ] DMA: Loaded 4603 existing records from primary storage. [2025-09-19T22:18:53.085157] [INFO ] [MAIN ] DMA: Loaded 4603 primary data records. [2025-09-19T22:18:53.871866] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:53.876110] [INFO ] [MAIN ] DLX: Generated 1820 derivative records from 29746 primary records. [2025-09-19T22:18:53.876313] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-19T22:18:53.907913] [DEBUG] [LOCAL ] DLX: Derivative data saved (1820 records). [2025-09-19T22:18:53.903627] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:53.908809] [INFO ] [MAIN ] DLY: Generated 1820 derivative records from 19696 primary records. [2025-09-19T22:18:53.909206] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-19T22:18:53.909341] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-19T22:18:53.911872] [INFO ] [MAIN ] Derivative Progress: 532/2093 symbols completed. DLX took 1.2s. Estimated remaining: 10m 9s. Rate: 153.7 symbols/min [2025-09-19T22:18:53.913279] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:53.932913] [DEBUG] [LOCAL ] DLY: Derivative data saved (1820 records). [2025-09-19T22:18:53.933176] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-19T22:18:53.935319] [INFO ] [MAIN ] Derivative Progress: 533/2093 symbols completed. DLY took 1.2s. Estimated remaining: 10m 8s. Rate: 154.0 symbols/min [2025-09-19T22:18:53.938499] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:53.945961] [DEBUG] [LOCAL ] DMB: Loaded 10260 existing records from primary storage. [2025-09-19T22:18:53.947029] [INFO ] [MAIN ] DMB: Loaded 10260 primary data records. [2025-09-19T22:18:54.006078] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:54.029270] [INFO ] [MAIN ] DMA: Generated 1820 derivative records from 4603 primary records. [2025-09-19T22:18:54.042075] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-19T22:18:54.102378] [DEBUG] [LOCAL ] DMA: Derivative data saved (1820 records). [2025-09-19T22:18:54.127696] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-19T22:18:54.139489] [INFO ] [MAIN ] Derivative Progress: 534/2093 symbols completed. DMA took 1.3s. Estimated remaining: 10m 7s. Rate: 154.1 symbols/min [2025-09-19T22:18:54.167857] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:54.327461] [DEBUG] [LOCAL ] DNA: Loaded 49205 existing records from primary storage. [2025-09-19T22:18:54.327833] [INFO ] [MAIN ] DNA: Loaded 49205 primary data records. [2025-09-19T22:18:54.550210] [DEBUG] [LOCAL ] DNOW: Loaded 44148 existing records from primary storage. [2025-09-19T22:18:54.561719] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:54.562682] [INFO ] [MAIN ] DNOW: Loaded 44148 primary data records. [2025-09-19T22:18:54.562772] [INFO ] [MAIN ] DMB: Generated 1820 derivative records from 10260 primary records. [2025-09-19T22:18:54.563045] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-19T22:18:54.780853] [DEBUG] [LOCAL ] DMB: Derivative data saved (1820 records). [2025-09-19T22:18:54.804039] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-19T22:18:54.806854] [INFO ] [MAIN ] Derivative Progress: 535/2093 symbols completed. DMB took 0.9s. Estimated remaining: 10m 7s. Rate: 153.9 symbols/min [2025-09-19T22:18:54.807915] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:55.036422] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:55.037636] [INFO ] [MAIN ] DNA: Generated 1820 derivative records from 49205 primary records. [2025-09-19T22:18:55.037794] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-19T22:18:55.056923] [DEBUG] [LOCAL ] DNA: Derivative data saved (1820 records). [2025-09-19T22:18:55.057315] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-19T22:18:55.068549] [INFO ] [MAIN ] Derivative Progress: 536/2093 symbols completed. DNA took 1.1s. Estimated remaining: 10m 7s. Rate: 154.0 symbols/min [2025-09-19T22:18:55.070321] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:55.071075] [DEBUG] [LOCAL ] DNP: Loaded 33926 existing records from primary storage. [2025-09-19T22:18:55.071683] [INFO ] [MAIN ] DNP: Loaded 33926 primary data records. [2025-09-19T22:18:55.281782] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:55.442432] [INFO ] [MAIN ] DNOW: Generated 1820 derivative records from 44148 primary records. [2025-09-19T22:18:55.465929] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-19T22:18:55.486241] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1820 records). [2025-09-19T22:18:55.487454] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-19T22:18:55.490118] [INFO ] [MAIN ] Derivative Progress: 537/2093 symbols completed. DNOW took 1.3s. Estimated remaining: 10m 6s. Rate: 154.0 symbols/min [2025-09-19T22:18:55.490717] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:55.507241] [DEBUG] [LOCAL ] DOC: Loaded 54313 existing records from primary storage. [2025-09-19T22:18:55.507557] [INFO ] [MAIN ] DOC: Loaded 54313 primary data records. [2025-09-19T22:18:55.868171] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:55.870407] [INFO ] [MAIN ] DNP: Generated 1820 derivative records from 33926 primary records. [2025-09-19T22:18:55.870628] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-19T22:18:55.872365] [DEBUG] [LOCAL ] DOCN: Loaded 51180 existing records from primary storage. [2025-09-19T22:18:55.880517] [INFO ] [MAIN ] DOCN: Loaded 51180 primary data records. [2025-09-19T22:18:55.948202] [DEBUG] [LOCAL ] DNP: Derivative data saved (1820 records). [2025-09-19T22:18:55.975374] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-19T22:18:55.983788] [INFO ] [MAIN ] Derivative Progress: 538/2093 symbols completed. DNP took 1.2s. Estimated remaining: 10m 6s. Rate: 153.9 symbols/min [2025-09-19T22:18:56.224463] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:56.225715] [INFO ] [MAIN ] DOC: Generated 1820 derivative records from 54313 primary records. [2025-09-19T22:18:56.226130] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-19T22:18:56.244627] [DEBUG] [LOCAL ] DOC: Derivative data saved (1820 records). [2025-09-19T22:18:56.244955] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-19T22:18:56.247134] [INFO ] [MAIN ] Derivative Progress: 539/2093 symbols completed. DOC took 1.2s. Estimated remaining: 10m 5s. Rate: 154.0 symbols/min [2025-09-19T22:18:56.262916] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:56.263519] [INFO ] [MAIN ] DOCN: Generated 1820 derivative records from 51180 primary records. [2025-09-19T22:18:56.263593] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-19T22:18:56.279070] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1820 records). [2025-09-19T22:18:56.279129] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-19T22:18:56.281634] [INFO ] [MAIN ] Derivative Progress: 540/2093 symbols completed. DOCN took 0.8s. Estimated remaining: 10m 4s. Rate: 154.3 symbols/min [2025-09-19T22:18:56.282555] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:56.282480] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:56.282266] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:56.350836] [DEBUG] [LOCAL ] DOUG: Loaded 35374 existing records from primary storage. [2025-09-19T22:18:56.363562] [INFO ] [MAIN ] DOUG: Loaded 35374 primary data records. [2025-09-19T22:18:56.517529] [DEBUG] [LOCAL ] DOV: Loaded 46479 existing records from primary storage. [2025-09-19T22:18:56.574533] [INFO ] [MAIN ] DOV: Loaded 46479 primary data records. [2025-09-19T22:18:56.575794] [DEBUG] [LOCAL ] DOCS: Loaded 52104 existing records from primary storage. [2025-09-19T22:18:56.576041] [INFO ] [MAIN ] DOCS: Loaded 52104 primary data records. [2025-09-19T22:18:57.406482] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:57.408313] [INFO ] [MAIN ] DOUG: Generated 1820 derivative records from 35374 primary records. [2025-09-19T22:18:57.408617] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-19T22:18:57.427352] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1820 records). [2025-09-19T22:18:57.427673] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-19T22:18:57.429525] [INFO ] [MAIN ] Derivative Progress: 541/2093 symbols completed. DOUG took 1.1s. Estimated remaining: 10m 6s. Rate: 153.7 symbols/min [2025-09-19T22:18:57.437782] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:57.443465] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:57.444181] [INFO ] [MAIN ] DOV: Generated 1820 derivative records from 46479 primary records. [2025-09-19T22:18:57.444478] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-19T22:18:57.478888] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:57.479665] [DEBUG] [LOCAL ] DOV: Derivative data saved (1820 records). [2025-09-19T22:18:57.480530] [INFO ] [MAIN ] DOCS: Generated 1820 derivative records from 52104 primary records. [2025-09-19T22:18:57.480967] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-19T22:18:57.481062] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-19T22:18:57.484360] [INFO ] [MAIN ] Derivative Progress: 542/2093 symbols completed. DOV took 1.2s. Estimated remaining: 10m 4s. Rate: 154.0 symbols/min [2025-09-19T22:18:57.493768] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:57.502924] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1820 records). [2025-09-19T22:18:57.503182] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-19T22:18:57.505943] [INFO ] [MAIN ] Derivative Progress: 543/2093 symbols completed. DOCS took 1.2s. Estimated remaining: 10m 3s. Rate: 154.2 symbols/min [2025-09-19T22:18:57.506273] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:57.551600] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-09-19T22:18:57.551836] [INFO ] [MAIN ] DOW: Loaded 54513 primary data records. [2025-09-19T22:18:57.779496] [DEBUG] [LOCAL ] DQ: Loaded 43775 existing records from primary storage. [2025-09-19T22:18:57.845692] [INFO ] [MAIN ] DQ: Loaded 43775 primary data records. [2025-09-19T22:18:57.952173] [DEBUG] [LOCAL ] DRD: Loaded 37026 existing records from primary storage. [2025-09-19T22:18:57.980997] [INFO ] [MAIN ] DRD: Loaded 37026 primary data records. [2025-09-19T22:18:58.561909] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:58.563167] [INFO ] [MAIN ] DOW: Generated 1820 derivative records from 54513 primary records. [2025-09-19T22:18:58.563529] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-19T22:18:58.583071] [DEBUG] [LOCAL ] DOW: Derivative data saved (1820 records). [2025-09-19T22:18:58.584503] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-19T22:18:58.586609] [INFO ] [MAIN ] Derivative Progress: 544/2093 symbols completed. DOW took 1.2s. Estimated remaining: 10m 5s. Rate: 153.7 symbols/min [2025-09-19T22:18:58.588699] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:58.603617] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:58.604719] [INFO ] [MAIN ] DQ: Generated 1820 derivative records from 43775 primary records. [2025-09-19T22:18:58.605755] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-19T22:18:58.635826] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:58.637346] [INFO ] [MAIN ] DRD: Generated 1820 derivative records from 37026 primary records. [2025-09-19T22:18:58.639493] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-19T22:18:58.654681] [DEBUG] [LOCAL ] DQ: Derivative data saved (1820 records). [2025-09-19T22:18:58.655802] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-19T22:18:58.661206] [INFO ] [MAIN ] Derivative Progress: 545/2093 symbols completed. DQ took 1.2s. Estimated remaining: 10m 3s. Rate: 153.9 symbols/min [2025-09-19T22:18:58.661634] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:58.657979] [DEBUG] [LOCAL ] DRD: Derivative data saved (1820 records). [2025-09-19T22:18:58.661795] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-19T22:18:58.664856] [INFO ] [MAIN ] Derivative Progress: 546/2093 symbols completed. DRD took 1.2s. Estimated remaining: 10m 2s. Rate: 154.2 symbols/min [2025-09-19T22:18:58.665191] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:58.689320] [DEBUG] [LOCAL ] DRLL: Loaded 10151 existing records from primary storage. [2025-09-19T22:18:58.689510] [INFO ] [MAIN ] DRLL: Loaded 10151 primary data records. [2025-09-19T22:18:58.808772] [DEBUG] [LOCAL ] DRH: Loaded 51192 existing records from primary storage. [2025-09-19T22:18:58.820163] [INFO ] [MAIN ] DRH: Loaded 51192 primary data records. [2025-09-19T22:18:59.197055] [DEBUG] [LOCAL ] DRI: Loaded 48576 existing records from primary storage. [2025-09-19T22:18:59.208827] [INFO ] [MAIN ] DRI: Loaded 48576 primary data records. [2025-09-19T22:18:59.732773] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:59.733860] [INFO ] [MAIN ] DRLL: Generated 1820 derivative records from 10151 primary records. [2025-09-19T22:18:59.734965] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-19T22:18:59.766111] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:59.767946] [INFO ] [MAIN ] DRH: Generated 1820 derivative records from 51192 primary records. [2025-09-19T22:18:59.768749] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1820 records). [2025-09-19T22:18:59.768052] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-19T22:18:59.769594] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-19T22:18:59.771961] [INFO ] [MAIN ] Derivative Progress: 547/2093 symbols completed. DRLL took 1.1s. Estimated remaining: 10m 3s. Rate: 153.7 symbols/min [2025-09-19T22:18:59.772198] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:59.788047] [DEBUG] [LOCAL ] DRH: Derivative data saved (1820 records). [2025-09-19T22:18:59.788254] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-19T22:18:59.791120] [INFO ] [MAIN ] Derivative Progress: 548/2093 symbols completed. DRH took 1.2s. Estimated remaining: 10m 2s. Rate: 154.0 symbols/min [2025-09-19T22:18:59.791767] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:18:59.821774] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:18:59.823746] [INFO ] [MAIN ] DRI: Generated 1820 derivative records from 48576 primary records. [2025-09-19T22:18:59.823865] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-19T22:18:59.843348] [DEBUG] [LOCAL ] DSM: Loaded 16018 existing records from primary storage. [2025-09-19T22:18:59.843482] [INFO ] [MAIN ] DSM: Loaded 16018 primary data records. [2025-09-19T22:18:59.945406] [DEBUG] [LOCAL ] DSL: Loaded 28666 existing records from primary storage. [2025-09-19T22:18:59.952015] [DEBUG] [LOCAL ] DRI: Derivative data saved (1820 records). [2025-09-19T22:18:59.959401] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-19T22:18:59.959322] [INFO ] [MAIN ] DSL: Loaded 28666 primary data records. [2025-09-19T22:18:59.983301] [INFO ] [MAIN ] Derivative Progress: 549/2093 symbols completed. DRI took 1.3s. Estimated remaining: 10m 1s. Rate: 154.1 symbols/min [2025-09-19T22:19:00.007907] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:00.148870] [DEBUG] [LOCAL ] DSMC: Loaded 2049 existing records from primary storage. [2025-09-19T22:19:00.329343] [INFO ] [MAIN ] DSMC: Loaded 2049 primary data records. [2025-09-19T22:19:00.815963] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:00.817460] [INFO ] [MAIN ] DSM: Generated 1820 derivative records from 16018 primary records. [2025-09-19T22:19:00.817742] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-19T22:19:00.835742] [DEBUG] [LOCAL ] DSM: Derivative data saved (1820 records). [2025-09-19T22:19:00.837669] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-19T22:19:00.840038] [INFO ] [MAIN ] Derivative Progress: 550/2093 symbols completed. DSM took 1.0s. Estimated remaining: 10m 2s. Rate: 153.8 symbols/min [2025-09-19T22:19:00.840638] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:00.856199] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:00.857203] [INFO ] [MAIN ] DSL: Generated 1820 derivative records from 28666 primary records. [2025-09-19T22:19:00.857507] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-19T22:19:00.875600] [DEBUG] [LOCAL ] DSL: Derivative data saved (1820 records). [2025-09-19T22:19:00.876874] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-19T22:19:00.879723] [INFO ] [MAIN ] Derivative Progress: 551/2093 symbols completed. DSL took 1.1s. Estimated remaining: 10m 1s. Rate: 154.0 symbols/min [2025-09-19T22:19:00.881880] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:00.902339] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:19:00.903168] [INFO ] [MAIN ] DSMC: Generated 1819 derivative records from 2049 primary records. [2025-09-19T22:19:00.903371] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-19T22:19:00.922161] [DEBUG] [LOCAL ] DSU: Loaded 22088 existing records from primary storage. [2025-09-19T22:19:00.925844] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1819 records). [2025-09-19T22:19:00.925977] [INFO ] [MAIN ] DSU: Loaded 22088 primary data records. [2025-09-19T22:19:00.926161] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-19T22:19:00.929137] [INFO ] [MAIN ] Derivative Progress: 552/2093 symbols completed. DSMC took 0.9s. Estimated remaining: 9m 59s. Rate: 154.3 symbols/min [2025-09-19T22:19:00.975869] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:01.056746] [DEBUG] [LOCAL ] DSX: Loaded 25050 existing records from primary storage. [2025-09-19T22:19:01.057184] [INFO ] [MAIN ] DSX: Loaded 25050 primary data records. [2025-09-19T22:19:01.667450] [DEBUG] [LOCAL ] DT: Loaded 53726 existing records from primary storage. [2025-09-19T22:19:01.667968] [INFO ] [MAIN ] DT: Loaded 53726 primary data records. [2025-09-19T22:19:02.006202] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:02.007916] [INFO ] [MAIN ] DSU: Generated 1820 derivative records from 22088 primary records. [2025-09-19T22:19:02.008080] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-19T22:19:02.027994] [DEBUG] [LOCAL ] DSU: Derivative data saved (1820 records). [2025-09-19T22:19:02.028514] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-19T22:19:02.043205] [INFO ] [MAIN ] Derivative Progress: 553/2093 symbols completed. DSU took 1.2s. Estimated remaining: 10m 1s. Rate: 153.8 symbols/min [2025-09-19T22:19:02.043617] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:02.044794] [INFO ] [MAIN ] DSX: Generated 1820 derivative records from 25050 primary records. [2025-09-19T22:19:02.044903] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-19T22:19:02.063965] [DEBUG] [LOCAL ] DSX: Derivative data saved (1820 records). [2025-09-19T22:19:02.076500] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-19T22:19:02.076436] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:02.079998] [INFO ] [MAIN ] Derivative Progress: 554/2093 symbols completed. DSX took 1.2s. Estimated remaining: 9m 60s. Rate: 154.0 symbols/min [2025-09-19T22:19:02.077199] [INFO ] [MAIN ] DT: Generated 1820 derivative records from 53726 primary records. [2025-09-19T22:19:02.080220] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-19T22:19:02.095543] [DEBUG] [LOCAL ] DT: Derivative data saved (1820 records). [2025-09-19T22:19:02.095606] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-19T22:19:02.098138] [INFO ] [MAIN ] Derivative Progress: 555/2093 symbols completed. DT took 1.2s. Estimated remaining: 9m 58s. Rate: 154.3 symbols/min [2025-09-19T22:19:02.098945] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:02.098884] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:02.099078] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:02.110249] [DEBUG] [LOCAL ] DTB: Loaded 4777 existing records from primary storage. [2025-09-19T22:19:02.113270] [DEBUG] [LOCAL ] DTG: Loaded 5979 existing records from primary storage. [2025-09-19T22:19:02.113556] [INFO ] [MAIN ] DTB: Loaded 4777 primary data records. [2025-09-19T22:19:02.113472] [INFO ] [MAIN ] DTG: Loaded 5979 primary data records. [2025-09-19T22:19:02.748123] [DEBUG] [LOCAL ] DTE: Loaded 48671 existing records from primary storage. [2025-09-19T22:19:02.748427] [INFO ] [MAIN ] DTE: Loaded 48671 primary data records. [2025-09-19T22:19:03.101122] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:03.101574] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:03.103292] [INFO ] [MAIN ] DTG: Generated 1820 derivative records from 5979 primary records. [2025-09-19T22:19:03.102711] [INFO ] [MAIN ] DTB: Generated 1820 derivative records from 4777 primary records. [2025-09-19T22:19:03.103423] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-19T22:19:03.103500] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-19T22:19:03.130706] [DEBUG] [LOCAL ] DTG: Derivative data saved (1820 records). [2025-09-19T22:19:03.134296] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-19T22:19:03.134939] [DEBUG] [LOCAL ] DTB: Derivative data saved (1820 records). [2025-09-19T22:19:03.135171] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-19T22:19:03.137520] [INFO ] [MAIN ] Derivative Progress: 556/2093 symbols completed. DTG took 1.0s. Estimated remaining: 9m 60s. Rate: 153.8 symbols/min [2025-09-19T22:19:03.140728] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:03.141172] [INFO ] [MAIN ] Derivative Progress: 557/2093 symbols completed. DTB took 1.0s. Estimated remaining: 9m 58s. Rate: 154.1 symbols/min [2025-09-19T22:19:03.141515] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:03.164360] [DEBUG] [LOCAL ] DTW: Loaded 4977 existing records from primary storage. [2025-09-19T22:19:03.164157] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:03.164595] [INFO ] [MAIN ] DTW: Loaded 4977 primary data records. [2025-09-19T22:19:03.165238] [INFO ] [MAIN ] DTE: Generated 1820 derivative records from 48671 primary records. [2025-09-19T22:19:03.185800] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-19T22:19:03.280092] [DEBUG] [LOCAL ] DTE: Derivative data saved (1820 records). [2025-09-19T22:19:03.283441] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-19T22:19:03.287140] [INFO ] [MAIN ] Derivative Progress: 558/2093 symbols completed. DTE took 1.2s. Estimated remaining: 9m 57s. Rate: 154.3 symbols/min [2025-09-19T22:19:03.303138] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:03.536031] [DEBUG] [LOCAL ] DTM: Loaded 45355 existing records from primary storage. [2025-09-19T22:19:03.536771] [INFO ] [MAIN ] DTM: Loaded 45355 primary data records. [2025-09-19T22:19:03.911457] [DEBUG] [LOCAL ] DUK: Loaded 54250 existing records from primary storage. [2025-09-19T22:19:03.916982] [INFO ] [MAIN ] DUK: Loaded 54250 primary data records. [2025-09-19T22:19:03.929113] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:03.939758] [INFO ] [MAIN ] DTW: Generated 1820 derivative records from 4977 primary records. [2025-09-19T22:19:03.950386] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-19T22:19:04.064153] [DEBUG] [LOCAL ] DTW: Derivative data saved (1820 records). [2025-09-19T22:19:04.074726] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-19T22:19:04.104309] [INFO ] [MAIN ] Derivative Progress: 559/2093 symbols completed. DTW took 1.0s. Estimated remaining: 9m 58s. Rate: 154.0 symbols/min [2025-09-19T22:19:04.136130] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:04.273112] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:04.276532] [INFO ] [MAIN ] DTM: Generated 1820 derivative records from 45355 primary records. [2025-09-19T22:19:04.277614] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-19T22:19:04.282619] [DEBUG] [LOCAL ] DUKB: Loaded 6504 existing records from primary storage. [2025-09-19T22:19:04.291183] [INFO ] [MAIN ] DUKB: Loaded 6504 primary data records. [2025-09-19T22:19:04.403356] [DEBUG] [LOCAL ] DTM: Derivative data saved (1820 records). [2025-09-19T22:19:04.407046] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-19T22:19:04.410199] [INFO ] [MAIN ] Derivative Progress: 560/2093 symbols completed. DTM took 1.3s. Estimated remaining: 9m 57s. Rate: 154.0 symbols/min [2025-09-19T22:19:04.416113] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:04.623672] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:04.624374] [INFO ] [MAIN ] DUK: Generated 1820 derivative records from 54250 primary records. [2025-09-19T22:19:04.624463] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-19T22:19:04.658144] [DEBUG] [LOCAL ] DUK: Derivative data saved (1820 records). [2025-09-19T22:19:04.658575] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-19T22:19:04.660740] [INFO ] [MAIN ] Derivative Progress: 561/2093 symbols completed. DUK took 1.4s. Estimated remaining: 9m 56s. Rate: 154.1 symbols/min [2025-09-19T22:19:04.661168] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:04.679321] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:04.680296] [INFO ] [MAIN ] DUKB: Generated 1820 derivative records from 6504 primary records. [2025-09-19T22:19:04.694293] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-19T22:19:04.695600] [DEBUG] [LOCAL ] DV: Loaded 52057 existing records from primary storage. [2025-09-19T22:19:04.696300] [INFO ] [MAIN ] DV: Loaded 52057 primary data records. [2025-09-19T22:19:04.732811] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1820 records). [2025-09-19T22:19:04.748472] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-19T22:19:04.770265] [INFO ] [MAIN ] Derivative Progress: 562/2093 symbols completed. DUKB took 0.6s. Estimated remaining: 9m 55s. Rate: 154.3 symbols/min [2025-09-19T22:19:04.791057] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:04.920863] [DEBUG] [LOCAL ] DVA: Loaded 42344 existing records from primary storage. [2025-09-19T22:19:04.927905] [INFO ] [MAIN ] DVA: Loaded 42344 primary data records. [2025-09-19T22:19:05.426109] [DEBUG] [LOCAL ] DVN: Loaded 54479 existing records from primary storage. [2025-09-19T22:19:05.427878] [INFO ] [MAIN ] DVN: Loaded 54479 primary data records. [2025-09-19T22:19:05.524875] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:05.544376] [INFO ] [MAIN ] DV: Generated 1820 derivative records from 52057 primary records. [2025-09-19T22:19:05.548202] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-19T22:19:05.769695] [DEBUG] [LOCAL ] DV: Derivative data saved (1820 records). [2025-09-19T22:19:05.770797] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-19T22:19:05.785824] [INFO ] [MAIN ] Derivative Progress: 563/2093 symbols completed. DV took 1.4s. Estimated remaining: 9m 57s. Rate: 153.9 symbols/min [2025-09-19T22:19:05.787378] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:05.788711] [INFO ] [MAIN ] DVA: Generated 1820 derivative records from 42344 primary records. [2025-09-19T22:19:05.788888] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:05.789226] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-19T22:19:05.812367] [DEBUG] [LOCAL ] DVA: Derivative data saved (1820 records). [2025-09-19T22:19:05.812737] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-19T22:19:05.816419] [INFO ] [MAIN ] Derivative Progress: 564/2093 symbols completed. DVA took 1.2s. Estimated remaining: 9m 55s. Rate: 154.1 symbols/min [2025-09-19T22:19:05.817505] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:05.834386] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:05.835139] [INFO ] [MAIN ] DVN: Generated 1820 derivative records from 54479 primary records. [2025-09-19T22:19:05.835200] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-19T22:19:05.865990] [DEBUG] [LOCAL ] DVN: Derivative data saved (1820 records). [2025-09-19T22:19:05.866136] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-19T22:19:05.868850] [INFO ] [MAIN ] Derivative Progress: 565/2093 symbols completed. DVN took 1.1s. Estimated remaining: 9m 54s. Rate: 154.4 symbols/min [2025-09-19T22:19:05.869303] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:05.902929] [DEBUG] [LOCAL ] DX: Loaded 53245 existing records from primary storage. [2025-09-19T22:19:05.903227] [INFO ] [MAIN ] DX: Loaded 53245 primary data records. [2025-09-19T22:19:06.061682] [DEBUG] [LOCAL ] DXYZ: Loaded 37323 existing records from primary storage. [2025-09-19T22:19:06.067729] [DEBUG] [LOCAL ] DXC: Loaded 50193 existing records from primary storage. [2025-09-19T22:19:06.067851] [INFO ] [MAIN ] DXYZ: Loaded 37323 primary data records. [2025-09-19T22:19:06.092329] [INFO ] [MAIN ] DXC: Loaded 50193 primary data records. [2025-09-19T22:19:06.887523] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:06.889889] [INFO ] [MAIN ] DX: Generated 1820 derivative records from 53245 primary records. [2025-09-19T22:19:06.890140] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-19T22:19:06.923669] [DEBUG] [LOCAL ] DX: Derivative data saved (1820 records). [2025-09-19T22:19:06.924301] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-19T22:19:06.924007] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:06.926991] [INFO ] [MAIN ] Derivative Progress: 566/2093 symbols completed. DX took 1.1s. Estimated remaining: 9m 55s. Rate: 153.9 symbols/min [2025-09-19T22:19:06.927965] [INFO ] [MAIN ] DXC: Generated 1820 derivative records from 50193 primary records. [2025-09-19T22:19:06.928291] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:06.928980] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-19T22:19:06.942901] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:06.951190] [INFO ] [MAIN ] DXYZ: Generated 1820 derivative records from 37323 primary records. [2025-09-19T22:19:06.957724] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-19T22:19:06.959248] [DEBUG] [LOCAL ] DXC: Derivative data saved (1820 records). [2025-09-19T22:19:06.960079] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-19T22:19:06.962726] [INFO ] [MAIN ] Derivative Progress: 567/2093 symbols completed. DXC took 1.1s. Estimated remaining: 9m 54s. Rate: 154.1 symbols/min [2025-09-19T22:19:06.978251] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1820 records). [2025-09-19T22:19:06.978344] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-19T22:19:06.976975] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:06.981275] [INFO ] [MAIN ] Derivative Progress: 568/2093 symbols completed. DXYZ took 1.1s. Estimated remaining: 9m 53s. Rate: 154.4 symbols/min [2025-09-19T22:19:07.006049] [DEBUG] [LOCAL ] DY: Loaded 30563 existing records from primary storage. [2025-09-19T22:19:07.006255] [INFO ] [MAIN ] DY: Loaded 30563 primary data records. [2025-09-19T22:19:07.314058] [DEBUG] [LOCAL ] E: Loaded 34114 existing records from primary storage. [2025-09-19T22:19:07.322609] [INFO ] [MAIN ] E: Loaded 34114 primary data records. [2025-09-19T22:19:07.690576] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:07.692755] [INFO ] [MAIN ] DY: Generated 1820 derivative records from 30563 primary records. [2025-09-19T22:19:07.693144] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-19T22:19:07.711039] [DEBUG] [LOCAL ] DY: Derivative data saved (1820 records). [2025-09-19T22:19:07.711144] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-19T22:19:07.713294] [INFO ] [MAIN ] Derivative Progress: 569/2093 symbols completed. DY took 0.8s. Estimated remaining: 9m 53s. Rate: 154.2 symbols/min [2025-09-19T22:19:07.732726] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:07.733343] [INFO ] [MAIN ] E: Generated 1820 derivative records from 34114 primary records. [2025-09-19T22:19:07.733404] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-19T22:19:07.748818] [DEBUG] [LOCAL ] E: Derivative data saved (1820 records). [2025-09-19T22:19:07.748875] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-19T22:19:07.751458] [INFO ] [MAIN ] Derivative Progress: 570/2093 symbols completed. E took 0.8s. Estimated remaining: 9m 52s. Rate: 154.4 symbols/min [2025-09-19T22:19:07.752333] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:07.752252] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:07.752501] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:07.760946] [DEBUG] [LOCAL ] EAI: Loaded 4060 existing records from primary storage. [2025-09-19T22:19:07.761192] [INFO ] [MAIN ] EAI: Loaded 4060 primary data records. [2025-09-19T22:19:08.122164] [DEBUG] [LOCAL ] EB: Loaded 38768 existing records from primary storage. [2025-09-19T22:19:08.123176] [INFO ] [MAIN ] EB: Loaded 38768 primary data records. [2025-09-19T22:19:08.124263] [DEBUG] [LOCAL ] EAT: Loaded 50594 existing records from primary storage. [2025-09-19T22:19:08.136400] [INFO ] [MAIN ] EAT: Loaded 50594 primary data records. [2025-09-19T22:19:08.763779] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:08.765506] [INFO ] [MAIN ] EAI: Generated 1820 derivative records from 4060 primary records. [2025-09-19T22:19:08.765927] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-19T22:19:08.789628] [DEBUG] [LOCAL ] EAI: Derivative data saved (1820 records). [2025-09-19T22:19:08.789928] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-19T22:19:08.792835] [INFO ] [MAIN ] Derivative Progress: 571/2093 symbols completed. EAI took 1.0s. Estimated remaining: 9m 53s. Rate: 153.9 symbols/min [2025-09-19T22:19:08.793790] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:08.814354] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:08.827326] [INFO ] [MAIN ] EB: Generated 1820 derivative records from 38768 primary records. [2025-09-19T22:19:08.832945] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:08.833668] [INFO ] [MAIN ] EAT: Generated 1820 derivative records from 50594 primary records. [2025-09-19T22:19:08.833003] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-19T22:19:08.834265] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-19T22:19:08.865945] [DEBUG] [LOCAL ] EBF: Loaded 19927 existing records from primary storage. [2025-09-19T22:19:08.872855] [INFO ] [MAIN ] EBF: Loaded 19927 primary data records. [2025-09-19T22:19:08.872750] [DEBUG] [LOCAL ] EAT: Derivative data saved (1820 records). [2025-09-19T22:19:08.874294] [DEBUG] [LOCAL ] EB: Derivative data saved (1820 records). [2025-09-19T22:19:08.873752] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-19T22:19:08.895258] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-19T22:19:08.898297] [INFO ] [MAIN ] Derivative Progress: 572/2093 symbols completed. EAT took 1.1s. Estimated remaining: 9m 52s. Rate: 154.1 symbols/min [2025-09-19T22:19:08.935710] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:08.944664] [INFO ] [MAIN ] Derivative Progress: 573/2093 symbols completed. EB took 1.2s. Estimated remaining: 9m 51s. Rate: 154.4 symbols/min [2025-09-19T22:19:08.955435] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:09.237166] [DEBUG] [LOCAL ] EBS: Loaded 47661 existing records from primary storage. [2025-09-19T22:19:09.238352] [DEBUG] [LOCAL ] EC: Loaded 50191 existing records from primary storage. [2025-09-19T22:19:09.238743] [INFO ] [MAIN ] EBS: Loaded 47661 primary data records. [2025-09-19T22:19:09.238964] [INFO ] [MAIN ] EC: Loaded 50191 primary data records. [2025-09-19T22:19:09.478977] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:09.489359] [INFO ] [MAIN ] EBF: Generated 1820 derivative records from 19927 primary records. [2025-09-19T22:19:09.520826] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-19T22:19:09.938744] [DEBUG] [LOCAL ] EBF: Derivative data saved (1820 records). [2025-09-19T22:19:09.938932] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-19T22:19:09.940950] [INFO ] [MAIN ] Derivative Progress: 574/2093 symbols completed. EBF took 1.1s. Estimated remaining: 9m 52s. Rate: 154.0 symbols/min [2025-09-19T22:19:09.941395] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:09.989542] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:09.990041] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:10.002576] [INFO ] [MAIN ] EC: Generated 1820 derivative records from 50191 primary records. [2025-09-19T22:19:10.001636] [INFO ] [MAIN ] EBS: Generated 1820 derivative records from 47661 primary records. [2025-09-19T22:19:10.002701] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-19T22:19:10.003240] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-19T22:19:10.032910] [DEBUG] [LOCAL ] EBS: Derivative data saved (1820 records). [2025-09-19T22:19:10.034481] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-19T22:19:10.048664] [INFO ] [MAIN ] Derivative Progress: 575/2093 symbols completed. EBS took 1.1s. Estimated remaining: 9m 51s. Rate: 154.2 symbols/min [2025-09-19T22:19:10.050802] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:10.052509] [DEBUG] [LOCAL ] ECC: Loaded 44039 existing records from primary storage. [2025-09-19T22:19:10.053884] [INFO ] [MAIN ] ECC: Loaded 44039 primary data records. [2025-09-19T22:19:10.053984] [DEBUG] [LOCAL ] EC: Derivative data saved (1820 records). [2025-09-19T22:19:10.054388] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-19T22:19:10.069451] [INFO ] [MAIN ] Derivative Progress: 576/2093 symbols completed. EC took 1.1s. Estimated remaining: 9m 49s. Rate: 154.4 symbols/min [2025-09-19T22:19:10.102493] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:10.393785] [DEBUG] [LOCAL ] ECG: Loaded 35132 existing records from primary storage. [2025-09-19T22:19:10.394124] [INFO ] [MAIN ] ECG: Loaded 35132 primary data records. [2025-09-19T22:19:10.556133] [DEBUG] [LOCAL ] ECL: Loaded 47444 existing records from primary storage. [2025-09-19T22:19:10.571438] [INFO ] [MAIN ] ECL: Loaded 47444 primary data records. [2025-09-19T22:19:11.077896] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:11.079096] [INFO ] [MAIN ] ECC: Generated 1820 derivative records from 44039 primary records. [2025-09-19T22:19:11.079562] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-19T22:19:11.099742] [DEBUG] [LOCAL ] ECC: Derivative data saved (1820 records). [2025-09-19T22:19:11.099940] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-19T22:19:11.102087] [INFO ] [MAIN ] Derivative Progress: 577/2093 symbols completed. ECC took 1.2s. Estimated remaining: 9m 51s. Rate: 154.0 symbols/min [2025-09-19T22:19:11.102673] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:11.122488] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:11.123379] [INFO ] [MAIN ] ECG: Generated 1820 derivative records from 35132 primary records. [2025-09-19T22:19:11.123758] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-19T22:19:11.153694] [DEBUG] [LOCAL ] ECO: Loaded 18901 existing records from primary storage. [2025-09-19T22:19:11.153282] [DEBUG] [LOCAL ] ECG: Derivative data saved (1820 records). [2025-09-19T22:19:11.153962] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-19T22:19:11.156215] [INFO ] [MAIN ] Derivative Progress: 578/2093 symbols completed. ECG took 1.1s. Estimated remaining: 9m 49s. Rate: 154.2 symbols/min [2025-09-19T22:19:11.153891] [INFO ] [MAIN ] ECO: Loaded 18901 primary data records. [2025-09-19T22:19:11.157198] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:11.330837] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:11.342880] [INFO ] [MAIN ] ECL: Generated 1820 derivative records from 47444 primary records. [2025-09-19T22:19:11.343073] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-19T22:19:11.565554] [DEBUG] [LOCAL ] ECL: Derivative data saved (1820 records). [2025-09-19T22:19:11.565863] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-19T22:19:11.566888] [DEBUG] [LOCAL ] ECVT: Loaded 43818 existing records from primary storage. [2025-09-19T22:19:11.567324] [INFO ] [MAIN ] ECVT: Loaded 43818 primary data records. [2025-09-19T22:19:11.570554] [INFO ] [MAIN ] Derivative Progress: 579/2093 symbols completed. ECL took 1.5s. Estimated remaining: 9m 49s. Rate: 154.2 symbols/min [2025-09-19T22:19:11.625247] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:11.924462] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:11.925618] [INFO ] [MAIN ] ECO: Generated 1820 derivative records from 18901 primary records. [2025-09-19T22:19:11.925935] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-19T22:19:11.927722] [DEBUG] [LOCAL ] EDD: Loaded 27679 existing records from primary storage. [2025-09-19T22:19:11.928144] [INFO ] [MAIN ] EDD: Loaded 27679 primary data records. [2025-09-19T22:19:12.010682] [DEBUG] [LOCAL ] ECO: Derivative data saved (1820 records). [2025-09-19T22:19:12.024936] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-19T22:19:12.032272] [INFO ] [MAIN ] Derivative Progress: 580/2093 symbols completed. ECO took 0.9s. Estimated remaining: 9m 49s. Rate: 154.1 symbols/min [2025-09-19T22:19:12.056148] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:12.289841] [DEBUG] [LOCAL ] EDF: Loaded 13744 existing records from primary storage. [2025-09-19T22:19:12.290526] [INFO ] [MAIN ] EDF: Loaded 13744 primary data records. [2025-09-19T22:19:12.290444] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:12.291365] [INFO ] [MAIN ] ECVT: Generated 1820 derivative records from 43818 primary records. [2025-09-19T22:19:12.292291] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-19T22:19:12.415031] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1820 records). [2025-09-19T22:19:12.442377] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-19T22:19:12.476745] [INFO ] [MAIN ] Derivative Progress: 581/2093 symbols completed. ECVT took 1.3s. Estimated remaining: 9m 49s. Rate: 154.1 symbols/min [2025-09-19T22:19:12.501789] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:12.656940] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:12.658003] [INFO ] [MAIN ] EDD: Generated 1820 derivative records from 27679 primary records. [2025-09-19T22:19:12.666114] [DEBUG] [LOCAL ] EDN: Loaded 18158 existing records from primary storage. [2025-09-19T22:19:12.664072] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-19T22:19:12.666370] [INFO ] [MAIN ] EDN: Loaded 18158 primary data records. [2025-09-19T22:19:12.778006] [DEBUG] [LOCAL ] EDD: Derivative data saved (1820 records). [2025-09-19T22:19:12.790904] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-19T22:19:12.798598] [INFO ] [MAIN ] Derivative Progress: 582/2093 symbols completed. EDD took 1.2s. Estimated remaining: 9m 48s. Rate: 154.1 symbols/min [2025-09-19T22:19:12.835234] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:13.013584] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:13.014370] [INFO ] [MAIN ] EDF: Generated 1820 derivative records from 13744 primary records. [2025-09-19T22:19:13.015138] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-19T22:19:13.035843] [DEBUG] [LOCAL ] EDF: Derivative data saved (1820 records). [2025-09-19T22:19:13.036933] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-19T22:19:13.039918] [INFO ] [MAIN ] Derivative Progress: 583/2093 symbols completed. EDF took 1.0s. Estimated remaining: 9m 47s. Rate: 154.2 symbols/min [2025-09-19T22:19:13.064593] [DEBUG] [LOCAL ] EE: Loaded 33025 existing records from primary storage. [2025-09-19T22:19:13.076974] [INFO ] [MAIN ] EE: Loaded 33025 primary data records. [2025-09-19T22:19:13.108962] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:13.147567] [INFO ] [MAIN ] EDN: Generated 1820 derivative records from 18158 primary records. [2025-09-19T22:19:13.153358] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-19T22:19:13.283779] [DEBUG] [LOCAL ] EDN: Derivative data saved (1820 records). [2025-09-19T22:19:13.449046] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-19T22:19:13.452617] [INFO ] [MAIN ] Derivative Progress: 584/2093 symbols completed. EDN took 1.0s. Estimated remaining: 9m 47s. Rate: 154.2 symbols/min [2025-09-19T22:19:13.478052] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:13.478724] [INFO ] [MAIN ] EE: Generated 1820 derivative records from 33025 primary records. [2025-09-19T22:19:13.478790] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-19T22:19:13.494401] [DEBUG] [LOCAL ] EE: Derivative data saved (1820 records). [2025-09-19T22:19:13.494503] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-19T22:19:13.497098] [INFO ] [MAIN ] Derivative Progress: 585/2093 symbols completed. EE took 0.7s. Estimated remaining: 9m 46s. Rate: 154.5 symbols/min [2025-09-19T22:19:13.497706] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:13.498689] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:13.498579] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:13.504382] [DEBUG] [LOCAL ] EEA: Loaded 2853 existing records from primary storage. [2025-09-19T22:19:13.504579] [INFO ] [MAIN ] EEA: Loaded 2853 primary data records. [2025-09-19T22:19:13.622668] [DEBUG] [LOCAL ] EFR: Loaded 14298 existing records from primary storage. [2025-09-19T22:19:13.623161] [INFO ] [MAIN ] EFR: Loaded 14298 primary data records. [2025-09-19T22:19:14.032146] [DEBUG] [LOCAL ] EFC: Loaded 46929 existing records from primary storage. [2025-09-19T22:19:14.038664] [INFO ] [MAIN ] EFC: Loaded 46929 primary data records. [2025-09-19T22:19:14.497719] [DEBUG] [MAIN ] EEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:14.499308] [INFO ] [MAIN ] EEA: Generated 1820 derivative records from 2853 primary records. [2025-09-19T22:19:14.514787] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-19T22:19:14.517311] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:14.524518] [INFO ] [MAIN ] EFR: Generated 1820 derivative records from 14298 primary records. [2025-09-19T22:19:14.526151] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-19T22:19:14.549212] [DEBUG] [LOCAL ] EEA: Derivative data saved (1820 records). [2025-09-19T22:19:14.549434] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-19T22:19:14.554385] [DEBUG] [LOCAL ] EFR: Derivative data saved (1820 records). [2025-09-19T22:19:14.553376] [INFO ] [MAIN ] Derivative Progress: 586/2093 symbols completed. EEA took 1.1s. Estimated remaining: 9m 47s. Rate: 154.0 symbols/min [2025-09-19T22:19:14.556378] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:14.555601] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-19T22:19:14.559189] [INFO ] [MAIN ] Derivative Progress: 587/2093 symbols completed. EFR took 1.1s. Estimated remaining: 9m 46s. Rate: 154.3 symbols/min [2025-09-19T22:19:14.559665] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:14.573875] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:14.574805] [INFO ] [MAIN ] EFC: Generated 1820 derivative records from 46929 primary records. [2025-09-19T22:19:14.574913] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-19T22:19:14.599607] [DEBUG] [LOCAL ] EFT: Loaded 12640 existing records from primary storage. [2025-09-19T22:19:14.601461] [DEBUG] [LOCAL ] EFC: Derivative data saved (1820 records). [2025-09-19T22:19:14.601616] [INFO ] [MAIN ] EFT: Loaded 12640 primary data records. [2025-09-19T22:19:14.601702] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-19T22:19:14.604195] [INFO ] [MAIN ] Derivative Progress: 588/2093 symbols completed. EFC took 1.1s. Estimated remaining: 9m 44s. Rate: 154.5 symbols/min [2025-09-19T22:19:14.634487] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:14.823884] [DEBUG] [LOCAL ] EFX: Loaded 45687 existing records from primary storage. [2025-09-19T22:19:14.824297] [INFO ] [MAIN ] EFX: Loaded 45687 primary data records. [2025-09-19T22:19:14.980364] [DEBUG] [LOCAL ] EFXT: Loaded 30115 existing records from primary storage. [2025-09-19T22:19:14.996520] [INFO ] [MAIN ] EFXT: Loaded 30115 primary data records. [2025-09-19T22:19:15.675011] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:15.676486] [INFO ] [MAIN ] EFT: Generated 1820 derivative records from 12640 primary records. [2025-09-19T22:19:15.676879] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-19T22:19:15.697840] [DEBUG] [LOCAL ] EFT: Derivative data saved (1820 records). [2025-09-19T22:19:15.698126] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-19T22:19:15.708592] [INFO ] [MAIN ] Derivative Progress: 589/2093 symbols completed. EFT took 1.2s. Estimated remaining: 9m 46s. Rate: 154.0 symbols/min [2025-09-19T22:19:15.714871] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:15.715826] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:15.716776] [INFO ] [MAIN ] EFX: Generated 1820 derivative records from 45687 primary records. [2025-09-19T22:19:15.717481] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-19T22:19:15.738051] [DEBUG] [LOCAL ] EFX: Derivative data saved (1820 records). [2025-09-19T22:19:15.746157] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-19T22:19:15.748599] [INFO ] [MAIN ] Derivative Progress: 590/2093 symbols completed. EFX took 1.2s. Estimated remaining: 9m 45s. Rate: 154.3 symbols/min [2025-09-19T22:19:15.754222] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:15.754051] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:15.755213] [INFO ] [MAIN ] EFXT: Generated 1820 derivative records from 30115 primary records. [2025-09-19T22:19:15.755343] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-19T22:19:15.780336] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1820 records). [2025-09-19T22:19:15.781032] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-19T22:19:15.783943] [INFO ] [MAIN ] Derivative Progress: 591/2093 symbols completed. EFXT took 1.2s. Estimated remaining: 9m 43s. Rate: 154.5 symbols/min [2025-09-19T22:19:15.793047] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:15.797182] [DEBUG] [LOCAL ] EG: Loaded 29471 existing records from primary storage. [2025-09-19T22:19:15.797532] [INFO ] [MAIN ] EG: Loaded 29471 primary data records. [2025-09-19T22:19:16.139866] [DEBUG] [LOCAL ] EGO: Loaded 52165 existing records from primary storage. [2025-09-19T22:19:16.148734] [INFO ] [MAIN ] EGO: Loaded 52165 primary data records. [2025-09-19T22:19:16.151118] [DEBUG] [LOCAL ] EGP: Loaded 31908 existing records from primary storage. [2025-09-19T22:19:16.162841] [INFO ] [MAIN ] EGP: Loaded 31908 primary data records. [2025-09-19T22:19:16.812492] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:16.813704] [INFO ] [MAIN ] EG: Generated 1820 derivative records from 29471 primary records. [2025-09-19T22:19:16.814137] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-19T22:19:16.835477] [DEBUG] [LOCAL ] EG: Derivative data saved (1820 records). [2025-09-19T22:19:16.835727] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-19T22:19:16.838627] [INFO ] [MAIN ] Derivative Progress: 592/2093 symbols completed. EG took 1.1s. Estimated remaining: 9m 45s. Rate: 154.0 symbols/min [2025-09-19T22:19:16.839363] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:16.858762] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:16.861038] [INFO ] [MAIN ] EGO: Generated 1820 derivative records from 52165 primary records. [2025-09-19T22:19:16.861215] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-19T22:19:16.888441] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:16.889477] [INFO ] [MAIN ] EGP: Generated 1820 derivative records from 31908 primary records. [2025-09-19T22:19:16.891109] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-19T22:19:16.910926] [DEBUG] [LOCAL ] EGO: Derivative data saved (1820 records). [2025-09-19T22:19:16.915440] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-19T22:19:16.918051] [INFO ] [MAIN ] Derivative Progress: 593/2093 symbols completed. EGO took 1.2s. Estimated remaining: 9m 43s. Rate: 154.2 symbols/min [2025-09-19T22:19:16.919332] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:16.922754] [DEBUG] [LOCAL ] EGP: Derivative data saved (1820 records). [2025-09-19T22:19:16.922962] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-19T22:19:16.925624] [INFO ] [MAIN ] Derivative Progress: 594/2093 symbols completed. EGP took 1.1s. Estimated remaining: 9m 42s. Rate: 154.5 symbols/min [2025-09-19T22:19:16.926040] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:16.939346] [DEBUG] [LOCAL ] EGY: Loaded 43031 existing records from primary storage. [2025-09-19T22:19:16.939706] [INFO ] [MAIN ] EGY: Loaded 43031 primary data records. [2025-09-19T22:19:17.090981] [DEBUG] [LOCAL ] EHAB: Loaded 30600 existing records from primary storage. [2025-09-19T22:19:17.113902] [INFO ] [MAIN ] EHAB: Loaded 30600 primary data records. [2025-09-19T22:19:17.457710] [DEBUG] [LOCAL ] EHC: Loaded 42121 existing records from primary storage. [2025-09-19T22:19:17.458760] [INFO ] [MAIN ] EHC: Loaded 42121 primary data records. [2025-09-19T22:19:17.983781] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:17.986134] [INFO ] [MAIN ] EGY: Generated 1820 derivative records from 43031 primary records. [2025-09-19T22:19:17.986809] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-19T22:19:18.004683] [DEBUG] [LOCAL ] EGY: Derivative data saved (1820 records). [2025-09-19T22:19:18.004865] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-19T22:19:18.007040] [INFO ] [MAIN ] Derivative Progress: 595/2093 symbols completed. EGY took 1.2s. Estimated remaining: 9m 43s. Rate: 154.0 symbols/min [2025-09-19T22:19:18.007415] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:18.026022] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:18.027093] [INFO ] [MAIN ] EHAB: Generated 1820 derivative records from 30600 primary records. [2025-09-19T22:19:18.027362] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-19T22:19:18.053086] [DEBUG] [LOCAL ] EHI: Loaded 10346 existing records from primary storage. [2025-09-19T22:19:18.056758] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1820 records). [2025-09-19T22:19:18.057007] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-19T22:19:18.057124] [INFO ] [MAIN ] EHI: Loaded 10346 primary data records. [2025-09-19T22:19:18.061744] [INFO ] [MAIN ] Derivative Progress: 596/2093 symbols completed. EHAB took 1.1s. Estimated remaining: 9m 42s. Rate: 154.3 symbols/min [2025-09-19T22:19:18.062422] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:18.155444] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:18.188423] [INFO ] [MAIN ] EHC: Generated 1820 derivative records from 42121 primary records. [2025-09-19T22:19:18.192553] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-19T22:19:18.305098] [DEBUG] [LOCAL ] EHC: Derivative data saved (1820 records). [2025-09-19T22:19:18.408802] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-19T22:19:18.408679] [DEBUG] [LOCAL ] EIC: Loaded 24897 existing records from primary storage. [2025-09-19T22:19:18.412282] [INFO ] [MAIN ] EIC: Loaded 24897 primary data records. [2025-09-19T22:19:18.412148] [INFO ] [MAIN ] Derivative Progress: 597/2093 symbols completed. EHC took 1.5s. Estimated remaining: 9m 42s. Rate: 154.3 symbols/min [2025-09-19T22:19:18.432277] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:18.631727] [DEBUG] [LOCAL ] EIG: Loaded 20564 existing records from primary storage. [2025-09-19T22:19:18.750203] [INFO ] [MAIN ] EIG: Loaded 20564 primary data records. [2025-09-19T22:19:19.086424] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:19.087426] [INFO ] [MAIN ] EHI: Generated 1820 derivative records from 10346 primary records. [2025-09-19T22:19:19.087629] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-19T22:19:19.124091] [DEBUG] [LOCAL ] EHI: Derivative data saved (1820 records). [2025-09-19T22:19:19.124447] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:19.125391] [INFO ] [MAIN ] EIC: Generated 1820 derivative records from 24897 primary records. [2025-09-19T22:19:19.125938] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-19T22:19:19.125866] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-19T22:19:19.129117] [INFO ] [MAIN ] Derivative Progress: 598/2093 symbols completed. EHI took 1.1s. Estimated remaining: 9m 42s. Rate: 154.1 symbols/min [2025-09-19T22:19:19.148051] [DEBUG] [LOCAL ] EIC: Derivative data saved (1820 records). [2025-09-19T22:19:19.148283] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-19T22:19:19.150745] [INFO ] [MAIN ] Derivative Progress: 599/2093 symbols completed. EIC took 1.1s. Estimated remaining: 9m 41s. Rate: 154.3 symbols/min [2025-09-19T22:19:19.167832] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:19.168470] [INFO ] [MAIN ] EIG: Generated 1820 derivative records from 20564 primary records. [2025-09-19T22:19:19.168529] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-19T22:19:19.184075] [DEBUG] [LOCAL ] EIG: Derivative data saved (1820 records). [2025-09-19T22:19:19.184194] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-19T22:19:19.187058] [INFO ] [MAIN ] Derivative Progress: 600/2093 symbols completed. EIG took 0.8s. Estimated remaining: 9m 40s. Rate: 154.5 symbols/min [2025-09-19T22:19:19.188113] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:19.188259] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:19.188428] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:19.196871] [DEBUG] [LOCAL ] ELC: Loaded 3562 existing records from primary storage. [2025-09-19T22:19:19.197082] [INFO ] [MAIN ] ELC: Loaded 3562 primary data records. [2025-09-19T22:19:19.587869] [DEBUG] [LOCAL ] ELAN: Loaded 53959 existing records from primary storage. [2025-09-19T22:19:19.603145] [INFO ] [MAIN ] ELAN: Loaded 53959 primary data records. [2025-09-19T22:19:19.649672] [DEBUG] [LOCAL ] EL: Loaded 54205 existing records from primary storage. [2025-09-19T22:19:19.663759] [INFO ] [MAIN ] EL: Loaded 54205 primary data records. [2025-09-19T22:19:20.256788] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:20.257770] [INFO ] [MAIN ] ELC: Generated 1820 derivative records from 3562 primary records. [2025-09-19T22:19:20.257867] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-19T22:19:20.279681] [DEBUG] [LOCAL ] ELC: Derivative data saved (1820 records). [2025-09-19T22:19:20.280604] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-19T22:19:20.283173] [INFO ] [MAIN ] Derivative Progress: 601/2093 symbols completed. ELC took 1.1s. Estimated remaining: 9m 41s. Rate: 154.1 symbols/min [2025-09-19T22:19:20.284297] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:20.314083] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:20.317844] [INFO ] [MAIN ] ELAN: Generated 1820 derivative records from 53959 primary records. [2025-09-19T22:19:20.318063] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-19T22:19:20.351495] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:20.353425] [INFO ] [MAIN ] EL: Generated 1820 derivative records from 54205 primary records. [2025-09-19T22:19:20.354231] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-19T22:19:20.389384] [DEBUG] [LOCAL ] EL: Derivative data saved (1820 records). [2025-09-19T22:19:20.386978] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1820 records). [2025-09-19T22:19:20.389756] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-19T22:19:20.392780] [INFO ] [MAIN ] Derivative Progress: 602/2093 symbols completed. EL took 1.2s. Estimated remaining: 9m 40s. Rate: 154.3 symbols/min [2025-09-19T22:19:20.389900] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-19T22:19:20.397033] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:20.397173] [INFO ] [MAIN ] Derivative Progress: 603/2093 symbols completed. ELAN took 1.2s. Estimated remaining: 9m 39s. Rate: 154.5 symbols/min [2025-09-19T22:19:20.398142] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:20.414322] [DEBUG] [LOCAL ] ELF: Loaded 53101 existing records from primary storage. [2025-09-19T22:19:20.414681] [INFO ] [MAIN ] ELF: Loaded 53101 primary data records. [2025-09-19T22:19:20.592832] [DEBUG] [LOCAL ] ELP: Loaded 26324 existing records from primary storage. [2025-09-19T22:19:20.610430] [INFO ] [MAIN ] ELP: Loaded 26324 primary data records. [2025-09-19T22:19:20.871272] [DEBUG] [LOCAL ] ELME: Loaded 39870 existing records from primary storage. [2025-09-19T22:19:20.872348] [INFO ] [MAIN ] ELME: Loaded 39870 primary data records. [2025-09-19T22:19:21.488082] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:21.489170] [INFO ] [MAIN ] ELF: Generated 1820 derivative records from 53101 primary records. [2025-09-19T22:19:21.489988] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-19T22:19:21.509861] [DEBUG] [LOCAL ] ELF: Derivative data saved (1820 records). [2025-09-19T22:19:21.509961] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-19T22:19:21.514186] [INFO ] [MAIN ] Derivative Progress: 604/2093 symbols completed. ELF took 1.2s. Estimated remaining: 9m 40s. Rate: 154.0 symbols/min [2025-09-19T22:19:21.515298] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:21.534567] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:21.535409] [INFO ] [MAIN ] ELP: Generated 1820 derivative records from 26324 primary records. [2025-09-19T22:19:21.535547] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-19T22:19:21.564741] [DEBUG] [LOCAL ] ELP: Derivative data saved (1820 records). [2025-09-19T22:19:21.572990] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-19T22:19:21.580824] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:21.581591] [INFO ] [MAIN ] ELME: Generated 1820 derivative records from 39870 primary records. [2025-09-19T22:19:21.581688] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-19T22:19:21.580447] [INFO ] [MAIN ] Derivative Progress: 605/2093 symbols completed. ELP took 1.2s. Estimated remaining: 9m 39s. Rate: 154.3 symbols/min [2025-09-19T22:19:21.591425] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:21.593972] [DEBUG] [LOCAL ] EME: Loaded 32382 existing records from primary storage. [2025-09-19T22:19:21.594584] [INFO ] [MAIN ] EME: Loaded 32382 primary data records. [2025-09-19T22:19:21.697585] [DEBUG] [LOCAL ] EMF: Loaded 3735 existing records from primary storage. [2025-09-19T22:19:21.711853] [INFO ] [MAIN ] EMF: Loaded 3735 primary data records. [2025-09-19T22:19:21.787329] [DEBUG] [LOCAL ] ELME: Derivative data saved (1820 records). [2025-09-19T22:19:21.793156] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-19T22:19:21.795939] [INFO ] [MAIN ] Derivative Progress: 606/2093 symbols completed. ELME took 1.4s. Estimated remaining: 9m 38s. Rate: 154.4 symbols/min [2025-09-19T22:19:21.825718] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:22.326130] [DEBUG] [LOCAL ] EMN: Loaded 50995 existing records from primary storage. [2025-09-19T22:19:22.326801] [INFO ] [MAIN ] EMN: Loaded 50995 primary data records. [2025-09-19T22:19:22.371507] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:22.408026] [INFO ] [MAIN ] EME: Generated 1820 derivative records from 32382 primary records. [2025-09-19T22:19:22.420563] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-19T22:19:22.486446] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:22.497977] [INFO ] [MAIN ] EMF: Generated 1820 derivative records from 3735 primary records. [2025-09-19T22:19:22.505107] [DEBUG] [LOCAL ] EME: Derivative data saved (1820 records). [2025-09-19T22:19:22.529538] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-19T22:19:22.536913] [INFO ] [MAIN ] Derivative Progress: 607/2093 symbols completed. EME took 1.0s. Estimated remaining: 9m 38s. Rate: 154.1 symbols/min [2025-09-19T22:19:22.529438] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-19T22:19:22.559694] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:22.711065] [DEBUG] [LOCAL ] EMF: Derivative data saved (1820 records). [2025-09-19T22:19:22.711288] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-19T22:19:22.713606] [INFO ] [MAIN ] Derivative Progress: 608/2093 symbols completed. EMF took 1.1s. Estimated remaining: 9m 38s. Rate: 154.3 symbols/min [2025-09-19T22:19:22.714236] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:22.724932] [DEBUG] [LOCAL ] EMP: Loaded 3035 existing records from primary storage. [2025-09-19T22:19:22.725379] [INFO ] [MAIN ] EMP: Loaded 3035 primary data records. [2025-09-19T22:19:22.753054] [DEBUG] [LOCAL ] EMO: Loaded 12458 existing records from primary storage. [2025-09-19T22:19:22.775840] [INFO ] [MAIN ] EMO: Loaded 12458 primary data records. [2025-09-19T22:19:23.408335] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:23.410505] [INFO ] [MAIN ] EMN: Generated 1820 derivative records from 50995 primary records. [2025-09-19T22:19:23.410868] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-19T22:19:23.432909] [DEBUG] [LOCAL ] EMN: Derivative data saved (1820 records). [2025-09-19T22:19:23.433857] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-19T22:19:23.436246] [INFO ] [MAIN ] Derivative Progress: 609/2093 symbols completed. EMN took 1.6s. Estimated remaining: 9m 38s. Rate: 154.1 symbols/min [2025-09-19T22:19:23.437258] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:23.463372] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:23.464822] [INFO ] [MAIN ] EMP: Generated 1820 derivative records from 3035 primary records. [2025-09-19T22:19:23.465123] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-19T22:19:23.490009] [DEBUG] [LOCAL ] EMP: Derivative data saved (1820 records). [2025-09-19T22:19:23.506977] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-19T22:19:23.510498] [INFO ] [MAIN ] Derivative Progress: 610/2093 symbols completed. EMP took 0.8s. Estimated remaining: 9m 37s. Rate: 154.3 symbols/min [2025-09-19T22:19:23.507388] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:23.510979] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:23.512256] [INFO ] [MAIN ] EMO: Generated 1820 derivative records from 12458 primary records. [2025-09-19T22:19:23.527397] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-19T22:19:23.546413] [DEBUG] [LOCAL ] EMO: Derivative data saved (1820 records). [2025-09-19T22:19:23.546564] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-19T22:19:23.549569] [INFO ] [MAIN ] Derivative Progress: 611/2093 symbols completed. EMO took 1.0s. Estimated remaining: 9m 36s. Rate: 154.5 symbols/min [2025-09-19T22:19:23.550672] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:23.568994] [DEBUG] [LOCAL ] EMR: Loaded 54035 existing records from primary storage. [2025-09-19T22:19:23.569210] [INFO ] [MAIN ] EMR: Loaded 54035 primary data records. [2025-09-19T22:19:23.578240] [DEBUG] [LOCAL ] ENFY: Loaded 3085 existing records from primary storage. [2025-09-19T22:19:23.594756] [INFO ] [MAIN ] ENFY: Loaded 3085 primary data records. [2025-09-19T22:19:24.175064] [DEBUG] [LOCAL ] ENB: Loaded 54299 existing records from primary storage. [2025-09-19T22:19:24.181766] [INFO ] [MAIN ] ENB: Loaded 54299 primary data records. [2025-09-19T22:19:24.672765] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:24.673953] [INFO ] [MAIN ] EMR: Generated 1820 derivative records from 54035 primary records. [2025-09-19T22:19:24.674091] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-19T22:19:24.691111] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:24.705273] [INFO ] [MAIN ] ENFY: Generated 1820 derivative records from 3085 primary records. [2025-09-19T22:19:24.708007] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-19T22:19:24.708462] [DEBUG] [LOCAL ] EMR: Derivative data saved (1820 records). [2025-09-19T22:19:24.709866] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-19T22:19:24.712613] [INFO ] [MAIN ] Derivative Progress: 612/2093 symbols completed. EMR took 1.3s. Estimated remaining: 9m 37s. Rate: 154.0 symbols/min [2025-09-19T22:19:24.713200] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:24.728467] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1820 records). [2025-09-19T22:19:24.733121] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-19T22:19:24.735609] [INFO ] [MAIN ] Derivative Progress: 613/2093 symbols completed. ENFY took 1.2s. Estimated remaining: 9m 36s. Rate: 154.2 symbols/min [2025-09-19T22:19:24.749232] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:24.750030] [INFO ] [MAIN ] ENB: Generated 1820 derivative records from 54299 primary records. [2025-09-19T22:19:24.750094] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-19T22:19:24.775769] [DEBUG] [LOCAL ] ENB: Derivative data saved (1820 records). [2025-09-19T22:19:24.775915] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-19T22:19:24.778561] [INFO ] [MAIN ] Derivative Progress: 614/2093 symbols completed. ENB took 1.3s. Estimated remaining: 9m 35s. Rate: 154.4 symbols/min [2025-09-19T22:19:24.791542] [DEBUG] [LOCAL ] ENIC: Loaded 37334 existing records from primary storage. [2025-09-19T22:19:24.791669] [INFO ] [MAIN ] ENIC: Loaded 37334 primary data records. [2025-09-19T22:19:25.111409] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:25.112042] [INFO ] [MAIN ] ENIC: Generated 1820 derivative records from 37334 primary records. [2025-09-19T22:19:25.112105] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-19T22:19:25.127396] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1820 records). [2025-09-19T22:19:25.127467] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-19T22:19:25.129450] [INFO ] [MAIN ] Derivative Progress: 615/2093 symbols completed. ENIC took 0.4s. Estimated remaining: 9m 34s. Rate: 154.5 symbols/min [2025-09-19T22:19:25.130239] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:25.130449] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:25.130707] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:25.136487] [DEBUG] [LOCAL ] ENO: Loaded 2016 existing records from primary storage. [2025-09-19T22:19:25.136771] [INFO ] [MAIN ] ENO: Loaded 2016 primary data records. [2025-09-19T22:19:25.471359] [DEBUG] [LOCAL ] ENS: Loaded 29761 existing records from primary storage. [2025-09-19T22:19:25.471635] [INFO ] [MAIN ] ENS: Loaded 29761 primary data records. [2025-09-19T22:19:25.583945] [DEBUG] [LOCAL ] ENOV: Loaded 45945 existing records from primary storage. [2025-09-19T22:19:25.595589] [INFO ] [MAIN ] ENOV: Loaded 45945 primary data records. [2025-09-19T22:19:26.169255] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:26.170600] [INFO ] [MAIN ] ENO: Generated 1820 derivative records from 2016 primary records. [2025-09-19T22:19:26.172263] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-19T22:19:26.188726] [DEBUG] [LOCAL ] ENO: Derivative data saved (1820 records). [2025-09-19T22:19:26.189111] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-19T22:19:26.191737] [INFO ] [MAIN ] Derivative Progress: 616/2093 symbols completed. ENO took 1.1s. Estimated remaining: 9m 35s. Rate: 154.0 symbols/min [2025-09-19T22:19:26.192368] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:26.228202] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:26.237444] [INFO ] [MAIN ] ENOV: Generated 1820 derivative records from 45945 primary records. [2025-09-19T22:19:26.237600] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-19T22:19:26.236551] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:26.238556] [INFO ] [MAIN ] ENS: Generated 1820 derivative records from 29761 primary records. [2025-09-19T22:19:26.239435] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-19T22:19:26.274567] [DEBUG] [LOCAL ] ENVA: Loaded 26160 existing records from primary storage. [2025-09-19T22:19:26.276305] [INFO ] [MAIN ] ENVA: Loaded 26160 primary data records. [2025-09-19T22:19:26.310472] [DEBUG] [LOCAL ] ENS: Derivative data saved (1820 records). [2025-09-19T22:19:26.324711] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1820 records). [2025-09-19T22:19:26.324614] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-19T22:19:26.324949] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-19T22:19:26.332308] [INFO ] [MAIN ] Derivative Progress: 617/2093 symbols completed. ENS took 1.2s. Estimated remaining: 9m 34s. Rate: 154.2 symbols/min [2025-09-19T22:19:26.358296] [INFO ] [MAIN ] Derivative Progress: 618/2093 symbols completed. ENOV took 1.2s. Estimated remaining: 9m 33s. Rate: 154.4 symbols/min [2025-09-19T22:19:26.358172] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:26.369512] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:26.605715] [DEBUG] [LOCAL ] EOD: Loaded 14342 existing records from primary storage. [2025-09-19T22:19:26.605894] [INFO ] [MAIN ] EOD: Loaded 14342 primary data records. [2025-09-19T22:19:26.947406] [DEBUG] [LOCAL ] EOG: Loaded 54121 existing records from primary storage. [2025-09-19T22:19:26.947718] [INFO ] [MAIN ] EOG: Loaded 54121 primary data records. [2025-09-19T22:19:27.287075] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:27.289438] [INFO ] [MAIN ] ENVA: Generated 1820 derivative records from 26160 primary records. [2025-09-19T22:19:27.289882] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-19T22:19:27.311409] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1820 records). [2025-09-19T22:19:27.311811] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-19T22:19:27.314248] [INFO ] [MAIN ] Derivative Progress: 619/2093 symbols completed. ENVA took 1.1s. Estimated remaining: 9m 34s. Rate: 154.1 symbols/min [2025-09-19T22:19:27.314766] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:27.329224] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:27.330307] [INFO ] [MAIN ] EOD: Generated 1820 derivative records from 14342 primary records. [2025-09-19T22:19:27.330431] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-19T22:19:27.350313] [DEBUG] [LOCAL ] EOD: Derivative data saved (1820 records). [2025-09-19T22:19:27.351982] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-19T22:19:27.355022] [INFO ] [MAIN ] Derivative Progress: 620/2093 symbols completed. EOD took 1.0s. Estimated remaining: 9m 33s. Rate: 154.3 symbols/min [2025-09-19T22:19:27.359748] [DEBUG] [LOCAL ] EOI: Loaded 10854 existing records from primary storage. [2025-09-19T22:19:27.360145] [INFO ] [MAIN ] EOI: Loaded 10854 primary data records. [2025-09-19T22:19:27.368193] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:27.378890] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:27.386207] [INFO ] [MAIN ] EOG: Generated 1820 derivative records from 54121 primary records. [2025-09-19T22:19:27.418235] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-19T22:19:27.504020] [DEBUG] [LOCAL ] EOG: Derivative data saved (1820 records). [2025-09-19T22:19:27.524985] [DEBUG] [LOCAL ] EOS: Loaded 15784 existing records from primary storage. [2025-09-19T22:19:27.552242] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-19T22:19:27.585137] [INFO ] [MAIN ] Derivative Progress: 621/2093 symbols completed. EOG took 1.2s. Estimated remaining: 9m 32s. Rate: 154.4 symbols/min [2025-09-19T22:19:27.728476] [INFO ] [MAIN ] EOS: Loaded 15784 primary data records. [2025-09-19T22:19:27.733991] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:27.858997] [DEBUG] [LOCAL ] EOT: Loaded 6926 existing records from primary storage. [2025-09-19T22:19:27.859980] [INFO ] [MAIN ] EOT: Loaded 6926 primary data records. [2025-09-19T22:19:28.271295] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:28.390901] [INFO ] [MAIN ] EOI: Generated 1820 derivative records from 10854 primary records. [2025-09-19T22:19:28.391325] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-19T22:19:28.412202] [DEBUG] [LOCAL ] EOI: Derivative data saved (1820 records). [2025-09-19T22:19:28.420499] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-19T22:19:28.427279] [INFO ] [MAIN ] Derivative Progress: 622/2093 symbols completed. EOI took 1.1s. Estimated remaining: 9m 33s. Rate: 154.1 symbols/min [2025-09-19T22:19:28.427807] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:28.428664] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:28.429411] [INFO ] [MAIN ] EOS: Generated 1820 derivative records from 15784 primary records. [2025-09-19T22:19:28.429630] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-19T22:19:28.448664] [DEBUG] [LOCAL ] EOS: Derivative data saved (1820 records). [2025-09-19T22:19:28.449059] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-19T22:19:28.451778] [INFO ] [MAIN ] Derivative Progress: 623/2093 symbols completed. EOS took 1.1s. Estimated remaining: 9m 31s. Rate: 154.3 symbols/min [2025-09-19T22:19:28.452178] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:28.469700] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:28.470468] [INFO ] [MAIN ] EOT: Generated 1820 derivative records from 6926 primary records. [2025-09-19T22:19:28.470559] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-19T22:19:28.495847] [DEBUG] [LOCAL ] EOT: Derivative data saved (1820 records). [2025-09-19T22:19:28.496115] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-19T22:19:28.498598] [INFO ] [MAIN ] Derivative Progress: 624/2093 symbols completed. EOT took 0.8s. Estimated remaining: 9m 30s. Rate: 154.6 symbols/min [2025-09-19T22:19:28.499044] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:28.523515] [DEBUG] [LOCAL ] EPAM: Loaded 40338 existing records from primary storage. [2025-09-19T22:19:28.523861] [INFO ] [MAIN ] EPAM: Loaded 40338 primary data records. [2025-09-19T22:19:28.643060] [DEBUG] [LOCAL ] EPC: Loaded 40556 existing records from primary storage. [2025-09-19T22:19:28.654372] [INFO ] [MAIN ] EPC: Loaded 40556 primary data records. [2025-09-19T22:19:29.013124] [DEBUG] [LOCAL ] EPD: Loaded 54396 existing records from primary storage. [2025-09-19T22:19:29.041977] [INFO ] [MAIN ] EPD: Loaded 54396 primary data records. [2025-09-19T22:19:29.607927] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:29.609185] [INFO ] [MAIN ] EPAM: Generated 1820 derivative records from 40338 primary records. [2025-09-19T22:19:29.609437] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-19T22:19:29.631994] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1820 records). [2025-09-19T22:19:29.632299] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-19T22:19:29.634695] [INFO ] [MAIN ] Derivative Progress: 625/2093 symbols completed. EPAM took 1.2s. Estimated remaining: 9m 32s. Rate: 154.1 symbols/min [2025-09-19T22:19:29.648712] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:29.650122] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:29.651352] [INFO ] [MAIN ] EPC: Generated 1820 derivative records from 40556 primary records. [2025-09-19T22:19:29.651547] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-19T22:19:29.674863] [DEBUG] [LOCAL ] EPC: Derivative data saved (1820 records). [2025-09-19T22:19:29.675395] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-19T22:19:29.677844] [INFO ] [MAIN ] Derivative Progress: 626/2093 symbols completed. EPC took 1.2s. Estimated remaining: 9m 30s. Rate: 154.3 symbols/min [2025-09-19T22:19:29.678316] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:29.692552] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:29.693342] [INFO ] [MAIN ] EPD: Generated 1820 derivative records from 54396 primary records. [2025-09-19T22:19:29.693458] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-19T22:19:29.721482] [DEBUG] [LOCAL ] EPD: Derivative data saved (1820 records). [2025-09-19T22:19:29.721636] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-19T22:19:29.724705] [INFO ] [MAIN ] Derivative Progress: 627/2093 symbols completed. EPD took 1.2s. Estimated remaining: 9m 29s. Rate: 154.5 symbols/min [2025-09-19T22:19:29.726098] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:29.739804] [DEBUG] [LOCAL ] EPR: Loaded 45037 existing records from primary storage. [2025-09-19T22:19:29.740069] [INFO ] [MAIN ] EPR: Loaded 45037 primary data records. [2025-09-19T22:19:29.862082] [DEBUG] [LOCAL ] EQBK: Loaded 11059 existing records from primary storage. [2025-09-19T22:19:29.867882] [INFO ] [MAIN ] EQBK: Loaded 11059 primary data records. [2025-09-19T22:19:30.049668] [DEBUG] [LOCAL ] EPRT: Loaded 49420 existing records from primary storage. [2025-09-19T22:19:30.088719] [INFO ] [MAIN ] EPRT: Loaded 49420 primary data records. [2025-09-19T22:19:30.717886] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:30.720469] [INFO ] [MAIN ] EPR: Generated 1820 derivative records from 45037 primary records. [2025-09-19T22:19:30.721737] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-19T22:19:30.744193] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:30.749427] [INFO ] [MAIN ] EQBK: Generated 1820 derivative records from 11059 primary records. [2025-09-19T22:19:30.752337] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-19T22:19:30.767227] [DEBUG] [LOCAL ] EPR: Derivative data saved (1820 records). [2025-09-19T22:19:30.768476] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-19T22:19:30.771436] [INFO ] [MAIN ] Derivative Progress: 628/2093 symbols completed. EPR took 1.1s. Estimated remaining: 9m 30s. Rate: 154.1 symbols/min [2025-09-19T22:19:30.779618] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1820 records). [2025-09-19T22:19:30.793935] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-19T22:19:30.793845] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:30.797446] [INFO ] [MAIN ] EPRT: Generated 1820 derivative records from 49420 primary records. [2025-09-19T22:19:30.796604] [INFO ] [MAIN ] Derivative Progress: 629/2093 symbols completed. EQBK took 1.1s. Estimated remaining: 9m 29s. Rate: 154.3 symbols/min [2025-09-19T22:19:30.797580] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-19T22:19:30.813419] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1820 records). [2025-09-19T22:19:30.813535] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-19T22:19:30.816450] [INFO ] [MAIN ] Derivative Progress: 630/2093 symbols completed. EPRT took 1.1s. Estimated remaining: 9m 28s. Rate: 154.6 symbols/min [2025-09-19T22:19:30.817210] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:30.817088] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:30.817266] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:30.895383] [DEBUG] [LOCAL ] EQNR: Loaded 53821 existing records from primary storage. [2025-09-19T22:19:30.895693] [INFO ] [MAIN ] EQNR: Loaded 53821 primary data records. [2025-09-19T22:19:31.030612] [DEBUG] [LOCAL ] EQR: Loaded 52136 existing records from primary storage. [2025-09-19T22:19:31.035050] [INFO ] [MAIN ] EQR: Loaded 52136 primary data records. [2025-09-19T22:19:31.056867] [DEBUG] [LOCAL ] EQT: Loaded 54462 existing records from primary storage. [2025-09-19T22:19:31.124850] [INFO ] [MAIN ] EQT: Loaded 54462 primary data records. [2025-09-19T22:19:31.966113] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:31.967971] [INFO ] [MAIN ] EQNR: Generated 1820 derivative records from 53821 primary records. [2025-09-19T22:19:31.968679] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-19T22:19:31.991919] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1820 records). [2025-09-19T22:19:31.992390] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-19T22:19:31.994317] [INFO ] [MAIN ] Derivative Progress: 631/2093 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 29s. Rate: 154.1 symbols/min [2025-09-19T22:19:31.994777] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:32.010090] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:32.011192] [INFO ] [MAIN ] EQR: Generated 1820 derivative records from 52136 primary records. [2025-09-19T22:19:32.011433] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-19T22:19:32.045476] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:32.046484] [INFO ] [MAIN ] EQT: Generated 1820 derivative records from 54462 primary records. [2025-09-19T22:19:32.046677] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-19T22:19:32.045183] [DEBUG] [LOCAL ] EQR: Derivative data saved (1820 records). [2025-09-19T22:19:32.046825] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-19T22:19:32.049981] [INFO ] [MAIN ] Derivative Progress: 632/2093 symbols completed. EQR took 1.2s. Estimated remaining: 9m 28s. Rate: 154.3 symbols/min [2025-09-19T22:19:32.051533] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:32.083568] [DEBUG] [LOCAL ] EQT: Derivative data saved (1820 records). [2025-09-19T22:19:32.083882] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-19T22:19:32.087269] [INFO ] [MAIN ] Derivative Progress: 633/2093 symbols completed. EQT took 1.3s. Estimated remaining: 9m 27s. Rate: 154.5 symbols/min [2025-09-19T22:19:32.087749] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:32.104633] [DEBUG] [LOCAL ] ERJ: Loaded 51594 existing records from primary storage. [2025-09-19T22:19:32.104895] [INFO ] [MAIN ] ERJ: Loaded 51594 primary data records. [2025-09-19T22:19:32.438775] [DEBUG] [LOCAL ] ERO: Loaded 41705 existing records from primary storage. [2025-09-19T22:19:32.439163] [INFO ] [MAIN ] ERO: Loaded 41705 primary data records. [2025-09-19T22:19:32.542625] [DEBUG] [LOCAL ] ES: Loaded 53295 existing records from primary storage. [2025-09-19T22:19:32.592699] [INFO ] [MAIN ] ES: Loaded 53295 primary data records. [2025-09-19T22:19:33.142888] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:33.153174] [INFO ] [MAIN ] ERJ: Generated 1820 derivative records from 51594 primary records. [2025-09-19T22:19:33.153495] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-19T22:19:33.180228] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1820 records). [2025-09-19T22:19:33.180790] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-19T22:19:33.183128] [INFO ] [MAIN ] Derivative Progress: 634/2093 symbols completed. ERJ took 1.2s. Estimated remaining: 9m 28s. Rate: 154.1 symbols/min [2025-09-19T22:19:33.183413] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:33.201983] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:33.203172] [INFO ] [MAIN ] ERO: Generated 1820 derivative records from 41705 primary records. [2025-09-19T22:19:33.203332] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-19T22:19:33.223376] [DEBUG] [LOCAL ] ERO: Derivative data saved (1820 records). [2025-09-19T22:19:33.231125] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-19T22:19:33.233304] [INFO ] [MAIN ] Derivative Progress: 635/2093 symbols completed. ERO took 1.2s. Estimated remaining: 9m 27s. Rate: 154.3 symbols/min [2025-09-19T22:19:33.246218] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:33.247477] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:33.248419] [INFO ] [MAIN ] ES: Generated 1820 derivative records from 53295 primary records. [2025-09-19T22:19:33.248693] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-19T22:19:33.275778] [DEBUG] [LOCAL ] ES: Derivative data saved (1820 records). [2025-09-19T22:19:33.272902] [DEBUG] [LOCAL ] ESAB: Loaded 26149 existing records from primary storage. [2025-09-19T22:19:33.276022] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-19T22:19:33.278979] [INFO ] [MAIN ] ESAB: Loaded 26149 primary data records. [2025-09-19T22:19:33.278887] [INFO ] [MAIN ] Derivative Progress: 636/2093 symbols completed. ES took 1.2s. Estimated remaining: 9m 26s. Rate: 154.5 symbols/min [2025-09-19T22:19:33.279509] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:33.348781] [DEBUG] [LOCAL ] ESE: Loaded 16887 existing records from primary storage. [2025-09-19T22:19:33.380472] [INFO ] [MAIN ] ESE: Loaded 16887 primary data records. [2025-09-19T22:19:34.007428] [DEBUG] [LOCAL ] ESI: Loaded 51608 existing records from primary storage. [2025-09-19T22:19:34.009078] [INFO ] [MAIN ] ESI: Loaded 51608 primary data records. [2025-09-19T22:19:34.347155] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:34.348460] [INFO ] [MAIN ] ESAB: Generated 1820 derivative records from 26149 primary records. [2025-09-19T22:19:34.348732] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-19T22:19:34.367628] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1820 records). [2025-09-19T22:19:34.367908] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-19T22:19:34.369912] [INFO ] [MAIN ] Derivative Progress: 637/2093 symbols completed. ESAB took 1.2s. Estimated remaining: 9m 27s. Rate: 154.0 symbols/min [2025-09-19T22:19:34.370319] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:34.389090] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:34.389946] [INFO ] [MAIN ] ESE: Generated 1820 derivative records from 16887 primary records. [2025-09-19T22:19:34.390327] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-19T22:19:34.410009] [DEBUG] [LOCAL ] ESE: Derivative data saved (1820 records). [2025-09-19T22:19:34.411092] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-19T22:19:34.414782] [INFO ] [MAIN ] Derivative Progress: 638/2093 symbols completed. ESE took 1.2s. Estimated remaining: 9m 26s. Rate: 154.3 symbols/min [2025-09-19T22:19:34.415460] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:34.439098] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:34.439927] [INFO ] [MAIN ] ESI: Generated 1820 derivative records from 51608 primary records. [2025-09-19T22:19:34.440083] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-19T22:19:34.467967] [DEBUG] [LOCAL ] ESI: Derivative data saved (1820 records). [2025-09-19T22:19:34.468147] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-19T22:19:34.471683] [INFO ] [MAIN ] Derivative Progress: 639/2093 symbols completed. ESI took 1.2s. Estimated remaining: 9m 25s. Rate: 154.5 symbols/min [2025-09-19T22:19:34.468732] [DEBUG] [LOCAL ] ESNT: Loaded 39389 existing records from primary storage. [2025-09-19T22:19:34.472100] [INFO ] [MAIN ] ESNT: Loaded 39389 primary data records. [2025-09-19T22:19:34.472410] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:34.695911] [DEBUG] [LOCAL ] ESRT: Loaded 47076 existing records from primary storage. [2025-09-19T22:19:34.699334] [INFO ] [MAIN ] ESRT: Loaded 47076 primary data records. [2025-09-19T22:19:34.700087] [DEBUG] [LOCAL ] ESS: Loaded 30525 existing records from primary storage. [2025-09-19T22:19:34.839054] [INFO ] [MAIN ] ESS: Loaded 30525 primary data records. [2025-09-19T22:19:35.475390] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:35.476760] [INFO ] [MAIN ] ESNT: Generated 1820 derivative records from 39389 primary records. [2025-09-19T22:19:35.476985] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-19T22:19:35.499742] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1820 records). [2025-09-19T22:19:35.501129] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-19T22:19:35.503484] [INFO ] [MAIN ] Derivative Progress: 640/2093 symbols completed. ESNT took 1.1s. Estimated remaining: 9m 26s. Rate: 154.1 symbols/min [2025-09-19T22:19:35.504335] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:35.518370] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:35.519133] [INFO ] [MAIN ] ESRT: Generated 1820 derivative records from 47076 primary records. [2025-09-19T22:19:35.519416] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-19T22:19:35.549546] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:35.552879] [INFO ] [MAIN ] ESS: Generated 1820 derivative records from 30525 primary records. [2025-09-19T22:19:35.551794] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1820 records). [2025-09-19T22:19:35.553077] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-19T22:19:35.553212] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-19T22:19:35.555615] [INFO ] [MAIN ] Derivative Progress: 641/2093 symbols completed. ESRT took 1.1s. Estimated remaining: 9m 25s. Rate: 154.3 symbols/min [2025-09-19T22:19:35.564006] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:35.572860] [DEBUG] [LOCAL ] ESS: Derivative data saved (1820 records). [2025-09-19T22:19:35.572994] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-19T22:19:35.575708] [INFO ] [MAIN ] Derivative Progress: 642/2093 symbols completed. ESS took 1.1s. Estimated remaining: 9m 24s. Rate: 154.5 symbols/min [2025-09-19T22:19:35.588976] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:35.612518] [DEBUG] [LOCAL ] ESTC: Loaded 50967 existing records from primary storage. [2025-09-19T22:19:35.612790] [INFO ] [MAIN ] ESTC: Loaded 50967 primary data records. [2025-09-19T22:19:35.673223] [DEBUG] [LOCAL ] ETB: Loaded 12338 existing records from primary storage. [2025-09-19T22:19:35.713592] [INFO ] [MAIN ] ETB: Loaded 12338 primary data records. [2025-09-19T22:19:35.956502] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-09-19T22:19:36.150257] [INFO ] [MAIN ] ET: Loaded 54569 primary data records. [2025-09-19T22:19:36.639091] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:36.640338] [INFO ] [MAIN ] ESTC: Generated 1820 derivative records from 50967 primary records. [2025-09-19T22:19:36.640717] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-19T22:19:36.666276] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:36.668721] [INFO ] [MAIN ] ETB: Generated 1820 derivative records from 12338 primary records. [2025-09-19T22:19:36.669206] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-19T22:19:36.689133] [DEBUG] [LOCAL ] ETB: Derivative data saved (1820 records). [2025-09-19T22:19:36.689591] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1820 records). [2025-09-19T22:19:36.690635] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-19T22:19:36.690580] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-19T22:19:36.693338] [INFO ] [MAIN ] Derivative Progress: 643/2093 symbols completed. ETB took 1.1s. Estimated remaining: 9m 25s. Rate: 154.0 symbols/min [2025-09-19T22:19:36.696406] [INFO ] [MAIN ] Derivative Progress: 644/2093 symbols completed. ESTC took 1.2s. Estimated remaining: 9m 23s. Rate: 154.3 symbols/min [2025-09-19T22:19:36.709905] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:36.710545] [INFO ] [MAIN ] ET: Generated 1820 derivative records from 54569 primary records. [2025-09-19T22:19:36.710606] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-19T22:19:36.726273] [DEBUG] [LOCAL ] ET: Derivative data saved (1820 records). [2025-09-19T22:19:36.726331] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-19T22:19:36.729294] [INFO ] [MAIN ] Derivative Progress: 645/2093 symbols completed. ET took 1.2s. Estimated remaining: 9m 22s. Rate: 154.5 symbols/min [2025-09-19T22:19:36.729995] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:36.730344] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:36.730198] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:36.769069] [DEBUG] [LOCAL ] ETG: Loaded 17227 existing records from primary storage. [2025-09-19T22:19:36.769763] [DEBUG] [LOCAL ] ETJ: Loaded 17236 existing records from primary storage. [2025-09-19T22:19:36.777483] [INFO ] [MAIN ] ETG: Loaded 17227 primary data records. [2025-09-19T22:19:36.777555] [INFO ] [MAIN ] ETJ: Loaded 17236 primary data records. [2025-09-19T22:19:36.821358] [DEBUG] [LOCAL ] ETD: Loaded 27755 existing records from primary storage. [2025-09-19T22:19:36.880335] [INFO ] [MAIN ] ETD: Loaded 27755 primary data records. [2025-09-19T22:19:37.823520] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:37.836441] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:37.837456] [INFO ] [MAIN ] ETJ: Generated 1820 derivative records from 17236 primary records. [2025-09-19T22:19:37.851338] [INFO ] [MAIN ] ETG: Generated 1820 derivative records from 17227 primary records. [2025-09-19T22:19:37.851773] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-19T22:19:37.851869] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-19T22:19:37.853813] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:37.862159] [INFO ] [MAIN ] ETD: Generated 1820 derivative records from 27755 primary records. [2025-09-19T22:19:37.882670] [DEBUG] [LOCAL ] ETG: Derivative data saved (1820 records). [2025-09-19T22:19:37.878536] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-19T22:19:37.883356] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-19T22:19:37.885867] [INFO ] [MAIN ] Derivative Progress: 646/2093 symbols completed. ETG took 1.2s. Estimated remaining: 9m 24s. Rate: 154.0 symbols/min [2025-09-19T22:19:37.888186] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:37.905396] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1820 records). [2025-09-19T22:19:37.906365] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-19T22:19:37.909492] [INFO ] [MAIN ] Derivative Progress: 647/2093 symbols completed. ETJ took 1.2s. Estimated remaining: 9m 22s. Rate: 154.3 symbols/min [2025-09-19T22:19:37.910797] [DEBUG] [LOCAL ] ETD: Derivative data saved (1820 records). [2025-09-19T22:19:37.911171] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:37.911092] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-19T22:19:37.914325] [INFO ] [MAIN ] Derivative Progress: 648/2093 symbols completed. ETD took 1.2s. Estimated remaining: 9m 21s. Rate: 154.5 symbols/min [2025-09-19T22:19:37.914750] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:37.925230] [DEBUG] [LOCAL ] ETO: Loaded 6704 existing records from primary storage. [2025-09-19T22:19:37.925387] [INFO ] [MAIN ] ETO: Loaded 6704 primary data records. [2025-09-19T22:19:38.272446] [DEBUG] [LOCAL ] ETN: Loaded 53621 existing records from primary storage. [2025-09-19T22:19:38.272966] [INFO ] [MAIN ] ETN: Loaded 53621 primary data records. [2025-09-19T22:19:38.402067] [DEBUG] [LOCAL ] ETR: Loaded 54016 existing records from primary storage. [2025-09-19T22:19:38.409007] [INFO ] [MAIN ] ETR: Loaded 54016 primary data records. [2025-09-19T22:19:38.969880] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:38.982841] [INFO ] [MAIN ] ETO: Generated 1820 derivative records from 6704 primary records. [2025-09-19T22:19:39.143577] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-19T22:19:39.192602] [DEBUG] [LOCAL ] ETO: Derivative data saved (1820 records). [2025-09-19T22:19:39.193353] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-19T22:19:39.197348] [INFO ] [MAIN ] Derivative Progress: 649/2093 symbols completed. ETO took 1.3s. Estimated remaining: 9m 23s. Rate: 153.9 symbols/min [2025-09-19T22:19:39.198583] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:39.229337] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:39.230586] [INFO ] [MAIN ] ETN: Generated 1820 derivative records from 53621 primary records. [2025-09-19T22:19:39.230772] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-19T22:19:39.272118] [DEBUG] [LOCAL ] ETN: Derivative data saved (1820 records). [2025-09-19T22:19:39.287068] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-19T22:19:39.306840] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:39.306091] [DEBUG] [LOCAL ] ETV: Loaded 21937 existing records from primary storage. [2025-09-19T22:19:39.307045] [INFO ] [MAIN ] ETV: Loaded 21937 primary data records. [2025-09-19T22:19:39.304560] [INFO ] [MAIN ] Derivative Progress: 650/2093 symbols completed. ETN took 1.4s. Estimated remaining: 9m 22s. Rate: 154.1 symbols/min [2025-09-19T22:19:39.320268] [INFO ] [MAIN ] ETR: Generated 1820 derivative records from 54016 primary records. [2025-09-19T22:19:39.319244] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:39.333739] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-19T22:19:39.583112] [DEBUG] [LOCAL ] ETR: Derivative data saved (1820 records). [2025-09-19T22:19:39.599149] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-19T22:19:39.600515] [DEBUG] [LOCAL ] ETW: Loaded 25741 existing records from primary storage. [2025-09-19T22:19:39.600851] [INFO ] [MAIN ] ETW: Loaded 25741 primary data records. [2025-09-19T22:19:39.604866] [INFO ] [MAIN ] Derivative Progress: 651/2093 symbols completed. ETR took 1.7s. Estimated remaining: 9m 21s. Rate: 154.2 symbols/min [2025-09-19T22:19:39.771853] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:39.875763] [DEBUG] [LOCAL ] ETX: Loaded 4960 existing records from primary storage. [2025-09-19T22:19:39.881167] [INFO ] [MAIN ] ETX: Loaded 4960 primary data records. [2025-09-19T22:19:40.443895] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:40.445138] [INFO ] [MAIN ] ETV: Generated 1820 derivative records from 21937 primary records. [2025-09-19T22:19:40.445340] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-19T22:19:40.468202] [DEBUG] [LOCAL ] ETV: Derivative data saved (1820 records). [2025-09-19T22:19:40.468409] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-19T22:19:40.470423] [INFO ] [MAIN ] Derivative Progress: 652/2093 symbols completed. ETV took 1.3s. Estimated remaining: 9m 22s. Rate: 153.9 symbols/min [2025-09-19T22:19:40.473612] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:40.487087] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:40.487860] [INFO ] [MAIN ] ETW: Generated 1820 derivative records from 25741 primary records. [2025-09-19T22:19:40.488176] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-19T22:19:40.524457] [DEBUG] [LOCAL ] ETW: Derivative data saved (1820 records). [2025-09-19T22:19:40.525063] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-19T22:19:40.527995] [INFO ] [MAIN ] Derivative Progress: 653/2093 symbols completed. ETW took 1.2s. Estimated remaining: 9m 21s. Rate: 154.1 symbols/min [2025-09-19T22:19:40.528280] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:40.524996] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:40.529278] [INFO ] [MAIN ] ETX: Generated 1820 derivative records from 4960 primary records. [2025-09-19T22:19:40.529709] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-19T22:19:40.549693] [DEBUG] [LOCAL ] ETY: Loaded 23320 existing records from primary storage. [2025-09-19T22:19:40.550383] [INFO ] [MAIN ] ETY: Loaded 23320 primary data records. [2025-09-19T22:19:40.638419] [DEBUG] [LOCAL ] ETX: Derivative data saved (1820 records). [2025-09-19T22:19:40.655724] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-19T22:19:40.665968] [INFO ] [MAIN ] Derivative Progress: 654/2093 symbols completed. ETX took 0.9s. Estimated remaining: 9m 20s. Rate: 154.2 symbols/min [2025-09-19T22:19:40.669965] [DEBUG] [LOCAL ] EVC: Loaded 20566 existing records from primary storage. [2025-09-19T22:19:40.670504] [INFO ] [MAIN ] EVC: Loaded 20566 primary data records. [2025-09-19T22:19:40.681040] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:41.189021] [DEBUG] [LOCAL ] EVEX: Loaded 29763 existing records from primary storage. [2025-09-19T22:19:41.190681] [INFO ] [MAIN ] EVEX: Loaded 29763 primary data records. [2025-09-19T22:19:41.516691] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:41.517598] [INFO ] [MAIN ] ETY: Generated 1820 derivative records from 23320 primary records. [2025-09-19T22:19:41.517897] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-19T22:19:41.551983] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:41.553928] [INFO ] [MAIN ] EVC: Generated 1820 derivative records from 20566 primary records. [2025-09-19T22:19:41.554616] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-19T22:19:41.557050] [DEBUG] [LOCAL ] ETY: Derivative data saved (1820 records). [2025-09-19T22:19:41.557348] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-19T22:19:41.566473] [INFO ] [MAIN ] Derivative Progress: 655/2093 symbols completed. ETY took 1.1s. Estimated remaining: 9m 21s. Rate: 153.9 symbols/min [2025-09-19T22:19:41.571736] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:41.577056] [DEBUG] [LOCAL ] EVC: Derivative data saved (1820 records). [2025-09-19T22:19:41.577202] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-19T22:19:41.579679] [INFO ] [MAIN ] Derivative Progress: 656/2093 symbols completed. EVC took 1.1s. Estimated remaining: 9m 19s. Rate: 154.2 symbols/min [2025-09-19T22:19:41.580320] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:41.588787] [DEBUG] [LOCAL ] EVF: Loaded 9194 existing records from primary storage. [2025-09-19T22:19:41.591567] [INFO ] [MAIN ] EVF: Loaded 9194 primary data records. [2025-09-19T22:19:41.630926] [DEBUG] [LOCAL ] EVG: Loaded 5883 existing records from primary storage. [2025-09-19T22:19:41.638361] [INFO ] [MAIN ] EVG: Loaded 5883 primary data records. [2025-09-19T22:19:41.713083] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:41.759154] [INFO ] [MAIN ] EVEX: Generated 1820 derivative records from 29763 primary records. [2025-09-19T22:19:41.789485] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-19T22:19:42.283034] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1820 records). [2025-09-19T22:19:42.283171] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-19T22:19:42.286208] [INFO ] [MAIN ] Derivative Progress: 657/2093 symbols completed. EVEX took 1.6s. Estimated remaining: 9m 20s. Rate: 154.0 symbols/min [2025-09-19T22:19:42.287376] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:42.332296] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:42.343583] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:42.344415] [INFO ] [MAIN ] EVF: Generated 1820 derivative records from 9194 primary records. [2025-09-19T22:19:42.345175] [INFO ] [MAIN ] EVG: Generated 1820 derivative records from 5883 primary records. [2025-09-19T22:19:42.345347] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-19T22:19:42.345425] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-19T22:19:42.387352] [DEBUG] [LOCAL ] EVH: Loaded 50085 existing records from primary storage. [2025-09-19T22:19:42.388464] [INFO ] [MAIN ] EVH: Loaded 50085 primary data records. [2025-09-19T22:19:42.401588] [DEBUG] [LOCAL ] EVG: Derivative data saved (1820 records). [2025-09-19T22:19:42.411992] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-19T22:19:42.425020] [INFO ] [MAIN ] Derivative Progress: 658/2093 symbols completed. EVG took 0.8s. Estimated remaining: 9m 19s. Rate: 154.1 symbols/min [2025-09-19T22:19:42.422755] [DEBUG] [LOCAL ] EVF: Derivative data saved (1820 records). [2025-09-19T22:19:42.459557] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-19T22:19:42.467725] [INFO ] [MAIN ] Derivative Progress: 659/2093 symbols completed. EVF took 0.9s. Estimated remaining: 9m 18s. Rate: 154.3 symbols/min [2025-09-19T22:19:42.718638] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:42.719369] [INFO ] [MAIN ] EVH: Generated 1820 derivative records from 50085 primary records. [2025-09-19T22:19:42.719458] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-19T22:19:42.735214] [DEBUG] [LOCAL ] EVH: Derivative data saved (1820 records). [2025-09-19T22:19:42.735286] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-19T22:19:42.737584] [INFO ] [MAIN ] Derivative Progress: 660/2093 symbols completed. EVH took 0.5s. Estimated remaining: 9m 17s. Rate: 154.4 symbols/min [2025-09-19T22:19:42.738122] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:42.738380] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:42.738487] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:42.760098] [DEBUG] [LOCAL ] EVN: Loaded 11051 existing records from primary storage. [2025-09-19T22:19:42.760362] [INFO ] [MAIN ] EVN: Loaded 11051 primary data records. [2025-09-19T22:19:42.852365] [DEBUG] [LOCAL ] EVT: Loaded 17841 existing records from primary storage. [2025-09-19T22:19:42.865295] [INFO ] [MAIN ] EVT: Loaded 17841 primary data records. [2025-09-19T22:19:43.017892] [DEBUG] [LOCAL ] EVR: Loaded 36434 existing records from primary storage. [2025-09-19T22:19:43.087069] [INFO ] [MAIN ] EVR: Loaded 36434 primary data records. [2025-09-19T22:19:43.785008] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:43.789006] [INFO ] [MAIN ] EVN: Generated 1820 derivative records from 11051 primary records. [2025-09-19T22:19:43.789780] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-19T22:19:43.817721] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:43.819827] [INFO ] [MAIN ] EVT: Generated 1820 derivative records from 17841 primary records. [2025-09-19T22:19:43.820425] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-19T22:19:43.841895] [DEBUG] [LOCAL ] EVN: Derivative data saved (1820 records). [2025-09-19T22:19:43.841994] [DEBUG] [LOCAL ] EVT: Derivative data saved (1820 records). [2025-09-19T22:19:43.843826] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-19T22:19:43.843100] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-19T22:19:43.846425] [INFO ] [MAIN ] Derivative Progress: 661/2093 symbols completed. EVN took 1.1s. Estimated remaining: 9m 18s. Rate: 154.0 symbols/min [2025-09-19T22:19:43.846801] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:43.849909] [INFO ] [MAIN ] Derivative Progress: 662/2093 symbols completed. EVT took 1.1s. Estimated remaining: 9m 17s. Rate: 154.2 symbols/min [2025-09-19T22:19:43.864113] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:43.863765] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:43.865305] [INFO ] [MAIN ] EVR: Generated 1820 derivative records from 36434 primary records. [2025-09-19T22:19:43.865741] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-19T22:19:43.883833] [DEBUG] [LOCAL ] EVR: Derivative data saved (1820 records). [2025-09-19T22:19:43.884008] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-19T22:19:43.886949] [INFO ] [MAIN ] Derivative Progress: 663/2093 symbols completed. EVR took 1.1s. Estimated remaining: 9m 16s. Rate: 154.4 symbols/min [2025-09-19T22:19:43.895110] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:43.923800] [DEBUG] [LOCAL ] EVTR: Loaded 23278 existing records from primary storage. [2025-09-19T22:19:43.924143] [INFO ] [MAIN ] EVTR: Loaded 23278 primary data records. [2025-09-19T22:19:43.924893] [DEBUG] [LOCAL ] EVTC: Loaded 27089 existing records from primary storage. [2025-09-19T22:19:43.925087] [INFO ] [MAIN ] EVTC: Loaded 27089 primary data records. [2025-09-19T22:19:44.632205] [DEBUG] [LOCAL ] EW: Loaded 54177 existing records from primary storage. [2025-09-19T22:19:44.633975] [INFO ] [MAIN ] EW: Loaded 54177 primary data records. [2025-09-19T22:19:44.995055] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:19:44.996663] [INFO ] [MAIN ] EVTR: Generated 1819 derivative records from 23278 primary records. [2025-09-19T22:19:44.995317] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:44.997567] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-19T22:19:44.997496] [INFO ] [MAIN ] EVTC: Generated 1820 derivative records from 27089 primary records. [2025-09-19T22:19:44.997850] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-19T22:19:45.030799] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1819 records). [2025-09-19T22:19:45.031347] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-19T22:19:45.034385] [INFO ] [MAIN ] Derivative Progress: 664/2093 symbols completed. EVTR took 1.2s. Estimated remaining: 9m 17s. Rate: 154.0 symbols/min [2025-09-19T22:19:45.035930] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:45.037035] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1820 records). [2025-09-19T22:19:45.038232] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-19T22:19:45.040874] [INFO ] [MAIN ] Derivative Progress: 665/2093 symbols completed. EVTC took 1.2s. Estimated remaining: 9m 16s. Rate: 154.2 symbols/min [2025-09-19T22:19:45.042126] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:45.056998] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:45.057722] [INFO ] [MAIN ] EW: Generated 1820 derivative records from 54177 primary records. [2025-09-19T22:19:45.057917] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-19T22:19:45.075877] [DEBUG] [LOCAL ] EW: Derivative data saved (1820 records). [2025-09-19T22:19:45.076056] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-19T22:19:45.079420] [INFO ] [MAIN ] Derivative Progress: 666/2093 symbols completed. EW took 1.2s. Estimated remaining: 9m 15s. Rate: 154.4 symbols/min [2025-09-19T22:19:45.079871] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:45.104733] [DEBUG] [LOCAL ] EXG: Loaded 35265 existing records from primary storage. [2025-09-19T22:19:45.117908] [INFO ] [MAIN ] EXG: Loaded 35265 primary data records. [2025-09-19T22:19:45.281223] [DEBUG] [LOCAL ] EXK: Loaded 53855 existing records from primary storage. [2025-09-19T22:19:45.301410] [INFO ] [MAIN ] EXK: Loaded 53855 primary data records. [2025-09-19T22:19:45.287098] [DEBUG] [LOCAL ] EXP: Loaded 30759 existing records from primary storage. [2025-09-19T22:19:45.342296] [INFO ] [MAIN ] EXP: Loaded 30759 primary data records. [2025-09-19T22:19:46.153996] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:46.156191] [INFO ] [MAIN ] EXG: Generated 1820 derivative records from 35265 primary records. [2025-09-19T22:19:46.156510] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-19T22:19:46.190255] [DEBUG] [LOCAL ] EXG: Derivative data saved (1820 records). [2025-09-19T22:19:46.190738] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:46.191441] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-19T22:19:46.195625] [INFO ] [MAIN ] EXK: Generated 1820 derivative records from 53855 primary records. [2025-09-19T22:19:46.194737] [INFO ] [MAIN ] Derivative Progress: 667/2093 symbols completed. EXG took 1.2s. Estimated remaining: 9m 16s. Rate: 154.0 symbols/min [2025-09-19T22:19:46.195826] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-19T22:19:46.196910] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:46.221786] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:46.222837] [INFO ] [MAIN ] EXP: Generated 1820 derivative records from 30759 primary records. [2025-09-19T22:19:46.223024] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-19T22:19:46.244893] [DEBUG] [LOCAL ] EXP: Derivative data saved (1820 records). [2025-09-19T22:19:46.245937] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-19T22:19:46.249079] [INFO ] [MAIN ] Derivative Progress: 668/2093 symbols completed. EXP took 1.2s. Estimated remaining: 9m 15s. Rate: 154.2 symbols/min [2025-09-19T22:19:46.250130] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:46.251439] [DEBUG] [LOCAL ] EXK: Derivative data saved (1820 records). [2025-09-19T22:19:46.251620] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-19T22:19:46.270739] [INFO ] [MAIN ] Derivative Progress: 669/2093 symbols completed. EXK took 1.2s. Estimated remaining: 9m 13s. Rate: 154.4 symbols/min [2025-09-19T22:19:46.272365] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:46.342777] [DEBUG] [LOCAL ] EXR: Loaded 46271 existing records from primary storage. [2025-09-19T22:19:46.355779] [INFO ] [MAIN ] EXR: Loaded 46271 primary data records. [2025-09-19T22:19:46.400699] [DEBUG] [LOCAL ] EXPD: Loaded 48955 existing records from primary storage. [2025-09-19T22:19:46.413225] [INFO ] [MAIN ] EXPD: Loaded 48955 primary data records. [2025-09-19T22:19:46.494773] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-09-19T22:19:46.531287] [INFO ] [MAIN ] F: Loaded 54600 primary data records. [2025-09-19T22:19:47.345955] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:47.359768] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:47.359357] [INFO ] [MAIN ] EXR: Generated 1820 derivative records from 46271 primary records. [2025-09-19T22:19:47.360590] [INFO ] [MAIN ] EXPD: Generated 1820 derivative records from 48955 primary records. [2025-09-19T22:19:47.360757] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-19T22:19:47.360715] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-19T22:19:47.393853] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1820 records). [2025-09-19T22:19:47.394568] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-19T22:19:47.397724] [INFO ] [MAIN ] Derivative Progress: 670/2093 symbols completed. EXPD took 1.2s. Estimated remaining: 9m 15s. Rate: 153.9 symbols/min [2025-09-19T22:19:47.407285] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:47.413972] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:47.415729] [INFO ] [MAIN ] F: Generated 1820 derivative records from 54600 primary records. [2025-09-19T22:19:47.415929] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-19T22:19:47.417889] [DEBUG] [LOCAL ] EXR: Derivative data saved (1820 records). [2025-09-19T22:19:47.417956] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-19T22:19:47.427192] [INFO ] [MAIN ] Derivative Progress: 671/2093 symbols completed. EXR took 1.2s. Estimated remaining: 9m 13s. Rate: 154.1 symbols/min [2025-09-19T22:19:47.431459] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:47.436868] [DEBUG] [LOCAL ] F: Derivative data saved (1820 records). [2025-09-19T22:19:47.437016] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-19T22:19:47.440364] [INFO ] [MAIN ] Derivative Progress: 672/2093 symbols completed. F took 1.2s. Estimated remaining: 9m 12s. Rate: 154.4 symbols/min [2025-09-19T22:19:47.440668] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:47.478439] [DEBUG] [LOCAL ] FBK: Loaded 25716 existing records from primary storage. [2025-09-19T22:19:47.492829] [INFO ] [MAIN ] FBK: Loaded 25716 primary data records. [2025-09-19T22:19:47.527514] [DEBUG] [LOCAL ] FAF: Loaded 42663 existing records from primary storage. [2025-09-19T22:19:47.560232] [INFO ] [MAIN ] FAF: Loaded 42663 primary data records. [2025-09-19T22:19:47.698320] [DEBUG] [LOCAL ] FBIN: Loaded 51209 existing records from primary storage. [2025-09-19T22:19:47.740727] [INFO ] [MAIN ] FBIN: Loaded 51209 primary data records. [2025-09-19T22:19:48.567258] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:48.568403] [INFO ] [MAIN ] FBK: Generated 1820 derivative records from 25716 primary records. [2025-09-19T22:19:48.571615] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-19T22:19:48.615042] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:48.619408] [INFO ] [MAIN ] FBIN: Generated 1820 derivative records from 51209 primary records. [2025-09-19T22:19:48.617244] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:48.619867] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-19T22:19:48.621535] [INFO ] [MAIN ] FAF: Generated 1820 derivative records from 42663 primary records. [2025-09-19T22:19:48.622181] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-19T22:19:48.623089] [DEBUG] [LOCAL ] FBK: Derivative data saved (1820 records). [2025-09-19T22:19:48.631215] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-19T22:19:48.633206] [INFO ] [MAIN ] Derivative Progress: 673/2093 symbols completed. FBK took 1.2s. Estimated remaining: 9m 14s. Rate: 153.9 symbols/min [2025-09-19T22:19:48.655617] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1820 records). [2025-09-19T22:19:48.656935] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-19T22:19:48.659525] [INFO ] [MAIN ] Derivative Progress: 674/2093 symbols completed. FBIN took 1.2s. Estimated remaining: 9m 12s. Rate: 154.1 symbols/min [2025-09-19T22:19:48.656871] [DEBUG] [LOCAL ] FAF: Derivative data saved (1820 records). [2025-09-19T22:19:48.659861] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-19T22:19:48.662756] [INFO ] [MAIN ] Derivative Progress: 675/2093 symbols completed. FAF took 1.3s. Estimated remaining: 9m 11s. Rate: 154.3 symbols/min [2025-09-19T22:19:48.663436] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:48.663312] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:48.663580] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:48.684522] [DEBUG] [LOCAL ] FC: Loaded 15640 existing records from primary storage. [2025-09-19T22:19:48.684699] [INFO ] [MAIN ] FC: Loaded 15640 primary data records. [2025-09-19T22:19:48.843540] [DEBUG] [LOCAL ] FBRT: Loaded 34817 existing records from primary storage. [2025-09-19T22:19:48.879089] [INFO ] [MAIN ] FBRT: Loaded 34817 primary data records. [2025-09-19T22:19:48.921906] [DEBUG] [LOCAL ] FBP: Loaded 47037 existing records from primary storage. [2025-09-19T22:19:48.932261] [INFO ] [MAIN ] FBP: Loaded 47037 primary data records. [2025-09-19T22:19:49.714288] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:49.715373] [INFO ] [MAIN ] FC: Generated 1820 derivative records from 15640 primary records. [2025-09-19T22:19:49.715571] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-19T22:19:49.736113] [DEBUG] [LOCAL ] FC: Derivative data saved (1820 records). [2025-09-19T22:19:49.736313] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-19T22:19:49.739816] [INFO ] [MAIN ] Derivative Progress: 676/2093 symbols completed. FC took 1.1s. Estimated remaining: 9m 12s. Rate: 153.9 symbols/min [2025-09-19T22:19:49.740219] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:49.754215] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:49.754976] [INFO ] [MAIN ] FBRT: Generated 1820 derivative records from 34817 primary records. [2025-09-19T22:19:49.756137] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-19T22:19:49.782886] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:49.784550] [INFO ] [MAIN ] FBP: Generated 1820 derivative records from 47037 primary records. [2025-09-19T22:19:49.785075] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-19T22:19:49.811318] [DEBUG] [LOCAL ] FBP: Derivative data saved (1820 records). [2025-09-19T22:19:49.812251] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-19T22:19:49.812190] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1820 records). [2025-09-19T22:19:49.812358] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-19T22:19:49.815158] [INFO ] [MAIN ] Derivative Progress: 677/2093 symbols completed. FBRT took 1.2s. Estimated remaining: 9m 11s. Rate: 154.1 symbols/min [2025-09-19T22:19:49.819082] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:49.819176] [INFO ] [MAIN ] Derivative Progress: 678/2093 symbols completed. FBP took 1.2s. Estimated remaining: 9m 10s. Rate: 154.3 symbols/min [2025-09-19T22:19:49.819913] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:49.831472] [DEBUG] [LOCAL ] FCN: Loaded 26751 existing records from primary storage. [2025-09-19T22:19:49.831615] [INFO ] [MAIN ] FCN: Loaded 26751 primary data records. [2025-09-19T22:19:49.949874] [DEBUG] [LOCAL ] FCT: Loaded 14568 existing records from primary storage. [2025-09-19T22:19:49.950047] [INFO ] [MAIN ] FCT: Loaded 14568 primary data records. [2025-09-19T22:19:50.309955] [DEBUG] [LOCAL ] FCPT: Loaded 38112 existing records from primary storage. [2025-09-19T22:19:50.332666] [INFO ] [MAIN ] FCPT: Loaded 38112 primary data records. [2025-09-19T22:19:50.886916] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:50.887890] [INFO ] [MAIN ] FCN: Generated 1820 derivative records from 26751 primary records. [2025-09-19T22:19:50.888123] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-19T22:19:50.906923] [DEBUG] [LOCAL ] FCN: Derivative data saved (1820 records). [2025-09-19T22:19:50.908445] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-19T22:19:50.910766] [INFO ] [MAIN ] Derivative Progress: 679/2093 symbols completed. FCN took 1.2s. Estimated remaining: 9m 11s. Rate: 153.9 symbols/min [2025-09-19T22:19:50.911349] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:50.925918] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:50.926718] [INFO ] [MAIN ] FCT: Generated 1820 derivative records from 14568 primary records. [2025-09-19T22:19:50.926890] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-19T22:19:50.944386] [DEBUG] [LOCAL ] FCT: Derivative data saved (1820 records). [2025-09-19T22:19:50.945995] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-19T22:19:50.948571] [INFO ] [MAIN ] Derivative Progress: 680/2093 symbols completed. FCT took 1.1s. Estimated remaining: 9m 10s. Rate: 154.1 symbols/min [2025-09-19T22:19:50.949032] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:50.964286] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:50.965180] [INFO ] [MAIN ] FCPT: Generated 1820 derivative records from 38112 primary records. [2025-09-19T22:19:50.965279] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-19T22:19:50.982118] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1820 records). [2025-09-19T22:19:50.982227] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-19T22:19:50.986174] [INFO ] [MAIN ] Derivative Progress: 681/2093 symbols completed. FCPT took 1.2s. Estimated remaining: 9m 9s. Rate: 154.3 symbols/min [2025-09-19T22:19:50.986664] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:51.029238] [DEBUG] [LOCAL ] FCX: Loaded 54480 existing records from primary storage. [2025-09-19T22:19:51.029456] [INFO ] [MAIN ] FCX: Loaded 54480 primary data records. [2025-09-19T22:19:51.151311] [DEBUG] [LOCAL ] FDP: Loaded 30932 existing records from primary storage. [2025-09-19T22:19:51.163039] [INFO ] [MAIN ] FDP: Loaded 30932 primary data records. [2025-09-19T22:19:51.179749] [DEBUG] [LOCAL ] FDS: Loaded 26237 existing records from primary storage. [2025-09-19T22:19:51.180028] [INFO ] [MAIN ] FDS: Loaded 26237 primary data records. [2025-09-19T22:19:52.062018] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:52.062980] [INFO ] [MAIN ] FCX: Generated 1820 derivative records from 54480 primary records. [2025-09-19T22:19:52.063116] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-19T22:19:52.082815] [DEBUG] [LOCAL ] FCX: Derivative data saved (1820 records). [2025-09-19T22:19:52.083119] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-19T22:19:52.085131] [INFO ] [MAIN ] Derivative Progress: 682/2093 symbols completed. FCX took 1.2s. Estimated remaining: 9m 10s. Rate: 153.9 symbols/min [2025-09-19T22:19:52.085495] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:52.119548] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:52.119273] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:52.120319] [INFO ] [MAIN ] FDP: Generated 1820 derivative records from 30932 primary records. [2025-09-19T22:19:52.120939] [INFO ] [MAIN ] FDS: Generated 1820 derivative records from 26237 primary records. [2025-09-19T22:19:52.121142] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-19T22:19:52.121232] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-19T22:19:52.151782] [DEBUG] [LOCAL ] FDP: Derivative data saved (1820 records). [2025-09-19T22:19:52.153561] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-19T22:19:52.157003] [INFO ] [MAIN ] Derivative Progress: 683/2093 symbols completed. FDP took 1.2s. Estimated remaining: 9m 9s. Rate: 154.1 symbols/min [2025-09-19T22:19:52.157815] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:52.158712] [DEBUG] [LOCAL ] FDS: Derivative data saved (1820 records). [2025-09-19T22:19:52.159199] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-19T22:19:52.161940] [INFO ] [MAIN ] Derivative Progress: 684/2093 symbols completed. FDS took 1.2s. Estimated remaining: 9m 8s. Rate: 154.3 symbols/min [2025-09-19T22:19:52.162352] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:52.202404] [DEBUG] [LOCAL ] FDX: Loaded 52338 existing records from primary storage. [2025-09-19T22:19:52.202667] [INFO ] [MAIN ] FDX: Loaded 52338 primary data records. [2025-09-19T22:19:52.592773] [DEBUG] [LOCAL ] FE: Loaded 54219 existing records from primary storage. [2025-09-19T22:19:52.605251] [INFO ] [MAIN ] FE: Loaded 54219 primary data records. [2025-09-19T22:19:52.654108] [DEBUG] [LOCAL ] FERG: Loaded 49797 existing records from primary storage. [2025-09-19T22:19:52.694482] [INFO ] [MAIN ] FERG: Loaded 49797 primary data records. [2025-09-19T22:19:53.253289] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:53.255932] [INFO ] [MAIN ] FDX: Generated 1820 derivative records from 52338 primary records. [2025-09-19T22:19:53.257670] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-19T22:19:53.278232] [DEBUG] [LOCAL ] FDX: Derivative data saved (1820 records). [2025-09-19T22:19:53.278638] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-19T22:19:53.281042] [INFO ] [MAIN ] Derivative Progress: 685/2093 symbols completed. FDX took 1.2s. Estimated remaining: 9m 9s. Rate: 153.9 symbols/min [2025-09-19T22:19:53.282091] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:53.299828] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:19:53.300673] [INFO ] [MAIN ] FE: Generated 1819 derivative records from 54219 primary records. [2025-09-19T22:19:53.300946] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-19T22:19:53.324556] [DEBUG] [LOCAL ] FE: Derivative data saved (1819 records). [2025-09-19T22:19:53.341801] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-19T22:19:53.342416] [DEBUG] [LOCAL ] FET: Loaded 12925 existing records from primary storage. [2025-09-19T22:19:53.344933] [INFO ] [MAIN ] Derivative Progress: 686/2093 symbols completed. FE took 1.2s. Estimated remaining: 9m 8s. Rate: 154.1 symbols/min [2025-09-19T22:19:53.345335] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:53.345707] [INFO ] [MAIN ] FET: Loaded 12925 primary data records. [2025-09-19T22:19:53.346795] [INFO ] [MAIN ] FERG: Generated 1820 derivative records from 49797 primary records. [2025-09-19T22:19:53.345784] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:53.346957] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-19T22:19:53.466150] [DEBUG] [LOCAL ] FERG: Derivative data saved (1820 records). [2025-09-19T22:19:53.478532] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-19T22:19:53.489543] [INFO ] [MAIN ] Derivative Progress: 687/2093 symbols completed. FERG took 1.3s. Estimated remaining: 9m 7s. Rate: 154.2 symbols/min [2025-09-19T22:19:53.532977] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:53.561475] [DEBUG] [LOCAL ] FF: Loaded 26197 existing records from primary storage. [2025-09-19T22:19:53.581408] [INFO ] [MAIN ] FF: Loaded 26197 primary data records. [2025-09-19T22:19:53.771939] [DEBUG] [LOCAL ] FFA: Loaded 5687 existing records from primary storage. [2025-09-19T22:19:53.792704] [INFO ] [MAIN ] FFA: Loaded 5687 primary data records. [2025-09-19T22:19:54.399137] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:54.400269] [INFO ] [MAIN ] FET: Generated 1820 derivative records from 12925 primary records. [2025-09-19T22:19:54.403435] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-19T22:19:54.434808] [DEBUG] [LOCAL ] FET: Derivative data saved (1820 records). [2025-09-19T22:19:54.430297] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:54.435286] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-19T22:19:54.437609] [INFO ] [MAIN ] Derivative Progress: 688/2093 symbols completed. FET took 1.2s. Estimated remaining: 9m 8s. Rate: 153.9 symbols/min [2025-09-19T22:19:54.438371] [INFO ] [MAIN ] FF: Generated 1820 derivative records from 26197 primary records. [2025-09-19T22:19:54.439186] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-19T22:19:54.458690] [DEBUG] [LOCAL ] FF: Derivative data saved (1820 records). [2025-09-19T22:19:54.459042] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-19T22:19:54.461680] [INFO ] [MAIN ] Derivative Progress: 689/2093 symbols completed. FF took 1.1s. Estimated remaining: 9m 7s. Rate: 154.1 symbols/min [2025-09-19T22:19:54.474177] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:54.474803] [INFO ] [MAIN ] FFA: Generated 1820 derivative records from 5687 primary records. [2025-09-19T22:19:54.474864] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-19T22:19:54.489417] [DEBUG] [LOCAL ] FFA: Derivative data saved (1820 records). [2025-09-19T22:19:54.489474] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-19T22:19:54.492283] [INFO ] [MAIN ] Derivative Progress: 690/2093 symbols completed. FFA took 1.0s. Estimated remaining: 9m 5s. Rate: 154.3 symbols/min [2025-09-19T22:19:54.493221] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:54.493364] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:54.493560] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:54.538425] [DEBUG] [LOCAL ] FG: Loaded 22587 existing records from primary storage. [2025-09-19T22:19:54.538081] [DEBUG] [LOCAL ] FFC: Loaded 16868 existing records from primary storage. [2025-09-19T22:19:54.538589] [INFO ] [MAIN ] FG: Loaded 22587 primary data records. [2025-09-19T22:19:54.538692] [INFO ] [MAIN ] FFC: Loaded 16868 primary data records. [2025-09-19T22:19:54.642365] [DEBUG] [LOCAL ] FFWM: Loaded 36810 existing records from primary storage. [2025-09-19T22:19:54.652047] [INFO ] [MAIN ] FFWM: Loaded 36810 primary data records. [2025-09-19T22:19:55.583542] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:55.584063] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:55.585120] [INFO ] [MAIN ] FG: Generated 1820 derivative records from 22587 primary records. [2025-09-19T22:19:55.586076] [INFO ] [MAIN ] FFC: Generated 1820 derivative records from 16868 primary records. [2025-09-19T22:19:55.585451] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-19T22:19:55.586199] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-19T22:19:55.620512] [DEBUG] [LOCAL ] FG: Derivative data saved (1820 records). [2025-09-19T22:19:55.620800] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-19T22:19:55.623725] [INFO ] [MAIN ] Derivative Progress: 691/2093 symbols completed. FG took 1.1s. Estimated remaining: 9m 7s. Rate: 153.9 symbols/min [2025-09-19T22:19:55.619582] [DEBUG] [LOCAL ] FFC: Derivative data saved (1820 records). [2025-09-19T22:19:55.625099] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-19T22:19:55.625190] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:55.627881] [INFO ] [MAIN ] Derivative Progress: 692/2093 symbols completed. FFC took 1.1s. Estimated remaining: 9m 5s. Rate: 154.1 symbols/min [2025-09-19T22:19:55.636543] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:55.642831] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:55.643697] [INFO ] [MAIN ] FFWM: Generated 1820 derivative records from 36810 primary records. [2025-09-19T22:19:55.646275] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-19T22:19:55.658321] [DEBUG] [LOCAL ] FGN: Loaded 4085 existing records from primary storage. [2025-09-19T22:19:55.658476] [INFO ] [MAIN ] FGN: Loaded 4085 primary data records. [2025-09-19T22:19:55.717527] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1820 records). [2025-09-19T22:19:55.747598] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-19T22:19:55.780114] [INFO ] [MAIN ] Derivative Progress: 693/2093 symbols completed. FFWM took 1.3s. Estimated remaining: 9m 5s. Rate: 154.3 symbols/min [2025-09-19T22:19:55.789968] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:56.011404] [DEBUG] [LOCAL ] FHI: Loaded 41458 existing records from primary storage. [2025-09-19T22:19:56.012892] [INFO ] [MAIN ] FHI: Loaded 41458 primary data records. [2025-09-19T22:19:56.348410] [DEBUG] [LOCAL ] FHN: Loaded 54148 existing records from primary storage. [2025-09-19T22:19:56.351991] [INFO ] [MAIN ] FHN: Loaded 54148 primary data records. [2025-09-19T22:19:56.443468] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:56.468354] [INFO ] [MAIN ] FGN: Generated 1820 derivative records from 4085 primary records. [2025-09-19T22:19:56.472096] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-19T22:19:56.570573] [DEBUG] [LOCAL ] FGN: Derivative data saved (1820 records). [2025-09-19T22:19:56.570768] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-19T22:19:56.572770] [INFO ] [MAIN ] Derivative Progress: 694/2093 symbols completed. FGN took 0.9s. Estimated remaining: 9m 5s. Rate: 154.0 symbols/min [2025-09-19T22:19:56.573304] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:56.760225] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:56.761529] [INFO ] [MAIN ] FHI: Generated 1820 derivative records from 41458 primary records. [2025-09-19T22:19:56.761862] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-19T22:19:56.779692] [DEBUG] [LOCAL ] FHI: Derivative data saved (1820 records). [2025-09-19T22:19:56.779910] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-19T22:19:56.782615] [INFO ] [MAIN ] Derivative Progress: 695/2093 symbols completed. FHI took 1.1s. Estimated remaining: 9m 4s. Rate: 154.1 symbols/min [2025-09-19T22:19:56.784081] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:56.817253] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:56.818014] [INFO ] [MAIN ] FHN: Generated 1820 derivative records from 54148 primary records. [2025-09-19T22:19:56.818894] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-19T22:19:56.854126] [DEBUG] [LOCAL ] FHN: Derivative data saved (1820 records). [2025-09-19T22:19:56.854295] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-19T22:19:56.856746] [INFO ] [MAIN ] Derivative Progress: 696/2093 symbols completed. FHN took 1.1s. Estimated remaining: 9m 3s. Rate: 154.3 symbols/min [2025-09-19T22:19:56.857855] [DEBUG] [LOCAL ] FI: Loaded 54278 existing records from primary storage. [2025-09-19T22:19:56.865077] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:56.865245] [INFO ] [MAIN ] FI: Loaded 54278 primary data records. [2025-09-19T22:19:56.865768] [DEBUG] [LOCAL ] FICO: Loaded 20784 existing records from primary storage. [2025-09-19T22:19:56.877304] [INFO ] [MAIN ] FICO: Loaded 20784 primary data records. [2025-09-19T22:19:57.535301] [DEBUG] [LOCAL ] FIGS: Loaded 49796 existing records from primary storage. [2025-09-19T22:19:57.535564] [INFO ] [MAIN ] FIGS: Loaded 49796 primary data records. [2025-09-19T22:19:57.875059] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:57.876030] [INFO ] [MAIN ] FI: Generated 1820 derivative records from 54278 primary records. [2025-09-19T22:19:57.879226] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-19T22:19:57.909957] [DEBUG] [LOCAL ] FI: Derivative data saved (1820 records). [2025-09-19T22:19:57.910678] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:57.910748] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-19T22:19:57.914220] [INFO ] [MAIN ] Derivative Progress: 697/2093 symbols completed. FI took 1.3s. Estimated remaining: 9m 4s. Rate: 153.9 symbols/min [2025-09-19T22:19:57.915615] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:57.915468] [INFO ] [MAIN ] FICO: Generated 1820 derivative records from 20784 primary records. [2025-09-19T22:19:57.915814] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-19T22:19:57.933928] [DEBUG] [LOCAL ] FICO: Derivative data saved (1820 records). [2025-09-19T22:19:57.934104] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-19T22:19:57.936773] [INFO ] [MAIN ] Derivative Progress: 698/2093 symbols completed. FICO took 1.2s. Estimated remaining: 9m 3s. Rate: 154.1 symbols/min [2025-09-19T22:19:57.937375] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:57.958103] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:57.959068] [INFO ] [MAIN ] FIGS: Generated 1820 derivative records from 49796 primary records. [2025-09-19T22:19:57.959233] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-19T22:19:57.975369] [DEBUG] [LOCAL ] FINS: Loaded 8288 existing records from primary storage. [2025-09-19T22:19:57.976682] [INFO ] [MAIN ] FINS: Loaded 8288 primary data records. [2025-09-19T22:19:57.979920] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1820 records). [2025-09-19T22:19:58.025997] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-19T22:19:58.047532] [INFO ] [MAIN ] Derivative Progress: 699/2093 symbols completed. FIGS took 1.2s. Estimated remaining: 9m 2s. Rate: 154.3 symbols/min [2025-09-19T22:19:58.073850] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:58.108860] [DEBUG] [LOCAL ] FIHL: Loaded 41125 existing records from primary storage. [2025-09-19T22:19:58.114989] [INFO ] [MAIN ] FIHL: Loaded 41125 primary data records. [2025-09-19T22:19:58.685032] [DEBUG] [LOCAL ] FINV: Loaded 45658 existing records from primary storage. [2025-09-19T22:19:58.685362] [INFO ] [MAIN ] FINV: Loaded 45658 primary data records. [2025-09-19T22:19:59.025968] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:59.027930] [INFO ] [MAIN ] FINS: Generated 1820 derivative records from 8288 primary records. [2025-09-19T22:19:59.028106] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-19T22:19:59.060159] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:59.061572] [INFO ] [MAIN ] FIHL: Generated 1820 derivative records from 41125 primary records. [2025-09-19T22:19:59.062147] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-19T22:19:59.086212] [DEBUG] [LOCAL ] FINS: Derivative data saved (1820 records). [2025-09-19T22:19:59.087561] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1820 records). [2025-09-19T22:19:59.087805] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-19T22:19:59.088131] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-19T22:19:59.090496] [INFO ] [MAIN ] Derivative Progress: 700/2093 symbols completed. FINS took 1.2s. Estimated remaining: 9m 3s. Rate: 153.9 symbols/min [2025-09-19T22:19:59.090968] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:59.094146] [INFO ] [MAIN ] Derivative Progress: 701/2093 symbols completed. FIHL took 1.2s. Estimated remaining: 9m 2s. Rate: 154.2 symbols/min [2025-09-19T22:19:59.094503] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:59.112155] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:19:59.112898] [INFO ] [MAIN ] FINV: Generated 1820 derivative records from 45658 primary records. [2025-09-19T22:19:59.112960] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-19T22:19:59.131063] [DEBUG] [LOCAL ] FINV: Derivative data saved (1820 records). [2025-09-19T22:19:59.131211] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-19T22:19:59.133712] [INFO ] [MAIN ] Derivative Progress: 702/2093 symbols completed. FINV took 1.1s. Estimated remaining: 9m 1s. Rate: 154.4 symbols/min [2025-09-19T22:19:59.134134] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:19:59.144562] [DEBUG] [LOCAL ] FLC: Loaded 5799 existing records from primary storage. [2025-09-19T22:19:59.144822] [INFO ] [MAIN ] FLC: Loaded 5799 primary data records. [2025-09-19T22:19:59.296945] [DEBUG] [LOCAL ] FIX: Loaded 31371 existing records from primary storage. [2025-09-19T22:19:59.308768] [INFO ] [MAIN ] FIX: Loaded 31371 primary data records. [2025-09-19T22:19:59.642236] [DEBUG] [LOCAL ] FIS: Loaded 54148 existing records from primary storage. [2025-09-19T22:19:59.659014] [INFO ] [MAIN ] FIS: Loaded 54148 primary data records. [2025-09-19T22:20:00.172879] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:00.175492] [INFO ] [MAIN ] FLC: Generated 1820 derivative records from 5799 primary records. [2025-09-19T22:20:00.176637] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-19T22:20:00.205721] [DEBUG] [LOCAL ] FLC: Derivative data saved (1820 records). [2025-09-19T22:20:00.206323] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-19T22:20:00.206219] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:00.208673] [INFO ] [MAIN ] Derivative Progress: 703/2093 symbols completed. FLC took 1.1s. Estimated remaining: 9m 2s. Rate: 154.0 symbols/min [2025-09-19T22:20:00.209546] [INFO ] [MAIN ] FIX: Generated 1820 derivative records from 31371 primary records. [2025-09-19T22:20:00.209824] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-19T22:20:00.230827] [DEBUG] [LOCAL ] FIX: Derivative data saved (1820 records). [2025-09-19T22:20:00.231136] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-19T22:20:00.233588] [INFO ] [MAIN ] Derivative Progress: 704/2093 symbols completed. FIX took 1.1s. Estimated remaining: 9m 1s. Rate: 154.2 symbols/min [2025-09-19T22:20:00.249405] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:00.250036] [INFO ] [MAIN ] FIS: Generated 1820 derivative records from 54148 primary records. [2025-09-19T22:20:00.250099] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-19T22:20:00.266095] [DEBUG] [LOCAL ] FIS: Derivative data saved (1820 records). [2025-09-19T22:20:00.266169] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-19T22:20:00.268869] [INFO ] [MAIN ] Derivative Progress: 705/2093 symbols completed. FIS took 1.2s. Estimated remaining: 8m 59s. Rate: 154.4 symbols/min [2025-09-19T22:20:00.269758] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:00.269630] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:00.269459] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:00.345410] [DEBUG] [LOCAL ] FLNG: Loaded 34778 existing records from primary storage. [2025-09-19T22:20:00.345624] [INFO ] [MAIN ] FLNG: Loaded 34778 primary data records. [2025-09-19T22:20:00.479583] [DEBUG] [LOCAL ] FLG: Loaded 54112 existing records from primary storage. [2025-09-19T22:20:00.478842] [DEBUG] [LOCAL ] FLO: Loaded 52630 existing records from primary storage. [2025-09-19T22:20:00.485460] [INFO ] [MAIN ] FLO: Loaded 52630 primary data records. [2025-09-19T22:20:00.485574] [INFO ] [MAIN ] FLG: Loaded 54112 primary data records. [2025-09-19T22:20:01.380604] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:01.382419] [INFO ] [MAIN ] FLNG: Generated 1820 derivative records from 34778 primary records. [2025-09-19T22:20:01.382715] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-19T22:20:01.402860] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1820 records). [2025-09-19T22:20:01.405376] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-19T22:20:01.407348] [INFO ] [MAIN ] Derivative Progress: 706/2093 symbols completed. FLNG took 1.1s. Estimated remaining: 9m 1s. Rate: 153.9 symbols/min [2025-09-19T22:20:01.420692] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:01.421519] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:01.436435] [INFO ] [MAIN ] FLG: Generated 1820 derivative records from 54112 primary records. [2025-09-19T22:20:01.436716] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-19T22:20:01.437180] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:01.439485] [INFO ] [MAIN ] FLO: Generated 1820 derivative records from 52630 primary records. [2025-09-19T22:20:01.439909] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-19T22:20:01.457408] [DEBUG] [LOCAL ] FLG: Derivative data saved (1820 records). [2025-09-19T22:20:01.473354] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-19T22:20:01.477481] [INFO ] [MAIN ] Derivative Progress: 707/2093 symbols completed. FLG took 1.2s. Estimated remaining: 8m 60s. Rate: 154.1 symbols/min [2025-09-19T22:20:01.477615] [DEBUG] [LOCAL ] FLO: Derivative data saved (1820 records). [2025-09-19T22:20:01.478228] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:01.477996] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-19T22:20:01.481679] [INFO ] [MAIN ] Derivative Progress: 708/2093 symbols completed. FLO took 1.2s. Estimated remaining: 8m 58s. Rate: 154.3 symbols/min [2025-09-19T22:20:01.482140] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:01.528843] [DEBUG] [LOCAL ] FLR: Loaded 53899 existing records from primary storage. [2025-09-19T22:20:01.542242] [INFO ] [MAIN ] FLR: Loaded 53899 primary data records. [2025-09-19T22:20:01.681144] [DEBUG] [LOCAL ] FLUT: Loaded 51736 existing records from primary storage. [2025-09-19T22:20:01.691829] [INFO ] [MAIN ] FLUT: Loaded 51736 primary data records. [2025-09-19T22:20:01.786395] [DEBUG] [LOCAL ] FLS: Loaded 50924 existing records from primary storage. [2025-09-19T22:20:01.973783] [INFO ] [MAIN ] FLS: Loaded 50924 primary data records. [2025-09-19T22:20:02.681628] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:02.683220] [INFO ] [MAIN ] FLR: Generated 1820 derivative records from 53899 primary records. [2025-09-19T22:20:02.683557] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-19T22:20:02.703055] [DEBUG] [LOCAL ] FLR: Derivative data saved (1820 records). [2025-09-19T22:20:02.703466] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-19T22:20:02.705474] [INFO ] [MAIN ] Derivative Progress: 709/2093 symbols completed. FLR took 1.3s. Estimated remaining: 8m 60s. Rate: 153.9 symbols/min [2025-09-19T22:20:02.706491] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:02.725365] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:02.726165] [INFO ] [MAIN ] FLUT: Generated 1820 derivative records from 51736 primary records. [2025-09-19T22:20:02.726346] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-19T22:20:02.748326] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1820 records). [2025-09-19T22:20:02.748437] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-19T22:20:02.753874] [INFO ] [MAIN ] Derivative Progress: 710/2093 symbols completed. FLUT took 1.3s. Estimated remaining: 8m 59s. Rate: 154.1 symbols/min [2025-09-19T22:20:02.754214] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:02.777942] [DEBUG] [LOCAL ] FLXR: Loaded 19941 existing records from primary storage. [2025-09-19T22:20:02.778356] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:02.778694] [INFO ] [MAIN ] FLXR: Loaded 19941 primary data records. [2025-09-19T22:20:02.779705] [INFO ] [MAIN ] FLS: Generated 1820 derivative records from 50924 primary records. [2025-09-19T22:20:02.785314] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-19T22:20:02.927091] [DEBUG] [LOCAL ] FLS: Derivative data saved (1820 records). [2025-09-19T22:20:02.932615] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-19T22:20:02.962302] [INFO ] [MAIN ] Derivative Progress: 711/2093 symbols completed. FLS took 1.5s. Estimated remaining: 8m 58s. Rate: 154.2 symbols/min [2025-09-19T22:20:03.003134] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:03.165587] [DEBUG] [LOCAL ] FMC: Loaded 52569 existing records from primary storage. [2025-09-19T22:20:03.165917] [INFO ] [MAIN ] FMC: Loaded 52569 primary data records. [2025-09-19T22:20:03.239234] [DEBUG] [LOCAL ] FMN: Loaded 6267 existing records from primary storage. [2025-09-19T22:20:03.280095] [INFO ] [MAIN ] FMN: Loaded 6267 primary data records. [2025-09-19T22:20:03.812519] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:03.814164] [INFO ] [MAIN ] FLXR: Generated 1820 derivative records from 19941 primary records. [2025-09-19T22:20:03.814369] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-19T22:20:03.836808] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1820 records). [2025-09-19T22:20:03.836953] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-19T22:20:03.839185] [INFO ] [MAIN ] Derivative Progress: 712/2093 symbols completed. FLXR took 1.1s. Estimated remaining: 8m 58s. Rate: 153.9 symbols/min [2025-09-19T22:20:03.839539] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:03.861740] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:03.862819] [INFO ] [MAIN ] FMC: Generated 1820 derivative records from 52569 primary records. [2025-09-19T22:20:03.863079] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-19T22:20:03.883278] [DEBUG] [LOCAL ] FMC: Derivative data saved (1820 records). [2025-09-19T22:20:03.895926] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-19T22:20:03.899304] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:03.898951] [INFO ] [MAIN ] Derivative Progress: 713/2093 symbols completed. FMC took 1.1s. Estimated remaining: 8m 57s. Rate: 154.1 symbols/min [2025-09-19T22:20:03.899822] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:03.908552] [INFO ] [MAIN ] FMN: Generated 1820 derivative records from 6267 primary records. [2025-09-19T22:20:03.909062] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-19T22:20:03.934678] [DEBUG] [LOCAL ] FMN: Derivative data saved (1820 records). [2025-09-19T22:20:03.934870] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-19T22:20:03.937459] [INFO ] [MAIN ] Derivative Progress: 714/2093 symbols completed. FMN took 0.9s. Estimated remaining: 8m 56s. Rate: 154.3 symbols/min [2025-09-19T22:20:03.938551] [DEBUG] [LOCAL ] FMS: Loaded 30974 existing records from primary storage. [2025-09-19T22:20:03.939109] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:03.939048] [INFO ] [MAIN ] FMS: Loaded 30974 primary data records. [2025-09-19T22:20:04.018630] [DEBUG] [LOCAL ] FMY: Loaded 1403 existing records from primary storage. [2025-09-19T22:20:04.024455] [INFO ] [MAIN ] FMY: Loaded 1403 primary data records. [2025-09-19T22:20:04.289741] [DEBUG] [LOCAL ] FMX: Loaded 41399 existing records from primary storage. [2025-09-19T22:20:04.341538] [INFO ] [MAIN ] FMX: Loaded 41399 primary data records. [2025-09-19T22:20:04.985832] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:04.999966] [INFO ] [MAIN ] FMS: Generated 1820 derivative records from 30974 primary records. [2025-09-19T22:20:05.000924] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-19T22:20:05.000851] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:05.002828] [INFO ] [MAIN ] FMY: Generated 1820 derivative records from 1403 primary records. [2025-09-19T22:20:05.003335] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-19T22:20:05.030806] [DEBUG] [LOCAL ] FMY: Derivative data saved (1820 records). [2025-09-19T22:20:05.032119] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-19T22:20:05.035690] [INFO ] [MAIN ] Derivative Progress: 715/2093 symbols completed. FMY took 1.1s. Estimated remaining: 8m 57s. Rate: 153.9 symbols/min [2025-09-19T22:20:05.037182] [DEBUG] [LOCAL ] FMS: Derivative data saved (1820 records). [2025-09-19T22:20:05.038289] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-19T22:20:05.036295] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:05.041022] [INFO ] [MAIN ] Derivative Progress: 716/2093 symbols completed. FMS took 1.2s. Estimated remaining: 8m 56s. Rate: 154.1 symbols/min [2025-09-19T22:20:05.042685] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:05.056584] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:05.057344] [INFO ] [MAIN ] FMX: Generated 1820 derivative records from 41399 primary records. [2025-09-19T22:20:05.057532] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-19T22:20:05.073925] [DEBUG] [LOCAL ] FMX: Derivative data saved (1820 records). [2025-09-19T22:20:05.074160] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-19T22:20:05.076755] [INFO ] [MAIN ] Derivative Progress: 717/2093 symbols completed. FMX took 1.2s. Estimated remaining: 8m 55s. Rate: 154.3 symbols/min [2025-09-19T22:20:05.077012] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:05.125134] [DEBUG] [LOCAL ] FN: Loaded 40301 existing records from primary storage. [2025-09-19T22:20:05.125374] [INFO ] [MAIN ] FN: Loaded 40301 primary data records. [2025-09-19T22:20:05.275486] [DEBUG] [LOCAL ] FNB: Loaded 53229 existing records from primary storage. [2025-09-19T22:20:05.291512] [INFO ] [MAIN ] FNB: Loaded 53229 primary data records. [2025-09-19T22:20:05.303023] [DEBUG] [LOCAL ] FND: Loaded 52939 existing records from primary storage. [2025-09-19T22:20:05.303149] [INFO ] [MAIN ] FND: Loaded 52939 primary data records. [2025-09-19T22:20:06.142849] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:06.144220] [INFO ] [MAIN ] FN: Generated 1820 derivative records from 40301 primary records. [2025-09-19T22:20:06.144739] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-19T22:20:06.164309] [DEBUG] [LOCAL ] FN: Derivative data saved (1820 records). [2025-09-19T22:20:06.167155] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-19T22:20:06.182082] [INFO ] [MAIN ] Derivative Progress: 718/2093 symbols completed. FN took 1.1s. Estimated remaining: 8m 56s. Rate: 153.9 symbols/min [2025-09-19T22:20:06.183302] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:06.184123] [INFO ] [MAIN ] FNB: Generated 1820 derivative records from 53229 primary records. [2025-09-19T22:20:06.191804] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-19T22:20:06.197382] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:06.198194] [INFO ] [MAIN ] FND: Generated 1820 derivative records from 52939 primary records. [2025-09-19T22:20:06.206622] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-19T22:20:06.228382] [DEBUG] [LOCAL ] FND: Derivative data saved (1820 records). [2025-09-19T22:20:06.228999] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-19T22:20:06.232808] [INFO ] [MAIN ] Derivative Progress: 719/2093 symbols completed. FND took 1.2s. Estimated remaining: 8m 55s. Rate: 154.1 symbols/min [2025-09-19T22:20:06.233080] [DEBUG] [LOCAL ] FNB: Derivative data saved (1820 records). [2025-09-19T22:20:06.233328] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-19T22:20:06.236301] [INFO ] [MAIN ] Derivative Progress: 720/2093 symbols completed. FNB took 1.2s. Estimated remaining: 8m 54s. Rate: 154.3 symbols/min [2025-09-19T22:20:06.236922] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:06.237180] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:06.237670] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:06.255125] [DEBUG] [LOCAL ] FOA: Loaded 13348 existing records from primary storage. [2025-09-19T22:20:06.255292] [INFO ] [MAIN ] FOA: Loaded 13348 primary data records. [2025-09-19T22:20:06.610438] [DEBUG] [LOCAL ] FNF: Loaded 50015 existing records from primary storage. [2025-09-19T22:20:06.610693] [DEBUG] [LOCAL ] FNV: Loaded 47177 existing records from primary storage. [2025-09-19T22:20:06.611111] [INFO ] [MAIN ] FNF: Loaded 50015 primary data records. [2025-09-19T22:20:06.611347] [INFO ] [MAIN ] FNV: Loaded 47177 primary data records. [2025-09-19T22:20:07.305995] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:07.307738] [INFO ] [MAIN ] FOA: Generated 1820 derivative records from 13348 primary records. [2025-09-19T22:20:07.308032] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-19T22:20:07.326959] [DEBUG] [LOCAL ] FOA: Derivative data saved (1820 records). [2025-09-19T22:20:07.327202] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-19T22:20:07.329835] [INFO ] [MAIN ] Derivative Progress: 721/2093 symbols completed. FOA took 1.1s. Estimated remaining: 8m 55s. Rate: 153.9 symbols/min [2025-09-19T22:20:07.330455] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:07.351438] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:07.352570] [INFO ] [MAIN ] FNF: Generated 1820 derivative records from 50015 primary records. [2025-09-19T22:20:07.352782] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-19T22:20:07.357632] [DEBUG] [LOCAL ] FOF: Loaded 8486 existing records from primary storage. [2025-09-19T22:20:07.373832] [INFO ] [MAIN ] FOF: Loaded 8486 primary data records. [2025-09-19T22:20:07.426564] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:07.445748] [DEBUG] [LOCAL ] FNF: Derivative data saved (1820 records). [2025-09-19T22:20:07.446563] [INFO ] [MAIN ] FNV: Generated 1820 derivative records from 47177 primary records. [2025-09-19T22:20:07.455475] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-19T22:20:07.455705] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-19T22:20:07.475396] [INFO ] [MAIN ] Derivative Progress: 722/2093 symbols completed. FNF took 1.2s. Estimated remaining: 8m 54s. Rate: 154.0 symbols/min [2025-09-19T22:20:07.486188] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:07.600349] [DEBUG] [LOCAL ] FNV: Derivative data saved (1820 records). [2025-09-19T22:20:07.600498] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-19T22:20:07.719285] [INFO ] [MAIN ] Derivative Progress: 723/2093 symbols completed. FNV took 1.5s. Estimated remaining: 8m 53s. Rate: 154.1 symbols/min [2025-09-19T22:20:07.719921] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:07.729178] [DEBUG] [LOCAL ] FOR: Loaded 20598 existing records from primary storage. [2025-09-19T22:20:07.730213] [INFO ] [MAIN ] FOR: Loaded 20598 primary data records. [2025-09-19T22:20:08.076049] [DEBUG] [LOCAL ] FOUR: Loaded 50265 existing records from primary storage. [2025-09-19T22:20:08.077386] [INFO ] [MAIN ] FOUR: Loaded 50265 primary data records. [2025-09-19T22:20:08.187962] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:08.200451] [INFO ] [MAIN ] FOF: Generated 1820 derivative records from 8486 primary records. [2025-09-19T22:20:08.200759] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-19T22:20:08.438995] [DEBUG] [LOCAL ] FOF: Derivative data saved (1820 records). [2025-09-19T22:20:08.440231] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-19T22:20:08.440019] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:08.444072] [INFO ] [MAIN ] Derivative Progress: 724/2093 symbols completed. FOF took 1.1s. Estimated remaining: 8m 54s. Rate: 153.9 symbols/min [2025-09-19T22:20:08.441541] [INFO ] [MAIN ] FOR: Generated 1820 derivative records from 20598 primary records. [2025-09-19T22:20:08.444949] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-19T22:20:08.445503] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:08.465523] [DEBUG] [LOCAL ] FOR: Derivative data saved (1820 records). [2025-09-19T22:20:08.465773] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-19T22:20:08.468863] [INFO ] [MAIN ] Derivative Progress: 725/2093 symbols completed. FOR took 1.0s. Estimated remaining: 8m 53s. Rate: 154.1 symbols/min [2025-09-19T22:20:08.470445] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:08.489849] [DEBUG] [LOCAL ] FPF: Loaded 17887 existing records from primary storage. [2025-09-19T22:20:08.508780] [INFO ] [MAIN ] FPF: Loaded 17887 primary data records. [2025-09-19T22:20:08.509389] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:08.521910] [INFO ] [MAIN ] FOUR: Generated 1820 derivative records from 50265 primary records. [2025-09-19T22:20:08.522109] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-19T22:20:08.592592] [DEBUG] [LOCAL ] FPH: Loaded 20104 existing records from primary storage. [2025-09-19T22:20:08.614284] [INFO ] [MAIN ] FPH: Loaded 20104 primary data records. [2025-09-19T22:20:08.941605] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1820 records). [2025-09-19T22:20:08.999782] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-19T22:20:09.006477] [INFO ] [MAIN ] Derivative Progress: 726/2093 symbols completed. FOUR took 1.3s. Estimated remaining: 8m 52s. Rate: 154.1 symbols/min [2025-09-19T22:20:09.028635] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:09.256820] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:09.257733] [INFO ] [MAIN ] FPF: Generated 1820 derivative records from 17887 primary records. [2025-09-19T22:20:09.258163] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-19T22:20:09.282224] [DEBUG] [LOCAL ] FPI: Loaded 31700 existing records from primary storage. [2025-09-19T22:20:09.282738] [INFO ] [MAIN ] FPI: Loaded 31700 primary data records. [2025-09-19T22:20:09.396314] [DEBUG] [LOCAL ] FPF: Derivative data saved (1820 records). [2025-09-19T22:20:09.396494] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-19T22:20:09.411913] [INFO ] [MAIN ] Derivative Progress: 727/2093 symbols completed. FPF took 1.0s. Estimated remaining: 8m 52s. Rate: 154.0 symbols/min [2025-09-19T22:20:09.418137] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:09.417901] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:09.429817] [INFO ] [MAIN ] FPH: Generated 1820 derivative records from 20104 primary records. [2025-09-19T22:20:09.454185] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-19T22:20:09.634015] [DEBUG] [LOCAL ] FPH: Derivative data saved (1820 records). [2025-09-19T22:20:09.635018] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-19T22:20:09.637554] [INFO ] [MAIN ] Derivative Progress: 728/2093 symbols completed. FPH took 1.2s. Estimated remaining: 8m 51s. Rate: 154.1 symbols/min [2025-09-19T22:20:09.638040] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:09.668507] [DEBUG] [LOCAL ] FRA: Loaded 14908 existing records from primary storage. [2025-09-19T22:20:09.669231] [INFO ] [MAIN ] FRA: Loaded 14908 primary data records. [2025-09-19T22:20:09.760837] [DEBUG] [LOCAL ] FR: Loaded 47434 existing records from primary storage. [2025-09-19T22:20:09.784850] [INFO ] [MAIN ] FR: Loaded 47434 primary data records. [2025-09-19T22:20:09.989473] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:10.103185] [INFO ] [MAIN ] FPI: Generated 1820 derivative records from 31700 primary records. [2025-09-19T22:20:10.127702] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-19T22:20:10.319967] [DEBUG] [LOCAL ] FPI: Derivative data saved (1820 records). [2025-09-19T22:20:10.320270] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-19T22:20:10.322611] [INFO ] [MAIN ] Derivative Progress: 729/2093 symbols completed. FPI took 1.3s. Estimated remaining: 8m 52s. Rate: 154.0 symbols/min [2025-09-19T22:20:10.322879] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:10.352398] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:10.353273] [INFO ] [MAIN ] FRA: Generated 1820 derivative records from 14908 primary records. [2025-09-19T22:20:10.359831] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-19T22:20:10.361503] [DEBUG] [LOCAL ] FRGE: Loaded 19246 existing records from primary storage. [2025-09-19T22:20:10.370328] [INFO ] [MAIN ] FRGE: Loaded 19246 primary data records. [2025-09-19T22:20:10.378385] [DEBUG] [LOCAL ] FRA: Derivative data saved (1820 records). [2025-09-19T22:20:10.378526] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-19T22:20:10.380796] [INFO ] [MAIN ] Derivative Progress: 730/2093 symbols completed. FRA took 0.7s. Estimated remaining: 8m 51s. Rate: 154.2 symbols/min [2025-09-19T22:20:10.401350] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:10.462941] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:10.486057] [INFO ] [MAIN ] FR: Generated 1820 derivative records from 47434 primary records. [2025-09-19T22:20:10.493567] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-19T22:20:10.539593] [DEBUG] [LOCAL ] FR: Derivative data saved (1820 records). [2025-09-19T22:20:10.552164] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-19T22:20:10.563310] [INFO ] [MAIN ] Derivative Progress: 731/2093 symbols completed. FR took 1.1s. Estimated remaining: 8m 50s. Rate: 154.3 symbols/min [2025-09-19T22:20:10.593438] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:10.766204] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:10.768217] [INFO ] [MAIN ] FRGE: Generated 1820 derivative records from 19246 primary records. [2025-09-19T22:20:10.767359] [DEBUG] [LOCAL ] FRO: Loaded 52689 existing records from primary storage. [2025-09-19T22:20:10.777422] [INFO ] [MAIN ] FRO: Loaded 52689 primary data records. [2025-09-19T22:20:10.777624] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-19T22:20:10.869522] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1820 records). [2025-09-19T22:20:10.885597] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-19T22:20:10.887943] [INFO ] [MAIN ] Derivative Progress: 732/2093 symbols completed. FRGE took 0.6s. Estimated remaining: 8m 49s. Rate: 154.3 symbols/min [2025-09-19T22:20:10.910125] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:10.912464] [DEBUG] [LOCAL ] FRT: Loaded 42999 existing records from primary storage. [2025-09-19T22:20:10.918392] [INFO ] [MAIN ] FRT: Loaded 42999 primary data records. [2025-09-19T22:20:11.463163] [DEBUG] [LOCAL ] FSCO: Loaded 37339 existing records from primary storage. [2025-09-19T22:20:11.463893] [INFO ] [MAIN ] FSCO: Loaded 37339 primary data records. [2025-09-19T22:20:11.804410] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:11.806289] [INFO ] [MAIN ] FRO: Generated 1820 derivative records from 52689 primary records. [2025-09-19T22:20:11.806631] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-19T22:20:11.827997] [DEBUG] [LOCAL ] FRO: Derivative data saved (1820 records). [2025-09-19T22:20:11.843030] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-19T22:20:11.842309] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:11.846492] [INFO ] [MAIN ] Derivative Progress: 733/2093 symbols completed. FRO took 1.5s. Estimated remaining: 8m 50s. Rate: 154.0 symbols/min [2025-09-19T22:20:11.844057] [INFO ] [MAIN ] FRT: Generated 1820 derivative records from 42999 primary records. [2025-09-19T22:20:11.846665] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-19T22:20:11.867048] [DEBUG] [LOCAL ] FRT: Derivative data saved (1820 records). [2025-09-19T22:20:11.867235] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-19T22:20:11.870169] [INFO ] [MAIN ] Derivative Progress: 734/2093 symbols completed. FRT took 1.3s. Estimated remaining: 8m 49s. Rate: 154.2 symbols/min [2025-09-19T22:20:11.883925] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:11.884678] [INFO ] [MAIN ] FSCO: Generated 1820 derivative records from 37339 primary records. [2025-09-19T22:20:11.884764] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-19T22:20:11.900196] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1820 records). [2025-09-19T22:20:11.900260] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-19T22:20:11.902784] [INFO ] [MAIN ] Derivative Progress: 735/2093 symbols completed. FSCO took 1.0s. Estimated remaining: 8m 48s. Rate: 154.4 symbols/min [2025-09-19T22:20:11.903353] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:11.903552] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:11.903677] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:11.981367] [DEBUG] [LOCAL ] FSLY: Loaded 52048 existing records from primary storage. [2025-09-19T22:20:11.981694] [INFO ] [MAIN ] FSLY: Loaded 52048 primary data records. [2025-09-19T22:20:12.039201] [DEBUG] [LOCAL ] FSK: Loaded 50114 existing records from primary storage. [2025-09-19T22:20:12.065808] [INFO ] [MAIN ] FSK: Loaded 50114 primary data records. [2025-09-19T22:20:12.111041] [DEBUG] [LOCAL ] FSM: Loaded 54061 existing records from primary storage. [2025-09-19T22:20:12.119423] [INFO ] [MAIN ] FSM: Loaded 54061 primary data records. [2025-09-19T22:20:13.026581] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:13.027373] [INFO ] [MAIN ] FSLY: Generated 1820 derivative records from 52048 primary records. [2025-09-19T22:20:13.027666] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-19T22:20:13.049136] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1820 records). [2025-09-19T22:20:13.075239] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:13.075528] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:13.074729] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-19T22:20:13.077295] [INFO ] [MAIN ] Derivative Progress: 736/2093 symbols completed. FSLY took 1.2s. Estimated remaining: 8m 49s. Rate: 154.0 symbols/min [2025-09-19T22:20:13.078176] [INFO ] [MAIN ] FSK: Generated 1820 derivative records from 50114 primary records. [2025-09-19T22:20:13.078845] [INFO ] [MAIN ] FSM: Generated 1820 derivative records from 54061 primary records. [2025-09-19T22:20:13.079200] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-19T22:20:13.079130] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:13.078921] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-19T22:20:13.114586] [DEBUG] [LOCAL ] FSM: Derivative data saved (1820 records). [2025-09-19T22:20:13.115239] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-19T22:20:13.118100] [INFO ] [MAIN ] Derivative Progress: 737/2093 symbols completed. FSM took 1.2s. Estimated remaining: 8m 48s. Rate: 154.1 symbols/min [2025-09-19T22:20:13.118433] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:13.122229] [DEBUG] [LOCAL ] FSK: Derivative data saved (1820 records). [2025-09-19T22:20:13.122415] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-19T22:20:13.126588] [INFO ] [MAIN ] Derivative Progress: 738/2093 symbols completed. FSK took 1.2s. Estimated remaining: 8m 47s. Rate: 154.4 symbols/min [2025-09-19T22:20:13.127128] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:13.131593] [DEBUG] [LOCAL ] FT: Loaded 6424 existing records from primary storage. [2025-09-19T22:20:13.131822] [INFO ] [MAIN ] FT: Loaded 6424 primary data records. [2025-09-19T22:20:13.281889] [DEBUG] [LOCAL ] FSS: Loaded 35405 existing records from primary storage. [2025-09-19T22:20:13.281111] [DEBUG] [LOCAL ] FTHY: Loaded 11845 existing records from primary storage. [2025-09-19T22:20:13.287258] [INFO ] [MAIN ] FSS: Loaded 35405 primary data records. [2025-09-19T22:20:13.282072] [INFO ] [MAIN ] FTHY: Loaded 11845 primary data records. [2025-09-19T22:20:14.112975] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:14.115461] [INFO ] [MAIN ] FT: Generated 1820 derivative records from 6424 primary records. [2025-09-19T22:20:14.116345] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-19T22:20:14.146115] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:14.149748] [INFO ] [MAIN ] FSS: Generated 1820 derivative records from 35405 primary records. [2025-09-19T22:20:14.150792] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-19T22:20:14.160192] [DEBUG] [LOCAL ] FT: Derivative data saved (1820 records). [2025-09-19T22:20:14.160423] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-19T22:20:14.178691] [INFO ] [MAIN ] Derivative Progress: 739/2093 symbols completed. FT took 1.1s. Estimated remaining: 8m 48s. Rate: 154.0 symbols/min [2025-09-19T22:20:14.183283] [DEBUG] [LOCAL ] FSS: Derivative data saved (1820 records). [2025-09-19T22:20:14.183481] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:14.183551] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-19T22:20:14.186947] [INFO ] [MAIN ] Derivative Progress: 740/2093 symbols completed. FSS took 1.1s. Estimated remaining: 8m 46s. Rate: 154.2 symbols/min [2025-09-19T22:20:14.184147] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:14.188292] [INFO ] [MAIN ] FTHY: Generated 1820 derivative records from 11845 primary records. [2025-09-19T22:20:14.188490] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:14.188601] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-19T22:20:14.205439] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1820 records). [2025-09-19T22:20:14.205618] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-19T22:20:14.208294] [INFO ] [MAIN ] Derivative Progress: 741/2093 symbols completed. FTHY took 1.1s. Estimated remaining: 8m 45s. Rate: 154.4 symbols/min [2025-09-19T22:20:14.208685] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:14.236183] [DEBUG] [LOCAL ] FTK: Loaded 32433 existing records from primary storage. [2025-09-19T22:20:14.236393] [INFO ] [MAIN ] FTK: Loaded 32433 primary data records. [2025-09-19T22:20:14.424607] [DEBUG] [LOCAL ] FTI: Loaded 54083 existing records from primary storage. [2025-09-19T22:20:14.445967] [INFO ] [MAIN ] FTI: Loaded 54083 primary data records. [2025-09-19T22:20:14.695699] [DEBUG] [LOCAL ] FTS: Loaded 42760 existing records from primary storage. [2025-09-19T22:20:14.701192] [INFO ] [MAIN ] FTS: Loaded 42760 primary data records. [2025-09-19T22:20:15.329500] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:15.331204] [INFO ] [MAIN ] FTK: Generated 1820 derivative records from 32433 primary records. [2025-09-19T22:20:15.331492] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-19T22:20:15.362254] [DEBUG] [LOCAL ] FTK: Derivative data saved (1820 records). [2025-09-19T22:20:15.363090] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-19T22:20:15.365547] [INFO ] [MAIN ] Derivative Progress: 742/2093 symbols completed. FTK took 1.2s. Estimated remaining: 8m 46s. Rate: 154.0 symbols/min [2025-09-19T22:20:15.386192] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:15.388082] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:15.390527] [INFO ] [MAIN ] FTI: Generated 1820 derivative records from 54083 primary records. [2025-09-19T22:20:15.399128] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-19T22:20:15.406923] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:15.415508] [INFO ] [MAIN ] FTS: Generated 1820 derivative records from 42760 primary records. [2025-09-19T22:20:15.419710] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-19T22:20:15.425349] [DEBUG] [LOCAL ] FTI: Derivative data saved (1820 records). [2025-09-19T22:20:15.437071] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-19T22:20:15.440139] [INFO ] [MAIN ] Derivative Progress: 743/2093 symbols completed. FTI took 1.3s. Estimated remaining: 8m 45s. Rate: 154.2 symbols/min [2025-09-19T22:20:15.440986] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:15.447531] [DEBUG] [LOCAL ] FTS: Derivative data saved (1820 records). [2025-09-19T22:20:15.449812] [DEBUG] [LOCAL ] FTWO: Loaded 1824 existing records from primary storage. [2025-09-19T22:20:15.450035] [INFO ] [MAIN ] FTWO: Loaded 1824 primary data records. [2025-09-19T22:20:15.450137] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-19T22:20:15.464382] [INFO ] [MAIN ] Derivative Progress: 744/2093 symbols completed. FTS took 1.3s. Estimated remaining: 8m 44s. Rate: 154.4 symbols/min [2025-09-19T22:20:15.473882] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:15.647245] [DEBUG] [LOCAL ] FTV: Loaded 53674 existing records from primary storage. [2025-09-19T22:20:15.670129] [INFO ] [MAIN ] FTV: Loaded 53674 primary data records. [2025-09-19T22:20:16.003432] [DEBUG] [LOCAL ] FUBO: Loaded 54479 existing records from primary storage. [2025-09-19T22:20:16.027558] [INFO ] [MAIN ] FUBO: Loaded 54479 primary data records. [2025-09-19T22:20:16.486343] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:20:16.488071] [INFO ] [MAIN ] FTWO: Generated 1819 derivative records from 1824 primary records. [2025-09-19T22:20:16.488307] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-19T22:20:16.503867] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1819 records). [2025-09-19T22:20:16.504281] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-19T22:20:16.506382] [INFO ] [MAIN ] Derivative Progress: 745/2093 symbols completed. FTWO took 1.1s. Estimated remaining: 8m 45s. Rate: 154.0 symbols/min [2025-09-19T22:20:16.507517] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:16.528244] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:16.529168] [INFO ] [MAIN ] FTV: Generated 1820 derivative records from 53674 primary records. [2025-09-19T22:20:16.529402] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-19T22:20:16.561315] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:16.563304] [INFO ] [MAIN ] FUBO: Generated 1820 derivative records from 54479 primary records. [2025-09-19T22:20:16.563690] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-19T22:20:16.582470] [DEBUG] [LOCAL ] FTV: Derivative data saved (1820 records). [2025-09-19T22:20:16.590991] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1820 records). [2025-09-19T22:20:16.590325] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-19T22:20:16.594065] [INFO ] [MAIN ] Derivative Progress: 746/2093 symbols completed. FTV took 1.2s. Estimated remaining: 8m 44s. Rate: 154.2 symbols/min [2025-09-19T22:20:16.591151] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-19T22:20:16.594619] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:16.597261] [INFO ] [MAIN ] Derivative Progress: 747/2093 symbols completed. FUBO took 1.1s. Estimated remaining: 8m 43s. Rate: 154.4 symbols/min [2025-09-19T22:20:16.607683] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:16.609226] [DEBUG] [LOCAL ] FUL: Loaded 33507 existing records from primary storage. [2025-09-19T22:20:16.609566] [INFO ] [MAIN ] FUL: Loaded 33507 primary data records. [2025-09-19T22:20:16.808086] [DEBUG] [LOCAL ] FVR: Loaded 22259 existing records from primary storage. [2025-09-19T22:20:16.954275] [INFO ] [MAIN ] FVR: Loaded 22259 primary data records. [2025-09-19T22:20:17.103576] [DEBUG] [LOCAL ] FUN: Loaded 52303 existing records from primary storage. [2025-09-19T22:20:17.130102] [INFO ] [MAIN ] FUN: Loaded 52303 primary data records. [2025-09-19T22:20:17.642026] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:17.643336] [INFO ] [MAIN ] FUL: Generated 1820 derivative records from 33507 primary records. [2025-09-19T22:20:17.643520] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-19T22:20:17.663764] [DEBUG] [LOCAL ] FUL: Derivative data saved (1820 records). [2025-09-19T22:20:17.664155] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-19T22:20:17.666278] [INFO ] [MAIN ] Derivative Progress: 748/2093 symbols completed. FUL took 1.2s. Estimated remaining: 8m 44s. Rate: 154.0 symbols/min [2025-09-19T22:20:17.680514] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:20:17.681421] [INFO ] [MAIN ] FVR: Generated 1819 derivative records from 22259 primary records. [2025-09-19T22:20:17.681538] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-19T22:20:17.713080] [DEBUG] [LOCAL ] FVR: Derivative data saved (1819 records). [2025-09-19T22:20:17.713263] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:17.714060] [INFO ] [MAIN ] FUN: Generated 1820 derivative records from 52303 primary records. [2025-09-19T22:20:17.713427] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-19T22:20:17.714161] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-19T22:20:17.716943] [INFO ] [MAIN ] Derivative Progress: 749/2093 symbols completed. FVR took 1.1s. Estimated remaining: 8m 43s. Rate: 154.2 symbols/min [2025-09-19T22:20:17.732551] [DEBUG] [LOCAL ] FUN: Derivative data saved (1820 records). [2025-09-19T22:20:17.732611] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-19T22:20:17.735681] [INFO ] [MAIN ] Derivative Progress: 750/2093 symbols completed. FUN took 1.1s. Estimated remaining: 8m 42s. Rate: 154.4 symbols/min [2025-09-19T22:20:17.736135] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:17.736395] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:17.736445] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:17.740913] [DEBUG] [LOCAL ] FXED: Loaded 1232 existing records from primary storage. [2025-09-19T22:20:17.741135] [INFO ] [MAIN ] FXED: Loaded 1232 primary data records. [2025-09-19T22:20:18.098897] [DEBUG] [LOCAL ] FVRR: Loaded 40863 existing records from primary storage. [2025-09-19T22:20:18.099760] [INFO ] [MAIN ] FVRR: Loaded 40863 primary data records. [2025-09-19T22:20:18.217471] [DEBUG] [LOCAL ] G: Loaded 50508 existing records from primary storage. [2025-09-19T22:20:18.228573] [INFO ] [MAIN ] G: Loaded 50508 primary data records. [2025-09-19T22:20:18.729686] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7799 incomplete bins [2025-09-19T22:20:18.731618] [INFO ] [MAIN ] FXED: Generated 1815 derivative records from 1232 primary records. [2025-09-19T22:20:18.732437] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-19T22:20:18.750605] [DEBUG] [LOCAL ] FXED: Derivative data saved (1815 records). [2025-09-19T22:20:18.750760] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-19T22:20:18.752809] [INFO ] [MAIN ] Derivative Progress: 751/2093 symbols completed. FXED took 1.0s. Estimated remaining: 8m 43s. Rate: 154.1 symbols/min [2025-09-19T22:20:18.753232] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:18.772153] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:18.772891] [INFO ] [MAIN ] FVRR: Generated 1820 derivative records from 40863 primary records. [2025-09-19T22:20:18.773177] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-19T22:20:18.808068] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1820 records). [2025-09-19T22:20:18.813414] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:18.813148] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-19T22:20:18.815609] [INFO ] [MAIN ] Derivative Progress: 752/2093 symbols completed. FVRR took 1.1s. Estimated remaining: 8m 42s. Rate: 154.2 symbols/min [2025-09-19T22:20:18.816444] [INFO ] [MAIN ] G: Generated 1820 derivative records from 50508 primary records. [2025-09-19T22:20:18.816546] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-19T22:20:18.817629] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:18.844027] [DEBUG] [LOCAL ] GAB: Loaded 28200 existing records from primary storage. [2025-09-19T22:20:18.843406] [DEBUG] [LOCAL ] G: Derivative data saved (1820 records). [2025-09-19T22:20:18.844339] [INFO ] [MAIN ] GAB: Loaded 28200 primary data records. [2025-09-19T22:20:18.844274] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-19T22:20:18.852197] [DEBUG] [LOCAL ] GAM: Loaded 4398 existing records from primary storage. [2025-09-19T22:20:18.854783] [INFO ] [MAIN ] Derivative Progress: 753/2093 symbols completed. G took 1.1s. Estimated remaining: 8m 41s. Rate: 154.4 symbols/min [2025-09-19T22:20:18.872319] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:18.872438] [INFO ] [MAIN ] GAM: Loaded 4398 primary data records. [2025-09-19T22:20:19.528189] [DEBUG] [LOCAL ] GAP: Loaded 54435 existing records from primary storage. [2025-09-19T22:20:19.529716] [INFO ] [MAIN ] GAP: Loaded 54435 primary data records. [2025-09-19T22:20:19.753478] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:19.863111] [INFO ] [MAIN ] GAB: Generated 1820 derivative records from 28200 primary records. [2025-09-19T22:20:19.871964] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-19T22:20:19.893299] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:19.900802] [INFO ] [MAIN ] GAM: Generated 1820 derivative records from 4398 primary records. [2025-09-19T22:20:19.901495] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-19T22:20:19.905170] [DEBUG] [LOCAL ] GAB: Derivative data saved (1820 records). [2025-09-19T22:20:19.911551] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-19T22:20:19.918258] [INFO ] [MAIN ] Derivative Progress: 754/2093 symbols completed. GAB took 1.2s. Estimated remaining: 8m 42s. Rate: 154.1 symbols/min [2025-09-19T22:20:19.918759] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:19.923930] [DEBUG] [LOCAL ] GAM: Derivative data saved (1820 records). [2025-09-19T22:20:19.924023] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-19T22:20:19.926317] [INFO ] [MAIN ] Derivative Progress: 755/2093 symbols completed. GAM took 1.1s. Estimated remaining: 8m 40s. Rate: 154.3 symbols/min [2025-09-19T22:20:19.926690] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:19.956220] [DEBUG] [LOCAL ] GBAB: Loaded 13219 existing records from primary storage. [2025-09-19T22:20:19.956566] [INFO ] [MAIN ] GBAB: Loaded 13219 primary data records. [2025-09-19T22:20:19.955875] [DEBUG] [LOCAL ] GATX: Loaded 18317 existing records from primary storage. [2025-09-19T22:20:19.964367] [INFO ] [MAIN ] GATX: Loaded 18317 primary data records. [2025-09-19T22:20:20.048576] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:20.098356] [INFO ] [MAIN ] GAP: Generated 1820 derivative records from 54435 primary records. [2025-09-19T22:20:20.127279] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-19T22:20:20.198536] [DEBUG] [LOCAL ] GAP: Derivative data saved (1820 records). [2025-09-19T22:20:20.254928] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-19T22:20:20.317604] [INFO ] [MAIN ] Derivative Progress: 756/2093 symbols completed. GAP took 1.5s. Estimated remaining: 8m 40s. Rate: 154.3 symbols/min [2025-09-19T22:20:20.454250] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:20.660079] [DEBUG] [LOCAL ] GBCI: Loaded 40713 existing records from primary storage. [2025-09-19T22:20:20.658853] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:20.660440] [INFO ] [MAIN ] GBCI: Loaded 40713 primary data records. [2025-09-19T22:20:20.662345] [INFO ] [MAIN ] GBAB: Generated 1820 derivative records from 13219 primary records. [2025-09-19T22:20:20.683771] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-19T22:20:20.808558] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:20.826380] [INFO ] [MAIN ] GATX: Generated 1820 derivative records from 18317 primary records. [2025-09-19T22:20:20.826796] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-19T22:20:21.056763] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1820 records). [2025-09-19T22:20:21.058731] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-19T22:20:21.061728] [INFO ] [MAIN ] Derivative Progress: 757/2093 symbols completed. GBAB took 1.1s. Estimated remaining: 8m 40s. Rate: 154.1 symbols/min [2025-09-19T22:20:21.062939] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:21.068066] [DEBUG] [LOCAL ] GATX: Derivative data saved (1820 records). [2025-09-19T22:20:21.068664] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-19T22:20:21.070883] [INFO ] [MAIN ] Derivative Progress: 758/2093 symbols completed. GATX took 1.2s. Estimated remaining: 8m 39s. Rate: 154.3 symbols/min [2025-09-19T22:20:21.072002] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:21.096814] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:21.114429] [INFO ] [MAIN ] GBCI: Generated 1820 derivative records from 40713 primary records. [2025-09-19T22:20:21.114734] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-19T22:20:21.141224] [DEBUG] [LOCAL ] GBX: Loaded 29882 existing records from primary storage. [2025-09-19T22:20:21.151425] [INFO ] [MAIN ] GBX: Loaded 29882 primary data records. [2025-09-19T22:20:21.140615] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1820 records). [2025-09-19T22:20:21.188414] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-19T22:20:21.200923] [DEBUG] [LOCAL ] GBTG: Loaded 41256 existing records from primary storage. [2025-09-19T22:20:21.204316] [INFO ] [MAIN ] GBTG: Loaded 41256 primary data records. [2025-09-19T22:20:21.204223] [INFO ] [MAIN ] Derivative Progress: 759/2093 symbols completed. GBCI took 0.9s. Estimated remaining: 8m 38s. Rate: 154.4 symbols/min [2025-09-19T22:20:21.288193] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:21.816262] [DEBUG] [LOCAL ] GCI: Loaded 44929 existing records from primary storage. [2025-09-19T22:20:21.816845] [INFO ] [MAIN ] GCI: Loaded 44929 primary data records. [2025-09-19T22:20:22.047746] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:22.175937] [INFO ] [MAIN ] GBTG: Generated 1820 derivative records from 41256 primary records. [2025-09-19T22:20:22.189115] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-19T22:20:22.189430] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:22.193070] [INFO ] [MAIN ] GBX: Generated 1820 derivative records from 29882 primary records. [2025-09-19T22:20:22.208783] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-19T22:20:22.209201] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1820 records). [2025-09-19T22:20:22.209576] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-19T22:20:22.211801] [INFO ] [MAIN ] Derivative Progress: 760/2093 symbols completed. GBTG took 1.1s. Estimated remaining: 8m 39s. Rate: 154.1 symbols/min [2025-09-19T22:20:22.213627] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:22.232010] [DEBUG] [LOCAL ] GBX: Derivative data saved (1820 records). [2025-09-19T22:20:22.233788] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-19T22:20:22.236090] [INFO ] [MAIN ] Derivative Progress: 761/2093 symbols completed. GBX took 1.2s. Estimated remaining: 8m 38s. Rate: 154.3 symbols/min [2025-09-19T22:20:22.236794] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:22.265013] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:22.266181] [INFO ] [MAIN ] GCI: Generated 1820 derivative records from 44929 primary records. [2025-09-19T22:20:22.266527] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-19T22:20:22.270126] [DEBUG] [LOCAL ] GCV: Loaded 7140 existing records from primary storage. [2025-09-19T22:20:22.271855] [INFO ] [MAIN ] GCV: Loaded 7140 primary data records. [2025-09-19T22:20:22.338462] [DEBUG] [LOCAL ] GCO: Loaded 26266 existing records from primary storage. [2025-09-19T22:20:22.352407] [INFO ] [MAIN ] GCO: Loaded 26266 primary data records. [2025-09-19T22:20:22.460097] [DEBUG] [LOCAL ] GCI: Derivative data saved (1820 records). [2025-09-19T22:20:22.492101] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-19T22:20:22.510602] [INFO ] [MAIN ] Derivative Progress: 762/2093 symbols completed. GCI took 1.3s. Estimated remaining: 8m 37s. Rate: 154.3 symbols/min [2025-09-19T22:20:22.577070] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:23.034396] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:23.033949] [DEBUG] [LOCAL ] GD: Loaded 48133 existing records from primary storage. [2025-09-19T22:20:23.034937] [INFO ] [MAIN ] GD: Loaded 48133 primary data records. [2025-09-19T22:20:23.037240] [INFO ] [MAIN ] GCV: Generated 1820 derivative records from 7140 primary records. [2025-09-19T22:20:23.037461] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-19T22:20:23.158317] [DEBUG] [LOCAL ] GCV: Derivative data saved (1820 records). [2025-09-19T22:20:23.171576] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-19T22:20:23.181777] [INFO ] [MAIN ] Derivative Progress: 763/2093 symbols completed. GCV took 0.9s. Estimated remaining: 8m 38s. Rate: 154.2 symbols/min [2025-09-19T22:20:23.213135] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:23.233785] [INFO ] [MAIN ] GCO: Generated 1820 derivative records from 26266 primary records. [2025-09-19T22:20:23.239406] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-19T22:20:23.407930] [DEBUG] [LOCAL ] GCO: Derivative data saved (1820 records). [2025-09-19T22:20:23.408473] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-19T22:20:23.411138] [INFO ] [MAIN ] Derivative Progress: 764/2093 symbols completed. GCO took 1.2s. Estimated remaining: 8m 37s. Rate: 154.3 symbols/min [2025-09-19T22:20:23.437744] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:23.438584] [INFO ] [MAIN ] GD: Generated 1820 derivative records from 48133 primary records. [2025-09-19T22:20:23.438670] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-19T22:20:23.454378] [DEBUG] [LOCAL ] GD: Derivative data saved (1820 records). [2025-09-19T22:20:23.454478] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-19T22:20:23.456507] [INFO ] [MAIN ] Derivative Progress: 765/2093 symbols completed. GD took 0.9s. Estimated remaining: 8m 36s. Rate: 154.4 symbols/min [2025-09-19T22:20:23.457356] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:23.457265] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:23.457607] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:23.467328] [DEBUG] [LOCAL ] GDIV: Loaded 3814 existing records from primary storage. [2025-09-19T22:20:23.467555] [INFO ] [MAIN ] GDIV: Loaded 3814 primary data records. [2025-09-19T22:20:23.504235] [DEBUG] [LOCAL ] GDO: Loaded 6116 existing records from primary storage. [2025-09-19T22:20:23.516542] [INFO ] [MAIN ] GDO: Loaded 6116 primary data records. [2025-09-19T22:20:24.131122] [DEBUG] [LOCAL ] GDDY: Loaded 50573 existing records from primary storage. [2025-09-19T22:20:24.132467] [INFO ] [MAIN ] GDDY: Loaded 50573 primary data records. [2025-09-19T22:20:24.483108] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:20:24.485589] [INFO ] [MAIN ] GDIV: Generated 1819 derivative records from 3814 primary records. [2025-09-19T22:20:24.486901] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-19T22:20:24.520335] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:24.522558] [INFO ] [MAIN ] GDO: Generated 1820 derivative records from 6116 primary records. [2025-09-19T22:20:24.525862] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-19T22:20:24.526846] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1819 records). [2025-09-19T22:20:24.527929] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-19T22:20:24.530624] [INFO ] [MAIN ] Derivative Progress: 766/2093 symbols completed. GDIV took 1.1s. Estimated remaining: 8m 37s. Rate: 154.1 symbols/min [2025-09-19T22:20:24.531443] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:24.550349] [DEBUG] [LOCAL ] GDO: Derivative data saved (1820 records). [2025-09-19T22:20:24.551612] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-19T22:20:24.554089] [INFO ] [MAIN ] Derivative Progress: 767/2093 symbols completed. GDO took 1.1s. Estimated remaining: 8m 36s. Rate: 154.3 symbols/min [2025-09-19T22:20:24.567266] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:24.568457] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:24.569352] [INFO ] [MAIN ] GDDY: Generated 1820 derivative records from 50573 primary records. [2025-09-19T22:20:24.569619] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-19T22:20:24.600760] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1820 records). [2025-09-19T22:20:24.601055] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-19T22:20:24.603407] [INFO ] [MAIN ] Derivative Progress: 768/2093 symbols completed. GDDY took 1.1s. Estimated remaining: 8m 35s. Rate: 154.4 symbols/min [2025-09-19T22:20:24.608356] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:24.630419] [DEBUG] [LOCAL ] GDV: Loaded 20234 existing records from primary storage. [2025-09-19T22:20:24.630622] [INFO ] [MAIN ] GDV: Loaded 20234 primary data records. [2025-09-19T22:20:24.636609] [DEBUG] [LOCAL ] GDOT: Loaded 39273 existing records from primary storage. [2025-09-19T22:20:24.671264] [INFO ] [MAIN ] GDOT: Loaded 39273 primary data records. [2025-09-19T22:20:24.834927] [DEBUG] [LOCAL ] GEF: Loaded 21067 existing records from primary storage. [2025-09-19T22:20:24.870328] [INFO ] [MAIN ] GEF: Loaded 21067 primary data records. [2025-09-19T22:20:25.661061] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:25.661945] [INFO ] [MAIN ] GDOT: Generated 1820 derivative records from 39273 primary records. [2025-09-19T22:20:25.662173] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-19T22:20:25.675817] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:25.685911] [INFO ] [MAIN ] GDV: Generated 1820 derivative records from 20234 primary records. [2025-09-19T22:20:25.686113] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-19T22:20:25.715089] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:25.720773] [INFO ] [MAIN ] GEF: Generated 1820 derivative records from 21067 primary records. [2025-09-19T22:20:25.722578] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-19T22:20:25.724632] [DEBUG] [LOCAL ] GDV: Derivative data saved (1820 records). [2025-09-19T22:20:25.725682] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-19T22:20:25.728012] [INFO ] [MAIN ] Derivative Progress: 769/2093 symbols completed. GDV took 1.2s. Estimated remaining: 8m 36s. Rate: 154.1 symbols/min [2025-09-19T22:20:25.739621] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:25.735910] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1820 records). [2025-09-19T22:20:25.743137] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-19T22:20:25.746484] [INFO ] [MAIN ] Derivative Progress: 770/2093 symbols completed. GDOT took 1.2s. Estimated remaining: 8m 35s. Rate: 154.3 symbols/min [2025-09-19T22:20:25.744151] [DEBUG] [LOCAL ] GEF: Derivative data saved (1820 records). [2025-09-19T22:20:25.746930] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-19T22:20:25.746975] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:25.749835] [INFO ] [MAIN ] Derivative Progress: 771/2093 symbols completed. GEF took 1.1s. Estimated remaining: 8m 34s. Rate: 154.5 symbols/min [2025-09-19T22:20:25.750440] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:25.785261] [DEBUG] [LOCAL ] GEL: Loaded 34950 existing records from primary storage. [2025-09-19T22:20:25.797711] [INFO ] [MAIN ] GEL: Loaded 34950 primary data records. [2025-09-19T22:20:25.969033] [DEBUG] [LOCAL ] GEO: Loaded 52962 existing records from primary storage. [2025-09-19T22:20:26.002346] [INFO ] [MAIN ] GEO: Loaded 52962 primary data records. [2025-09-19T22:20:26.002252] [DEBUG] [LOCAL ] GENI: Loaded 53692 existing records from primary storage. [2025-09-19T22:20:26.175365] [INFO ] [MAIN ] GENI: Loaded 53692 primary data records. [2025-09-19T22:20:26.842574] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:26.844058] [INFO ] [MAIN ] GEL: Generated 1820 derivative records from 34950 primary records. [2025-09-19T22:20:26.844702] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-19T22:20:26.862784] [DEBUG] [LOCAL ] GEL: Derivative data saved (1820 records). [2025-09-19T22:20:26.863196] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-19T22:20:26.865614] [INFO ] [MAIN ] Derivative Progress: 772/2093 symbols completed. GEL took 1.1s. Estimated remaining: 8m 34s. Rate: 154.1 symbols/min [2025-09-19T22:20:26.867528] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:26.886254] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:26.887343] [INFO ] [MAIN ] GEO: Generated 1820 derivative records from 52962 primary records. [2025-09-19T22:20:26.887601] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-19T22:20:26.920785] [DEBUG] [LOCAL ] GEO: Derivative data saved (1820 records). [2025-09-19T22:20:26.921745] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-19T22:20:26.921630] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:26.922787] [INFO ] [MAIN ] GENI: Generated 1820 derivative records from 53692 primary records. [2025-09-19T22:20:26.925256] [INFO ] [MAIN ] Derivative Progress: 773/2093 symbols completed. GEO took 1.2s. Estimated remaining: 8m 33s. Rate: 154.3 symbols/min [2025-09-19T22:20:26.925633] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:26.926007] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-19T22:20:26.956404] [DEBUG] [LOCAL ] GENI: Derivative data saved (1820 records). [2025-09-19T22:20:26.956737] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-19T22:20:26.959635] [INFO ] [MAIN ] Derivative Progress: 774/2093 symbols completed. GENI took 1.2s. Estimated remaining: 8m 32s. Rate: 154.4 symbols/min [2025-09-19T22:20:26.961037] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:26.984904] [DEBUG] [LOCAL ] GES: Loaded 41008 existing records from primary storage. [2025-09-19T22:20:26.985223] [INFO ] [MAIN ] GES: Loaded 41008 primary data records. [2025-09-19T22:20:27.113162] [DEBUG] [LOCAL ] GETY: Loaded 36842 existing records from primary storage. [2025-09-19T22:20:27.124345] [INFO ] [MAIN ] GETY: Loaded 36842 primary data records. [2025-09-19T22:20:27.515685] [DEBUG] [LOCAL ] GEV: Loaded 53932 existing records from primary storage. [2025-09-19T22:20:27.569082] [INFO ] [MAIN ] GEV: Loaded 53932 primary data records. [2025-09-19T22:20:28.035315] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:28.036199] [INFO ] [MAIN ] GES: Generated 1820 derivative records from 41008 primary records. [2025-09-19T22:20:28.036632] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-19T22:20:28.055998] [DEBUG] [LOCAL ] GES: Derivative data saved (1820 records). [2025-09-19T22:20:28.056450] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-19T22:20:28.058621] [INFO ] [MAIN ] Derivative Progress: 775/2093 symbols completed. GES took 1.2s. Estimated remaining: 8m 33s. Rate: 154.1 symbols/min [2025-09-19T22:20:28.059405] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:28.068453] [DEBUG] [LOCAL ] GF: Loaded 3524 existing records from primary storage. [2025-09-19T22:20:28.068895] [INFO ] [MAIN ] GF: Loaded 3524 primary data records. [2025-09-19T22:20:28.164274] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:28.176213] [INFO ] [MAIN ] GETY: Generated 1820 derivative records from 36842 primary records. [2025-09-19T22:20:28.187758] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-19T22:20:28.382241] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:28.416170] [DEBUG] [LOCAL ] GETY: Derivative data saved (1820 records). [2025-09-19T22:20:28.417211] [INFO ] [MAIN ] GEV: Generated 1820 derivative records from 53932 primary records. [2025-09-19T22:20:28.418022] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-19T22:20:28.418109] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-19T22:20:28.421159] [INFO ] [MAIN ] Derivative Progress: 776/2093 symbols completed. GETY took 1.5s. Estimated remaining: 8m 33s. Rate: 154.1 symbols/min [2025-09-19T22:20:28.422695] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:28.442288] [DEBUG] [LOCAL ] GEV: Derivative data saved (1820 records). [2025-09-19T22:20:28.442417] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-19T22:20:28.444997] [INFO ] [MAIN ] Derivative Progress: 777/2093 symbols completed. GEV took 1.5s. Estimated remaining: 8m 32s. Rate: 154.3 symbols/min [2025-09-19T22:20:28.445533] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:28.474557] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:28.475443] [INFO ] [MAIN ] GF: Generated 1820 derivative records from 3524 primary records. [2025-09-19T22:20:28.475624] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-19T22:20:28.498615] [DEBUG] [LOCAL ] GFF: Loaded 31628 existing records from primary storage. [2025-09-19T22:20:28.499261] [INFO ] [MAIN ] GFF: Loaded 31628 primary data records. [2025-09-19T22:20:28.557596] [DEBUG] [LOCAL ] GF: Derivative data saved (1820 records). [2025-09-19T22:20:28.608000] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-19T22:20:28.621450] [INFO ] [MAIN ] Derivative Progress: 778/2093 symbols completed. GF took 0.6s. Estimated remaining: 8m 31s. Rate: 154.4 symbols/min [2025-09-19T22:20:28.695529] [DEBUG] [LOCAL ] GFI: Loaded 53872 existing records from primary storage. [2025-09-19T22:20:28.715973] [INFO ] [MAIN ] GFI: Loaded 53872 primary data records. [2025-09-19T22:20:29.189034] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:29.190552] [INFO ] [MAIN ] GFF: Generated 1820 derivative records from 31628 primary records. [2025-09-19T22:20:29.190840] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-19T22:20:29.207459] [DEBUG] [LOCAL ] GFF: Derivative data saved (1820 records). [2025-09-19T22:20:29.207706] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-19T22:20:29.210474] [INFO ] [MAIN ] Derivative Progress: 779/2093 symbols completed. GFF took 0.8s. Estimated remaining: 8m 31s. Rate: 154.3 symbols/min [2025-09-19T22:20:29.225134] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:29.225690] [INFO ] [MAIN ] GFI: Generated 1820 derivative records from 53872 primary records. [2025-09-19T22:20:29.225752] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-19T22:20:29.241001] [DEBUG] [LOCAL ] GFI: Derivative data saved (1820 records). [2025-09-19T22:20:29.241059] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-19T22:20:29.243250] [INFO ] [MAIN ] Derivative Progress: 780/2093 symbols completed. GFI took 0.8s. Estimated remaining: 8m 30s. Rate: 154.5 symbols/min [2025-09-19T22:20:29.243895] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:29.243974] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:29.244203] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:29.255113] [DEBUG] [LOCAL ] GFR: Loaded 8622 existing records from primary storage. [2025-09-19T22:20:29.255315] [INFO ] [MAIN ] GFR: Loaded 8622 primary data records. [2025-09-19T22:20:29.606156] [DEBUG] [LOCAL ] GGB: Loaded 51759 existing records from primary storage. [2025-09-19T22:20:29.619099] [INFO ] [MAIN ] GGB: Loaded 51759 primary data records. [2025-09-19T22:20:29.659231] [DEBUG] [LOCAL ] GFL: Loaded 48895 existing records from primary storage. [2025-09-19T22:20:29.671769] [INFO ] [MAIN ] GFL: Loaded 48895 primary data records. [2025-09-19T22:20:30.249575] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:30.250880] [INFO ] [MAIN ] GFR: Generated 1820 derivative records from 8622 primary records. [2025-09-19T22:20:30.251438] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-19T22:20:30.270008] [DEBUG] [LOCAL ] GFR: Derivative data saved (1820 records). [2025-09-19T22:20:30.270169] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-19T22:20:30.272464] [INFO ] [MAIN ] Derivative Progress: 781/2093 symbols completed. GFR took 1.0s. Estimated remaining: 8m 31s. Rate: 154.1 symbols/min [2025-09-19T22:20:30.273141] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:30.293693] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:30.294392] [INFO ] [MAIN ] GGB: Generated 1820 derivative records from 51759 primary records. [2025-09-19T22:20:30.294502] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-19T22:20:30.314027] [DEBUG] [LOCAL ] GGB: Derivative data saved (1820 records). [2025-09-19T22:20:30.314338] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-19T22:20:30.316377] [INFO ] [MAIN ] Derivative Progress: 782/2093 symbols completed. GGB took 1.1s. Estimated remaining: 8m 30s. Rate: 154.3 symbols/min [2025-09-19T22:20:30.329066] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:30.339257] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:30.340049] [INFO ] [MAIN ] GFL: Generated 1820 derivative records from 48895 primary records. [2025-09-19T22:20:30.340397] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-19T22:20:30.372383] [DEBUG] [LOCAL ] GGG: Loaded 41753 existing records from primary storage. [2025-09-19T22:20:30.373248] [INFO ] [MAIN ] GGG: Loaded 41753 primary data records. [2025-09-19T22:20:30.389605] [DEBUG] [LOCAL ] GGT: Loaded 14290 existing records from primary storage. [2025-09-19T22:20:30.389747] [INFO ] [MAIN ] GGT: Loaded 14290 primary data records. [2025-09-19T22:20:30.390335] [DEBUG] [LOCAL ] GFL: Derivative data saved (1820 records). [2025-09-19T22:20:30.401357] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-19T22:20:30.448481] [INFO ] [MAIN ] Derivative Progress: 783/2093 symbols completed. GFL took 1.2s. Estimated remaining: 8m 29s. Rate: 154.4 symbols/min [2025-09-19T22:20:30.542333] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:30.709404] [DEBUG] [LOCAL ] GGZ: Loaded 2533 existing records from primary storage. [2025-09-19T22:20:30.730675] [INFO ] [MAIN ] GGZ: Loaded 2533 primary data records. [2025-09-19T22:20:31.427984] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:31.429817] [INFO ] [MAIN ] GGT: Generated 1820 derivative records from 14290 primary records. [2025-09-19T22:20:31.428702] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:31.430217] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-19T22:20:31.431928] [INFO ] [MAIN ] GGG: Generated 1820 derivative records from 41753 primary records. [2025-09-19T22:20:31.446435] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-19T22:20:31.474369] [DEBUG] [LOCAL ] GGT: Derivative data saved (1820 records). [2025-09-19T22:20:31.483585] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-19T22:20:31.495095] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:20:31.496318] [INFO ] [MAIN ] GGZ: Generated 1819 derivative records from 2533 primary records. [2025-09-19T22:20:31.493803] [INFO ] [MAIN ] Derivative Progress: 784/2093 symbols completed. GGT took 1.2s. Estimated remaining: 8m 30s. Rate: 154.1 symbols/min [2025-09-19T22:20:31.496464] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-19T22:20:31.497028] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:31.526936] [DEBUG] [LOCAL ] GHC: Loaded 2646 existing records from primary storage. [2025-09-19T22:20:31.523705] [DEBUG] [LOCAL ] GGG: Derivative data saved (1820 records). [2025-09-19T22:20:31.527487] [INFO ] [MAIN ] GHC: Loaded 2646 primary data records. [2025-09-19T22:20:31.533996] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-19T22:20:31.556907] [INFO ] [MAIN ] Derivative Progress: 785/2093 symbols completed. GGG took 1.3s. Estimated remaining: 8m 29s. Rate: 154.3 symbols/min [2025-09-19T22:20:31.578799] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:31.625029] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1819 records). [2025-09-19T22:20:31.645342] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-19T22:20:31.684241] [INFO ] [MAIN ] Derivative Progress: 786/2093 symbols completed. GGZ took 1.2s. Estimated remaining: 8m 28s. Rate: 154.4 symbols/min [2025-09-19T22:20:31.721311] [DEBUG] [LOCAL ] GHG: Loaded 3180 existing records from primary storage. [2025-09-19T22:20:31.711709] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:31.748113] [INFO ] [MAIN ] GHG: Loaded 3180 primary data records. [2025-09-19T22:20:32.047317] [DEBUG] [LOCAL ] GHI: Loaded 7129 existing records from primary storage. [2025-09-19T22:20:32.087056] [INFO ] [MAIN ] GHI: Loaded 7129 primary data records. [2025-09-19T22:20:32.800064] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:20:32.801327] [INFO ] [MAIN ] GHC: Generated 1819 derivative records from 2646 primary records. [2025-09-19T22:20:32.801930] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-19T22:20:32.823718] [DEBUG] [LOCAL ] GHC: Derivative data saved (1819 records). [2025-09-19T22:20:32.824734] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-19T22:20:32.827145] [INFO ] [MAIN ] Derivative Progress: 787/2093 symbols completed. GHC took 1.3s. Estimated remaining: 8m 29s. Rate: 154.0 symbols/min [2025-09-19T22:20:32.827853] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:32.855538] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:32.858540] [DEBUG] [LOCAL ] GHLD: Loaded 4080 existing records from primary storage. [2025-09-19T22:20:32.859029] [INFO ] [MAIN ] GHLD: Loaded 4080 primary data records. [2025-09-19T22:20:32.866633] [INFO ] [MAIN ] GHG: Generated 1820 derivative records from 3180 primary records. [2025-09-19T22:20:32.866837] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-19T22:20:32.957136] [DEBUG] [LOCAL ] GHG: Derivative data saved (1820 records). [2025-09-19T22:20:32.962460] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-19T22:20:32.972061] [INFO ] [MAIN ] Derivative Progress: 788/2093 symbols completed. GHG took 1.4s. Estimated remaining: 8m 28s. Rate: 154.1 symbols/min [2025-09-19T22:20:33.008922] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:33.013062] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:33.030890] [INFO ] [MAIN ] GHI: Generated 1820 derivative records from 7129 primary records. [2025-09-19T22:20:33.036153] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-19T22:20:33.282512] [DEBUG] [LOCAL ] GHM: Loaded 14487 existing records from primary storage. [2025-09-19T22:20:33.283389] [INFO ] [MAIN ] GHM: Loaded 14487 primary data records. [2025-09-19T22:20:33.370839] [DEBUG] [LOCAL ] GHI: Derivative data saved (1820 records). [2025-09-19T22:20:33.388006] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-19T22:20:33.391363] [INFO ] [MAIN ] Derivative Progress: 789/2093 symbols completed. GHI took 1.7s. Estimated remaining: 8m 28s. Rate: 154.1 symbols/min [2025-09-19T22:20:33.391852] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:33.634761] [DEBUG] [LOCAL ] GHY: Loaded 21391 existing records from primary storage. [2025-09-19T22:20:33.643145] [INFO ] [MAIN ] GHY: Loaded 21391 primary data records. [2025-09-19T22:20:33.649732] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:33.650755] [INFO ] [MAIN ] GHLD: Generated 1820 derivative records from 4080 primary records. [2025-09-19T22:20:33.682690] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-19T22:20:33.842790] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1820 records). [2025-09-19T22:20:33.844574] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-19T22:20:33.863454] [INFO ] [MAIN ] Derivative Progress: 790/2093 symbols completed. GHLD took 1.0s. Estimated remaining: 8m 27s. Rate: 154.1 symbols/min [2025-09-19T22:20:33.869845] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:34.018798] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:34.019773] [INFO ] [MAIN ] GHM: Generated 1820 derivative records from 14487 primary records. [2025-09-19T22:20:34.019945] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-19T22:20:34.038347] [DEBUG] [LOCAL ] GHM: Derivative data saved (1820 records). [2025-09-19T22:20:34.038532] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-19T22:20:34.041932] [INFO ] [MAIN ] Derivative Progress: 791/2093 symbols completed. GHM took 1.0s. Estimated remaining: 8m 27s. Rate: 154.2 symbols/min [2025-09-19T22:20:34.042771] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:34.083630] [DEBUG] [LOCAL ] GIB: Loaded 32922 existing records from primary storage. [2025-09-19T22:20:34.084259] [INFO ] [MAIN ] GIB: Loaded 32922 primary data records. [2025-09-19T22:20:34.084736] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:34.090559] [INFO ] [MAIN ] GHY: Generated 1820 derivative records from 21391 primary records. [2025-09-19T22:20:34.102207] [DEBUG] [LOCAL ] GIC: Loaded 14066 existing records from primary storage. [2025-09-19T22:20:34.111636] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-19T22:20:34.121676] [INFO ] [MAIN ] GIC: Loaded 14066 primary data records. [2025-09-19T22:20:34.566585] [DEBUG] [LOCAL ] GHY: Derivative data saved (1820 records). [2025-09-19T22:20:34.593897] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-19T22:20:34.723952] [INFO ] [MAIN ] Derivative Progress: 792/2093 symbols completed. GHY took 1.3s. Estimated remaining: 8m 27s. Rate: 154.0 symbols/min [2025-09-19T22:20:34.725759] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:34.758088] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:34.758987] [INFO ] [MAIN ] GIB: Generated 1820 derivative records from 32922 primary records. [2025-09-19T22:20:34.759212] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-19T22:20:34.801797] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:34.803425] [INFO ] [MAIN ] GIC: Generated 1820 derivative records from 14066 primary records. [2025-09-19T22:20:34.804050] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-19T22:20:34.804605] [DEBUG] [LOCAL ] GIB: Derivative data saved (1820 records). [2025-09-19T22:20:34.805358] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-19T22:20:34.808073] [INFO ] [MAIN ] Derivative Progress: 793/2093 symbols completed. GIB took 0.9s. Estimated remaining: 8m 26s. Rate: 154.2 symbols/min [2025-09-19T22:20:34.836227] [DEBUG] [LOCAL ] GIL: Loaded 43701 existing records from primary storage. [2025-09-19T22:20:34.836929] [INFO ] [MAIN ] GIL: Loaded 43701 primary data records. [2025-09-19T22:20:34.882786] [DEBUG] [LOCAL ] GIC: Derivative data saved (1820 records). [2025-09-19T22:20:34.916140] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-19T22:20:34.935173] [INFO ] [MAIN ] Derivative Progress: 794/2093 symbols completed. GIC took 0.9s. Estimated remaining: 8m 25s. Rate: 154.3 symbols/min [2025-09-19T22:20:35.166390] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:35.167266] [INFO ] [MAIN ] GIL: Generated 1820 derivative records from 43701 primary records. [2025-09-19T22:20:35.167334] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-19T22:20:35.183750] [DEBUG] [LOCAL ] GIL: Derivative data saved (1820 records). [2025-09-19T22:20:35.183842] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-19T22:20:35.186235] [INFO ] [MAIN ] Derivative Progress: 795/2093 symbols completed. GIL took 0.5s. Estimated remaining: 8m 24s. Rate: 154.4 symbols/min [2025-09-19T22:20:35.186862] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:35.187323] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:35.187262] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:35.238783] [DEBUG] [LOCAL ] GKOS: Loaded 43831 existing records from primary storage. [2025-09-19T22:20:35.239003] [INFO ] [MAIN ] GKOS: Loaded 43831 primary data records. [2025-09-19T22:20:35.357176] [DEBUG] [LOCAL ] GL: Loaded 38747 existing records from primary storage. [2025-09-19T22:20:35.368191] [INFO ] [MAIN ] GL: Loaded 38747 primary data records. [2025-09-19T22:20:35.567146] [DEBUG] [LOCAL ] GIS: Loaded 54454 existing records from primary storage. [2025-09-19T22:20:35.571100] [INFO ] [MAIN ] GIS: Loaded 54454 primary data records. [2025-09-19T22:20:36.287881] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:36.290476] [INFO ] [MAIN ] GKOS: Generated 1820 derivative records from 43831 primary records. [2025-09-19T22:20:36.292727] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-19T22:20:36.321883] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:36.323351] [INFO ] [MAIN ] GL: Generated 1820 derivative records from 38747 primary records. [2025-09-19T22:20:36.323849] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-19T22:20:36.344272] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1820 records). [2025-09-19T22:20:36.345042] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-19T22:20:36.347200] [INFO ] [MAIN ] Derivative Progress: 796/2093 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 25s. Rate: 154.0 symbols/min [2025-09-19T22:20:36.357373] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:36.364763] [DEBUG] [LOCAL ] GL: Derivative data saved (1820 records). [2025-09-19T22:20:36.365982] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:36.365621] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-19T22:20:36.369204] [INFO ] [MAIN ] Derivative Progress: 797/2093 symbols completed. GL took 1.2s. Estimated remaining: 8m 24s. Rate: 154.2 symbols/min [2025-09-19T22:20:36.369505] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:36.370710] [INFO ] [MAIN ] GIS: Generated 1820 derivative records from 54454 primary records. [2025-09-19T22:20:36.370835] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-19T22:20:36.389565] [DEBUG] [LOCAL ] GIS: Derivative data saved (1820 records). [2025-09-19T22:20:36.391983] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-19T22:20:36.394785] [INFO ] [MAIN ] Derivative Progress: 798/2093 symbols completed. GIS took 1.2s. Estimated remaining: 8m 23s. Rate: 154.4 symbols/min [2025-09-19T22:20:36.395333] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:36.400897] [DEBUG] [LOCAL ] GLP: Loaded 9735 existing records from primary storage. [2025-09-19T22:20:36.401047] [INFO ] [MAIN ] GLP: Loaded 9735 primary data records. [2025-09-19T22:20:36.737525] [DEBUG] [LOCAL ] GLOB: Loaded 47899 existing records from primary storage. [2025-09-19T22:20:36.766897] [INFO ] [MAIN ] GLOB: Loaded 47899 primary data records. [2025-09-19T22:20:36.894587] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-09-19T22:20:36.905411] [INFO ] [MAIN ] GLW: Loaded 54415 primary data records. [2025-09-19T22:20:37.493809] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:37.494684] [INFO ] [MAIN ] GLP: Generated 1820 derivative records from 9735 primary records. [2025-09-19T22:20:37.494906] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-19T22:20:37.514292] [DEBUG] [LOCAL ] GLP: Derivative data saved (1820 records). [2025-09-19T22:20:37.514850] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-19T22:20:37.517427] [INFO ] [MAIN ] Derivative Progress: 799/2093 symbols completed. GLP took 1.1s. Estimated remaining: 8m 24s. Rate: 154.0 symbols/min [2025-09-19T22:20:37.517883] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:37.536423] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:37.537257] [INFO ] [MAIN ] GLOB: Generated 1820 derivative records from 47899 primary records. [2025-09-19T22:20:37.537469] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-19T22:20:37.554991] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1820 records). [2025-09-19T22:20:37.555170] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-19T22:20:37.558334] [INFO ] [MAIN ] Derivative Progress: 800/2093 symbols completed. GLOB took 1.2s. Estimated remaining: 8m 23s. Rate: 154.2 symbols/min [2025-09-19T22:20:37.558779] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:37.577258] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:37.578192] [INFO ] [MAIN ] GLW: Generated 1820 derivative records from 54415 primary records. [2025-09-19T22:20:37.578265] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-19T22:20:37.611981] [DEBUG] [LOCAL ] GLW: Derivative data saved (1820 records). [2025-09-19T22:20:37.612125] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-19T22:20:37.614992] [INFO ] [MAIN ] Derivative Progress: 801/2093 symbols completed. GLW took 1.2s. Estimated remaining: 8m 22s. Rate: 154.4 symbols/min [2025-09-19T22:20:37.615545] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:37.634812] [DEBUG] [LOCAL ] GM: Loaded 54508 existing records from primary storage. [2025-09-19T22:20:37.648691] [INFO ] [MAIN ] GM: Loaded 54508 primary data records. [2025-09-19T22:20:37.776532] [DEBUG] [LOCAL ] GME: Loaded 54539 existing records from primary storage. [2025-09-19T22:20:37.802927] [INFO ] [MAIN ] GME: Loaded 54539 primary data records. [2025-09-19T22:20:38.112993] [DEBUG] [LOCAL ] GMED: Loaded 48979 existing records from primary storage. [2025-09-19T22:20:38.113307] [INFO ] [MAIN ] GMED: Loaded 48979 primary data records. [2025-09-19T22:20:38.649375] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:38.650670] [INFO ] [MAIN ] GM: Generated 1820 derivative records from 54508 primary records. [2025-09-19T22:20:38.650857] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-19T22:20:38.671418] [DEBUG] [LOCAL ] GM: Derivative data saved (1820 records). [2025-09-19T22:20:38.684314] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-19T22:20:38.687254] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:38.686832] [INFO ] [MAIN ] Derivative Progress: 802/2093 symbols completed. GM took 1.2s. Estimated remaining: 8m 23s. Rate: 154.0 symbols/min [2025-09-19T22:20:38.687594] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:38.688352] [INFO ] [MAIN ] GME: Generated 1820 derivative records from 54539 primary records. [2025-09-19T22:20:38.688584] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-19T22:20:38.710411] [DEBUG] [LOCAL ] GME: Derivative data saved (1820 records). [2025-09-19T22:20:38.710531] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-19T22:20:38.713085] [INFO ] [MAIN ] Derivative Progress: 803/2093 symbols completed. GME took 1.2s. Estimated remaining: 8m 22s. Rate: 154.2 symbols/min [2025-09-19T22:20:38.713421] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:38.728367] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:38.729256] [INFO ] [MAIN ] GMED: Generated 1820 derivative records from 48979 primary records. [2025-09-19T22:20:38.729462] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-19T22:20:38.761157] [DEBUG] [LOCAL ] GMED: Derivative data saved (1820 records). [2025-09-19T22:20:38.761511] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-19T22:20:38.774818] [INFO ] [MAIN ] Derivative Progress: 804/2093 symbols completed. GMED took 1.2s. Estimated remaining: 8m 21s. Rate: 154.4 symbols/min [2025-09-19T22:20:38.780983] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:38.782148] [DEBUG] [LOCAL ] GMRE: Loaded 38263 existing records from primary storage. [2025-09-19T22:20:38.782897] [DEBUG] [LOCAL ] GNE: Loaded 17580 existing records from primary storage. [2025-09-19T22:20:38.782570] [INFO ] [MAIN ] GMRE: Loaded 38263 primary data records. [2025-09-19T22:20:38.783139] [INFO ] [MAIN ] GNE: Loaded 17580 primary data records. [2025-09-19T22:20:39.473397] [DEBUG] [LOCAL ] GNK: Loaded 41479 existing records from primary storage. [2025-09-19T22:20:39.474414] [INFO ] [MAIN ] GNK: Loaded 41479 primary data records. [2025-09-19T22:20:39.814375] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:39.816052] [INFO ] [MAIN ] GMRE: Generated 1820 derivative records from 38263 primary records. [2025-09-19T22:20:39.816391] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-19T22:20:39.842495] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:39.843983] [INFO ] [MAIN ] GNE: Generated 1820 derivative records from 17580 primary records. [2025-09-19T22:20:39.844540] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-19T22:20:39.860273] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1820 records). [2025-09-19T22:20:39.860398] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-19T22:20:39.864331] [INFO ] [MAIN ] Derivative Progress: 805/2093 symbols completed. GMRE took 1.2s. Estimated remaining: 8m 22s. Rate: 154.0 symbols/min [2025-09-19T22:20:39.866046] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:39.868423] [DEBUG] [LOCAL ] GNE: Derivative data saved (1820 records). [2025-09-19T22:20:39.868626] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-19T22:20:39.871362] [INFO ] [MAIN ] Derivative Progress: 806/2093 symbols completed. GNE took 1.2s. Estimated remaining: 8m 21s. Rate: 154.2 symbols/min [2025-09-19T22:20:39.871883] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:39.890327] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:39.891225] [INFO ] [MAIN ] GNK: Generated 1820 derivative records from 41479 primary records. [2025-09-19T22:20:39.891337] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-19T22:20:39.915383] [DEBUG] [LOCAL ] GNK: Derivative data saved (1820 records). [2025-09-19T22:20:39.925722] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-19T22:20:39.928558] [INFO ] [MAIN ] Derivative Progress: 807/2093 symbols completed. GNK took 1.1s. Estimated remaining: 8m 20s. Rate: 154.4 symbols/min [2025-09-19T22:20:39.938233] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:39.965785] [DEBUG] [LOCAL ] GNT: Loaded 7944 existing records from primary storage. [2025-09-19T22:20:39.977723] [INFO ] [MAIN ] GNT: Loaded 7944 primary data records. [2025-09-19T22:20:39.961542] [DEBUG] [LOCAL ] GNL: Loaded 48190 existing records from primary storage. [2025-09-19T22:20:39.999687] [DEBUG] [LOCAL ] GNRC: Loaded 45796 existing records from primary storage. [2025-09-19T22:20:39.989145] [INFO ] [MAIN ] GNL: Loaded 48190 primary data records. [2025-09-19T22:20:40.016107] [INFO ] [MAIN ] GNRC: Loaded 45796 primary data records. [2025-09-19T22:20:40.971442] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:40.972074] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:40.985851] [INFO ] [MAIN ] GNT: Generated 1820 derivative records from 7944 primary records. [2025-09-19T22:20:40.985002] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:40.986534] [INFO ] [MAIN ] GNRC: Generated 1820 derivative records from 45796 primary records. [2025-09-19T22:20:40.987518] [INFO ] [MAIN ] GNL: Generated 1820 derivative records from 48190 primary records. [2025-09-19T22:20:40.986756] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-19T22:20:40.988052] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-19T22:20:40.987918] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-19T22:20:41.034704] [DEBUG] [LOCAL ] GNT: Derivative data saved (1820 records). [2025-09-19T22:20:41.036041] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-19T22:20:41.038428] [INFO ] [MAIN ] Derivative Progress: 808/2093 symbols completed. GNT took 1.1s. Estimated remaining: 8m 21s. Rate: 154.0 symbols/min [2025-09-19T22:20:41.039487] [DEBUG] [LOCAL ] GNL: Derivative data saved (1820 records). [2025-09-19T22:20:41.039931] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-19T22:20:41.042406] [INFO ] [MAIN ] Derivative Progress: 809/2093 symbols completed. GNL took 1.2s. Estimated remaining: 8m 20s. Rate: 154.2 symbols/min [2025-09-19T22:20:41.043297] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1820 records). [2025-09-19T22:20:41.043389] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-19T22:20:41.046439] [INFO ] [MAIN ] Derivative Progress: 810/2093 symbols completed. GNRC took 1.2s. Estimated remaining: 8m 19s. Rate: 154.4 symbols/min [2025-09-19T22:20:41.047373] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:41.047230] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:41.047310] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:41.059279] [DEBUG] [LOCAL ] GNTY: Loaded 7131 existing records from primary storage. [2025-09-19T22:20:41.059468] [INFO ] [MAIN ] GNTY: Loaded 7131 primary data records. [2025-09-19T22:20:41.433839] [DEBUG] [LOCAL ] GOF: Loaded 43673 existing records from primary storage. [2025-09-19T22:20:41.432609] [DEBUG] [LOCAL ] GNW: Loaded 52097 existing records from primary storage. [2025-09-19T22:20:41.434195] [INFO ] [MAIN ] GNW: Loaded 52097 primary data records. [2025-09-19T22:20:41.434375] [INFO ] [MAIN ] GOF: Loaded 43673 primary data records. [2025-09-19T22:20:42.124023] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:42.126796] [INFO ] [MAIN ] GNTY: Generated 1820 derivative records from 7131 primary records. [2025-09-19T22:20:42.127857] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-19T22:20:42.146926] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1820 records). [2025-09-19T22:20:42.147177] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-19T22:20:42.150251] [INFO ] [MAIN ] Derivative Progress: 811/2093 symbols completed. GNTY took 1.1s. Estimated remaining: 8m 19s. Rate: 154.0 symbols/min [2025-09-19T22:20:42.150834] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:42.174927] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:42.176169] [INFO ] [MAIN ] GOF: Generated 1820 derivative records from 43673 primary records. [2025-09-19T22:20:42.176371] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-19T22:20:42.218151] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:42.219848] [INFO ] [MAIN ] GNW: Generated 1820 derivative records from 52097 primary records. [2025-09-19T22:20:42.220186] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-19T22:20:42.240371] [DEBUG] [LOCAL ] GOF: Derivative data saved (1820 records). [2025-09-19T22:20:42.245032] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-19T22:20:42.247554] [INFO ] [MAIN ] Derivative Progress: 812/2093 symbols completed. GOF took 1.2s. Estimated remaining: 8m 19s. Rate: 154.2 symbols/min [2025-09-19T22:20:42.248710] [DEBUG] [LOCAL ] GOLF: Loaded 32439 existing records from primary storage. [2025-09-19T22:20:42.249362] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:42.249974] [INFO ] [MAIN ] GOLF: Loaded 32439 primary data records. [2025-09-19T22:20:42.318581] [DEBUG] [LOCAL ] GNW: Derivative data saved (1820 records). [2025-09-19T22:20:42.323947] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-19T22:20:42.333568] [INFO ] [MAIN ] Derivative Progress: 813/2093 symbols completed. GNW took 1.3s. Estimated remaining: 8m 18s. Rate: 154.3 symbols/min [2025-09-19T22:20:42.356700] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:42.594301] [DEBUG] [LOCAL ] GOOS: Loaded 46476 existing records from primary storage. [2025-09-19T22:20:42.594947] [INFO ] [MAIN ] GOOS: Loaded 46476 primary data records. [2025-09-19T22:20:42.686498] [DEBUG] [LOCAL ] GOTU: Loaded 40002 existing records from primary storage. [2025-09-19T22:20:42.697835] [INFO ] [MAIN ] GOTU: Loaded 40002 primary data records. [2025-09-19T22:20:43.259677] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:43.260482] [INFO ] [MAIN ] GOLF: Generated 1820 derivative records from 32439 primary records. [2025-09-19T22:20:43.260689] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-19T22:20:43.282255] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1820 records). [2025-09-19T22:20:43.283018] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-19T22:20:43.285309] [INFO ] [MAIN ] Derivative Progress: 814/2093 symbols completed. GOLF took 1.1s. Estimated remaining: 8m 18s. Rate: 154.1 symbols/min [2025-09-19T22:20:43.285869] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:43.313235] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:43.326447] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:43.327271] [INFO ] [MAIN ] GOOS: Generated 1820 derivative records from 46476 primary records. [2025-09-19T22:20:43.327935] [INFO ] [MAIN ] GOTU: Generated 1820 derivative records from 40002 primary records. [2025-09-19T22:20:43.327987] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-19T22:20:43.328817] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-19T22:20:43.357427] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1820 records). [2025-09-19T22:20:43.358163] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-19T22:20:43.360968] [INFO ] [MAIN ] Derivative Progress: 815/2093 symbols completed. GOTU took 1.0s. Estimated remaining: 8m 17s. Rate: 154.2 symbols/min [2025-09-19T22:20:43.362141] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:43.376189] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1820 records). [2025-09-19T22:20:43.376368] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-19T22:20:43.378696] [INFO ] [MAIN ] Derivative Progress: 816/2093 symbols completed. GOOS took 1.1s. Estimated remaining: 8m 16s. Rate: 154.4 symbols/min [2025-09-19T22:20:43.379295] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:43.404715] [DEBUG] [LOCAL ] GPC: Loaded 47474 existing records from primary storage. [2025-09-19T22:20:43.404924] [DEBUG] [LOCAL ] GPJA: Loaded 4084 existing records from primary storage. [2025-09-19T22:20:43.405081] [INFO ] [MAIN ] GPC: Loaded 47474 primary data records. [2025-09-19T22:20:43.405150] [INFO ] [MAIN ] GPJA: Loaded 4084 primary data records. [2025-09-19T22:20:43.485196] [DEBUG] [LOCAL ] GPI: Loaded 15365 existing records from primary storage. [2025-09-19T22:20:43.495707] [INFO ] [MAIN ] GPI: Loaded 15365 primary data records. [2025-09-19T22:20:44.407995] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-19T22:20:44.408985] [INFO ] [MAIN ] GPJA: Generated 1818 derivative records from 4084 primary records. [2025-09-19T22:20:44.409085] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-19T22:20:44.428438] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1818 records). [2025-09-19T22:20:44.428864] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-19T22:20:44.431060] [INFO ] [MAIN ] Derivative Progress: 817/2093 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 17s. Rate: 154.1 symbols/min [2025-09-19T22:20:44.439873] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:44.446613] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:44.448013] [INFO ] [MAIN ] GPI: Generated 1820 derivative records from 15365 primary records. [2025-09-19T22:20:44.448285] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-19T22:20:44.462553] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:44.463522] [INFO ] [MAIN ] GPC: Generated 1820 derivative records from 47474 primary records. [2025-09-19T22:20:44.470912] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-19T22:20:44.500105] [DEBUG] [LOCAL ] GPI: Derivative data saved (1820 records). [2025-09-19T22:20:44.499027] [DEBUG] [LOCAL ] GPC: Derivative data saved (1820 records). [2025-09-19T22:20:44.500294] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-19T22:20:44.500391] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-19T22:20:44.502953] [INFO ] [MAIN ] Derivative Progress: 818/2093 symbols completed. GPC took 1.2s. Estimated remaining: 8m 16s. Rate: 154.2 symbols/min [2025-09-19T22:20:44.505456] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:44.505546] [INFO ] [MAIN ] Derivative Progress: 819/2093 symbols completed. GPI took 1.1s. Estimated remaining: 8m 15s. Rate: 154.4 symbols/min [2025-09-19T22:20:44.506016] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:44.560453] [DEBUG] [LOCAL ] GPMT: Loaded 27210 existing records from primary storage. [2025-09-19T22:20:44.561747] [INFO ] [MAIN ] GPMT: Loaded 27210 primary data records. [2025-09-19T22:20:44.561624] [DEBUG] [LOCAL ] GPK: Loaded 53444 existing records from primary storage. [2025-09-19T22:20:44.561975] [INFO ] [MAIN ] GPK: Loaded 53444 primary data records. [2025-09-19T22:20:44.902567] [DEBUG] [LOCAL ] GPN: Loaded 52839 existing records from primary storage. [2025-09-19T22:20:44.999370] [INFO ] [MAIN ] GPN: Loaded 52839 primary data records. [2025-09-19T22:20:45.577849] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:45.590491] [INFO ] [MAIN ] GPMT: Generated 1820 derivative records from 27210 primary records. [2025-09-19T22:20:45.590852] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-19T22:20:45.591221] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:45.592782] [INFO ] [MAIN ] GPK: Generated 1820 derivative records from 53444 primary records. [2025-09-19T22:20:45.593022] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-19T22:20:45.627580] [DEBUG] [LOCAL ] GPK: Derivative data saved (1820 records). [2025-09-19T22:20:45.628175] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1820 records). [2025-09-19T22:20:45.628438] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-19T22:20:45.628720] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-19T22:20:45.638346] [INFO ] [MAIN ] Derivative Progress: 820/2093 symbols completed. GPK took 1.2s. Estimated remaining: 8m 16s. Rate: 154.0 symbols/min [2025-09-19T22:20:45.645199] [INFO ] [MAIN ] Derivative Progress: 821/2093 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 15s. Rate: 154.2 symbols/min [2025-09-19T22:20:45.646074] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:45.645994] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:45.646231] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:45.647481] [INFO ] [MAIN ] GPN: Generated 1820 derivative records from 52839 primary records. [2025-09-19T22:20:45.647717] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-19T22:20:45.664498] [DEBUG] [LOCAL ] GPN: Derivative data saved (1820 records). [2025-09-19T22:20:45.664747] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-19T22:20:45.667440] [INFO ] [MAIN ] Derivative Progress: 822/2093 symbols completed. GPN took 1.2s. Estimated remaining: 8m 14s. Rate: 154.4 symbols/min [2025-09-19T22:20:45.667739] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:45.686511] [DEBUG] [LOCAL ] GPOR: Loaded 23489 existing records from primary storage. [2025-09-19T22:20:45.686790] [INFO ] [MAIN ] GPOR: Loaded 23489 primary data records. [2025-09-19T22:20:45.815300] [DEBUG] [LOCAL ] GRBK: Loaded 27675 existing records from primary storage. [2025-09-19T22:20:45.830128] [INFO ] [MAIN ] GRBK: Loaded 27675 primary data records. [2025-09-19T22:20:45.846594] [DEBUG] [LOCAL ] GPRK: Loaded 39827 existing records from primary storage. [2025-09-19T22:20:45.862077] [INFO ] [MAIN ] GPRK: Loaded 39827 primary data records. [2025-09-19T22:20:46.676571] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:46.678797] [INFO ] [MAIN ] GPOR: Generated 1820 derivative records from 23489 primary records. [2025-09-19T22:20:46.680153] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-19T22:20:46.698264] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1820 records). [2025-09-19T22:20:46.699833] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-19T22:20:46.702323] [INFO ] [MAIN ] Derivative Progress: 823/2093 symbols completed. GPOR took 1.1s. Estimated remaining: 8m 14s. Rate: 154.1 symbols/min [2025-09-19T22:20:46.725392] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:46.726389] [INFO ] [MAIN ] GPRK: Generated 1820 derivative records from 39827 primary records. [2025-09-19T22:20:46.739368] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-19T22:20:46.739740] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:46.741260] [INFO ] [MAIN ] GRBK: Generated 1820 derivative records from 27675 primary records. [2025-09-19T22:20:46.741353] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-19T22:20:46.770811] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1820 records). [2025-09-19T22:20:46.771460] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-19T22:20:46.773997] [INFO ] [MAIN ] Derivative Progress: 824/2093 symbols completed. GPRK took 1.1s. Estimated remaining: 8m 14s. Rate: 154.2 symbols/min [2025-09-19T22:20:46.778079] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1820 records). [2025-09-19T22:20:46.778151] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-19T22:20:46.780471] [INFO ] [MAIN ] Derivative Progress: 825/2093 symbols completed. GRBK took 1.1s. Estimated remaining: 8m 13s. Rate: 154.4 symbols/min [2025-09-19T22:20:46.781093] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:46.781229] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:46.781365] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:46.793852] [DEBUG] [LOCAL ] GRC: Loaded 8977 existing records from primary storage. [2025-09-19T22:20:46.793990] [INFO ] [MAIN ] GRC: Loaded 8977 primary data records. [2025-09-19T22:20:46.922867] [DEBUG] [LOCAL ] GRDN: Loaded 19583 existing records from primary storage. [2025-09-19T22:20:46.923105] [INFO ] [MAIN ] GRDN: Loaded 19583 primary data records. [2025-09-19T22:20:47.182943] [DEBUG] [LOCAL ] GRMN: Loaded 42296 existing records from primary storage. [2025-09-19T22:20:47.214962] [INFO ] [MAIN ] GRMN: Loaded 42296 primary data records. [2025-09-19T22:20:47.842903] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:47.844206] [INFO ] [MAIN ] GRC: Generated 1820 derivative records from 8977 primary records. [2025-09-19T22:20:47.857536] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:47.857118] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-19T22:20:47.860212] [INFO ] [MAIN ] GRDN: Generated 1820 derivative records from 19583 primary records. [2025-09-19T22:20:47.860326] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-19T22:20:47.905770] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:47.908885] [DEBUG] [LOCAL ] GRC: Derivative data saved (1820 records). [2025-09-19T22:20:47.909680] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1820 records). [2025-09-19T22:20:47.909883] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-19T22:20:47.912354] [INFO ] [MAIN ] Derivative Progress: 826/2093 symbols completed. GRDN took 1.1s. Estimated remaining: 8m 13s. Rate: 154.1 symbols/min [2025-09-19T22:20:47.912507] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-19T22:20:47.910000] [INFO ] [MAIN ] GRMN: Generated 1820 derivative records from 42296 primary records. [2025-09-19T22:20:47.915269] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:47.915019] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-19T22:20:47.915138] [INFO ] [MAIN ] Derivative Progress: 827/2093 symbols completed. GRC took 1.1s. Estimated remaining: 8m 12s. Rate: 154.3 symbols/min [2025-09-19T22:20:47.916374] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:47.935572] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1820 records). [2025-09-19T22:20:47.935805] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-19T22:20:47.938458] [INFO ] [MAIN ] Derivative Progress: 828/2093 symbols completed. GRMN took 1.2s. Estimated remaining: 8m 11s. Rate: 154.4 symbols/min [2025-09-19T22:20:47.938833] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:47.949881] [DEBUG] [LOCAL ] GROV: Loaded 9258 existing records from primary storage. [2025-09-19T22:20:47.950088] [INFO ] [MAIN ] GROV: Loaded 9258 primary data records. [2025-09-19T22:20:48.153920] [DEBUG] [LOCAL ] GRNT: Loaded 34483 existing records from primary storage. [2025-09-19T22:20:48.298010] [INFO ] [MAIN ] GRNT: Loaded 34483 primary data records. [2025-09-19T22:20:48.299538] [DEBUG] [LOCAL ] GRND: Loaded 50876 existing records from primary storage. [2025-09-19T22:20:48.313864] [INFO ] [MAIN ] GRND: Loaded 50876 primary data records. [2025-09-19T22:20:48.978486] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:48.979812] [INFO ] [MAIN ] GROV: Generated 1820 derivative records from 9258 primary records. [2025-09-19T22:20:48.980058] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-19T22:20:49.000925] [DEBUG] [LOCAL ] GROV: Derivative data saved (1820 records). [2025-09-19T22:20:49.001328] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-19T22:20:49.003620] [INFO ] [MAIN ] Derivative Progress: 829/2093 symbols completed. GROV took 1.1s. Estimated remaining: 8m 12s. Rate: 154.1 symbols/min [2025-09-19T22:20:49.004212] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:49.015185] [DEBUG] [LOCAL ] GRX: Loaded 4454 existing records from primary storage. [2025-09-19T22:20:49.028587] [INFO ] [MAIN ] GRX: Loaded 4454 primary data records. [2025-09-19T22:20:49.029195] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:49.058467] [INFO ] [MAIN ] GRND: Generated 1820 derivative records from 50876 primary records. [2025-09-19T22:20:49.073414] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-19T22:20:49.108219] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:49.121503] [INFO ] [MAIN ] GRNT: Generated 1820 derivative records from 34483 primary records. [2025-09-19T22:20:49.122633] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-19T22:20:49.179285] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1820 records). [2025-09-19T22:20:49.180788] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-19T22:20:49.194670] [INFO ] [MAIN ] Derivative Progress: 830/2093 symbols completed. GRNT took 1.3s. Estimated remaining: 8m 11s. Rate: 154.2 symbols/min [2025-09-19T22:20:49.186760] [DEBUG] [LOCAL ] GRND: Derivative data saved (1820 records). [2025-09-19T22:20:49.233214] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:49.205313] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-19T22:20:49.244069] [INFO ] [MAIN ] Derivative Progress: 831/2093 symbols completed. GRND took 1.3s. Estimated remaining: 8m 11s. Rate: 154.4 symbols/min [2025-09-19T22:20:49.424110] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:49.465622] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:49.466689] [INFO ] [MAIN ] GRX: Generated 1820 derivative records from 4454 primary records. [2025-09-19T22:20:49.466844] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-19T22:20:49.484500] [DEBUG] [LOCAL ] GRX: Derivative data saved (1820 records). [2025-09-19T22:20:49.497418] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-19T22:20:49.511978] [INFO ] [MAIN ] Derivative Progress: 832/2093 symbols completed. GRX took 0.5s. Estimated remaining: 8m 10s. Rate: 154.4 symbols/min [2025-09-19T22:20:49.512462] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:49.513689] [DEBUG] [LOCAL ] GSBD: Loaded 39847 existing records from primary storage. [2025-09-19T22:20:49.514216] [INFO ] [MAIN ] GSBD: Loaded 39847 primary data records. [2025-09-19T22:20:49.638005] [DEBUG] [LOCAL ] GS: Loaded 52916 existing records from primary storage. [2025-09-19T22:20:49.643935] [INFO ] [MAIN ] GS: Loaded 52916 primary data records. [2025-09-19T22:20:50.198034] [DEBUG] [LOCAL ] GSK: Loaded 54278 existing records from primary storage. [2025-09-19T22:20:50.206946] [INFO ] [MAIN ] GSK: Loaded 54278 primary data records. [2025-09-19T22:20:50.546803] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:50.547861] [INFO ] [MAIN ] GSBD: Generated 1820 derivative records from 39847 primary records. [2025-09-19T22:20:50.548217] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-19T22:20:50.583686] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:50.585839] [INFO ] [MAIN ] GS: Generated 1820 derivative records from 52916 primary records. [2025-09-19T22:20:50.586279] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-19T22:20:50.587415] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1820 records). [2025-09-19T22:20:50.587665] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-19T22:20:50.590815] [INFO ] [MAIN ] Derivative Progress: 833/2093 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 11s. Rate: 154.1 symbols/min [2025-09-19T22:20:50.599693] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:50.608324] [DEBUG] [LOCAL ] GS: Derivative data saved (1820 records). [2025-09-19T22:20:50.609471] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-19T22:20:50.612519] [INFO ] [MAIN ] Derivative Progress: 834/2093 symbols completed. GS took 1.4s. Estimated remaining: 8m 10s. Rate: 154.3 symbols/min [2025-09-19T22:20:50.613703] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:50.627950] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:50.628601] [INFO ] [MAIN ] GSK: Generated 1820 derivative records from 54278 primary records. [2025-09-19T22:20:50.628798] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-19T22:20:50.654947] [DEBUG] [LOCAL ] GSK: Derivative data saved (1820 records). [2025-09-19T22:20:50.655202] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-19T22:20:50.657604] [INFO ] [MAIN ] Derivative Progress: 835/2093 symbols completed. GSK took 1.1s. Estimated remaining: 8m 9s. Rate: 154.4 symbols/min [2025-09-19T22:20:50.658166] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:50.670784] [DEBUG] [LOCAL ] GSL: Loaded 34370 existing records from primary storage. [2025-09-19T22:20:50.670916] [INFO ] [MAIN ] GSL: Loaded 34370 primary data records. [2025-09-19T22:20:50.917166] [DEBUG] [LOCAL ] GTES: Loaded 51492 existing records from primary storage. [2025-09-19T22:20:51.022588] [INFO ] [MAIN ] GTES: Loaded 51492 primary data records. [2025-09-19T22:20:51.120283] [DEBUG] [LOCAL ] GTLS: Loaded 43830 existing records from primary storage. [2025-09-19T22:20:51.144736] [INFO ] [MAIN ] GTLS: Loaded 43830 primary data records. [2025-09-19T22:20:51.647464] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:51.703288] [INFO ] [MAIN ] GSL: Generated 1820 derivative records from 34370 primary records. [2025-09-19T22:20:51.809800] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-19T22:20:51.830186] [DEBUG] [LOCAL ] GSL: Derivative data saved (1820 records). [2025-09-19T22:20:51.831126] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-19T22:20:51.833324] [INFO ] [MAIN ] Derivative Progress: 836/2093 symbols completed. GSL took 1.2s. Estimated remaining: 8m 10s. Rate: 154.1 symbols/min [2025-09-19T22:20:51.835402] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:51.852755] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:51.853756] [INFO ] [MAIN ] GTES: Generated 1820 derivative records from 51492 primary records. [2025-09-19T22:20:51.855038] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-19T22:20:51.874212] [DEBUG] [LOCAL ] GTES: Derivative data saved (1820 records). [2025-09-19T22:20:51.874860] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-19T22:20:51.877082] [INFO ] [MAIN ] Derivative Progress: 837/2093 symbols completed. GTES took 1.3s. Estimated remaining: 8m 9s. Rate: 154.2 symbols/min [2025-09-19T22:20:51.878156] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:51.894900] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:51.895671] [INFO ] [MAIN ] GTLS: Generated 1820 derivative records from 43830 primary records. [2025-09-19T22:20:51.895844] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-19T22:20:51.922249] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1820 records). [2025-09-19T22:20:51.922479] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-19T22:20:51.925235] [INFO ] [MAIN ] Derivative Progress: 838/2093 symbols completed. GTLS took 1.3s. Estimated remaining: 8m 8s. Rate: 154.4 symbols/min [2025-09-19T22:20:51.951517] [DEBUG] [LOCAL ] GTN: Loaded 46463 existing records from primary storage. [2025-09-19T22:20:51.960239] [INFO ] [MAIN ] GTN: Loaded 46463 primary data records. [2025-09-19T22:20:52.039604] [DEBUG] [LOCAL ] GTY: Loaded 30827 existing records from primary storage. [2025-09-19T22:20:52.056378] [INFO ] [MAIN ] GTY: Loaded 30827 primary data records. [2025-09-19T22:20:52.601561] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:52.602756] [INFO ] [MAIN ] GTN: Generated 1820 derivative records from 46463 primary records. [2025-09-19T22:20:52.603156] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-19T22:20:52.634001] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:52.635556] [INFO ] [MAIN ] GTY: Generated 1820 derivative records from 30827 primary records. [2025-09-19T22:20:52.635900] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-19T22:20:52.653281] [DEBUG] [LOCAL ] GTN: Derivative data saved (1820 records). [2025-09-19T22:20:52.654841] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-19T22:20:52.657165] [INFO ] [MAIN ] Derivative Progress: 839/2093 symbols completed. GTN took 0.8s. Estimated remaining: 8m 8s. Rate: 154.2 symbols/min [2025-09-19T22:20:52.658813] [DEBUG] [LOCAL ] GTY: Derivative data saved (1820 records). [2025-09-19T22:20:52.658944] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-19T22:20:52.661187] [INFO ] [MAIN ] Derivative Progress: 840/2093 symbols completed. GTY took 0.8s. Estimated remaining: 8m 7s. Rate: 154.4 symbols/min [2025-09-19T22:20:52.661803] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:52.662593] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:52.662208] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:52.681937] [DEBUG] [LOCAL ] GUG: Loaded 12453 existing records from primary storage. [2025-09-19T22:20:52.688834] [INFO ] [MAIN ] GUG: Loaded 12453 primary data records. [2025-09-19T22:20:52.701055] [DEBUG] [LOCAL ] GUT: Loaded 15779 existing records from primary storage. [2025-09-19T22:20:52.726722] [INFO ] [MAIN ] GUT: Loaded 15779 primary data records. [2025-09-19T22:20:52.932136] [DEBUG] [LOCAL ] GVA: Loaded 34588 existing records from primary storage. [2025-09-19T22:20:53.030556] [INFO ] [MAIN ] GVA: Loaded 34588 primary data records. [2025-09-19T22:20:53.755080] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:53.768939] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:20:53.768468] [INFO ] [MAIN ] GUT: Generated 1820 derivative records from 15779 primary records. [2025-09-19T22:20:53.770056] [INFO ] [MAIN ] GUG: Generated 1819 derivative records from 12453 primary records. [2025-09-19T22:20:53.770293] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-19T22:20:53.770382] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-19T22:20:53.800134] [DEBUG] [LOCAL ] GUG: Derivative data saved (1819 records). [2025-09-19T22:20:53.801384] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-19T22:20:53.804515] [INFO ] [MAIN ] Derivative Progress: 841/2093 symbols completed. GUG took 1.1s. Estimated remaining: 8m 8s. Rate: 154.1 symbols/min [2025-09-19T22:20:53.805857] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:53.811730] [DEBUG] [LOCAL ] GUT: Derivative data saved (1820 records). [2025-09-19T22:20:53.824258] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-19T22:20:53.827072] [INFO ] [MAIN ] Derivative Progress: 842/2093 symbols completed. GUT took 1.2s. Estimated remaining: 8m 7s. Rate: 154.2 symbols/min [2025-09-19T22:20:53.827504] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:53.828526] [INFO ] [MAIN ] GVA: Generated 1820 derivative records from 34588 primary records. [2025-09-19T22:20:53.828771] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-19T22:20:53.828965] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:53.855716] [DEBUG] [LOCAL ] GWH: Loaded 15335 existing records from primary storage. [2025-09-19T22:20:53.856422] [INFO ] [MAIN ] GWH: Loaded 15335 primary data records. [2025-09-19T22:20:53.908818] [DEBUG] [LOCAL ] GVA: Derivative data saved (1820 records). [2025-09-19T22:20:53.942753] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-19T22:20:53.977774] [INFO ] [MAIN ] Derivative Progress: 843/2093 symbols completed. GVA took 1.3s. Estimated remaining: 8m 6s. Rate: 154.3 symbols/min [2025-09-19T22:20:53.999555] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:54.197444] [DEBUG] [LOCAL ] GWRE: Loaded 41935 existing records from primary storage. [2025-09-19T22:20:54.197762] [INFO ] [MAIN ] GWRE: Loaded 41935 primary data records. [2025-09-19T22:20:54.325148] [DEBUG] [LOCAL ] GWW: Loaded 20360 existing records from primary storage. [2025-09-19T22:20:54.331048] [INFO ] [MAIN ] GWW: Loaded 20360 primary data records. [2025-09-19T22:20:54.859043] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:54.861093] [INFO ] [MAIN ] GWH: Generated 1820 derivative records from 15335 primary records. [2025-09-19T22:20:54.861672] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-19T22:20:54.885693] [DEBUG] [LOCAL ] GWH: Derivative data saved (1820 records). [2025-09-19T22:20:54.886332] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-19T22:20:54.888969] [INFO ] [MAIN ] Derivative Progress: 844/2093 symbols completed. GWH took 1.1s. Estimated remaining: 8m 6s. Rate: 154.1 symbols/min [2025-09-19T22:20:54.889388] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:54.904776] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:54.905883] [INFO ] [MAIN ] GWRE: Generated 1820 derivative records from 41935 primary records. [2025-09-19T22:20:54.905951] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-19T22:20:54.924134] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1820 records). [2025-09-19T22:20:54.924569] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-19T22:20:54.926789] [INFO ] [MAIN ] Derivative Progress: 845/2093 symbols completed. GWRE took 1.1s. Estimated remaining: 8m 5s. Rate: 154.3 symbols/min [2025-09-19T22:20:54.927673] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:54.935369] [DEBUG] [LOCAL ] GYLD: Loaded 1576 existing records from primary storage. [2025-09-19T22:20:54.935803] [INFO ] [MAIN ] GYLD: Loaded 1576 primary data records. [2025-09-19T22:20:54.984422] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:54.997505] [INFO ] [MAIN ] GWW: Generated 1820 derivative records from 20360 primary records. [2025-09-19T22:20:55.019246] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-19T22:20:55.168947] [DEBUG] [LOCAL ] GWW: Derivative data saved (1820 records). [2025-09-19T22:20:55.169114] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-19T22:20:55.210739] [INFO ] [MAIN ] Derivative Progress: 846/2093 symbols completed. GWW took 1.2s. Estimated remaining: 8m 5s. Rate: 154.3 symbols/min [2025-09-19T22:20:55.314765] [DEBUG] [LOCAL ] GXO: Loaded 48518 existing records from primary storage. [2025-09-19T22:20:55.315712] [INFO ] [MAIN ] GXO: Loaded 48518 primary data records. [2025-09-19T22:20:55.315820] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:55.722794] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:20:55.724001] [INFO ] [MAIN ] GYLD: Generated 1819 derivative records from 1576 primary records. [2025-09-19T22:20:55.725777] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-19T22:20:55.725322] [DEBUG] [LOCAL ] H: Loaded 45614 existing records from primary storage. [2025-09-19T22:20:55.727485] [INFO ] [MAIN ] H: Loaded 45614 primary data records. [2025-09-19T22:20:55.824837] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1819 records). [2025-09-19T22:20:55.830324] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-19T22:20:55.850067] [INFO ] [MAIN ] Derivative Progress: 847/2093 symbols completed. GYLD took 0.9s. Estimated remaining: 8m 5s. Rate: 154.2 symbols/min [2025-09-19T22:20:55.872063] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:56.089228] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:56.091427] [INFO ] [MAIN ] GXO: Generated 1820 derivative records from 48518 primary records. [2025-09-19T22:20:56.092080] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-19T22:20:56.130835] [DEBUG] [LOCAL ] GXO: Derivative data saved (1820 records). [2025-09-19T22:20:56.132068] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-19T22:20:56.136597] [INFO ] [MAIN ] Derivative Progress: 848/2093 symbols completed. GXO took 1.2s. Estimated remaining: 8m 4s. Rate: 154.2 symbols/min [2025-09-19T22:20:56.151344] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:56.155243] [DEBUG] [LOCAL ] HAE: Loaded 40186 existing records from primary storage. [2025-09-19T22:20:56.155527] [INFO ] [MAIN ] HAE: Loaded 40186 primary data records. [2025-09-19T22:20:56.348909] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:56.380115] [INFO ] [MAIN ] H: Generated 1820 derivative records from 45614 primary records. [2025-09-19T22:20:56.497543] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-19T22:20:56.549734] [DEBUG] [LOCAL ] H: Derivative data saved (1820 records). [2025-09-19T22:20:56.549874] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-19T22:20:56.552482] [INFO ] [MAIN ] Derivative Progress: 849/2093 symbols completed. H took 1.2s. Estimated remaining: 8m 4s. Rate: 154.2 symbols/min [2025-09-19T22:20:56.554005] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:56.556198] [DEBUG] [LOCAL ] HAFN: Loaded 44465 existing records from primary storage. [2025-09-19T22:20:56.556772] [INFO ] [MAIN ] HAFN: Loaded 44465 primary data records. [2025-09-19T22:20:56.879438] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:56.890147] [INFO ] [MAIN ] HAE: Generated 1820 derivative records from 40186 primary records. [2025-09-19T22:20:56.890543] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-19T22:20:56.939890] [DEBUG] [LOCAL ] HAE: Derivative data saved (1820 records). [2025-09-19T22:20:56.942756] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-19T22:20:56.945116] [INFO ] [MAIN ] Derivative Progress: 850/2093 symbols completed. HAE took 1.1s. Estimated remaining: 8m 4s. Rate: 154.2 symbols/min [2025-09-19T22:20:56.945611] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:56.947340] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-09-19T22:20:56.947994] [INFO ] [MAIN ] HAL: Loaded 54498 primary data records. [2025-09-19T22:20:57.288116] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:57.289078] [INFO ] [MAIN ] HAFN: Generated 1820 derivative records from 44465 primary records. [2025-09-19T22:20:57.290111] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-19T22:20:57.319856] [DEBUG] [LOCAL ] HASI: Loaded 47924 existing records from primary storage. [2025-09-19T22:20:57.321439] [INFO ] [MAIN ] HASI: Loaded 47924 primary data records. [2025-09-19T22:20:57.381863] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1820 records). [2025-09-19T22:20:57.391626] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-19T22:20:57.394530] [INFO ] [MAIN ] Derivative Progress: 851/2093 symbols completed. HAFN took 1.3s. Estimated remaining: 8m 3s. Rate: 154.2 symbols/min [2025-09-19T22:20:57.424349] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:57.732098] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:57.733024] [INFO ] [MAIN ] HAL: Generated 1820 derivative records from 54498 primary records. [2025-09-19T22:20:57.744667] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-19T22:20:57.763569] [DEBUG] [LOCAL ] HAL: Derivative data saved (1820 records). [2025-09-19T22:20:57.764185] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-19T22:20:57.766447] [INFO ] [MAIN ] Derivative Progress: 852/2093 symbols completed. HAL took 1.2s. Estimated remaining: 8m 3s. Rate: 154.2 symbols/min [2025-09-19T22:20:57.767609] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:57.784159] [DEBUG] [LOCAL ] HAYW: Loaded 49501 existing records from primary storage. [2025-09-19T22:20:57.785670] [INFO ] [MAIN ] HAYW: Loaded 49501 primary data records. [2025-09-19T22:20:57.862666] [DEBUG] [LOCAL ] HBB: Loaded 7028 existing records from primary storage. [2025-09-19T22:20:57.892503] [INFO ] [MAIN ] HBB: Loaded 7028 primary data records. [2025-09-19T22:20:58.161020] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:58.233207] [INFO ] [MAIN ] HASI: Generated 1820 derivative records from 47924 primary records. [2025-09-19T22:20:58.255603] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-19T22:20:58.457536] [DEBUG] [LOCAL ] HASI: Derivative data saved (1820 records). [2025-09-19T22:20:58.458413] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-19T22:20:58.460630] [INFO ] [MAIN ] Derivative Progress: 853/2093 symbols completed. HASI took 1.5s. Estimated remaining: 8m 3s. Rate: 154.1 symbols/min [2025-09-19T22:20:58.483821] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:58.485293] [INFO ] [MAIN ] HAYW: Generated 1820 derivative records from 49501 primary records. [2025-09-19T22:20:58.486033] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-19T22:20:58.510558] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:58.511416] [INFO ] [MAIN ] HBB: Generated 1820 derivative records from 7028 primary records. [2025-09-19T22:20:58.511691] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-19T22:20:58.534158] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1820 records). [2025-09-19T22:20:58.534269] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-19T22:20:58.538903] [INFO ] [MAIN ] Derivative Progress: 854/2093 symbols completed. HAYW took 1.1s. Estimated remaining: 8m 2s. Rate: 154.2 symbols/min [2025-09-19T22:20:58.533795] [DEBUG] [LOCAL ] HBB: Derivative data saved (1820 records). [2025-09-19T22:20:58.539124] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-19T22:20:58.544765] [INFO ] [MAIN ] Derivative Progress: 855/2093 symbols completed. HBB took 0.8s. Estimated remaining: 8m 1s. Rate: 154.4 symbols/min [2025-09-19T22:20:58.545286] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:58.545561] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:58.545450] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:58.625511] [DEBUG] [LOCAL ] HBI: Loaded 53802 existing records from primary storage. [2025-09-19T22:20:58.625841] [INFO ] [MAIN ] HBI: Loaded 53802 primary data records. [2025-09-19T22:20:58.765915] [DEBUG] [LOCAL ] HCA: Loaded 48109 existing records from primary storage. [2025-09-19T22:20:58.761247] [DEBUG] [LOCAL ] HBM: Loaded 53681 existing records from primary storage. [2025-09-19T22:20:58.766137] [INFO ] [MAIN ] HBM: Loaded 53681 primary data records. [2025-09-19T22:20:58.766232] [INFO ] [MAIN ] HCA: Loaded 48109 primary data records. [2025-09-19T22:20:59.595078] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:59.596307] [INFO ] [MAIN ] HBI: Generated 1820 derivative records from 53802 primary records. [2025-09-19T22:20:59.596488] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-19T22:20:59.615066] [DEBUG] [LOCAL ] HBI: Derivative data saved (1820 records). [2025-09-19T22:20:59.615295] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-19T22:20:59.620462] [INFO ] [MAIN ] Derivative Progress: 856/2093 symbols completed. HBI took 1.1s. Estimated remaining: 8m 2s. Rate: 154.1 symbols/min [2025-09-19T22:20:59.620989] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:59.641687] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:59.647236] [INFO ] [MAIN ] HCA: Generated 1820 derivative records from 48109 primary records. [2025-09-19T22:20:59.647819] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-19T22:20:59.647759] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:20:59.648455] [INFO ] [MAIN ] HBM: Generated 1820 derivative records from 53681 primary records. [2025-09-19T22:20:59.648571] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-19T22:20:59.676793] [DEBUG] [LOCAL ] HCA: Derivative data saved (1820 records). [2025-09-19T22:20:59.679946] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-19T22:20:59.683529] [INFO ] [MAIN ] Derivative Progress: 857/2093 symbols completed. HCA took 1.1s. Estimated remaining: 8m 1s. Rate: 154.2 symbols/min [2025-09-19T22:20:59.684198] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:59.684413] [DEBUG] [LOCAL ] HBM: Derivative data saved (1820 records). [2025-09-19T22:20:59.684676] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-19T22:20:59.688033] [INFO ] [MAIN ] Derivative Progress: 858/2093 symbols completed. HBM took 1.1s. Estimated remaining: 7m 60s. Rate: 154.4 symbols/min [2025-09-19T22:20:59.688460] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:20:59.715131] [DEBUG] [LOCAL ] HCI: Loaded 14144 existing records from primary storage. [2025-09-19T22:20:59.715282] [INFO ] [MAIN ] HCI: Loaded 14144 primary data records. [2025-09-19T22:20:59.832128] [DEBUG] [LOCAL ] HCC: Loaded 46078 existing records from primary storage. [2025-09-19T22:20:59.836055] [INFO ] [MAIN ] HCC: Loaded 46078 primary data records. [2025-09-19T22:21:00.286934] [DEBUG] [LOCAL ] HD: Loaded 54298 existing records from primary storage. [2025-09-19T22:21:00.406889] [INFO ] [MAIN ] HD: Loaded 54298 primary data records. [2025-09-19T22:21:00.743078] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:00.745060] [INFO ] [MAIN ] HCI: Generated 1820 derivative records from 14144 primary records. [2025-09-19T22:21:00.746857] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-19T22:21:00.778388] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:00.780025] [DEBUG] [LOCAL ] HCI: Derivative data saved (1820 records). [2025-09-19T22:21:00.780801] [INFO ] [MAIN ] HCC: Generated 1820 derivative records from 46078 primary records. [2025-09-19T22:21:00.781037] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-19T22:21:00.781260] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-19T22:21:00.783411] [INFO ] [MAIN ] Derivative Progress: 859/2093 symbols completed. HCI took 1.1s. Estimated remaining: 8m 1s. Rate: 154.1 symbols/min [2025-09-19T22:21:00.785411] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:00.801875] [DEBUG] [LOCAL ] HCC: Derivative data saved (1820 records). [2025-09-19T22:21:00.802120] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-19T22:21:00.804292] [INFO ] [MAIN ] Derivative Progress: 860/2093 symbols completed. HCC took 1.2s. Estimated remaining: 7m 60s. Rate: 154.2 symbols/min [2025-09-19T22:21:00.813165] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:00.828613] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:00.829601] [INFO ] [MAIN ] HD: Generated 1820 derivative records from 54298 primary records. [2025-09-19T22:21:00.829751] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-19T22:21:00.852129] [DEBUG] [LOCAL ] HD: Derivative data saved (1820 records). [2025-09-19T22:21:00.852299] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-19T22:21:00.855105] [INFO ] [MAIN ] Derivative Progress: 861/2093 symbols completed. HD took 1.2s. Estimated remaining: 7m 59s. Rate: 154.4 symbols/min [2025-09-19T22:21:00.855554] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:00.937779] [DEBUG] [LOCAL ] HE: Loaded 50053 existing records from primary storage. [2025-09-19T22:21:00.938018] [INFO ] [MAIN ] HE: Loaded 50053 primary data records. [2025-09-19T22:21:00.960246] [DEBUG] [LOCAL ] HDB: Loaded 52707 existing records from primary storage. [2025-09-19T22:21:00.976587] [INFO ] [MAIN ] HDB: Loaded 52707 primary data records. [2025-09-19T22:21:01.098214] [DEBUG] [LOCAL ] HEI: Loaded 33376 existing records from primary storage. [2025-09-19T22:21:01.125852] [INFO ] [MAIN ] HEI: Loaded 33376 primary data records. [2025-09-19T22:21:01.977883] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:01.997979] [INFO ] [MAIN ] HDB: Generated 1820 derivative records from 52707 primary records. [2025-09-19T22:21:01.998347] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:01.998975] [INFO ] [MAIN ] HE: Generated 1820 derivative records from 50053 primary records. [2025-09-19T22:21:02.003570] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-19T22:21:02.003677] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-19T22:21:02.005159] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:02.013508] [INFO ] [MAIN ] HEI: Generated 1820 derivative records from 33376 primary records. [2025-09-19T22:21:02.014840] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-19T22:21:02.047198] [DEBUG] [LOCAL ] HEI: Derivative data saved (1820 records). [2025-09-19T22:21:02.047528] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-19T22:21:02.050560] [INFO ] [MAIN ] Derivative Progress: 862/2093 symbols completed. HEI took 1.2s. Estimated remaining: 7m 60s. Rate: 154.0 symbols/min [2025-09-19T22:21:02.051287] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:02.055389] [DEBUG] [LOCAL ] HDB: Derivative data saved (1820 records). [2025-09-19T22:21:02.055681] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-19T22:21:02.056986] [DEBUG] [LOCAL ] HE: Derivative data saved (1820 records). [2025-09-19T22:21:02.059551] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-19T22:21:02.059392] [INFO ] [MAIN ] Derivative Progress: 863/2093 symbols completed. HDB took 1.3s. Estimated remaining: 7m 59s. Rate: 154.2 symbols/min [2025-09-19T22:21:02.063813] [INFO ] [MAIN ] Derivative Progress: 864/2093 symbols completed. HE took 1.3s. Estimated remaining: 7m 58s. Rate: 154.4 symbols/min [2025-09-19T22:21:02.063756] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:02.064053] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:02.077272] [DEBUG] [LOCAL ] HEQ: Loaded 6366 existing records from primary storage. [2025-09-19T22:21:02.077445] [INFO ] [MAIN ] HEQ: Loaded 6366 primary data records. [2025-09-19T22:21:02.201095] [DEBUG] [LOCAL ] HFRO: Loaded 17764 existing records from primary storage. [2025-09-19T22:21:02.201747] [INFO ] [MAIN ] HFRO: Loaded 17764 primary data records. [2025-09-19T22:21:02.554205] [DEBUG] [LOCAL ] HESM: Loaded 48865 existing records from primary storage. [2025-09-19T22:21:02.578136] [INFO ] [MAIN ] HESM: Loaded 48865 primary data records. [2025-09-19T22:21:03.059494] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:03.060811] [INFO ] [MAIN ] HEQ: Generated 1820 derivative records from 6366 primary records. [2025-09-19T22:21:03.061059] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-19T22:21:03.077828] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1820 records). [2025-09-19T22:21:03.079192] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-19T22:21:03.081328] [INFO ] [MAIN ] Derivative Progress: 865/2093 symbols completed. HEQ took 1.0s. Estimated remaining: 7m 58s. Rate: 154.1 symbols/min [2025-09-19T22:21:03.082104] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:03.100289] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:03.101092] [INFO ] [MAIN ] HFRO: Generated 1820 derivative records from 17764 primary records. [2025-09-19T22:21:03.101284] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-19T22:21:03.125392] [DEBUG] [LOCAL ] HGER: Loaded 12933 existing records from primary storage. [2025-09-19T22:21:03.139628] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:03.140681] [INFO ] [MAIN ] HESM: Generated 1820 derivative records from 48865 primary records. [2025-09-19T22:21:03.141024] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-19T22:21:03.139320] [INFO ] [MAIN ] HGER: Loaded 12933 primary data records. [2025-09-19T22:21:03.222626] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1820 records). [2025-09-19T22:21:03.237404] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-19T22:21:03.239639] [INFO ] [MAIN ] Derivative Progress: 866/2093 symbols completed. HFRO took 1.2s. Estimated remaining: 7m 57s. Rate: 154.2 symbols/min [2025-09-19T22:21:03.240234] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:03.323092] [DEBUG] [LOCAL ] HGLB: Loaded 9853 existing records from primary storage. [2025-09-19T22:21:03.332193] [DEBUG] [LOCAL ] HESM: Derivative data saved (1820 records). [2025-09-19T22:21:03.365425] [INFO ] [MAIN ] HGLB: Loaded 9853 primary data records. [2025-09-19T22:21:03.365313] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-19T22:21:03.368269] [INFO ] [MAIN ] Derivative Progress: 867/2093 symbols completed. HESM took 1.3s. Estimated remaining: 7m 57s. Rate: 154.3 symbols/min [2025-09-19T22:21:03.490332] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:03.681690] [DEBUG] [LOCAL ] HGTY: Loaded 13154 existing records from primary storage. [2025-09-19T22:21:03.839272] [INFO ] [MAIN ] HGTY: Loaded 13154 primary data records. [2025-09-19T22:21:04.171560] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:04.172461] [INFO ] [MAIN ] HGER: Generated 1820 derivative records from 12933 primary records. [2025-09-19T22:21:04.172638] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-19T22:21:04.191388] [DEBUG] [LOCAL ] HGER: Derivative data saved (1820 records). [2025-09-19T22:21:04.191508] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-19T22:21:04.193470] [INFO ] [MAIN ] Derivative Progress: 868/2093 symbols completed. HGER took 1.1s. Estimated remaining: 7m 57s. Rate: 154.1 symbols/min [2025-09-19T22:21:04.210286] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:04.210973] [INFO ] [MAIN ] HGLB: Generated 1820 derivative records from 9853 primary records. [2025-09-19T22:21:04.211134] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-19T22:21:04.229414] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1820 records). [2025-09-19T22:21:04.241391] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-19T22:21:04.243858] [INFO ] [MAIN ] Derivative Progress: 869/2093 symbols completed. HGLB took 1.0s. Estimated remaining: 7m 56s. Rate: 154.3 symbols/min [2025-09-19T22:21:04.244287] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:04.244942] [INFO ] [MAIN ] HGTY: Generated 1820 derivative records from 13154 primary records. [2025-09-19T22:21:04.245002] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-19T22:21:04.259871] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1820 records). [2025-09-19T22:21:04.259929] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-19T22:21:04.262420] [INFO ] [MAIN ] Derivative Progress: 870/2093 symbols completed. HGTY took 0.8s. Estimated remaining: 7m 55s. Rate: 154.4 symbols/min [2025-09-19T22:21:04.263115] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:04.263275] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:04.263484] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:04.326146] [DEBUG] [LOCAL ] HHH: Loaded 33300 existing records from primary storage. [2025-09-19T22:21:04.326339] [INFO ] [MAIN ] HHH: Loaded 33300 primary data records. [2025-09-19T22:21:04.326995] [DEBUG] [LOCAL ] HI: Loaded 35665 existing records from primary storage. [2025-09-19T22:21:04.340194] [INFO ] [MAIN ] HI: Loaded 35665 primary data records. [2025-09-19T22:21:04.446168] [DEBUG] [LOCAL ] HGV: Loaded 47765 existing records from primary storage. [2025-09-19T22:21:04.475261] [INFO ] [MAIN ] HGV: Loaded 47765 primary data records. [2025-09-19T22:21:05.310612] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:05.311750] [INFO ] [MAIN ] HHH: Generated 1820 derivative records from 33300 primary records. [2025-09-19T22:21:05.312019] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-19T22:21:05.336793] [DEBUG] [LOCAL ] HHH: Derivative data saved (1820 records). [2025-09-19T22:21:05.337885] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-19T22:21:05.340195] [INFO ] [MAIN ] Derivative Progress: 871/2093 symbols completed. HHH took 1.1s. Estimated remaining: 7m 56s. Rate: 154.1 symbols/min [2025-09-19T22:21:05.340852] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:05.366328] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:05.367423] [INFO ] [MAIN ] HGV: Generated 1820 derivative records from 47765 primary records. [2025-09-19T22:21:05.367799] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-19T22:21:05.367715] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:05.368830] [INFO ] [MAIN ] HI: Generated 1820 derivative records from 35665 primary records. [2025-09-19T22:21:05.369212] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-19T22:21:05.401034] [DEBUG] [LOCAL ] HGV: Derivative data saved (1820 records). [2025-09-19T22:21:05.401274] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-19T22:21:05.404237] [INFO ] [MAIN ] Derivative Progress: 872/2093 symbols completed. HGV took 1.1s. Estimated remaining: 7m 55s. Rate: 154.3 symbols/min [2025-09-19T22:21:05.401197] [DEBUG] [LOCAL ] HI: Derivative data saved (1820 records). [2025-09-19T22:21:05.404797] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:05.404866] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-19T22:21:05.407357] [INFO ] [MAIN ] Derivative Progress: 873/2093 symbols completed. HI took 1.1s. Estimated remaining: 7m 54s. Rate: 154.4 symbols/min [2025-09-19T22:21:05.408043] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:05.512026] [DEBUG] [LOCAL ] HII: Loaded 36225 existing records from primary storage. [2025-09-19T22:21:05.512981] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-09-19T22:21:05.513090] [INFO ] [MAIN ] HIMS: Loaded 54597 primary data records. [2025-09-19T22:21:05.512319] [INFO ] [MAIN ] HII: Loaded 36225 primary data records. [2025-09-19T22:21:05.513973] [DEBUG] [LOCAL ] HIG: Loaded 52033 existing records from primary storage. [2025-09-19T22:21:05.526149] [INFO ] [MAIN ] HIG: Loaded 52033 primary data records. [2025-09-19T22:21:06.535804] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:06.538697] [INFO ] [MAIN ] HIG: Generated 1820 derivative records from 52033 primary records. [2025-09-19T22:21:06.551456] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-19T22:21:06.551886] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:06.566585] [INFO ] [MAIN ] HII: Generated 1820 derivative records from 36225 primary records. [2025-09-19T22:21:06.567103] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-19T22:21:06.566971] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:06.568558] [INFO ] [MAIN ] HIMS: Generated 1820 derivative records from 54597 primary records. [2025-09-19T22:21:06.569127] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-19T22:21:06.606601] [DEBUG] [LOCAL ] HIG: Derivative data saved (1820 records). [2025-09-19T22:21:06.613283] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-19T22:21:06.617263] [INFO ] [MAIN ] Derivative Progress: 874/2093 symbols completed. HIG took 1.3s. Estimated remaining: 7m 55s. Rate: 154.1 symbols/min [2025-09-19T22:21:06.619968] [DEBUG] [LOCAL ] HII: Derivative data saved (1820 records). [2025-09-19T22:21:06.620276] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:06.620395] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1820 records). [2025-09-19T22:21:06.620760] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-19T22:21:06.620705] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-19T22:21:06.625980] [INFO ] [MAIN ] Derivative Progress: 875/2093 symbols completed. HII took 1.2s. Estimated remaining: 7m 54s. Rate: 154.2 symbols/min [2025-09-19T22:21:06.628903] [INFO ] [MAIN ] Derivative Progress: 876/2093 symbols completed. HIMS took 1.2s. Estimated remaining: 7m 53s. Rate: 154.4 symbols/min [2025-09-19T22:21:06.629206] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:06.629366] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:06.653690] [DEBUG] [LOCAL ] HIO: Loaded 24386 existing records from primary storage. [2025-09-19T22:21:06.653828] [INFO ] [MAIN ] HIO: Loaded 24386 primary data records. [2025-09-19T22:21:06.777002] [DEBUG] [LOCAL ] HIPO: Loaded 23241 existing records from primary storage. [2025-09-19T22:21:06.789235] [INFO ] [MAIN ] HIPO: Loaded 23241 primary data records. [2025-09-19T22:21:06.968628] [DEBUG] [LOCAL ] HIW: Loaded 45529 existing records from primary storage. [2025-09-19T22:21:07.000259] [INFO ] [MAIN ] HIW: Loaded 45529 primary data records. [2025-09-19T22:21:07.666744] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:07.669227] [INFO ] [MAIN ] HIO: Generated 1820 derivative records from 24386 primary records. [2025-09-19T22:21:07.669416] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-19T22:21:07.697288] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:07.698954] [INFO ] [MAIN ] HIPO: Generated 1820 derivative records from 23241 primary records. [2025-09-19T22:21:07.699148] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-19T22:21:07.717446] [DEBUG] [LOCAL ] HIO: Derivative data saved (1820 records). [2025-09-19T22:21:07.717635] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-19T22:21:07.719738] [INFO ] [MAIN ] Derivative Progress: 877/2093 symbols completed. HIO took 1.1s. Estimated remaining: 7m 53s. Rate: 154.1 symbols/min [2025-09-19T22:21:07.716970] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1820 records). [2025-09-19T22:21:07.720312] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-19T22:21:07.720241] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:07.722746] [INFO ] [MAIN ] Derivative Progress: 878/2093 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 53s. Rate: 154.3 symbols/min [2025-09-19T22:21:07.723439] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:07.741603] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:07.742352] [INFO ] [MAIN ] HIW: Generated 1820 derivative records from 45529 primary records. [2025-09-19T22:21:07.742508] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-19T22:21:07.763432] [DEBUG] [LOCAL ] HIW: Derivative data saved (1820 records). [2025-09-19T22:21:07.767558] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-19T22:21:07.770198] [INFO ] [MAIN ] Derivative Progress: 879/2093 symbols completed. HIW took 1.1s. Estimated remaining: 7m 52s. Rate: 154.4 symbols/min [2025-09-19T22:21:07.770573] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:07.786121] [DEBUG] [LOCAL ] HKD: Loaded 18304 existing records from primary storage. [2025-09-19T22:21:07.786724] [DEBUG] [LOCAL ] HIX: Loaded 20504 existing records from primary storage. [2025-09-19T22:21:07.786842] [INFO ] [MAIN ] HKD: Loaded 18304 primary data records. [2025-09-19T22:21:07.786960] [INFO ] [MAIN ] HIX: Loaded 20504 primary data records. [2025-09-19T22:21:08.473165] [DEBUG] [LOCAL ] HL: Loaded 54450 existing records from primary storage. [2025-09-19T22:21:08.474205] [INFO ] [MAIN ] HL: Loaded 54450 primary data records. [2025-09-19T22:21:08.799687] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:08.802424] [INFO ] [MAIN ] HKD: Generated 1820 derivative records from 18304 primary records. [2025-09-19T22:21:08.810762] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-19T22:21:08.816334] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:08.817263] [INFO ] [MAIN ] HIX: Generated 1820 derivative records from 20504 primary records. [2025-09-19T22:21:08.825338] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-19T22:21:08.845697] [DEBUG] [LOCAL ] HKD: Derivative data saved (1820 records). [2025-09-19T22:21:08.846017] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-19T22:21:08.848695] [INFO ] [MAIN ] Derivative Progress: 880/2093 symbols completed. HKD took 1.1s. Estimated remaining: 7m 52s. Rate: 154.1 symbols/min [2025-09-19T22:21:08.850522] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:08.852746] [DEBUG] [LOCAL ] HIX: Derivative data saved (1820 records). [2025-09-19T22:21:08.852881] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-19T22:21:08.855554] [INFO ] [MAIN ] Derivative Progress: 881/2093 symbols completed. HIX took 1.1s. Estimated remaining: 7m 51s. Rate: 154.3 symbols/min [2025-09-19T22:21:08.856052] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:08.873837] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:08.874569] [INFO ] [MAIN ] HL: Generated 1820 derivative records from 54450 primary records. [2025-09-19T22:21:08.874727] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-19T22:21:08.890287] [DEBUG] [LOCAL ] HL: Derivative data saved (1820 records). [2025-09-19T22:21:08.890473] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-19T22:21:08.895729] [INFO ] [MAIN ] Derivative Progress: 882/2093 symbols completed. HL took 1.1s. Estimated remaining: 7m 50s. Rate: 154.4 symbols/min [2025-09-19T22:21:08.899685] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:08.934600] [DEBUG] [LOCAL ] HLI: Loaded 31874 existing records from primary storage. [2025-09-19T22:21:08.934880] [INFO ] [MAIN ] HLI: Loaded 31874 primary data records. [2025-09-19T22:21:09.067719] [DEBUG] [LOCAL ] HLIO: Loaded 28501 existing records from primary storage. [2025-09-19T22:21:09.068682] [DEBUG] [LOCAL ] HLF: Loaded 49588 existing records from primary storage. [2025-09-19T22:21:09.068883] [INFO ] [MAIN ] HLIO: Loaded 28501 primary data records. [2025-09-19T22:21:09.068817] [INFO ] [MAIN ] HLF: Loaded 49588 primary data records. [2025-09-19T22:21:09.959342] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:09.961712] [INFO ] [MAIN ] HLI: Generated 1820 derivative records from 31874 primary records. [2025-09-19T22:21:09.962433] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-19T22:21:09.999294] [DEBUG] [LOCAL ] HLI: Derivative data saved (1820 records). [2025-09-19T22:21:09.990309] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:09.999489] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-19T22:21:10.000416] [INFO ] [MAIN ] HLF: Generated 1820 derivative records from 49588 primary records. [2025-09-19T22:21:10.005860] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:10.006743] [INFO ] [MAIN ] HLIO: Generated 1820 derivative records from 28501 primary records. [2025-09-19T22:21:10.005993] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-19T22:21:10.007409] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-19T22:21:10.009604] [INFO ] [MAIN ] Derivative Progress: 883/2093 symbols completed. HLI took 1.2s. Estimated remaining: 7m 51s. Rate: 154.1 symbols/min [2025-09-19T22:21:10.038866] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1820 records). [2025-09-19T22:21:10.040069] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-19T22:21:10.040138] [DEBUG] [LOCAL ] HLF: Derivative data saved (1820 records). [2025-09-19T22:21:10.042671] [INFO ] [MAIN ] Derivative Progress: 884/2093 symbols completed. HLIO took 1.1s. Estimated remaining: 7m 50s. Rate: 154.3 symbols/min [2025-09-19T22:21:10.042878] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-19T22:21:10.045315] [INFO ] [MAIN ] Derivative Progress: 885/2093 symbols completed. HLF took 1.2s. Estimated remaining: 7m 49s. Rate: 154.5 symbols/min [2025-09-19T22:21:10.045859] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:10.045982] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:10.046096] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:10.084590] [DEBUG] [LOCAL ] HLLY: Loaded 33735 existing records from primary storage. [2025-09-19T22:21:10.084849] [INFO ] [MAIN ] HLLY: Loaded 33735 primary data records. [2025-09-19T22:21:10.287964] [DEBUG] [LOCAL ] HLT: Loaded 51521 existing records from primary storage. [2025-09-19T22:21:10.329761] [INFO ] [MAIN ] HLT: Loaded 51521 primary data records. [2025-09-19T22:21:10.330680] [DEBUG] [LOCAL ] HLN: Loaded 53862 existing records from primary storage. [2025-09-19T22:21:10.330915] [INFO ] [MAIN ] HLN: Loaded 53862 primary data records. [2025-09-19T22:21:11.103754] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:11.106284] [INFO ] [MAIN ] HLLY: Generated 1820 derivative records from 33735 primary records. [2025-09-19T22:21:11.106636] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-19T22:21:11.125431] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1820 records). [2025-09-19T22:21:11.125587] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-19T22:21:11.127815] [INFO ] [MAIN ] Derivative Progress: 886/2093 symbols completed. HLLY took 1.1s. Estimated remaining: 7m 50s. Rate: 154.1 symbols/min [2025-09-19T22:21:11.128977] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:11.150117] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:11.151259] [INFO ] [MAIN ] HLT: Generated 1820 derivative records from 51521 primary records. [2025-09-19T22:21:11.151488] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-19T22:21:11.181472] [DEBUG] [LOCAL ] HLT: Derivative data saved (1820 records). [2025-09-19T22:21:11.181965] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-19T22:21:11.181881] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:11.184288] [INFO ] [MAIN ] Derivative Progress: 887/2093 symbols completed. HLT took 1.1s. Estimated remaining: 7m 49s. Rate: 154.3 symbols/min [2025-09-19T22:21:11.185793] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:11.185616] [INFO ] [MAIN ] HLN: Generated 1820 derivative records from 53862 primary records. [2025-09-19T22:21:11.186378] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-19T22:21:11.207385] [DEBUG] [LOCAL ] HLN: Derivative data saved (1820 records). [2025-09-19T22:21:11.207568] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-19T22:21:11.210191] [INFO ] [MAIN ] Derivative Progress: 888/2093 symbols completed. HLN took 1.2s. Estimated remaining: 7m 48s. Rate: 154.5 symbols/min [2025-09-19T22:21:11.210672] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:11.263008] [DEBUG] [LOCAL ] HLX: Loaded 48858 existing records from primary storage. [2025-09-19T22:21:11.263343] [INFO ] [MAIN ] HLX: Loaded 48858 primary data records. [2025-09-19T22:21:11.383775] [DEBUG] [LOCAL ] HMC: Loaded 47743 existing records from primary storage. [2025-09-19T22:21:11.383068] [DEBUG] [LOCAL ] HMN: Loaded 23567 existing records from primary storage. [2025-09-19T22:21:11.396043] [INFO ] [MAIN ] HMC: Loaded 47743 primary data records. [2025-09-19T22:21:11.408124] [INFO ] [MAIN ] HMN: Loaded 23567 primary data records. [2025-09-19T22:21:12.294438] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:12.295992] [INFO ] [MAIN ] HLX: Generated 1820 derivative records from 48858 primary records. [2025-09-19T22:21:12.296229] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-19T22:21:12.326616] [DEBUG] [LOCAL ] HLX: Derivative data saved (1820 records). [2025-09-19T22:21:12.343988] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-19T22:21:12.345018] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:12.344481] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:12.348411] [INFO ] [MAIN ] Derivative Progress: 889/2093 symbols completed. HLX took 1.2s. Estimated remaining: 7m 49s. Rate: 154.1 symbols/min [2025-09-19T22:21:12.345875] [INFO ] [MAIN ] HMC: Generated 1820 derivative records from 47743 primary records. [2025-09-19T22:21:12.348578] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-19T22:21:12.346490] [INFO ] [MAIN ] HMN: Generated 1820 derivative records from 23567 primary records. [2025-09-19T22:21:12.349883] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:12.348760] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-19T22:21:12.375287] [DEBUG] [LOCAL ] HMC: Derivative data saved (1820 records). [2025-09-19T22:21:12.377883] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-19T22:21:12.381119] [INFO ] [MAIN ] Derivative Progress: 890/2093 symbols completed. HMC took 1.2s. Estimated remaining: 7m 48s. Rate: 154.3 symbols/min [2025-09-19T22:21:12.381730] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:12.387532] [DEBUG] [LOCAL ] HMN: Derivative data saved (1820 records). [2025-09-19T22:21:12.387770] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-19T22:21:12.390608] [INFO ] [MAIN ] Derivative Progress: 891/2093 symbols completed. HMN took 1.2s. Estimated remaining: 7m 47s. Rate: 154.4 symbols/min [2025-09-19T22:21:12.390923] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:12.432962] [DEBUG] [LOCAL ] HNI: Loaded 29351 existing records from primary storage. [2025-09-19T22:21:12.433188] [INFO ] [MAIN ] HNI: Loaded 29351 primary data records. [2025-09-19T22:21:12.621580] [DEBUG] [LOCAL ] HMY: Loaded 53905 existing records from primary storage. [2025-09-19T22:21:12.644036] [DEBUG] [LOCAL ] HOG: Loaded 52045 existing records from primary storage. [2025-09-19T22:21:12.644141] [INFO ] [MAIN ] HMY: Loaded 53905 primary data records. [2025-09-19T22:21:12.673352] [INFO ] [MAIN ] HOG: Loaded 52045 primary data records. [2025-09-19T22:21:13.499213] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:13.500463] [INFO ] [MAIN ] HNI: Generated 1820 derivative records from 29351 primary records. [2025-09-19T22:21:13.500809] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-19T22:21:13.519310] [DEBUG] [LOCAL ] HNI: Derivative data saved (1820 records). [2025-09-19T22:21:13.520546] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-19T22:21:13.523607] [INFO ] [MAIN ] Derivative Progress: 892/2093 symbols completed. HNI took 1.1s. Estimated remaining: 7m 48s. Rate: 154.1 symbols/min [2025-09-19T22:21:13.525124] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:13.548737] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:13.554585] [INFO ] [MAIN ] HMY: Generated 1820 derivative records from 53905 primary records. [2025-09-19T22:21:13.555008] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:13.555144] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-19T22:21:13.555829] [INFO ] [MAIN ] HOG: Generated 1820 derivative records from 52045 primary records. [2025-09-19T22:21:13.571760] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-19T22:21:13.573095] [DEBUG] [LOCAL ] HMY: Derivative data saved (1820 records). [2025-09-19T22:21:13.573880] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-19T22:21:13.576701] [INFO ] [MAIN ] Derivative Progress: 893/2093 symbols completed. HMY took 1.2s. Estimated remaining: 7m 47s. Rate: 154.3 symbols/min [2025-09-19T22:21:13.577334] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:13.596303] [DEBUG] [LOCAL ] HOG: Derivative data saved (1820 records). [2025-09-19T22:21:13.596544] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-19T22:21:13.601224] [INFO ] [MAIN ] Derivative Progress: 894/2093 symbols completed. HOG took 1.2s. Estimated remaining: 7m 46s. Rate: 154.4 symbols/min [2025-09-19T22:21:13.601772] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:13.649086] [DEBUG] [LOCAL ] HOUS: Loaded 44658 existing records from primary storage. [2025-09-19T22:21:13.649342] [INFO ] [MAIN ] HOUS: Loaded 44658 primary data records. [2025-09-19T22:21:13.686569] [DEBUG] [LOCAL ] HOV: Loaded 13971 existing records from primary storage. [2025-09-19T22:21:13.736750] [INFO ] [MAIN ] HOV: Loaded 13971 primary data records. [2025-09-19T22:21:13.769348] [DEBUG] [LOCAL ] HOMB: Loaded 44380 existing records from primary storage. [2025-09-19T22:21:13.773416] [INFO ] [MAIN ] HOMB: Loaded 44380 primary data records. [2025-09-19T22:21:14.687754] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:14.688791] [INFO ] [MAIN ] HOUS: Generated 1820 derivative records from 44658 primary records. [2025-09-19T22:21:14.689214] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-19T22:21:14.723474] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:14.724937] [INFO ] [MAIN ] HOMB: Generated 1820 derivative records from 44380 primary records. [2025-09-19T22:21:14.725129] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-19T22:21:14.721080] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1820 records). [2025-09-19T22:21:14.742384] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-19T22:21:14.749322] [INFO ] [MAIN ] Derivative Progress: 895/2093 symbols completed. HOUS took 1.2s. Estimated remaining: 7m 46s. Rate: 154.1 symbols/min [2025-09-19T22:21:14.749989] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:14.753543] [INFO ] [MAIN ] HOV: Generated 1820 derivative records from 13971 primary records. [2025-09-19T22:21:14.753720] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:14.753840] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-19T22:21:14.776052] [DEBUG] [LOCAL ] HOV: Derivative data saved (1820 records). [2025-09-19T22:21:14.776274] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-19T22:21:14.775627] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1820 records). [2025-09-19T22:21:14.776396] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-19T22:21:14.778834] [INFO ] [MAIN ] Derivative Progress: 896/2093 symbols completed. HOV took 1.2s. Estimated remaining: 7m 46s. Rate: 154.2 symbols/min [2025-09-19T22:21:14.782974] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:14.783172] [INFO ] [MAIN ] Derivative Progress: 897/2093 symbols completed. HOMB took 1.3s. Estimated remaining: 7m 45s. Rate: 154.4 symbols/min [2025-09-19T22:21:14.783803] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:14.796143] [DEBUG] [LOCAL ] HPF: Loaded 7364 existing records from primary storage. [2025-09-19T22:21:14.796400] [INFO ] [MAIN ] HPF: Loaded 7364 primary data records. [2025-09-19T22:21:15.156303] [DEBUG] [LOCAL ] HP: Loaded 52374 existing records from primary storage. [2025-09-19T22:21:15.172080] [INFO ] [MAIN ] HP: Loaded 52374 primary data records. [2025-09-19T22:21:15.173146] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-09-19T22:21:15.184740] [INFO ] [MAIN ] HPE: Loaded 54477 primary data records. [2025-09-19T22:21:15.815795] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:15.817032] [INFO ] [MAIN ] HPF: Generated 1820 derivative records from 7364 primary records. [2025-09-19T22:21:15.817215] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-19T22:21:15.835046] [DEBUG] [LOCAL ] HPF: Derivative data saved (1820 records). [2025-09-19T22:21:15.835669] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-19T22:21:15.838003] [INFO ] [MAIN ] Derivative Progress: 898/2093 symbols completed. HPF took 1.1s. Estimated remaining: 7m 45s. Rate: 154.1 symbols/min [2025-09-19T22:21:15.854526] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:15.856713] [INFO ] [MAIN ] HPE: Generated 1820 derivative records from 54477 primary records. [2025-09-19T22:21:15.857444] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-19T22:21:15.870663] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:15.871468] [INFO ] [MAIN ] HP: Generated 1820 derivative records from 52374 primary records. [2025-09-19T22:21:15.879076] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-19T22:21:15.901960] [DEBUG] [LOCAL ] HP: Derivative data saved (1820 records). [2025-09-19T22:21:15.902665] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-19T22:21:15.902549] [DEBUG] [LOCAL ] HPE: Derivative data saved (1820 records). [2025-09-19T22:21:15.902779] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-19T22:21:15.905103] [INFO ] [MAIN ] Derivative Progress: 899/2093 symbols completed. HP took 1.2s. Estimated remaining: 7m 44s. Rate: 154.3 symbols/min [2025-09-19T22:21:15.907367] [INFO ] [MAIN ] Derivative Progress: 900/2093 symbols completed. HPE took 1.1s. Estimated remaining: 7m 43s. Rate: 154.4 symbols/min [2025-09-19T22:21:15.908012] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:15.908277] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:15.908115] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:15.922415] [DEBUG] [LOCAL ] HPI: Loaded 10185 existing records from primary storage. [2025-09-19T22:21:15.922548] [INFO ] [MAIN ] HPI: Loaded 10185 primary data records. [2025-09-19T22:21:16.297143] [DEBUG] [LOCAL ] HPP: Loaded 51503 existing records from primary storage. [2025-09-19T22:21:16.298572] [INFO ] [MAIN ] HPP: Loaded 51503 primary data records. [2025-09-19T22:21:16.399582] [DEBUG] [LOCAL ] HPQ: Loaded 54448 existing records from primary storage. [2025-09-19T22:21:16.416828] [INFO ] [MAIN ] HPQ: Loaded 54448 primary data records. [2025-09-19T22:21:16.972809] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:16.974206] [INFO ] [MAIN ] HPI: Generated 1820 derivative records from 10185 primary records. [2025-09-19T22:21:16.974626] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-19T22:21:16.992480] [DEBUG] [LOCAL ] HPI: Derivative data saved (1820 records). [2025-09-19T22:21:16.994337] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-19T22:21:16.996887] [INFO ] [MAIN ] Derivative Progress: 901/2093 symbols completed. HPI took 1.1s. Estimated remaining: 7m 44s. Rate: 154.1 symbols/min [2025-09-19T22:21:16.997421] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:17.016492] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:17.020161] [INFO ] [MAIN ] HPP: Generated 1820 derivative records from 51503 primary records. [2025-09-19T22:21:17.020329] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-19T22:21:17.058205] [DEBUG] [LOCAL ] HPP: Derivative data saved (1820 records). [2025-09-19T22:21:17.059137] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-19T22:21:17.059055] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:17.040756] [DEBUG] [LOCAL ] HPS: Loaded 10420 existing records from primary storage. [2025-09-19T22:21:17.062222] [INFO ] [MAIN ] Derivative Progress: 902/2093 symbols completed. HPP took 1.2s. Estimated remaining: 7m 43s. Rate: 154.3 symbols/min [2025-09-19T22:21:17.060212] [INFO ] [MAIN ] HPQ: Generated 1820 derivative records from 54448 primary records. [2025-09-19T22:21:17.062438] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-19T22:21:17.062498] [INFO ] [MAIN ] HPS: Loaded 10420 primary data records. [2025-09-19T22:21:17.074623] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:17.170836] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1820 records). [2025-09-19T22:21:17.181441] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-19T22:21:17.184243] [INFO ] [MAIN ] Derivative Progress: 903/2093 symbols completed. HPQ took 1.3s. Estimated remaining: 7m 42s. Rate: 154.4 symbols/min [2025-09-19T22:21:17.202842] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:17.395544] [DEBUG] [LOCAL ] HQH: Loaded 25294 existing records from primary storage. [2025-09-19T22:21:17.396636] [INFO ] [MAIN ] HQH: Loaded 25294 primary data records. [2025-09-19T22:21:17.507821] [DEBUG] [LOCAL ] HQL: Loaded 16379 existing records from primary storage. [2025-09-19T22:21:17.532187] [INFO ] [MAIN ] HQL: Loaded 16379 primary data records. [2025-09-19T22:21:18.123484] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:18.124731] [INFO ] [MAIN ] HPS: Generated 1820 derivative records from 10420 primary records. [2025-09-19T22:21:18.125226] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-19T22:21:18.144547] [DEBUG] [LOCAL ] HPS: Derivative data saved (1820 records). [2025-09-19T22:21:18.144747] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-19T22:21:18.147077] [INFO ] [MAIN ] Derivative Progress: 904/2093 symbols completed. HPS took 1.1s. Estimated remaining: 7m 43s. Rate: 154.1 symbols/min [2025-09-19T22:21:18.149522] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:18.166622] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:18.167742] [INFO ] [MAIN ] HQH: Generated 1820 derivative records from 25294 primary records. [2025-09-19T22:21:18.167990] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-19T22:21:18.187909] [DEBUG] [LOCAL ] HQH: Derivative data saved (1820 records). [2025-09-19T22:21:18.200662] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-19T22:21:18.203749] [INFO ] [MAIN ] Derivative Progress: 905/2093 symbols completed. HQH took 1.1s. Estimated remaining: 7m 42s. Rate: 154.3 symbols/min [2025-09-19T22:21:18.200899] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:18.204139] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:18.205035] [INFO ] [MAIN ] HQL: Generated 1820 derivative records from 16379 primary records. [2025-09-19T22:21:18.205566] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-19T22:21:18.236271] [DEBUG] [LOCAL ] HQL: Derivative data saved (1820 records). [2025-09-19T22:21:18.236462] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-19T22:21:18.238928] [INFO ] [MAIN ] Derivative Progress: 906/2093 symbols completed. HQL took 1.0s. Estimated remaining: 7m 41s. Rate: 154.4 symbols/min [2025-09-19T22:21:18.239382] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:18.261055] [DEBUG] [LOCAL ] HR: Loaded 52730 existing records from primary storage. [2025-09-19T22:21:18.261387] [INFO ] [MAIN ] HR: Loaded 52730 primary data records. [2025-09-19T22:21:18.494706] [DEBUG] [LOCAL ] HRB: Loaded 49332 existing records from primary storage. [2025-09-19T22:21:18.509223] [INFO ] [MAIN ] HRB: Loaded 49332 primary data records. [2025-09-19T22:21:18.652156] [DEBUG] [LOCAL ] HRL: Loaded 53857 existing records from primary storage. [2025-09-19T22:21:18.669313] [INFO ] [MAIN ] HRL: Loaded 53857 primary data records. [2025-09-19T22:21:19.273465] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:19.275042] [INFO ] [MAIN ] HR: Generated 1820 derivative records from 52730 primary records. [2025-09-19T22:21:19.275327] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-19T22:21:19.295308] [DEBUG] [LOCAL ] HR: Derivative data saved (1820 records). [2025-09-19T22:21:19.296388] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-19T22:21:19.299256] [INFO ] [MAIN ] Derivative Progress: 907/2093 symbols completed. HR took 1.2s. Estimated remaining: 7m 42s. Rate: 154.1 symbols/min [2025-09-19T22:21:19.308692] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:19.314717] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:19.315481] [INFO ] [MAIN ] HRB: Generated 1820 derivative records from 49332 primary records. [2025-09-19T22:21:19.315688] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-19T22:21:19.332760] [DEBUG] [LOCAL ] HRB: Derivative data saved (1820 records). [2025-09-19T22:21:19.333055] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-19T22:21:19.335189] [INFO ] [MAIN ] Derivative Progress: 908/2093 symbols completed. HRB took 1.1s. Estimated remaining: 7m 41s. Rate: 154.3 symbols/min [2025-09-19T22:21:19.335538] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:19.365449] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:19.366234] [INFO ] [MAIN ] HRL: Generated 1820 derivative records from 53857 primary records. [2025-09-19T22:21:19.366383] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-19T22:21:19.394028] [DEBUG] [LOCAL ] HRL: Derivative data saved (1820 records). [2025-09-19T22:21:19.395340] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-19T22:21:19.395837] [DEBUG] [LOCAL ] HRTG: Loaded 32937 existing records from primary storage. [2025-09-19T22:21:19.399413] [INFO ] [MAIN ] Derivative Progress: 909/2093 symbols completed. HRL took 1.2s. Estimated remaining: 7m 40s. Rate: 154.4 symbols/min [2025-09-19T22:21:19.399776] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:19.399944] [INFO ] [MAIN ] HRTG: Loaded 32937 primary data records. [2025-09-19T22:21:19.586813] [DEBUG] [LOCAL ] HSHP: Loaded 16012 existing records from primary storage. [2025-09-19T22:21:19.608544] [INFO ] [MAIN ] HSHP: Loaded 16012 primary data records. [2025-09-19T22:21:19.831267] [DEBUG] [LOCAL ] HSBC: Loaded 51975 existing records from primary storage. [2025-09-19T22:21:19.837008] [INFO ] [MAIN ] HSBC: Loaded 51975 primary data records. [2025-09-19T22:21:20.434794] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:20.436724] [INFO ] [MAIN ] HRTG: Generated 1820 derivative records from 32937 primary records. [2025-09-19T22:21:20.437076] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-19T22:21:20.455775] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1820 records). [2025-09-19T22:21:20.456398] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-19T22:21:20.458727] [INFO ] [MAIN ] Derivative Progress: 910/2093 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 40s. Rate: 154.1 symbols/min [2025-09-19T22:21:20.462523] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:20.481969] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:20.483167] [INFO ] [MAIN ] HSHP: Generated 1820 derivative records from 16012 primary records. [2025-09-19T22:21:20.483476] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-19T22:21:20.501253] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1820 records). [2025-09-19T22:21:20.501564] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-19T22:21:20.503883] [INFO ] [MAIN ] Derivative Progress: 911/2093 symbols completed. HSHP took 1.1s. Estimated remaining: 7m 40s. Rate: 154.3 symbols/min [2025-09-19T22:21:20.506160] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:20.521195] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:20.522103] [INFO ] [MAIN ] HSBC: Generated 1820 derivative records from 51975 primary records. [2025-09-19T22:21:20.522258] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-19T22:21:20.544011] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1820 records). [2025-09-19T22:21:20.549512] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-19T22:21:20.552343] [INFO ] [MAIN ] Derivative Progress: 912/2093 symbols completed. HSBC took 1.2s. Estimated remaining: 7m 39s. Rate: 154.4 symbols/min [2025-09-19T22:21:20.552817] [DEBUG] [LOCAL ] HTD: Loaded 13659 existing records from primary storage. [2025-09-19T22:21:20.553269] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:20.553467] [INFO ] [MAIN ] HTD: Loaded 13659 primary data records. [2025-09-19T22:21:20.742558] [DEBUG] [LOCAL ] HSY: Loaded 51230 existing records from primary storage. [2025-09-19T22:21:20.761806] [INFO ] [MAIN ] HSY: Loaded 51230 primary data records. [2025-09-19T22:21:21.038869] [DEBUG] [LOCAL ] HTGC: Loaded 48422 existing records from primary storage. [2025-09-19T22:21:21.049916] [INFO ] [MAIN ] HTGC: Loaded 48422 primary data records. [2025-09-19T22:21:21.549214] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:21.550510] [INFO ] [MAIN ] HTD: Generated 1820 derivative records from 13659 primary records. [2025-09-19T22:21:21.550602] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-19T22:21:21.571367] [DEBUG] [LOCAL ] HTD: Derivative data saved (1820 records). [2025-09-19T22:21:21.571774] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-19T22:21:21.573807] [INFO ] [MAIN ] Derivative Progress: 913/2093 symbols completed. HTD took 1.1s. Estimated remaining: 7m 39s. Rate: 154.2 symbols/min [2025-09-19T22:21:21.586722] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:21.587697] [INFO ] [MAIN ] HSY: Generated 1820 derivative records from 51230 primary records. [2025-09-19T22:21:21.587843] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-19T22:21:21.618956] [DEBUG] [LOCAL ] HSY: Derivative data saved (1820 records). [2025-09-19T22:21:21.619210] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:21.619326] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-19T22:21:21.619960] [INFO ] [MAIN ] HTGC: Generated 1820 derivative records from 48422 primary records. [2025-09-19T22:21:21.622895] [INFO ] [MAIN ] Derivative Progress: 914/2093 symbols completed. HSY took 1.2s. Estimated remaining: 7m 38s. Rate: 154.3 symbols/min [2025-09-19T22:21:21.623011] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-19T22:21:21.638633] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1820 records). [2025-09-19T22:21:21.638717] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-19T22:21:21.641033] [INFO ] [MAIN ] Derivative Progress: 915/2093 symbols completed. HTGC took 1.1s. Estimated remaining: 7m 38s. Rate: 154.5 symbols/min [2025-09-19T22:21:21.641850] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:21.641677] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:21.642290] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:21.722225] [DEBUG] [LOCAL ] HTH: Loaded 33269 existing records from primary storage. [2025-09-19T22:21:21.724010] [DEBUG] [LOCAL ] HUBB: Loaded 38022 existing records from primary storage. [2025-09-19T22:21:21.723490] [DEBUG] [LOCAL ] HUBS: Loaded 40384 existing records from primary storage. [2025-09-19T22:21:21.722505] [INFO ] [MAIN ] HTH: Loaded 33269 primary data records. [2025-09-19T22:21:21.724357] [INFO ] [MAIN ] HUBS: Loaded 40384 primary data records. [2025-09-19T22:21:21.724290] [INFO ] [MAIN ] HUBB: Loaded 38022 primary data records. [2025-09-19T22:21:22.744764] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:22.771692] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:22.765981] [INFO ] [MAIN ] HUBS: Generated 1820 derivative records from 40384 primary records. [2025-09-19T22:21:22.772305] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:22.773184] [INFO ] [MAIN ] HTH: Generated 1820 derivative records from 33269 primary records. [2025-09-19T22:21:22.774183] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-19T22:21:22.774264] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-19T22:21:22.774011] [INFO ] [MAIN ] HUBB: Generated 1820 derivative records from 38022 primary records. [2025-09-19T22:21:22.775480] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-19T22:21:22.821246] [DEBUG] [LOCAL ] HTH: Derivative data saved (1820 records). [2025-09-19T22:21:22.822386] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-19T22:21:22.824847] [INFO ] [MAIN ] Derivative Progress: 916/2093 symbols completed. HTH took 1.2s. Estimated remaining: 7m 38s. Rate: 154.1 symbols/min [2025-09-19T22:21:22.826797] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1820 records). [2025-09-19T22:21:22.826954] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:22.827463] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-19T22:21:22.831071] [INFO ] [MAIN ] Derivative Progress: 917/2093 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 37s. Rate: 154.3 symbols/min [2025-09-19T22:21:22.832547] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:22.832259] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1820 records). [2025-09-19T22:21:22.833033] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-19T22:21:22.835785] [INFO ] [MAIN ] Derivative Progress: 918/2093 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 36s. Rate: 154.5 symbols/min [2025-09-19T22:21:22.836089] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:22.905272] [DEBUG] [LOCAL ] HUYA: Loaded 45033 existing records from primary storage. [2025-09-19T22:21:22.906013] [INFO ] [MAIN ] HUYA: Loaded 45033 primary data records. [2025-09-19T22:21:22.955094] [DEBUG] [LOCAL ] HUM: Loaded 49586 existing records from primary storage. [2025-09-19T22:21:22.974204] [INFO ] [MAIN ] HUM: Loaded 49586 primary data records. [2025-09-19T22:21:23.052891] [DEBUG] [LOCAL ] HUN: Loaded 53978 existing records from primary storage. [2025-09-19T22:21:23.147418] [INFO ] [MAIN ] HUN: Loaded 53978 primary data records. [2025-09-19T22:21:23.926813] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:23.939728] [INFO ] [MAIN ] HUYA: Generated 1820 derivative records from 45033 primary records. [2025-09-19T22:21:23.939910] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-19T22:21:23.940163] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:23.940957] [INFO ] [MAIN ] HUM: Generated 1820 derivative records from 49586 primary records. [2025-09-19T22:21:23.941932] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-19T22:21:23.976903] [DEBUG] [LOCAL ] HUM: Derivative data saved (1820 records). [2025-09-19T22:21:23.977078] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-19T22:21:23.979839] [INFO ] [MAIN ] Derivative Progress: 919/2093 symbols completed. HUM took 1.2s. Estimated remaining: 7m 37s. Rate: 154.1 symbols/min [2025-09-19T22:21:23.975799] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1820 records). [2025-09-19T22:21:23.980018] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-19T22:21:23.982157] [INFO ] [MAIN ] Derivative Progress: 920/2093 symbols completed. HUYA took 1.1s. Estimated remaining: 7m 36s. Rate: 154.3 symbols/min [2025-09-19T22:21:23.990116] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:23.995465] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:23.996049] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:23.997153] [INFO ] [MAIN ] HUN: Generated 1820 derivative records from 53978 primary records. [2025-09-19T22:21:23.997443] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-19T22:21:24.019248] [DEBUG] [LOCAL ] HUN: Derivative data saved (1820 records). [2025-09-19T22:21:24.019380] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-19T22:21:24.021829] [INFO ] [MAIN ] Derivative Progress: 921/2093 symbols completed. HUN took 1.2s. Estimated remaining: 7m 35s. Rate: 154.5 symbols/min [2025-09-19T22:21:24.022207] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:24.029735] [DEBUG] [LOCAL ] HVT: Loaded 16524 existing records from primary storage. [2025-09-19T22:21:24.029968] [INFO ] [MAIN ] HVT: Loaded 16524 primary data records. [2025-09-19T22:21:24.400994] [DEBUG] [LOCAL ] HWM: Loaded 53803 existing records from primary storage. [2025-09-19T22:21:24.401265] [INFO ] [MAIN ] HWM: Loaded 53803 primary data records. [2025-09-19T22:21:24.521769] [DEBUG] [LOCAL ] HXL: Loaded 46858 existing records from primary storage. [2025-09-19T22:21:24.537425] [INFO ] [MAIN ] HXL: Loaded 46858 primary data records. [2025-09-19T22:21:25.052863] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:25.055017] [INFO ] [MAIN ] HVT: Generated 1820 derivative records from 16524 primary records. [2025-09-19T22:21:25.055980] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-19T22:21:25.074501] [DEBUG] [LOCAL ] HVT: Derivative data saved (1820 records). [2025-09-19T22:21:25.074806] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-19T22:21:25.076674] [INFO ] [MAIN ] Derivative Progress: 922/2093 symbols completed. HVT took 1.1s. Estimated remaining: 7m 36s. Rate: 154.2 symbols/min [2025-09-19T22:21:25.078059] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:25.094842] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:25.095834] [INFO ] [MAIN ] HWM: Generated 1820 derivative records from 53803 primary records. [2025-09-19T22:21:25.096001] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-19T22:21:25.116063] [DEBUG] [LOCAL ] HWM: Derivative data saved (1820 records). [2025-09-19T22:21:25.121816] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-19T22:21:25.121704] [DEBUG] [LOCAL ] HY: Loaded 10589 existing records from primary storage. [2025-09-19T22:21:25.125197] [INFO ] [MAIN ] Derivative Progress: 923/2093 symbols completed. HWM took 1.1s. Estimated remaining: 7m 35s. Rate: 154.3 symbols/min [2025-09-19T22:21:25.126433] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:25.126680] [INFO ] [MAIN ] HY: Loaded 10589 primary data records. [2025-09-19T22:21:25.207218] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:25.227678] [INFO ] [MAIN ] HXL: Generated 1820 derivative records from 46858 primary records. [2025-09-19T22:21:25.251042] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-19T22:21:25.271752] [DEBUG] [LOCAL ] HYI: Loaded 8995 existing records from primary storage. [2025-09-19T22:21:25.277022] [INFO ] [MAIN ] HYI: Loaded 8995 primary data records. [2025-09-19T22:21:25.571732] [DEBUG] [LOCAL ] HXL: Derivative data saved (1820 records). [2025-09-19T22:21:25.590014] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-19T22:21:25.593149] [INFO ] [MAIN ] Derivative Progress: 924/2093 symbols completed. HXL took 1.6s. Estimated remaining: 7m 35s. Rate: 154.3 symbols/min [2025-09-19T22:21:25.594052] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:25.845975] [DEBUG] [LOCAL ] HYT: Loaded 33598 existing records from primary storage. [2025-09-19T22:21:25.846383] [INFO ] [MAIN ] HYT: Loaded 33598 primary data records. [2025-09-19T22:21:25.892063] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:25.919225] [INFO ] [MAIN ] HY: Generated 1820 derivative records from 10589 primary records. [2025-09-19T22:21:25.921871] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-19T22:21:26.015969] [DEBUG] [LOCAL ] HY: Derivative data saved (1820 records). [2025-09-19T22:21:26.057982] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-19T22:21:26.075039] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:26.082681] [INFO ] [MAIN ] Derivative Progress: 925/2093 symbols completed. HY took 1.0s. Estimated remaining: 7m 34s. Rate: 154.2 symbols/min [2025-09-19T22:21:26.118494] [INFO ] [MAIN ] HYI: Generated 1820 derivative records from 8995 primary records. [2025-09-19T22:21:26.232077] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-19T22:21:26.226884] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:26.260816] [DEBUG] [LOCAL ] HYTR: Loaded 3252 existing records from primary storage. [2025-09-19T22:21:26.263994] [INFO ] [MAIN ] HYTR: Loaded 3252 primary data records. [2025-09-19T22:21:26.264058] [DEBUG] [LOCAL ] HYI: Derivative data saved (1820 records). [2025-09-19T22:21:26.308420] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-19T22:21:26.331748] [INFO ] [MAIN ] Derivative Progress: 926/2093 symbols completed. HYI took 1.2s. Estimated remaining: 7m 34s. Rate: 154.3 symbols/min [2025-09-19T22:21:26.360109] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:26.614401] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:26.615270] [INFO ] [MAIN ] HYT: Generated 1820 derivative records from 33598 primary records. [2025-09-19T22:21:26.615387] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-19T22:21:26.616316] [DEBUG] [LOCAL ] HZO: Loaded 29856 existing records from primary storage. [2025-09-19T22:21:26.626001] [INFO ] [MAIN ] HZO: Loaded 29856 primary data records. [2025-09-19T22:21:26.634376] [DEBUG] [LOCAL ] HYT: Derivative data saved (1820 records). [2025-09-19T22:21:26.634559] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-19T22:21:26.658283] [INFO ] [MAIN ] Derivative Progress: 927/2093 symbols completed. HYT took 1.1s. Estimated remaining: 7m 33s. Rate: 154.3 symbols/min [2025-09-19T22:21:26.674568] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:26.840896] [DEBUG] [LOCAL ] IAE: Loaded 5839 existing records from primary storage. [2025-09-19T22:21:26.959187] [INFO ] [MAIN ] IAE: Loaded 5839 primary data records. [2025-09-19T22:21:26.994261] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:21:27.007278] [INFO ] [MAIN ] HYTR: Generated 1819 derivative records from 3252 primary records. [2025-09-19T22:21:27.033333] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-19T22:21:27.098410] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1819 records). [2025-09-19T22:21:27.099252] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-19T22:21:27.111833] [INFO ] [MAIN ] Derivative Progress: 928/2093 symbols completed. HYTR took 1.0s. Estimated remaining: 7m 33s. Rate: 154.3 symbols/min [2025-09-19T22:21:27.321537] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:27.322398] [INFO ] [MAIN ] HZO: Generated 1820 derivative records from 29856 primary records. [2025-09-19T22:21:27.322478] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-19T22:21:27.339936] [DEBUG] [LOCAL ] HZO: Derivative data saved (1820 records). [2025-09-19T22:21:27.340081] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-19T22:21:27.342236] [INFO ] [MAIN ] Derivative Progress: 929/2093 symbols completed. HZO took 1.0s. Estimated remaining: 7m 32s. Rate: 154.4 symbols/min [2025-09-19T22:21:27.358880] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:27.359413] [INFO ] [MAIN ] IAE: Generated 1820 derivative records from 5839 primary records. [2025-09-19T22:21:27.359472] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-19T22:21:27.373573] [DEBUG] [LOCAL ] IAE: Derivative data saved (1820 records). [2025-09-19T22:21:27.373638] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-19T22:21:27.375991] [INFO ] [MAIN ] Derivative Progress: 930/2093 symbols completed. IAE took 0.7s. Estimated remaining: 7m 32s. Rate: 154.5 symbols/min [2025-09-19T22:21:27.376734] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:27.376673] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:27.376583] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:27.460500] [DEBUG] [LOCAL ] IBN: Loaded 53699 existing records from primary storage. [2025-09-19T22:21:27.460833] [INFO ] [MAIN ] IBN: Loaded 53699 primary data records. [2025-09-19T22:21:27.568820] [DEBUG] [LOCAL ] IAG: Loaded 54213 existing records from primary storage. [2025-09-19T22:21:27.595627] [INFO ] [MAIN ] IAG: Loaded 54213 primary data records. [2025-09-19T22:21:27.622610] [DEBUG] [LOCAL ] IBM: Loaded 54389 existing records from primary storage. [2025-09-19T22:21:27.678248] [INFO ] [MAIN ] IBM: Loaded 54389 primary data records. [2025-09-19T22:21:28.489638] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:28.491022] [INFO ] [MAIN ] IBN: Generated 1820 derivative records from 53699 primary records. [2025-09-19T22:21:28.491232] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-19T22:21:28.510347] [DEBUG] [LOCAL ] IBN: Derivative data saved (1820 records). [2025-09-19T22:21:28.510457] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-19T22:21:28.512193] [INFO ] [MAIN ] Derivative Progress: 931/2093 symbols completed. IBN took 1.1s. Estimated remaining: 7m 32s. Rate: 154.2 symbols/min [2025-09-19T22:21:28.512569] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:28.534175] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:28.535068] [INFO ] [MAIN ] IAG: Generated 1820 derivative records from 54213 primary records. [2025-09-19T22:21:28.535277] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-19T22:21:28.557302] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:28.562735] [INFO ] [MAIN ] IBM: Generated 1820 derivative records from 54389 primary records. [2025-09-19T22:21:28.566553] [DEBUG] [LOCAL ] IAG: Derivative data saved (1820 records). [2025-09-19T22:21:28.566260] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-19T22:21:28.566848] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-19T22:21:28.571515] [INFO ] [MAIN ] Derivative Progress: 932/2093 symbols completed. IAG took 1.2s. Estimated remaining: 7m 31s. Rate: 154.3 symbols/min [2025-09-19T22:21:28.579922] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:28.595372] [DEBUG] [LOCAL ] IBM: Derivative data saved (1820 records). [2025-09-19T22:21:28.595485] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-19T22:21:28.598331] [INFO ] [MAIN ] Derivative Progress: 933/2093 symbols completed. IBM took 1.2s. Estimated remaining: 7m 31s. Rate: 154.5 symbols/min [2025-09-19T22:21:28.598709] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:28.611631] [DEBUG] [LOCAL ] IBP: Loaded 29938 existing records from primary storage. [2025-09-19T22:21:28.611904] [INFO ] [MAIN ] IBP: Loaded 29938 primary data records. [2025-09-19T22:21:28.945161] [DEBUG] [LOCAL ] IBTA: Loaded 38885 existing records from primary storage. [2025-09-19T22:21:28.952968] [INFO ] [MAIN ] IBTA: Loaded 38885 primary data records. [2025-09-19T22:21:29.193491] [DEBUG] [LOCAL ] ICE: Loaded 53803 existing records from primary storage. [2025-09-19T22:21:29.193817] [INFO ] [MAIN ] ICE: Loaded 53803 primary data records. [2025-09-19T22:21:29.651064] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:29.669027] [INFO ] [MAIN ] IBP: Generated 1820 derivative records from 29938 primary records. [2025-09-19T22:21:29.669443] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-19T22:21:29.694819] [DEBUG] [LOCAL ] IBP: Derivative data saved (1820 records). [2025-09-19T22:21:29.697604] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-19T22:21:29.700187] [INFO ] [MAIN ] Derivative Progress: 934/2093 symbols completed. IBP took 1.2s. Estimated remaining: 7m 31s. Rate: 154.2 symbols/min [2025-09-19T22:21:29.700875] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:29.722875] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:29.724064] [INFO ] [MAIN ] IBTA: Generated 1820 derivative records from 38885 primary records. [2025-09-19T22:21:29.724366] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-19T22:21:29.749845] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1820 records). [2025-09-19T22:21:29.750016] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-19T22:21:29.752066] [INFO ] [MAIN ] Derivative Progress: 935/2093 symbols completed. IBTA took 1.2s. Estimated remaining: 7m 30s. Rate: 154.3 symbols/min [2025-09-19T22:21:29.752768] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:29.785747] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:29.786810] [INFO ] [MAIN ] ICE: Generated 1820 derivative records from 53803 primary records. [2025-09-19T22:21:29.786898] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-19T22:21:29.816630] [DEBUG] [LOCAL ] ICL: Loaded 39503 existing records from primary storage. [2025-09-19T22:21:29.817862] [INFO ] [MAIN ] ICL: Loaded 39503 primary data records. [2025-09-19T22:21:29.912236] [DEBUG] [LOCAL ] ICE: Derivative data saved (1820 records). [2025-09-19T22:21:29.923814] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-19T22:21:29.953057] [INFO ] [MAIN ] Derivative Progress: 936/2093 symbols completed. ICE took 1.4s. Estimated remaining: 7m 30s. Rate: 154.4 symbols/min [2025-09-19T22:21:29.965871] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:30.014064] [DEBUG] [LOCAL ] IDA: Loaded 32459 existing records from primary storage. [2025-09-19T22:21:30.017947] [INFO ] [MAIN ] IDA: Loaded 32459 primary data records. [2025-09-19T22:21:30.267844] [DEBUG] [LOCAL ] IDE: Loaded 8501 existing records from primary storage. [2025-09-19T22:21:30.285744] [INFO ] [MAIN ] IDE: Loaded 8501 primary data records. [2025-09-19T22:21:30.867545] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:30.869196] [INFO ] [MAIN ] ICL: Generated 1820 derivative records from 39503 primary records. [2025-09-19T22:21:30.869609] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-19T22:21:30.906124] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:30.907404] [DEBUG] [LOCAL ] ICL: Derivative data saved (1820 records). [2025-09-19T22:21:30.907780] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-19T22:21:30.920486] [INFO ] [MAIN ] IDA: Generated 1820 derivative records from 32459 primary records. [2025-09-19T22:21:30.923526] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-19T22:21:30.922556] [INFO ] [MAIN ] Derivative Progress: 937/2093 symbols completed. ICL took 1.2s. Estimated remaining: 7m 30s. Rate: 154.2 symbols/min [2025-09-19T22:21:30.924208] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:30.923892] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:30.925089] [INFO ] [MAIN ] IDE: Generated 1820 derivative records from 8501 primary records. [2025-09-19T22:21:30.925236] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-19T22:21:30.957312] [DEBUG] [LOCAL ] IDA: Derivative data saved (1820 records). [2025-09-19T22:21:30.963878] [DEBUG] [LOCAL ] IDE: Derivative data saved (1820 records). [2025-09-19T22:21:30.964027] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-19T22:21:30.966489] [INFO ] [MAIN ] Derivative Progress: 938/2093 symbols completed. IDA took 1.2s. Estimated remaining: 7m 29s. Rate: 154.3 symbols/min [2025-09-19T22:21:30.966692] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-19T22:21:30.970313] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:30.970457] [INFO ] [MAIN ] Derivative Progress: 939/2093 symbols completed. IDE took 1.0s. Estimated remaining: 7m 28s. Rate: 154.5 symbols/min [2025-09-19T22:21:30.970911] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:30.979901] [DEBUG] [LOCAL ] IDT: Loaded 17777 existing records from primary storage. [2025-09-19T22:21:30.983780] [INFO ] [MAIN ] IDT: Loaded 17777 primary data records. [2025-09-19T22:21:31.339198] [DEBUG] [LOCAL ] IEX: Loaded 38987 existing records from primary storage. [2025-09-19T22:21:31.340086] [INFO ] [MAIN ] IEX: Loaded 38987 primary data records. [2025-09-19T22:21:31.426146] [DEBUG] [LOCAL ] IFF: Loaded 51702 existing records from primary storage. [2025-09-19T22:21:31.450071] [INFO ] [MAIN ] IFF: Loaded 51702 primary data records. [2025-09-19T22:21:31.981978] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:31.983770] [INFO ] [MAIN ] IDT: Generated 1820 derivative records from 17777 primary records. [2025-09-19T22:21:31.985616] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-19T22:21:32.006204] [DEBUG] [LOCAL ] IDT: Derivative data saved (1820 records). [2025-09-19T22:21:32.006813] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-19T22:21:32.009318] [INFO ] [MAIN ] Derivative Progress: 940/2093 symbols completed. IDT took 1.1s. Estimated remaining: 7m 29s. Rate: 154.2 symbols/min [2025-09-19T22:21:32.009800] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:32.030076] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:32.032911] [INFO ] [MAIN ] IEX: Generated 1820 derivative records from 38987 primary records. [2025-09-19T22:21:32.033144] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-19T22:21:32.067737] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:32.069864] [INFO ] [MAIN ] IFF: Generated 1820 derivative records from 51702 primary records. [2025-09-19T22:21:32.070258] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-19T22:21:32.091565] [DEBUG] [LOCAL ] IFN: Loaded 18547 existing records from primary storage. [2025-09-19T22:21:32.091771] [INFO ] [MAIN ] IFN: Loaded 18547 primary data records. [2025-09-19T22:21:32.092309] [DEBUG] [LOCAL ] IEX: Derivative data saved (1820 records). [2025-09-19T22:21:32.107945] [DEBUG] [LOCAL ] IFF: Derivative data saved (1820 records). [2025-09-19T22:21:32.108039] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-19T22:21:32.127585] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-19T22:21:32.129663] [INFO ] [MAIN ] Derivative Progress: 941/2093 symbols completed. IEX took 1.2s. Estimated remaining: 7m 28s. Rate: 154.3 symbols/min [2025-09-19T22:21:32.145178] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:32.155319] [INFO ] [MAIN ] Derivative Progress: 942/2093 symbols completed. IFF took 1.2s. Estimated remaining: 7m 27s. Rate: 154.5 symbols/min [2025-09-19T22:21:32.166145] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:32.294802] [DEBUG] [LOCAL ] IGA: Loaded 9829 existing records from primary storage. [2025-09-19T22:21:32.298793] [INFO ] [MAIN ] IGA: Loaded 9829 primary data records. [2025-09-19T22:21:32.540876] [DEBUG] [LOCAL ] IFS: Loaded 23385 existing records from primary storage. [2025-09-19T22:21:32.553344] [INFO ] [MAIN ] IFS: Loaded 23385 primary data records. [2025-09-19T22:21:33.096378] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:33.097632] [INFO ] [MAIN ] IFN: Generated 1820 derivative records from 18547 primary records. [2025-09-19T22:21:33.097841] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-19T22:21:33.122246] [DEBUG] [LOCAL ] IFN: Derivative data saved (1820 records). [2025-09-19T22:21:33.123489] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-19T22:21:33.125734] [INFO ] [MAIN ] Derivative Progress: 943/2093 symbols completed. IFN took 1.1s. Estimated remaining: 7m 27s. Rate: 154.2 symbols/min [2025-09-19T22:21:33.139518] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:33.140536] [INFO ] [MAIN ] IGA: Generated 1820 derivative records from 9829 primary records. [2025-09-19T22:21:33.140768] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-19T22:21:33.159807] [DEBUG] [LOCAL ] IGA: Derivative data saved (1820 records). [2025-09-19T22:21:33.159997] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-19T22:21:33.162433] [INFO ] [MAIN ] Derivative Progress: 944/2093 symbols completed. IGA took 1.0s. Estimated remaining: 7m 27s. Rate: 154.4 symbols/min [2025-09-19T22:21:33.175303] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:33.175905] [INFO ] [MAIN ] IFS: Generated 1820 derivative records from 23385 primary records. [2025-09-19T22:21:33.175964] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-19T22:21:33.190922] [DEBUG] [LOCAL ] IFS: Derivative data saved (1820 records). [2025-09-19T22:21:33.190981] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-19T22:21:33.193640] [INFO ] [MAIN ] Derivative Progress: 945/2093 symbols completed. IFS took 1.0s. Estimated remaining: 7m 26s. Rate: 154.5 symbols/min [2025-09-19T22:21:33.194249] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:33.194634] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:33.194880] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:33.202719] [DEBUG] [LOCAL ] IGI: Loaded 3784 existing records from primary storage. [2025-09-19T22:21:33.203130] [INFO ] [MAIN ] IGI: Loaded 3784 primary data records. [2025-09-19T22:21:33.330098] [DEBUG] [LOCAL ] IGD: Loaded 19486 existing records from primary storage. [2025-09-19T22:21:33.334258] [INFO ] [MAIN ] IGD: Loaded 19486 primary data records. [2025-09-19T22:21:33.523164] [DEBUG] [LOCAL ] IGR: Loaded 31042 existing records from primary storage. [2025-09-19T22:21:33.528710] [INFO ] [MAIN ] IGR: Loaded 31042 primary data records. [2025-09-19T22:21:34.217673] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:34.218765] [INFO ] [MAIN ] IGI: Generated 1820 derivative records from 3784 primary records. [2025-09-19T22:21:34.219012] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-19T22:21:34.250064] [DEBUG] [LOCAL ] IGI: Derivative data saved (1820 records). [2025-09-19T22:21:34.250262] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-19T22:21:34.249707] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:34.253177] [INFO ] [MAIN ] Derivative Progress: 946/2093 symbols completed. IGI took 1.1s. Estimated remaining: 7m 26s. Rate: 154.2 symbols/min [2025-09-19T22:21:34.251139] [INFO ] [MAIN ] IGD: Generated 1820 derivative records from 19486 primary records. [2025-09-19T22:21:34.253464] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:34.253560] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-19T22:21:34.271725] [DEBUG] [LOCAL ] IGD: Derivative data saved (1820 records). [2025-09-19T22:21:34.273487] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-19T22:21:34.275991] [INFO ] [MAIN ] Derivative Progress: 947/2093 symbols completed. IGD took 1.1s. Estimated remaining: 7m 25s. Rate: 154.4 symbols/min [2025-09-19T22:21:34.276473] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:34.279120] [DEBUG] [LOCAL ] IH: Loaded 3638 existing records from primary storage. [2025-09-19T22:21:34.279314] [INFO ] [MAIN ] IH: Loaded 3638 primary data records. [2025-09-19T22:21:34.350438] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:34.373389] [INFO ] [MAIN ] IGR: Generated 1820 derivative records from 31042 primary records. [2025-09-19T22:21:34.378669] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-19T22:21:34.419094] [DEBUG] [LOCAL ] IGR: Derivative data saved (1820 records). [2025-09-19T22:21:34.424556] [DEBUG] [LOCAL ] IHD: Loaded 7308 existing records from primary storage. [2025-09-19T22:21:34.440019] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-19T22:21:34.447635] [INFO ] [MAIN ] Derivative Progress: 948/2093 symbols completed. IGR took 1.3s. Estimated remaining: 7m 25s. Rate: 154.5 symbols/min [2025-09-19T22:21:34.469678] [INFO ] [MAIN ] IHD: Loaded 7308 primary data records. [2025-09-19T22:21:34.460988] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:34.930927] [DEBUG] [LOCAL ] IHG: Loaded 25214 existing records from primary storage. [2025-09-19T22:21:34.931165] [INFO ] [MAIN ] IHG: Loaded 25214 primary data records. [2025-09-19T22:21:35.260518] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:35.261366] [INFO ] [MAIN ] IH: Generated 1820 derivative records from 3638 primary records. [2025-09-19T22:21:35.261538] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-19T22:21:35.281500] [DEBUG] [LOCAL ] IH: Derivative data saved (1820 records). [2025-09-19T22:21:35.282045] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-19T22:21:35.291915] [INFO ] [MAIN ] Derivative Progress: 949/2093 symbols completed. IH took 1.0s. Estimated remaining: 7m 25s. Rate: 154.3 symbols/min [2025-09-19T22:21:35.296802] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:35.298251] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:35.299226] [INFO ] [MAIN ] IHD: Generated 1820 derivative records from 7308 primary records. [2025-09-19T22:21:35.299692] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-19T22:21:35.317054] [DEBUG] [LOCAL ] IHD: Derivative data saved (1820 records). [2025-09-19T22:21:35.317195] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-19T22:21:35.319684] [INFO ] [MAIN ] Derivative Progress: 950/2093 symbols completed. IHD took 1.0s. Estimated remaining: 7m 24s. Rate: 154.4 symbols/min [2025-09-19T22:21:35.320454] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:35.340257] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:35.344482] [INFO ] [MAIN ] IHG: Generated 1820 derivative records from 25214 primary records. [2025-09-19T22:21:35.344635] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-19T22:21:35.343695] [DEBUG] [LOCAL ] IIF: Loaded 5891 existing records from primary storage. [2025-09-19T22:21:35.344828] [INFO ] [MAIN ] IIF: Loaded 5891 primary data records. [2025-09-19T22:21:35.441874] [DEBUG] [LOCAL ] IHG: Derivative data saved (1820 records). [2025-09-19T22:21:35.454152] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-19T22:21:35.456884] [INFO ] [MAIN ] Derivative Progress: 951/2093 symbols completed. IHG took 1.0s. Estimated remaining: 7m 23s. Rate: 154.5 symbols/min [2025-09-19T22:21:35.462296] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:35.493432] [DEBUG] [LOCAL ] IHS: Loaded 39559 existing records from primary storage. [2025-09-19T22:21:35.509677] [INFO ] [MAIN ] IHS: Loaded 39559 primary data records. [2025-09-19T22:21:35.792378] [DEBUG] [LOCAL ] IIIN: Loaded 17183 existing records from primary storage. [2025-09-19T22:21:35.825113] [INFO ] [MAIN ] IIIN: Loaded 17183 primary data records. [2025-09-19T22:21:36.399779] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:36.401728] [INFO ] [MAIN ] IIF: Generated 1820 derivative records from 5891 primary records. [2025-09-19T22:21:36.401984] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-19T22:21:36.427622] [DEBUG] [LOCAL ] IIF: Derivative data saved (1820 records). [2025-09-19T22:21:36.427760] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-19T22:21:36.430141] [INFO ] [MAIN ] Derivative Progress: 952/2093 symbols completed. IIF took 1.1s. Estimated remaining: 7m 24s. Rate: 154.3 symbols/min [2025-09-19T22:21:36.435321] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:36.437028] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:36.438090] [INFO ] [MAIN ] IHS: Generated 1820 derivative records from 39559 primary records. [2025-09-19T22:21:36.438258] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-19T22:21:36.473639] [DEBUG] [LOCAL ] IHS: Derivative data saved (1820 records). [2025-09-19T22:21:36.474151] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-19T22:21:36.474008] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:36.476838] [INFO ] [MAIN ] Derivative Progress: 953/2093 symbols completed. IHS took 1.2s. Estimated remaining: 7m 23s. Rate: 154.4 symbols/min [2025-09-19T22:21:36.478038] [INFO ] [MAIN ] IIIN: Generated 1820 derivative records from 17183 primary records. [2025-09-19T22:21:36.478250] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-19T22:21:36.478185] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:36.497083] [DEBUG] [LOCAL ] IIM: Loaded 16141 existing records from primary storage. [2025-09-19T22:21:36.501401] [INFO ] [MAIN ] IIM: Loaded 16141 primary data records. [2025-09-19T22:21:36.501762] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1820 records). [2025-09-19T22:21:36.513326] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-19T22:21:36.516251] [INFO ] [MAIN ] Derivative Progress: 954/2093 symbols completed. IIIN took 1.1s. Estimated remaining: 7m 22s. Rate: 154.6 symbols/min [2025-09-19T22:21:36.552545] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:36.703740] [DEBUG] [LOCAL ] IIPR: Loaded 30143 existing records from primary storage. [2025-09-19T22:21:36.819006] [INFO ] [MAIN ] IIPR: Loaded 30143 primary data records. [2025-09-19T22:21:37.028868] [DEBUG] [LOCAL ] IMAX: Loaded 43331 existing records from primary storage. [2025-09-19T22:21:37.148003] [INFO ] [MAIN ] IMAX: Loaded 43331 primary data records. [2025-09-19T22:21:37.485214] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:37.486371] [INFO ] [MAIN ] IIM: Generated 1820 derivative records from 16141 primary records. [2025-09-19T22:21:37.486477] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-19T22:21:37.510638] [DEBUG] [LOCAL ] IIM: Derivative data saved (1820 records). [2025-09-19T22:21:37.524605] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-19T22:21:37.525221] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:37.529473] [INFO ] [MAIN ] IIPR: Generated 1820 derivative records from 30143 primary records. [2025-09-19T22:21:37.528722] [INFO ] [MAIN ] Derivative Progress: 955/2093 symbols completed. IIM took 1.1s. Estimated remaining: 7m 22s. Rate: 154.3 symbols/min [2025-09-19T22:21:37.529859] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-19T22:21:37.531256] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:37.548590] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1820 records). [2025-09-19T22:21:37.548861] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-19T22:21:37.551284] [INFO ] [MAIN ] Derivative Progress: 956/2093 symbols completed. IIPR took 1.1s. Estimated remaining: 7m 22s. Rate: 154.5 symbols/min [2025-09-19T22:21:37.551974] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:37.570854] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:37.571786] [INFO ] [MAIN ] IMAX: Generated 1820 derivative records from 43331 primary records. [2025-09-19T22:21:37.571937] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-19T22:21:37.591484] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1820 records). [2025-09-19T22:21:37.591716] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-19T22:21:37.594348] [INFO ] [MAIN ] Derivative Progress: 957/2093 symbols completed. IMAX took 1.1s. Estimated remaining: 7m 21s. Rate: 154.6 symbols/min [2025-09-19T22:21:37.595109] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:37.668587] [DEBUG] [LOCAL ] INFA: Loaded 50875 existing records from primary storage. [2025-09-19T22:21:37.669905] [INFO ] [MAIN ] INFA: Loaded 50875 primary data records. [2025-09-19T22:21:37.670888] [DEBUG] [LOCAL ] INFY: Loaded 54378 existing records from primary storage. [2025-09-19T22:21:37.671083] [INFO ] [MAIN ] INFY: Loaded 54378 primary data records. [2025-09-19T22:21:38.308320] [DEBUG] [LOCAL ] ING: Loaded 51617 existing records from primary storage. [2025-09-19T22:21:38.339360] [INFO ] [MAIN ] ING: Loaded 51617 primary data records. [2025-09-19T22:21:38.683442] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:38.684595] [INFO ] [MAIN ] INFA: Generated 1820 derivative records from 50875 primary records. [2025-09-19T22:21:38.684831] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-19T22:21:38.711165] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:38.715411] [INFO ] [MAIN ] INFY: Generated 1820 derivative records from 54378 primary records. [2025-09-19T22:21:38.716867] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-19T22:21:38.717523] [DEBUG] [LOCAL ] INFA: Derivative data saved (1820 records). [2025-09-19T22:21:38.719122] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-19T22:21:38.730073] [INFO ] [MAIN ] Derivative Progress: 958/2093 symbols completed. INFA took 1.2s. Estimated remaining: 7m 21s. Rate: 154.3 symbols/min [2025-09-19T22:21:38.748237] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:38.750627] [INFO ] [MAIN ] ING: Generated 1820 derivative records from 51617 primary records. [2025-09-19T22:21:38.751777] [DEBUG] [LOCAL ] INFY: Derivative data saved (1820 records). [2025-09-19T22:21:38.751930] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-19T22:21:38.751863] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-19T22:21:38.753967] [INFO ] [MAIN ] Derivative Progress: 959/2093 symbols completed. INFY took 1.2s. Estimated remaining: 7m 20s. Rate: 154.5 symbols/min [2025-09-19T22:21:38.770134] [DEBUG] [LOCAL ] ING: Derivative data saved (1820 records). [2025-09-19T22:21:38.770199] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-19T22:21:38.773333] [INFO ] [MAIN ] Derivative Progress: 960/2093 symbols completed. ING took 1.2s. Estimated remaining: 7m 20s. Rate: 154.6 symbols/min [2025-09-19T22:21:38.773943] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:38.774179] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:38.774131] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:38.838221] [DEBUG] [LOCAL ] INN: Loaded 42564 existing records from primary storage. [2025-09-19T22:21:38.839427] [INFO ] [MAIN ] INN: Loaded 42564 primary data records. [2025-09-19T22:21:38.861928] [DEBUG] [LOCAL ] INGM: Loaded 29659 existing records from primary storage. [2025-09-19T22:21:38.895316] [INFO ] [MAIN ] INGM: Loaded 29659 primary data records. [2025-09-19T22:21:38.974334] [DEBUG] [LOCAL ] INGR: Loaded 33927 existing records from primary storage. [2025-09-19T22:21:39.000829] [INFO ] [MAIN ] INGR: Loaded 33927 primary data records. [2025-09-19T22:21:39.833337] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:39.833014] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:39.834737] [INFO ] [MAIN ] INN: Generated 1820 derivative records from 42564 primary records. [2025-09-19T22:21:39.835549] [INFO ] [MAIN ] INGM: Generated 1820 derivative records from 29659 primary records. [2025-09-19T22:21:39.835730] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-19T22:21:39.835806] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-19T22:21:39.871714] [DEBUG] [LOCAL ] INGM: Derivative data saved (1820 records). [2025-09-19T22:21:39.870506] [DEBUG] [LOCAL ] INN: Derivative data saved (1820 records). [2025-09-19T22:21:39.884292] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-19T22:21:39.884779] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-19T22:21:39.887547] [INFO ] [MAIN ] Derivative Progress: 961/2093 symbols completed. INGM took 1.1s. Estimated remaining: 7m 20s. Rate: 154.3 symbols/min [2025-09-19T22:21:39.888051] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:39.891120] [INFO ] [MAIN ] Derivative Progress: 962/2093 symbols completed. INN took 1.1s. Estimated remaining: 7m 19s. Rate: 154.5 symbols/min [2025-09-19T22:21:39.891041] [INFO ] [MAIN ] INGR: Generated 1820 derivative records from 33927 primary records. [2025-09-19T22:21:39.891504] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:39.891431] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:39.892014] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-19T22:21:39.912420] [DEBUG] [LOCAL ] INGR: Derivative data saved (1820 records). [2025-09-19T22:21:39.912579] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-19T22:21:39.915480] [INFO ] [MAIN ] Derivative Progress: 963/2093 symbols completed. INGR took 1.1s. Estimated remaining: 7m 18s. Rate: 154.6 symbols/min [2025-09-19T22:21:39.915915] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:39.972610] [DEBUG] [LOCAL ] INSP: Loaded 37158 existing records from primary storage. [2025-09-19T22:21:39.973315] [INFO ] [MAIN ] INSP: Loaded 37158 primary data records. [2025-09-19T22:21:39.971753] [DEBUG] [LOCAL ] INSW: Loaded 41250 existing records from primary storage. [2025-09-19T22:21:40.006441] [INFO ] [MAIN ] INSW: Loaded 41250 primary data records. [2025-09-19T22:21:40.314186] [DEBUG] [LOCAL ] INVH: Loaded 53917 existing records from primary storage. [2025-09-19T22:21:40.324567] [INFO ] [MAIN ] INVH: Loaded 53917 primary data records. [2025-09-19T22:21:41.024211] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:41.025981] [INFO ] [MAIN ] INSP: Generated 1820 derivative records from 37158 primary records. [2025-09-19T22:21:41.026247] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-19T22:21:41.057165] [DEBUG] [LOCAL ] INSP: Derivative data saved (1820 records). [2025-09-19T22:21:41.052605] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:41.057364] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-19T22:21:41.059509] [INFO ] [MAIN ] Derivative Progress: 964/2093 symbols completed. INSP took 1.2s. Estimated remaining: 7m 19s. Rate: 154.3 symbols/min [2025-09-19T22:21:41.060579] [INFO ] [MAIN ] INSW: Generated 1820 derivative records from 41250 primary records. [2025-09-19T22:21:41.061137] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-19T22:21:41.061041] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:41.089961] [DEBUG] [LOCAL ] INSW: Derivative data saved (1820 records). [2025-09-19T22:21:41.103474] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-19T22:21:41.103312] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:41.104256] [INFO ] [MAIN ] INVH: Generated 1820 derivative records from 53917 primary records. [2025-09-19T22:21:41.106460] [INFO ] [MAIN ] Derivative Progress: 965/2093 symbols completed. INSW took 1.2s. Estimated remaining: 7m 18s. Rate: 154.5 symbols/min [2025-09-19T22:21:41.106626] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-19T22:21:41.106873] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:41.132186] [DEBUG] [LOCAL ] INVX: Loaded 29676 existing records from primary storage. [2025-09-19T22:21:41.133302] [INFO ] [MAIN ] INVX: Loaded 29676 primary data records. [2025-09-19T22:21:41.145634] [DEBUG] [LOCAL ] INVH: Derivative data saved (1820 records). [2025-09-19T22:21:41.165773] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-19T22:21:41.180635] [INFO ] [MAIN ] Derivative Progress: 966/2093 symbols completed. INVH took 1.3s. Estimated remaining: 7m 17s. Rate: 154.6 symbols/min [2025-09-19T22:21:41.200020] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:41.479044] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-09-19T22:21:41.493286] [INFO ] [MAIN ] IONQ: Loaded 54568 primary data records. [2025-09-19T22:21:41.629489] [DEBUG] [LOCAL ] IOT: Loaded 54252 existing records from primary storage. [2025-09-19T22:21:41.641080] [INFO ] [MAIN ] IOT: Loaded 54252 primary data records. [2025-09-19T22:21:41.973299] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:41.974112] [INFO ] [MAIN ] INVX: Generated 1820 derivative records from 29676 primary records. [2025-09-19T22:21:41.974633] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-19T22:21:42.073175] [DEBUG] [LOCAL ] INVX: Derivative data saved (1820 records). [2025-09-19T22:21:42.073320] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-19T22:21:42.075398] [INFO ] [MAIN ] Derivative Progress: 967/2093 symbols completed. INVX took 1.0s. Estimated remaining: 7m 18s. Rate: 154.4 symbols/min [2025-09-19T22:21:42.076012] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:42.257821] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:42.258786] [INFO ] [MAIN ] IONQ: Generated 1820 derivative records from 54568 primary records. [2025-09-19T22:21:42.258961] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-19T22:21:42.305520] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:42.306618] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1820 records). [2025-09-19T22:21:42.306805] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-19T22:21:42.307637] [INFO ] [MAIN ] IOT: Generated 1820 derivative records from 54252 primary records. [2025-09-19T22:21:42.310530] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-19T22:21:42.310371] [INFO ] [MAIN ] Derivative Progress: 968/2093 symbols completed. IONQ took 1.2s. Estimated remaining: 7m 17s. Rate: 154.4 symbols/min [2025-09-19T22:21:42.311494] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:42.345522] [DEBUG] [LOCAL ] IP: Loaded 54109 existing records from primary storage. [2025-09-19T22:21:42.346390] [INFO ] [MAIN ] IP: Loaded 54109 primary data records. [2025-09-19T22:21:42.386073] [DEBUG] [LOCAL ] IOT: Derivative data saved (1820 records). [2025-09-19T22:21:42.386311] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-19T22:21:42.389269] [INFO ] [MAIN ] Derivative Progress: 969/2093 symbols completed. IOT took 1.2s. Estimated remaining: 7m 16s. Rate: 154.6 symbols/min [2025-09-19T22:21:42.424753] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:42.694913] [DEBUG] [LOCAL ] IPI: Loaded 21673 existing records from primary storage. [2025-09-19T22:21:42.695991] [INFO ] [MAIN ] IPI: Loaded 21673 primary data records. [2025-09-19T22:21:42.769330] [DEBUG] [LOCAL ] IPG: Loaded 54113 existing records from primary storage. [2025-09-19T22:21:42.815584] [INFO ] [MAIN ] IPG: Loaded 54113 primary data records. [2025-09-19T22:21:43.328559] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:43.330348] [INFO ] [MAIN ] IP: Generated 1820 derivative records from 54109 primary records. [2025-09-19T22:21:43.330687] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-19T22:21:43.353775] [DEBUG] [LOCAL ] IP: Derivative data saved (1820 records). [2025-09-19T22:21:43.354223] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-19T22:21:43.356531] [INFO ] [MAIN ] Derivative Progress: 970/2093 symbols completed. IP took 1.3s. Estimated remaining: 7m 17s. Rate: 154.3 symbols/min [2025-09-19T22:21:43.357377] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:43.374732] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:43.375516] [INFO ] [MAIN ] IPI: Generated 1820 derivative records from 21673 primary records. [2025-09-19T22:21:43.375773] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-19T22:21:43.412581] [DEBUG] [LOCAL ] IPI: Derivative data saved (1820 records). [2025-09-19T22:21:43.404228] [DEBUG] [LOCAL ] IQI: Loaded 18200 existing records from primary storage. [2025-09-19T22:21:43.417301] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-19T22:21:43.420080] [INFO ] [MAIN ] Derivative Progress: 971/2093 symbols completed. IPI took 1.0s. Estimated remaining: 7m 16s. Rate: 154.5 symbols/min [2025-09-19T22:21:43.417849] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:43.421290] [INFO ] [MAIN ] IPG: Generated 1820 derivative records from 54113 primary records. [2025-09-19T22:21:43.420509] [INFO ] [MAIN ] IQI: Loaded 18200 primary data records. [2025-09-19T22:21:43.421487] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-19T22:21:43.420401] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:43.584018] [DEBUG] [LOCAL ] IPG: Derivative data saved (1820 records). [2025-09-19T22:21:43.600806] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-19T22:21:43.622399] [INFO ] [MAIN ] Derivative Progress: 972/2093 symbols completed. IPG took 1.3s. Estimated remaining: 7m 15s. Rate: 154.5 symbols/min [2025-09-19T22:21:43.626543] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:43.782971] [DEBUG] [LOCAL ] IQV: Loaded 51146 existing records from primary storage. [2025-09-19T22:21:43.783366] [INFO ] [MAIN ] IQV: Loaded 51146 primary data records. [2025-09-19T22:21:43.917245] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:43.918552] [INFO ] [MAIN ] IQI: Generated 1820 derivative records from 18200 primary records. [2025-09-19T22:21:43.945565] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-19T22:21:44.020152] [DEBUG] [LOCAL ] IR: Loaded 53476 existing records from primary storage. [2025-09-19T22:21:44.204078] [INFO ] [MAIN ] IR: Loaded 53476 primary data records. [2025-09-19T22:21:44.302013] [DEBUG] [LOCAL ] IQI: Derivative data saved (1820 records). [2025-09-19T22:21:44.342291] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-19T22:21:44.363368] [INFO ] [MAIN ] Derivative Progress: 973/2093 symbols completed. IQI took 1.0s. Estimated remaining: 7m 15s. Rate: 154.4 symbols/min [2025-09-19T22:21:44.719142] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:44.720442] [INFO ] [MAIN ] IQV: Generated 1820 derivative records from 51146 primary records. [2025-09-19T22:21:44.721030] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-19T22:21:44.752536] [DEBUG] [LOCAL ] IQV: Derivative data saved (1820 records). [2025-09-19T22:21:44.753127] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-19T22:21:44.756180] [INFO ] [MAIN ] Derivative Progress: 974/2093 symbols completed. IQV took 1.3s. Estimated remaining: 7m 15s. Rate: 154.4 symbols/min [2025-09-19T22:21:44.777254] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:44.778039] [INFO ] [MAIN ] IR: Generated 1820 derivative records from 53476 primary records. [2025-09-19T22:21:44.778106] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-19T22:21:44.799354] [DEBUG] [LOCAL ] IR: Derivative data saved (1820 records). [2025-09-19T22:21:44.799515] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-19T22:21:44.802346] [INFO ] [MAIN ] Derivative Progress: 975/2093 symbols completed. IR took 1.2s. Estimated remaining: 7m 14s. Rate: 154.5 symbols/min [2025-09-19T22:21:44.803159] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:44.803390] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:44.804125] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:44.841687] [DEBUG] [LOCAL ] IRS: Loaded 21712 existing records from primary storage. [2025-09-19T22:21:44.841972] [INFO ] [MAIN ] IRS: Loaded 21712 primary data records. [2025-09-19T22:21:45.099936] [DEBUG] [LOCAL ] IRM: Loaded 50281 existing records from primary storage. [2025-09-19T22:21:45.100224] [INFO ] [MAIN ] IRM: Loaded 50281 primary data records. [2025-09-19T22:21:45.101729] [DEBUG] [LOCAL ] IRT: Loaded 51127 existing records from primary storage. [2025-09-19T22:21:45.112290] [INFO ] [MAIN ] IRT: Loaded 51127 primary data records. [2025-09-19T22:21:46.028267] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:46.029198] [INFO ] [MAIN ] IRS: Generated 1820 derivative records from 21712 primary records. [2025-09-19T22:21:46.029639] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-19T22:21:46.049891] [DEBUG] [LOCAL ] IRS: Derivative data saved (1820 records). [2025-09-19T22:21:46.062799] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-19T22:21:46.064878] [INFO ] [MAIN ] Derivative Progress: 976/2093 symbols completed. IRS took 1.3s. Estimated remaining: 7m 15s. Rate: 154.2 symbols/min [2025-09-19T22:21:46.065231] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:46.078081] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:46.079389] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:46.079037] [INFO ] [MAIN ] IRM: Generated 1820 derivative records from 50281 primary records. [2025-09-19T22:21:46.079508] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-19T22:21:46.080099] [INFO ] [MAIN ] IRT: Generated 1820 derivative records from 51127 primary records. [2025-09-19T22:21:46.081005] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-19T22:21:46.114988] [DEBUG] [LOCAL ] IRT: Derivative data saved (1820 records). [2025-09-19T22:21:46.116207] [DEBUG] [LOCAL ] IRM: Derivative data saved (1820 records). [2025-09-19T22:21:46.116295] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-19T22:21:46.118750] [INFO ] [MAIN ] Derivative Progress: 977/2093 symbols completed. IRM took 1.3s. Estimated remaining: 7m 14s. Rate: 154.3 symbols/min [2025-09-19T22:21:46.116385] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-19T22:21:46.122506] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:46.122380] [INFO ] [MAIN ] Derivative Progress: 978/2093 symbols completed. IRT took 1.3s. Estimated remaining: 7m 13s. Rate: 154.5 symbols/min [2025-09-19T22:21:46.128233] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:46.129004] [DEBUG] [LOCAL ] ISD: Loaded 16019 existing records from primary storage. [2025-09-19T22:21:46.129306] [INFO ] [MAIN ] ISD: Loaded 16019 primary data records. [2025-09-19T22:21:46.531401] [DEBUG] [LOCAL ] ITGR: Loaded 32189 existing records from primary storage. [2025-09-19T22:21:46.532490] [INFO ] [MAIN ] ITGR: Loaded 32189 primary data records. [2025-09-19T22:21:46.534901] [DEBUG] [LOCAL ] IT: Loaded 41777 existing records from primary storage. [2025-09-19T22:21:46.535707] [INFO ] [MAIN ] IT: Loaded 41777 primary data records. [2025-09-19T22:21:47.173887] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:47.176442] [INFO ] [MAIN ] ISD: Generated 1820 derivative records from 16019 primary records. [2025-09-19T22:21:47.177498] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-19T22:21:47.197593] [DEBUG] [LOCAL ] ISD: Derivative data saved (1820 records). [2025-09-19T22:21:47.197894] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-19T22:21:47.200093] [INFO ] [MAIN ] Derivative Progress: 979/2093 symbols completed. ISD took 1.1s. Estimated remaining: 7m 13s. Rate: 154.2 symbols/min [2025-09-19T22:21:47.200413] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:47.222700] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:47.226170] [INFO ] [MAIN ] ITGR: Generated 1820 derivative records from 32189 primary records. [2025-09-19T22:21:47.226483] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-19T22:21:47.256189] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:47.258421] [INFO ] [MAIN ] IT: Generated 1820 derivative records from 41777 primary records. [2025-09-19T22:21:47.261686] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-19T22:21:47.262534] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1820 records). [2025-09-19T22:21:47.262674] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-19T22:21:47.264902] [INFO ] [MAIN ] Derivative Progress: 980/2093 symbols completed. ITGR took 1.1s. Estimated remaining: 7m 13s. Rate: 154.3 symbols/min [2025-09-19T22:21:47.272778] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:47.296215] [DEBUG] [LOCAL ] IT: Derivative data saved (1820 records). [2025-09-19T22:21:47.296359] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-19T22:21:47.299039] [INFO ] [MAIN ] Derivative Progress: 981/2093 symbols completed. IT took 1.2s. Estimated remaining: 7m 12s. Rate: 154.5 symbols/min [2025-09-19T22:21:47.299544] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:47.321579] [DEBUG] [LOCAL ] ITUB: Loaded 54074 existing records from primary storage. [2025-09-19T22:21:47.321889] [INFO ] [MAIN ] ITUB: Loaded 54074 primary data records. [2025-09-19T22:21:47.665912] [DEBUG] [LOCAL ] ITW: Loaded 47147 existing records from primary storage. [2025-09-19T22:21:47.666159] [INFO ] [MAIN ] ITW: Loaded 47147 primary data records. [2025-09-19T22:21:47.735809] [DEBUG] [LOCAL ] IVR: Loaded 48461 existing records from primary storage. [2025-09-19T22:21:47.745608] [INFO ] [MAIN ] IVR: Loaded 48461 primary data records. [2025-09-19T22:21:48.333415] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:48.336967] [INFO ] [MAIN ] ITUB: Generated 1820 derivative records from 54074 primary records. [2025-09-19T22:21:48.337110] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-19T22:21:48.356750] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1820 records). [2025-09-19T22:21:48.357074] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-19T22:21:48.359403] [INFO ] [MAIN ] Derivative Progress: 982/2093 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 12s. Rate: 154.2 symbols/min [2025-09-19T22:21:48.360547] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:48.380756] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:48.381773] [INFO ] [MAIN ] ITW: Generated 1820 derivative records from 47147 primary records. [2025-09-19T22:21:48.382394] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-19T22:21:48.412237] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:48.422221] [INFO ] [MAIN ] IVR: Generated 1820 derivative records from 48461 primary records. [2025-09-19T22:21:48.422634] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-19T22:21:48.424625] [DEBUG] [LOCAL ] ITW: Derivative data saved (1820 records). [2025-09-19T22:21:48.425615] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-19T22:21:48.427926] [INFO ] [MAIN ] Derivative Progress: 983/2093 symbols completed. ITW took 1.2s. Estimated remaining: 7m 12s. Rate: 154.3 symbols/min [2025-09-19T22:21:48.436870] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:48.455201] [DEBUG] [LOCAL ] IVT: Loaded 31539 existing records from primary storage. [2025-09-19T22:21:48.456070] [DEBUG] [LOCAL ] IVR: Derivative data saved (1820 records). [2025-09-19T22:21:48.456361] [INFO ] [MAIN ] IVT: Loaded 31539 primary data records. [2025-09-19T22:21:48.456273] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-19T22:21:48.458773] [INFO ] [MAIN ] Derivative Progress: 984/2093 symbols completed. IVR took 1.2s. Estimated remaining: 7m 11s. Rate: 154.5 symbols/min [2025-09-19T22:21:48.459299] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:48.829408] [DEBUG] [LOCAL ] IX: Loaded 23105 existing records from primary storage. [2025-09-19T22:21:48.829606] [INFO ] [MAIN ] IX: Loaded 23105 primary data records. [2025-09-19T22:21:48.943965] [DEBUG] [LOCAL ] IVZ: Loaded 53923 existing records from primary storage. [2025-09-19T22:21:48.955683] [INFO ] [MAIN ] IVZ: Loaded 53923 primary data records. [2025-09-19T22:21:49.500829] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:49.502698] [INFO ] [MAIN ] IVT: Generated 1820 derivative records from 31539 primary records. [2025-09-19T22:21:49.503438] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-19T22:21:49.525497] [DEBUG] [LOCAL ] IVT: Derivative data saved (1820 records). [2025-09-19T22:21:49.527196] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-19T22:21:49.530425] [INFO ] [MAIN ] Derivative Progress: 985/2093 symbols completed. IVT took 1.2s. Estimated remaining: 7m 11s. Rate: 154.2 symbols/min [2025-09-19T22:21:49.532045] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:49.546431] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:49.547405] [INFO ] [MAIN ] IX: Generated 1820 derivative records from 23105 primary records. [2025-09-19T22:21:49.547501] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-19T22:21:49.582689] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:49.583535] [INFO ] [MAIN ] IVZ: Generated 1820 derivative records from 53923 primary records. [2025-09-19T22:21:49.583750] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-19T22:21:49.582459] [DEBUG] [LOCAL ] IX: Derivative data saved (1820 records). [2025-09-19T22:21:49.583841] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-19T22:21:49.586394] [INFO ] [MAIN ] Derivative Progress: 986/2093 symbols completed. IX took 1.1s. Estimated remaining: 7m 10s. Rate: 154.3 symbols/min [2025-09-19T22:21:49.594977] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:49.613076] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1820 records). [2025-09-19T22:21:49.613413] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-19T22:21:49.616065] [INFO ] [MAIN ] Derivative Progress: 987/2093 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 10s. Rate: 154.5 symbols/min [2025-09-19T22:21:49.616505] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:49.633414] [DEBUG] [LOCAL ] J: Loaded 41236 existing records from primary storage. [2025-09-19T22:21:49.633778] [INFO ] [MAIN ] J: Loaded 41236 primary data records. [2025-09-19T22:21:49.979488] [DEBUG] [LOCAL ] JBGS: Loaded 43083 existing records from primary storage. [2025-09-19T22:21:49.979888] [INFO ] [MAIN ] JBGS: Loaded 43083 primary data records. [2025-09-19T22:21:49.991936] [DEBUG] [LOCAL ] JBI: Loaded 44819 existing records from primary storage. [2025-09-19T22:21:50.013100] [INFO ] [MAIN ] JBI: Loaded 44819 primary data records. [2025-09-19T22:21:50.692672] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:50.693865] [INFO ] [MAIN ] J: Generated 1820 derivative records from 41236 primary records. [2025-09-19T22:21:50.694128] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-19T22:21:50.718853] [DEBUG] [LOCAL ] J: Derivative data saved (1820 records). [2025-09-19T22:21:50.719168] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-19T22:21:50.721872] [INFO ] [MAIN ] Derivative Progress: 988/2093 symbols completed. J took 1.2s. Estimated remaining: 7m 10s. Rate: 154.2 symbols/min [2025-09-19T22:21:50.742301] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:50.743207] [INFO ] [MAIN ] JBGS: Generated 1820 derivative records from 43083 primary records. [2025-09-19T22:21:50.755275] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-19T22:21:50.755467] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:50.756456] [INFO ] [MAIN ] JBI: Generated 1820 derivative records from 44819 primary records. [2025-09-19T22:21:50.756809] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-19T22:21:50.786983] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1820 records). [2025-09-19T22:21:50.788051] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-19T22:21:50.787950] [DEBUG] [LOCAL ] JBI: Derivative data saved (1820 records). [2025-09-19T22:21:50.790246] [INFO ] [MAIN ] Derivative Progress: 989/2093 symbols completed. JBGS took 1.2s. Estimated remaining: 7m 9s. Rate: 154.3 symbols/min [2025-09-19T22:21:50.790493] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-19T22:21:50.793336] [INFO ] [MAIN ] Derivative Progress: 990/2093 symbols completed. JBI took 1.2s. Estimated remaining: 7m 8s. Rate: 154.5 symbols/min [2025-09-19T22:21:50.793984] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:50.794368] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:50.793927] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:50.803821] [DEBUG] [LOCAL ] JCE: Loaded 6521 existing records from primary storage. [2025-09-19T22:21:50.803962] [INFO ] [MAIN ] JCE: Loaded 6521 primary data records. [2025-09-19T22:21:50.991685] [DEBUG] [LOCAL ] JBND: Loaded 25580 existing records from primary storage. [2025-09-19T22:21:51.007817] [INFO ] [MAIN ] JBND: Loaded 25580 primary data records. [2025-09-19T22:21:51.277471] [DEBUG] [LOCAL ] JBL: Loaded 49097 existing records from primary storage. [2025-09-19T22:21:51.279509] [INFO ] [MAIN ] JBL: Loaded 49097 primary data records. [2025-09-19T22:21:51.821634] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:51.823775] [INFO ] [MAIN ] JCE: Generated 1820 derivative records from 6521 primary records. [2025-09-19T22:21:51.824125] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-19T22:21:51.846718] [DEBUG] [LOCAL ] JCE: Derivative data saved (1820 records). [2025-09-19T22:21:51.847000] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-19T22:21:51.850347] [INFO ] [MAIN ] Derivative Progress: 991/2093 symbols completed. JCE took 1.1s. Estimated remaining: 7m 9s. Rate: 154.2 symbols/min [2025-09-19T22:21:51.851230] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:51.871963] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:51.875186] [INFO ] [MAIN ] JBND: Generated 1820 derivative records from 25580 primary records. [2025-09-19T22:21:51.875833] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-19T22:21:51.889268] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:51.890467] [INFO ] [MAIN ] JBL: Generated 1820 derivative records from 49097 primary records. [2025-09-19T22:21:51.890857] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-19T22:21:51.907632] [DEBUG] [LOCAL ] JBND: Derivative data saved (1820 records). [2025-09-19T22:21:51.907861] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-19T22:21:51.910228] [INFO ] [MAIN ] Derivative Progress: 992/2093 symbols completed. JBND took 1.1s. Estimated remaining: 7m 8s. Rate: 154.3 symbols/min [2025-09-19T22:21:51.918193] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:51.928291] [DEBUG] [LOCAL ] JBL: Derivative data saved (1820 records). [2025-09-19T22:21:51.928439] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-19T22:21:51.931605] [INFO ] [MAIN ] Derivative Progress: 993/2093 symbols completed. JBL took 1.1s. Estimated remaining: 7m 7s. Rate: 154.5 symbols/min [2025-09-19T22:21:51.932064] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:51.972488] [DEBUG] [LOCAL ] JCI: Loaded 54330 existing records from primary storage. [2025-09-19T22:21:51.972759] [INFO ] [MAIN ] JCI: Loaded 54330 primary data records. [2025-09-19T22:21:52.323178] [DEBUG] [LOCAL ] JELD: Loaded 46906 existing records from primary storage. [2025-09-19T22:21:52.323457] [INFO ] [MAIN ] JELD: Loaded 46906 primary data records. [2025-09-19T22:21:52.341630] [DEBUG] [LOCAL ] JEF: Loaded 50767 existing records from primary storage. [2025-09-19T22:21:52.368035] [INFO ] [MAIN ] JEF: Loaded 50767 primary data records. [2025-09-19T22:21:53.056490] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:53.058113] [INFO ] [MAIN ] JCI: Generated 1820 derivative records from 54330 primary records. [2025-09-19T22:21:53.058534] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-19T22:21:53.078710] [DEBUG] [LOCAL ] JCI: Derivative data saved (1820 records). [2025-09-19T22:21:53.080419] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-19T22:21:53.084135] [INFO ] [MAIN ] Derivative Progress: 994/2093 symbols completed. JCI took 1.2s. Estimated remaining: 7m 8s. Rate: 154.2 symbols/min [2025-09-19T22:21:53.084950] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:53.099493] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:53.100694] [INFO ] [MAIN ] JELD: Generated 1820 derivative records from 46906 primary records. [2025-09-19T22:21:53.100949] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-19T22:21:53.134090] [DEBUG] [LOCAL ] JEQ: Loaded 9163 existing records from primary storage. [2025-09-19T22:21:53.138193] [DEBUG] [LOCAL ] JELD: Derivative data saved (1820 records). [2025-09-19T22:21:53.138295] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-19T22:21:53.140859] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:53.140450] [INFO ] [MAIN ] Derivative Progress: 995/2093 symbols completed. JELD took 1.2s. Estimated remaining: 7m 7s. Rate: 154.3 symbols/min [2025-09-19T22:21:53.138125] [INFO ] [MAIN ] JEQ: Loaded 9163 primary data records. [2025-09-19T22:21:53.141633] [INFO ] [MAIN ] JEF: Generated 1820 derivative records from 50767 primary records. [2025-09-19T22:21:53.141907] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:53.142108] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-19T22:21:53.236797] [DEBUG] [LOCAL ] JEF: Derivative data saved (1820 records). [2025-09-19T22:21:53.262257] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-19T22:21:53.273733] [INFO ] [MAIN ] Derivative Progress: 996/2093 symbols completed. JEF took 1.4s. Estimated remaining: 7m 6s. Rate: 154.4 symbols/min [2025-09-19T22:21:53.279129] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:53.513031] [DEBUG] [LOCAL ] JGH: Loaded 11148 existing records from primary storage. [2025-09-19T22:21:53.513370] [INFO ] [MAIN ] JGH: Loaded 11148 primary data records. [2025-09-19T22:21:53.514300] [DEBUG] [LOCAL ] JFR: Loaded 31079 existing records from primary storage. [2025-09-19T22:21:53.519804] [INFO ] [MAIN ] JFR: Loaded 31079 primary data records. [2025-09-19T22:21:54.195669] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:54.197046] [INFO ] [MAIN ] JEQ: Generated 1820 derivative records from 9163 primary records. [2025-09-19T22:21:54.197342] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-19T22:21:54.216477] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1820 records). [2025-09-19T22:21:54.216943] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-19T22:21:54.219203] [INFO ] [MAIN ] Derivative Progress: 997/2093 symbols completed. JEQ took 1.1s. Estimated remaining: 7m 6s. Rate: 154.2 symbols/min [2025-09-19T22:21:54.219688] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:54.242157] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:54.250922] [INFO ] [MAIN ] JGH: Generated 1820 derivative records from 11148 primary records. [2025-09-19T22:21:54.256665] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:54.256724] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-19T22:21:54.257457] [INFO ] [MAIN ] JFR: Generated 1820 derivative records from 31079 primary records. [2025-09-19T22:21:54.258268] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-19T22:21:54.289722] [DEBUG] [LOCAL ] JFR: Derivative data saved (1820 records). [2025-09-19T22:21:54.290376] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-19T22:21:54.293299] [INFO ] [MAIN ] Derivative Progress: 998/2093 symbols completed. JFR took 1.2s. Estimated remaining: 7m 6s. Rate: 154.3 symbols/min [2025-09-19T22:21:54.294335] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:54.295086] [DEBUG] [LOCAL ] JGH: Derivative data saved (1820 records). [2025-09-19T22:21:54.295597] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-19T22:21:54.298055] [INFO ] [MAIN ] Derivative Progress: 999/2093 symbols completed. JGH took 1.0s. Estimated remaining: 7m 5s. Rate: 154.5 symbols/min [2025-09-19T22:21:54.310905] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:54.315745] [DEBUG] [LOCAL ] JHI: Loaded 3819 existing records from primary storage. [2025-09-19T22:21:54.316576] [INFO ] [MAIN ] JHI: Loaded 3819 primary data records. [2025-09-19T22:21:54.380825] [DEBUG] [LOCAL ] JHS: Loaded 2951 existing records from primary storage. [2025-09-19T22:21:54.418678] [INFO ] [MAIN ] JHS: Loaded 2951 primary data records. [2025-09-19T22:21:54.465433] [DEBUG] [LOCAL ] JHG: Loaded 48849 existing records from primary storage. [2025-09-19T22:21:54.497210] [INFO ] [MAIN ] JHG: Loaded 48849 primary data records. [2025-09-19T22:21:55.364976] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:55.367475] [INFO ] [MAIN ] JHI: Generated 1820 derivative records from 3819 primary records. [2025-09-19T22:21:55.367983] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-19T22:21:55.382494] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:55.398637] [INFO ] [MAIN ] JHS: Generated 1820 derivative records from 2951 primary records. [2025-09-19T22:21:55.399963] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-19T22:21:55.405587] [DEBUG] [LOCAL ] JHI: Derivative data saved (1820 records). [2025-09-19T22:21:55.405810] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-19T22:21:55.408817] [INFO ] [MAIN ] Derivative Progress: 1000/2093 symbols completed. JHI took 1.1s. Estimated remaining: 7m 5s. Rate: 154.2 symbols/min [2025-09-19T22:21:55.417060] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:55.437882] [DEBUG] [LOCAL ] JHS: Derivative data saved (1820 records). [2025-09-19T22:21:55.438552] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-19T22:21:55.438485] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:55.441319] [INFO ] [MAIN ] Derivative Progress: 1001/2093 symbols completed. JHS took 1.1s. Estimated remaining: 7m 5s. Rate: 154.3 symbols/min [2025-09-19T22:21:55.441588] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:55.442508] [INFO ] [MAIN ] JHG: Generated 1820 derivative records from 48849 primary records. [2025-09-19T22:21:55.442960] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-19T22:21:55.460108] [DEBUG] [LOCAL ] JHG: Derivative data saved (1820 records). [2025-09-19T22:21:55.460281] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-19T22:21:55.463067] [INFO ] [MAIN ] Derivative Progress: 1002/2093 symbols completed. JHG took 1.2s. Estimated remaining: 7m 4s. Rate: 154.5 symbols/min [2025-09-19T22:21:55.467848] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:55.476813] [DEBUG] [LOCAL ] JILL: Loaded 16934 existing records from primary storage. [2025-09-19T22:21:55.477974] [INFO ] [MAIN ] JILL: Loaded 16934 primary data records. [2025-09-19T22:21:55.629441] [DEBUG] [LOCAL ] JHX: Loaded 49724 existing records from primary storage. [2025-09-19T22:21:55.659394] [INFO ] [MAIN ] JHX: Loaded 49724 primary data records. [2025-09-19T22:21:55.864428] [DEBUG] [LOCAL ] JKS: Loaded 40779 existing records from primary storage. [2025-09-19T22:21:55.883979] [INFO ] [MAIN ] JKS: Loaded 40779 primary data records. [2025-09-19T22:21:56.465070] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:56.465858] [INFO ] [MAIN ] JILL: Generated 1820 derivative records from 16934 primary records. [2025-09-19T22:21:56.466041] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-19T22:21:56.488075] [DEBUG] [LOCAL ] JILL: Derivative data saved (1820 records). [2025-09-19T22:21:56.488620] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-19T22:21:56.491007] [INFO ] [MAIN ] Derivative Progress: 1003/2093 symbols completed. JILL took 1.0s. Estimated remaining: 7m 4s. Rate: 154.2 symbols/min [2025-09-19T22:21:56.504629] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:56.505515] [INFO ] [MAIN ] JHX: Generated 1820 derivative records from 49724 primary records. [2025-09-19T22:21:56.505846] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-19T22:21:56.523941] [DEBUG] [LOCAL ] JHX: Derivative data saved (1820 records). [2025-09-19T22:21:56.524704] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-19T22:21:56.527159] [INFO ] [MAIN ] Derivative Progress: 1004/2093 symbols completed. JHX took 1.1s. Estimated remaining: 7m 3s. Rate: 154.4 symbols/min [2025-09-19T22:21:56.539747] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:56.540289] [INFO ] [MAIN ] JKS: Generated 1820 derivative records from 40779 primary records. [2025-09-19T22:21:56.540352] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-19T22:21:56.556106] [DEBUG] [LOCAL ] JKS: Derivative data saved (1820 records). [2025-09-19T22:21:56.556171] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-19T22:21:56.558453] [INFO ] [MAIN ] Derivative Progress: 1005/2093 symbols completed. JKS took 1.1s. Estimated remaining: 7m 3s. Rate: 154.5 symbols/min [2025-09-19T22:21:56.559016] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:56.559157] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:56.559371] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:56.567590] [DEBUG] [LOCAL ] JLS: Loaded 4152 existing records from primary storage. [2025-09-19T22:21:56.567844] [INFO ] [MAIN ] JLS: Loaded 4152 primary data records. [2025-09-19T22:21:56.798704] [DEBUG] [LOCAL ] JLL: Loaded 32790 existing records from primary storage. [2025-09-19T22:21:56.798901] [INFO ] [MAIN ] JLL: Loaded 32790 primary data records. [2025-09-19T22:21:56.998022] [DEBUG] [LOCAL ] JMIA: Loaded 51198 existing records from primary storage. [2025-09-19T22:21:57.021225] [INFO ] [MAIN ] JMIA: Loaded 51198 primary data records. [2025-09-19T22:21:57.627779] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:57.628929] [INFO ] [MAIN ] JLS: Generated 1820 derivative records from 4152 primary records. [2025-09-19T22:21:57.629033] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-19T22:21:57.646873] [DEBUG] [LOCAL ] JLS: Derivative data saved (1820 records). [2025-09-19T22:21:57.647812] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-19T22:21:57.650361] [INFO ] [MAIN ] Derivative Progress: 1006/2093 symbols completed. JLS took 1.1s. Estimated remaining: 7m 3s. Rate: 154.2 symbols/min [2025-09-19T22:21:57.650793] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:57.677944] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:57.679233] [INFO ] [MAIN ] JLL: Generated 1820 derivative records from 32790 primary records. [2025-09-19T22:21:57.679548] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-19T22:21:57.701946] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:57.705487] [INFO ] [MAIN ] JMIA: Generated 1820 derivative records from 51198 primary records. [2025-09-19T22:21:57.706885] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-19T22:21:57.740197] [DEBUG] [LOCAL ] JLL: Derivative data saved (1820 records). [2025-09-19T22:21:57.741730] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-19T22:21:57.741612] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1820 records). [2025-09-19T22:21:57.744201] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-19T22:21:57.743939] [INFO ] [MAIN ] Derivative Progress: 1007/2093 symbols completed. JLL took 1.2s. Estimated remaining: 7m 2s. Rate: 154.3 symbols/min [2025-09-19T22:21:57.747361] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:57.747428] [INFO ] [MAIN ] Derivative Progress: 1008/2093 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 1s. Rate: 154.5 symbols/min [2025-09-19T22:21:57.748030] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:57.771787] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-09-19T22:21:57.771946] [INFO ] [MAIN ] JNJ: Loaded 54533 primary data records. [2025-09-19T22:21:57.946043] [DEBUG] [LOCAL ] JOE: Loaded 25189 existing records from primary storage. [2025-09-19T22:21:57.976078] [INFO ] [MAIN ] JOE: Loaded 25189 primary data records. [2025-09-19T22:21:58.228324] [DEBUG] [LOCAL ] JOBY: Loaded 54578 existing records from primary storage. [2025-09-19T22:21:58.234708] [INFO ] [MAIN ] JOBY: Loaded 54578 primary data records. [2025-09-19T22:21:58.807851] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:58.809102] [INFO ] [MAIN ] JNJ: Generated 1820 derivative records from 54533 primary records. [2025-09-19T22:21:58.809342] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-19T22:21:58.828236] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1820 records). [2025-09-19T22:21:58.828772] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-19T22:21:58.830741] [INFO ] [MAIN ] Derivative Progress: 1009/2093 symbols completed. JNJ took 1.2s. Estimated remaining: 7m 2s. Rate: 154.2 symbols/min [2025-09-19T22:21:58.832110] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:58.851745] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:58.852556] [INFO ] [MAIN ] JOE: Generated 1820 derivative records from 25189 primary records. [2025-09-19T22:21:58.852801] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-19T22:21:58.857262] [DEBUG] [LOCAL ] JOF: Loaded 7259 existing records from primary storage. [2025-09-19T22:21:58.868358] [INFO ] [MAIN ] JOF: Loaded 7259 primary data records. [2025-09-19T22:21:58.931352] [DEBUG] [LOCAL ] JOE: Derivative data saved (1820 records). [2025-09-19T22:21:58.941388] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-19T22:21:58.992337] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:58.991935] [INFO ] [MAIN ] Derivative Progress: 1010/2093 symbols completed. JOE took 1.2s. Estimated remaining: 7m 1s. Rate: 154.3 symbols/min [2025-09-19T22:21:59.000869] [INFO ] [MAIN ] JOBY: Generated 1820 derivative records from 54578 primary records. [2025-09-19T22:21:59.004907] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-19T22:21:59.004806] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:59.101732] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1820 records). [2025-09-19T22:21:59.101876] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-19T22:21:59.225564] [INFO ] [MAIN ] Derivative Progress: 1011/2093 symbols completed. JOBY took 1.5s. Estimated remaining: 7m 1s. Rate: 154.4 symbols/min [2025-09-19T22:21:59.226371] [INFO ] [MAIN ] JPI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:59.247271] [DEBUG] [LOCAL ] JPI: Loaded 5528 existing records from primary storage. [2025-09-19T22:21:59.247843] [INFO ] [MAIN ] JPI: Loaded 5528 primary data records. [2025-09-19T22:21:59.329602] [DEBUG] [LOCAL ] JPC: Loaded 37802 existing records from primary storage. [2025-09-19T22:21:59.359472] [INFO ] [MAIN ] JPC: Loaded 37802 primary data records. [2025-09-19T22:21:59.733964] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:59.761736] [INFO ] [MAIN ] JOF: Generated 1820 derivative records from 7259 primary records. [2025-09-19T22:21:59.780990] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-19T22:21:59.950101] [DEBUG] [LOCAL ] JOF: Derivative data saved (1820 records). [2025-09-19T22:21:59.950592] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-19T22:21:59.952713] [INFO ] [MAIN ] Derivative Progress: 1012/2093 symbols completed. JOF took 1.1s. Estimated remaining: 7m 1s. Rate: 154.2 symbols/min [2025-09-19T22:21:59.954634] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:21:59.976193] [DEBUG] [MAIN ] JPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:21:59.976962] [INFO ] [MAIN ] JPI: Generated 1820 derivative records from 5528 primary records. [2025-09-19T22:21:59.977168] [DEBUG] [LOCAL ] JPI: Saving derivative data. [2025-09-19T22:21:59.994604] [DEBUG] [LOCAL ] JPI: Derivative data saved (1820 records). [2025-09-19T22:21:59.996097] [INFO ] [MAIN ] JPI: Successfully saved derivative data. [2025-09-19T22:21:59.999389] [INFO ] [MAIN ] Derivative Progress: 1013/2093 symbols completed. JPI took 0.8s. Estimated remaining: 6m 60s. Rate: 154.4 symbols/min [2025-09-19T22:22:00.000133] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:00.014388] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:00.015588] [INFO ] [MAIN ] JPC: Generated 1820 derivative records from 37802 primary records. [2025-09-19T22:22:00.015783] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-19T22:22:00.050919] [DEBUG] [LOCAL ] JPC: Derivative data saved (1820 records). [2025-09-19T22:22:00.051127] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-19T22:22:00.054389] [INFO ] [MAIN ] Derivative Progress: 1014/2093 symbols completed. JPC took 1.1s. Estimated remaining: 6m 59s. Rate: 154.5 symbols/min [2025-09-19T22:22:00.054975] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:00.081702] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-09-19T22:22:00.082068] [INFO ] [MAIN ] JPM: Loaded 54574 primary data records. [2025-09-19T22:22:00.199316] [DEBUG] [LOCAL ] JQC: Loaded 34392 existing records from primary storage. [2025-09-19T22:22:00.207593] [INFO ] [MAIN ] JQC: Loaded 34392 primary data records. [2025-09-19T22:22:00.199687] [DEBUG] [LOCAL ] JRI: Loaded 15354 existing records from primary storage. [2025-09-19T22:22:00.207868] [INFO ] [MAIN ] JRI: Loaded 15354 primary data records. [2025-09-19T22:22:01.112297] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:01.113351] [INFO ] [MAIN ] JPM: Generated 1820 derivative records from 54574 primary records. [2025-09-19T22:22:01.113584] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-19T22:22:01.132944] [DEBUG] [LOCAL ] JPM: Derivative data saved (1820 records). [2025-09-19T22:22:01.133976] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-19T22:22:01.138108] [INFO ] [MAIN ] Derivative Progress: 1015/2093 symbols completed. JPM took 1.2s. Estimated remaining: 6m 59s. Rate: 154.2 symbols/min [2025-09-19T22:22:01.138755] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:01.156075] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:01.160720] [INFO ] [MAIN ] JQC: Generated 1820 derivative records from 34392 primary records. [2025-09-19T22:22:01.160863] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-19T22:22:01.175436] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:01.189181] [DEBUG] [LOCAL ] JRS: Loaded 11214 existing records from primary storage. [2025-09-19T22:22:01.191942] [INFO ] [MAIN ] JRS: Loaded 11214 primary data records. [2025-09-19T22:22:01.188875] [INFO ] [MAIN ] JRI: Generated 1820 derivative records from 15354 primary records. [2025-09-19T22:22:01.201441] [DEBUG] [LOCAL ] JQC: Derivative data saved (1820 records). [2025-09-19T22:22:01.201561] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-19T22:22:01.218768] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-19T22:22:01.272892] [INFO ] [MAIN ] Derivative Progress: 1016/2093 symbols completed. JQC took 1.3s. Estimated remaining: 6m 59s. Rate: 154.3 symbols/min [2025-09-19T22:22:01.315397] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:01.457682] [DEBUG] [LOCAL ] JRI: Derivative data saved (1820 records). [2025-09-19T22:22:01.467433] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-19T22:22:01.470417] [INFO ] [MAIN ] Derivative Progress: 1017/2093 symbols completed. JRI took 1.4s. Estimated remaining: 6m 58s. Rate: 154.4 symbols/min [2025-09-19T22:22:01.499857] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:01.650984] [DEBUG] [LOCAL ] JXN: Loaded 46816 existing records from primary storage. [2025-09-19T22:22:01.651442] [INFO ] [MAIN ] JXN: Loaded 46816 primary data records. [2025-09-19T22:22:01.871004] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:01.882010] [INFO ] [MAIN ] JRS: Generated 1820 derivative records from 11214 primary records. [2025-09-19T22:22:01.893684] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-19T22:22:02.052318] [DEBUG] [LOCAL ] K: Loaded 50518 existing records from primary storage. [2025-09-19T22:22:02.080106] [INFO ] [MAIN ] K: Loaded 50518 primary data records. [2025-09-19T22:22:02.084583] [DEBUG] [LOCAL ] JRS: Derivative data saved (1820 records). [2025-09-19T22:22:02.096003] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-19T22:22:02.118075] [INFO ] [MAIN ] Derivative Progress: 1018/2093 symbols completed. JRS took 1.0s. Estimated remaining: 6m 58s. Rate: 154.3 symbols/min [2025-09-19T22:22:02.415950] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:02.416998] [INFO ] [MAIN ] JXN: Generated 1820 derivative records from 46816 primary records. [2025-09-19T22:22:02.417374] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-19T22:22:02.435391] [DEBUG] [LOCAL ] JXN: Derivative data saved (1820 records). [2025-09-19T22:22:02.435683] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-19T22:22:02.438122] [INFO ] [MAIN ] Derivative Progress: 1019/2093 symbols completed. JXN took 1.1s. Estimated remaining: 6m 58s. Rate: 154.3 symbols/min [2025-09-19T22:22:02.453339] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:02.453926] [INFO ] [MAIN ] K: Generated 1820 derivative records from 50518 primary records. [2025-09-19T22:22:02.453988] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-19T22:22:02.469167] [DEBUG] [LOCAL ] K: Derivative data saved (1820 records). [2025-09-19T22:22:02.469225] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-19T22:22:02.471283] [INFO ] [MAIN ] Derivative Progress: 1020/2093 symbols completed. K took 1.0s. Estimated remaining: 6m 57s. Rate: 154.5 symbols/min [2025-09-19T22:22:02.472054] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:02.472200] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:02.472428] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:02.489123] [DEBUG] [LOCAL ] KAI: Loaded 13884 existing records from primary storage. [2025-09-19T22:22:02.494788] [INFO ] [MAIN ] KAI: Loaded 13884 primary data records. [2025-09-19T22:22:02.626102] [DEBUG] [LOCAL ] KB: Loaded 24706 existing records from primary storage. [2025-09-19T22:22:02.648456] [DEBUG] [LOCAL ] KAR: Loaded 40650 existing records from primary storage. [2025-09-19T22:22:02.667131] [INFO ] [MAIN ] KB: Loaded 24706 primary data records. [2025-09-19T22:22:02.694131] [INFO ] [MAIN ] KAR: Loaded 40650 primary data records. [2025-09-19T22:22:03.522942] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:03.531761] [INFO ] [MAIN ] KAI: Generated 1820 derivative records from 13884 primary records. [2025-09-19T22:22:03.537220] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:03.537937] [INFO ] [MAIN ] KB: Generated 1820 derivative records from 24706 primary records. [2025-09-19T22:22:03.538034] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-19T22:22:03.538239] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-19T22:22:03.567046] [DEBUG] [LOCAL ] KAI: Derivative data saved (1820 records). [2025-09-19T22:22:03.567403] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-19T22:22:03.569774] [INFO ] [MAIN ] Derivative Progress: 1021/2093 symbols completed. KAI took 1.1s. Estimated remaining: 6m 57s. Rate: 154.2 symbols/min [2025-09-19T22:22:03.570555] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:03.590530] [DEBUG] [LOCAL ] KB: Derivative data saved (1820 records). [2025-09-19T22:22:03.590725] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-19T22:22:03.593584] [INFO ] [MAIN ] Derivative Progress: 1022/2093 symbols completed. KB took 1.1s. Estimated remaining: 6m 56s. Rate: 154.3 symbols/min [2025-09-19T22:22:03.594018] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:03.594963] [INFO ] [MAIN ] KAR: Generated 1820 derivative records from 40650 primary records. [2025-09-19T22:22:03.595049] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-19T22:22:03.595725] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:03.623506] [DEBUG] [LOCAL ] KBDC: Loaded 20999 existing records from primary storage. [2025-09-19T22:22:03.625800] [DEBUG] [LOCAL ] KAR: Derivative data saved (1820 records). [2025-09-19T22:22:03.626046] [INFO ] [MAIN ] KBDC: Loaded 20999 primary data records. [2025-09-19T22:22:03.626140] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-19T22:22:03.640078] [INFO ] [MAIN ] Derivative Progress: 1023/2093 symbols completed. KAR took 1.2s. Estimated remaining: 6m 56s. Rate: 154.5 symbols/min [2025-09-19T22:22:03.658799] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:03.997175] [DEBUG] [LOCAL ] KBH: Loaded 49581 existing records from primary storage. [2025-09-19T22:22:03.997536] [INFO ] [MAIN ] KBH: Loaded 49581 primary data records. [2025-09-19T22:22:04.119227] [DEBUG] [LOCAL ] KBR: Loaded 48981 existing records from primary storage. [2025-09-19T22:22:04.119603] [INFO ] [MAIN ] KBR: Loaded 48981 primary data records. [2025-09-19T22:22:04.655070] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:04.656725] [INFO ] [MAIN ] KBDC: Generated 1820 derivative records from 20999 primary records. [2025-09-19T22:22:04.657102] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-19T22:22:04.677572] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1820 records). [2025-09-19T22:22:04.677880] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-19T22:22:04.680312] [INFO ] [MAIN ] Derivative Progress: 1024/2093 symbols completed. KBDC took 1.1s. Estimated remaining: 6m 56s. Rate: 154.2 symbols/min [2025-09-19T22:22:04.680997] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:04.701772] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:04.702829] [INFO ] [MAIN ] KBH: Generated 1820 derivative records from 49581 primary records. [2025-09-19T22:22:04.703067] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-19T22:22:04.734000] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:04.735926] [INFO ] [MAIN ] KBR: Generated 1820 derivative records from 48981 primary records. [2025-09-19T22:22:04.736028] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-19T22:22:04.749501] [DEBUG] [LOCAL ] KBH: Derivative data saved (1820 records). [2025-09-19T22:22:04.752856] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-19T22:22:04.756080] [INFO ] [MAIN ] Derivative Progress: 1025/2093 symbols completed. KBH took 1.2s. Estimated remaining: 6m 55s. Rate: 154.3 symbols/min [2025-09-19T22:22:04.756761] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:04.776957] [DEBUG] [LOCAL ] KBR: Derivative data saved (1820 records). [2025-09-19T22:22:04.777210] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-19T22:22:04.782609] [INFO ] [MAIN ] Derivative Progress: 1026/2093 symbols completed. KBR took 1.1s. Estimated remaining: 6m 54s. Rate: 154.5 symbols/min [2025-09-19T22:22:04.782980] [DEBUG] [LOCAL ] KEN: Loaded 4795 existing records from primary storage. [2025-09-19T22:22:04.783220] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:04.783542] [INFO ] [MAIN ] KEN: Loaded 4795 primary data records. [2025-09-19T22:22:04.919180] [DEBUG] [LOCAL ] KD: Loaded 53065 existing records from primary storage. [2025-09-19T22:22:04.945572] [INFO ] [MAIN ] KD: Loaded 53065 primary data records. [2025-09-19T22:22:05.075969] [DEBUG] [LOCAL ] KEP: Loaded 30662 existing records from primary storage. [2025-09-19T22:22:05.098742] [INFO ] [MAIN ] KEP: Loaded 30662 primary data records. [2025-09-19T22:22:05.808715] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:05.817781] [INFO ] [MAIN ] KEN: Generated 1820 derivative records from 4795 primary records. [2025-09-19T22:22:05.823112] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:05.824014] [INFO ] [MAIN ] KD: Generated 1820 derivative records from 53065 primary records. [2025-09-19T22:22:05.823233] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-19T22:22:05.824226] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-19T22:22:05.855856] [DEBUG] [LOCAL ] KEN: Derivative data saved (1820 records). [2025-09-19T22:22:05.856345] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-19T22:22:05.858922] [INFO ] [MAIN ] Derivative Progress: 1027/2093 symbols completed. KEN took 1.1s. Estimated remaining: 6m 55s. Rate: 154.2 symbols/min [2025-09-19T22:22:05.859803] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:05.861078] [DEBUG] [LOCAL ] KD: Derivative data saved (1820 records). [2025-09-19T22:22:05.861296] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-19T22:22:05.863942] [INFO ] [MAIN ] Derivative Progress: 1028/2093 symbols completed. KD took 1.2s. Estimated remaining: 6m 54s. Rate: 154.3 symbols/min [2025-09-19T22:22:05.867160] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:05.883771] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:05.884517] [INFO ] [MAIN ] KEP: Generated 1820 derivative records from 30662 primary records. [2025-09-19T22:22:05.884610] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-19T22:22:05.901025] [DEBUG] [LOCAL ] KEP: Derivative data saved (1820 records). [2025-09-19T22:22:05.901103] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-19T22:22:05.903418] [INFO ] [MAIN ] Derivative Progress: 1029/2093 symbols completed. KEP took 1.1s. Estimated remaining: 6m 53s. Rate: 154.5 symbols/min [2025-09-19T22:22:05.903760] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:05.908579] [DEBUG] [LOCAL ] KF: Loaded 2520 existing records from primary storage. [2025-09-19T22:22:05.908882] [INFO ] [MAIN ] KF: Loaded 2520 primary data records. [2025-09-19T22:22:06.043106] [DEBUG] [LOCAL ] KEX: Loaded 38420 existing records from primary storage. [2025-09-19T22:22:06.043294] [INFO ] [MAIN ] KEX: Loaded 38420 primary data records. [2025-09-19T22:22:06.224242] [DEBUG] [LOCAL ] KEYS: Loaded 44107 existing records from primary storage. [2025-09-19T22:22:06.339422] [INFO ] [MAIN ] KEYS: Loaded 44107 primary data records. [2025-09-19T22:22:06.979288] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:06.983369] [INFO ] [MAIN ] KF: Generated 1820 derivative records from 2520 primary records. [2025-09-19T22:22:06.983488] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-19T22:22:07.010144] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:07.013483] [INFO ] [MAIN ] KEX: Generated 1820 derivative records from 38420 primary records. [2025-09-19T22:22:07.013574] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-19T22:22:07.012537] [DEBUG] [LOCAL ] KF: Derivative data saved (1820 records). [2025-09-19T22:22:07.013972] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-19T22:22:07.016016] [INFO ] [MAIN ] Derivative Progress: 1030/2093 symbols completed. KF took 1.1s. Estimated remaining: 6m 54s. Rate: 154.2 symbols/min [2025-09-19T22:22:07.016967] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:07.034739] [DEBUG] [LOCAL ] KEX: Derivative data saved (1820 records). [2025-09-19T22:22:07.035038] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-19T22:22:07.037500] [INFO ] [MAIN ] Derivative Progress: 1031/2093 symbols completed. KEX took 1.2s. Estimated remaining: 6m 53s. Rate: 154.3 symbols/min [2025-09-19T22:22:07.038290] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:07.068988] [DEBUG] [LOCAL ] KFRC: Loaded 19497 existing records from primary storage. [2025-09-19T22:22:07.071475] [INFO ] [MAIN ] KFRC: Loaded 19497 primary data records. [2025-09-19T22:22:07.072113] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:07.104102] [INFO ] [MAIN ] KEYS: Generated 1820 derivative records from 44107 primary records. [2025-09-19T22:22:07.125085] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-19T22:22:07.124939] [DEBUG] [LOCAL ] KFS: Loaded 8270 existing records from primary storage. [2025-09-19T22:22:07.142682] [INFO ] [MAIN ] KFS: Loaded 8270 primary data records. [2025-09-19T22:22:07.269911] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1820 records). [2025-09-19T22:22:07.305953] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-19T22:22:07.334707] [INFO ] [MAIN ] Derivative Progress: 1032/2093 symbols completed. KEYS took 1.5s. Estimated remaining: 6m 52s. Rate: 154.4 symbols/min [2025-09-19T22:22:07.400381] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:07.746175] [DEBUG] [LOCAL ] KFY: Loaded 31278 existing records from primary storage. [2025-09-19T22:22:07.746749] [INFO ] [MAIN ] KFY: Loaded 31278 primary data records. [2025-09-19T22:22:07.887961] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:07.893620] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:07.910172] [INFO ] [MAIN ] KFRC: Generated 1820 derivative records from 19497 primary records. [2025-09-19T22:22:07.916228] [INFO ] [MAIN ] KFS: Generated 1820 derivative records from 8270 primary records. [2025-09-19T22:22:07.930090] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-19T22:22:07.964578] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-19T22:22:08.131082] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1820 records). [2025-09-19T22:22:08.130262] [DEBUG] [LOCAL ] KFS: Derivative data saved (1820 records). [2025-09-19T22:22:08.131517] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-19T22:22:08.133757] [INFO ] [MAIN ] Derivative Progress: 1033/2093 symbols completed. KFS took 1.1s. Estimated remaining: 6m 52s. Rate: 154.2 symbols/min [2025-09-19T22:22:08.134027] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-19T22:22:08.138186] [INFO ] [MAIN ] Derivative Progress: 1034/2093 symbols completed. KFRC took 1.1s. Estimated remaining: 6m 52s. Rate: 154.4 symbols/min [2025-09-19T22:22:08.158396] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:08.159061] [INFO ] [MAIN ] KFY: Generated 1820 derivative records from 31278 primary records. [2025-09-19T22:22:08.159124] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-19T22:22:08.174289] [DEBUG] [LOCAL ] KFY: Derivative data saved (1820 records). [2025-09-19T22:22:08.174346] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-19T22:22:08.176858] [INFO ] [MAIN ] Derivative Progress: 1035/2093 symbols completed. KFY took 0.8s. Estimated remaining: 6m 51s. Rate: 154.5 symbols/min [2025-09-19T22:22:08.178125] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:08.178208] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:08.177894] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:08.239771] [DEBUG] [LOCAL ] KGS: Loaded 46501 existing records from primary storage. [2025-09-19T22:22:08.240050] [INFO ] [MAIN ] KGS: Loaded 46501 primary data records. [2025-09-19T22:22:08.452308] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-09-19T22:22:08.451573] [DEBUG] [LOCAL ] KIM: Loaded 53850 existing records from primary storage. [2025-09-19T22:22:08.461344] [INFO ] [MAIN ] KIM: Loaded 53850 primary data records. [2025-09-19T22:22:08.471297] [INFO ] [MAIN ] KGC: Loaded 54479 primary data records. [2025-09-19T22:22:09.346905] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:09.347800] [INFO ] [MAIN ] KGS: Generated 1820 derivative records from 46501 primary records. [2025-09-19T22:22:09.348439] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-19T22:22:09.367352] [DEBUG] [LOCAL ] KGS: Derivative data saved (1820 records). [2025-09-19T22:22:09.367700] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-19T22:22:09.370032] [INFO ] [MAIN ] Derivative Progress: 1036/2093 symbols completed. KGS took 1.2s. Estimated remaining: 6m 51s. Rate: 154.2 symbols/min [2025-09-19T22:22:09.370532] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:09.388768] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:09.392287] [INFO ] [MAIN ] KIM: Generated 1820 derivative records from 53850 primary records. [2025-09-19T22:22:09.392568] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-19T22:22:09.419844] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:09.427820] [INFO ] [MAIN ] KGC: Generated 1820 derivative records from 54479 primary records. [2025-09-19T22:22:09.427992] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-19T22:22:09.429799] [DEBUG] [LOCAL ] KIM: Derivative data saved (1820 records). [2025-09-19T22:22:09.430754] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-19T22:22:09.433587] [INFO ] [MAIN ] Derivative Progress: 1037/2093 symbols completed. KIM took 1.3s. Estimated remaining: 6m 51s. Rate: 154.3 symbols/min [2025-09-19T22:22:09.442973] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:09.457970] [DEBUG] [LOCAL ] KIO: Loaded 21731 existing records from primary storage. [2025-09-19T22:22:09.460119] [INFO ] [MAIN ] KIO: Loaded 21731 primary data records. [2025-09-19T22:22:09.460236] [DEBUG] [LOCAL ] KGC: Derivative data saved (1820 records). [2025-09-19T22:22:09.460427] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-19T22:22:09.463440] [INFO ] [MAIN ] Derivative Progress: 1038/2093 symbols completed. KGC took 1.3s. Estimated remaining: 6m 50s. Rate: 154.5 symbols/min [2025-09-19T22:22:09.463716] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:09.593374] [DEBUG] [LOCAL ] KKRS: Loaded 5784 existing records from primary storage. [2025-09-19T22:22:09.594316] [INFO ] [MAIN ] KKRS: Loaded 5784 primary data records. [2025-09-19T22:22:09.778250] [DEBUG] [LOCAL ] KLC: Loaded 36718 existing records from primary storage. [2025-09-19T22:22:09.789665] [INFO ] [MAIN ] KLC: Loaded 36718 primary data records. [2025-09-19T22:22:10.522132] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:10.527293] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:10.528186] [INFO ] [MAIN ] KKRS: Generated 1820 derivative records from 5784 primary records. [2025-09-19T22:22:10.528829] [INFO ] [MAIN ] KIO: Generated 1820 derivative records from 21731 primary records. [2025-09-19T22:22:10.529148] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-19T22:22:10.529226] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-19T22:22:10.560324] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1820 records). [2025-09-19T22:22:10.563326] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-19T22:22:10.565914] [INFO ] [MAIN ] Derivative Progress: 1039/2093 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 50s. Rate: 154.2 symbols/min [2025-09-19T22:22:10.573371] [DEBUG] [LOCAL ] KIO: Derivative data saved (1820 records). [2025-09-19T22:22:10.579708] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:10.588038] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:10.587677] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-19T22:22:10.589192] [INFO ] [MAIN ] KLC: Generated 1820 derivative records from 36718 primary records. [2025-09-19T22:22:10.589313] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-19T22:22:10.592068] [INFO ] [MAIN ] Derivative Progress: 1040/2093 symbols completed. KIO took 1.2s. Estimated remaining: 6m 49s. Rate: 154.3 symbols/min [2025-09-19T22:22:10.603527] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:10.613132] [DEBUG] [LOCAL ] KLC: Derivative data saved (1820 records). [2025-09-19T22:22:10.613413] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-19T22:22:10.615773] [INFO ] [MAIN ] Derivative Progress: 1041/2093 symbols completed. KLC took 1.2s. Estimated remaining: 6m 49s. Rate: 154.5 symbols/min [2025-09-19T22:22:10.616173] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:10.634919] [DEBUG] [LOCAL ] KMPB: Loaded 3656 existing records from primary storage. [2025-09-19T22:22:10.635120] [INFO ] [MAIN ] KMPB: Loaded 3656 primary data records. [2025-09-19T22:22:11.022910] [DEBUG] [LOCAL ] KLG: Loaded 42547 existing records from primary storage. [2025-09-19T22:22:11.023282] [INFO ] [MAIN ] KLG: Loaded 42547 primary data records. [2025-09-19T22:22:11.106276] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-09-19T22:22:11.119974] [INFO ] [MAIN ] KMI: Loaded 54473 primary data records. [2025-09-19T22:22:11.708993] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:11.710167] [INFO ] [MAIN ] KMPB: Generated 1820 derivative records from 3656 primary records. [2025-09-19T22:22:11.713574] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-19T22:22:11.733851] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1820 records). [2025-09-19T22:22:11.734116] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-19T22:22:11.736960] [INFO ] [MAIN ] Derivative Progress: 1042/2093 symbols completed. KMPB took 1.1s. Estimated remaining: 6m 49s. Rate: 154.2 symbols/min [2025-09-19T22:22:11.737701] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:11.759480] [DEBUG] [MAIN ] KLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:11.773604] [INFO ] [MAIN ] KLG: Generated 1820 derivative records from 42547 primary records. [2025-09-19T22:22:11.774095] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-19T22:22:11.774016] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:11.775880] [INFO ] [MAIN ] KMI: Generated 1820 derivative records from 54473 primary records. [2025-09-19T22:22:11.787536] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-19T22:22:11.791888] [DEBUG] [LOCAL ] KLG: Derivative data saved (1820 records). [2025-09-19T22:22:11.792039] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-19T22:22:11.794752] [INFO ] [MAIN ] Derivative Progress: 1043/2093 symbols completed. KLG took 1.2s. Estimated remaining: 6m 48s. Rate: 154.3 symbols/min [2025-09-19T22:22:11.796472] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:11.823579] [DEBUG] [LOCAL ] KMI: Derivative data saved (1820 records). [2025-09-19T22:22:11.824773] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-19T22:22:11.827160] [INFO ] [MAIN ] Derivative Progress: 1044/2093 symbols completed. KMI took 1.2s. Estimated remaining: 6m 48s. Rate: 154.4 symbols/min [2025-09-19T22:22:11.838720] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:11.839900] [DEBUG] [LOCAL ] KMPR: Loaded 38460 existing records from primary storage. [2025-09-19T22:22:11.840208] [INFO ] [MAIN ] KMPR: Loaded 38460 primary data records. [2025-09-19T22:22:12.215004] [DEBUG] [LOCAL ] KMT: Loaded 43803 existing records from primary storage. [2025-09-19T22:22:12.215196] [INFO ] [MAIN ] KMT: Loaded 43803 primary data records. [2025-09-19T22:22:12.360723] [DEBUG] [LOCAL ] KMX: Loaded 53867 existing records from primary storage. [2025-09-19T22:22:12.366433] [INFO ] [MAIN ] KMX: Loaded 53867 primary data records. [2025-09-19T22:22:12.909251] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:12.911199] [INFO ] [MAIN ] KMPR: Generated 1820 derivative records from 38460 primary records. [2025-09-19T22:22:12.911787] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-19T22:22:12.931165] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1820 records). [2025-09-19T22:22:12.931509] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-19T22:22:12.933830] [INFO ] [MAIN ] Derivative Progress: 1045/2093 symbols completed. KMPR took 1.2s. Estimated remaining: 6m 48s. Rate: 154.2 symbols/min [2025-09-19T22:22:12.934724] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:12.965541] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:12.967685] [INFO ] [MAIN ] KMT: Generated 1820 derivative records from 43803 primary records. [2025-09-19T22:22:12.969361] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-19T22:22:13.000230] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:13.005239] [DEBUG] [LOCAL ] KMT: Derivative data saved (1820 records). [2025-09-19T22:22:13.016474] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-19T22:22:13.017794] [INFO ] [MAIN ] KMX: Generated 1820 derivative records from 53867 primary records. [2025-09-19T22:22:13.020789] [INFO ] [MAIN ] Derivative Progress: 1046/2093 symbols completed. KMT took 1.2s. Estimated remaining: 6m 47s. Rate: 154.3 symbols/min [2025-09-19T22:22:13.021057] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-19T22:22:13.021534] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:13.040486] [DEBUG] [LOCAL ] KMX: Derivative data saved (1820 records). [2025-09-19T22:22:13.052580] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-19T22:22:13.055077] [INFO ] [MAIN ] Derivative Progress: 1047/2093 symbols completed. KMX took 1.2s. Estimated remaining: 6m 46s. Rate: 154.4 symbols/min [2025-09-19T22:22:13.055526] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:13.057206] [DEBUG] [LOCAL ] KN: Loaded 39680 existing records from primary storage. [2025-09-19T22:22:13.057498] [INFO ] [MAIN ] KN: Loaded 39680 primary data records. [2025-09-19T22:22:13.183562] [DEBUG] [LOCAL ] KNOP: Loaded 10092 existing records from primary storage. [2025-09-19T22:22:13.206775] [INFO ] [MAIN ] KNOP: Loaded 10092 primary data records. [2025-09-19T22:22:13.318215] [DEBUG] [LOCAL ] KNF: Loaded 36245 existing records from primary storage. [2025-09-19T22:22:13.394609] [INFO ] [MAIN ] KNF: Loaded 36245 primary data records. [2025-09-19T22:22:14.125214] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:14.126321] [INFO ] [MAIN ] KN: Generated 1820 derivative records from 39680 primary records. [2025-09-19T22:22:14.127594] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-19T22:22:14.145824] [DEBUG] [LOCAL ] KN: Derivative data saved (1820 records). [2025-09-19T22:22:14.146060] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-19T22:22:14.148334] [INFO ] [MAIN ] Derivative Progress: 1048/2093 symbols completed. KN took 1.2s. Estimated remaining: 6m 47s. Rate: 154.2 symbols/min [2025-09-19T22:22:14.165815] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:14.168693] [INFO ] [MAIN ] KNOP: Generated 1820 derivative records from 10092 primary records. [2025-09-19T22:22:14.169692] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-19T22:22:14.194612] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:14.197784] [INFO ] [MAIN ] KNF: Generated 1820 derivative records from 36245 primary records. [2025-09-19T22:22:14.199538] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1820 records). [2025-09-19T22:22:14.198725] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-19T22:22:14.199991] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-19T22:22:14.202937] [INFO ] [MAIN ] Derivative Progress: 1049/2093 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 46s. Rate: 154.3 symbols/min [2025-09-19T22:22:14.218571] [DEBUG] [LOCAL ] KNF: Derivative data saved (1820 records). [2025-09-19T22:22:14.218639] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-19T22:22:14.221752] [INFO ] [MAIN ] Derivative Progress: 1050/2093 symbols completed. KNF took 1.2s. Estimated remaining: 6m 45s. Rate: 154.4 symbols/min [2025-09-19T22:22:14.222473] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:14.222844] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:14.222761] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:14.244742] [DEBUG] [LOCAL ] KNSL: Loaded 18452 existing records from primary storage. [2025-09-19T22:22:14.245069] [INFO ] [MAIN ] KNSL: Loaded 18452 primary data records. [2025-09-19T22:22:14.601301] [DEBUG] [LOCAL ] KNTK: Loaded 46851 existing records from primary storage. [2025-09-19T22:22:14.601784] [INFO ] [MAIN ] KNTK: Loaded 46851 primary data records. [2025-09-19T22:22:14.602707] [DEBUG] [LOCAL ] KNX: Loaded 53366 existing records from primary storage. [2025-09-19T22:22:14.603385] [INFO ] [MAIN ] KNX: Loaded 53366 primary data records. [2025-09-19T22:22:15.300671] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:15.301988] [INFO ] [MAIN ] KNSL: Generated 1820 derivative records from 18452 primary records. [2025-09-19T22:22:15.302520] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-19T22:22:15.323851] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1820 records). [2025-09-19T22:22:15.324238] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-19T22:22:15.327636] [INFO ] [MAIN ] Derivative Progress: 1051/2093 symbols completed. KNSL took 1.1s. Estimated remaining: 6m 46s. Rate: 154.2 symbols/min [2025-09-19T22:22:15.329182] [INFO ] [MAIN ] KO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:15.343629] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:15.344692] [INFO ] [MAIN ] KNX: Generated 1820 derivative records from 53366 primary records. [2025-09-19T22:22:15.344781] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-19T22:22:15.364890] [DEBUG] [LOCAL ] KNX: Derivative data saved (1820 records). [2025-09-19T22:22:15.365111] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-19T22:22:15.367402] [INFO ] [MAIN ] Derivative Progress: 1052/2093 symbols completed. KNX took 1.1s. Estimated remaining: 6m 45s. Rate: 154.3 symbols/min [2025-09-19T22:22:15.380566] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:15.381668] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:15.383042] [INFO ] [MAIN ] KNTK: Generated 1820 derivative records from 46851 primary records. [2025-09-19T22:22:15.383271] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-19T22:22:15.409474] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1820 records). [2025-09-19T22:22:15.410078] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-19T22:22:15.413150] [INFO ] [MAIN ] Derivative Progress: 1053/2093 symbols completed. KNTK took 1.2s. Estimated remaining: 6m 44s. Rate: 154.4 symbols/min [2025-09-19T22:22:15.413725] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:15.473516] [DEBUG] [LOCAL ] KODK: Loaded 44070 existing records from primary storage. [2025-09-19T22:22:15.494713] [INFO ] [MAIN ] KODK: Loaded 44070 primary data records. [2025-09-19T22:22:15.531608] [DEBUG] [LOCAL ] KO: Loaded 54598 existing records from primary storage. [2025-09-19T22:22:15.532268] [DEBUG] [LOCAL ] KOF: Loaded 26373 existing records from primary storage. [2025-09-19T22:22:15.537586] [INFO ] [MAIN ] KO: Loaded 54598 primary data records. [2025-09-19T22:22:15.537699] [INFO ] [MAIN ] KOF: Loaded 26373 primary data records. [2025-09-19T22:22:16.509258] [DEBUG] [MAIN ] KO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:16.523045] [INFO ] [MAIN ] KO: Generated 1820 derivative records from 54598 primary records. [2025-09-19T22:22:16.524857] [DEBUG] [LOCAL ] KO: Saving derivative data. [2025-09-19T22:22:16.534313] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:16.541719] [INFO ] [MAIN ] KODK: Generated 1820 derivative records from 44070 primary records. [2025-09-19T22:22:16.543841] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-19T22:22:16.548406] [DEBUG] [LOCAL ] KO: Derivative data saved (1820 records). [2025-09-19T22:22:16.549486] [INFO ] [MAIN ] KO: Successfully saved derivative data. [2025-09-19T22:22:16.552135] [INFO ] [MAIN ] Derivative Progress: 1054/2093 symbols completed. KO took 1.2s. Estimated remaining: 6m 44s. Rate: 154.1 symbols/min [2025-09-19T22:22:16.578500] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:16.587967] [DEBUG] [LOCAL ] KODK: Derivative data saved (1820 records). [2025-09-19T22:22:16.585478] [INFO ] [MAIN ] KOF: Generated 1820 derivative records from 26373 primary records. [2025-09-19T22:22:16.578719] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:16.588115] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-19T22:22:16.588867] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-19T22:22:16.590831] [INFO ] [MAIN ] Derivative Progress: 1055/2093 symbols completed. KODK took 1.2s. Estimated remaining: 6m 44s. Rate: 154.3 symbols/min [2025-09-19T22:22:16.592241] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:16.609666] [DEBUG] [LOCAL ] KOF: Derivative data saved (1820 records). [2025-09-19T22:22:16.609817] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-19T22:22:16.619846] [INFO ] [MAIN ] Derivative Progress: 1056/2093 symbols completed. KOF took 1.2s. Estimated remaining: 6m 43s. Rate: 154.4 symbols/min [2025-09-19T22:22:16.616927] [DEBUG] [LOCAL ] KORE: Loaded 1975 existing records from primary storage. [2025-09-19T22:22:16.620075] [INFO ] [MAIN ] KORE: Loaded 1975 primary data records. [2025-09-19T22:22:16.632135] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:16.706327] [DEBUG] [LOCAL ] KOP: Loaded 18334 existing records from primary storage. [2025-09-19T22:22:16.734394] [INFO ] [MAIN ] KOP: Loaded 18334 primary data records. [2025-09-19T22:22:17.378636] [DEBUG] [LOCAL ] KOS: Loaded 53842 existing records from primary storage. [2025-09-19T22:22:17.381071] [INFO ] [MAIN ] KOS: Loaded 53842 primary data records. [2025-09-19T22:22:17.726241] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:17.736220] [INFO ] [MAIN ] KORE: Generated 1820 derivative records from 1975 primary records. [2025-09-19T22:22:17.741598] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-19T22:22:17.742375] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:17.743341] [INFO ] [MAIN ] KOP: Generated 1820 derivative records from 18334 primary records. [2025-09-19T22:22:17.744899] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-19T22:22:17.770596] [DEBUG] [LOCAL ] KORE: Derivative data saved (1820 records). [2025-09-19T22:22:17.773743] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-19T22:22:17.776093] [INFO ] [MAIN ] Derivative Progress: 1057/2093 symbols completed. KORE took 1.2s. Estimated remaining: 6m 43s. Rate: 154.1 symbols/min [2025-09-19T22:22:17.777434] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:17.783985] [DEBUG] [LOCAL ] KOP: Derivative data saved (1820 records). [2025-09-19T22:22:17.784250] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-19T22:22:17.787319] [INFO ] [MAIN ] Derivative Progress: 1058/2093 symbols completed. KOP took 1.2s. Estimated remaining: 6m 43s. Rate: 154.3 symbols/min [2025-09-19T22:22:17.790392] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:17.804335] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:17.805140] [INFO ] [MAIN ] KOS: Generated 1820 derivative records from 53842 primary records. [2025-09-19T22:22:17.805331] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-19T22:22:17.823386] [DEBUG] [LOCAL ] KOS: Derivative data saved (1820 records). [2025-09-19T22:22:17.823501] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-19T22:22:17.826486] [INFO ] [MAIN ] Derivative Progress: 1059/2093 symbols completed. KOS took 1.2s. Estimated remaining: 6m 42s. Rate: 154.4 symbols/min [2025-09-19T22:22:17.826825] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:17.900885] [DEBUG] [LOCAL ] KR: Loaded 54462 existing records from primary storage. [2025-09-19T22:22:17.910338] [INFO ] [MAIN ] KR: Loaded 54462 primary data records. [2025-09-19T22:22:17.917192] [DEBUG] [LOCAL ] KRC: Loaded 49159 existing records from primary storage. [2025-09-19T22:22:17.946167] [INFO ] [MAIN ] KRC: Loaded 49159 primary data records. [2025-09-19T22:22:18.035996] [DEBUG] [LOCAL ] KREF: Loaded 37539 existing records from primary storage. [2025-09-19T22:22:18.079334] [INFO ] [MAIN ] KREF: Loaded 37539 primary data records. [2025-09-19T22:22:18.900255] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:18.901152] [INFO ] [MAIN ] KR: Generated 1820 derivative records from 54462 primary records. [2025-09-19T22:22:18.913299] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-19T22:22:18.914870] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:18.923763] [INFO ] [MAIN ] KRC: Generated 1820 derivative records from 49159 primary records. [2025-09-19T22:22:18.929420] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-19T22:22:18.931477] [DEBUG] [LOCAL ] KR: Derivative data saved (1820 records). [2025-09-19T22:22:18.941075] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-19T22:22:18.946754] [INFO ] [MAIN ] Derivative Progress: 1060/2093 symbols completed. KR took 1.2s. Estimated remaining: 6m 42s. Rate: 154.1 symbols/min [2025-09-19T22:22:18.950207] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:18.951390] [DEBUG] [LOCAL ] KRC: Derivative data saved (1820 records). [2025-09-19T22:22:18.951526] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-19T22:22:18.967726] [INFO ] [MAIN ] Derivative Progress: 1061/2093 symbols completed. KRC took 1.2s. Estimated remaining: 6m 41s. Rate: 154.2 symbols/min [2025-09-19T22:22:18.968810] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:18.969718] [INFO ] [MAIN ] KREF: Generated 1820 derivative records from 37539 primary records. [2025-09-19T22:22:18.969869] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:18.969955] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-19T22:22:18.989360] [DEBUG] [LOCAL ] KREF: Derivative data saved (1820 records). [2025-09-19T22:22:18.989541] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-19T22:22:18.991998] [INFO ] [MAIN ] Derivative Progress: 1062/2093 symbols completed. KREF took 1.2s. Estimated remaining: 6m 41s. Rate: 154.4 symbols/min [2025-09-19T22:22:18.992411] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:19.014630] [DEBUG] [LOCAL ] KRO: Loaded 26145 existing records from primary storage. [2025-09-19T22:22:19.014876] [INFO ] [MAIN ] KRO: Loaded 26145 primary data records. [2025-09-19T22:22:19.202681] [DEBUG] [LOCAL ] KRG: Loaded 49895 existing records from primary storage. [2025-09-19T22:22:19.210517] [INFO ] [MAIN ] KRG: Loaded 49895 primary data records. [2025-09-19T22:22:19.442010] [DEBUG] [LOCAL ] KRP: Loaded 38635 existing records from primary storage. [2025-09-19T22:22:19.453666] [INFO ] [MAIN ] KRP: Loaded 38635 primary data records. [2025-09-19T22:22:20.027784] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:20.028960] [INFO ] [MAIN ] KRO: Generated 1820 derivative records from 26145 primary records. [2025-09-19T22:22:20.029149] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-19T22:22:20.049585] [DEBUG] [LOCAL ] KRO: Derivative data saved (1820 records). [2025-09-19T22:22:20.050009] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-19T22:22:20.052252] [INFO ] [MAIN ] Derivative Progress: 1063/2093 symbols completed. KRO took 1.1s. Estimated remaining: 6m 41s. Rate: 154.1 symbols/min [2025-09-19T22:22:20.065877] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:20.067085] [INFO ] [MAIN ] KRG: Generated 1820 derivative records from 49895 primary records. [2025-09-19T22:22:20.067179] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-19T22:22:20.098481] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:20.099831] [DEBUG] [LOCAL ] KRG: Derivative data saved (1820 records). [2025-09-19T22:22:20.099938] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-19T22:22:20.100777] [INFO ] [MAIN ] KRP: Generated 1820 derivative records from 38635 primary records. [2025-09-19T22:22:20.100894] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-19T22:22:20.103376] [INFO ] [MAIN ] Derivative Progress: 1064/2093 symbols completed. KRG took 1.2s. Estimated remaining: 6m 40s. Rate: 154.3 symbols/min [2025-09-19T22:22:20.122487] [DEBUG] [LOCAL ] KRP: Derivative data saved (1820 records). [2025-09-19T22:22:20.122559] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-19T22:22:20.124869] [INFO ] [MAIN ] Derivative Progress: 1065/2093 symbols completed. KRP took 1.1s. Estimated remaining: 6m 39s. Rate: 154.4 symbols/min [2025-09-19T22:22:20.125361] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:20.125612] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:20.126064] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:20.202684] [DEBUG] [LOCAL ] KSS: Loaded 54391 existing records from primary storage. [2025-09-19T22:22:20.203416] [INFO ] [MAIN ] KSS: Loaded 54391 primary data records. [2025-09-19T22:22:20.311504] [DEBUG] [LOCAL ] KTB: Loaded 41933 existing records from primary storage. [2025-09-19T22:22:20.335864] [INFO ] [MAIN ] KTB: Loaded 41933 primary data records. [2025-09-19T22:22:20.336563] [DEBUG] [LOCAL ] KT: Loaded 46373 existing records from primary storage. [2025-09-19T22:22:20.336980] [INFO ] [MAIN ] KT: Loaded 46373 primary data records. [2025-09-19T22:22:21.206428] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:21.207920] [INFO ] [MAIN ] KSS: Generated 1820 derivative records from 54391 primary records. [2025-09-19T22:22:21.208033] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-19T22:22:21.230827] [DEBUG] [LOCAL ] KSS: Derivative data saved (1820 records). [2025-09-19T22:22:21.231344] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-19T22:22:21.233794] [INFO ] [MAIN ] Derivative Progress: 1066/2093 symbols completed. KSS took 1.1s. Estimated remaining: 6m 40s. Rate: 154.1 symbols/min [2025-09-19T22:22:21.234197] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:21.253382] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:21.261116] [INFO ] [MAIN ] KT: Generated 1820 derivative records from 46373 primary records. [2025-09-19T22:22:21.268333] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:21.269167] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-19T22:22:21.269106] [INFO ] [MAIN ] KTB: Generated 1820 derivative records from 41933 primary records. [2025-09-19T22:22:21.270033] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-19T22:22:21.304366] [DEBUG] [LOCAL ] KTB: Derivative data saved (1820 records). [2025-09-19T22:22:21.305617] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-19T22:22:21.314008] [DEBUG] [LOCAL ] KT: Derivative data saved (1820 records). [2025-09-19T22:22:21.317992] [INFO ] [MAIN ] Derivative Progress: 1067/2093 symbols completed. KTB took 1.2s. Estimated remaining: 6m 39s. Rate: 154.2 symbols/min [2025-09-19T22:22:21.315403] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-19T22:22:21.320810] [INFO ] [MAIN ] Derivative Progress: 1068/2093 symbols completed. KT took 1.2s. Estimated remaining: 6m 38s. Rate: 154.4 symbols/min [2025-09-19T22:22:21.318246] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:21.321590] [DEBUG] [LOCAL ] KTF: Loaded 13320 existing records from primary storage. [2025-09-19T22:22:21.322077] [INFO ] [MAIN ] KTF: Loaded 13320 primary data records. [2025-09-19T22:22:21.322035] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:21.737040] [DEBUG] [LOCAL ] KVYO: Loaded 50569 existing records from primary storage. [2025-09-19T22:22:21.737275] [INFO ] [MAIN ] KVYO: Loaded 50569 primary data records. [2025-09-19T22:22:21.738236] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-09-19T22:22:21.760997] [INFO ] [MAIN ] KVUE: Loaded 54447 primary data records. [2025-09-19T22:22:22.369735] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:22.370683] [INFO ] [MAIN ] KTF: Generated 1820 derivative records from 13320 primary records. [2025-09-19T22:22:22.370862] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-19T22:22:22.391036] [DEBUG] [LOCAL ] KTF: Derivative data saved (1820 records). [2025-09-19T22:22:22.391875] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-19T22:22:22.394246] [INFO ] [MAIN ] Derivative Progress: 1069/2093 symbols completed. KTF took 1.2s. Estimated remaining: 6m 39s. Rate: 154.1 symbols/min [2025-09-19T22:22:22.394638] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:22.432011] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:22:22.433376] [INFO ] [MAIN ] KVYO: Generated 1819 derivative records from 50569 primary records. [2025-09-19T22:22:22.433603] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:22.433745] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-19T22:22:22.434317] [INFO ] [MAIN ] KVUE: Generated 1820 derivative records from 54447 primary records. [2025-09-19T22:22:22.434968] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-19T22:22:22.474535] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1819 records). [2025-09-19T22:22:22.475886] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1820 records). [2025-09-19T22:22:22.476589] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-19T22:22:22.476666] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-19T22:22:22.479240] [INFO ] [MAIN ] Derivative Progress: 1070/2093 symbols completed. KVUE took 1.2s. Estimated remaining: 6m 38s. Rate: 154.2 symbols/min [2025-09-19T22:22:22.481542] [INFO ] [MAIN ] Derivative Progress: 1071/2093 symbols completed. KVYO took 1.2s. Estimated remaining: 6m 37s. Rate: 154.4 symbols/min [2025-09-19T22:22:22.481489] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:22.481932] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:22.494630] [DEBUG] [LOCAL ] KW: Loaded 41246 existing records from primary storage. [2025-09-19T22:22:22.494858] [INFO ] [MAIN ] KW: Loaded 41246 primary data records. [2025-09-19T22:22:22.673919] [DEBUG] [LOCAL ] KWR: Loaded 17129 existing records from primary storage. [2025-09-19T22:22:22.697234] [INFO ] [MAIN ] KWR: Loaded 17129 primary data records. [2025-09-19T22:22:22.905818] [DEBUG] [LOCAL ] KYN: Loaded 30875 existing records from primary storage. [2025-09-19T22:22:22.928739] [INFO ] [MAIN ] KYN: Loaded 30875 primary data records. [2025-09-19T22:22:23.505304] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:23.506461] [INFO ] [MAIN ] KW: Generated 1820 derivative records from 41246 primary records. [2025-09-19T22:22:23.506637] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-19T22:22:23.524083] [DEBUG] [LOCAL ] KW: Derivative data saved (1820 records). [2025-09-19T22:22:23.526785] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-19T22:22:23.529299] [INFO ] [MAIN ] Derivative Progress: 1072/2093 symbols completed. KW took 1.1s. Estimated remaining: 6m 37s. Rate: 154.1 symbols/min [2025-09-19T22:22:23.530127] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:23.543565] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:23.544375] [INFO ] [MAIN ] KWR: Generated 1820 derivative records from 17129 primary records. [2025-09-19T22:22:23.548725] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-19T22:22:23.582529] [DEBUG] [LOCAL ] KWR: Derivative data saved (1820 records). [2025-09-19T22:22:23.582826] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:23.583058] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-19T22:22:23.583861] [INFO ] [MAIN ] KYN: Generated 1820 derivative records from 30875 primary records. [2025-09-19T22:22:23.584027] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-19T22:22:23.586157] [INFO ] [MAIN ] Derivative Progress: 1073/2093 symbols completed. KWR took 1.1s. Estimated remaining: 6m 37s. Rate: 154.3 symbols/min [2025-09-19T22:22:23.587016] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:23.604366] [DEBUG] [LOCAL ] KYN: Derivative data saved (1820 records). [2025-09-19T22:22:23.604627] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-19T22:22:23.607313] [INFO ] [MAIN ] Derivative Progress: 1074/2093 symbols completed. KYN took 1.1s. Estimated remaining: 6m 36s. Rate: 154.4 symbols/min [2025-09-19T22:22:23.617304] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:23.635361] [DEBUG] [LOCAL ] L: Loaded 41511 existing records from primary storage. [2025-09-19T22:22:23.635596] [INFO ] [MAIN ] L: Loaded 41511 primary data records. [2025-09-19T22:22:23.839890] [DEBUG] [LOCAL ] LAD: Loaded 24380 existing records from primary storage. [2025-09-19T22:22:23.871114] [INFO ] [MAIN ] LAD: Loaded 24380 primary data records. [2025-09-19T22:22:23.966589] [DEBUG] [LOCAL ] LAC: Loaded 53062 existing records from primary storage. [2025-09-19T22:22:24.027601] [INFO ] [MAIN ] LAC: Loaded 53062 primary data records. [2025-09-19T22:22:24.649627] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:24.651059] [INFO ] [MAIN ] L: Generated 1820 derivative records from 41511 primary records. [2025-09-19T22:22:24.651728] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-19T22:22:24.675053] [DEBUG] [LOCAL ] L: Derivative data saved (1820 records). [2025-09-19T22:22:24.675200] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-19T22:22:24.677164] [INFO ] [MAIN ] Derivative Progress: 1075/2093 symbols completed. L took 1.1s. Estimated remaining: 6m 36s. Rate: 154.1 symbols/min [2025-09-19T22:22:24.677704] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:24.696399] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:24.698467] [INFO ] [MAIN ] LAD: Generated 1820 derivative records from 24380 primary records. [2025-09-19T22:22:24.698613] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-19T22:22:24.720080] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:24.725243] [INFO ] [MAIN ] LAC: Generated 1820 derivative records from 53062 primary records. [2025-09-19T22:22:24.725353] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-19T22:22:24.745305] [DEBUG] [LOCAL ] LAC: Derivative data saved (1820 records). [2025-09-19T22:22:24.754750] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-19T22:22:24.757474] [INFO ] [MAIN ] Derivative Progress: 1076/2093 symbols completed. LAC took 1.2s. Estimated remaining: 6m 36s. Rate: 154.3 symbols/min [2025-09-19T22:22:24.758470] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:24.758358] [DEBUG] [LOCAL ] LAD: Derivative data saved (1820 records). [2025-09-19T22:22:24.758683] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-19T22:22:24.761437] [INFO ] [MAIN ] Derivative Progress: 1077/2093 symbols completed. LAD took 1.2s. Estimated remaining: 6m 35s. Rate: 154.4 symbols/min [2025-09-19T22:22:24.761904] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:24.765942] [DEBUG] [LOCAL ] LANV: Loaded 2699 existing records from primary storage. [2025-09-19T22:22:24.766189] [INFO ] [MAIN ] LANV: Loaded 2699 primary data records. [2025-09-19T22:22:24.852304] [DEBUG] [LOCAL ] LADR: Loaded 39244 existing records from primary storage. [2025-09-19T22:22:24.869126] [INFO ] [MAIN ] LADR: Loaded 39244 primary data records. [2025-09-19T22:22:24.907825] [DEBUG] [LOCAL ] LAW: Loaded 14108 existing records from primary storage. [2025-09-19T22:22:25.015966] [INFO ] [MAIN ] LAW: Loaded 14108 primary data records. [2025-09-19T22:22:25.802712] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:22:25.803609] [INFO ] [MAIN ] LANV: Generated 1819 derivative records from 2699 primary records. [2025-09-19T22:22:25.804060] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-19T22:22:25.820637] [DEBUG] [LOCAL ] LANV: Derivative data saved (1819 records). [2025-09-19T22:22:25.821009] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-19T22:22:25.836243] [INFO ] [MAIN ] Derivative Progress: 1078/2093 symbols completed. LANV took 1.1s. Estimated remaining: 6m 35s. Rate: 154.2 symbols/min [2025-09-19T22:22:25.838317] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:25.839349] [INFO ] [MAIN ] LADR: Generated 1820 derivative records from 39244 primary records. [2025-09-19T22:22:25.839466] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-19T22:22:25.852534] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:25.861679] [INFO ] [MAIN ] LAW: Generated 1820 derivative records from 14108 primary records. [2025-09-19T22:22:25.864300] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-19T22:22:25.882925] [DEBUG] [LOCAL ] LADR: Derivative data saved (1820 records). [2025-09-19T22:22:25.883848] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-19T22:22:25.883794] [DEBUG] [LOCAL ] LAW: Derivative data saved (1820 records). [2025-09-19T22:22:25.885978] [INFO ] [MAIN ] Derivative Progress: 1079/2093 symbols completed. LADR took 1.2s. Estimated remaining: 6m 34s. Rate: 154.3 symbols/min [2025-09-19T22:22:25.886213] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-19T22:22:25.888734] [INFO ] [MAIN ] Derivative Progress: 1080/2093 symbols completed. LAW took 1.1s. Estimated remaining: 6m 34s. Rate: 154.4 symbols/min [2025-09-19T22:22:25.889372] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:25.889257] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:25.890730] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:25.959257] [DEBUG] [LOCAL ] LAZ: Loaded 46085 existing records from primary storage. [2025-09-19T22:22:25.969148] [INFO ] [MAIN ] LAZ: Loaded 46085 primary data records. [2025-09-19T22:22:26.021514] [DEBUG] [LOCAL ] LB: Loaded 38376 existing records from primary storage. [2025-09-19T22:22:26.058743] [INFO ] [MAIN ] LB: Loaded 38376 primary data records. [2025-09-19T22:22:26.134009] [DEBUG] [LOCAL ] LBRT: Loaded 53697 existing records from primary storage. [2025-09-19T22:22:26.154017] [INFO ] [MAIN ] LBRT: Loaded 53697 primary data records. [2025-09-19T22:22:26.947895] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:26.948907] [INFO ] [MAIN ] LAZ: Generated 1820 derivative records from 46085 primary records. [2025-09-19T22:22:26.949282] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-19T22:22:26.968768] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1820 records). [2025-09-19T22:22:26.969520] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-19T22:22:26.971732] [INFO ] [MAIN ] Derivative Progress: 1081/2093 symbols completed. LAZ took 1.1s. Estimated remaining: 6m 34s. Rate: 154.2 symbols/min [2025-09-19T22:22:26.973244] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:26.989014] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:26.989823] [INFO ] [MAIN ] LBRT: Generated 1820 derivative records from 53697 primary records. [2025-09-19T22:22:26.997830] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-19T22:22:27.004186] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:27.012519] [INFO ] [MAIN ] LB: Generated 1820 derivative records from 38376 primary records. [2025-09-19T22:22:27.012745] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-19T22:22:27.039745] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1820 records). [2025-09-19T22:22:27.039057] [DEBUG] [LOCAL ] LB: Derivative data saved (1820 records). [2025-09-19T22:22:27.039896] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-19T22:22:27.042483] [INFO ] [MAIN ] Derivative Progress: 1082/2093 symbols completed. LB took 1.2s. Estimated remaining: 6m 33s. Rate: 154.3 symbols/min [2025-09-19T22:22:27.042820] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:27.042999] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-19T22:22:27.045601] [INFO ] [MAIN ] Derivative Progress: 1083/2093 symbols completed. LBRT took 1.2s. Estimated remaining: 6m 32s. Rate: 154.4 symbols/min [2025-09-19T22:22:27.046062] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:27.097823] [DEBUG] [LOCAL ] LC: Loaded 48747 existing records from primary storage. [2025-09-19T22:22:27.105466] [INFO ] [MAIN ] LC: Loaded 48747 primary data records. [2025-09-19T22:22:27.237666] [DEBUG] [LOCAL ] LCII: Loaded 29177 existing records from primary storage. [2025-09-19T22:22:27.238408] [DEBUG] [LOCAL ] LDI: Loaded 44135 existing records from primary storage. [2025-09-19T22:22:27.238939] [INFO ] [MAIN ] LDI: Loaded 44135 primary data records. [2025-09-19T22:22:27.260602] [INFO ] [MAIN ] LCII: Loaded 29177 primary data records. [2025-09-19T22:22:28.115556] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:28.116506] [INFO ] [MAIN ] LC: Generated 1820 derivative records from 48747 primary records. [2025-09-19T22:22:28.116684] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-19T22:22:28.138806] [DEBUG] [LOCAL ] LC: Derivative data saved (1820 records). [2025-09-19T22:22:28.139112] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-19T22:22:28.140867] [INFO ] [MAIN ] Derivative Progress: 1084/2093 symbols completed. LC took 1.2s. Estimated remaining: 6m 33s. Rate: 154.2 symbols/min [2025-09-19T22:22:28.141251] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:28.161740] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:28.162776] [INFO ] [MAIN ] LDI: Generated 1820 derivative records from 44135 primary records. [2025-09-19T22:22:28.163018] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-19T22:22:28.191198] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:28.194014] [INFO ] [MAIN ] LCII: Generated 1820 derivative records from 29177 primary records. [2025-09-19T22:22:28.195064] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-19T22:22:28.195830] [DEBUG] [LOCAL ] LDI: Derivative data saved (1820 records). [2025-09-19T22:22:28.196529] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-19T22:22:28.206261] [INFO ] [MAIN ] Derivative Progress: 1085/2093 symbols completed. LDI took 1.2s. Estimated remaining: 6m 32s. Rate: 154.3 symbols/min [2025-09-19T22:22:28.206587] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:28.227155] [DEBUG] [LOCAL ] LCII: Derivative data saved (1820 records). [2025-09-19T22:22:28.227346] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-19T22:22:28.229707] [INFO ] [MAIN ] Derivative Progress: 1086/2093 symbols completed. LCII took 1.2s. Estimated remaining: 6m 31s. Rate: 154.4 symbols/min [2025-09-19T22:22:28.230243] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:28.254353] [DEBUG] [LOCAL ] LDP: Loaded 13351 existing records from primary storage. [2025-09-19T22:22:28.255401] [DEBUG] [LOCAL ] LDOS: Loaded 46704 existing records from primary storage. [2025-09-19T22:22:28.254566] [INFO ] [MAIN ] LDP: Loaded 13351 primary data records. [2025-09-19T22:22:28.255586] [INFO ] [MAIN ] LDOS: Loaded 46704 primary data records. [2025-09-19T22:22:28.887353] [DEBUG] [LOCAL ] LEA: Loaded 42546 existing records from primary storage. [2025-09-19T22:22:28.901684] [INFO ] [MAIN ] LEA: Loaded 42546 primary data records. [2025-09-19T22:22:29.252752] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:29.254246] [INFO ] [MAIN ] LDOS: Generated 1820 derivative records from 46704 primary records. [2025-09-19T22:22:29.266069] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-19T22:22:29.268840] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:29.269718] [INFO ] [MAIN ] LDP: Generated 1820 derivative records from 13351 primary records. [2025-09-19T22:22:29.277374] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-19T22:22:29.301912] [DEBUG] [LOCAL ] LDP: Derivative data saved (1820 records). [2025-09-19T22:22:29.302566] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1820 records). [2025-09-19T22:22:29.302946] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-19T22:22:29.302851] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-19T22:22:29.305572] [INFO ] [MAIN ] Derivative Progress: 1087/2093 symbols completed. LDOS took 1.2s. Estimated remaining: 6m 32s. Rate: 154.2 symbols/min [2025-09-19T22:22:29.308089] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:29.308147] [INFO ] [MAIN ] Derivative Progress: 1088/2093 symbols completed. LDP took 1.1s. Estimated remaining: 6m 31s. Rate: 154.3 symbols/min [2025-09-19T22:22:29.309054] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:29.327667] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:29.328422] [INFO ] [MAIN ] LEA: Generated 1820 derivative records from 42546 primary records. [2025-09-19T22:22:29.328534] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-19T22:22:29.345474] [DEBUG] [LOCAL ] LEA: Derivative data saved (1820 records). [2025-09-19T22:22:29.345622] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-19T22:22:29.347908] [INFO ] [MAIN ] Derivative Progress: 1089/2093 symbols completed. LEA took 1.1s. Estimated remaining: 6m 30s. Rate: 154.4 symbols/min [2025-09-19T22:22:29.348266] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:29.392339] [DEBUG] [LOCAL ] LEO: Loaded 17935 existing records from primary storage. [2025-09-19T22:22:29.392532] [INFO ] [MAIN ] LEO: Loaded 17935 primary data records. [2025-09-19T22:22:29.530744] [DEBUG] [LOCAL ] LEG: Loaded 51158 existing records from primary storage. [2025-09-19T22:22:29.535249] [INFO ] [MAIN ] LEG: Loaded 51158 primary data records. [2025-09-19T22:22:29.536332] [DEBUG] [LOCAL ] LEN: Loaded 53964 existing records from primary storage. [2025-09-19T22:22:29.558469] [INFO ] [MAIN ] LEN: Loaded 53964 primary data records. [2025-09-19T22:22:30.467737] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:30.469091] [INFO ] [MAIN ] LEO: Generated 1820 derivative records from 17935 primary records. [2025-09-19T22:22:30.470047] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-19T22:22:30.501412] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:30.503224] [INFO ] [MAIN ] LEG: Generated 1820 derivative records from 51158 primary records. [2025-09-19T22:22:30.503926] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-19T22:22:30.532266] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:30.536131] [INFO ] [MAIN ] LEN: Generated 1820 derivative records from 53964 primary records. [2025-09-19T22:22:30.538832] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-19T22:22:30.538956] [DEBUG] [LOCAL ] LEO: Derivative data saved (1820 records). [2025-09-19T22:22:30.539108] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-19T22:22:30.538713] [DEBUG] [LOCAL ] LEG: Derivative data saved (1820 records). [2025-09-19T22:22:30.540961] [INFO ] [MAIN ] Derivative Progress: 1090/2093 symbols completed. LEO took 1.2s. Estimated remaining: 6m 30s. Rate: 154.1 symbols/min [2025-09-19T22:22:30.541296] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-19T22:22:30.541415] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:30.543716] [INFO ] [MAIN ] Derivative Progress: 1091/2093 symbols completed. LEG took 1.2s. Estimated remaining: 6m 30s. Rate: 154.3 symbols/min [2025-09-19T22:22:30.544811] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:30.565181] [DEBUG] [LOCAL ] LEN: Derivative data saved (1820 records). [2025-09-19T22:22:30.565468] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-19T22:22:30.568422] [INFO ] [MAIN ] Derivative Progress: 1092/2093 symbols completed. LEN took 1.3s. Estimated remaining: 6m 29s. Rate: 154.4 symbols/min [2025-09-19T22:22:30.568947] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:30.584997] [DEBUG] [LOCAL ] LFT: Loaded 18069 existing records from primary storage. [2025-09-19T22:22:30.588220] [INFO ] [MAIN ] LFT: Loaded 18069 primary data records. [2025-09-19T22:22:30.641011] [DEBUG] [LOCAL ] LGI: Loaded 10308 existing records from primary storage. [2025-09-19T22:22:30.666896] [INFO ] [MAIN ] LGI: Loaded 10308 primary data records. [2025-09-19T22:22:30.923991] [DEBUG] [LOCAL ] LEVI: Loaded 52245 existing records from primary storage. [2025-09-19T22:22:31.085073] [INFO ] [MAIN ] LEVI: Loaded 52245 primary data records. [2025-09-19T22:22:31.667716] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:31.669283] [INFO ] [MAIN ] LFT: Generated 1820 derivative records from 18069 primary records. [2025-09-19T22:22:31.681854] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-19T22:22:31.683416] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:31.684712] [INFO ] [MAIN ] LGI: Generated 1820 derivative records from 10308 primary records. [2025-09-19T22:22:31.686007] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-19T22:22:31.712082] [DEBUG] [LOCAL ] LFT: Derivative data saved (1820 records). [2025-09-19T22:22:31.716671] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-19T22:22:31.721637] [INFO ] [MAIN ] Derivative Progress: 1093/2093 symbols completed. LFT took 1.2s. Estimated remaining: 6m 29s. Rate: 154.1 symbols/min [2025-09-19T22:22:31.721820] [DEBUG] [LOCAL ] LGI: Derivative data saved (1820 records). [2025-09-19T22:22:31.721914] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-19T22:22:31.724563] [INFO ] [MAIN ] Derivative Progress: 1094/2093 symbols completed. LGI took 1.2s. Estimated remaining: 6m 29s. Rate: 154.3 symbols/min [2025-09-19T22:22:31.742243] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:31.742986] [INFO ] [MAIN ] LEVI: Generated 1820 derivative records from 52245 primary records. [2025-09-19T22:22:31.743117] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-19T22:22:31.761117] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1820 records). [2025-09-19T22:22:31.761279] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-19T22:22:31.764899] [INFO ] [MAIN ] Derivative Progress: 1095/2093 symbols completed. LEVI took 1.2s. Estimated remaining: 6m 28s. Rate: 154.4 symbols/min [2025-09-19T22:22:31.765578] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:31.765950] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:31.766043] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:31.799028] [DEBUG] [LOCAL ] LII: Loaded 29065 existing records from primary storage. [2025-09-19T22:22:31.799262] [INFO ] [MAIN ] LII: Loaded 29065 primary data records. [2025-09-19T22:22:31.975091] [DEBUG] [LOCAL ] LH: Loaded 39293 existing records from primary storage. [2025-09-19T22:22:32.013934] [INFO ] [MAIN ] LH: Loaded 39293 primary data records. [2025-09-19T22:22:32.031061] [DEBUG] [LOCAL ] LHX: Loaded 49633 existing records from primary storage. [2025-09-19T22:22:32.037479] [INFO ] [MAIN ] LHX: Loaded 49633 primary data records. [2025-09-19T22:22:32.841465] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:32.843502] [INFO ] [MAIN ] LII: Generated 1820 derivative records from 29065 primary records. [2025-09-19T22:22:32.843780] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-19T22:22:32.864900] [DEBUG] [LOCAL ] LII: Derivative data saved (1820 records). [2025-09-19T22:22:32.865329] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-19T22:22:32.879863] [INFO ] [MAIN ] Derivative Progress: 1096/2093 symbols completed. LII took 1.1s. Estimated remaining: 6m 28s. Rate: 154.1 symbols/min [2025-09-19T22:22:32.880593] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:32.881691] [INFO ] [MAIN ] LH: Generated 1820 derivative records from 39293 primary records. [2025-09-19T22:22:32.881881] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-19T22:22:32.881970] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:32.914991] [DEBUG] [LOCAL ] LH: Derivative data saved (1820 records). [2025-09-19T22:22:32.915318] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:32.915543] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-19T22:22:32.916351] [INFO ] [MAIN ] LHX: Generated 1820 derivative records from 49633 primary records. [2025-09-19T22:22:32.916440] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-19T22:22:32.918635] [INFO ] [MAIN ] Derivative Progress: 1097/2093 symbols completed. LH took 1.2s. Estimated remaining: 6m 27s. Rate: 154.3 symbols/min [2025-09-19T22:22:32.919699] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:32.935873] [DEBUG] [LOCAL ] LHX: Derivative data saved (1820 records). [2025-09-19T22:22:32.937320] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-19T22:22:32.951899] [INFO ] [MAIN ] Derivative Progress: 1098/2093 symbols completed. LHX took 1.2s. Estimated remaining: 6m 27s. Rate: 154.4 symbols/min [2025-09-19T22:22:32.952182] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:32.956037] [DEBUG] [LOCAL ] LITB: Loaded 4328 existing records from primary storage. [2025-09-19T22:22:32.956246] [INFO ] [MAIN ] LITB: Loaded 4328 primary data records. [2025-09-19T22:22:33.085741] [DEBUG] [LOCAL ] LION: Loaded 43038 existing records from primary storage. [2025-09-19T22:22:33.107317] [INFO ] [MAIN ] LION: Loaded 43038 primary data records. [2025-09-19T22:22:33.645570] [DEBUG] [LOCAL ] LLY: Loaded 54077 existing records from primary storage. [2025-09-19T22:22:33.654288] [INFO ] [MAIN ] LLY: Loaded 54077 primary data records. [2025-09-19T22:22:33.983223] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:33.984929] [INFO ] [MAIN ] LITB: Generated 1820 derivative records from 4328 primary records. [2025-09-19T22:22:33.988782] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-19T22:22:34.018291] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:34.017618] [DEBUG] [LOCAL ] LITB: Derivative data saved (1820 records). [2025-09-19T22:22:34.020478] [INFO ] [MAIN ] LION: Generated 1820 derivative records from 43038 primary records. [2025-09-19T22:22:34.020725] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-19T22:22:34.020785] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-19T22:22:34.023497] [INFO ] [MAIN ] Derivative Progress: 1099/2093 symbols completed. LITB took 1.1s. Estimated remaining: 6m 27s. Rate: 154.1 symbols/min [2025-09-19T22:22:34.024540] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:34.039735] [DEBUG] [LOCAL ] LION: Derivative data saved (1820 records). [2025-09-19T22:22:34.039831] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-19T22:22:34.042102] [INFO ] [MAIN ] Derivative Progress: 1100/2093 symbols completed. LION took 1.2s. Estimated remaining: 6m 26s. Rate: 154.3 symbols/min [2025-09-19T22:22:34.043006] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:34.061039] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:34.061753] [INFO ] [MAIN ] LLY: Generated 1820 derivative records from 54077 primary records. [2025-09-19T22:22:34.061861] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-19T22:22:34.081036] [DEBUG] [LOCAL ] LLY: Derivative data saved (1820 records). [2025-09-19T22:22:34.081236] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-19T22:22:34.083974] [INFO ] [MAIN ] Derivative Progress: 1101/2093 symbols completed. LLY took 1.1s. Estimated remaining: 6m 25s. Rate: 154.4 symbols/min [2025-09-19T22:22:34.084409] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:34.150847] [DEBUG] [LOCAL ] LMT: Loaded 50702 existing records from primary storage. [2025-09-19T22:22:34.152330] [INFO ] [MAIN ] LMT: Loaded 50702 primary data records. [2025-09-19T22:22:34.153385] [DEBUG] [LOCAL ] LMND: Loaded 52648 existing records from primary storage. [2025-09-19T22:22:34.185005] [INFO ] [MAIN ] LMND: Loaded 52648 primary data records. [2025-09-19T22:22:34.548133] [DEBUG] [LOCAL ] LNC: Loaded 52409 existing records from primary storage. [2025-09-19T22:22:34.550834] [INFO ] [MAIN ] LNC: Loaded 52409 primary data records. [2025-09-19T22:22:35.162136] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:35.163596] [INFO ] [MAIN ] LMND: Generated 1820 derivative records from 52648 primary records. [2025-09-19T22:22:35.163910] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-19T22:22:35.187017] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:22:35.192108] [INFO ] [MAIN ] LMT: Generated 1819 derivative records from 50702 primary records. [2025-09-19T22:22:35.192748] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-19T22:22:35.197808] [DEBUG] [LOCAL ] LMND: Derivative data saved (1820 records). [2025-09-19T22:22:35.198371] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-19T22:22:35.200503] [INFO ] [MAIN ] Derivative Progress: 1102/2093 symbols completed. LMND took 1.2s. Estimated remaining: 6m 26s. Rate: 154.1 symbols/min [2025-09-19T22:22:35.200787] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:35.230275] [DEBUG] [LOCAL ] LMT: Derivative data saved (1819 records). [2025-09-19T22:22:35.235720] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-19T22:22:35.239058] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:35.238552] [INFO ] [MAIN ] Derivative Progress: 1103/2093 symbols completed. LMT took 1.2s. Estimated remaining: 6m 25s. Rate: 154.3 symbols/min [2025-09-19T22:22:35.239835] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:35.244270] [DEBUG] [LOCAL ] LND: Loaded 5257 existing records from primary storage. [2025-09-19T22:22:35.240835] [INFO ] [MAIN ] LNC: Generated 1820 derivative records from 52409 primary records. [2025-09-19T22:22:35.244401] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-19T22:22:35.245611] [INFO ] [MAIN ] LND: Loaded 5257 primary data records. [2025-09-19T22:22:35.283303] [DEBUG] [LOCAL ] LNC: Derivative data saved (1820 records). [2025-09-19T22:22:35.301230] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-19T22:22:35.303907] [INFO ] [MAIN ] Derivative Progress: 1104/2093 symbols completed. LNC took 1.2s. Estimated remaining: 6m 24s. Rate: 154.4 symbols/min [2025-09-19T22:22:35.309431] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:35.491020] [DEBUG] [LOCAL ] LNN: Loaded 11397 existing records from primary storage. [2025-09-19T22:22:35.491361] [INFO ] [MAIN ] LNN: Loaded 11397 primary data records. [2025-09-19T22:22:35.740794] [DEBUG] [LOCAL ] LNG: Loaded 52311 existing records from primary storage. [2025-09-19T22:22:35.765023] [INFO ] [MAIN ] LNG: Loaded 52311 primary data records. [2025-09-19T22:22:36.324738] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:36.326810] [INFO ] [MAIN ] LND: Generated 1820 derivative records from 5257 primary records. [2025-09-19T22:22:36.327010] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-19T22:22:36.348471] [DEBUG] [LOCAL ] LND: Derivative data saved (1820 records). [2025-09-19T22:22:36.361895] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-19T22:22:36.362637] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:36.365599] [INFO ] [MAIN ] Derivative Progress: 1105/2093 symbols completed. LND took 1.2s. Estimated remaining: 6m 25s. Rate: 154.1 symbols/min [2025-09-19T22:22:36.367544] [INFO ] [MAIN ] LNN: Generated 1820 derivative records from 11397 primary records. [2025-09-19T22:22:36.366741] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:36.367872] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-19T22:22:36.402802] [DEBUG] [LOCAL ] LNN: Derivative data saved (1820 records). [2025-09-19T22:22:36.401407] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:36.403063] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-19T22:22:36.403934] [INFO ] [MAIN ] LNG: Generated 1820 derivative records from 52311 primary records. [2025-09-19T22:22:36.406105] [INFO ] [MAIN ] Derivative Progress: 1106/2093 symbols completed. LNN took 1.1s. Estimated remaining: 6m 24s. Rate: 154.3 symbols/min [2025-09-19T22:22:36.406315] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-19T22:22:36.406623] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:36.425331] [DEBUG] [LOCAL ] LNG: Derivative data saved (1820 records). [2025-09-19T22:22:36.425577] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-19T22:22:36.428331] [INFO ] [MAIN ] Derivative Progress: 1107/2093 symbols completed. LNG took 1.2s. Estimated remaining: 6m 23s. Rate: 154.4 symbols/min [2025-09-19T22:22:36.428738] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:36.445836] [DEBUG] [LOCAL ] LOCL: Loaded 3558 existing records from primary storage. [2025-09-19T22:22:36.452325] [INFO ] [MAIN ] LOCL: Loaded 3558 primary data records. [2025-09-19T22:22:36.582696] [DEBUG] [LOCAL ] LOAR: Loaded 42056 existing records from primary storage. [2025-09-19T22:22:36.593936] [DEBUG] [LOCAL ] LOB: Loaded 27973 existing records from primary storage. [2025-09-19T22:22:36.599168] [INFO ] [MAIN ] LOAR: Loaded 42056 primary data records. [2025-09-19T22:22:36.631055] [INFO ] [MAIN ] LOB: Loaded 27973 primary data records. [2025-09-19T22:22:37.602862] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:37.606778] [INFO ] [MAIN ] LOCL: Generated 1820 derivative records from 3558 primary records. [2025-09-19T22:22:37.608956] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-19T22:22:37.633247] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1820 records). [2025-09-19T22:22:37.633990] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-19T22:22:37.637523] [INFO ] [MAIN ] Derivative Progress: 1108/2093 symbols completed. LOCL took 1.2s. Estimated remaining: 6m 23s. Rate: 154.1 symbols/min [2025-09-19T22:22:37.662368] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:37.664399] [INFO ] [MAIN ] LOB: Generated 1820 derivative records from 27973 primary records. [2025-09-19T22:22:37.664567] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-19T22:22:37.702309] [DEBUG] [LOCAL ] LOB: Derivative data saved (1820 records). [2025-09-19T22:22:37.702809] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:37.703102] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-19T22:22:37.707127] [INFO ] [MAIN ] Derivative Progress: 1109/2093 symbols completed. LOB took 1.3s. Estimated remaining: 6m 23s. Rate: 154.2 symbols/min [2025-09-19T22:22:37.704189] [INFO ] [MAIN ] LOAR: Generated 1820 derivative records from 42056 primary records. [2025-09-19T22:22:37.707606] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-19T22:22:37.732154] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1820 records). [2025-09-19T22:22:37.732312] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-19T22:22:37.735459] [INFO ] [MAIN ] Derivative Progress: 1110/2093 symbols completed. LOAR took 1.4s. Estimated remaining: 6m 22s. Rate: 154.4 symbols/min [2025-09-19T22:22:37.736204] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:37.736584] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:37.737417] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:37.802111] [DEBUG] [LOCAL ] LOMA: Loaded 32010 existing records from primary storage. [2025-09-19T22:22:37.825719] [INFO ] [MAIN ] LOMA: Loaded 32010 primary data records. [2025-09-19T22:22:37.912227] [DEBUG] [LOCAL ] LPG: Loaded 40939 existing records from primary storage. [2025-09-19T22:22:37.940098] [INFO ] [MAIN ] LPG: Loaded 40939 primary data records. [2025-09-19T22:22:38.038165] [DEBUG] [LOCAL ] LOW: Loaded 53729 existing records from primary storage. [2025-09-19T22:22:38.076356] [INFO ] [MAIN ] LOW: Loaded 53729 primary data records. [2025-09-19T22:22:38.966224] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:38.967439] [INFO ] [MAIN ] LOMA: Generated 1820 derivative records from 32010 primary records. [2025-09-19T22:22:38.967969] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-19T22:22:39.003939] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1820 records). [2025-09-19T22:22:39.004574] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-19T22:22:39.004346] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:39.006591] [INFO ] [MAIN ] Derivative Progress: 1111/2093 symbols completed. LOMA took 1.3s. Estimated remaining: 6m 23s. Rate: 154.0 symbols/min [2025-09-19T22:22:39.015163] [INFO ] [MAIN ] LOW: Generated 1820 derivative records from 53729 primary records. [2025-09-19T22:22:39.015318] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:39.020899] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:39.020394] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-19T22:22:39.022414] [INFO ] [MAIN ] LPG: Generated 1820 derivative records from 40939 primary records. [2025-09-19T22:22:39.022894] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-19T22:22:39.053092] [DEBUG] [LOCAL ] LPG: Derivative data saved (1820 records). [2025-09-19T22:22:39.054442] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-19T22:22:39.056945] [INFO ] [MAIN ] Derivative Progress: 1112/2093 symbols completed. LPG took 1.3s. Estimated remaining: 6m 22s. Rate: 154.2 symbols/min [2025-09-19T22:22:39.054373] [DEBUG] [LOCAL ] LOW: Derivative data saved (1820 records). [2025-09-19T22:22:39.057324] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:39.057545] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-19T22:22:39.060475] [INFO ] [MAIN ] Derivative Progress: 1113/2093 symbols completed. LOW took 1.3s. Estimated remaining: 6m 21s. Rate: 154.3 symbols/min [2025-09-19T22:22:39.060847] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:39.082949] [DEBUG] [LOCAL ] LPL: Loaded 25507 existing records from primary storage. [2025-09-19T22:22:39.083185] [INFO ] [MAIN ] LPL: Loaded 25507 primary data records. [2025-09-19T22:22:39.256760] [DEBUG] [LOCAL ] LPX: Loaded 40396 existing records from primary storage. [2025-09-19T22:22:39.268124] [INFO ] [MAIN ] LPX: Loaded 40396 primary data records. [2025-09-19T22:22:39.294635] [DEBUG] [LOCAL ] LRN: Loaded 40764 existing records from primary storage. [2025-09-19T22:22:39.333832] [INFO ] [MAIN ] LRN: Loaded 40764 primary data records. [2025-09-19T22:22:40.162033] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:40.163762] [INFO ] [MAIN ] LPL: Generated 1820 derivative records from 25507 primary records. [2025-09-19T22:22:40.164247] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-19T22:22:40.186435] [DEBUG] [LOCAL ] LPL: Derivative data saved (1820 records). [2025-09-19T22:22:40.187334] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-19T22:22:40.189585] [INFO ] [MAIN ] Derivative Progress: 1114/2093 symbols completed. LPL took 1.2s. Estimated remaining: 6m 21s. Rate: 154.0 symbols/min [2025-09-19T22:22:40.199183] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:40.204744] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:40.205892] [INFO ] [MAIN ] LRN: Generated 1820 derivative records from 40764 primary records. [2025-09-19T22:22:40.222733] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-19T22:22:40.224894] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:40.234375] [INFO ] [MAIN ] LPX: Generated 1820 derivative records from 40396 primary records. [2025-09-19T22:22:40.237319] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-19T22:22:40.252261] [DEBUG] [LOCAL ] LRN: Derivative data saved (1820 records). [2025-09-19T22:22:40.252424] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-19T22:22:40.257612] [INFO ] [MAIN ] Derivative Progress: 1115/2093 symbols completed. LRN took 1.2s. Estimated remaining: 6m 21s. Rate: 154.1 symbols/min [2025-09-19T22:22:40.261879] [DEBUG] [LOCAL ] LPX: Derivative data saved (1820 records). [2025-09-19T22:22:40.262375] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-19T22:22:40.262131] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:40.265835] [INFO ] [MAIN ] Derivative Progress: 1116/2093 symbols completed. LPX took 1.2s. Estimated remaining: 6m 20s. Rate: 154.3 symbols/min [2025-09-19T22:22:40.266383] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:40.312575] [DEBUG] [LOCAL ] LSPD: Loaded 44246 existing records from primary storage. [2025-09-19T22:22:40.312929] [INFO ] [MAIN ] LSPD: Loaded 44246 primary data records. [2025-09-19T22:22:40.469351] [DEBUG] [LOCAL ] LTC: Loaded 30403 existing records from primary storage. [2025-09-19T22:22:40.469844] [INFO ] [MAIN ] LTC: Loaded 30403 primary data records. [2025-09-19T22:22:40.487225] [DEBUG] [LOCAL ] LTH: Loaded 52690 existing records from primary storage. [2025-09-19T22:22:40.530606] [INFO ] [MAIN ] LTH: Loaded 52690 primary data records. [2025-09-19T22:22:41.342764] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:41.344586] [INFO ] [MAIN ] LSPD: Generated 1820 derivative records from 44246 primary records. [2025-09-19T22:22:41.344896] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-19T22:22:41.360192] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:41.375205] [INFO ] [MAIN ] LTC: Generated 1820 derivative records from 30403 primary records. [2025-09-19T22:22:41.377527] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-19T22:22:41.377682] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1820 records). [2025-09-19T22:22:41.378807] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-19T22:22:41.381187] [INFO ] [MAIN ] Derivative Progress: 1117/2093 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 20s. Rate: 154.0 symbols/min [2025-09-19T22:22:41.391331] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:41.400810] [DEBUG] [LOCAL ] LTC: Derivative data saved (1820 records). [2025-09-19T22:22:41.401613] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-19T22:22:41.404834] [INFO ] [MAIN ] Derivative Progress: 1118/2093 symbols completed. LTC took 1.1s. Estimated remaining: 6m 19s. Rate: 154.2 symbols/min [2025-09-19T22:22:41.413198] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:41.419101] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:41.419988] [INFO ] [MAIN ] LTH: Generated 1820 derivative records from 52690 primary records. [2025-09-19T22:22:41.420252] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-19T22:22:41.437251] [DEBUG] [LOCAL ] LTH: Derivative data saved (1820 records). [2025-09-19T22:22:41.437406] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-19T22:22:41.439808] [INFO ] [MAIN ] Derivative Progress: 1119/2093 symbols completed. LTH took 1.2s. Estimated remaining: 6m 19s. Rate: 154.3 symbols/min [2025-09-19T22:22:41.440146] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:41.480799] [DEBUG] [LOCAL ] LTM: Loaded 36215 existing records from primary storage. [2025-09-19T22:22:41.481031] [INFO ] [MAIN ] LTM: Loaded 36215 primary data records. [2025-09-19T22:22:41.635111] [DEBUG] [LOCAL ] LU: Loaded 49686 existing records from primary storage. [2025-09-19T22:22:41.664020] [INFO ] [MAIN ] LU: Loaded 49686 primary data records. [2025-09-19T22:22:41.898782] [DEBUG] [LOCAL ] LUMN: Loaded 54414 existing records from primary storage. [2025-09-19T22:22:41.912709] [INFO ] [MAIN ] LUMN: Loaded 54414 primary data records. [2025-09-19T22:22:42.578535] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:42.580529] [INFO ] [MAIN ] LTM: Generated 1820 derivative records from 36215 primary records. [2025-09-19T22:22:42.581517] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-19T22:22:42.615130] [DEBUG] [LOCAL ] LTM: Derivative data saved (1820 records). [2025-09-19T22:22:42.620405] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-19T22:22:42.620738] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:42.621669] [INFO ] [MAIN ] LU: Generated 1820 derivative records from 49686 primary records. [2025-09-19T22:22:42.623935] [INFO ] [MAIN ] Derivative Progress: 1120/2093 symbols completed. LTM took 1.2s. Estimated remaining: 6m 19s. Rate: 154.0 symbols/min [2025-09-19T22:22:42.624440] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-19T22:22:42.625185] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:42.645357] [DEBUG] [LOCAL ] LU: Derivative data saved (1820 records). [2025-09-19T22:22:42.647732] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-19T22:22:42.650637] [INFO ] [MAIN ] Derivative Progress: 1121/2093 symbols completed. LU took 1.2s. Estimated remaining: 6m 18s. Rate: 154.1 symbols/min [2025-09-19T22:22:42.651335] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:42.666372] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:42.667244] [INFO ] [MAIN ] LUMN: Generated 1820 derivative records from 54414 primary records. [2025-09-19T22:22:42.667391] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-19T22:22:42.685135] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1820 records). [2025-09-19T22:22:42.685362] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-19T22:22:42.687831] [INFO ] [MAIN ] Derivative Progress: 1122/2093 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 18s. Rate: 154.2 symbols/min [2025-09-19T22:22:42.688283] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:42.735347] [DEBUG] [LOCAL ] LVWR: Loaded 17439 existing records from primary storage. [2025-09-19T22:22:42.750568] [INFO ] [MAIN ] LVWR: Loaded 17439 primary data records. [2025-09-19T22:22:42.784552] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-09-19T22:22:42.790576] [INFO ] [MAIN ] LUV: Loaded 54469 primary data records. [2025-09-19T22:22:42.933347] [DEBUG] [LOCAL ] LVS: Loaded 54347 existing records from primary storage. [2025-09-19T22:22:42.949043] [INFO ] [MAIN ] LVS: Loaded 54347 primary data records. [2025-09-19T22:22:43.769507] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:43.771867] [INFO ] [MAIN ] LVWR: Generated 1820 derivative records from 17439 primary records. [2025-09-19T22:22:43.772061] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-19T22:22:43.798921] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:43.805302] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1820 records). [2025-09-19T22:22:43.804401] [INFO ] [MAIN ] LUV: Generated 1820 derivative records from 54469 primary records. [2025-09-19T22:22:43.805532] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-19T22:22:43.805724] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-19T22:22:43.807510] [INFO ] [MAIN ] Derivative Progress: 1123/2093 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 18s. Rate: 154.0 symbols/min [2025-09-19T22:22:43.829412] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:43.833865] [INFO ] [MAIN ] LVS: Generated 1820 derivative records from 54347 primary records. [2025-09-19T22:22:43.838434] [DEBUG] [LOCAL ] LUV: Derivative data saved (1820 records). [2025-09-19T22:22:43.838520] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-19T22:22:43.841118] [INFO ] [MAIN ] Derivative Progress: 1124/2093 symbols completed. LUV took 1.2s. Estimated remaining: 6m 17s. Rate: 154.1 symbols/min [2025-09-19T22:22:43.836614] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-19T22:22:43.857577] [DEBUG] [LOCAL ] LVS: Derivative data saved (1820 records). [2025-09-19T22:22:43.857660] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-19T22:22:43.860016] [INFO ] [MAIN ] Derivative Progress: 1125/2093 symbols completed. LVS took 1.2s. Estimated remaining: 6m 17s. Rate: 154.2 symbols/min [2025-09-19T22:22:43.860523] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:43.860827] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:43.860738] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:43.887090] [DEBUG] [LOCAL ] LXFR: Loaded 17450 existing records from primary storage. [2025-09-19T22:22:43.887226] [INFO ] [MAIN ] LXFR: Loaded 17450 primary data records. [2025-09-19T22:22:44.071599] [DEBUG] [LOCAL ] LXP: Loaded 51359 existing records from primary storage. [2025-09-19T22:22:44.145436] [INFO ] [MAIN ] LXP: Loaded 51359 primary data records. [2025-09-19T22:22:44.266754] [DEBUG] [LOCAL ] LW: Loaded 52035 existing records from primary storage. [2025-09-19T22:22:44.275754] [INFO ] [MAIN ] LW: Loaded 52035 primary data records. [2025-09-19T22:22:45.004707] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:45.006401] [INFO ] [MAIN ] LXFR: Generated 1820 derivative records from 17450 primary records. [2025-09-19T22:22:45.007410] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-19T22:22:45.027891] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1820 records). [2025-09-19T22:22:45.028435] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-19T22:22:45.030945] [INFO ] [MAIN ] Derivative Progress: 1126/2093 symbols completed. LXFR took 1.2s. Estimated remaining: 6m 17s. Rate: 154.0 symbols/min [2025-09-19T22:22:45.033129] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:45.054586] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:45.057685] [INFO ] [MAIN ] LXP: Generated 1820 derivative records from 51359 primary records. [2025-09-19T22:22:45.058962] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-19T22:22:45.087092] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:45.089088] [INFO ] [MAIN ] LW: Generated 1820 derivative records from 52035 primary records. [2025-09-19T22:22:45.099199] [DEBUG] [LOCAL ] LXP: Derivative data saved (1820 records). [2025-09-19T22:22:45.099679] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-19T22:22:45.099532] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-19T22:22:45.102857] [INFO ] [MAIN ] Derivative Progress: 1127/2093 symbols completed. LXP took 1.2s. Estimated remaining: 6m 16s. Rate: 154.1 symbols/min [2025-09-19T22:22:45.104084] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:45.122141] [DEBUG] [LOCAL ] LW: Derivative data saved (1820 records). [2025-09-19T22:22:45.132090] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-19T22:22:45.134972] [INFO ] [MAIN ] Derivative Progress: 1128/2093 symbols completed. LW took 1.3s. Estimated remaining: 6m 15s. Rate: 154.2 symbols/min [2025-09-19T22:22:45.136350] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:45.136489] [DEBUG] [LOCAL ] LXU: Loaded 32691 existing records from primary storage. [2025-09-19T22:22:45.137127] [INFO ] [MAIN ] LXU: Loaded 32691 primary data records. [2025-09-19T22:22:45.516698] [DEBUG] [LOCAL ] LYB: Loaded 54378 existing records from primary storage. [2025-09-19T22:22:45.517848] [INFO ] [MAIN ] LYB: Loaded 54378 primary data records. [2025-09-19T22:22:45.645420] [DEBUG] [LOCAL ] LYG: Loaded 53679 existing records from primary storage. [2025-09-19T22:22:45.645974] [INFO ] [MAIN ] LYG: Loaded 53679 primary data records. [2025-09-19T22:22:46.186350] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:46.187525] [INFO ] [MAIN ] LXU: Generated 1820 derivative records from 32691 primary records. [2025-09-19T22:22:46.188748] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-19T22:22:46.207739] [DEBUG] [LOCAL ] LXU: Derivative data saved (1820 records). [2025-09-19T22:22:46.208053] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-19T22:22:46.210468] [INFO ] [MAIN ] Derivative Progress: 1129/2093 symbols completed. LXU took 1.2s. Estimated remaining: 6m 16s. Rate: 154.0 symbols/min [2025-09-19T22:22:46.210864] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:46.230867] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:46.231586] [INFO ] [MAIN ] LYB: Generated 1820 derivative records from 54378 primary records. [2025-09-19T22:22:46.231818] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-19T22:22:46.252234] [DEBUG] [LOCAL ] LYB: Derivative data saved (1820 records). [2025-09-19T22:22:46.252511] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-19T22:22:46.255160] [INFO ] [MAIN ] Derivative Progress: 1130/2093 symbols completed. LYB took 1.2s. Estimated remaining: 6m 15s. Rate: 154.1 symbols/min [2025-09-19T22:22:46.268131] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:46.268464] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:46.269581] [INFO ] [MAIN ] LYG: Generated 1820 derivative records from 53679 primary records. [2025-09-19T22:22:46.269696] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-19T22:22:46.301926] [DEBUG] [LOCAL ] LYG: Derivative data saved (1820 records). [2025-09-19T22:22:46.302834] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-19T22:22:46.317851] [INFO ] [MAIN ] Derivative Progress: 1131/2093 symbols completed. LYG took 1.2s. Estimated remaining: 6m 14s. Rate: 154.2 symbols/min [2025-09-19T22:22:46.319219] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:46.321136] [DEBUG] [LOCAL ] LYV: Loaded 52036 existing records from primary storage. [2025-09-19T22:22:46.321454] [INFO ] [MAIN ] LYV: Loaded 52036 primary data records. [2025-09-19T22:22:46.448033] [DEBUG] [LOCAL ] LZM: Loaded 13614 existing records from primary storage. [2025-09-19T22:22:46.472829] [INFO ] [MAIN ] LZM: Loaded 13614 primary data records. [2025-09-19T22:22:46.568192] [DEBUG] [LOCAL ] LZB: Loaded 36007 existing records from primary storage. [2025-09-19T22:22:46.657316] [INFO ] [MAIN ] LZB: Loaded 36007 primary data records. [2025-09-19T22:22:47.319101] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:47.319935] [INFO ] [MAIN ] LYV: Generated 1820 derivative records from 52036 primary records. [2025-09-19T22:22:47.320305] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-19T22:22:47.357090] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:47.359882] [DEBUG] [LOCAL ] LYV: Derivative data saved (1820 records). [2025-09-19T22:22:47.360743] [INFO ] [MAIN ] LZM: Generated 1820 derivative records from 13614 primary records. [2025-09-19T22:22:47.360862] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-19T22:22:47.361071] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-19T22:22:47.363994] [INFO ] [MAIN ] Derivative Progress: 1132/2093 symbols completed. LYV took 1.2s. Estimated remaining: 6m 14s. Rate: 154.0 symbols/min [2025-09-19T22:22:47.364288] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:47.397764] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:47.399825] [INFO ] [MAIN ] LZB: Generated 1820 derivative records from 36007 primary records. [2025-09-19T22:22:47.399974] [DEBUG] [LOCAL ] LZM: Derivative data saved (1820 records). [2025-09-19T22:22:47.400190] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-19T22:22:47.400304] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-19T22:22:47.403308] [INFO ] [MAIN ] Derivative Progress: 1133/2093 symbols completed. LZM took 1.1s. Estimated remaining: 6m 14s. Rate: 154.1 symbols/min [2025-09-19T22:22:47.411874] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:47.422058] [DEBUG] [LOCAL ] LZB: Derivative data saved (1820 records). [2025-09-19T22:22:47.422252] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-19T22:22:47.425339] [INFO ] [MAIN ] Derivative Progress: 1134/2093 symbols completed. LZB took 1.2s. Estimated remaining: 6m 13s. Rate: 154.2 symbols/min [2025-09-19T22:22:47.425747] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:47.472708] [DEBUG] [LOCAL ] M: Loaded 54315 existing records from primary storage. [2025-09-19T22:22:47.472935] [INFO ] [MAIN ] M: Loaded 54315 primary data records. [2025-09-19T22:22:47.827960] [DEBUG] [LOCAL ] MAA: Loaded 43601 existing records from primary storage. [2025-09-19T22:22:47.828174] [INFO ] [MAIN ] MAA: Loaded 43601 primary data records. [2025-09-19T22:22:47.829319] [DEBUG] [LOCAL ] MA: Loaded 53357 existing records from primary storage. [2025-09-19T22:22:47.829487] [INFO ] [MAIN ] MA: Loaded 53357 primary data records. [2025-09-19T22:22:48.518133] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:48.519188] [INFO ] [MAIN ] M: Generated 1820 derivative records from 54315 primary records. [2025-09-19T22:22:48.519342] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-19T22:22:48.539601] [DEBUG] [LOCAL ] M: Derivative data saved (1820 records). [2025-09-19T22:22:48.540229] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-19T22:22:48.542728] [INFO ] [MAIN ] Derivative Progress: 1135/2093 symbols completed. M took 1.2s. Estimated remaining: 6m 13s. Rate: 154.0 symbols/min [2025-09-19T22:22:48.543366] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:48.576083] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:48.575833] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:48.577477] [INFO ] [MAIN ] MA: Generated 1820 derivative records from 53357 primary records. [2025-09-19T22:22:48.576908] [INFO ] [MAIN ] MAA: Generated 1820 derivative records from 43601 primary records. [2025-09-19T22:22:48.577629] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-19T22:22:48.577705] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-19T22:22:48.616242] [DEBUG] [LOCAL ] MA: Derivative data saved (1820 records). [2025-09-19T22:22:48.613929] [DEBUG] [LOCAL ] MAA: Derivative data saved (1820 records). [2025-09-19T22:22:48.616498] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-19T22:22:48.616591] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-19T22:22:48.618433] [INFO ] [MAIN ] Derivative Progress: 1136/2093 symbols completed. MAA took 1.2s. Estimated remaining: 6m 13s. Rate: 154.1 symbols/min [2025-09-19T22:22:48.621720] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:48.621616] [INFO ] [MAIN ] Derivative Progress: 1137/2093 symbols completed. MA took 1.2s. Estimated remaining: 6m 12s. Rate: 154.2 symbols/min [2025-09-19T22:22:48.622361] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:48.664019] [DEBUG] [LOCAL ] MAC: Loaded 50480 existing records from primary storage. [2025-09-19T22:22:48.673204] [INFO ] [MAIN ] MAC: Loaded 50480 primary data records. [2025-09-19T22:22:48.796231] [DEBUG] [LOCAL ] MAGN: Loaded 35554 existing records from primary storage. [2025-09-19T22:22:48.809246] [INFO ] [MAIN ] MAGN: Loaded 35554 primary data records. [2025-09-19T22:22:48.950863] [DEBUG] [LOCAL ] MAIN: Loaded 42093 existing records from primary storage. [2025-09-19T22:22:49.001779] [INFO ] [MAIN ] MAIN: Loaded 42093 primary data records. [2025-09-19T22:22:49.693978] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:49.695229] [INFO ] [MAIN ] MAC: Generated 1820 derivative records from 50480 primary records. [2025-09-19T22:22:49.695331] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-19T22:22:49.725317] [DEBUG] [LOCAL ] MAC: Derivative data saved (1820 records). [2025-09-19T22:22:49.730408] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-19T22:22:49.732548] [INFO ] [MAIN ] Derivative Progress: 1138/2093 symbols completed. MAC took 1.2s. Estimated remaining: 6m 12s. Rate: 154.0 symbols/min [2025-09-19T22:22:49.732973] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:49.734327] [INFO ] [MAIN ] MAGN: Generated 1820 derivative records from 35554 primary records. [2025-09-19T22:22:49.734492] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-19T22:22:49.767614] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1820 records). [2025-09-19T22:22:49.767963] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:49.768125] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-19T22:22:49.768841] [INFO ] [MAIN ] MAIN: Generated 1820 derivative records from 42093 primary records. [2025-09-19T22:22:49.772057] [INFO ] [MAIN ] Derivative Progress: 1139/2093 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 11s. Rate: 154.1 symbols/min [2025-09-19T22:22:49.772284] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-19T22:22:49.789576] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1820 records). [2025-09-19T22:22:49.789639] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-19T22:22:49.792188] [INFO ] [MAIN ] Derivative Progress: 1140/2093 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 11s. Rate: 154.2 symbols/min [2025-09-19T22:22:49.792688] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:49.792943] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:49.792839] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:49.825088] [DEBUG] [LOCAL ] MANU: Loaded 27676 existing records from primary storage. [2025-09-19T22:22:49.835686] [INFO ] [MAIN ] MANU: Loaded 27676 primary data records. [2025-09-19T22:22:49.981251] [DEBUG] [LOCAL ] MAN: Loaded 44330 existing records from primary storage. [2025-09-19T22:22:49.981522] [INFO ] [MAIN ] MAN: Loaded 44330 primary data records. [2025-09-19T22:22:50.093692] [DEBUG] [LOCAL ] MAS: Loaded 53128 existing records from primary storage. [2025-09-19T22:22:50.180764] [INFO ] [MAIN ] MAS: Loaded 53128 primary data records. [2025-09-19T22:22:50.914332] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:50.915801] [INFO ] [MAIN ] MANU: Generated 1820 derivative records from 27676 primary records. [2025-09-19T22:22:50.916683] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-19T22:22:50.937282] [DEBUG] [LOCAL ] MANU: Derivative data saved (1820 records). [2025-09-19T22:22:50.943100] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-19T22:22:50.945143] [INFO ] [MAIN ] Derivative Progress: 1141/2093 symbols completed. MANU took 1.2s. Estimated remaining: 6m 11s. Rate: 153.9 symbols/min [2025-09-19T22:22:50.945686] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:50.958298] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:50.959473] [INFO ] [MAIN ] MAN: Generated 1820 derivative records from 44330 primary records. [2025-09-19T22:22:50.959607] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-19T22:22:50.978500] [DEBUG] [LOCAL ] MAN: Derivative data saved (1820 records). [2025-09-19T22:22:50.978753] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-19T22:22:50.981514] [INFO ] [MAIN ] Derivative Progress: 1142/2093 symbols completed. MAN took 1.2s. Estimated remaining: 6m 10s. Rate: 154.1 symbols/min [2025-09-19T22:22:50.989995] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:50.995560] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:50.996638] [INFO ] [MAIN ] MAS: Generated 1820 derivative records from 53128 primary records. [2025-09-19T22:22:50.996827] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-19T22:22:51.025794] [DEBUG] [LOCAL ] MAS: Derivative data saved (1820 records). [2025-09-19T22:22:51.026080] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-19T22:22:51.028523] [INFO ] [MAIN ] Derivative Progress: 1143/2093 symbols completed. MAS took 1.2s. Estimated remaining: 6m 10s. Rate: 154.2 symbols/min [2025-09-19T22:22:51.028933] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:51.058212] [DEBUG] [LOCAL ] MATX: Loaded 32049 existing records from primary storage. [2025-09-19T22:22:51.058503] [INFO ] [MAIN ] MATX: Loaded 32049 primary data records. [2025-09-19T22:22:51.189315] [DEBUG] [LOCAL ] MAX: Loaded 31616 existing records from primary storage. [2025-09-19T22:22:51.200071] [INFO ] [MAIN ] MAX: Loaded 31616 primary data records. [2025-09-19T22:22:51.531706] [DEBUG] [LOCAL ] MBC: Loaded 43804 existing records from primary storage. [2025-09-19T22:22:51.548587] [INFO ] [MAIN ] MBC: Loaded 43804 primary data records. [2025-09-19T22:22:52.107579] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:52.109355] [INFO ] [MAIN ] MATX: Generated 1820 derivative records from 32049 primary records. [2025-09-19T22:22:52.109677] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-19T22:22:52.129117] [DEBUG] [LOCAL ] MATX: Derivative data saved (1820 records). [2025-09-19T22:22:52.129394] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-19T22:22:52.133196] [INFO ] [MAIN ] Derivative Progress: 1144/2093 symbols completed. MATX took 1.2s. Estimated remaining: 6m 10s. Rate: 153.9 symbols/min [2025-09-19T22:22:52.136111] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:52.151335] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:52.152460] [INFO ] [MAIN ] MAX: Generated 1820 derivative records from 31616 primary records. [2025-09-19T22:22:52.152689] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-19T22:22:52.191636] [DEBUG] [LOCAL ] MAX: Derivative data saved (1820 records). [2025-09-19T22:22:52.197350] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:52.197158] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-19T22:22:52.198119] [INFO ] [MAIN ] MBC: Generated 1820 derivative records from 43804 primary records. [2025-09-19T22:22:52.200418] [INFO ] [MAIN ] Derivative Progress: 1145/2093 symbols completed. MAX took 1.2s. Estimated remaining: 6m 9s. Rate: 154.1 symbols/min [2025-09-19T22:22:52.207676] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-19T22:22:52.209437] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:52.210982] [DEBUG] [LOCAL ] MBI: Loaded 25442 existing records from primary storage. [2025-09-19T22:22:52.211215] [INFO ] [MAIN ] MBI: Loaded 25442 primary data records. [2025-09-19T22:22:52.265214] [DEBUG] [LOCAL ] MBC: Derivative data saved (1820 records). [2025-09-19T22:22:52.294800] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-19T22:22:52.315826] [INFO ] [MAIN ] Derivative Progress: 1146/2093 symbols completed. MBC took 1.3s. Estimated remaining: 6m 9s. Rate: 154.1 symbols/min [2025-09-19T22:22:52.338446] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:52.552727] [DEBUG] [LOCAL ] MCB: Loaded 11984 existing records from primary storage. [2025-09-19T22:22:52.553664] [INFO ] [MAIN ] MCB: Loaded 11984 primary data records. [2025-09-19T22:22:52.610784] [DEBUG] [LOCAL ] MC: Loaded 45069 existing records from primary storage. [2025-09-19T22:22:52.646233] [INFO ] [MAIN ] MC: Loaded 45069 primary data records. [2025-09-19T22:22:53.284626] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:53.286384] [INFO ] [MAIN ] MBI: Generated 1820 derivative records from 25442 primary records. [2025-09-19T22:22:53.286986] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-19T22:22:53.312549] [DEBUG] [LOCAL ] MBI: Derivative data saved (1820 records). [2025-09-19T22:22:53.312776] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-19T22:22:53.315306] [INFO ] [MAIN ] Derivative Progress: 1147/2093 symbols completed. MBI took 1.2s. Estimated remaining: 6m 9s. Rate: 153.9 symbols/min [2025-09-19T22:22:53.329061] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:53.329757] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:53.330972] [INFO ] [MAIN ] MCB: Generated 1820 derivative records from 11984 primary records. [2025-09-19T22:22:53.331305] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-19T22:22:53.352770] [DEBUG] [LOCAL ] MCB: Derivative data saved (1820 records). [2025-09-19T22:22:53.353369] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-19T22:22:53.366356] [INFO ] [MAIN ] Derivative Progress: 1148/2093 symbols completed. MCB took 1.0s. Estimated remaining: 6m 8s. Rate: 154.1 symbols/min [2025-09-19T22:22:53.371760] [DEBUG] [LOCAL ] MCI: Loaded 6425 existing records from primary storage. [2025-09-19T22:22:53.372120] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:53.372700] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:53.373070] [INFO ] [MAIN ] MCI: Loaded 6425 primary data records. [2025-09-19T22:22:53.373820] [INFO ] [MAIN ] MC: Generated 1820 derivative records from 45069 primary records. [2025-09-19T22:22:53.373926] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-19T22:22:53.609855] [DEBUG] [LOCAL ] MC: Derivative data saved (1820 records). [2025-09-19T22:22:53.611627] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-19T22:22:53.633920] [INFO ] [MAIN ] Derivative Progress: 1149/2093 symbols completed. MC took 1.4s. Estimated remaining: 6m 8s. Rate: 154.1 symbols/min [2025-09-19T22:22:53.774374] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:53.799969] [DEBUG] [LOCAL ] MCK: Loaded 40064 existing records from primary storage. [2025-09-19T22:22:53.800145] [INFO ] [MAIN ] MCK: Loaded 40064 primary data records. [2025-09-19T22:22:53.915803] [DEBUG] [LOCAL ] MCN: Loaded 8284 existing records from primary storage. [2025-09-19T22:22:53.948401] [INFO ] [MAIN ] MCN: Loaded 8284 primary data records. [2025-09-19T22:22:54.505356] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:54.507341] [INFO ] [MAIN ] MCI: Generated 1820 derivative records from 6425 primary records. [2025-09-19T22:22:54.508769] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-19T22:22:54.526610] [DEBUG] [LOCAL ] MCI: Derivative data saved (1820 records). [2025-09-19T22:22:54.527021] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-19T22:22:54.529347] [INFO ] [MAIN ] Derivative Progress: 1150/2093 symbols completed. MCI took 1.2s. Estimated remaining: 6m 8s. Rate: 153.9 symbols/min [2025-09-19T22:22:54.529779] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:54.557954] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:54.559204] [INFO ] [MAIN ] MCK: Generated 1820 derivative records from 40064 primary records. [2025-09-19T22:22:54.559596] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-19T22:22:54.601362] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:54.601525] [DEBUG] [LOCAL ] MCK: Derivative data saved (1820 records). [2025-09-19T22:22:54.601737] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-19T22:22:54.604620] [INFO ] [MAIN ] Derivative Progress: 1151/2093 symbols completed. MCK took 1.2s. Estimated remaining: 6m 7s. Rate: 154.0 symbols/min [2025-09-19T22:22:54.615057] [INFO ] [MAIN ] MCN: Generated 1820 derivative records from 8284 primary records. [2025-09-19T22:22:54.615380] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-19T22:22:54.615945] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:54.652883] [DEBUG] [LOCAL ] MCO: Loaded 40292 existing records from primary storage. [2025-09-19T22:22:54.654198] [DEBUG] [LOCAL ] MCR: Loaded 9047 existing records from primary storage. [2025-09-19T22:22:54.653865] [INFO ] [MAIN ] MCO: Loaded 40292 primary data records. [2025-09-19T22:22:54.654681] [INFO ] [MAIN ] MCR: Loaded 9047 primary data records. [2025-09-19T22:22:54.653786] [DEBUG] [LOCAL ] MCN: Derivative data saved (1820 records). [2025-09-19T22:22:54.690754] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-19T22:22:54.698388] [INFO ] [MAIN ] Derivative Progress: 1152/2093 symbols completed. MCN took 1.1s. Estimated remaining: 6m 6s. Rate: 154.1 symbols/min [2025-09-19T22:22:54.791524] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:55.318072] [DEBUG] [LOCAL ] MCS: Loaded 21782 existing records from primary storage. [2025-09-19T22:22:55.319746] [INFO ] [MAIN ] MCS: Loaded 21782 primary data records. [2025-09-19T22:22:55.650387] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:55.652204] [INFO ] [MAIN ] MCR: Generated 1820 derivative records from 9047 primary records. [2025-09-19T22:22:55.652409] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-19T22:22:55.677007] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:55.678199] [INFO ] [MAIN ] MCO: Generated 1820 derivative records from 40292 primary records. [2025-09-19T22:22:55.678750] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-19T22:22:55.696292] [DEBUG] [LOCAL ] MCR: Derivative data saved (1820 records). [2025-09-19T22:22:55.697812] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-19T22:22:55.700162] [INFO ] [MAIN ] Derivative Progress: 1153/2093 symbols completed. MCR took 1.1s. Estimated remaining: 6m 6s. Rate: 153.9 symbols/min [2025-09-19T22:22:55.702043] [DEBUG] [LOCAL ] MCO: Derivative data saved (1820 records). [2025-09-19T22:22:55.702149] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-19T22:22:55.705323] [INFO ] [MAIN ] Derivative Progress: 1154/2093 symbols completed. MCO took 1.2s. Estimated remaining: 6m 6s. Rate: 154.1 symbols/min [2025-09-19T22:22:55.720248] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:55.720820] [INFO ] [MAIN ] MCS: Generated 1820 derivative records from 21782 primary records. [2025-09-19T22:22:55.720880] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-19T22:22:55.736599] [DEBUG] [LOCAL ] MCS: Derivative data saved (1820 records). [2025-09-19T22:22:55.736684] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-19T22:22:55.739212] [INFO ] [MAIN ] Derivative Progress: 1155/2093 symbols completed. MCS took 1.0s. Estimated remaining: 6m 5s. Rate: 154.2 symbols/min [2025-09-19T22:22:55.739689] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:55.739922] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:55.740025] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:55.749709] [DEBUG] [LOCAL ] MDST: Loaded 5577 existing records from primary storage. [2025-09-19T22:22:55.749889] [INFO ] [MAIN ] MDST: Loaded 5577 primary data records. [2025-09-19T22:22:55.886042] [DEBUG] [LOCAL ] MCY: Loaded 25942 existing records from primary storage. [2025-09-19T22:22:55.892016] [INFO ] [MAIN ] MCY: Loaded 25942 primary data records. [2025-09-19T22:22:56.203565] [DEBUG] [LOCAL ] MD: Loaded 39347 existing records from primary storage. [2025-09-19T22:22:56.203832] [INFO ] [MAIN ] MD: Loaded 39347 primary data records. [2025-09-19T22:22:56.789256] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:56.790490] [INFO ] [MAIN ] MDST: Generated 1820 derivative records from 5577 primary records. [2025-09-19T22:22:56.790728] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-19T22:22:56.825263] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:56.825711] [DEBUG] [LOCAL ] MDST: Derivative data saved (1820 records). [2025-09-19T22:22:56.826446] [INFO ] [MAIN ] MCY: Generated 1820 derivative records from 25942 primary records. [2025-09-19T22:22:56.826911] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-19T22:22:56.826752] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-19T22:22:56.829296] [INFO ] [MAIN ] Derivative Progress: 1156/2093 symbols completed. MDST took 1.1s. Estimated remaining: 6m 5s. Rate: 153.9 symbols/min [2025-09-19T22:22:56.830019] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:56.857426] [DEBUG] [LOCAL ] MCY: Derivative data saved (1820 records). [2025-09-19T22:22:56.862747] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-19T22:22:56.862681] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:56.865797] [INFO ] [MAIN ] Derivative Progress: 1157/2093 symbols completed. MCY took 1.1s. Estimated remaining: 6m 5s. Rate: 154.1 symbols/min [2025-09-19T22:22:56.866114] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:56.863459] [INFO ] [MAIN ] MD: Generated 1820 derivative records from 39347 primary records. [2025-09-19T22:22:56.866286] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-19T22:22:56.883674] [DEBUG] [LOCAL ] MD: Derivative data saved (1820 records). [2025-09-19T22:22:56.884851] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-19T22:22:56.887751] [INFO ] [MAIN ] Derivative Progress: 1158/2093 symbols completed. MD took 1.1s. Estimated remaining: 6m 4s. Rate: 154.2 symbols/min [2025-09-19T22:22:56.888131] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:56.916169] [DEBUG] [LOCAL ] MDV: Loaded 8942 existing records from primary storage. [2025-09-19T22:22:56.916385] [INFO ] [MAIN ] MDV: Loaded 8942 primary data records. [2025-09-19T22:22:57.064621] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-09-19T22:22:57.064901] [INFO ] [MAIN ] MDT: Loaded 54458 primary data records. [2025-09-19T22:22:57.141857] [DEBUG] [LOCAL ] MDU: Loaded 48589 existing records from primary storage. [2025-09-19T22:22:57.163534] [INFO ] [MAIN ] MDU: Loaded 48589 primary data records. [2025-09-19T22:22:57.909911] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:57.913339] [INFO ] [MAIN ] MDV: Generated 1820 derivative records from 8942 primary records. [2025-09-19T22:22:57.913851] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-19T22:22:57.940130] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:57.940933] [INFO ] [MAIN ] MDU: Generated 1820 derivative records from 48589 primary records. [2025-09-19T22:22:57.941688] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-19T22:22:57.946082] [DEBUG] [LOCAL ] MDV: Derivative data saved (1820 records). [2025-09-19T22:22:57.958527] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-19T22:22:57.968356] [INFO ] [MAIN ] Derivative Progress: 1159/2093 symbols completed. MDV took 1.1s. Estimated remaining: 6m 4s. Rate: 153.9 symbols/min [2025-09-19T22:22:57.966459] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:57.969392] [INFO ] [MAIN ] MDT: Generated 1820 derivative records from 54458 primary records. [2025-09-19T22:22:57.969720] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:57.973395] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-19T22:22:57.978747] [DEBUG] [LOCAL ] MDU: Derivative data saved (1820 records). [2025-09-19T22:22:57.986572] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-19T22:22:57.989384] [INFO ] [MAIN ] Derivative Progress: 1160/2093 symbols completed. MDU took 1.1s. Estimated remaining: 6m 3s. Rate: 154.1 symbols/min [2025-09-19T22:22:57.991035] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:57.999637] [DEBUG] [LOCAL ] MDT: Derivative data saved (1820 records). [2025-09-19T22:22:57.999848] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-19T22:22:58.002482] [INFO ] [MAIN ] Derivative Progress: 1161/2093 symbols completed. MDT took 1.2s. Estimated remaining: 6m 3s. Rate: 154.2 symbols/min [2025-09-19T22:22:58.002993] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:58.023518] [DEBUG] [LOCAL ] MEC: Loaded 16915 existing records from primary storage. [2025-09-19T22:22:58.023758] [INFO ] [MAIN ] MEC: Loaded 16915 primary data records. [2025-09-19T22:22:58.111202] [DEBUG] [LOCAL ] MED: Loaded 22191 existing records from primary storage. [2025-09-19T22:22:58.125907] [INFO ] [MAIN ] MED: Loaded 22191 primary data records. [2025-09-19T22:22:58.313490] [DEBUG] [LOCAL ] MEG: Loaded 32614 existing records from primary storage. [2025-09-19T22:22:58.338517] [INFO ] [MAIN ] MEG: Loaded 32614 primary data records. [2025-09-19T22:22:59.046204] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:59.047298] [INFO ] [MAIN ] MEC: Generated 1820 derivative records from 16915 primary records. [2025-09-19T22:22:59.047514] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-19T22:22:59.073974] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:59.079532] [INFO ] [MAIN ] MED: Generated 1820 derivative records from 22191 primary records. [2025-09-19T22:22:59.078563] [DEBUG] [LOCAL ] MEC: Derivative data saved (1820 records). [2025-09-19T22:22:59.081554] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-19T22:22:59.082526] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-19T22:22:59.085674] [INFO ] [MAIN ] Derivative Progress: 1162/2093 symbols completed. MEC took 1.1s. Estimated remaining: 6m 3s. Rate: 154.0 symbols/min [2025-09-19T22:22:59.112117] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:59.110286] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:22:59.118161] [INFO ] [MAIN ] MEG: Generated 1820 derivative records from 32614 primary records. [2025-09-19T22:22:59.118712] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-19T22:22:59.147256] [DEBUG] [LOCAL ] MEG: Derivative data saved (1820 records). [2025-09-19T22:22:59.148902] [DEBUG] [LOCAL ] MED: Derivative data saved (1820 records). [2025-09-19T22:22:59.149239] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-19T22:22:59.152482] [INFO ] [MAIN ] Derivative Progress: 1163/2093 symbols completed. MEG took 1.1s. Estimated remaining: 6m 2s. Rate: 154.1 symbols/min [2025-09-19T22:22:59.153024] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:59.152773] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-19T22:22:59.155809] [INFO ] [MAIN ] Derivative Progress: 1164/2093 symbols completed. MED took 1.2s. Estimated remaining: 6m 1s. Rate: 154.2 symbols/min [2025-09-19T22:22:59.156730] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:22:59.166049] [DEBUG] [LOCAL ] MEGI: Loaded 20847 existing records from primary storage. [2025-09-19T22:22:59.166395] [INFO ] [MAIN ] MEGI: Loaded 20847 primary data records. [2025-09-19T22:22:59.360423] [DEBUG] [LOCAL ] MEI: Loaded 33152 existing records from primary storage. [2025-09-19T22:22:59.389612] [INFO ] [MAIN ] MEI: Loaded 33152 primary data records. [2025-09-19T22:22:59.650542] [DEBUG] [LOCAL ] MET: Loaded 54092 existing records from primary storage. [2025-09-19T22:22:59.650968] [INFO ] [MAIN ] MET: Loaded 54092 primary data records. [2025-09-19T22:23:00.203663] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:00.205028] [INFO ] [MAIN ] MEGI: Generated 1820 derivative records from 20847 primary records. [2025-09-19T22:23:00.206351] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-19T22:23:00.225577] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1820 records). [2025-09-19T22:23:00.225714] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-19T22:23:00.228198] [INFO ] [MAIN ] Derivative Progress: 1165/2093 symbols completed. MEGI took 1.1s. Estimated remaining: 6m 2s. Rate: 154.0 symbols/min [2025-09-19T22:23:00.228758] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:00.247998] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:00.249215] [INFO ] [MAIN ] MEI: Generated 1820 derivative records from 33152 primary records. [2025-09-19T22:23:00.249328] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-19T22:23:00.265969] [DEBUG] [LOCAL ] MEI: Derivative data saved (1820 records). [2025-09-19T22:23:00.266292] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-19T22:23:00.269509] [INFO ] [MAIN ] Derivative Progress: 1166/2093 symbols completed. MEI took 1.1s. Estimated remaining: 6m 1s. Rate: 154.1 symbols/min [2025-09-19T22:23:00.271349] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:00.285127] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:00.287264] [INFO ] [MAIN ] MET: Generated 1820 derivative records from 54092 primary records. [2025-09-19T22:23:00.287413] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-19T22:23:00.291236] [DEBUG] [LOCAL ] MFAN: Loaded 4335 existing records from primary storage. [2025-09-19T22:23:00.309342] [INFO ] [MAIN ] MFAN: Loaded 4335 primary data records. [2025-09-19T22:23:00.386482] [DEBUG] [LOCAL ] MET: Derivative data saved (1820 records). [2025-09-19T22:23:00.398900] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-19T22:23:00.406724] [INFO ] [MAIN ] Derivative Progress: 1167/2093 symbols completed. MET took 1.3s. Estimated remaining: 6m 0s. Rate: 154.2 symbols/min [2025-09-19T22:23:00.407086] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:00.454852] [DEBUG] [LOCAL ] MFA: Loaded 45843 existing records from primary storage. [2025-09-19T22:23:00.489034] [INFO ] [MAIN ] MFA: Loaded 45843 primary data records. [2025-09-19T22:23:00.565354] [DEBUG] [LOCAL ] MFAO: Loaded 3866 existing records from primary storage. [2025-09-19T22:23:00.686302] [INFO ] [MAIN ] MFAO: Loaded 3866 primary data records. [2025-09-19T22:23:01.293829] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:01.294994] [INFO ] [MAIN ] MFAN: Generated 1820 derivative records from 4335 primary records. [2025-09-19T22:23:01.295175] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-19T22:23:01.312942] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1820 records). [2025-09-19T22:23:01.313775] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-19T22:23:01.316246] [INFO ] [MAIN ] Derivative Progress: 1168/2093 symbols completed. MFAN took 1.0s. Estimated remaining: 6m 0s. Rate: 154.0 symbols/min [2025-09-19T22:23:01.329303] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:01.330082] [INFO ] [MAIN ] MFA: Generated 1820 derivative records from 45843 primary records. [2025-09-19T22:23:01.330222] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-19T22:23:01.360085] [DEBUG] [LOCAL ] MFA: Derivative data saved (1820 records). [2025-09-19T22:23:01.360174] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-19T22:23:01.360026] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:01.362942] [INFO ] [MAIN ] Derivative Progress: 1169/2093 symbols completed. MFA took 1.1s. Estimated remaining: 5m 60s. Rate: 154.1 symbols/min [2025-09-19T22:23:01.363847] [INFO ] [MAIN ] MFAO: Generated 1820 derivative records from 3866 primary records. [2025-09-19T22:23:01.363967] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-19T22:23:01.377749] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1820 records). [2025-09-19T22:23:01.377809] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-19T22:23:01.380417] [INFO ] [MAIN ] Derivative Progress: 1170/2093 symbols completed. MFAO took 1.0s. Estimated remaining: 5m 59s. Rate: 154.2 symbols/min [2025-09-19T22:23:01.381150] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:01.381222] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:01.381322] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:01.397941] [DEBUG] [LOCAL ] MFM: Loaded 14537 existing records from primary storage. [2025-09-19T22:23:01.398115] [INFO ] [MAIN ] MFM: Loaded 14537 primary data records. [2025-09-19T22:23:01.778870] [DEBUG] [LOCAL ] MFC: Loaded 52127 existing records from primary storage. [2025-09-19T22:23:01.779821] [INFO ] [MAIN ] MFC: Loaded 52127 primary data records. [2025-09-19T22:23:01.781000] [DEBUG] [LOCAL ] MFG: Loaded 49670 existing records from primary storage. [2025-09-19T22:23:01.781238] [INFO ] [MAIN ] MFG: Loaded 49670 primary data records. [2025-09-19T22:23:02.422494] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:02.423492] [INFO ] [MAIN ] MFM: Generated 1820 derivative records from 14537 primary records. [2025-09-19T22:23:02.423698] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-19T22:23:02.442666] [DEBUG] [LOCAL ] MFM: Derivative data saved (1820 records). [2025-09-19T22:23:02.442802] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-19T22:23:02.445497] [INFO ] [MAIN ] Derivative Progress: 1171/2093 symbols completed. MFM took 1.1s. Estimated remaining: 5m 59s. Rate: 154.0 symbols/min [2025-09-19T22:23:02.446144] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:02.466385] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:02.467376] [INFO ] [MAIN ] MFC: Generated 1820 derivative records from 52127 primary records. [2025-09-19T22:23:02.471867] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-19T22:23:02.485073] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:02.486173] [INFO ] [MAIN ] MFG: Generated 1820 derivative records from 49670 primary records. [2025-09-19T22:23:02.486470] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-19T22:23:02.504311] [DEBUG] [LOCAL ] MG: Loaded 17120 existing records from primary storage. [2025-09-19T22:23:02.511270] [INFO ] [MAIN ] MG: Loaded 17120 primary data records. [2025-09-19T22:23:02.530860] [DEBUG] [LOCAL ] MFC: Derivative data saved (1820 records). [2025-09-19T22:23:02.541425] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-19T22:23:02.553956] [INFO ] [MAIN ] Derivative Progress: 1172/2093 symbols completed. MFC took 1.2s. Estimated remaining: 5m 59s. Rate: 154.1 symbols/min [2025-09-19T22:23:02.573459] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:02.650114] [DEBUG] [LOCAL ] MFG: Derivative data saved (1820 records). [2025-09-19T22:23:02.682314] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-19T22:23:02.695009] [INFO ] [MAIN ] Derivative Progress: 1173/2093 symbols completed. MFG took 1.3s. Estimated remaining: 5m 58s. Rate: 154.2 symbols/min [2025-09-19T22:23:02.857592] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:02.882529] [DEBUG] [LOCAL ] MGF: Loaded 4190 existing records from primary storage. [2025-09-19T22:23:02.883328] [INFO ] [MAIN ] MGF: Loaded 4190 primary data records. [2025-09-19T22:23:02.990973] [DEBUG] [LOCAL ] MGA: Loaded 51426 existing records from primary storage. [2025-09-19T22:23:03.018050] [INFO ] [MAIN ] MGA: Loaded 51426 primary data records. [2025-09-19T22:23:03.292250] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:03.312809] [INFO ] [MAIN ] MG: Generated 1820 derivative records from 17120 primary records. [2025-09-19T22:23:03.313350] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-19T22:23:03.354961] [DEBUG] [LOCAL ] MG: Derivative data saved (1820 records). [2025-09-19T22:23:03.355077] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-19T22:23:03.357484] [INFO ] [MAIN ] Derivative Progress: 1174/2093 symbols completed. MG took 0.9s. Estimated remaining: 5m 58s. Rate: 154.1 symbols/min [2025-09-19T22:23:03.418572] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:03.560139] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:03.561121] [INFO ] [MAIN ] MGF: Generated 1820 derivative records from 4190 primary records. [2025-09-19T22:23:03.561219] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-19T22:23:03.577093] [DEBUG] [LOCAL ] MGF: Derivative data saved (1820 records). [2025-09-19T22:23:03.577488] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-19T22:23:03.579816] [INFO ] [MAIN ] Derivative Progress: 1175/2093 symbols completed. MGF took 0.7s. Estimated remaining: 5m 57s. Rate: 154.2 symbols/min [2025-09-19T22:23:03.580160] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:03.613638] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:03.616611] [DEBUG] [LOCAL ] MGR: Loaded 5756 existing records from primary storage. [2025-09-19T22:23:03.616747] [INFO ] [MAIN ] MGR: Loaded 5756 primary data records. [2025-09-19T22:23:03.630418] [INFO ] [MAIN ] MGA: Generated 1820 derivative records from 51426 primary records. [2025-09-19T22:23:03.631327] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-19T22:23:03.695634] [DEBUG] [LOCAL ] MGM: Loaded 54387 existing records from primary storage. [2025-09-19T22:23:03.709770] [INFO ] [MAIN ] MGM: Loaded 54387 primary data records. [2025-09-19T22:23:03.781913] [DEBUG] [LOCAL ] MGA: Derivative data saved (1820 records). [2025-09-19T22:23:03.787142] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-19T22:23:03.823999] [INFO ] [MAIN ] Derivative Progress: 1176/2093 symbols completed. MGA took 1.3s. Estimated remaining: 5m 57s. Rate: 154.2 symbols/min [2025-09-19T22:23:03.843449] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:04.125943] [DEBUG] [LOCAL ] MGRB: Loaded 4147 existing records from primary storage. [2025-09-19T22:23:04.131513] [INFO ] [MAIN ] MGRB: Loaded 4147 primary data records. [2025-09-19T22:23:04.620595] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:23:04.623280] [INFO ] [MAIN ] MGR: Generated 1819 derivative records from 5756 primary records. [2025-09-19T22:23:04.623459] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-19T22:23:04.649489] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:04.650622] [INFO ] [MAIN ] MGM: Generated 1820 derivative records from 54387 primary records. [2025-09-19T22:23:04.651285] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-19T22:23:04.670301] [DEBUG] [LOCAL ] MGM: Derivative data saved (1820 records). [2025-09-19T22:23:04.670482] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-19T22:23:04.673126] [INFO ] [MAIN ] Derivative Progress: 1177/2093 symbols completed. MGM took 1.3s. Estimated remaining: 5m 57s. Rate: 154.1 symbols/min [2025-09-19T22:23:04.673905] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:04.673637] [DEBUG] [LOCAL ] MGR: Derivative data saved (1819 records). [2025-09-19T22:23:04.674547] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-19T22:23:04.676706] [INFO ] [MAIN ] Derivative Progress: 1178/2093 symbols completed. MGR took 1.1s. Estimated remaining: 5m 56s. Rate: 154.2 symbols/min [2025-09-19T22:23:04.677261] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:04.683310] [DEBUG] [LOCAL ] MGRD: Loaded 2267 existing records from primary storage. [2025-09-19T22:23:04.691032] [INFO ] [MAIN ] MGRD: Loaded 2267 primary data records. [2025-09-19T22:23:04.716599] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:04.753768] [INFO ] [MAIN ] MGRB: Generated 1820 derivative records from 4147 primary records. [2025-09-19T22:23:04.753912] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-19T22:23:04.782806] [DEBUG] [LOCAL ] MGRE: Loaded 6651 existing records from primary storage. [2025-09-19T22:23:04.788322] [INFO ] [MAIN ] MGRE: Loaded 6651 primary data records. [2025-09-19T22:23:05.118410] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1820 records). [2025-09-19T22:23:05.119107] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-19T22:23:05.126849] [INFO ] [MAIN ] Derivative Progress: 1179/2093 symbols completed. MGRB took 1.3s. Estimated remaining: 5m 56s. Rate: 154.2 symbols/min [2025-09-19T22:23:05.143437] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:05.348835] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:05.363638] [INFO ] [MAIN ] MGRD: Generated 1820 derivative records from 2267 primary records. [2025-09-19T22:23:05.364044] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-19T22:23:05.380351] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1820 records). [2025-09-19T22:23:05.381302] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-19T22:23:05.383792] [INFO ] [MAIN ] Derivative Progress: 1180/2093 symbols completed. MGRD took 0.7s. Estimated remaining: 5m 55s. Rate: 154.2 symbols/min [2025-09-19T22:23:05.384102] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:05.411028] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:05.411942] [INFO ] [MAIN ] MGRE: Generated 1820 derivative records from 6651 primary records. [2025-09-19T22:23:05.413218] [DEBUG] [LOCAL ] MGY: Loaded 53216 existing records from primary storage. [2025-09-19T22:23:05.412134] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-19T22:23:05.414199] [INFO ] [MAIN ] MGY: Loaded 53216 primary data records. [2025-09-19T22:23:05.533608] [DEBUG] [LOCAL ] MHD: Loaded 12423 existing records from primary storage. [2025-09-19T22:23:05.537907] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1820 records). [2025-09-19T22:23:05.543615] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-19T22:23:05.560831] [INFO ] [MAIN ] Derivative Progress: 1181/2093 symbols completed. MGRE took 0.9s. Estimated remaining: 5m 55s. Rate: 154.3 symbols/min [2025-09-19T22:23:05.548853] [INFO ] [MAIN ] MHD: Loaded 12423 primary data records. [2025-09-19T22:23:05.652813] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:05.898011] [DEBUG] [LOCAL ] MHF: Loaded 8671 existing records from primary storage. [2025-09-19T22:23:05.926254] [INFO ] [MAIN ] MHF: Loaded 8671 primary data records. [2025-09-19T22:23:06.413765] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:06.415026] [INFO ] [MAIN ] MGY: Generated 1820 derivative records from 53216 primary records. [2025-09-19T22:23:06.415140] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-19T22:23:06.435473] [DEBUG] [LOCAL ] MGY: Derivative data saved (1820 records). [2025-09-19T22:23:06.436584] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-19T22:23:06.439007] [INFO ] [MAIN ] Derivative Progress: 1182/2093 symbols completed. MGY took 1.3s. Estimated remaining: 5m 55s. Rate: 154.1 symbols/min [2025-09-19T22:23:06.439447] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:06.452771] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:06.453457] [INFO ] [MAIN ] MHD: Generated 1820 derivative records from 12423 primary records. [2025-09-19T22:23:06.453718] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-19T22:23:06.472034] [DEBUG] [LOCAL ] MHD: Derivative data saved (1820 records). [2025-09-19T22:23:06.472379] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-19T22:23:06.486812] [INFO ] [MAIN ] Derivative Progress: 1183/2093 symbols completed. MHD took 1.1s. Estimated remaining: 5m 54s. Rate: 154.2 symbols/min [2025-09-19T22:23:06.487247] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:06.488134] [INFO ] [MAIN ] MHF: Generated 1820 derivative records from 8671 primary records. [2025-09-19T22:23:06.488279] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-19T22:23:06.502916] [DEBUG] [LOCAL ] MHF: Derivative data saved (1820 records). [2025-09-19T22:23:06.503005] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-19T22:23:06.505749] [INFO ] [MAIN ] Derivative Progress: 1184/2093 symbols completed. MHF took 0.9s. Estimated remaining: 5m 53s. Rate: 154.3 symbols/min [2025-09-19T22:23:06.533509] [DEBUG] [LOCAL ] MHK: Loaded 43183 existing records from primary storage. [2025-09-19T22:23:06.533632] [INFO ] [MAIN ] MHK: Loaded 43183 primary data records. [2025-09-19T22:23:06.840578] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:06.841203] [INFO ] [MAIN ] MHK: Generated 1820 derivative records from 43183 primary records. [2025-09-19T22:23:06.841265] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-19T22:23:06.857523] [DEBUG] [LOCAL ] MHK: Derivative data saved (1820 records). [2025-09-19T22:23:06.857584] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-19T22:23:06.859853] [INFO ] [MAIN ] Derivative Progress: 1185/2093 symbols completed. MHK took 0.4s. Estimated remaining: 5m 53s. Rate: 154.4 symbols/min [2025-09-19T22:23:06.860856] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:06.861067] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:06.861135] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:06.875967] [DEBUG] [LOCAL ] MHN: Loaded 7887 existing records from primary storage. [2025-09-19T22:23:06.876108] [INFO ] [MAIN ] MHN: Loaded 7887 primary data records. [2025-09-19T22:23:06.950528] [DEBUG] [LOCAL ] MIN: Loaded 13288 existing records from primary storage. [2025-09-19T22:23:06.967556] [INFO ] [MAIN ] MIN: Loaded 13288 primary data records. [2025-09-19T22:23:07.122942] [DEBUG] [LOCAL ] MHO: Loaded 24873 existing records from primary storage. [2025-09-19T22:23:07.180672] [INFO ] [MAIN ] MHO: Loaded 24873 primary data records. [2025-09-19T22:23:07.843219] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:07.843478] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:07.844399] [INFO ] [MAIN ] MIN: Generated 1820 derivative records from 13288 primary records. [2025-09-19T22:23:07.844518] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-19T22:23:07.845141] [INFO ] [MAIN ] MHN: Generated 1820 derivative records from 7887 primary records. [2025-09-19T22:23:07.845351] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-19T22:23:07.872687] [DEBUG] [LOCAL ] MIN: Derivative data saved (1820 records). [2025-09-19T22:23:07.873006] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-19T22:23:07.875730] [INFO ] [MAIN ] Derivative Progress: 1186/2093 symbols completed. MIN took 1.0s. Estimated remaining: 5m 53s. Rate: 154.2 symbols/min [2025-09-19T22:23:07.876210] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:07.893935] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:07.895224] [INFO ] [MAIN ] MHO: Generated 1820 derivative records from 24873 primary records. [2025-09-19T22:23:07.895397] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-19T22:23:07.896060] [DEBUG] [LOCAL ] MHN: Derivative data saved (1820 records). [2025-09-19T22:23:07.896825] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-19T22:23:07.899151] [INFO ] [MAIN ] Derivative Progress: 1187/2093 symbols completed. MHN took 1.0s. Estimated remaining: 5m 52s. Rate: 154.3 symbols/min [2025-09-19T22:23:07.899498] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:07.921948] [DEBUG] [LOCAL ] MHO: Derivative data saved (1820 records). [2025-09-19T22:23:07.922054] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-19T22:23:07.921872] [DEBUG] [LOCAL ] MITP: Loaded 2434 existing records from primary storage. [2025-09-19T22:23:07.922164] [INFO ] [MAIN ] MITP: Loaded 2434 primary data records. [2025-09-19T22:23:07.924330] [INFO ] [MAIN ] Derivative Progress: 1188/2093 symbols completed. MHO took 1.1s. Estimated remaining: 5m 52s. Rate: 154.4 symbols/min [2025-09-19T22:23:07.984495] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:08.265153] [DEBUG] [LOCAL ] MIR: Loaded 51550 existing records from primary storage. [2025-09-19T22:23:08.282047] [DEBUG] [LOCAL ] MITT: Loaded 23333 existing records from primary storage. [2025-09-19T22:23:08.281637] [INFO ] [MAIN ] MIR: Loaded 51550 primary data records. [2025-09-19T22:23:08.282270] [INFO ] [MAIN ] MITT: Loaded 23333 primary data records. [2025-09-19T22:23:08.955107] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:23:08.957706] [INFO ] [MAIN ] MITP: Generated 1819 derivative records from 2434 primary records. [2025-09-19T22:23:08.958332] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-19T22:23:08.973945] [DEBUG] [LOCAL ] MITP: Derivative data saved (1819 records). [2025-09-19T22:23:08.974240] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-19T22:23:08.976815] [INFO ] [MAIN ] Derivative Progress: 1189/2093 symbols completed. MITP took 1.1s. Estimated remaining: 5m 52s. Rate: 154.2 symbols/min [2025-09-19T22:23:08.977578] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:09.010972] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:09.010687] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:09.011799] [INFO ] [MAIN ] MITT: Generated 1820 derivative records from 23333 primary records. [2025-09-19T22:23:09.012065] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-19T22:23:09.015341] [INFO ] [MAIN ] MIR: Generated 1820 derivative records from 51550 primary records. [2025-09-19T22:23:09.016176] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-19T22:23:09.016966] [DEBUG] [LOCAL ] MIY: Loaded 6122 existing records from primary storage. [2025-09-19T22:23:09.017229] [INFO ] [MAIN ] MIY: Loaded 6122 primary data records. [2025-09-19T22:23:09.159042] [DEBUG] [LOCAL ] MITT: Derivative data saved (1820 records). [2025-09-19T22:23:09.175908] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-19T22:23:09.178544] [INFO ] [MAIN ] Derivative Progress: 1190/2093 symbols completed. MITT took 1.2s. Estimated remaining: 5m 51s. Rate: 154.2 symbols/min [2025-09-19T22:23:09.176368] [DEBUG] [LOCAL ] MIR: Derivative data saved (1820 records). [2025-09-19T22:23:09.192622] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-19T22:23:09.201414] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:09.203742] [INFO ] [MAIN ] Derivative Progress: 1191/2093 symbols completed. MIR took 1.3s. Estimated remaining: 5m 51s. Rate: 154.4 symbols/min [2025-09-19T22:23:09.233920] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:09.392566] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:09.406116] [INFO ] [MAIN ] MIY: Generated 1820 derivative records from 6122 primary records. [2025-09-19T22:23:09.416451] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-19T22:23:09.417758] [DEBUG] [LOCAL ] MKL: Loaded 34735 existing records from primary storage. [2025-09-19T22:23:09.418178] [INFO ] [MAIN ] MKL: Loaded 34735 primary data records. [2025-09-19T22:23:09.528923] [DEBUG] [LOCAL ] MIY: Derivative data saved (1820 records). [2025-09-19T22:23:09.540326] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-19T22:23:09.552852] [DEBUG] [LOCAL ] MKC: Loaded 53211 existing records from primary storage. [2025-09-19T22:23:09.552023] [INFO ] [MAIN ] Derivative Progress: 1192/2093 symbols completed. MIY took 0.6s. Estimated remaining: 5m 50s. Rate: 154.4 symbols/min [2025-09-19T22:23:09.558425] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:09.558186] [INFO ] [MAIN ] MKC: Loaded 53211 primary data records. [2025-09-19T22:23:10.115207] [DEBUG] [LOCAL ] MLI: Loaded 44630 existing records from primary storage. [2025-09-19T22:23:10.115587] [INFO ] [MAIN ] MLI: Loaded 44630 primary data records. [2025-09-19T22:23:10.487070] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:10.488075] [INFO ] [MAIN ] MKL: Generated 1820 derivative records from 34735 primary records. [2025-09-19T22:23:10.488330] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-19T22:23:10.522128] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:10.523731] [INFO ] [MAIN ] MKC: Generated 1820 derivative records from 53211 primary records. [2025-09-19T22:23:10.523828] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-19T22:23:10.526213] [DEBUG] [LOCAL ] MKL: Derivative data saved (1820 records). [2025-09-19T22:23:10.534955] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-19T22:23:10.540962] [INFO ] [MAIN ] Derivative Progress: 1193/2093 symbols completed. MKL took 1.3s. Estimated remaining: 5m 50s. Rate: 154.2 symbols/min [2025-09-19T22:23:10.545233] [DEBUG] [LOCAL ] MKC: Derivative data saved (1820 records). [2025-09-19T22:23:10.545789] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:10.545455] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-19T22:23:10.548603] [INFO ] [MAIN ] Derivative Progress: 1194/2093 symbols completed. MKC took 1.4s. Estimated remaining: 5m 50s. Rate: 154.3 symbols/min [2025-09-19T22:23:10.549379] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:10.567718] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:10.568470] [INFO ] [MAIN ] MLI: Generated 1820 derivative records from 44630 primary records. [2025-09-19T22:23:10.568582] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-19T22:23:10.591935] [DEBUG] [LOCAL ] MLI: Derivative data saved (1820 records). [2025-09-19T22:23:10.599339] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-19T22:23:10.601442] [INFO ] [MAIN ] Derivative Progress: 1195/2093 symbols completed. MLI took 1.0s. Estimated remaining: 5m 49s. Rate: 154.4 symbols/min [2025-09-19T22:23:10.601879] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:10.622304] [DEBUG] [LOCAL ] MLM: Loaded 31890 existing records from primary storage. [2025-09-19T22:23:10.621833] [DEBUG] [LOCAL ] MLNK: Loaded 26172 existing records from primary storage. [2025-09-19T22:23:10.624633] [INFO ] [MAIN ] MLM: Loaded 31890 primary data records. [2025-09-19T22:23:10.622602] [INFO ] [MAIN ] MLNK: Loaded 26172 primary data records. [2025-09-19T22:23:10.624983] [DEBUG] [LOCAL ] MLP: Loaded 3069 existing records from primary storage. [2025-09-19T22:23:10.658123] [INFO ] [MAIN ] MLP: Loaded 3069 primary data records. [2025-09-19T22:23:11.575129] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:11.591781] [INFO ] [MAIN ] MLP: Generated 1820 derivative records from 3069 primary records. [2025-09-19T22:23:11.602538] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-19T22:23:11.602441] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:11.603163] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:11.604384] [INFO ] [MAIN ] MLM: Generated 1820 derivative records from 31890 primary records. [2025-09-19T22:23:11.605274] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-19T22:23:11.605188] [INFO ] [MAIN ] MLNK: Generated 1820 derivative records from 26172 primary records. [2025-09-19T22:23:11.615384] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-19T22:23:11.628916] [DEBUG] [LOCAL ] MLM: Derivative data saved (1820 records). [2025-09-19T22:23:11.630686] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-19T22:23:11.636131] [INFO ] [MAIN ] Derivative Progress: 1196/2093 symbols completed. MLM took 1.1s. Estimated remaining: 5m 49s. Rate: 154.2 symbols/min [2025-09-19T22:23:11.648279] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:11.640269] [DEBUG] [LOCAL ] MLP: Derivative data saved (1820 records). [2025-09-19T22:23:11.653228] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-19T22:23:11.655953] [INFO ] [MAIN ] Derivative Progress: 1197/2093 symbols completed. MLP took 1.1s. Estimated remaining: 5m 48s. Rate: 154.3 symbols/min [2025-09-19T22:23:11.656320] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:11.662593] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1820 records). [2025-09-19T22:23:11.662888] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-19T22:23:11.665132] [INFO ] [MAIN ] Derivative Progress: 1198/2093 symbols completed. MLNK took 1.1s. Estimated remaining: 5m 48s. Rate: 154.4 symbols/min [2025-09-19T22:23:11.676678] [DEBUG] [LOCAL ] MLR: Loaded 13403 existing records from primary storage. [2025-09-19T22:23:11.676803] [INFO ] [MAIN ] MLR: Loaded 13403 primary data records. [2025-09-19T22:23:12.005697] [DEBUG] [LOCAL ] MMC: Loaded 52568 existing records from primary storage. [2025-09-19T22:23:12.005883] [INFO ] [MAIN ] MMC: Loaded 52568 primary data records. [2025-09-19T22:23:12.353031] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:12.353769] [INFO ] [MAIN ] MLR: Generated 1820 derivative records from 13403 primary records. [2025-09-19T22:23:12.353918] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-19T22:23:12.371150] [DEBUG] [LOCAL ] MLR: Derivative data saved (1820 records). [2025-09-19T22:23:12.371279] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-19T22:23:12.373786] [INFO ] [MAIN ] Derivative Progress: 1199/2093 symbols completed. MLR took 0.7s. Estimated remaining: 5m 48s. Rate: 154.3 symbols/min [2025-09-19T22:23:12.393043] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:12.393586] [INFO ] [MAIN ] MMC: Generated 1820 derivative records from 52568 primary records. [2025-09-19T22:23:12.393664] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-19T22:23:12.408923] [DEBUG] [LOCAL ] MMC: Derivative data saved (1820 records). [2025-09-19T22:23:12.408981] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-19T22:23:12.410924] [INFO ] [MAIN ] Derivative Progress: 1200/2093 symbols completed. MMC took 0.8s. Estimated remaining: 5m 47s. Rate: 154.5 symbols/min [2025-09-19T22:23:12.411948] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:12.411569] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:12.411818] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:12.429820] [DEBUG] [LOCAL ] MMD: Loaded 11278 existing records from primary storage. [2025-09-19T22:23:12.429950] [INFO ] [MAIN ] MMD: Loaded 11278 primary data records. [2025-09-19T22:23:12.470902] [DEBUG] [LOCAL ] MMI: Loaded 15608 existing records from primary storage. [2025-09-19T22:23:12.477813] [INFO ] [MAIN ] MMI: Loaded 15608 primary data records. [2025-09-19T22:23:13.059411] [DEBUG] [LOCAL ] MMM: Loaded 54039 existing records from primary storage. [2025-09-19T22:23:13.059695] [INFO ] [MAIN ] MMM: Loaded 54039 primary data records. [2025-09-19T22:23:13.418180] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:13.419314] [INFO ] [MAIN ] MMD: Generated 1820 derivative records from 11278 primary records. [2025-09-19T22:23:13.419678] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-19T22:23:13.419940] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:13.421551] [INFO ] [MAIN ] MMI: Generated 1820 derivative records from 15608 primary records. [2025-09-19T22:23:13.422291] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-19T22:23:13.449048] [DEBUG] [LOCAL ] MMD: Derivative data saved (1820 records). [2025-09-19T22:23:13.452128] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-19T22:23:13.454402] [INFO ] [MAIN ] Derivative Progress: 1201/2093 symbols completed. MMD took 1.0s. Estimated remaining: 5m 47s. Rate: 154.2 symbols/min [2025-09-19T22:23:13.456071] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:13.455928] [DEBUG] [LOCAL ] MMI: Derivative data saved (1820 records). [2025-09-19T22:23:13.456760] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-19T22:23:13.458919] [INFO ] [MAIN ] Derivative Progress: 1202/2093 symbols completed. MMI took 1.0s. Estimated remaining: 5m 46s. Rate: 154.4 symbols/min [2025-09-19T22:23:13.459558] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:13.476176] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:13.476892] [INFO ] [MAIN ] MMM: Generated 1820 derivative records from 54039 primary records. [2025-09-19T22:23:13.477073] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-19T22:23:13.501558] [DEBUG] [LOCAL ] MMM: Derivative data saved (1820 records). [2025-09-19T22:23:13.501887] [DEBUG] [LOCAL ] MMT: Loaded 11600 existing records from primary storage. [2025-09-19T22:23:13.501971] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-19T22:23:13.504528] [INFO ] [MAIN ] Derivative Progress: 1203/2093 symbols completed. MMM took 1.1s. Estimated remaining: 5m 46s. Rate: 154.5 symbols/min [2025-09-19T22:23:13.504683] [INFO ] [MAIN ] MMT: Loaded 11600 primary data records. [2025-09-19T22:23:13.504997] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:13.631144] [DEBUG] [LOCAL ] MMS: Loaded 34667 existing records from primary storage. [2025-09-19T22:23:13.647274] [INFO ] [MAIN ] MMS: Loaded 34667 primary data records. [2025-09-19T22:23:13.777048] [DEBUG] [LOCAL ] MMU: Loaded 17308 existing records from primary storage. [2025-09-19T22:23:13.793866] [INFO ] [MAIN ] MMU: Loaded 17308 primary data records. [2025-09-19T22:23:14.489608] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:14.490670] [INFO ] [MAIN ] MMT: Generated 1820 derivative records from 11600 primary records. [2025-09-19T22:23:14.490780] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-19T22:23:14.508411] [DEBUG] [LOCAL ] MMT: Derivative data saved (1820 records). [2025-09-19T22:23:14.508593] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-19T22:23:14.523671] [INFO ] [MAIN ] Derivative Progress: 1204/2093 symbols completed. MMT took 1.1s. Estimated remaining: 5m 46s. Rate: 154.3 symbols/min [2025-09-19T22:23:14.524001] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:14.521468] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:14.524952] [INFO ] [MAIN ] MMS: Generated 1820 derivative records from 34667 primary records. [2025-09-19T22:23:14.525040] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-19T22:23:14.544057] [DEBUG] [LOCAL ] MMS: Derivative data saved (1820 records). [2025-09-19T22:23:14.544177] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-19T22:23:14.546292] [INFO ] [MAIN ] Derivative Progress: 1205/2093 symbols completed. MMS took 1.1s. Estimated remaining: 5m 45s. Rate: 154.4 symbols/min [2025-09-19T22:23:14.546724] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:14.560142] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:14.560913] [INFO ] [MAIN ] MMU: Generated 1820 derivative records from 17308 primary records. [2025-09-19T22:23:14.561035] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-19T22:23:14.583499] [DEBUG] [LOCAL ] MMU: Derivative data saved (1820 records). [2025-09-19T22:23:14.583756] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-19T22:23:14.586345] [INFO ] [MAIN ] Derivative Progress: 1206/2093 symbols completed. MMU took 1.1s. Estimated remaining: 5m 44s. Rate: 154.5 symbols/min [2025-09-19T22:23:14.586679] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:14.596485] [DEBUG] [LOCAL ] MNR: Loaded 25261 existing records from primary storage. [2025-09-19T22:23:14.596737] [INFO ] [MAIN ] MNR: Loaded 25261 primary data records. [2025-09-19T22:23:14.822071] [DEBUG] [LOCAL ] MNSO: Loaded 45102 existing records from primary storage. [2025-09-19T22:23:14.834708] [INFO ] [MAIN ] MNSO: Loaded 45102 primary data records. [2025-09-19T22:23:15.056469] [DEBUG] [LOCAL ] MOD: Loaded 46432 existing records from primary storage. [2025-09-19T22:23:15.056807] [INFO ] [MAIN ] MOD: Loaded 46432 primary data records. [2025-09-19T22:23:15.579743] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:15.581228] [INFO ] [MAIN ] MNR: Generated 1820 derivative records from 25261 primary records. [2025-09-19T22:23:15.581513] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-19T22:23:15.602080] [DEBUG] [LOCAL ] MNR: Derivative data saved (1820 records). [2025-09-19T22:23:15.602185] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-19T22:23:15.604978] [INFO ] [MAIN ] Derivative Progress: 1207/2093 symbols completed. MNR took 1.1s. Estimated remaining: 5m 45s. Rate: 154.3 symbols/min [2025-09-19T22:23:15.617804] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:15.619208] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:15.620339] [INFO ] [MAIN ] MNSO: Generated 1820 derivative records from 45102 primary records. [2025-09-19T22:23:15.620573] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-19T22:23:15.641874] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1820 records). [2025-09-19T22:23:15.642214] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-19T22:23:15.644932] [INFO ] [MAIN ] Derivative Progress: 1208/2093 symbols completed. MNSO took 1.1s. Estimated remaining: 5m 44s. Rate: 154.4 symbols/min [2025-09-19T22:23:15.647391] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:15.662903] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:15.663781] [INFO ] [MAIN ] MOD: Generated 1820 derivative records from 46432 primary records. [2025-09-19T22:23:15.663946] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-19T22:23:15.696352] [DEBUG] [LOCAL ] MOD: Derivative data saved (1820 records). [2025-09-19T22:23:15.696516] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-19T22:23:15.699179] [INFO ] [MAIN ] Derivative Progress: 1209/2093 symbols completed. MOD took 1.1s. Estimated remaining: 5m 43s. Rate: 154.5 symbols/min [2025-09-19T22:23:15.699595] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:15.719691] [DEBUG] [LOCAL ] MODG: Loaded 52376 existing records from primary storage. [2025-09-19T22:23:15.719844] [INFO ] [MAIN ] MODG: Loaded 52376 primary data records. [2025-09-19T22:23:15.900466] [DEBUG] [LOCAL ] MOH: Loaded 42381 existing records from primary storage. [2025-09-19T22:23:15.925070] [INFO ] [MAIN ] MOH: Loaded 42381 primary data records. [2025-09-19T22:23:16.262280] [DEBUG] [LOCAL ] MOS: Loaded 54292 existing records from primary storage. [2025-09-19T22:23:16.417334] [INFO ] [MAIN ] MOS: Loaded 54292 primary data records. [2025-09-19T22:23:16.717997] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:16.746253] [INFO ] [MAIN ] MODG: Generated 1820 derivative records from 52376 primary records. [2025-09-19T22:23:16.759795] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-19T22:23:16.785118] [DEBUG] [LOCAL ] MODG: Derivative data saved (1820 records). [2025-09-19T22:23:16.785866] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-19T22:23:16.788454] [INFO ] [MAIN ] Derivative Progress: 1210/2093 symbols completed. MODG took 1.2s. Estimated remaining: 5m 43s. Rate: 154.3 symbols/min [2025-09-19T22:23:16.789084] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:16.803295] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:16.804723] [INFO ] [MAIN ] MOH: Generated 1820 derivative records from 42381 primary records. [2025-09-19T22:23:16.804989] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-19T22:23:16.823121] [DEBUG] [LOCAL ] MOH: Derivative data saved (1820 records). [2025-09-19T22:23:16.823197] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-19T22:23:16.825726] [INFO ] [MAIN ] Derivative Progress: 1211/2093 symbols completed. MOH took 1.2s. Estimated remaining: 5m 43s. Rate: 154.4 symbols/min [2025-09-19T22:23:16.826340] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:16.845274] [DEBUG] [LOCAL ] MOV: Loaded 22639 existing records from primary storage. [2025-09-19T22:23:16.845563] [INFO ] [MAIN ] MOV: Loaded 22639 primary data records. [2025-09-19T22:23:16.878708] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:16.894997] [INFO ] [MAIN ] MOS: Generated 1820 derivative records from 54292 primary records. [2025-09-19T22:23:16.895079] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-19T22:23:16.983127] [DEBUG] [LOCAL ] MOS: Derivative data saved (1820 records). [2025-09-19T22:23:16.993531] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-19T22:23:17.000802] [INFO ] [MAIN ] Derivative Progress: 1212/2093 symbols completed. MOS took 1.3s. Estimated remaining: 5m 42s. Rate: 154.5 symbols/min [2025-09-19T22:23:17.030516] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:17.216999] [DEBUG] [LOCAL ] MPA: Loaded 5298 existing records from primary storage. [2025-09-19T22:23:17.217602] [INFO ] [MAIN ] MPA: Loaded 5298 primary data records. [2025-09-19T22:23:17.339127] [DEBUG] [LOCAL ] MP: Loaded 54436 existing records from primary storage. [2025-09-19T22:23:17.345252] [INFO ] [MAIN ] MP: Loaded 54436 primary data records. [2025-09-19T22:23:17.916269] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:17.918404] [INFO ] [MAIN ] MOV: Generated 1820 derivative records from 22639 primary records. [2025-09-19T22:23:17.919150] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-19T22:23:17.938624] [DEBUG] [LOCAL ] MOV: Derivative data saved (1820 records). [2025-09-19T22:23:17.939307] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-19T22:23:17.942028] [INFO ] [MAIN ] Derivative Progress: 1213/2093 symbols completed. MOV took 1.2s. Estimated remaining: 5m 42s. Rate: 154.3 symbols/min [2025-09-19T22:23:17.960249] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:17.961090] [INFO ] [MAIN ] MPA: Generated 1820 derivative records from 5298 primary records. [2025-09-19T22:23:17.961240] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-19T22:23:17.976937] [DEBUG] [LOCAL ] MPA: Derivative data saved (1820 records). [2025-09-19T22:23:17.978794] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-19T22:23:17.981562] [INFO ] [MAIN ] Derivative Progress: 1214/2093 symbols completed. MPA took 1.0s. Estimated remaining: 5m 42s. Rate: 154.4 symbols/min [2025-09-19T22:23:17.996398] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:17.997063] [INFO ] [MAIN ] MP: Generated 1820 derivative records from 54436 primary records. [2025-09-19T22:23:17.997126] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-19T22:23:18.013606] [DEBUG] [LOCAL ] MP: Derivative data saved (1820 records). [2025-09-19T22:23:18.013714] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-19T22:23:18.016570] [INFO ] [MAIN ] Derivative Progress: 1215/2093 symbols completed. MP took 1.2s. Estimated remaining: 5m 41s. Rate: 154.5 symbols/min [2025-09-19T22:23:18.017851] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:18.017453] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:18.018070] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:18.028045] [DEBUG] [LOCAL ] MPV: Loaded 5262 existing records from primary storage. [2025-09-19T22:23:18.028285] [INFO ] [MAIN ] MPV: Loaded 5262 primary data records. [2025-09-19T22:23:18.453399] [DEBUG] [LOCAL ] MPC: Loaded 52917 existing records from primary storage. [2025-09-19T22:23:18.453991] [INFO ] [MAIN ] MPC: Loaded 52917 primary data records. [2025-09-19T22:23:18.585973] [DEBUG] [LOCAL ] MPLX: Loaded 51533 existing records from primary storage. [2025-09-19T22:23:18.597601] [INFO ] [MAIN ] MPLX: Loaded 51533 primary data records. [2025-09-19T22:23:19.172369] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:19.174534] [INFO ] [MAIN ] MPV: Generated 1820 derivative records from 5262 primary records. [2025-09-19T22:23:19.174750] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-19T22:23:19.194936] [DEBUG] [LOCAL ] MPV: Derivative data saved (1820 records). [2025-09-19T22:23:19.195188] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-19T22:23:19.198615] [INFO ] [MAIN ] Derivative Progress: 1216/2093 symbols completed. MPV took 1.2s. Estimated remaining: 5m 41s. Rate: 154.3 symbols/min [2025-09-19T22:23:19.200182] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:19.223929] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:19.224895] [INFO ] [MAIN ] MPC: Generated 1820 derivative records from 52917 primary records. [2025-09-19T22:23:19.225255] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-19T22:23:19.265301] [DEBUG] [LOCAL ] MPC: Derivative data saved (1820 records). [2025-09-19T22:23:19.266158] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-19T22:23:19.266072] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:19.268125] [INFO ] [MAIN ] Derivative Progress: 1217/2093 symbols completed. MPC took 1.3s. Estimated remaining: 5m 40s. Rate: 154.4 symbols/min [2025-09-19T22:23:19.269010] [INFO ] [MAIN ] MPLX: Generated 1820 derivative records from 51533 primary records. [2025-09-19T22:23:19.269165] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-19T22:23:19.270028] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:19.291768] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1820 records). [2025-09-19T22:23:19.306279] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-19T22:23:19.292181] [DEBUG] [LOCAL ] MPX: Loaded 4326 existing records from primary storage. [2025-09-19T22:23:19.306536] [INFO ] [MAIN ] MPX: Loaded 4326 primary data records. [2025-09-19T22:23:19.309168] [INFO ] [MAIN ] Derivative Progress: 1218/2093 symbols completed. MPLX took 1.3s. Estimated remaining: 5m 40s. Rate: 154.5 symbols/min [2025-09-19T22:23:19.321703] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:19.434964] [DEBUG] [LOCAL ] MPW: Loaded 54280 existing records from primary storage. [2025-09-19T22:23:19.460718] [INFO ] [MAIN ] MPW: Loaded 54280 primary data records. [2025-09-19T22:23:19.455475] [DEBUG] [LOCAL ] MQT: Loaded 8527 existing records from primary storage. [2025-09-19T22:23:19.461028] [INFO ] [MAIN ] MQT: Loaded 8527 primary data records. [2025-09-19T22:23:20.364363] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:20.365983] [INFO ] [MAIN ] MPX: Generated 1820 derivative records from 4326 primary records. [2025-09-19T22:23:20.366403] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-19T22:23:20.401310] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:20.402760] [INFO ] [MAIN ] MQT: Generated 1820 derivative records from 8527 primary records. [2025-09-19T22:23:20.402877] [DEBUG] [LOCAL ] MPX: Derivative data saved (1820 records). [2025-09-19T22:23:20.403040] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-19T22:23:20.403243] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-19T22:23:20.418807] [INFO ] [MAIN ] Derivative Progress: 1219/2093 symbols completed. MPX took 1.1s. Estimated remaining: 5m 40s. Rate: 154.2 symbols/min [2025-09-19T22:23:20.419436] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:20.420004] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:20.428258] [INFO ] [MAIN ] MPW: Generated 1820 derivative records from 54280 primary records. [2025-09-19T22:23:20.432494] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-19T22:23:20.450677] [DEBUG] [LOCAL ] MQT: Derivative data saved (1820 records). [2025-09-19T22:23:20.453538] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-19T22:23:20.455978] [INFO ] [MAIN ] Derivative Progress: 1220/2093 symbols completed. MQT took 1.1s. Estimated remaining: 5m 39s. Rate: 154.4 symbols/min [2025-09-19T22:23:20.456717] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:20.457854] [DEBUG] [LOCAL ] MPW: Derivative data saved (1820 records). [2025-09-19T22:23:20.457985] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-19T22:23:20.460751] [INFO ] [MAIN ] Derivative Progress: 1221/2093 symbols completed. MPW took 1.3s. Estimated remaining: 5m 39s. Rate: 154.5 symbols/min [2025-09-19T22:23:20.466067] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:20.477594] [DEBUG] [LOCAL ] MQY: Loaded 17048 existing records from primary storage. [2025-09-19T22:23:20.477873] [INFO ] [MAIN ] MQY: Loaded 17048 primary data records. [2025-09-19T22:23:20.838421] [DEBUG] [LOCAL ] MRC: Loaded 38199 existing records from primary storage. [2025-09-19T22:23:20.858460] [INFO ] [MAIN ] MRC: Loaded 38199 primary data records. [2025-09-19T22:23:20.873521] [DEBUG] [LOCAL ] MRK: Loaded 54569 existing records from primary storage. [2025-09-19T22:23:20.884444] [INFO ] [MAIN ] MRK: Loaded 54569 primary data records. [2025-09-19T22:23:21.503872] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:21.504850] [INFO ] [MAIN ] MQY: Generated 1820 derivative records from 17048 primary records. [2025-09-19T22:23:21.505532] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-19T22:23:21.527355] [DEBUG] [LOCAL ] MQY: Derivative data saved (1820 records). [2025-09-19T22:23:21.529196] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-19T22:23:21.534038] [INFO ] [MAIN ] Derivative Progress: 1222/2093 symbols completed. MQY took 1.1s. Estimated remaining: 5m 39s. Rate: 154.3 symbols/min [2025-09-19T22:23:21.536293] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:21.563291] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:21.563009] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:21.564628] [INFO ] [MAIN ] MRK: Generated 1820 derivative records from 54569 primary records. [2025-09-19T22:23:21.565329] [INFO ] [MAIN ] MRC: Generated 1820 derivative records from 38199 primary records. [2025-09-19T22:23:21.564732] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-19T22:23:21.565485] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-19T22:23:21.595502] [DEBUG] [LOCAL ] MRK: Derivative data saved (1820 records). [2025-09-19T22:23:21.595734] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-19T22:23:21.599331] [INFO ] [MAIN ] Derivative Progress: 1223/2093 symbols completed. MRK took 1.1s. Estimated remaining: 5m 38s. Rate: 154.4 symbols/min [2025-09-19T22:23:21.599983] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:21.604637] [DEBUG] [LOCAL ] MRC: Derivative data saved (1820 records). [2025-09-19T22:23:21.604821] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-19T22:23:21.606741] [INFO ] [MAIN ] Derivative Progress: 1224/2093 symbols completed. MRC took 1.2s. Estimated remaining: 5m 37s. Rate: 154.5 symbols/min [2025-09-19T22:23:21.607173] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:21.617788] [DEBUG] [LOCAL ] MSB: Loaded 8043 existing records from primary storage. [2025-09-19T22:23:21.618024] [INFO ] [MAIN ] MSB: Loaded 8043 primary data records. [2025-09-19T22:23:21.731371] [DEBUG] [LOCAL ] MSA: Loaded 19039 existing records from primary storage. [2025-09-19T22:23:21.744697] [INFO ] [MAIN ] MSA: Loaded 19039 primary data records. [2025-09-19T22:23:21.981447] [DEBUG] [LOCAL ] MS: Loaded 54474 existing records from primary storage. [2025-09-19T22:23:22.128879] [INFO ] [MAIN ] MS: Loaded 54474 primary data records. [2025-09-19T22:23:22.692753] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:22.695196] [INFO ] [MAIN ] MSB: Generated 1820 derivative records from 8043 primary records. [2025-09-19T22:23:22.695504] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-19T22:23:22.730064] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:22.731620] [INFO ] [MAIN ] MSA: Generated 1820 derivative records from 19039 primary records. [2025-09-19T22:23:22.732100] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-19T22:23:22.732322] [DEBUG] [LOCAL ] MSB: Derivative data saved (1820 records). [2025-09-19T22:23:22.733490] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-19T22:23:22.735761] [INFO ] [MAIN ] Derivative Progress: 1225/2093 symbols completed. MSB took 1.1s. Estimated remaining: 5m 38s. Rate: 154.3 symbols/min [2025-09-19T22:23:22.746113] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:22.766276] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:22.768168] [INFO ] [MAIN ] MS: Generated 1820 derivative records from 54474 primary records. [2025-09-19T22:23:22.768578] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-19T22:23:22.780229] [DEBUG] [LOCAL ] MSA: Derivative data saved (1820 records). [2025-09-19T22:23:22.784568] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-19T22:23:22.787772] [DEBUG] [LOCAL ] MS: Derivative data saved (1820 records). [2025-09-19T22:23:22.790183] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-19T22:23:22.790080] [INFO ] [MAIN ] Derivative Progress: 1226/2093 symbols completed. MSA took 1.2s. Estimated remaining: 5m 37s. Rate: 154.4 symbols/min [2025-09-19T22:23:22.793440] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:22.793323] [INFO ] [MAIN ] Derivative Progress: 1227/2093 symbols completed. MS took 1.3s. Estimated remaining: 5m 36s. Rate: 154.5 symbols/min [2025-09-19T22:23:22.794007] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:22.829501] [DEBUG] [LOCAL ] MSD: Loaded 15868 existing records from primary storage. [2025-09-19T22:23:22.830981] [INFO ] [MAIN ] MSD: Loaded 15868 primary data records. [2025-09-19T22:23:22.830856] [DEBUG] [LOCAL ] MSCI: Loaded 35459 existing records from primary storage. [2025-09-19T22:23:22.831326] [INFO ] [MAIN ] MSCI: Loaded 35459 primary data records. [2025-09-19T22:23:23.088079] [DEBUG] [LOCAL ] MSDL: Loaded 38691 existing records from primary storage. [2025-09-19T22:23:23.103766] [INFO ] [MAIN ] MSDL: Loaded 38691 primary data records. [2025-09-19T22:23:23.851266] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:23.852566] [INFO ] [MAIN ] MSD: Generated 1820 derivative records from 15868 primary records. [2025-09-19T22:23:23.852890] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-19T22:23:23.867377] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:23.879534] [INFO ] [MAIN ] MSCI: Generated 1820 derivative records from 35459 primary records. [2025-09-19T22:23:23.879807] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-19T22:23:23.884574] [DEBUG] [LOCAL ] MSD: Derivative data saved (1820 records). [2025-09-19T22:23:23.885805] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-19T22:23:23.888946] [INFO ] [MAIN ] Derivative Progress: 1228/2093 symbols completed. MSD took 1.1s. Estimated remaining: 5m 36s. Rate: 154.3 symbols/min [2025-09-19T22:23:23.907307] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1820 records). [2025-09-19T22:23:23.907507] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-19T22:23:23.922520] [INFO ] [MAIN ] Derivative Progress: 1229/2093 symbols completed. MSCI took 1.2s. Estimated remaining: 5m 36s. Rate: 154.4 symbols/min [2025-09-19T22:23:23.923099] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:23.923966] [INFO ] [MAIN ] MSDL: Generated 1820 derivative records from 38691 primary records. [2025-09-19T22:23:23.924031] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-19T22:23:23.939687] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1820 records). [2025-09-19T22:23:23.939768] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-19T22:23:23.942713] [INFO ] [MAIN ] Derivative Progress: 1230/2093 symbols completed. MSDL took 1.1s. Estimated remaining: 5m 35s. Rate: 154.5 symbols/min [2025-09-19T22:23:23.943511] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:23.943620] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:23.943818] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:23.991413] [DEBUG] [LOCAL ] MSGS: Loaded 17066 existing records from primary storage. [2025-09-19T22:23:23.991711] [INFO ] [MAIN ] MSGS: Loaded 17066 primary data records. [2025-09-19T22:23:24.061030] [DEBUG] [LOCAL ] MSGE: Loaded 27557 existing records from primary storage. [2025-09-19T22:23:24.086456] [INFO ] [MAIN ] MSGE: Loaded 27557 primary data records. [2025-09-19T22:23:24.117422] [DEBUG] [LOCAL ] MSI: Loaded 41240 existing records from primary storage. [2025-09-19T22:23:24.133036] [INFO ] [MAIN ] MSI: Loaded 41240 primary data records. [2025-09-19T22:23:25.027627] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:25.028951] [INFO ] [MAIN ] MSGS: Generated 1820 derivative records from 17066 primary records. [2025-09-19T22:23:25.029408] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-19T22:23:25.047701] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1820 records). [2025-09-19T22:23:25.047939] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-19T22:23:25.050170] [INFO ] [MAIN ] Derivative Progress: 1231/2093 symbols completed. MSGS took 1.1s. Estimated remaining: 5m 35s. Rate: 154.3 symbols/min [2025-09-19T22:23:25.050620] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:25.071125] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:25.072280] [INFO ] [MAIN ] MSGE: Generated 1820 derivative records from 27557 primary records. [2025-09-19T22:23:25.072379] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-19T22:23:25.085929] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:25.086738] [INFO ] [MAIN ] MSI: Generated 1820 derivative records from 41240 primary records. [2025-09-19T22:23:25.094523] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-19T22:23:25.119829] [DEBUG] [LOCAL ] MSI: Derivative data saved (1820 records). [2025-09-19T22:23:25.121670] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1820 records). [2025-09-19T22:23:25.121579] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-19T22:23:25.121914] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-19T22:23:25.124313] [INFO ] [MAIN ] Derivative Progress: 1232/2093 symbols completed. MSI took 1.2s. Estimated remaining: 5m 35s. Rate: 154.4 symbols/min [2025-09-19T22:23:25.127293] [INFO ] [MAIN ] Derivative Progress: 1233/2093 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 34s. Rate: 154.5 symbols/min [2025-09-19T22:23:25.124792] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:25.136441] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:25.155250] [DEBUG] [LOCAL ] MSM: Loaded 35948 existing records from primary storage. [2025-09-19T22:23:25.155549] [INFO ] [MAIN ] MSM: Loaded 35948 primary data records. [2025-09-19T22:23:25.494131] [DEBUG] [LOCAL ] MTAL: Loaded 36734 existing records from primary storage. [2025-09-19T22:23:25.516988] [INFO ] [MAIN ] MTAL: Loaded 36734 primary data records. [2025-09-19T22:23:25.517807] [DEBUG] [LOCAL ] MT: Loaded 51525 existing records from primary storage. [2025-09-19T22:23:25.530225] [INFO ] [MAIN ] MT: Loaded 51525 primary data records. [2025-09-19T22:23:26.159712] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:26.160963] [INFO ] [MAIN ] MSM: Generated 1820 derivative records from 35948 primary records. [2025-09-19T22:23:26.161057] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-19T22:23:26.179536] [DEBUG] [LOCAL ] MSM: Derivative data saved (1820 records). [2025-09-19T22:23:26.179817] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-19T22:23:26.182112] [INFO ] [MAIN ] Derivative Progress: 1234/2093 symbols completed. MSM took 1.1s. Estimated remaining: 5m 34s. Rate: 154.3 symbols/min [2025-09-19T22:23:26.182782] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:26.202732] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:26.205380] [INFO ] [MAIN ] MT: Generated 1820 derivative records from 51525 primary records. [2025-09-19T22:23:26.206272] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-19T22:23:26.229477] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:26.236438] [INFO ] [MAIN ] MTAL: Generated 1820 derivative records from 36734 primary records. [2025-09-19T22:23:26.237807] [DEBUG] [LOCAL ] MT: Derivative data saved (1820 records). [2025-09-19T22:23:26.237475] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-19T22:23:26.237959] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-19T22:23:26.240432] [INFO ] [MAIN ] Derivative Progress: 1235/2093 symbols completed. MT took 1.1s. Estimated remaining: 5m 33s. Rate: 154.4 symbols/min [2025-09-19T22:23:26.241949] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:26.259044] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1820 records). [2025-09-19T22:23:26.259271] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-19T22:23:26.261734] [INFO ] [MAIN ] Derivative Progress: 1236/2093 symbols completed. MTAL took 1.1s. Estimated remaining: 5m 33s. Rate: 154.5 symbols/min [2025-09-19T22:23:26.262033] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:26.287630] [DEBUG] [LOCAL ] MTD: Loaded 15506 existing records from primary storage. [2025-09-19T22:23:26.287889] [INFO ] [MAIN ] MTD: Loaded 15506 primary data records. [2025-09-19T22:23:26.406757] [DEBUG] [LOCAL ] MTB: Loaded 47970 existing records from primary storage. [2025-09-19T22:23:26.410599] [INFO ] [MAIN ] MTB: Loaded 47970 primary data records. [2025-09-19T22:23:26.867737] [DEBUG] [LOCAL ] MTDR: Loaded 52334 existing records from primary storage. [2025-09-19T22:23:26.973696] [INFO ] [MAIN ] MTDR: Loaded 52334 primary data records. [2025-09-19T22:23:27.338861] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:27.340356] [INFO ] [MAIN ] MTD: Generated 1820 derivative records from 15506 primary records. [2025-09-19T22:23:27.340637] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-19T22:23:27.363985] [DEBUG] [LOCAL ] MTD: Derivative data saved (1820 records). [2025-09-19T22:23:27.364719] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-19T22:23:27.372894] [INFO ] [MAIN ] Derivative Progress: 1237/2093 symbols completed. MTD took 1.1s. Estimated remaining: 5m 33s. Rate: 154.3 symbols/min [2025-09-19T22:23:27.386151] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:27.386274] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:27.387607] [INFO ] [MAIN ] MTB: Generated 1820 derivative records from 47970 primary records. [2025-09-19T22:23:27.388306] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-19T22:23:27.409539] [DEBUG] [LOCAL ] MTB: Derivative data saved (1820 records). [2025-09-19T22:23:27.410385] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-19T22:23:27.412836] [INFO ] [MAIN ] Derivative Progress: 1238/2093 symbols completed. MTB took 1.2s. Estimated remaining: 5m 32s. Rate: 154.4 symbols/min [2025-09-19T22:23:27.413398] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:27.427574] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:27.428302] [INFO ] [MAIN ] MTDR: Generated 1820 derivative records from 52334 primary records. [2025-09-19T22:23:27.428417] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-19T22:23:27.445329] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1820 records). [2025-09-19T22:23:27.445478] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-19T22:23:27.448593] [INFO ] [MAIN ] Derivative Progress: 1239/2093 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 32s. Rate: 154.5 symbols/min [2025-09-19T22:23:27.448994] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:27.508249] [DEBUG] [LOCAL ] MTH: Loaded 44670 existing records from primary storage. [2025-09-19T22:23:27.508469] [INFO ] [MAIN ] MTH: Loaded 44670 primary data records. [2025-09-19T22:23:27.637543] [DEBUG] [LOCAL ] MTG: Loaded 52129 existing records from primary storage. [2025-09-19T22:23:27.642598] [INFO ] [MAIN ] MTG: Loaded 52129 primary data records. [2025-09-19T22:23:27.648713] [DEBUG] [LOCAL ] MTN: Loaded 39558 existing records from primary storage. [2025-09-19T22:23:27.702759] [INFO ] [MAIN ] MTN: Loaded 39558 primary data records. [2025-09-19T22:23:28.520994] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:28.522507] [INFO ] [MAIN ] MTH: Generated 1820 derivative records from 44670 primary records. [2025-09-19T22:23:28.523636] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-19T22:23:28.555947] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:28.557054] [DEBUG] [LOCAL ] MTH: Derivative data saved (1820 records). [2025-09-19T22:23:28.558137] [INFO ] [MAIN ] MTG: Generated 1820 derivative records from 52129 primary records. [2025-09-19T22:23:28.558593] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-19T22:23:28.558494] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-19T22:23:28.561340] [INFO ] [MAIN ] Derivative Progress: 1240/2093 symbols completed. MTH took 1.1s. Estimated remaining: 5m 32s. Rate: 154.3 symbols/min [2025-09-19T22:23:28.562101] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:28.594054] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:28.596366] [INFO ] [MAIN ] MTN: Generated 1820 derivative records from 39558 primary records. [2025-09-19T22:23:28.600540] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-19T22:23:28.595479] [DEBUG] [LOCAL ] MTG: Derivative data saved (1820 records). [2025-09-19T22:23:28.601569] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-19T22:23:28.603924] [INFO ] [MAIN ] Derivative Progress: 1241/2093 symbols completed. MTG took 1.2s. Estimated remaining: 5m 31s. Rate: 154.4 symbols/min [2025-09-19T22:23:28.604528] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:28.623787] [DEBUG] [LOCAL ] MTRN: Loaded 18229 existing records from primary storage. [2025-09-19T22:23:28.630009] [INFO ] [MAIN ] MTRN: Loaded 18229 primary data records. [2025-09-19T22:23:28.648020] [DEBUG] [LOCAL ] MTN: Derivative data saved (1820 records). [2025-09-19T22:23:28.658552] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-19T22:23:28.684405] [INFO ] [MAIN ] Derivative Progress: 1242/2093 symbols completed. MTN took 1.2s. Estimated remaining: 5m 31s. Rate: 154.5 symbols/min [2025-09-19T22:23:28.704591] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:28.849393] [DEBUG] [LOCAL ] MTUS: Loaded 29399 existing records from primary storage. [2025-09-19T22:23:28.979173] [INFO ] [MAIN ] MTUS: Loaded 29399 primary data records. [2025-09-19T22:23:29.069972] [DEBUG] [LOCAL ] MTW: Loaded 27033 existing records from primary storage. [2025-09-19T22:23:29.080825] [INFO ] [MAIN ] MTW: Loaded 27033 primary data records. [2025-09-19T22:23:29.633632] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:29.635341] [INFO ] [MAIN ] MTRN: Generated 1820 derivative records from 18229 primary records. [2025-09-19T22:23:29.635670] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-19T22:23:29.656820] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1820 records). [2025-09-19T22:23:29.657364] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-19T22:23:29.660323] [INFO ] [MAIN ] Derivative Progress: 1243/2093 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 31s. Rate: 154.3 symbols/min [2025-09-19T22:23:29.678825] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:29.679542] [INFO ] [MAIN ] MTUS: Generated 1820 derivative records from 29399 primary records. [2025-09-19T22:23:29.679930] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-19T22:23:29.700257] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1820 records). [2025-09-19T22:23:29.700475] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-19T22:23:29.702798] [INFO ] [MAIN ] Derivative Progress: 1244/2093 symbols completed. MTUS took 1.1s. Estimated remaining: 5m 30s. Rate: 154.4 symbols/min [2025-09-19T22:23:29.715485] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:29.716119] [INFO ] [MAIN ] MTW: Generated 1820 derivative records from 27033 primary records. [2025-09-19T22:23:29.716181] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-19T22:23:29.732310] [DEBUG] [LOCAL ] MTW: Derivative data saved (1820 records). [2025-09-19T22:23:29.732382] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-19T22:23:29.735090] [INFO ] [MAIN ] Derivative Progress: 1245/2093 symbols completed. MTW took 1.0s. Estimated remaining: 5m 29s. Rate: 154.5 symbols/min [2025-09-19T22:23:29.736296] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:29.736510] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:29.736797] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:29.754761] [DEBUG] [LOCAL ] MUA: Loaded 12547 existing records from primary storage. [2025-09-19T22:23:29.760005] [INFO ] [MAIN ] MUA: Loaded 12547 primary data records. [2025-09-19T22:23:29.846878] [DEBUG] [LOCAL ] MTX: Loaded 23151 existing records from primary storage. [2025-09-19T22:23:29.870212] [INFO ] [MAIN ] MTX: Loaded 23151 primary data records. [2025-09-19T22:23:30.343739] [DEBUG] [LOCAL ] MTZ: Loaded 44264 existing records from primary storage. [2025-09-19T22:23:30.353526] [INFO ] [MAIN ] MTZ: Loaded 44264 primary data records. [2025-09-19T22:23:31.141375] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:31.143928] [INFO ] [MAIN ] MUA: Generated 1820 derivative records from 12547 primary records. [2025-09-19T22:23:31.144692] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-19T22:23:31.170583] [DEBUG] [LOCAL ] MUA: Derivative data saved (1820 records). [2025-09-19T22:23:31.171921] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-19T22:23:31.175233] [INFO ] [MAIN ] Derivative Progress: 1246/2093 symbols completed. MUA took 1.4s. Estimated remaining: 5m 30s. Rate: 154.2 symbols/min [2025-09-19T22:23:31.175767] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:31.191262] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:31.192158] [INFO ] [MAIN ] MTX: Generated 1820 derivative records from 23151 primary records. [2025-09-19T22:23:31.192332] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-19T22:23:31.211005] [DEBUG] [LOCAL ] MTX: Derivative data saved (1820 records). [2025-09-19T22:23:31.213492] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-19T22:23:31.215962] [INFO ] [MAIN ] Derivative Progress: 1247/2093 symbols completed. MTX took 1.5s. Estimated remaining: 5m 29s. Rate: 154.3 symbols/min [2025-09-19T22:23:31.221436] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:31.235628] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:31.236453] [INFO ] [MAIN ] MTZ: Generated 1820 derivative records from 44264 primary records. [2025-09-19T22:23:31.236727] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-19T22:23:31.259411] [DEBUG] [LOCAL ] MUC: Loaded 20455 existing records from primary storage. [2025-09-19T22:23:31.263570] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1820 records). [2025-09-19T22:23:31.263693] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-19T22:23:31.263840] [INFO ] [MAIN ] MUC: Loaded 20455 primary data records. [2025-09-19T22:23:31.271664] [INFO ] [MAIN ] Derivative Progress: 1248/2093 symbols completed. MTZ took 1.5s. Estimated remaining: 5m 28s. Rate: 154.4 symbols/min [2025-09-19T22:23:31.290175] [DEBUG] [LOCAL ] MUE: Loaded 12087 existing records from primary storage. [2025-09-19T22:23:31.297290] [INFO ] [MAIN ] MUE: Loaded 12087 primary data records. [2025-09-19T22:23:31.316118] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:31.977478] [DEBUG] [LOCAL ] MUFG: Loaded 53408 existing records from primary storage. [2025-09-19T22:23:31.978825] [INFO ] [MAIN ] MUFG: Loaded 53408 primary data records. [2025-09-19T22:23:32.322945] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:32.324275] [INFO ] [MAIN ] MUC: Generated 1820 derivative records from 20455 primary records. [2025-09-19T22:23:32.325276] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-19T22:23:32.341410] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:32.354131] [INFO ] [MAIN ] MUE: Generated 1820 derivative records from 12087 primary records. [2025-09-19T22:23:32.358474] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-19T22:23:32.358390] [DEBUG] [LOCAL ] MUC: Derivative data saved (1820 records). [2025-09-19T22:23:32.359225] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-19T22:23:32.361436] [INFO ] [MAIN ] Derivative Progress: 1249/2093 symbols completed. MUC took 1.2s. Estimated remaining: 5m 28s. Rate: 154.2 symbols/min [2025-09-19T22:23:32.362298] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:32.381143] [DEBUG] [LOCAL ] MUE: Derivative data saved (1820 records). [2025-09-19T22:23:32.381314] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-19T22:23:32.383715] [INFO ] [MAIN ] Derivative Progress: 1250/2093 symbols completed. MUE took 1.2s. Estimated remaining: 5m 28s. Rate: 154.3 symbols/min [2025-09-19T22:23:32.388496] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:32.396470] [DEBUG] [LOCAL ] MUJ: Loaded 13376 existing records from primary storage. [2025-09-19T22:23:32.396797] [INFO ] [MAIN ] MUJ: Loaded 13376 primary data records. [2025-09-19T22:23:32.538218] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:32.549619] [INFO ] [MAIN ] MUFG: Generated 1820 derivative records from 53408 primary records. [2025-09-19T22:23:32.555005] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-19T22:23:32.773161] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1820 records). [2025-09-19T22:23:32.787734] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-19T22:23:32.794126] [DEBUG] [LOCAL ] MUR: Loaded 53713 existing records from primary storage. [2025-09-19T22:23:32.792784] [INFO ] [MAIN ] Derivative Progress: 1251/2093 symbols completed. MUFG took 1.5s. Estimated remaining: 5m 27s. Rate: 154.3 symbols/min [2025-09-19T22:23:32.794313] [INFO ] [MAIN ] MUR: Loaded 53713 primary data records. [2025-09-19T22:23:32.806768] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:33.177097] [DEBUG] [LOCAL ] MUSA: Loaded 25473 existing records from primary storage. [2025-09-19T22:23:33.179358] [INFO ] [MAIN ] MUSA: Loaded 25473 primary data records. [2025-09-19T22:23:33.209542] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:33.248039] [INFO ] [MAIN ] MUJ: Generated 1820 derivative records from 13376 primary records. [2025-09-19T22:23:33.270022] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-19T22:23:33.546183] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1820 records). [2025-09-19T22:23:33.546523] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-19T22:23:33.548956] [INFO ] [MAIN ] Derivative Progress: 1252/2093 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 27s. Rate: 154.2 symbols/min [2025-09-19T22:23:33.550250] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:33.565344] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:33.566531] [INFO ] [MAIN ] MUR: Generated 1820 derivative records from 53713 primary records. [2025-09-19T22:23:33.566741] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-19T22:23:33.587495] [DEBUG] [LOCAL ] MUR: Derivative data saved (1820 records). [2025-09-19T22:23:33.587912] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-19T22:23:33.590035] [INFO ] [MAIN ] Derivative Progress: 1253/2093 symbols completed. MUR took 1.2s. Estimated remaining: 5m 27s. Rate: 154.3 symbols/min [2025-09-19T22:23:33.590595] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:33.622928] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:33.628790] [DEBUG] [LOCAL ] MVF: Loaded 13078 existing records from primary storage. [2025-09-19T22:23:33.629361] [INFO ] [MAIN ] MVF: Loaded 13078 primary data records. [2025-09-19T22:23:33.628483] [INFO ] [MAIN ] MUSA: Generated 1820 derivative records from 25473 primary records. [2025-09-19T22:23:33.629685] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-19T22:23:33.710780] [DEBUG] [LOCAL ] MUX: Loaded 42940 existing records from primary storage. [2025-09-19T22:23:33.723296] [INFO ] [MAIN ] MUX: Loaded 42940 primary data records. [2025-09-19T22:23:33.834714] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1820 records). [2025-09-19T22:23:33.873537] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-19T22:23:33.880391] [INFO ] [MAIN ] Derivative Progress: 1254/2093 symbols completed. MUSA took 1.1s. Estimated remaining: 5m 26s. Rate: 154.3 symbols/min [2025-09-19T22:23:33.891171] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:34.303033] [DEBUG] [LOCAL ] MVT: Loaded 10194 existing records from primary storage. [2025-09-19T22:23:34.303321] [INFO ] [MAIN ] MVT: Loaded 10194 primary data records. [2025-09-19T22:23:34.647001] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:34.660546] [INFO ] [MAIN ] MVF: Generated 1820 derivative records from 13078 primary records. [2025-09-19T22:23:34.660815] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-19T22:23:34.669933] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:34.674351] [INFO ] [MAIN ] MUX: Generated 1820 derivative records from 42940 primary records. [2025-09-19T22:23:34.674959] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-19T22:23:34.697420] [DEBUG] [LOCAL ] MUX: Derivative data saved (1820 records). [2025-09-19T22:23:34.697672] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-19T22:23:34.696798] [DEBUG] [LOCAL ] MVF: Derivative data saved (1820 records). [2025-09-19T22:23:34.701220] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-19T22:23:34.700749] [INFO ] [MAIN ] Derivative Progress: 1255/2093 symbols completed. MUX took 1.2s. Estimated remaining: 5m 26s. Rate: 154.2 symbols/min [2025-09-19T22:23:34.704505] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:34.704593] [INFO ] [MAIN ] Derivative Progress: 1256/2093 symbols completed. MVF took 1.1s. Estimated remaining: 5m 26s. Rate: 154.3 symbols/min [2025-09-19T22:23:34.706407] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:34.720090] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:34.720958] [INFO ] [MAIN ] MVT: Generated 1820 derivative records from 10194 primary records. [2025-09-19T22:23:34.721160] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-19T22:23:34.745452] [DEBUG] [LOCAL ] MVT: Derivative data saved (1820 records). [2025-09-19T22:23:34.745666] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-19T22:23:34.748592] [INFO ] [MAIN ] Derivative Progress: 1257/2093 symbols completed. MVT took 0.9s. Estimated remaining: 5m 25s. Rate: 154.4 symbols/min [2025-09-19T22:23:34.749098] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:34.758619] [DEBUG] [LOCAL ] MX: Loaded 23271 existing records from primary storage. [2025-09-19T22:23:34.758859] [INFO ] [MAIN ] MX: Loaded 23271 primary data records. [2025-09-19T22:23:34.829233] [DEBUG] [LOCAL ] MXF: Loaded 6145 existing records from primary storage. [2025-09-19T22:23:34.849316] [INFO ] [MAIN ] MXF: Loaded 6145 primary data records. [2025-09-19T22:23:35.105284] [DEBUG] [LOCAL ] MWA: Loaded 47924 existing records from primary storage. [2025-09-19T22:23:35.273905] [INFO ] [MAIN ] MWA: Loaded 47924 primary data records. [2025-09-19T22:23:35.768026] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:35.769209] [INFO ] [MAIN ] MX: Generated 1820 derivative records from 23271 primary records. [2025-09-19T22:23:35.768503] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:35.769396] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-19T22:23:35.770551] [INFO ] [MAIN ] MXF: Generated 1820 derivative records from 6145 primary records. [2025-09-19T22:23:35.770739] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-19T22:23:35.798895] [DEBUG] [LOCAL ] MXF: Derivative data saved (1820 records). [2025-09-19T22:23:35.799606] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-19T22:23:35.805137] [INFO ] [MAIN ] Derivative Progress: 1258/2093 symbols completed. MXF took 1.1s. Estimated remaining: 5m 25s. Rate: 154.2 symbols/min [2025-09-19T22:23:35.807035] [DEBUG] [LOCAL ] MX: Derivative data saved (1820 records). [2025-09-19T22:23:35.807316] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-19T22:23:35.821784] [INFO ] [MAIN ] Derivative Progress: 1259/2093 symbols completed. MX took 1.1s. Estimated remaining: 5m 24s. Rate: 154.3 symbols/min [2025-09-19T22:23:35.822094] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:35.822888] [INFO ] [MAIN ] MWA: Generated 1820 derivative records from 47924 primary records. [2025-09-19T22:23:35.823074] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-19T22:23:35.838366] [DEBUG] [LOCAL ] MWA: Derivative data saved (1820 records). [2025-09-19T22:23:35.838424] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-19T22:23:35.840861] [INFO ] [MAIN ] Derivative Progress: 1260/2093 symbols completed. MWA took 1.1s. Estimated remaining: 5m 24s. Rate: 154.4 symbols/min [2025-09-19T22:23:35.841395] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:35.841476] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:35.841835] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:35.862498] [DEBUG] [LOCAL ] MYD: Loaded 13981 existing records from primary storage. [2025-09-19T22:23:35.862732] [INFO ] [MAIN ] MYD: Loaded 13981 primary data records. [2025-09-19T22:23:35.986161] [DEBUG] [LOCAL ] MYI: Loaded 19663 existing records from primary storage. [2025-09-19T22:23:35.986777] [DEBUG] [LOCAL ] MYE: Loaded 25917 existing records from primary storage. [2025-09-19T22:23:35.986850] [INFO ] [MAIN ] MYI: Loaded 19663 primary data records. [2025-09-19T22:23:35.987005] [INFO ] [MAIN ] MYE: Loaded 25917 primary data records. [2025-09-19T22:23:36.859426] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:36.860293] [INFO ] [MAIN ] MYD: Generated 1820 derivative records from 13981 primary records. [2025-09-19T22:23:36.860494] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-19T22:23:36.877810] [DEBUG] [LOCAL ] MYD: Derivative data saved (1820 records). [2025-09-19T22:23:36.879431] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-19T22:23:36.881661] [INFO ] [MAIN ] Derivative Progress: 1261/2093 symbols completed. MYD took 1.0s. Estimated remaining: 5m 24s. Rate: 154.2 symbols/min [2025-09-19T22:23:36.882896] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:36.898334] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:36.910743] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:36.911416] [INFO ] [MAIN ] MYI: Generated 1820 derivative records from 19663 primary records. [2025-09-19T22:23:36.912087] [INFO ] [MAIN ] MYE: Generated 1820 derivative records from 25917 primary records. [2025-09-19T22:23:36.912176] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-19T22:23:36.912281] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-19T22:23:36.940087] [DEBUG] [LOCAL ] MYN: Loaded 10530 existing records from primary storage. [2025-09-19T22:23:36.940420] [INFO ] [MAIN ] MYN: Loaded 10530 primary data records. [2025-09-19T22:23:36.991353] [DEBUG] [LOCAL ] MYI: Derivative data saved (1820 records). [2025-09-19T22:23:37.018170] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-19T22:23:37.027111] [INFO ] [MAIN ] Derivative Progress: 1262/2093 symbols completed. MYI took 1.2s. Estimated remaining: 5m 23s. Rate: 154.3 symbols/min [2025-09-19T22:23:37.038138] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:37.057304] [DEBUG] [LOCAL ] MYE: Derivative data saved (1820 records). [2025-09-19T22:23:37.057475] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-19T22:23:37.060531] [INFO ] [MAIN ] Derivative Progress: 1263/2093 symbols completed. MYE took 1.2s. Estimated remaining: 5m 23s. Rate: 154.4 symbols/min [2025-09-19T22:23:37.071594] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:37.300720] [DEBUG] [LOCAL ] NAC: Loaded 25128 existing records from primary storage. [2025-09-19T22:23:37.301716] [INFO ] [MAIN ] NAC: Loaded 25128 primary data records. [2025-09-19T22:23:37.302357] [DEBUG] [LOCAL ] NABL: Loaded 40942 existing records from primary storage. [2025-09-19T22:23:37.323446] [INFO ] [MAIN ] NABL: Loaded 40942 primary data records. [2025-09-19T22:23:37.930080] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:37.931719] [INFO ] [MAIN ] MYN: Generated 1820 derivative records from 10530 primary records. [2025-09-19T22:23:37.931860] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-19T22:23:37.951057] [DEBUG] [LOCAL ] MYN: Derivative data saved (1820 records). [2025-09-19T22:23:37.952216] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-19T22:23:37.954905] [INFO ] [MAIN ] Derivative Progress: 1264/2093 symbols completed. MYN took 1.1s. Estimated remaining: 5m 22s. Rate: 154.2 symbols/min [2025-09-19T22:23:37.955717] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:37.981701] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:37.994957] [INFO ] [MAIN ] NABL: Generated 1820 derivative records from 40942 primary records. [2025-09-19T22:23:37.995226] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-19T22:23:37.995404] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:37.996639] [INFO ] [MAIN ] NAC: Generated 1820 derivative records from 25128 primary records. [2025-09-19T22:23:38.005433] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-19T22:23:38.033939] [DEBUG] [LOCAL ] NAC: Derivative data saved (1820 records). [2025-09-19T22:23:38.035125] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-19T22:23:38.038035] [INFO ] [MAIN ] Derivative Progress: 1265/2093 symbols completed. NAC took 1.0s. Estimated remaining: 5m 22s. Rate: 154.3 symbols/min [2025-09-19T22:23:38.038992] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:38.050099] [DEBUG] [LOCAL ] NABL: Derivative data saved (1820 records). [2025-09-19T22:23:38.050204] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-19T22:23:38.052916] [INFO ] [MAIN ] Derivative Progress: 1266/2093 symbols completed. NABL took 1.0s. Estimated remaining: 5m 21s. Rate: 154.5 symbols/min [2025-09-19T22:23:38.053267] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:38.056141] [DEBUG] [LOCAL ] NAD: Loaded 34609 existing records from primary storage. [2025-09-19T22:23:38.056342] [INFO ] [MAIN ] NAD: Loaded 34609 primary data records. [2025-09-19T22:23:38.168305] [DEBUG] [LOCAL ] NAN: Loaded 9197 existing records from primary storage. [2025-09-19T22:23:38.179954] [INFO ] [MAIN ] NAN: Loaded 9197 primary data records. [2025-09-19T22:23:38.738932] [DEBUG] [LOCAL ] NAT: Loaded 49893 existing records from primary storage. [2025-09-19T22:23:38.739303] [INFO ] [MAIN ] NAT: Loaded 49893 primary data records. [2025-09-19T22:23:39.067899] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:39.069513] [INFO ] [MAIN ] NAD: Generated 1820 derivative records from 34609 primary records. [2025-09-19T22:23:39.070186] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-19T22:23:39.091205] [DEBUG] [LOCAL ] NAD: Derivative data saved (1820 records). [2025-09-19T22:23:39.104624] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-19T22:23:39.106932] [INFO ] [MAIN ] Derivative Progress: 1267/2093 symbols completed. NAD took 1.2s. Estimated remaining: 5m 21s. Rate: 154.2 symbols/min [2025-09-19T22:23:39.107707] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:39.108852] [INFO ] [MAIN ] NAN: Generated 1820 derivative records from 9197 primary records. [2025-09-19T22:23:39.109004] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-19T22:23:39.107304] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:39.126193] [DEBUG] [LOCAL ] NAN: Derivative data saved (1820 records). [2025-09-19T22:23:39.127999] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-19T22:23:39.131297] [INFO ] [MAIN ] Derivative Progress: 1268/2093 symbols completed. NAN took 1.1s. Estimated remaining: 5m 21s. Rate: 154.4 symbols/min [2025-09-19T22:23:39.131777] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:39.147747] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:39.149419] [INFO ] [MAIN ] NAT: Generated 1820 derivative records from 49893 primary records. [2025-09-19T22:23:39.149636] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-19T22:23:39.160949] [DEBUG] [LOCAL ] NAZ: Loaded 2766 existing records from primary storage. [2025-09-19T22:23:39.161219] [INFO ] [MAIN ] NAZ: Loaded 2766 primary data records. [2025-09-19T22:23:39.256836] [DEBUG] [LOCAL ] NAT: Derivative data saved (1820 records). [2025-09-19T22:23:39.282392] [DEBUG] [LOCAL ] NATL: Loaded 33354 existing records from primary storage. [2025-09-19T22:23:39.294699] [INFO ] [MAIN ] NATL: Loaded 33354 primary data records. [2025-09-19T22:23:39.290778] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-19T22:23:39.323220] [INFO ] [MAIN ] Derivative Progress: 1269/2093 symbols completed. NAT took 1.3s. Estimated remaining: 5m 20s. Rate: 154.4 symbols/min [2025-09-19T22:23:39.364711] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:39.658835] [DEBUG] [LOCAL ] NBB: Loaded 9027 existing records from primary storage. [2025-09-19T22:23:39.790946] [INFO ] [MAIN ] NBB: Loaded 9027 primary data records. [2025-09-19T22:23:40.140295] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:40.154062] [INFO ] [MAIN ] NAZ: Generated 1820 derivative records from 2766 primary records. [2025-09-19T22:23:40.154752] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:40.155874] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-19T22:23:40.155803] [INFO ] [MAIN ] NATL: Generated 1820 derivative records from 33354 primary records. [2025-09-19T22:23:40.156522] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-19T22:23:40.188620] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1820 records). [2025-09-19T22:23:40.189807] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-19T22:23:40.194141] [INFO ] [MAIN ] Derivative Progress: 1270/2093 symbols completed. NAZ took 1.1s. Estimated remaining: 5m 20s. Rate: 154.3 symbols/min [2025-09-19T22:23:40.195168] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:40.191942] [DEBUG] [LOCAL ] NATL: Derivative data saved (1820 records). [2025-09-19T22:23:40.195596] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-19T22:23:40.198583] [INFO ] [MAIN ] Derivative Progress: 1271/2093 symbols completed. NATL took 1.1s. Estimated remaining: 5m 19s. Rate: 154.4 symbols/min [2025-09-19T22:23:40.199246] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:40.213187] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:40.213961] [INFO ] [MAIN ] NBB: Generated 1820 derivative records from 9027 primary records. [2025-09-19T22:23:40.214022] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-19T22:23:40.230351] [DEBUG] [LOCAL ] NBB: Derivative data saved (1820 records). [2025-09-19T22:23:40.230623] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-19T22:23:40.233202] [INFO ] [MAIN ] Derivative Progress: 1272/2093 symbols completed. NBB took 0.9s. Estimated remaining: 5m 19s. Rate: 154.5 symbols/min [2025-09-19T22:23:40.233526] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:40.252222] [DEBUG] [LOCAL ] NBHC: Loaded 23438 existing records from primary storage. [2025-09-19T22:23:40.259931] [INFO ] [MAIN ] NBHC: Loaded 23438 primary data records. [2025-09-19T22:23:40.348027] [DEBUG] [LOCAL ] NBXG: Loaded 23153 existing records from primary storage. [2025-09-19T22:23:40.360143] [DEBUG] [LOCAL ] NBR: Loaded 35512 existing records from primary storage. [2025-09-19T22:23:40.367496] [INFO ] [MAIN ] NBR: Loaded 35512 primary data records. [2025-09-19T22:23:40.359376] [INFO ] [MAIN ] NBXG: Loaded 23153 primary data records. [2025-09-19T22:23:41.290218] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:41.298592] [INFO ] [MAIN ] NBXG: Generated 1820 derivative records from 23153 primary records. [2025-09-19T22:23:41.303898] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-19T22:23:41.304843] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:41.305586] [INFO ] [MAIN ] NBHC: Generated 1820 derivative records from 23438 primary records. [2025-09-19T22:23:41.306071] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-19T22:23:41.336345] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1820 records). [2025-09-19T22:23:41.352130] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-19T22:23:41.354911] [INFO ] [MAIN ] Derivative Progress: 1273/2093 symbols completed. NBXG took 1.1s. Estimated remaining: 5m 19s. Rate: 154.3 symbols/min [2025-09-19T22:23:41.358065] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:41.359589] [INFO ] [MAIN ] NBR: Generated 1820 derivative records from 35512 primary records. [2025-09-19T22:23:41.359794] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-19T22:23:41.364230] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1820 records). [2025-09-19T22:23:41.371582] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-19T22:23:41.374723] [INFO ] [MAIN ] Derivative Progress: 1274/2093 symbols completed. NBHC took 1.2s. Estimated remaining: 5m 18s. Rate: 154.4 symbols/min [2025-09-19T22:23:41.381597] [DEBUG] [LOCAL ] NBR: Derivative data saved (1820 records). [2025-09-19T22:23:41.381697] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-19T22:23:41.384490] [INFO ] [MAIN ] Derivative Progress: 1275/2093 symbols completed. NBR took 1.2s. Estimated remaining: 5m 18s. Rate: 154.5 symbols/min [2025-09-19T22:23:41.385187] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:41.385376] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:41.386178] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:41.390865] [DEBUG] [LOCAL ] NC: Loaded 1945 existing records from primary storage. [2025-09-19T22:23:41.391054] [INFO ] [MAIN ] NC: Loaded 1945 primary data records. [2025-09-19T22:23:41.504786] [DEBUG] [LOCAL ] NCA: Loaded 10214 existing records from primary storage. [2025-09-19T22:23:41.525865] [INFO ] [MAIN ] NCA: Loaded 10214 primary data records. [2025-09-19T22:23:41.667979] [DEBUG] [LOCAL ] NCDL: Loaded 22141 existing records from primary storage. [2025-09-19T22:23:41.804619] [INFO ] [MAIN ] NCDL: Loaded 22141 primary data records. [2025-09-19T22:23:42.384408] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:42.385320] [INFO ] [MAIN ] NC: Generated 1820 derivative records from 1945 primary records. [2025-09-19T22:23:42.385535] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-19T22:23:42.402206] [DEBUG] [LOCAL ] NC: Derivative data saved (1820 records). [2025-09-19T22:23:42.402421] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-19T22:23:42.405864] [INFO ] [MAIN ] Derivative Progress: 1276/2093 symbols completed. NC took 1.0s. Estimated remaining: 5m 18s. Rate: 154.3 symbols/min [2025-09-19T22:23:42.407303] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:42.420967] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:42.424338] [INFO ] [MAIN ] NCA: Generated 1820 derivative records from 10214 primary records. [2025-09-19T22:23:42.424683] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-19T22:23:42.450280] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:23:42.452359] [INFO ] [MAIN ] NCDL: Generated 1819 derivative records from 22141 primary records. [2025-09-19T22:23:42.452440] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-19T22:23:42.470087] [DEBUG] [LOCAL ] NCA: Derivative data saved (1820 records). [2025-09-19T22:23:42.471515] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-19T22:23:42.475063] [INFO ] [MAIN ] Derivative Progress: 1277/2093 symbols completed. NCA took 1.1s. Estimated remaining: 5m 17s. Rate: 154.4 symbols/min [2025-09-19T22:23:42.475668] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:42.477712] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1819 records). [2025-09-19T22:23:42.478181] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-19T22:23:42.480991] [INFO ] [MAIN ] Derivative Progress: 1278/2093 symbols completed. NCDL took 1.1s. Estimated remaining: 5m 16s. Rate: 154.5 symbols/min [2025-09-19T22:23:42.481330] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:42.510677] [DEBUG] [LOCAL ] NCV: Loaded 13619 existing records from primary storage. [2025-09-19T22:23:42.510933] [INFO ] [MAIN ] NCV: Loaded 13619 primary data records. [2025-09-19T22:23:42.538731] [DEBUG] [LOCAL ] NCZ: Loaded 11979 existing records from primary storage. [2025-09-19T22:23:42.562279] [INFO ] [MAIN ] NCZ: Loaded 11979 primary data records. [2025-09-19T22:23:42.664816] [DEBUG] [LOCAL ] NCLH: Loaded 54533 existing records from primary storage. [2025-09-19T22:23:42.696061] [INFO ] [MAIN ] NCLH: Loaded 54533 primary data records. [2025-09-19T22:23:43.520354] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:43.522622] [INFO ] [MAIN ] NCZ: Generated 1820 derivative records from 11979 primary records. [2025-09-19T22:23:43.524036] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-19T22:23:43.551251] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:43.553399] [INFO ] [MAIN ] NCV: Generated 1820 derivative records from 13619 primary records. [2025-09-19T22:23:43.554869] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-19T22:23:43.586712] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:43.589062] [INFO ] [MAIN ] NCLH: Generated 1820 derivative records from 54533 primary records. [2025-09-19T22:23:43.589691] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-19T22:23:43.590159] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1820 records). [2025-09-19T22:23:43.591916] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-19T22:23:43.594928] [INFO ] [MAIN ] Derivative Progress: 1279/2093 symbols completed. NCZ took 1.1s. Estimated remaining: 5m 17s. Rate: 154.3 symbols/min [2025-09-19T22:23:43.595751] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:43.604267] [DEBUG] [LOCAL ] NCV: Derivative data saved (1820 records). [2025-09-19T22:23:43.604547] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-19T22:23:43.611126] [INFO ] [MAIN ] Derivative Progress: 1280/2093 symbols completed. NCV took 1.1s. Estimated remaining: 5m 16s. Rate: 154.4 symbols/min [2025-09-19T22:23:43.612167] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:43.621855] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1820 records). [2025-09-19T22:23:43.622216] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-19T22:23:43.625528] [INFO ] [MAIN ] Derivative Progress: 1281/2093 symbols completed. NCLH took 1.2s. Estimated remaining: 5m 15s. Rate: 154.5 symbols/min [2025-09-19T22:23:43.625957] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:43.633926] [DEBUG] [LOCAL ] NDMO: Loaded 16709 existing records from primary storage. [2025-09-19T22:23:43.634096] [INFO ] [MAIN ] NDMO: Loaded 16709 primary data records. [2025-09-19T22:23:44.004685] [DEBUG] [LOCAL ] NEA: Loaded 35876 existing records from primary storage. [2025-09-19T22:23:44.006137] [INFO ] [MAIN ] NEA: Loaded 35876 primary data records. [2025-09-19T22:23:44.006943] [DEBUG] [LOCAL ] NE: Loaded 53173 existing records from primary storage. [2025-09-19T22:23:44.012706] [INFO ] [MAIN ] NE: Loaded 53173 primary data records. [2025-09-19T22:23:44.704143] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:44.705395] [INFO ] [MAIN ] NDMO: Generated 1820 derivative records from 16709 primary records. [2025-09-19T22:23:44.708717] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-19T22:23:44.730593] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1820 records). [2025-09-19T22:23:44.730966] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-19T22:23:44.733195] [INFO ] [MAIN ] Derivative Progress: 1282/2093 symbols completed. NDMO took 1.1s. Estimated remaining: 5m 15s. Rate: 154.3 symbols/min [2025-09-19T22:23:44.733761] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:44.754457] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:44.755978] [INFO ] [MAIN ] NE: Generated 1820 derivative records from 53173 primary records. [2025-09-19T22:23:44.756075] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-19T22:23:44.782843] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:44.784434] [INFO ] [MAIN ] NEA: Generated 1820 derivative records from 35876 primary records. [2025-09-19T22:23:44.784623] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-19T22:23:44.787394] [DEBUG] [LOCAL ] NE: Derivative data saved (1820 records). [2025-09-19T22:23:44.787731] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-19T22:23:44.789956] [INFO ] [MAIN ] Derivative Progress: 1283/2093 symbols completed. NE took 1.2s. Estimated remaining: 5m 15s. Rate: 154.4 symbols/min [2025-09-19T22:23:44.801242] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:44.806538] [DEBUG] [LOCAL ] NEA: Derivative data saved (1820 records). [2025-09-19T22:23:44.806670] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-19T22:23:44.823097] [INFO ] [MAIN ] Derivative Progress: 1284/2093 symbols completed. NEA took 1.2s. Estimated remaining: 5m 14s. Rate: 154.5 symbols/min [2025-09-19T22:23:44.823500] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:44.845708] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-09-19T22:23:44.845949] [INFO ] [MAIN ] NEE: Loaded 54487 primary data records. [2025-09-19T22:23:45.215328] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-09-19T22:23:45.214145] [DEBUG] [LOCAL ] NET: Loaded 53854 existing records from primary storage. [2025-09-19T22:23:45.215758] [INFO ] [MAIN ] NET: Loaded 53854 primary data records. [2025-09-19T22:23:45.215697] [INFO ] [MAIN ] NEM: Loaded 54488 primary data records. [2025-09-19T22:23:45.864014] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:45.865124] [INFO ] [MAIN ] NEE: Generated 1820 derivative records from 54487 primary records. [2025-09-19T22:23:45.865577] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-19T22:23:45.883734] [DEBUG] [LOCAL ] NEE: Derivative data saved (1820 records). [2025-09-19T22:23:45.883894] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-19T22:23:45.886671] [INFO ] [MAIN ] Derivative Progress: 1285/2093 symbols completed. NEE took 1.2s. Estimated remaining: 5m 14s. Rate: 154.3 symbols/min [2025-09-19T22:23:45.887219] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:45.905776] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:45.910910] [INFO ] [MAIN ] NEM: Generated 1820 derivative records from 54488 primary records. [2025-09-19T22:23:45.911118] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-19T22:23:45.923312] [DEBUG] [LOCAL ] NEU: Loaded 8234 existing records from primary storage. [2025-09-19T22:23:45.928317] [INFO ] [MAIN ] NEU: Loaded 8234 primary data records. [2025-09-19T22:23:45.941307] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:45.952023] [INFO ] [MAIN ] NET: Generated 1820 derivative records from 53854 primary records. [2025-09-19T22:23:45.963138] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-19T22:23:46.039552] [DEBUG] [LOCAL ] NEM: Derivative data saved (1820 records). [2025-09-19T22:23:46.046288] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-19T22:23:46.054337] [INFO ] [MAIN ] Derivative Progress: 1286/2093 symbols completed. NEM took 1.3s. Estimated remaining: 5m 14s. Rate: 154.4 symbols/min [2025-09-19T22:23:46.069822] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:46.075456] [DEBUG] [LOCAL ] NET: Derivative data saved (1820 records). [2025-09-19T22:23:46.086665] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-19T22:23:46.118363] [INFO ] [MAIN ] Derivative Progress: 1287/2093 symbols completed. NET took 1.3s. Estimated remaining: 5m 13s. Rate: 154.5 symbols/min [2025-09-19T22:23:46.155308] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:46.161595] [DEBUG] [LOCAL ] NEUE: Loaded 2278 existing records from primary storage. [2025-09-19T22:23:46.282577] [INFO ] [MAIN ] NEUE: Loaded 2278 primary data records. [2025-09-19T22:23:46.326634] [DEBUG] [LOCAL ] NEXA: Loaded 4087 existing records from primary storage. [2025-09-19T22:23:46.340718] [INFO ] [MAIN ] NEXA: Loaded 4087 primary data records. [2025-09-19T22:23:46.966876] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:46.967681] [INFO ] [MAIN ] NEU: Generated 1820 derivative records from 8234 primary records. [2025-09-19T22:23:46.967890] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-19T22:23:46.984576] [DEBUG] [LOCAL ] NEU: Derivative data saved (1820 records). [2025-09-19T22:23:46.984711] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-19T22:23:46.986885] [INFO ] [MAIN ] Derivative Progress: 1288/2093 symbols completed. NEU took 1.1s. Estimated remaining: 5m 13s. Rate: 154.3 symbols/min [2025-09-19T22:23:47.003527] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:47.004350] [INFO ] [MAIN ] NEUE: Generated 1820 derivative records from 2278 primary records. [2025-09-19T22:23:47.004449] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-19T22:23:47.017399] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1820 records). [2025-09-19T22:23:47.018905] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-19T22:23:47.022115] [INFO ] [MAIN ] Derivative Progress: 1289/2093 symbols completed. NEUE took 1.0s. Estimated remaining: 5m 12s. Rate: 154.4 symbols/min [2025-09-19T22:23:47.034941] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:47.035467] [INFO ] [MAIN ] NEXA: Generated 1820 derivative records from 4087 primary records. [2025-09-19T22:23:47.035527] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-19T22:23:47.048972] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1820 records). [2025-09-19T22:23:47.049034] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-19T22:23:47.051552] [INFO ] [MAIN ] Derivative Progress: 1290/2093 symbols completed. NEXA took 0.9s. Estimated remaining: 5m 12s. Rate: 154.6 symbols/min [2025-09-19T22:23:47.052222] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:47.052316] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:47.054716] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:47.088942] [DEBUG] [LOCAL ] NFJ: Loaded 20729 existing records from primary storage. [2025-09-19T22:23:47.089161] [INFO ] [MAIN ] NFJ: Loaded 20729 primary data records. [2025-09-19T22:23:47.222212] [DEBUG] [LOCAL ] NFG: Loaded 39313 existing records from primary storage. [2025-09-19T22:23:47.244177] [INFO ] [MAIN ] NFG: Loaded 39313 primary data records. [2025-09-19T22:23:47.351219] [DEBUG] [LOCAL ] NGG: Loaded 46764 existing records from primary storage. [2025-09-19T22:23:47.379129] [INFO ] [MAIN ] NGG: Loaded 46764 primary data records. [2025-09-19T22:23:48.068975] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:48.081639] [INFO ] [MAIN ] NFJ: Generated 1820 derivative records from 20729 primary records. [2025-09-19T22:23:48.082063] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-19T22:23:48.083535] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:48.092870] [INFO ] [MAIN ] NFG: Generated 1820 derivative records from 39313 primary records. [2025-09-19T22:23:48.095873] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-19T22:23:48.117232] [DEBUG] [LOCAL ] NFG: Derivative data saved (1820 records). [2025-09-19T22:23:48.117525] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-19T22:23:48.120280] [INFO ] [MAIN ] Derivative Progress: 1291/2093 symbols completed. NFG took 1.1s. Estimated remaining: 5m 12s. Rate: 154.3 symbols/min [2025-09-19T22:23:48.121122] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:48.122774] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1820 records). [2025-09-19T22:23:48.135410] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-19T22:23:48.135980] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:48.137939] [INFO ] [MAIN ] Derivative Progress: 1292/2093 symbols completed. NFJ took 1.1s. Estimated remaining: 5m 11s. Rate: 154.5 symbols/min [2025-09-19T22:23:48.138269] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:48.139102] [INFO ] [MAIN ] NGG: Generated 1820 derivative records from 46764 primary records. [2025-09-19T22:23:48.139290] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-19T22:23:48.155779] [DEBUG] [LOCAL ] NGG: Derivative data saved (1820 records). [2025-09-19T22:23:48.156054] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-19T22:23:48.159265] [INFO ] [MAIN ] Derivative Progress: 1293/2093 symbols completed. NGG took 1.1s. Estimated remaining: 5m 11s. Rate: 154.6 symbols/min [2025-09-19T22:23:48.162604] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:48.176187] [DEBUG] [LOCAL ] NGS: Loaded 11953 existing records from primary storage. [2025-09-19T22:23:48.176325] [INFO ] [MAIN ] NGS: Loaded 11953 primary data records. [2025-09-19T22:23:48.293696] [DEBUG] [LOCAL ] NGL: Loaded 30987 existing records from primary storage. [2025-09-19T22:23:48.310786] [INFO ] [MAIN ] NGL: Loaded 30987 primary data records. [2025-09-19T22:23:48.416565] [DEBUG] [LOCAL ] NGVC: Loaded 22756 existing records from primary storage. [2025-09-19T22:23:48.565525] [INFO ] [MAIN ] NGVC: Loaded 22756 primary data records. [2025-09-19T22:23:49.158356] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:49.159384] [INFO ] [MAIN ] NGS: Generated 1820 derivative records from 11953 primary records. [2025-09-19T22:23:49.159468] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-19T22:23:49.179364] [DEBUG] [LOCAL ] NGS: Derivative data saved (1820 records). [2025-09-19T22:23:49.179505] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-19T22:23:49.181609] [INFO ] [MAIN ] Derivative Progress: 1294/2093 symbols completed. NGS took 1.0s. Estimated remaining: 5m 11s. Rate: 154.4 symbols/min [2025-09-19T22:23:49.182281] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:49.195862] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:49.196815] [INFO ] [MAIN ] NGL: Generated 1820 derivative records from 30987 primary records. [2025-09-19T22:23:49.197173] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-19T22:23:49.213101] [DEBUG] [LOCAL ] NGL: Derivative data saved (1820 records). [2025-09-19T22:23:49.214148] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-19T22:23:49.217826] [INFO ] [MAIN ] Derivative Progress: 1295/2093 symbols completed. NGL took 1.1s. Estimated remaining: 5m 10s. Rate: 154.5 symbols/min [2025-09-19T22:23:49.219104] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:49.238901] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:49.239867] [INFO ] [MAIN ] NGVC: Generated 1820 derivative records from 22756 primary records. [2025-09-19T22:23:49.240046] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-19T22:23:49.261808] [DEBUG] [LOCAL ] NGVT: Loaded 24863 existing records from primary storage. [2025-09-19T22:23:49.263346] [INFO ] [MAIN ] NGVT: Loaded 24863 primary data records. [2025-09-19T22:23:49.300286] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1820 records). [2025-09-19T22:23:49.336934] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-19T22:23:49.336831] [DEBUG] [LOCAL ] NHI: Loaded 22458 existing records from primary storage. [2025-09-19T22:23:49.360462] [INFO ] [MAIN ] Derivative Progress: 1296/2093 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 9s. Rate: 154.6 symbols/min [2025-09-19T22:23:49.360846] [INFO ] [MAIN ] NHI: Loaded 22458 primary data records. [2025-09-19T22:23:49.360747] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:49.575190] [DEBUG] [LOCAL ] NIC: Loaded 9062 existing records from primary storage. [2025-09-19T22:23:49.575369] [INFO ] [MAIN ] NIC: Loaded 9062 primary data records. [2025-09-19T22:23:50.224331] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:50.225129] [INFO ] [MAIN ] NGVT: Generated 1820 derivative records from 24863 primary records. [2025-09-19T22:23:50.225329] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-19T22:23:50.242566] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1820 records). [2025-09-19T22:23:50.244933] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-19T22:23:50.247921] [INFO ] [MAIN ] Derivative Progress: 1297/2093 symbols completed. NGVT took 1.1s. Estimated remaining: 5m 9s. Rate: 154.4 symbols/min [2025-09-19T22:23:50.248610] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:50.263499] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:50.264795] [INFO ] [MAIN ] NHI: Generated 1820 derivative records from 22458 primary records. [2025-09-19T22:23:50.265022] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-19T22:23:50.290443] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:50.295557] [INFO ] [MAIN ] NIC: Generated 1820 derivative records from 9062 primary records. [2025-09-19T22:23:50.296815] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-19T22:23:50.307151] [DEBUG] [LOCAL ] NHI: Derivative data saved (1820 records). [2025-09-19T22:23:50.310727] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-19T22:23:50.318557] [DEBUG] [LOCAL ] NIE: Loaded 11831 existing records from primary storage. [2025-09-19T22:23:50.318689] [INFO ] [MAIN ] NIE: Loaded 11831 primary data records. [2025-09-19T22:23:50.321319] [INFO ] [MAIN ] Derivative Progress: 1298/2093 symbols completed. NHI took 1.1s. Estimated remaining: 5m 9s. Rate: 154.5 symbols/min [2025-09-19T22:23:50.321667] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:50.328101] [DEBUG] [LOCAL ] NIC: Derivative data saved (1820 records). [2025-09-19T22:23:50.328210] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-19T22:23:50.356570] [INFO ] [MAIN ] Derivative Progress: 1299/2093 symbols completed. NIC took 1.0s. Estimated remaining: 5m 8s. Rate: 154.6 symbols/min [2025-09-19T22:23:50.408124] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:50.432530] [DEBUG] [LOCAL ] NIM: Loaded 4178 existing records from primary storage. [2025-09-19T22:23:50.443499] [INFO ] [MAIN ] NIM: Loaded 4178 primary data records. [2025-09-19T22:23:50.824269] [DEBUG] [LOCAL ] NINE: Loaded 29387 existing records from primary storage. [2025-09-19T22:23:50.848499] [INFO ] [MAIN ] NINE: Loaded 29387 primary data records. [2025-09-19T22:23:51.295745] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:51.296850] [INFO ] [MAIN ] NIE: Generated 1820 derivative records from 11831 primary records. [2025-09-19T22:23:51.297072] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-19T22:23:51.316969] [DEBUG] [LOCAL ] NIE: Derivative data saved (1820 records). [2025-09-19T22:23:51.317417] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-19T22:23:51.319620] [INFO ] [MAIN ] Derivative Progress: 1300/2093 symbols completed. NIE took 1.1s. Estimated remaining: 5m 8s. Rate: 154.4 symbols/min [2025-09-19T22:23:51.320129] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:51.333712] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:51.334998] [INFO ] [MAIN ] NIM: Generated 1820 derivative records from 4178 primary records. [2025-09-19T22:23:51.335287] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-19T22:23:51.353510] [DEBUG] [LOCAL ] NIM: Derivative data saved (1820 records). [2025-09-19T22:23:51.353781] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-19T22:23:51.356368] [INFO ] [MAIN ] Derivative Progress: 1301/2093 symbols completed. NIM took 1.0s. Estimated remaining: 5m 7s. Rate: 154.5 symbols/min [2025-09-19T22:23:51.356766] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:51.370330] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:51.371272] [INFO ] [MAIN ] NINE: Generated 1820 derivative records from 29387 primary records. [2025-09-19T22:23:51.371498] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-19T22:23:51.389679] [DEBUG] [LOCAL ] NINE: Derivative data saved (1820 records). [2025-09-19T22:23:51.389858] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-19T22:23:51.392717] [INFO ] [MAIN ] Derivative Progress: 1302/2093 symbols completed. NINE took 1.0s. Estimated remaining: 5m 7s. Rate: 154.6 symbols/min [2025-09-19T22:23:51.393148] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:51.421060] [DEBUG] [LOCAL ] NLOP: Loaded 12008 existing records from primary storage. [2025-09-19T22:23:51.421262] [INFO ] [MAIN ] NLOP: Loaded 12008 primary data records. [2025-09-19T22:23:51.578137] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-09-19T22:23:51.601974] [INFO ] [MAIN ] NIO: Loaded 54582 primary data records. [2025-09-19T22:23:51.650214] [DEBUG] [LOCAL ] NJR: Loaded 38528 existing records from primary storage. [2025-09-19T22:23:51.696620] [INFO ] [MAIN ] NJR: Loaded 38528 primary data records. [2025-09-19T22:23:52.474866] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:52.476393] [INFO ] [MAIN ] NLOP: Generated 1820 derivative records from 12008 primary records. [2025-09-19T22:23:52.477188] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-19T22:23:52.508595] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:52.510094] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1820 records). [2025-09-19T22:23:52.511156] [INFO ] [MAIN ] NIO: Generated 1820 derivative records from 54582 primary records. [2025-09-19T22:23:52.511371] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-19T22:23:52.510305] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-19T22:23:52.513427] [INFO ] [MAIN ] Derivative Progress: 1303/2093 symbols completed. NLOP took 1.1s. Estimated remaining: 5m 7s. Rate: 154.4 symbols/min [2025-09-19T22:23:52.532535] [DEBUG] [LOCAL ] NIO: Derivative data saved (1820 records). [2025-09-19T22:23:52.532708] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-19T22:23:52.535280] [INFO ] [MAIN ] Derivative Progress: 1304/2093 symbols completed. NIO took 1.2s. Estimated remaining: 5m 6s. Rate: 154.5 symbols/min [2025-09-19T22:23:52.548006] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:52.548637] [INFO ] [MAIN ] NJR: Generated 1820 derivative records from 38528 primary records. [2025-09-19T22:23:52.548731] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-19T22:23:52.564436] [DEBUG] [LOCAL ] NJR: Derivative data saved (1820 records). [2025-09-19T22:23:52.564590] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-19T22:23:52.567298] [INFO ] [MAIN ] Derivative Progress: 1305/2093 symbols completed. NJR took 1.2s. Estimated remaining: 5m 6s. Rate: 154.6 symbols/min [2025-09-19T22:23:52.567904] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:52.568082] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:52.568224] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:52.597573] [DEBUG] [LOCAL ] NMCO: Loaded 16688 existing records from primary storage. [2025-09-19T22:23:52.599637] [DEBUG] [LOCAL ] NMAI: Loaded 13451 existing records from primary storage. [2025-09-19T22:23:52.599983] [INFO ] [MAIN ] NMCO: Loaded 16688 primary data records. [2025-09-19T22:23:52.599922] [INFO ] [MAIN ] NMAI: Loaded 13451 primary data records. [2025-09-19T22:23:52.954970] [DEBUG] [LOCAL ] NLY: Loaded 54361 existing records from primary storage. [2025-09-19T22:23:52.987721] [INFO ] [MAIN ] NLY: Loaded 54361 primary data records. [2025-09-19T22:23:53.641146] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:53.642523] [INFO ] [MAIN ] NMCO: Generated 1820 derivative records from 16688 primary records. [2025-09-19T22:23:53.642675] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-19T22:23:53.672632] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1820 records). [2025-09-19T22:23:53.670511] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:53.672902] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-19T22:23:53.675340] [INFO ] [MAIN ] Derivative Progress: 1306/2093 symbols completed. NMCO took 1.1s. Estimated remaining: 5m 6s. Rate: 154.4 symbols/min [2025-09-19T22:23:53.676220] [INFO ] [MAIN ] NMAI: Generated 1820 derivative records from 13451 primary records. [2025-09-19T22:23:53.676632] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-19T22:23:53.676821] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:53.695427] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1820 records). [2025-09-19T22:23:53.699330] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-19T22:23:53.702192] [INFO ] [MAIN ] Derivative Progress: 1307/2093 symbols completed. NMAI took 1.1s. Estimated remaining: 5m 5s. Rate: 154.5 symbols/min [2025-09-19T22:23:53.702775] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:53.720213] [DEBUG] [LOCAL ] NMG: Loaded 7572 existing records from primary storage. [2025-09-19T22:23:53.720855] [INFO ] [MAIN ] NMG: Loaded 7572 primary data records. [2025-09-19T22:23:53.720755] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:53.734283] [INFO ] [MAIN ] NLY: Generated 1820 derivative records from 54361 primary records. [2025-09-19T22:23:53.753671] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-19T22:23:53.797098] [DEBUG] [LOCAL ] NMI: Loaded 4156 existing records from primary storage. [2025-09-19T22:23:53.802378] [INFO ] [MAIN ] NMI: Loaded 4156 primary data records. [2025-09-19T22:23:53.879279] [DEBUG] [LOCAL ] NLY: Derivative data saved (1820 records). [2025-09-19T22:23:53.907755] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-19T22:23:53.930879] [INFO ] [MAIN ] Derivative Progress: 1308/2093 symbols completed. NLY took 1.4s. Estimated remaining: 5m 5s. Rate: 154.6 symbols/min [2025-09-19T22:23:53.984574] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:54.425743] [DEBUG] [LOCAL ] NMM: Loaded 14541 existing records from primary storage. [2025-09-19T22:23:54.427168] [INFO ] [MAIN ] NMM: Loaded 14541 primary data records. [2025-09-19T22:23:54.787911] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:54.787706] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:54.789140] [INFO ] [MAIN ] NMG: Generated 1820 derivative records from 7572 primary records. [2025-09-19T22:23:54.789839] [INFO ] [MAIN ] NMI: Generated 1820 derivative records from 4156 primary records. [2025-09-19T22:23:54.790095] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-19T22:23:54.789969] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-19T22:23:54.819673] [DEBUG] [LOCAL ] NMI: Derivative data saved (1820 records). [2025-09-19T22:23:54.820562] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-19T22:23:54.823765] [INFO ] [MAIN ] Derivative Progress: 1309/2093 symbols completed. NMI took 1.1s. Estimated remaining: 5m 5s. Rate: 154.4 symbols/min [2025-09-19T22:23:54.824743] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:54.825867] [DEBUG] [LOCAL ] NMG: Derivative data saved (1820 records). [2025-09-19T22:23:54.826206] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-19T22:23:54.828461] [INFO ] [MAIN ] Derivative Progress: 1310/2093 symbols completed. NMG took 1.2s. Estimated remaining: 5m 4s. Rate: 154.5 symbols/min [2025-09-19T22:23:54.829148] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:54.835873] [DEBUG] [LOCAL ] NMS: Loaded 2899 existing records from primary storage. [2025-09-19T22:23:54.836173] [INFO ] [MAIN ] NMS: Loaded 2899 primary data records. [2025-09-19T22:23:54.967896] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:55.009207] [INFO ] [MAIN ] NMM: Generated 1820 derivative records from 14541 primary records. [2025-09-19T22:23:55.060318] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-19T22:23:55.184089] [DEBUG] [LOCAL ] NMR: Loaded 35725 existing records from primary storage. [2025-09-19T22:23:55.193558] [INFO ] [MAIN ] NMR: Loaded 35725 primary data records. [2025-09-19T22:23:55.314441] [DEBUG] [LOCAL ] NMM: Derivative data saved (1820 records). [2025-09-19T22:23:55.326154] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-19T22:23:55.393691] [INFO ] [MAIN ] Derivative Progress: 1311/2093 symbols completed. NMM took 1.4s. Estimated remaining: 5m 4s. Rate: 154.5 symbols/min [2025-09-19T22:23:55.399862] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:55.530713] [DEBUG] [LOCAL ] NMT: Loaded 2857 existing records from primary storage. [2025-09-19T22:23:55.534761] [INFO ] [MAIN ] NMT: Loaded 2857 primary data records. [2025-09-19T22:23:55.619968] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:55.643420] [INFO ] [MAIN ] NMS: Generated 1820 derivative records from 2899 primary records. [2025-09-19T22:23:55.654631] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-19T22:23:55.713806] [DEBUG] [LOCAL ] NMS: Derivative data saved (1820 records). [2025-09-19T22:23:55.719269] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-19T22:23:55.746809] [INFO ] [MAIN ] Derivative Progress: 1312/2093 symbols completed. NMS took 0.9s. Estimated remaining: 5m 3s. Rate: 154.5 symbols/min [2025-09-19T22:23:55.779173] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:55.888118] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:55.889434] [INFO ] [MAIN ] NMR: Generated 1820 derivative records from 35725 primary records. [2025-09-19T22:23:55.889612] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-19T22:23:55.911756] [DEBUG] [LOCAL ] NMR: Derivative data saved (1820 records). [2025-09-19T22:23:55.911952] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-19T22:23:55.914872] [INFO ] [MAIN ] Derivative Progress: 1313/2093 symbols completed. NMR took 1.1s. Estimated remaining: 5m 3s. Rate: 154.6 symbols/min [2025-09-19T22:23:55.915307] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:55.926558] [DEBUG] [LOCAL ] NMZ: Loaded 21695 existing records from primary storage. [2025-09-19T22:23:55.929008] [INFO ] [MAIN ] NMZ: Loaded 21695 primary data records. [2025-09-19T22:23:55.983167] [DEBUG] [LOCAL ] NNI: Loaded 9997 existing records from primary storage. [2025-09-19T22:23:56.017392] [INFO ] [MAIN ] NNI: Loaded 9997 primary data records. [2025-09-19T22:23:56.246824] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:56.247691] [INFO ] [MAIN ] NMT: Generated 1820 derivative records from 2857 primary records. [2025-09-19T22:23:56.359829] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-19T22:23:56.648122] [DEBUG] [LOCAL ] NMT: Derivative data saved (1820 records). [2025-09-19T22:23:56.648931] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-19T22:23:56.651307] [INFO ] [MAIN ] Derivative Progress: 1314/2093 symbols completed. NMT took 1.3s. Estimated remaining: 5m 3s. Rate: 154.5 symbols/min [2025-09-19T22:23:56.652348] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:56.678467] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:56.679533] [INFO ] [MAIN ] NMZ: Generated 1820 derivative records from 21695 primary records. [2025-09-19T22:23:56.679818] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-19T22:23:56.710014] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1820 records). [2025-09-19T22:23:56.710300] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-19T22:23:56.713039] [INFO ] [MAIN ] Derivative Progress: 1315/2093 symbols completed. NMZ took 0.9s. Estimated remaining: 5m 2s. Rate: 154.6 symbols/min [2025-09-19T22:23:56.721101] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:56.728546] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:56.729671] [INFO ] [MAIN ] NNI: Generated 1820 derivative records from 9997 primary records. [2025-09-19T22:23:56.729925] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-19T22:23:56.761743] [DEBUG] [LOCAL ] NNY: Loaded 5772 existing records from primary storage. [2025-09-19T22:23:56.762426] [INFO ] [MAIN ] NNY: Loaded 5772 primary data records. [2025-09-19T22:23:56.775012] [DEBUG] [LOCAL ] NNN: Loaded 49131 existing records from primary storage. [2025-09-19T22:23:56.795228] [INFO ] [MAIN ] NNN: Loaded 49131 primary data records. [2025-09-19T22:23:56.906820] [DEBUG] [LOCAL ] NNI: Derivative data saved (1820 records). [2025-09-19T22:23:56.951140] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-19T22:23:56.963418] [INFO ] [MAIN ] Derivative Progress: 1316/2093 symbols completed. NNI took 1.0s. Estimated remaining: 5m 2s. Rate: 154.6 symbols/min [2025-09-19T22:23:56.964248] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:57.396135] [DEBUG] [LOCAL ] NOA: Loaded 16673 existing records from primary storage. [2025-09-19T22:23:57.396711] [INFO ] [MAIN ] NOA: Loaded 16673 primary data records. [2025-09-19T22:23:57.742611] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:57.743882] [INFO ] [MAIN ] NNY: Generated 1820 derivative records from 5772 primary records. [2025-09-19T22:23:57.744048] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-19T22:23:57.764204] [DEBUG] [LOCAL ] NNY: Derivative data saved (1820 records). [2025-09-19T22:23:57.764550] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-19T22:23:57.780400] [INFO ] [MAIN ] Derivative Progress: 1317/2093 symbols completed. NNY took 1.1s. Estimated remaining: 5m 1s. Rate: 154.5 symbols/min [2025-09-19T22:23:57.781500] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:57.781369] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:57.783000] [INFO ] [MAIN ] NNN: Generated 1820 derivative records from 49131 primary records. [2025-09-19T22:23:57.783398] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-19T22:23:57.801976] [DEBUG] [LOCAL ] NNN: Derivative data saved (1820 records). [2025-09-19T22:23:57.802239] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-19T22:23:57.807840] [INFO ] [MAIN ] Derivative Progress: 1318/2093 symbols completed. NNN took 1.2s. Estimated remaining: 5m 1s. Rate: 154.6 symbols/min [2025-09-19T22:23:57.820998] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:57.827932] [INFO ] [MAIN ] NOA: Generated 1820 derivative records from 16673 primary records. [2025-09-19T22:23:57.827996] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-19T22:23:57.854626] [DEBUG] [LOCAL ] NOA: Derivative data saved (1820 records). [2025-09-19T22:23:57.854742] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-19T22:23:57.854123] [DEBUG] [LOCAL ] NOAH: Loaded 20306 existing records from primary storage. [2025-09-19T22:23:57.857357] [INFO ] [MAIN ] Derivative Progress: 1319/2093 symbols completed. NOA took 0.9s. Estimated remaining: 5m 0s. Rate: 154.7 symbols/min [2025-09-19T22:23:57.857760] [INFO ] [MAIN ] NOAH: Loaded 20306 primary data records. [2025-09-19T22:23:58.177911] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:58.178715] [INFO ] [MAIN ] NOAH: Generated 1820 derivative records from 20306 primary records. [2025-09-19T22:23:58.178782] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-19T22:23:58.195042] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1820 records). [2025-09-19T22:23:58.195134] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-19T22:23:58.197286] [INFO ] [MAIN ] Derivative Progress: 1320/2093 symbols completed. NOAH took 0.4s. Estimated remaining: 4m 60s. Rate: 154.7 symbols/min [2025-09-19T22:23:58.198590] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:58.198453] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:58.198067] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:58.271297] [DEBUG] [LOCAL ] NOC: Loaded 43509 existing records from primary storage. [2025-09-19T22:23:58.299126] [INFO ] [MAIN ] NOC: Loaded 43509 primary data records. [2025-09-19T22:23:58.327797] [DEBUG] [LOCAL ] NOG: Loaded 51936 existing records from primary storage. [2025-09-19T22:23:58.344266] [INFO ] [MAIN ] NOG: Loaded 51936 primary data records. [2025-09-19T22:23:58.359618] [DEBUG] [LOCAL ] NOK: Loaded 54401 existing records from primary storage. [2025-09-19T22:23:58.371427] [INFO ] [MAIN ] NOK: Loaded 54401 primary data records. [2025-09-19T22:23:59.330955] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:59.332074] [INFO ] [MAIN ] NOG: Generated 1820 derivative records from 51936 primary records. [2025-09-19T22:23:59.332309] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-19T22:23:59.360112] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:59.363473] [DEBUG] [LOCAL ] NOG: Derivative data saved (1820 records). [2025-09-19T22:23:59.376158] [INFO ] [MAIN ] NOC: Generated 1820 derivative records from 43509 primary records. [2025-09-19T22:23:59.376233] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-19T22:23:59.376783] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:23:59.378553] [INFO ] [MAIN ] Derivative Progress: 1321/2093 symbols completed. NOG took 1.2s. Estimated remaining: 4m 60s. Rate: 154.5 symbols/min [2025-09-19T22:23:59.379315] [INFO ] [MAIN ] NOK: Generated 1820 derivative records from 54401 primary records. [2025-09-19T22:23:59.376464] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-19T22:23:59.379570] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:59.380567] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-19T22:23:59.411979] [DEBUG] [LOCAL ] NOK: Derivative data saved (1820 records). [2025-09-19T22:23:59.412609] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-19T22:23:59.416194] [INFO ] [MAIN ] Derivative Progress: 1322/2093 symbols completed. NOK took 1.2s. Estimated remaining: 4m 59s. Rate: 154.6 symbols/min [2025-09-19T22:23:59.416501] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:59.416745] [DEBUG] [LOCAL ] NOC: Derivative data saved (1820 records). [2025-09-19T22:23:59.417219] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-19T22:23:59.419869] [INFO ] [MAIN ] Derivative Progress: 1323/2093 symbols completed. NOC took 1.2s. Estimated remaining: 4m 59s. Rate: 154.7 symbols/min [2025-09-19T22:23:59.420212] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:23:59.452367] [DEBUG] [LOCAL ] NOMD: Loaded 42179 existing records from primary storage. [2025-09-19T22:23:59.452616] [INFO ] [MAIN ] NOMD: Loaded 42179 primary data records. [2025-09-19T22:23:59.602356] [DEBUG] [LOCAL ] NOTE: Loaded 43867 existing records from primary storage. [2025-09-19T22:23:59.643730] [INFO ] [MAIN ] NOTE: Loaded 43867 primary data records. [2025-09-19T22:23:59.938013] [DEBUG] [LOCAL ] NOV: Loaded 53967 existing records from primary storage. [2025-09-19T22:23:59.945333] [INFO ] [MAIN ] NOV: Loaded 53967 primary data records. [2025-09-19T22:24:00.545474] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:00.547547] [INFO ] [MAIN ] NOMD: Generated 1820 derivative records from 42179 primary records. [2025-09-19T22:24:00.547999] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-19T22:24:00.578815] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:00.580915] [INFO ] [MAIN ] NOTE: Generated 1820 derivative records from 43867 primary records. [2025-09-19T22:24:00.581796] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-19T22:24:00.583946] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1820 records). [2025-09-19T22:24:00.590265] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-19T22:24:00.593808] [INFO ] [MAIN ] Derivative Progress: 1324/2093 symbols completed. NOMD took 1.2s. Estimated remaining: 4m 59s. Rate: 154.4 symbols/min [2025-09-19T22:24:00.596957] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:00.602175] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1820 records). [2025-09-19T22:24:00.602292] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-19T22:24:00.604866] [INFO ] [MAIN ] Derivative Progress: 1325/2093 symbols completed. NOTE took 1.2s. Estimated remaining: 4m 58s. Rate: 154.6 symbols/min [2025-09-19T22:24:00.605273] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:00.622177] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:00.627384] [INFO ] [MAIN ] NOV: Generated 1820 derivative records from 53967 primary records. [2025-09-19T22:24:00.629928] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-19T22:24:00.655452] [DEBUG] [LOCAL ] NPFD: Loaded 9943 existing records from primary storage. [2025-09-19T22:24:00.655713] [INFO ] [MAIN ] NPFD: Loaded 9943 primary data records. [2025-09-19T22:24:00.655146] [DEBUG] [LOCAL ] NPCT: Loaded 17187 existing records from primary storage. [2025-09-19T22:24:00.656379] [INFO ] [MAIN ] NPCT: Loaded 17187 primary data records. [2025-09-19T22:24:00.883865] [DEBUG] [LOCAL ] NOV: Derivative data saved (1820 records). [2025-09-19T22:24:00.889355] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-19T22:24:00.912795] [INFO ] [MAIN ] Derivative Progress: 1326/2093 symbols completed. NOV took 1.5s. Estimated remaining: 4m 58s. Rate: 154.6 symbols/min [2025-09-19T22:24:00.936387] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:01.327721] [DEBUG] [LOCAL ] NPK: Loaded 8278 existing records from primary storage. [2025-09-19T22:24:01.328449] [INFO ] [MAIN ] NPK: Loaded 8278 primary data records. [2025-09-19T22:24:01.679215] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:01.680822] [INFO ] [MAIN ] NPCT: Generated 1820 derivative records from 17187 primary records. [2025-09-19T22:24:01.681019] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-19T22:24:01.702591] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1820 records). [2025-09-19T22:24:01.703035] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-19T22:24:01.719285] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:01.718659] [INFO ] [MAIN ] Derivative Progress: 1327/2093 symbols completed. NPCT took 1.1s. Estimated remaining: 4m 58s. Rate: 154.5 symbols/min [2025-09-19T22:24:01.719574] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:01.720367] [INFO ] [MAIN ] NPFD: Generated 1820 derivative records from 9943 primary records. [2025-09-19T22:24:01.721453] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-19T22:24:01.745567] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1820 records). [2025-09-19T22:24:01.745800] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-19T22:24:01.748573] [INFO ] [MAIN ] Derivative Progress: 1328/2093 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 57s. Rate: 154.6 symbols/min [2025-09-19T22:24:01.763937] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:01.764194] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:01.765082] [INFO ] [MAIN ] NPK: Generated 1820 derivative records from 8278 primary records. [2025-09-19T22:24:01.770832] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-19T22:24:01.771619] [DEBUG] [LOCAL ] NPO: Loaded 13074 existing records from primary storage. [2025-09-19T22:24:01.772666] [INFO ] [MAIN ] NPO: Loaded 13074 primary data records. [2025-09-19T22:24:01.851426] [DEBUG] [LOCAL ] NPV: Loaded 5021 existing records from primary storage. [2025-09-19T22:24:01.878526] [INFO ] [MAIN ] NPV: Loaded 5021 primary data records. [2025-09-19T22:24:01.864519] [DEBUG] [LOCAL ] NPK: Derivative data saved (1820 records). [2025-09-19T22:24:01.913392] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-19T22:24:01.948779] [INFO ] [MAIN ] Derivative Progress: 1329/2093 symbols completed. NPK took 1.0s. Estimated remaining: 4m 56s. Rate: 154.6 symbols/min [2025-09-19T22:24:01.984770] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:02.506826] [DEBUG] [LOCAL ] NPWR: Loaded 43617 existing records from primary storage. [2025-09-19T22:24:02.507537] [INFO ] [MAIN ] NPWR: Loaded 43617 primary data records. [2025-09-19T22:24:02.703821] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:02.722768] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:02.723770] [INFO ] [MAIN ] NPO: Generated 1820 derivative records from 13074 primary records. [2025-09-19T22:24:02.842229] [INFO ] [MAIN ] NPV: Generated 1820 derivative records from 5021 primary records. [2025-09-19T22:24:02.842376] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-19T22:24:02.842513] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-19T22:24:02.873853] [DEBUG] [LOCAL ] NPO: Derivative data saved (1820 records). [2025-09-19T22:24:02.874675] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-19T22:24:02.876764] [INFO ] [MAIN ] Derivative Progress: 1330/2093 symbols completed. NPO took 1.2s. Estimated remaining: 4m 56s. Rate: 154.5 symbols/min [2025-09-19T22:24:02.877673] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:02.880285] [DEBUG] [LOCAL ] NPV: Derivative data saved (1820 records). [2025-09-19T22:24:02.880435] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-19T22:24:02.883370] [INFO ] [MAIN ] Derivative Progress: 1331/2093 symbols completed. NPV took 1.1s. Estimated remaining: 4m 56s. Rate: 154.6 symbols/min [2025-09-19T22:24:02.884407] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:02.896046] [DEBUG] [LOCAL ] NQP: Loaded 9289 existing records from primary storage. [2025-09-19T22:24:02.896324] [INFO ] [MAIN ] NQP: Loaded 9289 primary data records. [2025-09-19T22:24:03.032725] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:03.101587] [INFO ] [MAIN ] NPWR: Generated 1820 derivative records from 43617 primary records. [2025-09-19T22:24:03.105282] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-19T22:24:03.123824] [DEBUG] [LOCAL ] NRDY: Loaded 33746 existing records from primary storage. [2025-09-19T22:24:03.129456] [INFO ] [MAIN ] NRDY: Loaded 33746 primary data records. [2025-09-19T22:24:03.378180] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1820 records). [2025-09-19T22:24:03.378639] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-19T22:24:03.381835] [INFO ] [MAIN ] Derivative Progress: 1332/2093 symbols completed. NPWR took 1.4s. Estimated remaining: 4m 55s. Rate: 154.5 symbols/min [2025-09-19T22:24:03.382150] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:03.549073] [DEBUG] [LOCAL ] NREF: Loaded 7913 existing records from primary storage. [2025-09-19T22:24:03.585816] [INFO ] [MAIN ] NREF: Loaded 7913 primary data records. [2025-09-19T22:24:03.919265] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:03.920278] [INFO ] [MAIN ] NQP: Generated 1820 derivative records from 9289 primary records. [2025-09-19T22:24:03.920555] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-19T22:24:03.938546] [DEBUG] [LOCAL ] NQP: Derivative data saved (1820 records). [2025-09-19T22:24:03.938850] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-19T22:24:03.941249] [INFO ] [MAIN ] Derivative Progress: 1333/2093 symbols completed. NQP took 1.1s. Estimated remaining: 4m 55s. Rate: 154.5 symbols/min [2025-09-19T22:24:03.958068] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:03.958799] [INFO ] [MAIN ] NRDY: Generated 1820 derivative records from 33746 primary records. [2025-09-19T22:24:03.958959] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-19T22:24:03.975379] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1820 records). [2025-09-19T22:24:03.975563] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-19T22:24:03.978191] [INFO ] [MAIN ] Derivative Progress: 1334/2093 symbols completed. NRDY took 1.1s. Estimated remaining: 4m 55s. Rate: 154.6 symbols/min [2025-09-19T22:24:03.993110] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:03.993625] [INFO ] [MAIN ] NREF: Generated 1820 derivative records from 7913 primary records. [2025-09-19T22:24:03.993710] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-19T22:24:04.008858] [DEBUG] [LOCAL ] NREF: Derivative data saved (1820 records). [2025-09-19T22:24:04.008917] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-19T22:24:04.011637] [INFO ] [MAIN ] Derivative Progress: 1335/2093 symbols completed. NREF took 0.6s. Estimated remaining: 4m 54s. Rate: 154.7 symbols/min [2025-09-19T22:24:04.012201] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:04.012401] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:04.012616] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:04.019996] [DEBUG] [LOCAL ] NRP: Loaded 4219 existing records from primary storage. [2025-09-19T22:24:04.020129] [INFO ] [MAIN ] NRP: Loaded 4219 primary data records. [2025-09-19T22:24:04.223785] [DEBUG] [LOCAL ] NRK: Loaded 19774 existing records from primary storage. [2025-09-19T22:24:04.224131] [INFO ] [MAIN ] NRK: Loaded 19774 primary data records. [2025-09-19T22:24:04.399187] [DEBUG] [LOCAL ] NRGV: Loaded 43456 existing records from primary storage. [2025-09-19T22:24:04.429912] [INFO ] [MAIN ] NRGV: Loaded 43456 primary data records. [2025-09-19T22:24:05.021429] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:05.022631] [INFO ] [MAIN ] NRP: Generated 1820 derivative records from 4219 primary records. [2025-09-19T22:24:05.023634] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-19T22:24:05.040317] [DEBUG] [LOCAL ] NRP: Derivative data saved (1820 records). [2025-09-19T22:24:05.040609] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-19T22:24:05.043049] [INFO ] [MAIN ] Derivative Progress: 1336/2093 symbols completed. NRP took 1.0s. Estimated remaining: 4m 54s. Rate: 154.5 symbols/min [2025-09-19T22:24:05.043513] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:05.067746] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:05.067368] [DEBUG] [LOCAL ] NRT: Loaded 4976 existing records from primary storage. [2025-09-19T22:24:05.080376] [INFO ] [MAIN ] NRK: Generated 1820 derivative records from 19774 primary records. [2025-09-19T22:24:05.080790] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:05.079753] [INFO ] [MAIN ] NRT: Loaded 4976 primary data records. [2025-09-19T22:24:05.080898] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-19T22:24:05.081878] [INFO ] [MAIN ] NRGV: Generated 1820 derivative records from 43456 primary records. [2025-09-19T22:24:05.113103] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-19T22:24:05.211999] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1820 records). [2025-09-19T22:24:05.212616] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-19T22:24:05.242849] [DEBUG] [LOCAL ] NRK: Derivative data saved (1820 records). [2025-09-19T22:24:05.231106] [INFO ] [MAIN ] Derivative Progress: 1337/2093 symbols completed. NRGV took 1.2s. Estimated remaining: 4m 53s. Rate: 154.6 symbols/min [2025-09-19T22:24:05.257675] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-19T22:24:05.257881] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:05.260566] [INFO ] [MAIN ] Derivative Progress: 1338/2093 symbols completed. NRK took 1.2s. Estimated remaining: 4m 53s. Rate: 154.7 symbols/min [2025-09-19T22:24:05.300566] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:05.419235] [DEBUG] [LOCAL ] NRUC: Loaded 3191 existing records from primary storage. [2025-09-19T22:24:05.419407] [INFO ] [MAIN ] NRUC: Loaded 3191 primary data records. [2025-09-19T22:24:05.768585] [DEBUG] [LOCAL ] NSA: Loaded 45492 existing records from primary storage. [2025-09-19T22:24:05.781548] [INFO ] [MAIN ] NSA: Loaded 45492 primary data records. [2025-09-19T22:24:05.803154] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:05.839020] [INFO ] [MAIN ] NRT: Generated 1820 derivative records from 4976 primary records. [2025-09-19T22:24:05.859833] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-19T22:24:06.101717] [DEBUG] [LOCAL ] NRT: Derivative data saved (1820 records). [2025-09-19T22:24:06.102090] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-19T22:24:06.112171] [INFO ] [MAIN ] Derivative Progress: 1339/2093 symbols completed. NRT took 1.1s. Estimated remaining: 4m 53s. Rate: 154.5 symbols/min [2025-09-19T22:24:06.117746] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:06.118980] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:06.119992] [INFO ] [MAIN ] NRUC: Generated 1820 derivative records from 3191 primary records. [2025-09-19T22:24:06.121187] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-19T22:24:06.139248] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1820 records). [2025-09-19T22:24:06.139568] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-19T22:24:06.142534] [INFO ] [MAIN ] Derivative Progress: 1340/2093 symbols completed. NRUC took 0.9s. Estimated remaining: 4m 52s. Rate: 154.6 symbols/min [2025-09-19T22:24:06.143101] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:06.180277] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:06.181248] [INFO ] [MAIN ] NSA: Generated 1820 derivative records from 45492 primary records. [2025-09-19T22:24:06.181432] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-19T22:24:06.212224] [DEBUG] [LOCAL ] NTB: Loaded 21194 existing records from primary storage. [2025-09-19T22:24:06.212628] [INFO ] [MAIN ] NTB: Loaded 21194 primary data records. [2025-09-19T22:24:06.211613] [DEBUG] [LOCAL ] NSP: Loaded 35435 existing records from primary storage. [2025-09-19T22:24:06.218782] [INFO ] [MAIN ] NSP: Loaded 35435 primary data records. [2025-09-19T22:24:06.438538] [DEBUG] [LOCAL ] NSA: Derivative data saved (1820 records). [2025-09-19T22:24:06.459446] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-19T22:24:06.477918] [INFO ] [MAIN ] Derivative Progress: 1341/2093 symbols completed. NSA took 1.2s. Estimated remaining: 4m 52s. Rate: 154.7 symbols/min [2025-09-19T22:24:06.505506] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:06.921572] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:06.923577] [INFO ] [MAIN ] NSP: Generated 1820 derivative records from 35435 primary records. [2025-09-19T22:24:06.923892] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-19T22:24:06.947463] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:06.948527] [INFO ] [MAIN ] NTB: Generated 1820 derivative records from 21194 primary records. [2025-09-19T22:24:06.963448] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-19T22:24:06.969887] [DEBUG] [LOCAL ] NTR: Loaded 53385 existing records from primary storage. [2025-09-19T22:24:06.970686] [INFO ] [MAIN ] NTR: Loaded 53385 primary data records. [2025-09-19T22:24:06.972439] [DEBUG] [LOCAL ] NSP: Derivative data saved (1820 records). [2025-09-19T22:24:06.972941] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-19T22:24:06.996554] [INFO ] [MAIN ] Derivative Progress: 1342/2093 symbols completed. NSP took 0.9s. Estimated remaining: 4m 51s. Rate: 154.6 symbols/min [2025-09-19T22:24:07.043762] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:07.124006] [DEBUG] [LOCAL ] NTB: Derivative data saved (1820 records). [2025-09-19T22:24:07.137322] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-19T22:24:07.148298] [INFO ] [MAIN ] Derivative Progress: 1343/2093 symbols completed. NTB took 1.0s. Estimated remaining: 4m 51s. Rate: 154.7 symbols/min [2025-09-19T22:24:07.296077] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:07.336270] [DEBUG] [LOCAL ] NTST: Loaded 44080 existing records from primary storage. [2025-09-19T22:24:07.336529] [INFO ] [MAIN ] NTST: Loaded 44080 primary data records. [2025-09-19T22:24:07.349418] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:07.370611] [INFO ] [MAIN ] NTR: Generated 1820 derivative records from 53385 primary records. [2025-09-19T22:24:07.393149] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-19T22:24:07.539446] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-09-19T22:24:07.549021] [DEBUG] [LOCAL ] NTR: Derivative data saved (1820 records). [2025-09-19T22:24:07.549129] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-19T22:24:07.581295] [INFO ] [MAIN ] Derivative Progress: 1344/2093 symbols completed. NTR took 1.1s. Estimated remaining: 4m 51s. Rate: 154.7 symbols/min [2025-09-19T22:24:07.688691] [INFO ] [MAIN ] NU: Loaded 54526 primary data records. [2025-09-19T22:24:07.697175] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:08.046308] [DEBUG] [LOCAL ] NUS: Loaded 36901 existing records from primary storage. [2025-09-19T22:24:08.046912] [INFO ] [MAIN ] NUS: Loaded 36901 primary data records. [2025-09-19T22:24:08.252962] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:08.253952] [INFO ] [MAIN ] NTST: Generated 1820 derivative records from 44080 primary records. [2025-09-19T22:24:08.435821] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-19T22:24:08.458444] [DEBUG] [LOCAL ] NTST: Derivative data saved (1820 records). [2025-09-19T22:24:08.460072] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-19T22:24:08.463353] [INFO ] [MAIN ] Derivative Progress: 1345/2093 symbols completed. NTST took 1.4s. Estimated remaining: 4m 50s. Rate: 154.5 symbols/min [2025-09-19T22:24:08.464994] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:08.479273] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:08.480605] [INFO ] [MAIN ] NU: Generated 1820 derivative records from 54526 primary records. [2025-09-19T22:24:08.481118] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-19T22:24:08.500207] [DEBUG] [LOCAL ] NU: Derivative data saved (1820 records). [2025-09-19T22:24:08.500462] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-19T22:24:08.502968] [INFO ] [MAIN ] Derivative Progress: 1346/2093 symbols completed. NU took 1.2s. Estimated remaining: 4m 50s. Rate: 154.6 symbols/min [2025-09-19T22:24:08.504252] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:08.525807] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:08.526575] [INFO ] [MAIN ] NUS: Generated 1820 derivative records from 36901 primary records. [2025-09-19T22:24:08.526750] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-19T22:24:08.544544] [DEBUG] [LOCAL ] NUS: Derivative data saved (1820 records). [2025-09-19T22:24:08.550875] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-19T22:24:08.554724] [INFO ] [MAIN ] Derivative Progress: 1347/2093 symbols completed. NUS took 0.9s. Estimated remaining: 4m 49s. Rate: 154.7 symbols/min [2025-09-19T22:24:08.555281] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:08.556864] [DEBUG] [LOCAL ] NUV: Loaded 23361 existing records from primary storage. [2025-09-19T22:24:08.557073] [INFO ] [MAIN ] NUV: Loaded 23361 primary data records. [2025-09-19T22:24:08.693190] [DEBUG] [LOCAL ] NUW: Loaded 7591 existing records from primary storage. [2025-09-19T22:24:08.705002] [INFO ] [MAIN ] NUW: Loaded 7591 primary data records. [2025-09-19T22:24:08.842043] [DEBUG] [LOCAL ] NUVB: Loaded 51955 existing records from primary storage. [2025-09-19T22:24:08.993476] [INFO ] [MAIN ] NUVB: Loaded 51955 primary data records. [2025-09-19T22:24:09.585339] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:09.587375] [INFO ] [MAIN ] NUV: Generated 1820 derivative records from 23361 primary records. [2025-09-19T22:24:09.587521] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-19T22:24:09.621763] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:09.623709] [INFO ] [MAIN ] NUW: Generated 1820 derivative records from 7591 primary records. [2025-09-19T22:24:09.624376] [DEBUG] [LOCAL ] NUV: Derivative data saved (1820 records). [2025-09-19T22:24:09.624672] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-19T22:24:09.624501] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-19T22:24:09.627607] [INFO ] [MAIN ] Derivative Progress: 1348/2093 symbols completed. NUV took 1.2s. Estimated remaining: 4m 49s. Rate: 154.5 symbols/min [2025-09-19T22:24:09.656848] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:09.657774] [INFO ] [MAIN ] NUVB: Generated 1820 derivative records from 51955 primary records. [2025-09-19T22:24:09.658070] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-19T22:24:09.667214] [DEBUG] [LOCAL ] NUW: Derivative data saved (1820 records). [2025-09-19T22:24:09.670689] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-19T22:24:09.673095] [INFO ] [MAIN ] Derivative Progress: 1349/2093 symbols completed. NUW took 1.1s. Estimated remaining: 4m 49s. Rate: 154.6 symbols/min [2025-09-19T22:24:09.677406] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1820 records). [2025-09-19T22:24:09.677469] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-19T22:24:09.679876] [INFO ] [MAIN ] Derivative Progress: 1350/2093 symbols completed. NUVB took 1.2s. Estimated remaining: 4m 48s. Rate: 154.7 symbols/min [2025-09-19T22:24:09.680504] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:09.680713] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:09.680793] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:09.740455] [DEBUG] [LOCAL ] NVG: Loaded 27624 existing records from primary storage. [2025-09-19T22:24:09.741524] [INFO ] [MAIN ] NVG: Loaded 27624 primary data records. [2025-09-19T22:24:09.747313] [DEBUG] [LOCAL ] NVGS: Loaded 31645 existing records from primary storage. [2025-09-19T22:24:09.763959] [INFO ] [MAIN ] NVGS: Loaded 31645 primary data records. [2025-09-19T22:24:10.044072] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-09-19T22:24:10.083998] [INFO ] [MAIN ] NVO: Loaded 54564 primary data records. [2025-09-19T22:24:10.814071] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:10.813627] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:10.815400] [INFO ] [MAIN ] NVGS: Generated 1820 derivative records from 31645 primary records. [2025-09-19T22:24:10.816702] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-19T22:24:10.816570] [INFO ] [MAIN ] NVG: Generated 1820 derivative records from 27624 primary records. [2025-09-19T22:24:10.819454] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-19T22:24:10.861690] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:10.867447] [INFO ] [MAIN ] NVO: Generated 1820 derivative records from 54564 primary records. [2025-09-19T22:24:10.868394] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-19T22:24:10.876695] [DEBUG] [LOCAL ] NVG: Derivative data saved (1820 records). [2025-09-19T22:24:10.886182] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-19T22:24:10.895925] [INFO ] [MAIN ] Derivative Progress: 1351/2093 symbols completed. NVG took 1.2s. Estimated remaining: 4m 48s. Rate: 154.5 symbols/min [2025-09-19T22:24:10.898275] [DEBUG] [LOCAL ] NVO: Derivative data saved (1820 records). [2025-09-19T22:24:10.898537] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:10.900064] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-19T22:24:10.899765] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1820 records). [2025-09-19T22:24:10.903005] [INFO ] [MAIN ] Derivative Progress: 1352/2093 symbols completed. NVO took 1.2s. Estimated remaining: 4m 48s. Rate: 154.6 symbols/min [2025-09-19T22:24:10.903328] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-19T22:24:10.903235] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:10.906927] [INFO ] [MAIN ] Derivative Progress: 1353/2093 symbols completed. NVGS took 1.2s. Estimated remaining: 4m 47s. Rate: 154.7 symbols/min [2025-09-19T22:24:10.907843] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:10.928426] [DEBUG] [LOCAL ] NVR: Loaded 19838 existing records from primary storage. [2025-09-19T22:24:10.928563] [INFO ] [MAIN ] NVR: Loaded 19838 primary data records. [2025-09-19T22:24:11.117124] [DEBUG] [LOCAL ] NVRI: Loaded 39584 existing records from primary storage. [2025-09-19T22:24:11.128956] [INFO ] [MAIN ] NVRI: Loaded 39584 primary data records. [2025-09-19T22:24:11.422900] [DEBUG] [LOCAL ] NVS: Loaded 52474 existing records from primary storage. [2025-09-19T22:24:11.423756] [INFO ] [MAIN ] NVS: Loaded 52474 primary data records. [2025-09-19T22:24:11.953716] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:11.954978] [INFO ] [MAIN ] NVR: Generated 1820 derivative records from 19838 primary records. [2025-09-19T22:24:11.955242] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-19T22:24:11.988980] [DEBUG] [LOCAL ] NVR: Derivative data saved (1820 records). [2025-09-19T22:24:11.989910] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-19T22:24:11.989836] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:11.990780] [INFO ] [MAIN ] NVRI: Generated 1820 derivative records from 39584 primary records. [2025-09-19T22:24:11.990873] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-19T22:24:11.993777] [INFO ] [MAIN ] Derivative Progress: 1354/2093 symbols completed. NVR took 1.1s. Estimated remaining: 4m 47s. Rate: 154.5 symbols/min [2025-09-19T22:24:11.994513] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:12.013554] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1820 records). [2025-09-19T22:24:12.013787] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-19T22:24:12.016289] [INFO ] [MAIN ] Derivative Progress: 1355/2093 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 46s. Rate: 154.6 symbols/min [2025-09-19T22:24:12.016632] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:12.029909] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:12.030596] [INFO ] [MAIN ] NVS: Generated 1820 derivative records from 52474 primary records. [2025-09-19T22:24:12.030711] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-19T22:24:12.048105] [DEBUG] [LOCAL ] NVS: Derivative data saved (1820 records). [2025-09-19T22:24:12.048296] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-19T22:24:12.050997] [INFO ] [MAIN ] Derivative Progress: 1356/2093 symbols completed. NVS took 1.1s. Estimated remaining: 4m 46s. Rate: 154.7 symbols/min [2025-09-19T22:24:12.051327] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:12.103074] [DEBUG] [LOCAL ] NVST: Loaded 52463 existing records from primary storage. [2025-09-19T22:24:12.103322] [INFO ] [MAIN ] NVST: Loaded 52463 primary data records. [2025-09-19T22:24:12.218760] [DEBUG] [LOCAL ] NVT: Loaded 52384 existing records from primary storage. [2025-09-19T22:24:12.247393] [INFO ] [MAIN ] NVT: Loaded 52384 primary data records. [2025-09-19T22:24:12.559811] [DEBUG] [LOCAL ] NWG: Loaded 52434 existing records from primary storage. [2025-09-19T22:24:12.564407] [INFO ] [MAIN ] NWG: Loaded 52434 primary data records. [2025-09-19T22:24:13.132746] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:13.134721] [INFO ] [MAIN ] NVST: Generated 1820 derivative records from 52463 primary records. [2025-09-19T22:24:13.134916] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-19T22:24:13.156796] [DEBUG] [LOCAL ] NVST: Derivative data saved (1820 records). [2025-09-19T22:24:13.157015] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-19T22:24:13.167598] [INFO ] [MAIN ] Derivative Progress: 1357/2093 symbols completed. NVST took 1.2s. Estimated remaining: 4m 46s. Rate: 154.5 symbols/min [2025-09-19T22:24:13.173455] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:13.173193] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:13.176559] [INFO ] [MAIN ] NVT: Generated 1820 derivative records from 52384 primary records. [2025-09-19T22:24:13.176834] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-19T22:24:13.207936] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:13.207578] [DEBUG] [LOCAL ] NVT: Derivative data saved (1820 records). [2025-09-19T22:24:13.208202] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-19T22:24:13.211500] [INFO ] [MAIN ] NWG: Generated 1820 derivative records from 52434 primary records. [2025-09-19T22:24:13.210679] [INFO ] [MAIN ] Derivative Progress: 1358/2093 symbols completed. NVT took 1.2s. Estimated remaining: 4m 45s. Rate: 154.6 symbols/min [2025-09-19T22:24:13.212073] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:13.211713] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-19T22:24:13.231032] [DEBUG] [LOCAL ] NXC: Loaded 4230 existing records from primary storage. [2025-09-19T22:24:13.231672] [INFO ] [MAIN ] NXC: Loaded 4230 primary data records. [2025-09-19T22:24:13.356094] [DEBUG] [LOCAL ] NWG: Derivative data saved (1820 records). [2025-09-19T22:24:13.366874] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-19T22:24:13.369617] [INFO ] [MAIN ] Derivative Progress: 1359/2093 symbols completed. NWG took 1.3s. Estimated remaining: 4m 45s. Rate: 154.7 symbols/min [2025-09-19T22:24:13.371383] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:13.370762] [DEBUG] [LOCAL ] NX: Loaded 33956 existing records from primary storage. [2025-09-19T22:24:13.371630] [INFO ] [MAIN ] NX: Loaded 33956 primary data records. [2025-09-19T22:24:13.702025] [DEBUG] [LOCAL ] NXDT: Loaded 16764 existing records from primary storage. [2025-09-19T22:24:13.732757] [INFO ] [MAIN ] NXDT: Loaded 16764 primary data records. [2025-09-19T22:24:14.280946] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:14.298108] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:14.297627] [INFO ] [MAIN ] NXC: Generated 1820 derivative records from 4230 primary records. [2025-09-19T22:24:14.299314] [INFO ] [MAIN ] NX: Generated 1820 derivative records from 33956 primary records. [2025-09-19T22:24:14.299500] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-19T22:24:14.300701] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-19T22:24:14.327749] [DEBUG] [LOCAL ] NX: Derivative data saved (1820 records). [2025-09-19T22:24:14.327933] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-19T22:24:14.340106] [INFO ] [MAIN ] Derivative Progress: 1360/2093 symbols completed. NX took 1.2s. Estimated remaining: 4m 45s. Rate: 154.5 symbols/min [2025-09-19T22:24:14.341569] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:14.342747] [DEBUG] [LOCAL ] NXC: Derivative data saved (1820 records). [2025-09-19T22:24:14.343388] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-19T22:24:14.346577] [INFO ] [MAIN ] Derivative Progress: 1361/2093 symbols completed. NXC took 1.1s. Estimated remaining: 4m 44s. Rate: 154.6 symbols/min [2025-09-19T22:24:14.347112] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:14.368043] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:14.372002] [INFO ] [MAIN ] NXDT: Generated 1820 derivative records from 16764 primary records. [2025-09-19T22:24:14.372202] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-19T22:24:14.392525] [DEBUG] [LOCAL ] NXG: Loaded 10734 existing records from primary storage. [2025-09-19T22:24:14.393183] [INFO ] [MAIN ] NXG: Loaded 10734 primary data records. [2025-09-19T22:24:14.533210] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1820 records). [2025-09-19T22:24:14.533456] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-19T22:24:14.547292] [INFO ] [MAIN ] Derivative Progress: 1362/2093 symbols completed. NXDT took 1.2s. Estimated remaining: 4m 44s. Rate: 154.7 symbols/min [2025-09-19T22:24:14.582083] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:14.813857] [DEBUG] [LOCAL ] NXE: Loaded 53760 existing records from primary storage. [2025-09-19T22:24:14.814180] [INFO ] [MAIN ] NXE: Loaded 53760 primary data records. [2025-09-19T22:24:14.937534] [DEBUG] [LOCAL ] NXJ: Loaded 15097 existing records from primary storage. [2025-09-19T22:24:14.938232] [INFO ] [MAIN ] NXJ: Loaded 15097 primary data records. [2025-09-19T22:24:15.464886] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:15.465681] [INFO ] [MAIN ] NXG: Generated 1820 derivative records from 10734 primary records. [2025-09-19T22:24:15.465946] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-19T22:24:15.485435] [DEBUG] [LOCAL ] NXG: Derivative data saved (1820 records). [2025-09-19T22:24:15.485703] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-19T22:24:15.487990] [INFO ] [MAIN ] Derivative Progress: 1363/2093 symbols completed. NXG took 1.1s. Estimated remaining: 4m 43s. Rate: 154.5 symbols/min [2025-09-19T22:24:15.504823] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:15.505589] [INFO ] [MAIN ] NXE: Generated 1820 derivative records from 53760 primary records. [2025-09-19T22:24:15.505774] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-19T22:24:15.521908] [DEBUG] [LOCAL ] NXE: Derivative data saved (1820 records). [2025-09-19T22:24:15.521977] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-19T22:24:15.524185] [INFO ] [MAIN ] Derivative Progress: 1364/2093 symbols completed. NXE took 1.2s. Estimated remaining: 4m 43s. Rate: 154.6 symbols/min [2025-09-19T22:24:15.539238] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:15.539817] [INFO ] [MAIN ] NXJ: Generated 1820 derivative records from 15097 primary records. [2025-09-19T22:24:15.539880] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-19T22:24:15.555445] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1820 records). [2025-09-19T22:24:15.555509] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-19T22:24:15.558186] [INFO ] [MAIN ] Derivative Progress: 1365/2093 symbols completed. NXJ took 1.0s. Estimated remaining: 4m 42s. Rate: 154.7 symbols/min [2025-09-19T22:24:15.558833] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:15.558922] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:15.558776] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:15.564863] [DEBUG] [LOCAL ] NXN: Loaded 2363 existing records from primary storage. [2025-09-19T22:24:15.565177] [INFO ] [MAIN ] NXN: Loaded 2363 primary data records. [2025-09-19T22:24:15.689859] [DEBUG] [LOCAL ] NXP: Loaded 12392 existing records from primary storage. [2025-09-19T22:24:15.690700] [INFO ] [MAIN ] NXP: Loaded 12392 primary data records. [2025-09-19T22:24:15.690193] [DEBUG] [LOCAL ] NXRT: Loaded 19184 existing records from primary storage. [2025-09-19T22:24:15.748455] [INFO ] [MAIN ] NXRT: Loaded 19184 primary data records. [2025-09-19T22:24:16.597760] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:16.598521] [INFO ] [MAIN ] NXN: Generated 1820 derivative records from 2363 primary records. [2025-09-19T22:24:16.598910] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-19T22:24:16.629614] [DEBUG] [LOCAL ] NXN: Derivative data saved (1820 records). [2025-09-19T22:24:16.629787] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-19T22:24:16.628259] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:16.630516] [INFO ] [MAIN ] NXP: Generated 1820 derivative records from 12392 primary records. [2025-09-19T22:24:16.633409] [INFO ] [MAIN ] Derivative Progress: 1366/2093 symbols completed. NXN took 1.1s. Estimated remaining: 4m 42s. Rate: 154.5 symbols/min [2025-09-19T22:24:16.634552] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:16.634311] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-19T22:24:16.663266] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:16.664357] [DEBUG] [LOCAL ] NXP: Derivative data saved (1820 records). [2025-09-19T22:24:16.665128] [INFO ] [MAIN ] NXRT: Generated 1820 derivative records from 19184 primary records. [2025-09-19T22:24:16.665308] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-19T22:24:16.667937] [INFO ] [MAIN ] Derivative Progress: 1367/2093 symbols completed. NXP took 1.1s. Estimated remaining: 4m 42s. Rate: 154.6 symbols/min [2025-09-19T22:24:16.665380] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-19T22:24:16.668287] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:16.688838] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1820 records). [2025-09-19T22:24:16.689113] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-19T22:24:16.692149] [INFO ] [MAIN ] Derivative Progress: 1368/2093 symbols completed. NXRT took 1.1s. Estimated remaining: 4m 41s. Rate: 154.7 symbols/min [2025-09-19T22:24:16.692608] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:16.729276] [DEBUG] [LOCAL ] NZF: Loaded 29676 existing records from primary storage. [2025-09-19T22:24:16.729456] [INFO ] [MAIN ] NZF: Loaded 29676 primary data records. [2025-09-19T22:24:16.894942] [DEBUG] [LOCAL ] NYT: Loaded 50763 existing records from primary storage. [2025-09-19T22:24:16.927623] [INFO ] [MAIN ] NYT: Loaded 50763 primary data records. [2025-09-19T22:24:17.207320] [DEBUG] [LOCAL ] OBDC: Loaded 52406 existing records from primary storage. [2025-09-19T22:24:17.208047] [INFO ] [MAIN ] OBDC: Loaded 52406 primary data records. [2025-09-19T22:24:17.757439] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:17.759294] [INFO ] [MAIN ] NZF: Generated 1820 derivative records from 29676 primary records. [2025-09-19T22:24:17.759414] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-19T22:24:17.779077] [DEBUG] [LOCAL ] NZF: Derivative data saved (1820 records). [2025-09-19T22:24:17.779303] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-19T22:24:17.784452] [INFO ] [MAIN ] Derivative Progress: 1369/2093 symbols completed. NZF took 1.1s. Estimated remaining: 4m 41s. Rate: 154.5 symbols/min [2025-09-19T22:24:17.785232] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:17.804127] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:17.805748] [INFO ] [MAIN ] NYT: Generated 1820 derivative records from 50763 primary records. [2025-09-19T22:24:17.805904] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-19T22:24:17.834870] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:17.837288] [INFO ] [MAIN ] OBDC: Generated 1820 derivative records from 52406 primary records. [2025-09-19T22:24:17.839860] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-19T22:24:17.839966] [DEBUG] [LOCAL ] NYT: Derivative data saved (1820 records). [2025-09-19T22:24:17.840110] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-19T22:24:17.842614] [INFO ] [MAIN ] Derivative Progress: 1370/2093 symbols completed. NYT took 1.2s. Estimated remaining: 4m 41s. Rate: 154.6 symbols/min [2025-09-19T22:24:17.858188] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:17.864134] [DEBUG] [LOCAL ] OBK: Loaded 16504 existing records from primary storage. [2025-09-19T22:24:17.866972] [INFO ] [MAIN ] OBK: Loaded 16504 primary data records. [2025-09-19T22:24:17.866563] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1820 records). [2025-09-19T22:24:17.867150] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-19T22:24:17.869778] [INFO ] [MAIN ] Derivative Progress: 1371/2093 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 40s. Rate: 154.7 symbols/min [2025-09-19T22:24:17.887782] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:18.003062] [DEBUG] [LOCAL ] OCFT: Loaded 9497 existing records from primary storage. [2025-09-19T22:24:18.018833] [INFO ] [MAIN ] OCFT: Loaded 9497 primary data records. [2025-09-19T22:24:18.368025] [DEBUG] [LOCAL ] OC: Loaded 45549 existing records from primary storage. [2025-09-19T22:24:18.401948] [INFO ] [MAIN ] OC: Loaded 45549 primary data records. [2025-09-19T22:24:18.932574] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:18.933592] [INFO ] [MAIN ] OBK: Generated 1820 derivative records from 16504 primary records. [2025-09-19T22:24:18.934000] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-19T22:24:18.953011] [DEBUG] [LOCAL ] OBK: Derivative data saved (1820 records). [2025-09-19T22:24:18.953561] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-19T22:24:18.956063] [INFO ] [MAIN ] Derivative Progress: 1372/2093 symbols completed. OBK took 1.2s. Estimated remaining: 4m 40s. Rate: 154.5 symbols/min [2025-09-19T22:24:18.957525] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:18.973857] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:18.974993] [INFO ] [MAIN ] OCFT: Generated 1820 derivative records from 9497 primary records. [2025-09-19T22:24:18.975383] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-19T22:24:18.998257] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1820 records). [2025-09-19T22:24:18.998434] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-19T22:24:19.001385] [INFO ] [MAIN ] Derivative Progress: 1373/2093 symbols completed. OCFT took 1.1s. Estimated remaining: 4m 39s. Rate: 154.6 symbols/min [2025-09-19T22:24:18.998762] [DEBUG] [LOCAL ] ODC: Loaded 8633 existing records from primary storage. [2025-09-19T22:24:19.002724] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:19.004961] [INFO ] [MAIN ] ODC: Loaded 8633 primary data records. [2025-09-19T22:24:19.106880] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:19.132566] [INFO ] [MAIN ] OC: Generated 1820 derivative records from 45549 primary records. [2025-09-19T22:24:19.132804] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-19T22:24:19.210407] [DEBUG] [LOCAL ] ODV: Loaded 25338 existing records from primary storage. [2025-09-19T22:24:19.213282] [INFO ] [MAIN ] ODV: Loaded 25338 primary data records. [2025-09-19T22:24:19.222579] [DEBUG] [LOCAL ] OC: Derivative data saved (1820 records). [2025-09-19T22:24:19.249053] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-19T22:24:19.267818] [INFO ] [MAIN ] Derivative Progress: 1374/2093 symbols completed. OC took 1.4s. Estimated remaining: 4m 39s. Rate: 154.7 symbols/min [2025-09-19T22:24:19.283639] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:19.710592] [DEBUG] [LOCAL ] OEC: Loaded 37971 existing records from primary storage. [2025-09-19T22:24:19.711798] [INFO ] [MAIN ] OEC: Loaded 37971 primary data records. [2025-09-19T22:24:19.836624] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:19.837990] [INFO ] [MAIN ] ODC: Generated 1820 derivative records from 8633 primary records. [2025-09-19T22:24:19.838219] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-19T22:24:19.936465] [DEBUG] [LOCAL ] ODC: Derivative data saved (1820 records). [2025-09-19T22:24:19.942435] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-19T22:24:19.945664] [INFO ] [MAIN ] Derivative Progress: 1375/2093 symbols completed. ODC took 1.0s. Estimated remaining: 4m 39s. Rate: 154.6 symbols/min [2025-09-19T22:24:20.063243] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:20.091258] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:20.098154] [INFO ] [MAIN ] ODV: Generated 1820 derivative records from 25338 primary records. [2025-09-19T22:24:20.098856] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-19T22:24:20.125562] [DEBUG] [LOCAL ] ODV: Derivative data saved (1820 records). [2025-09-19T22:24:20.132853] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-19T22:24:20.137114] [INFO ] [MAIN ] Derivative Progress: 1376/2093 symbols completed. ODV took 1.1s. Estimated remaining: 4m 38s. Rate: 154.6 symbols/min [2025-09-19T22:24:20.133480] [DEBUG] [LOCAL ] OFG: Loaded 22682 existing records from primary storage. [2025-09-19T22:24:20.137514] [INFO ] [MAIN ] OFG: Loaded 22682 primary data records. [2025-09-19T22:24:20.137883] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:20.353900] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:20.474241] [INFO ] [MAIN ] OEC: Generated 1820 derivative records from 37971 primary records. [2025-09-19T22:24:20.488852] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-19T22:24:20.523479] [DEBUG] [LOCAL ] OEC: Derivative data saved (1820 records). [2025-09-19T22:24:20.524042] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-19T22:24:20.525147] [DEBUG] [LOCAL ] OGE: Loaded 47295 existing records from primary storage. [2025-09-19T22:24:20.525274] [INFO ] [MAIN ] OGE: Loaded 47295 primary data records. [2025-09-19T22:24:20.527928] [INFO ] [MAIN ] Derivative Progress: 1377/2093 symbols completed. OEC took 1.2s. Estimated remaining: 4m 38s. Rate: 154.6 symbols/min [2025-09-19T22:24:20.528368] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:20.909405] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:20.911782] [INFO ] [MAIN ] OFG: Generated 1820 derivative records from 22682 primary records. [2025-09-19T22:24:20.912584] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-19T22:24:20.941401] [DEBUG] [LOCAL ] OGN: Loaded 53908 existing records from primary storage. [2025-09-19T22:24:20.945091] [INFO ] [MAIN ] OGN: Loaded 53908 primary data records. [2025-09-19T22:24:20.946430] [DEBUG] [LOCAL ] OFG: Derivative data saved (1820 records). [2025-09-19T22:24:20.968543] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-19T22:24:20.972083] [INFO ] [MAIN ] Derivative Progress: 1378/2093 symbols completed. OFG took 0.9s. Estimated remaining: 4m 37s. Rate: 154.6 symbols/min [2025-09-19T22:24:21.282423] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:21.284001] [INFO ] [MAIN ] OGE: Generated 1820 derivative records from 47295 primary records. [2025-09-19T22:24:21.284106] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-19T22:24:21.302869] [DEBUG] [LOCAL ] OGE: Derivative data saved (1820 records). [2025-09-19T22:24:21.303559] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-19T22:24:21.306471] [INFO ] [MAIN ] Derivative Progress: 1379/2093 symbols completed. OGE took 1.2s. Estimated remaining: 4m 37s. Rate: 154.6 symbols/min [2025-09-19T22:24:21.326821] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:21.327438] [INFO ] [MAIN ] OGN: Generated 1820 derivative records from 53908 primary records. [2025-09-19T22:24:21.327501] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-19T22:24:21.343147] [DEBUG] [LOCAL ] OGN: Derivative data saved (1820 records). [2025-09-19T22:24:21.343207] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-19T22:24:21.345717] [INFO ] [MAIN ] Derivative Progress: 1380/2093 symbols completed. OGN took 0.8s. Estimated remaining: 4m 36s. Rate: 154.7 symbols/min [2025-09-19T22:24:21.346386] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:21.346548] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:21.346753] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:21.387278] [DEBUG] [LOCAL ] OGS: Loaded 34357 existing records from primary storage. [2025-09-19T22:24:21.387519] [INFO ] [MAIN ] OGS: Loaded 34357 primary data records. [2025-09-19T22:24:21.631415] [DEBUG] [LOCAL ] OI: Loaded 48123 existing records from primary storage. [2025-09-19T22:24:21.745048] [INFO ] [MAIN ] OI: Loaded 48123 primary data records. [2025-09-19T22:24:21.744958] [DEBUG] [LOCAL ] OHI: Loaded 52885 existing records from primary storage. [2025-09-19T22:24:21.745239] [INFO ] [MAIN ] OHI: Loaded 52885 primary data records. [2025-09-19T22:24:22.441918] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:22.443305] [INFO ] [MAIN ] OGS: Generated 1820 derivative records from 34357 primary records. [2025-09-19T22:24:22.444666] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-19T22:24:22.463258] [DEBUG] [LOCAL ] OGS: Derivative data saved (1820 records). [2025-09-19T22:24:22.463440] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-19T22:24:22.467918] [INFO ] [MAIN ] Derivative Progress: 1381/2093 symbols completed. OGS took 1.1s. Estimated remaining: 4m 36s. Rate: 154.5 symbols/min [2025-09-19T22:24:22.468396] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:22.486083] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:22.486995] [INFO ] [MAIN ] OHI: Generated 1820 derivative records from 52885 primary records. [2025-09-19T22:24:22.491181] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-19T22:24:22.511597] [DEBUG] [LOCAL ] OIA: Loaded 13944 existing records from primary storage. [2025-09-19T22:24:22.525872] [INFO ] [MAIN ] OIA: Loaded 13944 primary data records. [2025-09-19T22:24:22.525797] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:22.539597] [INFO ] [MAIN ] OI: Generated 1820 derivative records from 48123 primary records. [2025-09-19T22:24:22.551871] [DEBUG] [LOCAL ] OHI: Derivative data saved (1820 records). [2025-09-19T22:24:22.562501] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-19T22:24:22.577239] [INFO ] [MAIN ] Derivative Progress: 1382/2093 symbols completed. OHI took 1.2s. Estimated remaining: 4m 36s. Rate: 154.6 symbols/min [2025-09-19T22:24:22.551989] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-19T22:24:22.604589] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:22.679060] [DEBUG] [LOCAL ] OI: Derivative data saved (1820 records). [2025-09-19T22:24:22.698406] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-19T22:24:22.716961] [INFO ] [MAIN ] Derivative Progress: 1383/2093 symbols completed. OI took 1.4s. Estimated remaining: 4m 35s. Rate: 154.7 symbols/min [2025-09-19T22:24:22.893042] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:22.932748] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:22.933552] [INFO ] [MAIN ] OIA: Generated 1820 derivative records from 13944 primary records. [2025-09-19T22:24:22.933872] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-19T22:24:22.972059] [DEBUG] [LOCAL ] OIA: Derivative data saved (1820 records). [2025-09-19T22:24:22.972380] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-19T22:24:22.987362] [DEBUG] [LOCAL ] OII: Loaded 43796 existing records from primary storage. [2025-09-19T22:24:22.984970] [INFO ] [MAIN ] Derivative Progress: 1384/2093 symbols completed. OIA took 0.5s. Estimated remaining: 4m 35s. Rate: 154.7 symbols/min [2025-09-19T22:24:22.987632] [INFO ] [MAIN ] OII: Loaded 43796 primary data records. [2025-09-19T22:24:22.987990] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:23.000296] [DEBUG] [LOCAL ] OIS: Loaded 41515 existing records from primary storage. [2025-09-19T22:24:23.000523] [INFO ] [MAIN ] OIS: Loaded 41515 primary data records. [2025-09-19T22:24:23.815685] [DEBUG] [LOCAL ] OKE: Loaded 54316 existing records from primary storage. [2025-09-19T22:24:23.840477] [INFO ] [MAIN ] OKE: Loaded 54316 primary data records. [2025-09-19T22:24:24.373311] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:24.375275] [INFO ] [MAIN ] OIS: Generated 1820 derivative records from 41515 primary records. [2025-09-19T22:24:24.375611] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-19T22:24:24.407952] [DEBUG] [LOCAL ] OIS: Derivative data saved (1820 records). [2025-09-19T22:24:24.426417] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-19T22:24:24.427611] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:24.431941] [INFO ] [MAIN ] Derivative Progress: 1385/2093 symbols completed. OIS took 1.6s. Estimated remaining: 4m 35s. Rate: 154.4 symbols/min [2025-09-19T22:24:24.432445] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:24.428638] [INFO ] [MAIN ] OII: Generated 1820 derivative records from 43796 primary records. [2025-09-19T22:24:24.433250] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-19T22:24:24.461598] [DEBUG] [LOCAL ] OII: Derivative data saved (1820 records). [2025-09-19T22:24:24.461948] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-19T22:24:24.464818] [INFO ] [MAIN ] Derivative Progress: 1386/2093 symbols completed. OII took 1.9s. Estimated remaining: 4m 35s. Rate: 154.5 symbols/min [2025-09-19T22:24:24.465414] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:24.487769] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:24.488901] [INFO ] [MAIN ] OKE: Generated 1820 derivative records from 54316 primary records. [2025-09-19T22:24:24.489205] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-19T22:24:24.524395] [DEBUG] [LOCAL ] OLP: Loaded 9774 existing records from primary storage. [2025-09-19T22:24:24.525079] [INFO ] [MAIN ] OLP: Loaded 9774 primary data records. [2025-09-19T22:24:24.652528] [DEBUG] [LOCAL ] OKE: Derivative data saved (1820 records). [2025-09-19T22:24:24.656376] [DEBUG] [LOCAL ] OLN: Loaded 52484 existing records from primary storage. [2025-09-19T22:24:24.656490] [INFO ] [MAIN ] OLN: Loaded 52484 primary data records. [2025-09-19T22:24:24.662167] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-19T22:24:24.664871] [INFO ] [MAIN ] Derivative Progress: 1387/2093 symbols completed. OKE took 1.7s. Estimated remaining: 4m 34s. Rate: 154.6 symbols/min [2025-09-19T22:24:24.696510] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:25.265861] [DEBUG] [LOCAL ] OMC: Loaded 54071 existing records from primary storage. [2025-09-19T22:24:25.264462] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:25.266264] [INFO ] [MAIN ] OMC: Loaded 54071 primary data records. [2025-09-19T22:24:25.267224] [INFO ] [MAIN ] OLP: Generated 1820 derivative records from 9774 primary records. [2025-09-19T22:24:25.288494] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-19T22:24:25.372094] [DEBUG] [LOCAL ] OLP: Derivative data saved (1820 records). [2025-09-19T22:24:25.378956] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-19T22:24:25.392727] [INFO ] [MAIN ] Derivative Progress: 1388/2093 symbols completed. OLP took 0.9s. Estimated remaining: 4m 34s. Rate: 154.5 symbols/min [2025-09-19T22:24:25.409536] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:25.609770] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:25.610506] [INFO ] [MAIN ] OLN: Generated 1820 derivative records from 52484 primary records. [2025-09-19T22:24:25.610595] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-19T22:24:25.629329] [DEBUG] [LOCAL ] OLN: Derivative data saved (1820 records). [2025-09-19T22:24:25.629854] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-19T22:24:25.632172] [INFO ] [MAIN ] Derivative Progress: 1389/2093 symbols completed. OLN took 1.2s. Estimated remaining: 4m 33s. Rate: 154.5 symbols/min [2025-09-19T22:24:25.632813] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:25.680625] [DEBUG] [LOCAL ] OMF: Loaded 46967 existing records from primary storage. [2025-09-19T22:24:25.681520] [INFO ] [MAIN ] OMF: Loaded 46967 primary data records. [2025-09-19T22:24:25.681942] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:25.749348] [INFO ] [MAIN ] OMC: Generated 1820 derivative records from 54071 primary records. [2025-09-19T22:24:25.764623] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-19T22:24:25.852781] [DEBUG] [LOCAL ] OMI: Loaded 46620 existing records from primary storage. [2025-09-19T22:24:25.890699] [INFO ] [MAIN ] OMI: Loaded 46620 primary data records. [2025-09-19T22:24:25.891012] [DEBUG] [LOCAL ] OMC: Derivative data saved (1820 records). [2025-09-19T22:24:25.907884] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-19T22:24:26.114327] [INFO ] [MAIN ] Derivative Progress: 1390/2093 symbols completed. OMC took 1.4s. Estimated remaining: 4m 33s. Rate: 154.5 symbols/min [2025-09-19T22:24:26.128674] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:26.337144] [DEBUG] [LOCAL ] ONIT: Loaded 7906 existing records from primary storage. [2025-09-19T22:24:26.337457] [INFO ] [MAIN ] ONIT: Loaded 7906 primary data records. [2025-09-19T22:24:26.548363] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:26.673921] [INFO ] [MAIN ] OMF: Generated 1820 derivative records from 46967 primary records. [2025-09-19T22:24:26.679312] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-19T22:24:26.713746] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:26.713334] [DEBUG] [LOCAL ] OMF: Derivative data saved (1820 records). [2025-09-19T22:24:26.714994] [INFO ] [MAIN ] OMI: Generated 1820 derivative records from 46620 primary records. [2025-09-19T22:24:26.715586] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-19T22:24:26.715358] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-19T22:24:26.718251] [INFO ] [MAIN ] Derivative Progress: 1391/2093 symbols completed. OMF took 1.3s. Estimated remaining: 4m 33s. Rate: 154.4 symbols/min [2025-09-19T22:24:26.719269] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:26.737575] [DEBUG] [LOCAL ] OMI: Derivative data saved (1820 records). [2025-09-19T22:24:26.739132] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-19T22:24:26.742600] [INFO ] [MAIN ] Derivative Progress: 1392/2093 symbols completed. OMI took 1.1s. Estimated remaining: 4m 32s. Rate: 154.5 symbols/min [2025-09-19T22:24:26.744123] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:26.758478] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:24:26.760326] [INFO ] [MAIN ] ONIT: Generated 1819 derivative records from 7906 primary records. [2025-09-19T22:24:26.760445] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-19T22:24:26.785981] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1819 records). [2025-09-19T22:24:26.786239] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-19T22:24:26.788753] [INFO ] [MAIN ] Derivative Progress: 1393/2093 symbols completed. ONIT took 0.7s. Estimated remaining: 4m 32s. Rate: 154.6 symbols/min [2025-09-19T22:24:26.799225] [DEBUG] [LOCAL ] ONL: Loaded 32574 existing records from primary storage. [2025-09-19T22:24:26.799313] [INFO ] [MAIN ] ONL: Loaded 32574 primary data records. [2025-09-19T22:24:27.169942] [DEBUG] [LOCAL ] ONON: Loaded 54393 existing records from primary storage. [2025-09-19T22:24:27.170813] [INFO ] [MAIN ] ONON: Loaded 54393 primary data records. [2025-09-19T22:24:27.488578] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:27.489970] [INFO ] [MAIN ] ONL: Generated 1820 derivative records from 32574 primary records. [2025-09-19T22:24:27.490195] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-19T22:24:27.507378] [DEBUG] [LOCAL ] ONL: Derivative data saved (1820 records). [2025-09-19T22:24:27.507512] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-19T22:24:27.509880] [INFO ] [MAIN ] Derivative Progress: 1394/2093 symbols completed. ONL took 0.8s. Estimated remaining: 4m 31s. Rate: 154.5 symbols/min [2025-09-19T22:24:27.527421] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:27.528061] [INFO ] [MAIN ] ONON: Generated 1820 derivative records from 54393 primary records. [2025-09-19T22:24:27.528121] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-19T22:24:27.543682] [DEBUG] [LOCAL ] ONON: Derivative data saved (1820 records). [2025-09-19T22:24:27.543744] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-19T22:24:27.545938] [INFO ] [MAIN ] Derivative Progress: 1395/2093 symbols completed. ONON took 0.8s. Estimated remaining: 4m 31s. Rate: 154.6 symbols/min [2025-09-19T22:24:27.546718] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:27.546919] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:27.547333] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:27.581168] [DEBUG] [LOCAL ] ONTF: Loaded 23403 existing records from primary storage. [2025-09-19T22:24:27.581779] [DEBUG] [LOCAL ] OOMA: Loaded 19448 existing records from primary storage. [2025-09-19T22:24:27.581972] [INFO ] [MAIN ] ONTF: Loaded 23403 primary data records. [2025-09-19T22:24:27.582143] [INFO ] [MAIN ] OOMA: Loaded 19448 primary data records. [2025-09-19T22:24:27.879555] [DEBUG] [LOCAL ] ONTO: Loaded 47235 existing records from primary storage. [2025-09-19T22:24:27.920550] [INFO ] [MAIN ] ONTO: Loaded 47235 primary data records. [2025-09-19T22:24:28.568041] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:28.569130] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:28.570050] [INFO ] [MAIN ] ONTF: Generated 1820 derivative records from 23403 primary records. [2025-09-19T22:24:28.570949] [INFO ] [MAIN ] OOMA: Generated 1820 derivative records from 19448 primary records. [2025-09-19T22:24:28.571318] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-19T22:24:28.571410] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-19T22:24:28.600861] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1820 records). [2025-09-19T22:24:28.601808] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-19T22:24:28.608024] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1820 records). [2025-09-19T22:24:28.604221] [INFO ] [MAIN ] Derivative Progress: 1396/2093 symbols completed. ONTF took 1.1s. Estimated remaining: 4m 31s. Rate: 154.4 symbols/min [2025-09-19T22:24:28.608637] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-19T22:24:28.608556] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:28.612861] [INFO ] [MAIN ] Derivative Progress: 1397/2093 symbols completed. OOMA took 1.1s. Estimated remaining: 4m 30s. Rate: 154.5 symbols/min [2025-09-19T22:24:28.614096] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:28.630294] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:28.631043] [INFO ] [MAIN ] ONTO: Generated 1820 derivative records from 47235 primary records. [2025-09-19T22:24:28.631199] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-19T22:24:28.660222] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1820 records). [2025-09-19T22:24:28.660140] [DEBUG] [LOCAL ] OPAD: Loaded 19367 existing records from primary storage. [2025-09-19T22:24:28.660400] [INFO ] [MAIN ] OPAD: Loaded 19367 primary data records. [2025-09-19T22:24:28.660490] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-19T22:24:28.663013] [INFO ] [MAIN ] Derivative Progress: 1398/2093 symbols completed. ONTO took 1.1s. Estimated remaining: 4m 30s. Rate: 154.6 symbols/min [2025-09-19T22:24:28.674367] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:28.847197] [DEBUG] [LOCAL ] OPP: Loaded 11926 existing records from primary storage. [2025-09-19T22:24:28.838370] [DEBUG] [LOCAL ] OPFI: Loaded 47512 existing records from primary storage. [2025-09-19T22:24:28.854678] [INFO ] [MAIN ] OPP: Loaded 11926 primary data records. [2025-09-19T22:24:28.871342] [INFO ] [MAIN ] OPFI: Loaded 47512 primary data records. [2025-09-19T22:24:29.649900] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:29.651083] [INFO ] [MAIN ] OPAD: Generated 1820 derivative records from 19367 primary records. [2025-09-19T22:24:29.651245] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-19T22:24:29.669383] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1820 records). [2025-09-19T22:24:29.669551] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-19T22:24:29.683941] [INFO ] [MAIN ] Derivative Progress: 1399/2093 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 30s. Rate: 154.5 symbols/min [2025-09-19T22:24:29.684339] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:29.684711] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:29.686506] [INFO ] [MAIN ] OPP: Generated 1820 derivative records from 11926 primary records. [2025-09-19T22:24:29.686633] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-19T22:24:29.716613] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:29.717397] [INFO ] [MAIN ] OPFI: Generated 1820 derivative records from 47512 primary records. [2025-09-19T22:24:29.716351] [DEBUG] [LOCAL ] OPP: Derivative data saved (1820 records). [2025-09-19T22:24:29.717510] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-19T22:24:29.717553] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-19T22:24:29.720431] [INFO ] [MAIN ] Derivative Progress: 1400/2093 symbols completed. OPP took 1.1s. Estimated remaining: 4m 29s. Rate: 154.6 symbols/min [2025-09-19T22:24:29.720747] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:29.737019] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1820 records). [2025-09-19T22:24:29.737215] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-19T22:24:29.739639] [INFO ] [MAIN ] Derivative Progress: 1401/2093 symbols completed. OPFI took 1.1s. Estimated remaining: 4m 28s. Rate: 154.7 symbols/min [2025-09-19T22:24:29.740044] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:29.778123] [DEBUG] [LOCAL ] OR: Loaded 46633 existing records from primary storage. [2025-09-19T22:24:29.785367] [INFO ] [MAIN ] OR: Loaded 46633 primary data records. [2025-09-19T22:24:29.915557] [DEBUG] [LOCAL ] ORA: Loaded 33165 existing records from primary storage. [2025-09-19T22:24:29.971594] [INFO ] [MAIN ] ORA: Loaded 33165 primary data records. [2025-09-19T22:24:30.004954] [DEBUG] [LOCAL ] ORC: Loaded 53032 existing records from primary storage. [2025-09-19T22:24:30.112447] [INFO ] [MAIN ] ORC: Loaded 53032 primary data records. [2025-09-19T22:24:30.769923] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:30.771395] [INFO ] [MAIN ] OR: Generated 1820 derivative records from 46633 primary records. [2025-09-19T22:24:30.772242] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-19T22:24:30.790295] [DEBUG] [LOCAL ] OR: Derivative data saved (1820 records). [2025-09-19T22:24:30.790509] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-19T22:24:30.793019] [INFO ] [MAIN ] Derivative Progress: 1402/2093 symbols completed. OR took 1.1s. Estimated remaining: 4m 28s. Rate: 154.5 symbols/min [2025-09-19T22:24:30.793418] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:30.814257] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:30.815430] [INFO ] [MAIN ] ORA: Generated 1820 derivative records from 33165 primary records. [2025-09-19T22:24:30.815740] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-19T22:24:30.829800] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:30.838557] [INFO ] [MAIN ] ORC: Generated 1820 derivative records from 53032 primary records. [2025-09-19T22:24:30.850497] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-19T22:24:30.864885] [DEBUG] [LOCAL ] ORA: Derivative data saved (1820 records). [2025-09-19T22:24:30.876706] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-19T22:24:30.881256] [INFO ] [MAIN ] Derivative Progress: 1403/2093 symbols completed. ORA took 1.2s. Estimated remaining: 4m 28s. Rate: 154.6 symbols/min [2025-09-19T22:24:30.885230] [DEBUG] [LOCAL ] ORC: Derivative data saved (1820 records). [2025-09-19T22:24:30.885685] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:30.885822] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-19T22:24:30.888497] [INFO ] [MAIN ] Derivative Progress: 1404/2093 symbols completed. ORC took 1.1s. Estimated remaining: 4m 27s. Rate: 154.7 symbols/min [2025-09-19T22:24:30.889555] [DEBUG] [LOCAL ] ORN: Loaded 32390 existing records from primary storage. [2025-09-19T22:24:30.889704] [INFO ] [MAIN ] ORN: Loaded 32390 primary data records. [2025-09-19T22:24:30.890209] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:31.262205] [DEBUG] [LOCAL ] OSCR: Loaded 54475 existing records from primary storage. [2025-09-19T22:24:31.262546] [INFO ] [MAIN ] OSCR: Loaded 54475 primary data records. [2025-09-19T22:24:31.381957] [DEBUG] [LOCAL ] OTIS: Loaded 53491 existing records from primary storage. [2025-09-19T22:24:31.393071] [INFO ] [MAIN ] OTIS: Loaded 53491 primary data records. [2025-09-19T22:24:31.912209] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:31.922357] [INFO ] [MAIN ] ORN: Generated 1820 derivative records from 32390 primary records. [2025-09-19T22:24:31.922484] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-19T22:24:31.942359] [DEBUG] [LOCAL ] ORN: Derivative data saved (1820 records). [2025-09-19T22:24:31.943142] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-19T22:24:31.945896] [INFO ] [MAIN ] Derivative Progress: 1405/2093 symbols completed. ORN took 1.2s. Estimated remaining: 4m 27s. Rate: 154.5 symbols/min [2025-09-19T22:24:31.946861] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:31.972238] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:31.973430] [INFO ] [MAIN ] OSCR: Generated 1820 derivative records from 54475 primary records. [2025-09-19T22:24:31.974564] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-19T22:24:32.006503] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1820 records). [2025-09-19T22:24:32.017293] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:32.018235] [INFO ] [MAIN ] OTIS: Generated 1820 derivative records from 53491 primary records. [2025-09-19T22:24:32.018366] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-19T22:24:32.016807] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-19T22:24:32.020383] [INFO ] [MAIN ] Derivative Progress: 1406/2093 symbols completed. OSCR took 1.1s. Estimated remaining: 4m 27s. Rate: 154.6 symbols/min [2025-09-19T22:24:32.021611] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:32.039305] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1820 records). [2025-09-19T22:24:32.039444] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-19T22:24:32.042040] [INFO ] [MAIN ] Derivative Progress: 1407/2093 symbols completed. OTIS took 1.2s. Estimated remaining: 4m 26s. Rate: 154.7 symbols/min [2025-09-19T22:24:32.043202] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:32.058193] [DEBUG] [LOCAL ] OUT: Loaded 48911 existing records from primary storage. [2025-09-19T22:24:32.058492] [INFO ] [MAIN ] OUT: Loaded 48911 primary data records. [2025-09-19T22:24:32.173886] [DEBUG] [LOCAL ] OWLT: Loaded 8963 existing records from primary storage. [2025-09-19T22:24:32.177480] [INFO ] [MAIN ] OWLT: Loaded 8963 primary data records. [2025-09-19T22:24:32.703482] [DEBUG] [LOCAL ] OWL: Loaded 54336 existing records from primary storage. [2025-09-19T22:24:32.717638] [INFO ] [MAIN ] OWL: Loaded 54336 primary data records. [2025-09-19T22:24:33.113932] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:33.115390] [INFO ] [MAIN ] OUT: Generated 1820 derivative records from 48911 primary records. [2025-09-19T22:24:33.115789] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-19T22:24:33.134254] [DEBUG] [LOCAL ] OUT: Derivative data saved (1820 records). [2025-09-19T22:24:33.135820] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-19T22:24:33.138196] [INFO ] [MAIN ] Derivative Progress: 1408/2093 symbols completed. OUT took 1.2s. Estimated remaining: 4m 26s. Rate: 154.5 symbols/min [2025-09-19T22:24:33.151559] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:33.152356] [INFO ] [MAIN ] OWLT: Generated 1820 derivative records from 8963 primary records. [2025-09-19T22:24:33.152504] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-19T22:24:33.168028] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1820 records). [2025-09-19T22:24:33.168108] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-19T22:24:33.170213] [INFO ] [MAIN ] Derivative Progress: 1409/2093 symbols completed. OWLT took 1.1s. Estimated remaining: 4m 26s. Rate: 154.6 symbols/min [2025-09-19T22:24:33.188587] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:33.189293] [INFO ] [MAIN ] OWL: Generated 1820 derivative records from 54336 primary records. [2025-09-19T22:24:33.189355] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-19T22:24:33.204963] [DEBUG] [LOCAL ] OWL: Derivative data saved (1820 records). [2025-09-19T22:24:33.205036] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-19T22:24:33.207447] [INFO ] [MAIN ] Derivative Progress: 1410/2093 symbols completed. OWL took 1.2s. Estimated remaining: 4m 25s. Rate: 154.7 symbols/min [2025-09-19T22:24:33.208180] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:33.208015] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:33.208258] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:33.222954] [DEBUG] [LOCAL ] PAC: Loaded 11793 existing records from primary storage. [2025-09-19T22:24:33.223095] [INFO ] [MAIN ] PAC: Loaded 11793 primary data records. [2025-09-19T22:24:33.558999] [DEBUG] [LOCAL ] OXM: Loaded 34131 existing records from primary storage. [2025-09-19T22:24:33.559413] [INFO ] [MAIN ] OXM: Loaded 34131 primary data records. [2025-09-19T22:24:33.683052] [DEBUG] [LOCAL ] PAAS: Loaded 54383 existing records from primary storage. [2025-09-19T22:24:33.694377] [INFO ] [MAIN ] PAAS: Loaded 54383 primary data records. [2025-09-19T22:24:34.217966] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:34.219024] [INFO ] [MAIN ] PAC: Generated 1820 derivative records from 11793 primary records. [2025-09-19T22:24:34.219333] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-19T22:24:34.237987] [DEBUG] [LOCAL ] PAC: Derivative data saved (1820 records). [2025-09-19T22:24:34.238376] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-19T22:24:34.243337] [INFO ] [MAIN ] Derivative Progress: 1411/2093 symbols completed. PAC took 1.0s. Estimated remaining: 4m 25s. Rate: 154.5 symbols/min [2025-09-19T22:24:34.244318] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:34.260376] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:34.261189] [INFO ] [MAIN ] OXM: Generated 1820 derivative records from 34131 primary records. [2025-09-19T22:24:34.261427] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-19T22:24:34.278726] [DEBUG] [LOCAL ] OXM: Derivative data saved (1820 records). [2025-09-19T22:24:34.278869] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-19T22:24:34.280850] [INFO ] [MAIN ] Derivative Progress: 1412/2093 symbols completed. OXM took 1.1s. Estimated remaining: 4m 24s. Rate: 154.6 symbols/min [2025-09-19T22:24:34.281496] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:34.307041] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:34.308430] [INFO ] [MAIN ] PAAS: Generated 1820 derivative records from 54383 primary records. [2025-09-19T22:24:34.308602] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-19T22:24:34.319075] [DEBUG] [LOCAL ] PACK: Loaded 32597 existing records from primary storage. [2025-09-19T22:24:34.327390] [INFO ] [MAIN ] PACK: Loaded 32597 primary data records. [2025-09-19T22:24:34.355235] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1820 records). [2025-09-19T22:24:34.380820] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-19T22:24:34.389164] [INFO ] [MAIN ] Derivative Progress: 1413/2093 symbols completed. PAAS took 1.2s. Estimated remaining: 4m 24s. Rate: 154.7 symbols/min [2025-09-19T22:24:34.389516] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:34.482082] [DEBUG] [LOCAL ] PACS: Loaded 34403 existing records from primary storage. [2025-09-19T22:24:34.509422] [INFO ] [MAIN ] PACS: Loaded 34403 primary data records. [2025-09-19T22:24:35.049604] [DEBUG] [LOCAL ] PAGS: Loaded 53457 existing records from primary storage. [2025-09-19T22:24:35.050629] [INFO ] [MAIN ] PAGS: Loaded 53457 primary data records. [2025-09-19T22:24:35.395373] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:35.405034] [INFO ] [MAIN ] PACK: Generated 1820 derivative records from 32597 primary records. [2025-09-19T22:24:35.410301] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-19T22:24:35.411028] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:35.413767] [INFO ] [MAIN ] PACS: Generated 1820 derivative records from 34403 primary records. [2025-09-19T22:24:35.422168] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-19T22:24:35.439739] [DEBUG] [LOCAL ] PACK: Derivative data saved (1820 records). [2025-09-19T22:24:35.443307] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-19T22:24:35.447097] [INFO ] [MAIN ] Derivative Progress: 1414/2093 symbols completed. PACK took 1.2s. Estimated remaining: 4m 24s. Rate: 154.5 symbols/min [2025-09-19T22:24:35.450858] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:35.450341] [DEBUG] [LOCAL ] PACS: Derivative data saved (1820 records). [2025-09-19T22:24:35.451084] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-19T22:24:35.454092] [INFO ] [MAIN ] Derivative Progress: 1415/2093 symbols completed. PACS took 1.2s. Estimated remaining: 4m 23s. Rate: 154.6 symbols/min [2025-09-19T22:24:35.454873] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:35.460144] [DEBUG] [LOCAL ] PAI: Loaded 2767 existing records from primary storage. [2025-09-19T22:24:35.460463] [INFO ] [MAIN ] PAI: Loaded 2767 primary data records. [2025-09-19T22:24:35.609941] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:35.638376] [INFO ] [MAIN ] PAGS: Generated 1820 derivative records from 53457 primary records. [2025-09-19T22:24:35.638551] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-19T22:24:35.809630] [DEBUG] [LOCAL ] PAM: Loaded 28046 existing records from primary storage. [2025-09-19T22:24:35.814438] [INFO ] [MAIN ] PAM: Loaded 28046 primary data records. [2025-09-19T22:24:35.814224] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1820 records). [2025-09-19T22:24:35.814813] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-19T22:24:35.828757] [INFO ] [MAIN ] Derivative Progress: 1416/2093 symbols completed. PAGS took 1.4s. Estimated remaining: 4m 23s. Rate: 154.6 symbols/min [2025-09-19T22:24:35.829842] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:36.146029] [DEBUG] [LOCAL ] PAR: Loaded 33100 existing records from primary storage. [2025-09-19T22:24:36.147301] [INFO ] [MAIN ] PAR: Loaded 33100 primary data records. [2025-09-19T22:24:36.235845] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:36.261147] [INFO ] [MAIN ] PAI: Generated 1820 derivative records from 2767 primary records. [2025-09-19T22:24:36.272692] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-19T22:24:36.371438] [DEBUG] [LOCAL ] PAI: Derivative data saved (1820 records). [2025-09-19T22:24:36.471898] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-19T22:24:36.501264] [INFO ] [MAIN ] Derivative Progress: 1417/2093 symbols completed. PAI took 1.1s. Estimated remaining: 4m 23s. Rate: 154.5 symbols/min [2025-09-19T22:24:36.502203] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:36.521612] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:36.522545] [INFO ] [MAIN ] PAM: Generated 1820 derivative records from 28046 primary records. [2025-09-19T22:24:36.523033] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-19T22:24:36.540459] [DEBUG] [LOCAL ] PAM: Derivative data saved (1820 records). [2025-09-19T22:24:36.541455] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-19T22:24:36.543882] [INFO ] [MAIN ] Derivative Progress: 1418/2093 symbols completed. PAM took 1.1s. Estimated remaining: 4m 22s. Rate: 154.6 symbols/min [2025-09-19T22:24:36.544785] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:36.564183] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:36.565051] [INFO ] [MAIN ] PAR: Generated 1820 derivative records from 33100 primary records. [2025-09-19T22:24:36.565371] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-19T22:24:36.592794] [DEBUG] [LOCAL ] PAR: Derivative data saved (1820 records). [2025-09-19T22:24:36.592975] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-19T22:24:36.595605] [INFO ] [MAIN ] Derivative Progress: 1419/2093 symbols completed. PAR took 0.8s. Estimated remaining: 4m 21s. Rate: 154.7 symbols/min [2025-09-19T22:24:36.596145] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:36.612294] [DEBUG] [LOCAL ] PARR: Loaded 49140 existing records from primary storage. [2025-09-19T22:24:36.612553] [INFO ] [MAIN ] PARR: Loaded 49140 primary data records. [2025-09-19T22:24:36.798587] [DEBUG] [LOCAL ] PAXS: Loaded 21415 existing records from primary storage. [2025-09-19T22:24:36.787827] [DEBUG] [LOCAL ] PATH: Loaded 54458 existing records from primary storage. [2025-09-19T22:24:36.832883] [INFO ] [MAIN ] PATH: Loaded 54458 primary data records. [2025-09-19T22:24:36.850598] [INFO ] [MAIN ] PAXS: Loaded 21415 primary data records. [2025-09-19T22:24:37.681637] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:37.682800] [INFO ] [MAIN ] PARR: Generated 1820 derivative records from 49140 primary records. [2025-09-19T22:24:37.683107] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-19T22:24:37.708988] [DEBUG] [LOCAL ] PARR: Derivative data saved (1820 records). [2025-09-19T22:24:37.721979] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-19T22:24:37.724533] [INFO ] [MAIN ] Derivative Progress: 1420/2093 symbols completed. PARR took 1.2s. Estimated remaining: 4m 21s. Rate: 154.5 symbols/min [2025-09-19T22:24:37.725302] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:37.725166] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:37.738380] [INFO ] [MAIN ] PAXS: Generated 1820 derivative records from 21415 primary records. [2025-09-19T22:24:37.738481] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-19T22:24:37.739238] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:37.740128] [INFO ] [MAIN ] PATH: Generated 1820 derivative records from 54458 primary records. [2025-09-19T22:24:37.740670] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-19T22:24:37.769685] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1820 records). [2025-09-19T22:24:37.771599] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-19T22:24:37.774354] [INFO ] [MAIN ] Derivative Progress: 1421/2093 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 21s. Rate: 154.6 symbols/min [2025-09-19T22:24:37.775685] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:37.776114] [DEBUG] [LOCAL ] PATH: Derivative data saved (1820 records). [2025-09-19T22:24:37.776544] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-19T22:24:37.779620] [INFO ] [MAIN ] Derivative Progress: 1422/2093 symbols completed. PATH took 1.2s. Estimated remaining: 4m 20s. Rate: 154.7 symbols/min [2025-09-19T22:24:37.780744] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:37.810373] [DEBUG] [LOCAL ] PAY: Loaded 38809 existing records from primary storage. [2025-09-19T22:24:37.810616] [INFO ] [MAIN ] PAY: Loaded 38809 primary data records. [2025-09-19T22:24:38.025159] [DEBUG] [LOCAL ] PAYC: Loaded 36966 existing records from primary storage. [2025-09-19T22:24:38.157181] [INFO ] [MAIN ] PAYC: Loaded 36966 primary data records. [2025-09-19T22:24:38.164433] [DEBUG] [LOCAL ] PB: Loaded 41998 existing records from primary storage. [2025-09-19T22:24:38.179514] [INFO ] [MAIN ] PB: Loaded 41998 primary data records. [2025-09-19T22:24:38.805202] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:38.806411] [INFO ] [MAIN ] PAY: Generated 1820 derivative records from 38809 primary records. [2025-09-19T22:24:38.806511] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-19T22:24:38.829758] [DEBUG] [LOCAL ] PAY: Derivative data saved (1820 records). [2025-09-19T22:24:38.830201] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-19T22:24:38.832624] [INFO ] [MAIN ] Derivative Progress: 1423/2093 symbols completed. PAY took 1.1s. Estimated remaining: 4m 20s. Rate: 154.5 symbols/min [2025-09-19T22:24:38.846425] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:38.847854] [INFO ] [MAIN ] PAYC: Generated 1820 derivative records from 36966 primary records. [2025-09-19T22:24:38.848516] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-19T22:24:38.869793] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:38.874112] [INFO ] [MAIN ] PB: Generated 1820 derivative records from 41998 primary records. [2025-09-19T22:24:38.874866] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-19T22:24:38.892967] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1820 records). [2025-09-19T22:24:38.893238] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-19T22:24:38.895994] [INFO ] [MAIN ] Derivative Progress: 1424/2093 symbols completed. PAYC took 1.1s. Estimated remaining: 4m 20s. Rate: 154.6 symbols/min [2025-09-19T22:24:38.898991] [DEBUG] [LOCAL ] PB: Derivative data saved (1820 records). [2025-09-19T22:24:38.899059] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-19T22:24:38.901901] [INFO ] [MAIN ] Derivative Progress: 1425/2093 symbols completed. PB took 1.1s. Estimated remaining: 4m 19s. Rate: 154.7 symbols/min [2025-09-19T22:24:38.902453] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:38.902577] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:38.903287] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:38.964267] [DEBUG] [LOCAL ] PBH: Loaded 31950 existing records from primary storage. [2025-09-19T22:24:38.977809] [INFO ] [MAIN ] PBH: Loaded 31950 primary data records. [2025-09-19T22:24:39.015548] [DEBUG] [LOCAL ] PBA: Loaded 49752 existing records from primary storage. [2025-09-19T22:24:39.034399] [INFO ] [MAIN ] PBA: Loaded 49752 primary data records. [2025-09-19T22:24:39.117979] [DEBUG] [LOCAL ] PBF: Loaded 53870 existing records from primary storage. [2025-09-19T22:24:39.161557] [INFO ] [MAIN ] PBF: Loaded 53870 primary data records. [2025-09-19T22:24:39.988616] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:39.989283] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:39.990138] [INFO ] [MAIN ] PBA: Generated 1820 derivative records from 49752 primary records. [2025-09-19T22:24:39.991330] [INFO ] [MAIN ] PBH: Generated 1820 derivative records from 31950 primary records. [2025-09-19T22:24:39.990492] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-19T22:24:39.991562] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-19T22:24:40.011964] [DEBUG] [LOCAL ] PBH: Derivative data saved (1820 records). [2025-09-19T22:24:40.020780] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-19T22:24:40.030906] [INFO ] [MAIN ] Derivative Progress: 1426/2093 symbols completed. PBH took 1.1s. Estimated remaining: 4m 19s. Rate: 154.5 symbols/min [2025-09-19T22:24:40.039583] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:40.040965] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:40.042912] [INFO ] [MAIN ] PBF: Generated 1820 derivative records from 53870 primary records. [2025-09-19T22:24:40.043852] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-19T22:24:40.059771] [DEBUG] [LOCAL ] PBA: Derivative data saved (1820 records). [2025-09-19T22:24:40.060743] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-19T22:24:40.064116] [INFO ] [MAIN ] Derivative Progress: 1427/2093 symbols completed. PBA took 1.2s. Estimated remaining: 4m 18s. Rate: 154.6 symbols/min [2025-09-19T22:24:40.064966] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:40.069714] [DEBUG] [LOCAL ] PBF: Derivative data saved (1820 records). [2025-09-19T22:24:40.069986] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-19T22:24:40.074269] [INFO ] [MAIN ] Derivative Progress: 1428/2093 symbols completed. PBF took 1.2s. Estimated remaining: 4m 18s. Rate: 154.7 symbols/min [2025-09-19T22:24:40.074750] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:40.115667] [DEBUG] [LOCAL ] PBT: Loaded 17804 existing records from primary storage. [2025-09-19T22:24:40.115843] [INFO ] [MAIN ] PBT: Loaded 17804 primary data records. [2025-09-19T22:24:40.254970] [DEBUG] [LOCAL ] PBI: Loaded 50856 existing records from primary storage. [2025-09-19T22:24:40.271953] [INFO ] [MAIN ] PBI: Loaded 50856 primary data records. [2025-09-19T22:24:40.394354] [DEBUG] [LOCAL ] PBR: Loaded 54493 existing records from primary storage. [2025-09-19T22:24:40.551250] [INFO ] [MAIN ] PBR: Loaded 54493 primary data records. [2025-09-19T22:24:41.194926] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:41.195891] [INFO ] [MAIN ] PBT: Generated 1820 derivative records from 17804 primary records. [2025-09-19T22:24:41.196087] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-19T22:24:41.216267] [DEBUG] [LOCAL ] PBT: Derivative data saved (1820 records). [2025-09-19T22:24:41.216416] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-19T22:24:41.218313] [INFO ] [MAIN ] Derivative Progress: 1429/2093 symbols completed. PBT took 1.1s. Estimated remaining: 4m 18s. Rate: 154.5 symbols/min [2025-09-19T22:24:41.219418] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:41.237305] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:41.240312] [INFO ] [MAIN ] PBI: Generated 1820 derivative records from 50856 primary records. [2025-09-19T22:24:41.240846] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-19T22:24:41.257774] [DEBUG] [LOCAL ] PCF: Loaded 8854 existing records from primary storage. [2025-09-19T22:24:41.257917] [INFO ] [MAIN ] PCF: Loaded 8854 primary data records. [2025-09-19T22:24:41.351083] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:41.362917] [INFO ] [MAIN ] PBR: Generated 1820 derivative records from 54493 primary records. [2025-09-19T22:24:41.368895] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-19T22:24:41.368967] [DEBUG] [LOCAL ] PBI: Derivative data saved (1820 records). [2025-09-19T22:24:41.379812] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-19T22:24:41.382737] [INFO ] [MAIN ] Derivative Progress: 1430/2093 symbols completed. PBI took 1.3s. Estimated remaining: 4m 17s. Rate: 154.6 symbols/min [2025-09-19T22:24:41.383517] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:41.490083] [DEBUG] [LOCAL ] PBR: Derivative data saved (1820 records). [2025-09-19T22:24:41.487814] [DEBUG] [LOCAL ] PCM: Loaded 6920 existing records from primary storage. [2025-09-19T22:24:41.610013] [INFO ] [MAIN ] PCM: Loaded 6920 primary data records. [2025-09-19T22:24:41.609586] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-19T22:24:41.644343] [INFO ] [MAIN ] Derivative Progress: 1431/2093 symbols completed. PBR took 1.6s. Estimated remaining: 4m 17s. Rate: 154.6 symbols/min [2025-09-19T22:24:41.669589] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:41.942448] [DEBUG] [LOCAL ] PCN: Loaded 24489 existing records from primary storage. [2025-09-19T22:24:41.942873] [INFO ] [MAIN ] PCN: Loaded 24489 primary data records. [2025-09-19T22:24:42.039739] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:42.060809] [INFO ] [MAIN ] PCF: Generated 1820 derivative records from 8854 primary records. [2025-09-19T22:24:42.064135] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-19T22:24:42.129006] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:42.165720] [INFO ] [MAIN ] PCM: Generated 1820 derivative records from 6920 primary records. [2025-09-19T22:24:42.285804] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-19T22:24:42.315347] [DEBUG] [LOCAL ] PCF: Derivative data saved (1820 records). [2025-09-19T22:24:42.316252] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-19T22:24:42.318435] [INFO ] [MAIN ] Derivative Progress: 1432/2093 symbols completed. PCF took 1.1s. Estimated remaining: 4m 17s. Rate: 154.5 symbols/min [2025-09-19T22:24:42.319234] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:42.323418] [DEBUG] [LOCAL ] PCM: Derivative data saved (1820 records). [2025-09-19T22:24:42.323952] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-19T22:24:42.326410] [INFO ] [MAIN ] Derivative Progress: 1433/2093 symbols completed. PCM took 0.9s. Estimated remaining: 4m 16s. Rate: 154.6 symbols/min [2025-09-19T22:24:42.327394] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:42.343008] [DEBUG] [LOCAL ] PCQ: Loaded 12264 existing records from primary storage. [2025-09-19T22:24:42.351915] [INFO ] [MAIN ] PCQ: Loaded 12264 primary data records. [2025-09-19T22:24:42.389904] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:42.424004] [INFO ] [MAIN ] PCN: Generated 1820 derivative records from 24489 primary records. [2025-09-19T22:24:42.435873] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-19T22:24:42.704914] [DEBUG] [LOCAL ] PCOR: Loaded 48854 existing records from primary storage. [2025-09-19T22:24:42.706092] [INFO ] [MAIN ] PCOR: Loaded 48854 primary data records. [2025-09-19T22:24:42.719289] [DEBUG] [LOCAL ] PCN: Derivative data saved (1820 records). [2025-09-19T22:24:42.730018] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-19T22:24:42.743250] [INFO ] [MAIN ] Derivative Progress: 1434/2093 symbols completed. PCN took 1.1s. Estimated remaining: 4m 16s. Rate: 154.6 symbols/min [2025-09-19T22:24:42.748937] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:43.114571] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:43.130446] [INFO ] [MAIN ] PCQ: Generated 1820 derivative records from 12264 primary records. [2025-09-19T22:24:43.131754] [DEBUG] [LOCAL ] PD: Loaded 48486 existing records from primary storage. [2025-09-19T22:24:43.130812] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-19T22:24:43.131870] [INFO ] [MAIN ] PD: Loaded 48486 primary data records. [2025-09-19T22:24:43.294057] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1820 records). [2025-09-19T22:24:43.333491] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-19T22:24:43.336121] [INFO ] [MAIN ] Derivative Progress: 1435/2093 symbols completed. PCQ took 1.0s. Estimated remaining: 4m 15s. Rate: 154.6 symbols/min [2025-09-19T22:24:43.453455] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:43.468426] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:43.469247] [INFO ] [MAIN ] PCOR: Generated 1820 derivative records from 48854 primary records. [2025-09-19T22:24:43.469410] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-19T22:24:43.488849] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1820 records). [2025-09-19T22:24:43.489312] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-19T22:24:43.492189] [INFO ] [MAIN ] Derivative Progress: 1436/2093 symbols completed. PCOR took 1.2s. Estimated remaining: 4m 15s. Rate: 154.6 symbols/min [2025-09-19T22:24:43.492744] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:43.514895] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:43.515625] [INFO ] [MAIN ] PD: Generated 1820 derivative records from 48486 primary records. [2025-09-19T22:24:43.515830] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-19T22:24:43.574522] [DEBUG] [LOCAL ] PD: Derivative data saved (1820 records). [2025-09-19T22:24:43.574813] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-19T22:24:43.577204] [INFO ] [MAIN ] Derivative Progress: 1437/2093 symbols completed. PD took 0.8s. Estimated remaining: 4m 14s. Rate: 154.7 symbols/min [2025-09-19T22:24:43.577605] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:43.578500] [DEBUG] [LOCAL ] PDI: Loaded 51004 existing records from primary storage. [2025-09-19T22:24:43.579370] [INFO ] [MAIN ] PDI: Loaded 51004 primary data records. [2025-09-19T22:24:43.661631] [DEBUG] [LOCAL ] PDM: Loaded 40500 existing records from primary storage. [2025-09-19T22:24:43.673344] [INFO ] [MAIN ] PDM: Loaded 40500 primary data records. [2025-09-19T22:24:44.100326] [DEBUG] [LOCAL ] PDO: Loaded 32308 existing records from primary storage. [2025-09-19T22:24:44.100539] [INFO ] [MAIN ] PDO: Loaded 32308 primary data records. [2025-09-19T22:24:44.591360] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:44.592371] [INFO ] [MAIN ] PDI: Generated 1820 derivative records from 51004 primary records. [2025-09-19T22:24:44.593218] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-19T22:24:44.625027] [DEBUG] [LOCAL ] PDI: Derivative data saved (1820 records). [2025-09-19T22:24:44.625404] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-19T22:24:44.627558] [INFO ] [MAIN ] Derivative Progress: 1438/2093 symbols completed. PDI took 1.2s. Estimated remaining: 4m 14s. Rate: 154.5 symbols/min [2025-09-19T22:24:44.623569] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:44.628617] [INFO ] [MAIN ] PDM: Generated 1820 derivative records from 40500 primary records. [2025-09-19T22:24:44.628980] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-19T22:24:44.645400] [DEBUG] [LOCAL ] PDM: Derivative data saved (1820 records). [2025-09-19T22:24:44.645487] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-19T22:24:44.648516] [INFO ] [MAIN ] Derivative Progress: 1439/2093 symbols completed. PDM took 1.2s. Estimated remaining: 4m 14s. Rate: 154.6 symbols/min [2025-09-19T22:24:44.663377] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:44.664035] [INFO ] [MAIN ] PDO: Generated 1820 derivative records from 32308 primary records. [2025-09-19T22:24:44.664097] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-19T22:24:44.679466] [DEBUG] [LOCAL ] PDO: Derivative data saved (1820 records). [2025-09-19T22:24:44.679530] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-19T22:24:44.682156] [INFO ] [MAIN ] Derivative Progress: 1440/2093 symbols completed. PDO took 1.1s. Estimated remaining: 4m 13s. Rate: 154.7 symbols/min [2025-09-19T22:24:44.682696] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:44.683050] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:44.682996] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:44.719672] [DEBUG] [LOCAL ] PDX: Loaded 14674 existing records from primary storage. [2025-09-19T22:24:44.720081] [DEBUG] [LOCAL ] PDT: Loaded 17765 existing records from primary storage. [2025-09-19T22:24:44.720279] [INFO ] [MAIN ] PDX: Loaded 14674 primary data records. [2025-09-19T22:24:44.720840] [INFO ] [MAIN ] PDT: Loaded 17765 primary data records. [2025-09-19T22:24:44.720751] [DEBUG] [LOCAL ] PDS: Loaded 18902 existing records from primary storage. [2025-09-19T22:24:44.720959] [INFO ] [MAIN ] PDS: Loaded 18902 primary data records. [2025-09-19T22:24:45.695411] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:45.697988] [INFO ] [MAIN ] PDT: Generated 1820 derivative records from 17765 primary records. [2025-09-19T22:24:45.710668] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-19T22:24:45.710981] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:45.719423] [INFO ] [MAIN ] PDS: Generated 1820 derivative records from 18902 primary records. [2025-09-19T22:24:45.725229] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-19T22:24:45.733740] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:45.739016] [INFO ] [MAIN ] PDX: Generated 1820 derivative records from 14674 primary records. [2025-09-19T22:24:45.746471] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-19T22:24:45.757417] [DEBUG] [LOCAL ] PDS: Derivative data saved (1820 records). [2025-09-19T22:24:45.757971] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-19T22:24:45.758465] [DEBUG] [LOCAL ] PDT: Derivative data saved (1820 records). [2025-09-19T22:24:45.758568] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-19T22:24:45.768053] [INFO ] [MAIN ] Derivative Progress: 1441/2093 symbols completed. PDS took 1.1s. Estimated remaining: 4m 13s. Rate: 154.5 symbols/min [2025-09-19T22:24:45.778931] [DEBUG] [LOCAL ] PDX: Derivative data saved (1820 records). [2025-09-19T22:24:45.779107] [INFO ] [MAIN ] Derivative Progress: 1442/2093 symbols completed. PDT took 1.1s. Estimated remaining: 4m 13s. Rate: 154.6 symbols/min [2025-09-19T22:24:45.779226] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:45.779519] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:45.779678] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-19T22:24:45.782675] [INFO ] [MAIN ] Derivative Progress: 1443/2093 symbols completed. PDX took 1.1s. Estimated remaining: 4m 12s. Rate: 154.7 symbols/min [2025-09-19T22:24:45.783362] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:45.797337] [DEBUG] [LOCAL ] PEO: Loaded 11030 existing records from primary storage. [2025-09-19T22:24:45.797474] [INFO ] [MAIN ] PEO: Loaded 11030 primary data records. [2025-09-19T22:24:45.999106] [DEBUG] [LOCAL ] PEN: Loaded 31122 existing records from primary storage. [2025-09-19T22:24:46.030582] [INFO ] [MAIN ] PEN: Loaded 31122 primary data records. [2025-09-19T22:24:46.031334] [DEBUG] [LOCAL ] PEB: Loaded 51497 existing records from primary storage. [2025-09-19T22:24:46.156900] [INFO ] [MAIN ] PEB: Loaded 51497 primary data records. [2025-09-19T22:24:46.784439] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:46.785735] [INFO ] [MAIN ] PEO: Generated 1820 derivative records from 11030 primary records. [2025-09-19T22:24:46.785874] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-19T22:24:46.804757] [DEBUG] [LOCAL ] PEO: Derivative data saved (1820 records). [2025-09-19T22:24:46.806012] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-19T22:24:46.809751] [INFO ] [MAIN ] Derivative Progress: 1444/2093 symbols completed. PEO took 1.0s. Estimated remaining: 4m 12s. Rate: 154.6 symbols/min [2025-09-19T22:24:46.810383] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:46.824909] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:46.825747] [INFO ] [MAIN ] PEB: Generated 1820 derivative records from 51497 primary records. [2025-09-19T22:24:46.825889] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-19T22:24:46.849053] [DEBUG] [LOCAL ] PEB: Derivative data saved (1820 records). [2025-09-19T22:24:46.850053] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-19T22:24:46.852626] [INFO ] [MAIN ] Derivative Progress: 1445/2093 symbols completed. PEB took 1.1s. Estimated remaining: 4m 11s. Rate: 154.7 symbols/min [2025-09-19T22:24:46.852979] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:46.873325] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:46.872900] [DEBUG] [LOCAL ] PERF: Loaded 14289 existing records from primary storage. [2025-09-19T22:24:46.874348] [INFO ] [MAIN ] PEN: Generated 1820 derivative records from 31122 primary records. [2025-09-19T22:24:46.874444] [INFO ] [MAIN ] PERF: Loaded 14289 primary data records. [2025-09-19T22:24:46.874582] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-19T22:24:46.937364] [DEBUG] [LOCAL ] PFD: Loaded 5232 existing records from primary storage. [2025-09-19T22:24:46.951618] [INFO ] [MAIN ] PFD: Loaded 5232 primary data records. [2025-09-19T22:24:47.055248] [DEBUG] [LOCAL ] PEN: Derivative data saved (1820 records). [2025-09-19T22:24:47.083586] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-19T22:24:47.114110] [INFO ] [MAIN ] Derivative Progress: 1446/2093 symbols completed. PEN took 1.3s. Estimated remaining: 4m 11s. Rate: 154.7 symbols/min [2025-09-19T22:24:47.161083] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:47.605715] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:47.605371] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:47.619570] [INFO ] [MAIN ] PFD: Generated 1820 derivative records from 5232 primary records. [2025-09-19T22:24:47.619755] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-19T22:24:47.620392] [INFO ] [MAIN ] PERF: Generated 1820 derivative records from 14289 primary records. [2025-09-19T22:24:47.620839] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-19T22:24:47.621734] [DEBUG] [LOCAL ] PFGC: Loaded 47747 existing records from primary storage. [2025-09-19T22:24:47.630368] [INFO ] [MAIN ] PFGC: Loaded 47747 primary data records. [2025-09-19T22:24:47.679967] [DEBUG] [LOCAL ] PFD: Derivative data saved (1820 records). [2025-09-19T22:24:47.707464] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-19T22:24:47.719132] [INFO ] [MAIN ] Derivative Progress: 1447/2093 symbols completed. PFD took 0.9s. Estimated remaining: 4m 11s. Rate: 154.6 symbols/min [2025-09-19T22:24:47.732730] [DEBUG] [LOCAL ] PERF: Derivative data saved (1820 records). [2025-09-19T22:24:47.732835] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-19T22:24:47.731733] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:47.735150] [INFO ] [MAIN ] Derivative Progress: 1448/2093 symbols completed. PERF took 0.9s. Estimated remaining: 4m 10s. Rate: 154.7 symbols/min [2025-09-19T22:24:47.750910] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:47.859479] [DEBUG] [LOCAL ] PFH: Loaded 7016 existing records from primary storage. [2025-09-19T22:24:47.988365] [INFO ] [MAIN ] PFH: Loaded 7016 primary data records. [2025-09-19T22:24:48.032670] [DEBUG] [LOCAL ] PFL: Loaded 13980 existing records from primary storage. [2025-09-19T22:24:48.053797] [INFO ] [MAIN ] PFL: Loaded 13980 primary data records. [2025-09-19T22:24:48.643343] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:48.644597] [INFO ] [MAIN ] PFGC: Generated 1820 derivative records from 47747 primary records. [2025-09-19T22:24:48.644991] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-19T22:24:48.663682] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1820 records). [2025-09-19T22:24:48.663924] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-19T22:24:48.666240] [INFO ] [MAIN ] Derivative Progress: 1449/2093 symbols completed. PFGC took 1.5s. Estimated remaining: 4m 10s. Rate: 154.6 symbols/min [2025-09-19T22:24:48.667935] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:48.684172] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:48.685086] [INFO ] [MAIN ] PFH: Generated 1820 derivative records from 7016 primary records. [2025-09-19T22:24:48.685373] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-19T22:24:48.703762] [DEBUG] [LOCAL ] PFH: Derivative data saved (1820 records). [2025-09-19T22:24:48.704103] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-19T22:24:48.706953] [INFO ] [MAIN ] Derivative Progress: 1450/2093 symbols completed. PFH took 1.0s. Estimated remaining: 4m 9s. Rate: 154.7 symbols/min [2025-09-19T22:24:48.719880] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:48.720745] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:48.721526] [INFO ] [MAIN ] PFL: Generated 1820 derivative records from 13980 primary records. [2025-09-19T22:24:48.721743] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-19T22:24:48.752443] [DEBUG] [LOCAL ] PFL: Derivative data saved (1820 records). [2025-09-19T22:24:48.752622] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-19T22:24:48.755020] [INFO ] [MAIN ] Derivative Progress: 1451/2093 symbols completed. PFL took 1.0s. Estimated remaining: 4m 9s. Rate: 154.8 symbols/min [2025-09-19T22:24:48.755406] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:48.763843] [DEBUG] [LOCAL ] PFN: Loaded 22003 existing records from primary storage. [2025-09-19T22:24:48.764073] [INFO ] [MAIN ] PFN: Loaded 22003 primary data records. [2025-09-19T22:24:48.821122] [DEBUG] [LOCAL ] PFLT: Loaded 44319 existing records from primary storage. [2025-09-19T22:24:48.868554] [DEBUG] [LOCAL ] PFO: Loaded 5940 existing records from primary storage. [2025-09-19T22:24:48.868340] [INFO ] [MAIN ] PFLT: Loaded 44319 primary data records. [2025-09-19T22:24:48.874910] [INFO ] [MAIN ] PFO: Loaded 5940 primary data records. [2025-09-19T22:24:49.755048] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:49.756999] [INFO ] [MAIN ] PFN: Generated 1820 derivative records from 22003 primary records. [2025-09-19T22:24:49.759563] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-19T22:24:49.802917] [DEBUG] [LOCAL ] PFN: Derivative data saved (1820 records). [2025-09-19T22:24:49.803873] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:49.803505] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-19T22:24:49.804872] [INFO ] [MAIN ] PFLT: Generated 1820 derivative records from 44319 primary records. [2025-09-19T22:24:49.804968] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-19T22:24:49.803222] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:49.811422] [INFO ] [MAIN ] Derivative Progress: 1452/2093 symbols completed. PFN took 1.1s. Estimated remaining: 4m 9s. Rate: 154.6 symbols/min [2025-09-19T22:24:49.809080] [INFO ] [MAIN ] PFO: Generated 1820 derivative records from 5940 primary records. [2025-09-19T22:24:49.813108] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:49.812986] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-19T22:24:49.842547] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1820 records). [2025-09-19T22:24:49.845984] [DEBUG] [LOCAL ] PFO: Derivative data saved (1820 records). [2025-09-19T22:24:49.846095] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-19T22:24:49.842801] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-19T22:24:49.848998] [INFO ] [MAIN ] Derivative Progress: 1453/2093 symbols completed. PFO took 1.1s. Estimated remaining: 4m 8s. Rate: 154.7 symbols/min [2025-09-19T22:24:49.851903] [INFO ] [MAIN ] Derivative Progress: 1454/2093 symbols completed. PFLT took 1.2s. Estimated remaining: 4m 8s. Rate: 154.8 symbols/min [2025-09-19T22:24:49.884134] [DEBUG] [LOCAL ] PFS: Loaded 36345 existing records from primary storage. [2025-09-19T22:24:49.884302] [INFO ] [MAIN ] PFS: Loaded 36345 primary data records. [2025-09-19T22:24:50.197959] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:50.198595] [INFO ] [MAIN ] PFS: Generated 1820 derivative records from 36345 primary records. [2025-09-19T22:24:50.198683] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-19T22:24:50.214570] [DEBUG] [LOCAL ] PFS: Derivative data saved (1820 records). [2025-09-19T22:24:50.214630] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-19T22:24:50.217619] [INFO ] [MAIN ] Derivative Progress: 1455/2093 symbols completed. PFS took 0.4s. Estimated remaining: 4m 7s. Rate: 154.8 symbols/min [2025-09-19T22:24:50.218598] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:50.219043] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:50.218752] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:50.228505] [DEBUG] [LOCAL ] PGP: Loaded 5490 existing records from primary storage. [2025-09-19T22:24:50.228747] [INFO ] [MAIN ] PGP: Loaded 5490 primary data records. [2025-09-19T22:24:50.415336] [DEBUG] [LOCAL ] PFSI: Loaded 29233 existing records from primary storage. [2025-09-19T22:24:50.433817] [INFO ] [MAIN ] PFSI: Loaded 29233 primary data records. [2025-09-19T22:24:50.469384] [DEBUG] [LOCAL ] PGRE: Loaded 46920 existing records from primary storage. [2025-09-19T22:24:50.481181] [INFO ] [MAIN ] PGRE: Loaded 46920 primary data records. [2025-09-19T22:24:51.284059] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:51.285129] [INFO ] [MAIN ] PGP: Generated 1820 derivative records from 5490 primary records. [2025-09-19T22:24:51.286391] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-19T22:24:51.304826] [DEBUG] [LOCAL ] PGP: Derivative data saved (1820 records). [2025-09-19T22:24:51.305160] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-19T22:24:51.320480] [INFO ] [MAIN ] Derivative Progress: 1456/2093 symbols completed. PGP took 1.1s. Estimated remaining: 4m 7s. Rate: 154.6 symbols/min [2025-09-19T22:24:51.321041] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:51.321343] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:51.322887] [INFO ] [MAIN ] PFSI: Generated 1820 derivative records from 29233 primary records. [2025-09-19T22:24:51.323080] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-19T22:24:51.342583] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1820 records). [2025-09-19T22:24:51.346628] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-19T22:24:51.347258] [DEBUG] [LOCAL ] PGZ: Loaded 5490 existing records from primary storage. [2025-09-19T22:24:51.349690] [INFO ] [MAIN ] Derivative Progress: 1457/2093 symbols completed. PFSI took 1.1s. Estimated remaining: 4m 7s. Rate: 154.7 symbols/min [2025-09-19T22:24:51.351481] [INFO ] [MAIN ] PGZ: Loaded 5490 primary data records. [2025-09-19T22:24:51.351896] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:51.411159] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:51.451627] [INFO ] [MAIN ] PGRE: Generated 1820 derivative records from 46920 primary records. [2025-09-19T22:24:51.471342] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-19T22:24:51.542227] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1820 records). [2025-09-19T22:24:51.574493] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-19T22:24:51.697568] [INFO ] [MAIN ] Derivative Progress: 1458/2093 symbols completed. PGRE took 1.5s. Estimated remaining: 4m 6s. Rate: 154.7 symbols/min [2025-09-19T22:24:51.698522] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:51.716704] [DEBUG] [LOCAL ] PH: Loaded 39897 existing records from primary storage. [2025-09-19T22:24:51.717329] [INFO ] [MAIN ] PH: Loaded 39897 primary data records. [2025-09-19T22:24:51.800584] [DEBUG] [LOCAL ] PHD: Loaded 9763 existing records from primary storage. [2025-09-19T22:24:51.818556] [INFO ] [MAIN ] PHD: Loaded 9763 primary data records. [2025-09-19T22:24:52.352214] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:52.366594] [INFO ] [MAIN ] PGZ: Generated 1820 derivative records from 5490 primary records. [2025-09-19T22:24:52.367607] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-19T22:24:52.384958] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1820 records). [2025-09-19T22:24:52.385846] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-19T22:24:52.388683] [INFO ] [MAIN ] Derivative Progress: 1459/2093 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 6s. Rate: 154.6 symbols/min [2025-09-19T22:24:52.389590] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:52.415854] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:52.418606] [INFO ] [MAIN ] PH: Generated 1820 derivative records from 39897 primary records. [2025-09-19T22:24:52.418876] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-19T22:24:52.463267] [DEBUG] [LOCAL ] PH: Derivative data saved (1820 records). [2025-09-19T22:24:52.463770] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-19T22:24:52.466739] [INFO ] [MAIN ] Derivative Progress: 1460/2093 symbols completed. PH took 1.1s. Estimated remaining: 4m 5s. Rate: 154.7 symbols/min [2025-09-19T22:24:52.467164] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:52.463573] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:52.468439] [INFO ] [MAIN ] PHD: Generated 1820 derivative records from 9763 primary records. [2025-09-19T22:24:52.468557] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-19T22:24:52.485822] [DEBUG] [LOCAL ] PHD: Derivative data saved (1820 records). [2025-09-19T22:24:52.498901] [DEBUG] [LOCAL ] PHG: Loaded 46960 existing records from primary storage. [2025-09-19T22:24:52.498266] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-19T22:24:52.504107] [INFO ] [MAIN ] PHG: Loaded 46960 primary data records. [2025-09-19T22:24:52.507053] [INFO ] [MAIN ] Derivative Progress: 1461/2093 symbols completed. PHD took 0.8s. Estimated remaining: 4m 5s. Rate: 154.8 symbols/min [2025-09-19T22:24:52.528200] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:52.618828] [DEBUG] [LOCAL ] PHI: Loaded 15124 existing records from primary storage. [2025-09-19T22:24:52.619367] [INFO ] [MAIN ] PHI: Loaded 15124 primary data records. [2025-09-19T22:24:53.035492] [DEBUG] [LOCAL ] PHIN: Loaded 34030 existing records from primary storage. [2025-09-19T22:24:53.035888] [INFO ] [MAIN ] PHIN: Loaded 34030 primary data records. [2025-09-19T22:24:53.505184] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:53.506221] [INFO ] [MAIN ] PHG: Generated 1820 derivative records from 46960 primary records. [2025-09-19T22:24:53.506492] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-19T22:24:53.525639] [DEBUG] [LOCAL ] PHG: Derivative data saved (1820 records). [2025-09-19T22:24:53.527275] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-19T22:24:53.529732] [INFO ] [MAIN ] Derivative Progress: 1462/2093 symbols completed. PHG took 1.1s. Estimated remaining: 4m 5s. Rate: 154.6 symbols/min [2025-09-19T22:24:53.530087] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:53.544234] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:53.544989] [INFO ] [MAIN ] PHI: Generated 1820 derivative records from 15124 primary records. [2025-09-19T22:24:53.545167] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-19T22:24:53.562462] [DEBUG] [LOCAL ] PHI: Derivative data saved (1820 records). [2025-09-19T22:24:53.563270] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-19T22:24:53.565733] [INFO ] [MAIN ] Derivative Progress: 1463/2093 symbols completed. PHI took 1.1s. Estimated remaining: 4m 4s. Rate: 154.7 symbols/min [2025-09-19T22:24:53.578395] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:53.586415] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:53.587180] [INFO ] [MAIN ] PHIN: Generated 1820 derivative records from 34030 primary records. [2025-09-19T22:24:53.587427] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-19T22:24:53.604097] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1820 records). [2025-09-19T22:24:53.612109] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-19T22:24:53.614744] [INFO ] [MAIN ] Derivative Progress: 1464/2093 symbols completed. PHIN took 1.1s. Estimated remaining: 4m 4s. Rate: 154.8 symbols/min [2025-09-19T22:24:53.615098] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:53.615870] [DEBUG] [LOCAL ] PHK: Loaded 27059 existing records from primary storage. [2025-09-19T22:24:53.616289] [INFO ] [MAIN ] PHK: Loaded 27059 primary data records. [2025-09-19T22:24:53.826800] [DEBUG] [LOCAL ] PHR: Loaded 37775 existing records from primary storage. [2025-09-19T22:24:53.914747] [INFO ] [MAIN ] PHR: Loaded 37775 primary data records. [2025-09-19T22:24:54.095377] [DEBUG] [LOCAL ] PII: Loaded 50081 existing records from primary storage. [2025-09-19T22:24:54.113780] [INFO ] [MAIN ] PII: Loaded 50081 primary data records. [2025-09-19T22:24:54.585475] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:54.586943] [INFO ] [MAIN ] PHK: Generated 1820 derivative records from 27059 primary records. [2025-09-19T22:24:54.587194] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-19T22:24:54.605177] [DEBUG] [LOCAL ] PHK: Derivative data saved (1820 records). [2025-09-19T22:24:54.605433] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-19T22:24:54.607586] [INFO ] [MAIN ] Derivative Progress: 1465/2093 symbols completed. PHK took 1.1s. Estimated remaining: 4m 4s. Rate: 154.7 symbols/min [2025-09-19T22:24:54.608146] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:54.626085] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:54.627295] [INFO ] [MAIN ] PHR: Generated 1820 derivative records from 37775 primary records. [2025-09-19T22:24:54.629901] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-19T22:24:54.629824] [DEBUG] [LOCAL ] PIM: Loaded 4840 existing records from primary storage. [2025-09-19T22:24:54.630683] [INFO ] [MAIN ] PIM: Loaded 4840 primary data records. [2025-09-19T22:24:54.768702] [DEBUG] [LOCAL ] PHR: Derivative data saved (1820 records). [2025-09-19T22:24:54.763125] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:54.768827] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-19T22:24:54.774640] [INFO ] [MAIN ] PII: Generated 1820 derivative records from 50081 primary records. [2025-09-19T22:24:54.787312] [INFO ] [MAIN ] Derivative Progress: 1466/2093 symbols completed. PHR took 1.2s. Estimated remaining: 4m 3s. Rate: 154.7 symbols/min [2025-09-19T22:24:54.805660] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-19T22:24:54.814293] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:55.025021] [DEBUG] [LOCAL ] PII: Derivative data saved (1820 records). [2025-09-19T22:24:55.025348] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-19T22:24:55.028449] [INFO ] [MAIN ] Derivative Progress: 1467/2093 symbols completed. PII took 1.4s. Estimated remaining: 4m 3s. Rate: 154.8 symbols/min [2025-09-19T22:24:55.029312] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:55.035890] [DEBUG] [LOCAL ] PINE: Loaded 14460 existing records from primary storage. [2025-09-19T22:24:55.036008] [INFO ] [MAIN ] PINE: Loaded 14460 primary data records. [2025-09-19T22:24:55.395231] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-09-19T22:24:55.396317] [INFO ] [MAIN ] PINS: Loaded 54473 primary data records. [2025-09-19T22:24:55.395917] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:55.397365] [INFO ] [MAIN ] PIM: Generated 1820 derivative records from 4840 primary records. [2025-09-19T22:24:55.397560] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-19T22:24:55.515274] [DEBUG] [LOCAL ] PIM: Derivative data saved (1820 records). [2025-09-19T22:24:55.515473] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-19T22:24:55.517807] [INFO ] [MAIN ] Derivative Progress: 1468/2093 symbols completed. PIM took 0.9s. Estimated remaining: 4m 2s. Rate: 154.7 symbols/min [2025-09-19T22:24:55.724993] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:55.725779] [INFO ] [MAIN ] PINE: Generated 1820 derivative records from 14460 primary records. [2025-09-19T22:24:55.725952] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-19T22:24:55.743490] [DEBUG] [LOCAL ] PINE: Derivative data saved (1820 records). [2025-09-19T22:24:55.743938] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-19T22:24:55.746570] [INFO ] [MAIN ] Derivative Progress: 1469/2093 symbols completed. PINE took 0.9s. Estimated remaining: 4m 2s. Rate: 154.8 symbols/min [2025-09-19T22:24:55.769851] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:55.770528] [INFO ] [MAIN ] PINS: Generated 1820 derivative records from 54473 primary records. [2025-09-19T22:24:55.770590] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-19T22:24:55.785892] [DEBUG] [LOCAL ] PINS: Derivative data saved (1820 records). [2025-09-19T22:24:55.785950] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-19T22:24:55.788638] [INFO ] [MAIN ] Derivative Progress: 1470/2093 symbols completed. PINS took 0.8s. Estimated remaining: 4m 1s. Rate: 154.9 symbols/min [2025-09-19T22:24:55.789438] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:55.789607] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:55.790013] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:55.809779] [DEBUG] [LOCAL ] PIPR: Loaded 15659 existing records from primary storage. [2025-09-19T22:24:55.815606] [INFO ] [MAIN ] PIPR: Loaded 15659 primary data records. [2025-09-19T22:24:55.924544] [DEBUG] [LOCAL ] PJT: Loaded 23163 existing records from primary storage. [2025-09-19T22:24:55.928815] [INFO ] [MAIN ] PJT: Loaded 23163 primary data records. [2025-09-19T22:24:56.275999] [DEBUG] [LOCAL ] PK: Loaded 53672 existing records from primary storage. [2025-09-19T22:24:56.281468] [INFO ] [MAIN ] PK: Loaded 53672 primary data records. [2025-09-19T22:24:56.847562] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:56.848498] [INFO ] [MAIN ] PIPR: Generated 1820 derivative records from 15659 primary records. [2025-09-19T22:24:56.848597] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-19T22:24:56.881571] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1820 records). [2025-09-19T22:24:56.882003] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-19T22:24:56.884294] [INFO ] [MAIN ] Derivative Progress: 1471/2093 symbols completed. PIPR took 1.1s. Estimated remaining: 4m 1s. Rate: 154.7 symbols/min [2025-09-19T22:24:56.881880] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:56.885293] [INFO ] [MAIN ] PJT: Generated 1820 derivative records from 23163 primary records. [2025-09-19T22:24:56.885537] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-19T22:24:56.885892] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:56.903867] [DEBUG] [LOCAL ] PJT: Derivative data saved (1820 records). [2025-09-19T22:24:56.905565] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-19T22:24:56.908118] [INFO ] [MAIN ] Derivative Progress: 1472/2093 symbols completed. PJT took 1.1s. Estimated remaining: 4m 1s. Rate: 154.8 symbols/min [2025-09-19T22:24:56.908621] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:56.924711] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:56.925499] [INFO ] [MAIN ] PK: Generated 1820 derivative records from 53672 primary records. [2025-09-19T22:24:56.925635] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-19T22:24:56.942785] [DEBUG] [LOCAL ] PKE: Loaded 12512 existing records from primary storage. [2025-09-19T22:24:56.944774] [INFO ] [MAIN ] PKE: Loaded 12512 primary data records. [2025-09-19T22:24:56.959446] [DEBUG] [LOCAL ] PK: Derivative data saved (1820 records). [2025-09-19T22:24:56.964712] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-19T22:24:56.967358] [INFO ] [MAIN ] Derivative Progress: 1473/2093 symbols completed. PK took 1.2s. Estimated remaining: 4m 0s. Rate: 154.9 symbols/min [2025-09-19T22:24:56.982791] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:57.290857] [DEBUG] [LOCAL ] PKST: Loaded 19892 existing records from primary storage. [2025-09-19T22:24:57.300892] [INFO ] [MAIN ] PKST: Loaded 19892 primary data records. [2025-09-19T22:24:57.339245] [DEBUG] [LOCAL ] PKG: Loaded 40008 existing records from primary storage. [2025-09-19T22:24:57.358917] [INFO ] [MAIN ] PKG: Loaded 40008 primary data records. [2025-09-19T22:24:57.935668] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:57.936584] [INFO ] [MAIN ] PKE: Generated 1820 derivative records from 12512 primary records. [2025-09-19T22:24:57.937390] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-19T22:24:57.959710] [DEBUG] [LOCAL ] PKE: Derivative data saved (1820 records). [2025-09-19T22:24:57.961195] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-19T22:24:57.963806] [INFO ] [MAIN ] Derivative Progress: 1474/2093 symbols completed. PKE took 1.1s. Estimated remaining: 4m 0s. Rate: 154.7 symbols/min [2025-09-19T22:24:57.964153] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:57.978480] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:57.979241] [INFO ] [MAIN ] PKST: Generated 1820 derivative records from 19892 primary records. [2025-09-19T22:24:57.979414] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-19T22:24:57.998033] [DEBUG] [LOCAL ] PKST: Derivative data saved (1820 records). [2025-09-19T22:24:57.998238] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-19T22:24:58.000723] [INFO ] [MAIN ] Derivative Progress: 1475/2093 symbols completed. PKST took 1.0s. Estimated remaining: 3m 60s. Rate: 154.8 symbols/min [2025-09-19T22:24:58.001180] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:58.015020] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:58.022889] [INFO ] [MAIN ] PKG: Generated 1820 derivative records from 40008 primary records. [2025-09-19T22:24:58.023040] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-19T22:24:58.047451] [DEBUG] [LOCAL ] PKX: Loaded 25728 existing records from primary storage. [2025-09-19T22:24:58.048365] [INFO ] [MAIN ] PKX: Loaded 25728 primary data records. [2025-09-19T22:24:58.070891] [DEBUG] [LOCAL ] PKG: Derivative data saved (1820 records). [2025-09-19T22:24:58.086809] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-19T22:24:58.121928] [INFO ] [MAIN ] Derivative Progress: 1476/2093 symbols completed. PKG took 1.2s. Estimated remaining: 3m 59s. Rate: 154.9 symbols/min [2025-09-19T22:24:58.171843] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:58.393193] [DEBUG] [LOCAL ] PL: Loaded 53884 existing records from primary storage. [2025-09-19T22:24:58.394825] [INFO ] [MAIN ] PL: Loaded 53884 primary data records. [2025-09-19T22:24:58.739502] [DEBUG] [LOCAL ] PLD: Loaded 54265 existing records from primary storage. [2025-09-19T22:24:58.741576] [INFO ] [MAIN ] PLD: Loaded 54265 primary data records. [2025-09-19T22:24:58.777454] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:58.827376] [INFO ] [MAIN ] PKX: Generated 1820 derivative records from 25728 primary records. [2025-09-19T22:24:58.838192] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-19T22:24:58.922505] [DEBUG] [LOCAL ] PKX: Derivative data saved (1820 records). [2025-09-19T22:24:58.933618] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-19T22:24:58.936341] [INFO ] [MAIN ] Derivative Progress: 1477/2093 symbols completed. PKX took 1.0s. Estimated remaining: 3m 59s. Rate: 154.7 symbols/min [2025-09-19T22:24:58.952055] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:59.148552] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:59.149759] [INFO ] [MAIN ] PL: Generated 1820 derivative records from 53884 primary records. [2025-09-19T22:24:59.150267] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-19T22:24:59.180350] [DEBUG] [LOCAL ] PL: Derivative data saved (1820 records). [2025-09-19T22:24:59.180441] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-19T22:24:59.182789] [INFO ] [MAIN ] Derivative Progress: 1478/2093 symbols completed. PL took 1.2s. Estimated remaining: 3m 58s. Rate: 154.8 symbols/min [2025-09-19T22:24:59.183247] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:59.204214] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:59.205331] [INFO ] [MAIN ] PLD: Generated 1820 derivative records from 54265 primary records. [2025-09-19T22:24:59.217368] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-19T22:24:59.219794] [DEBUG] [LOCAL ] PLNT: Loaded 49283 existing records from primary storage. [2025-09-19T22:24:59.219904] [INFO ] [MAIN ] PLNT: Loaded 49283 primary data records. [2025-09-19T22:24:59.326459] [DEBUG] [LOCAL ] PLOW: Loaded 20993 existing records from primary storage. [2025-09-19T22:24:59.338186] [INFO ] [MAIN ] PLOW: Loaded 20993 primary data records. [2025-09-19T22:24:59.361918] [DEBUG] [LOCAL ] PLD: Derivative data saved (1820 records). [2025-09-19T22:24:59.362061] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-19T22:24:59.391218] [INFO ] [MAIN ] Derivative Progress: 1479/2093 symbols completed. PLD took 1.2s. Estimated remaining: 3m 58s. Rate: 154.8 symbols/min [2025-09-19T22:24:59.425176] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:24:59.897742] [DEBUG] [LOCAL ] PLYM: Loaded 33622 existing records from primary storage. [2025-09-19T22:24:59.906258] [INFO ] [MAIN ] PLYM: Loaded 33622 primary data records. [2025-09-19T22:24:59.911994] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:24:59.950221] [INFO ] [MAIN ] PLNT: Generated 1820 derivative records from 49283 primary records. [2025-09-19T22:24:59.950625] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-19T22:25:00.045509] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1820 records). [2025-09-19T22:25:00.073349] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-19T22:25:00.094784] [INFO ] [MAIN ] Derivative Progress: 1480/2093 symbols completed. PLNT took 1.1s. Estimated remaining: 3m 58s. Rate: 154.7 symbols/min [2025-09-19T22:25:00.106712] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:00.107251] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:00.141483] [INFO ] [MAIN ] PLOW: Generated 1820 derivative records from 20993 primary records. [2025-09-19T22:25:00.141602] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-19T22:25:00.305010] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1820 records). [2025-09-19T22:25:00.310916] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-19T22:25:00.314328] [INFO ] [MAIN ] Derivative Progress: 1481/2093 symbols completed. PLOW took 1.1s. Estimated remaining: 3m 57s. Rate: 154.8 symbols/min [2025-09-19T22:25:00.315059] [DEBUG] [LOCAL ] PML: Loaded 20606 existing records from primary storage. [2025-09-19T22:25:00.315355] [INFO ] [MAIN ] PML: Loaded 20606 primary data records. [2025-09-19T22:25:00.315600] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:00.422340] [DEBUG] [LOCAL ] PMM: Loaded 10862 existing records from primary storage. [2025-09-19T22:25:00.430828] [INFO ] [MAIN ] PMM: Loaded 10862 primary data records. [2025-09-19T22:25:00.787728] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:00.822424] [INFO ] [MAIN ] PLYM: Generated 1820 derivative records from 33622 primary records. [2025-09-19T22:25:00.846119] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-19T22:25:01.030226] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1820 records). [2025-09-19T22:25:01.030712] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-19T22:25:01.033142] [INFO ] [MAIN ] Derivative Progress: 1482/2093 symbols completed. PLYM took 1.6s. Estimated remaining: 3m 57s. Rate: 154.7 symbols/min [2025-09-19T22:25:01.034174] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:01.050572] [DEBUG] [LOCAL ] PMO: Loaded 10805 existing records from primary storage. [2025-09-19T22:25:01.050934] [INFO ] [MAIN ] PMO: Loaded 10805 primary data records. [2025-09-19T22:25:01.146135] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:01.168461] [INFO ] [MAIN ] PML: Generated 1820 derivative records from 20606 primary records. [2025-09-19T22:25:01.168671] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-19T22:25:01.187249] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:01.188232] [INFO ] [MAIN ] PMM: Generated 1820 derivative records from 10862 primary records. [2025-09-19T22:25:01.205478] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-19T22:25:01.246476] [DEBUG] [LOCAL ] PML: Derivative data saved (1820 records). [2025-09-19T22:25:01.286814] [DEBUG] [LOCAL ] PMM: Derivative data saved (1820 records). [2025-09-19T22:25:01.292538] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-19T22:25:01.286711] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-19T22:25:01.418056] [INFO ] [MAIN ] Derivative Progress: 1483/2093 symbols completed. PML took 1.3s. Estimated remaining: 3m 57s. Rate: 154.7 symbols/min [2025-09-19T22:25:01.429935] [INFO ] [MAIN ] Derivative Progress: 1484/2093 symbols completed. PMM took 1.1s. Estimated remaining: 3m 56s. Rate: 154.8 symbols/min [2025-09-19T22:25:01.454174] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:01.454988] [INFO ] [MAIN ] PMO: Generated 1820 derivative records from 10805 primary records. [2025-09-19T22:25:01.455053] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-19T22:25:01.474070] [DEBUG] [LOCAL ] PMO: Derivative data saved (1820 records). [2025-09-19T22:25:01.474228] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-19T22:25:01.477163] [INFO ] [MAIN ] Derivative Progress: 1485/2093 symbols completed. PMO took 0.4s. Estimated remaining: 3m 56s. Rate: 154.9 symbols/min [2025-09-19T22:25:01.477796] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:01.478136] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:01.478044] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:01.488569] [DEBUG] [LOCAL ] PNI: Loaded 6860 existing records from primary storage. [2025-09-19T22:25:01.488733] [INFO ] [MAIN ] PNI: Loaded 6860 primary data records. [2025-09-19T22:25:01.810614] [DEBUG] [LOCAL ] PNNT: Loaded 33466 existing records from primary storage. [2025-09-19T22:25:01.848321] [DEBUG] [LOCAL ] PMT: Loaded 40944 existing records from primary storage. [2025-09-19T22:25:01.848440] [INFO ] [MAIN ] PMT: Loaded 40944 primary data records. [2025-09-19T22:25:01.847694] [INFO ] [MAIN ] PNNT: Loaded 33466 primary data records. [2025-09-19T22:25:02.501520] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:02.503004] [INFO ] [MAIN ] PNI: Generated 1820 derivative records from 6860 primary records. [2025-09-19T22:25:02.503231] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-19T22:25:02.529432] [DEBUG] [LOCAL ] PNI: Derivative data saved (1820 records). [2025-09-19T22:25:02.529738] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-19T22:25:02.532494] [INFO ] [MAIN ] Derivative Progress: 1486/2093 symbols completed. PNI took 1.1s. Estimated remaining: 3m 55s. Rate: 154.7 symbols/min [2025-09-19T22:25:02.541398] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:02.547347] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:02.549199] [INFO ] [MAIN ] PMT: Generated 1820 derivative records from 40944 primary records. [2025-09-19T22:25:02.549559] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-19T22:25:02.571519] [DEBUG] [LOCAL ] PMT: Derivative data saved (1820 records). [2025-09-19T22:25:02.584748] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:02.584379] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-19T22:25:02.587996] [INFO ] [MAIN ] Derivative Progress: 1487/2093 symbols completed. PMT took 1.1s. Estimated remaining: 3m 55s. Rate: 154.8 symbols/min [2025-09-19T22:25:02.585524] [INFO ] [MAIN ] PNNT: Generated 1820 derivative records from 33466 primary records. [2025-09-19T22:25:02.588569] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-19T22:25:02.588451] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:02.609974] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1820 records). [2025-09-19T22:25:02.610118] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-19T22:25:02.612738] [INFO ] [MAIN ] Derivative Progress: 1488/2093 symbols completed. PNNT took 1.1s. Estimated remaining: 3m 54s. Rate: 154.9 symbols/min [2025-09-19T22:25:02.613314] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:02.649310] [DEBUG] [LOCAL ] PNW: Loaded 46778 existing records from primary storage. [2025-09-19T22:25:02.649663] [INFO ] [MAIN ] PNW: Loaded 46778 primary data records. [2025-09-19T22:25:02.790381] [DEBUG] [LOCAL ] POST: Loaded 39517 existing records from primary storage. [2025-09-19T22:25:02.795940] [INFO ] [MAIN ] POST: Loaded 39517 primary data records. [2025-09-19T22:25:02.889444] [DEBUG] [LOCAL ] POR: Loaded 47675 existing records from primary storage. [2025-09-19T22:25:02.932565] [INFO ] [MAIN ] POR: Loaded 47675 primary data records. [2025-09-19T22:25:03.672236] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:03.673572] [INFO ] [MAIN ] PNW: Generated 1820 derivative records from 46778 primary records. [2025-09-19T22:25:03.673756] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-19T22:25:03.687181] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:03.699107] [INFO ] [MAIN ] POST: Generated 1820 derivative records from 39517 primary records. [2025-09-19T22:25:03.699381] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-19T22:25:03.704331] [DEBUG] [LOCAL ] PNW: Derivative data saved (1820 records). [2025-09-19T22:25:03.704632] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-19T22:25:03.707158] [INFO ] [MAIN ] Derivative Progress: 1489/2093 symbols completed. PNW took 1.2s. Estimated remaining: 3m 54s. Rate: 154.7 symbols/min [2025-09-19T22:25:03.714857] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:03.725752] [DEBUG] [LOCAL ] POST: Derivative data saved (1820 records). [2025-09-19T22:25:03.725942] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-19T22:25:03.736450] [INFO ] [MAIN ] Derivative Progress: 1490/2093 symbols completed. POST took 1.1s. Estimated remaining: 3m 54s. Rate: 154.8 symbols/min [2025-09-19T22:25:03.742561] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:03.743506] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:03.744399] [INFO ] [MAIN ] POR: Generated 1820 derivative records from 47675 primary records. [2025-09-19T22:25:03.744622] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-19T22:25:03.764678] [DEBUG] [LOCAL ] POR: Derivative data saved (1820 records). [2025-09-19T22:25:03.764931] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-19T22:25:03.773341] [INFO ] [MAIN ] Derivative Progress: 1491/2093 symbols completed. POR took 1.2s. Estimated remaining: 3m 53s. Rate: 154.9 symbols/min [2025-09-19T22:25:03.773813] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:03.783207] [DEBUG] [LOCAL ] PPT: Loaded 20609 existing records from primary storage. [2025-09-19T22:25:03.783373] [INFO ] [MAIN ] PPT: Loaded 20609 primary data records. [2025-09-19T22:25:04.118710] [DEBUG] [LOCAL ] PPG: Loaded 51474 existing records from primary storage. [2025-09-19T22:25:04.119740] [INFO ] [MAIN ] PPG: Loaded 51474 primary data records. [2025-09-19T22:25:04.269936] [DEBUG] [LOCAL ] PR: Loaded 54389 existing records from primary storage. [2025-09-19T22:25:04.276623] [INFO ] [MAIN ] PR: Loaded 54389 primary data records. [2025-09-19T22:25:04.837870] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:04.839442] [INFO ] [MAIN ] PPT: Generated 1820 derivative records from 20609 primary records. [2025-09-19T22:25:04.841632] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-19T22:25:04.858507] [DEBUG] [LOCAL ] PPT: Derivative data saved (1820 records). [2025-09-19T22:25:04.859261] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-19T22:25:04.863888] [INFO ] [MAIN ] Derivative Progress: 1492/2093 symbols completed. PPT took 1.1s. Estimated remaining: 3m 53s. Rate: 154.7 symbols/min [2025-09-19T22:25:04.865190] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:04.879767] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:04.880519] [INFO ] [MAIN ] PPG: Generated 1820 derivative records from 51474 primary records. [2025-09-19T22:25:04.880839] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-19T22:25:04.919022] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:04.919129] [DEBUG] [LOCAL ] PPG: Derivative data saved (1820 records). [2025-09-19T22:25:04.928055] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-19T22:25:04.927939] [INFO ] [MAIN ] PR: Generated 1820 derivative records from 54389 primary records. [2025-09-19T22:25:04.930455] [INFO ] [MAIN ] Derivative Progress: 1493/2093 symbols completed. PPG took 1.2s. Estimated remaining: 3m 53s. Rate: 154.8 symbols/min [2025-09-19T22:25:04.930885] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:04.930834] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-19T22:25:04.948360] [DEBUG] [LOCAL ] PR: Derivative data saved (1820 records). [2025-09-19T22:25:04.957510] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-19T22:25:04.961149] [INFO ] [MAIN ] Derivative Progress: 1494/2093 symbols completed. PR took 1.2s. Estimated remaining: 3m 52s. Rate: 154.9 symbols/min [2025-09-19T22:25:04.961545] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:04.963243] [DEBUG] [LOCAL ] PRA: Loaded 35074 existing records from primary storage. [2025-09-19T22:25:04.963844] [INFO ] [MAIN ] PRA: Loaded 35074 primary data records. [2025-09-19T22:25:05.122612] [DEBUG] [LOCAL ] PRG: Loaded 30917 existing records from primary storage. [2025-09-19T22:25:05.153079] [INFO ] [MAIN ] PRG: Loaded 30917 primary data records. [2025-09-19T22:25:05.489163] [DEBUG] [LOCAL ] PRGO: Loaded 47667 existing records from primary storage. [2025-09-19T22:25:05.544562] [INFO ] [MAIN ] PRGO: Loaded 47667 primary data records. [2025-09-19T22:25:06.003127] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:06.004214] [INFO ] [MAIN ] PRA: Generated 1820 derivative records from 35074 primary records. [2025-09-19T22:25:06.004572] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-19T22:25:06.018289] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:06.019473] [INFO ] [MAIN ] PRG: Generated 1820 derivative records from 30917 primary records. [2025-09-19T22:25:06.019604] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-19T22:25:06.049120] [DEBUG] [LOCAL ] PRA: Derivative data saved (1820 records). [2025-09-19T22:25:06.051060] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-19T22:25:06.056300] [INFO ] [MAIN ] Derivative Progress: 1495/2093 symbols completed. PRA took 1.2s. Estimated remaining: 3m 52s. Rate: 154.7 symbols/min [2025-09-19T22:25:06.058100] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:06.057698] [DEBUG] [LOCAL ] PRG: Derivative data saved (1820 records). [2025-09-19T22:25:06.058448] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-19T22:25:06.061748] [INFO ] [MAIN ] Derivative Progress: 1496/2093 symbols completed. PRG took 1.1s. Estimated remaining: 3m 51s. Rate: 154.8 symbols/min [2025-09-19T22:25:06.062463] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:06.074751] [DEBUG] [LOCAL ] PRH: Loaded 5020 existing records from primary storage. [2025-09-19T22:25:06.075250] [INFO ] [MAIN ] PRH: Loaded 5020 primary data records. [2025-09-19T22:25:06.160426] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:06.184039] [INFO ] [MAIN ] PRGO: Generated 1820 derivative records from 47667 primary records. [2025-09-19T22:25:06.197124] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-19T22:25:06.218346] [DEBUG] [LOCAL ] PRI: Loaded 18684 existing records from primary storage. [2025-09-19T22:25:06.228784] [INFO ] [MAIN ] PRI: Loaded 18684 primary data records. [2025-09-19T22:25:06.364580] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1820 records). [2025-09-19T22:25:06.507044] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-19T22:25:06.540709] [INFO ] [MAIN ] Derivative Progress: 1497/2093 symbols completed. PRGO took 1.6s. Estimated remaining: 3m 51s. Rate: 154.8 symbols/min [2025-09-19T22:25:06.551006] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:06.786974] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:06.798182] [INFO ] [MAIN ] PRH: Generated 1820 derivative records from 5020 primary records. [2025-09-19T22:25:06.798373] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-19T22:25:06.815484] [DEBUG] [LOCAL ] PRH: Derivative data saved (1820 records). [2025-09-19T22:25:06.817100] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-19T22:25:06.832051] [INFO ] [MAIN ] Derivative Progress: 1498/2093 symbols completed. PRH took 0.8s. Estimated remaining: 3m 51s. Rate: 154.8 symbols/min [2025-09-19T22:25:06.846220] [DEBUG] [LOCAL ] PRIM: Loaded 45230 existing records from primary storage. [2025-09-19T22:25:06.845154] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:06.846452] [INFO ] [MAIN ] PRIM: Loaded 45230 primary data records. [2025-09-19T22:25:06.847220] [INFO ] [MAIN ] PRI: Generated 1820 derivative records from 18684 primary records. [2025-09-19T22:25:06.847318] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-19T22:25:07.199937] [DEBUG] [LOCAL ] PRI: Derivative data saved (1820 records). [2025-09-19T22:25:07.200738] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-19T22:25:07.203638] [INFO ] [MAIN ] Derivative Progress: 1499/2093 symbols completed. PRI took 1.1s. Estimated remaining: 3m 50s. Rate: 154.8 symbols/min [2025-09-19T22:25:07.228183] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:07.228894] [INFO ] [MAIN ] PRIM: Generated 1820 derivative records from 45230 primary records. [2025-09-19T22:25:07.228962] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-19T22:25:07.245966] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1820 records). [2025-09-19T22:25:07.246046] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-19T22:25:07.248673] [INFO ] [MAIN ] Derivative Progress: 1500/2093 symbols completed. PRIM took 0.7s. Estimated remaining: 3m 50s. Rate: 154.9 symbols/min [2025-09-19T22:25:07.249478] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:07.250314] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:07.249680] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:07.271482] [DEBUG] [LOCAL ] PRLB: Loaded 21223 existing records from primary storage. [2025-09-19T22:25:07.271598] [INFO ] [MAIN ] PRLB: Loaded 21223 primary data records. [2025-09-19T22:25:07.499219] [DEBUG] [LOCAL ] PRKS: Loaded 43351 existing records from primary storage. [2025-09-19T22:25:07.499540] [INFO ] [MAIN ] PRKS: Loaded 43351 primary data records. [2025-09-19T22:25:07.607953] [DEBUG] [LOCAL ] PRM: Loaded 45339 existing records from primary storage. [2025-09-19T22:25:07.616401] [INFO ] [MAIN ] PRM: Loaded 45339 primary data records. [2025-09-19T22:25:08.253814] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:08.255911] [INFO ] [MAIN ] PRLB: Generated 1820 derivative records from 21223 primary records. [2025-09-19T22:25:08.256322] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-19T22:25:08.281481] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1820 records). [2025-09-19T22:25:08.281823] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-19T22:25:08.291989] [INFO ] [MAIN ] Derivative Progress: 1501/2093 symbols completed. PRLB took 1.0s. Estimated remaining: 3m 50s. Rate: 154.7 symbols/min [2025-09-19T22:25:08.297637] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:08.297291] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:08.309937] [INFO ] [MAIN ] PRM: Generated 1820 derivative records from 45339 primary records. [2025-09-19T22:25:08.317368] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-19T22:25:08.318214] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:08.319574] [INFO ] [MAIN ] PRKS: Generated 1820 derivative records from 43351 primary records. [2025-09-19T22:25:08.330696] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-19T22:25:08.358003] [DEBUG] [LOCAL ] PRM: Derivative data saved (1820 records). [2025-09-19T22:25:08.360786] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-19T22:25:08.360696] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1820 records). [2025-09-19T22:25:08.360913] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-19T22:25:08.363065] [INFO ] [MAIN ] Derivative Progress: 1502/2093 symbols completed. PRM took 1.1s. Estimated remaining: 3m 49s. Rate: 154.8 symbols/min [2025-09-19T22:25:08.363435] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:08.366688] [INFO ] [MAIN ] Derivative Progress: 1503/2093 symbols completed. PRKS took 1.1s. Estimated remaining: 3m 49s. Rate: 154.9 symbols/min [2025-09-19T22:25:08.367214] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:08.390882] [DEBUG] [LOCAL ] PRT: Loaded 5488 existing records from primary storage. [2025-09-19T22:25:08.391092] [INFO ] [MAIN ] PRT: Loaded 5488 primary data records. [2025-09-19T22:25:08.525011] [DEBUG] [LOCAL ] PRMB: Loaded 53904 existing records from primary storage. [2025-09-19T22:25:08.536320] [INFO ] [MAIN ] PRMB: Loaded 53904 primary data records. [2025-09-19T22:25:08.619751] [DEBUG] [LOCAL ] PRO: Loaded 37833 existing records from primary storage. [2025-09-19T22:25:08.678800] [INFO ] [MAIN ] PRO: Loaded 37833 primary data records. [2025-09-19T22:25:09.440555] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:09.442408] [INFO ] [MAIN ] PRT: Generated 1820 derivative records from 5488 primary records. [2025-09-19T22:25:09.442819] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-19T22:25:09.460057] [DEBUG] [LOCAL ] PRT: Derivative data saved (1820 records). [2025-09-19T22:25:09.460354] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-19T22:25:09.462571] [INFO ] [MAIN ] Derivative Progress: 1504/2093 symbols completed. PRT took 1.1s. Estimated remaining: 3m 48s. Rate: 154.7 symbols/min [2025-09-19T22:25:09.464595] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:09.482836] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:09.484534] [INFO ] [MAIN ] PRMB: Generated 1820 derivative records from 53904 primary records. [2025-09-19T22:25:09.484750] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-19T22:25:09.510168] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:09.515255] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1820 records). [2025-09-19T22:25:09.516036] [INFO ] [MAIN ] PRO: Generated 1820 derivative records from 37833 primary records. [2025-09-19T22:25:09.516231] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-19T22:25:09.516153] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-19T22:25:09.520298] [INFO ] [MAIN ] Derivative Progress: 1505/2093 symbols completed. PRMB took 1.2s. Estimated remaining: 3m 48s. Rate: 154.8 symbols/min [2025-09-19T22:25:09.527961] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:09.538466] [DEBUG] [LOCAL ] PRO: Derivative data saved (1820 records). [2025-09-19T22:25:09.538687] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-19T22:25:09.541127] [INFO ] [MAIN ] Derivative Progress: 1506/2093 symbols completed. PRO took 1.2s. Estimated remaining: 3m 47s. Rate: 154.9 symbols/min [2025-09-19T22:25:09.541594] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:09.551466] [DEBUG] [LOCAL ] PSBD: Loaded 6916 existing records from primary storage. [2025-09-19T22:25:09.551597] [INFO ] [MAIN ] PSBD: Loaded 6916 primary data records. [2025-09-19T22:25:09.910173] [DEBUG] [LOCAL ] PRU: Loaded 52304 existing records from primary storage. [2025-09-19T22:25:09.911099] [INFO ] [MAIN ] PRU: Loaded 52304 primary data records. [2025-09-19T22:25:09.912068] [DEBUG] [LOCAL ] PSA: Loaded 42535 existing records from primary storage. [2025-09-19T22:25:09.924523] [INFO ] [MAIN ] PSA: Loaded 42535 primary data records. [2025-09-19T22:25:10.579139] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:10.581055] [INFO ] [MAIN ] PSBD: Generated 1820 derivative records from 6916 primary records. [2025-09-19T22:25:10.581158] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-19T22:25:10.599504] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1820 records). [2025-09-19T22:25:10.600857] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-19T22:25:10.603613] [INFO ] [MAIN ] Derivative Progress: 1507/2093 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 47s. Rate: 154.7 symbols/min [2025-09-19T22:25:10.605041] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:10.619804] [DEBUG] [LOCAL ] PSF: Loaded 6842 existing records from primary storage. [2025-09-19T22:25:10.620313] [INFO ] [MAIN ] PSF: Loaded 6842 primary data records. [2025-09-19T22:25:10.693053] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:10.698587] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:10.736967] [INFO ] [MAIN ] PSA: Generated 1820 derivative records from 42535 primary records. [2025-09-19T22:25:10.747364] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-19T22:25:10.754287] [INFO ] [MAIN ] PRU: Generated 1820 derivative records from 52304 primary records. [2025-09-19T22:25:10.765754] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-19T22:25:10.793159] [DEBUG] [LOCAL ] PSA: Derivative data saved (1820 records). [2025-09-19T22:25:10.813144] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-19T22:25:10.848540] [INFO ] [MAIN ] Derivative Progress: 1508/2093 symbols completed. PSA took 1.3s. Estimated remaining: 3m 47s. Rate: 154.8 symbols/min [2025-09-19T22:25:10.873557] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:10.877518] [DEBUG] [LOCAL ] PRU: Derivative data saved (1820 records). [2025-09-19T22:25:10.877730] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-19T22:25:10.883843] [INFO ] [MAIN ] Derivative Progress: 1509/2093 symbols completed. PRU took 1.4s. Estimated remaining: 3m 46s. Rate: 154.9 symbols/min [2025-09-19T22:25:10.968924] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:11.068406] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:11.069235] [INFO ] [MAIN ] PSF: Generated 1820 derivative records from 6842 primary records. [2025-09-19T22:25:11.069468] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-19T22:25:11.081062] [DEBUG] [LOCAL ] PSFE: Loaded 31222 existing records from primary storage. [2025-09-19T22:25:11.091903] [INFO ] [MAIN ] PSFE: Loaded 31222 primary data records. [2025-09-19T22:25:11.184789] [DEBUG] [LOCAL ] PSF: Derivative data saved (1820 records). [2025-09-19T22:25:11.197594] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-19T22:25:11.210831] [INFO ] [MAIN ] Derivative Progress: 1510/2093 symbols completed. PSF took 0.6s. Estimated remaining: 3m 46s. Rate: 154.9 symbols/min [2025-09-19T22:25:11.239252] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:11.246569] [DEBUG] [LOCAL ] PSN: Loaded 47118 existing records from primary storage. [2025-09-19T22:25:11.262620] [INFO ] [MAIN ] PSN: Loaded 47118 primary data records. [2025-09-19T22:25:11.808935] [DEBUG] [LOCAL ] PSO: Loaded 38334 existing records from primary storage. [2025-09-19T22:25:11.809255] [INFO ] [MAIN ] PSO: Loaded 38334 primary data records. [2025-09-19T22:25:12.151291] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:12.153324] [INFO ] [MAIN ] PSFE: Generated 1820 derivative records from 31222 primary records. [2025-09-19T22:25:12.153597] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-19T22:25:12.186809] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:12.189638] [INFO ] [MAIN ] PSN: Generated 1820 derivative records from 47118 primary records. [2025-09-19T22:25:12.190719] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-19T22:25:12.191010] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1820 records). [2025-09-19T22:25:12.191891] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-19T22:25:12.205405] [INFO ] [MAIN ] Derivative Progress: 1511/2093 symbols completed. PSFE took 1.3s. Estimated remaining: 3m 46s. Rate: 154.7 symbols/min [2025-09-19T22:25:12.206281] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:12.212787] [DEBUG] [LOCAL ] PSN: Derivative data saved (1820 records). [2025-09-19T22:25:12.213156] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-19T22:25:12.217534] [INFO ] [MAIN ] Derivative Progress: 1512/2093 symbols completed. PSN took 1.3s. Estimated remaining: 3m 45s. Rate: 154.8 symbols/min [2025-09-19T22:25:12.218779] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:12.232967] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:12.233768] [INFO ] [MAIN ] PSO: Generated 1820 derivative records from 38334 primary records. [2025-09-19T22:25:12.233923] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-19T22:25:12.260517] [DEBUG] [LOCAL ] PSO: Derivative data saved (1820 records). [2025-09-19T22:25:12.260814] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-19T22:25:12.263404] [INFO ] [MAIN ] Derivative Progress: 1513/2093 symbols completed. PSO took 1.0s. Estimated remaining: 3m 45s. Rate: 154.9 symbols/min [2025-09-19T22:25:12.276510] [DEBUG] [LOCAL ] PSQH: Loaded 35077 existing records from primary storage. [2025-09-19T22:25:12.276681] [INFO ] [MAIN ] PSQH: Loaded 35077 primary data records. [2025-09-19T22:25:12.604051] [DEBUG] [LOCAL ] PSTG: Loaded 53628 existing records from primary storage. [2025-09-19T22:25:12.604281] [INFO ] [MAIN ] PSTG: Loaded 53628 primary data records. [2025-09-19T22:25:12.991344] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:12.992393] [INFO ] [MAIN ] PSQH: Generated 1820 derivative records from 35077 primary records. [2025-09-19T22:25:12.992547] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-19T22:25:13.011356] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1820 records). [2025-09-19T22:25:13.011530] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-19T22:25:13.013862] [INFO ] [MAIN ] Derivative Progress: 1514/2093 symbols completed. PSQH took 0.8s. Estimated remaining: 3m 44s. Rate: 154.8 symbols/min [2025-09-19T22:25:13.028883] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:13.029435] [INFO ] [MAIN ] PSTG: Generated 1820 derivative records from 53628 primary records. [2025-09-19T22:25:13.029496] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-19T22:25:13.045078] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1820 records). [2025-09-19T22:25:13.045138] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-19T22:25:13.047472] [INFO ] [MAIN ] Derivative Progress: 1515/2093 symbols completed. PSTG took 0.8s. Estimated remaining: 3m 44s. Rate: 154.9 symbols/min [2025-09-19T22:25:13.048153] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:13.048348] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:13.048941] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:13.081379] [DEBUG] [LOCAL ] PSTL: Loaded 20982 existing records from primary storage. [2025-09-19T22:25:13.083016] [INFO ] [MAIN ] PSTL: Loaded 20982 primary data records. [2025-09-19T22:25:13.083796] [DEBUG] [LOCAL ] PTA: Loaded 15248 existing records from primary storage. [2025-09-19T22:25:13.095855] [INFO ] [MAIN ] PTA: Loaded 15248 primary data records. [2025-09-19T22:25:13.433634] [DEBUG] [LOCAL ] PSX: Loaded 53908 existing records from primary storage. [2025-09-19T22:25:13.710035] [INFO ] [MAIN ] PSX: Loaded 53908 primary data records. [2025-09-19T22:25:14.080132] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:14.080560] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:14.081864] [INFO ] [MAIN ] PSTL: Generated 1820 derivative records from 20982 primary records. [2025-09-19T22:25:14.082848] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-19T22:25:14.082688] [INFO ] [MAIN ] PTA: Generated 1820 derivative records from 15248 primary records. [2025-09-19T22:25:14.082987] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-19T22:25:14.110543] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1820 records). [2025-09-19T22:25:14.112135] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-19T22:25:14.117139] [INFO ] [MAIN ] Derivative Progress: 1516/2093 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 44s. Rate: 154.7 symbols/min [2025-09-19T22:25:14.117660] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:14.123276] [DEBUG] [LOCAL ] PTA: Derivative data saved (1820 records). [2025-09-19T22:25:14.124611] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-19T22:25:14.128073] [INFO ] [MAIN ] Derivative Progress: 1517/2093 symbols completed. PTA took 1.1s. Estimated remaining: 3m 43s. Rate: 154.8 symbols/min [2025-09-19T22:25:14.128501] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:14.142411] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:14.143244] [INFO ] [MAIN ] PSX: Generated 1820 derivative records from 53908 primary records. [2025-09-19T22:25:14.143484] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-19T22:25:14.161838] [DEBUG] [LOCAL ] PSX: Derivative data saved (1820 records). [2025-09-19T22:25:14.162036] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-19T22:25:14.164955] [INFO ] [MAIN ] Derivative Progress: 1518/2093 symbols completed. PSX took 1.1s. Estimated remaining: 3m 43s. Rate: 154.9 symbols/min [2025-09-19T22:25:14.165603] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:14.200457] [DEBUG] [LOCAL ] PTY: Loaded 37923 existing records from primary storage. [2025-09-19T22:25:14.200598] [INFO ] [MAIN ] PTY: Loaded 37923 primary data records. [2025-09-19T22:25:14.317745] [DEBUG] [LOCAL ] PUK: Loaded 45716 existing records from primary storage. [2025-09-19T22:25:14.328997] [INFO ] [MAIN ] PUK: Loaded 45716 primary data records. [2025-09-19T22:25:14.697617] [DEBUG] [LOCAL ] PUMP: Loaded 50240 existing records from primary storage. [2025-09-19T22:25:14.728793] [INFO ] [MAIN ] PUMP: Loaded 50240 primary data records. [2025-09-19T22:25:15.239920] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:15.241522] [INFO ] [MAIN ] PTY: Generated 1820 derivative records from 37923 primary records. [2025-09-19T22:25:15.241848] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-19T22:25:15.263222] [DEBUG] [LOCAL ] PTY: Derivative data saved (1820 records). [2025-09-19T22:25:15.263896] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-19T22:25:15.266702] [INFO ] [MAIN ] Derivative Progress: 1519/2093 symbols completed. PTY took 1.1s. Estimated remaining: 3m 43s. Rate: 154.7 symbols/min [2025-09-19T22:25:15.270365] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:15.287176] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:15.287945] [INFO ] [MAIN ] PUK: Generated 1820 derivative records from 45716 primary records. [2025-09-19T22:25:15.288120] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-19T22:25:15.305338] [DEBUG] [LOCAL ] PUK: Derivative data saved (1820 records). [2025-09-19T22:25:15.305686] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-19T22:25:15.308030] [INFO ] [MAIN ] Derivative Progress: 1520/2093 symbols completed. PUK took 1.2s. Estimated remaining: 3m 42s. Rate: 154.8 symbols/min [2025-09-19T22:25:15.310434] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:15.326981] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:15.327827] [INFO ] [MAIN ] PUMP: Generated 1820 derivative records from 50240 primary records. [2025-09-19T22:25:15.328025] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-19T22:25:15.331337] [DEBUG] [LOCAL ] PVL: Loaded 4822 existing records from primary storage. [2025-09-19T22:25:15.331659] [INFO ] [MAIN ] PVL: Loaded 4822 primary data records. [2025-09-19T22:25:15.451862] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1820 records). [2025-09-19T22:25:15.468496] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-19T22:25:15.475429] [INFO ] [MAIN ] Derivative Progress: 1521/2093 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 42s. Rate: 154.9 symbols/min [2025-09-19T22:25:15.476460] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:15.692283] [DEBUG] [LOCAL ] PVH: Loaded 51116 existing records from primary storage. [2025-09-19T22:25:15.692569] [INFO ] [MAIN ] PVH: Loaded 51116 primary data records. [2025-09-19T22:25:16.035806] [DEBUG] [LOCAL ] PWR: Loaded 48250 existing records from primary storage. [2025-09-19T22:25:16.038013] [INFO ] [MAIN ] PWR: Loaded 48250 primary data records. [2025-09-19T22:25:16.140167] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:16.163454] [INFO ] [MAIN ] PVL: Generated 1820 derivative records from 4822 primary records. [2025-09-19T22:25:16.163677] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-19T22:25:16.258679] [DEBUG] [LOCAL ] PVL: Derivative data saved (1820 records). [2025-09-19T22:25:16.258813] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-19T22:25:16.379522] [INFO ] [MAIN ] Derivative Progress: 1522/2093 symbols completed. PVL took 1.1s. Estimated remaining: 3m 41s. Rate: 154.7 symbols/min [2025-09-19T22:25:16.381168] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:16.398159] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:16.399152] [INFO ] [MAIN ] PVH: Generated 1820 derivative records from 51116 primary records. [2025-09-19T22:25:16.399383] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-19T22:25:16.417209] [DEBUG] [LOCAL ] PVH: Derivative data saved (1820 records). [2025-09-19T22:25:16.417459] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-19T22:25:16.425730] [INFO ] [MAIN ] Derivative Progress: 1523/2093 symbols completed. PVH took 1.2s. Estimated remaining: 3m 41s. Rate: 154.8 symbols/min [2025-09-19T22:25:16.426471] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:16.453319] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:16.453998] [INFO ] [MAIN ] PWR: Generated 1820 derivative records from 48250 primary records. [2025-09-19T22:25:16.454062] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-19T22:25:16.486997] [DEBUG] [LOCAL ] PWR: Derivative data saved (1820 records). [2025-09-19T22:25:16.487827] [DEBUG] [LOCAL ] PX: Loaded 35302 existing records from primary storage. [2025-09-19T22:25:16.487942] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-19T22:25:16.490310] [INFO ] [MAIN ] Derivative Progress: 1524/2093 symbols completed. PWR took 1.0s. Estimated remaining: 3m 40s. Rate: 154.9 symbols/min [2025-09-19T22:25:16.490741] [INFO ] [MAIN ] PX: Loaded 35302 primary data records. [2025-09-19T22:25:16.490592] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:16.593616] [DEBUG] [LOCAL ] QD: Loaded 28413 existing records from primary storage. [2025-09-19T22:25:16.606399] [INFO ] [MAIN ] QD: Loaded 28413 primary data records. [2025-09-19T22:25:17.021180] [DEBUG] [LOCAL ] QGEN: Loaded 49909 existing records from primary storage. [2025-09-19T22:25:17.167206] [INFO ] [MAIN ] QGEN: Loaded 49909 primary data records. [2025-09-19T22:25:17.516542] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:17.518454] [INFO ] [MAIN ] PX: Generated 1820 derivative records from 35302 primary records. [2025-09-19T22:25:17.518920] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-19T22:25:17.552357] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:17.554996] [INFO ] [MAIN ] QD: Generated 1820 derivative records from 28413 primary records. [2025-09-19T22:25:17.555390] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-19T22:25:17.558467] [DEBUG] [LOCAL ] PX: Derivative data saved (1820 records). [2025-09-19T22:25:17.565980] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-19T22:25:17.570253] [INFO ] [MAIN ] Derivative Progress: 1525/2093 symbols completed. PX took 1.2s. Estimated remaining: 3m 40s. Rate: 154.7 symbols/min [2025-09-19T22:25:17.577426] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:17.578866] [DEBUG] [LOCAL ] QD: Derivative data saved (1820 records). [2025-09-19T22:25:17.579532] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-19T22:25:17.582266] [INFO ] [MAIN ] Derivative Progress: 1526/2093 symbols completed. QD took 1.2s. Estimated remaining: 3m 40s. Rate: 154.8 symbols/min [2025-09-19T22:25:17.582746] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:17.600393] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:17.601193] [INFO ] [MAIN ] QGEN: Generated 1820 derivative records from 49909 primary records. [2025-09-19T22:25:17.601254] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-19T22:25:17.619084] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1820 records). [2025-09-19T22:25:17.619230] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-19T22:25:17.621533] [INFO ] [MAIN ] Derivative Progress: 1527/2093 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 39s. Rate: 154.9 symbols/min [2025-09-19T22:25:17.621931] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:17.686109] [DEBUG] [LOCAL ] QTWO: Loaded 39758 existing records from primary storage. [2025-09-19T22:25:17.702323] [INFO ] [MAIN ] QTWO: Loaded 39758 primary data records. [2025-09-19T22:25:17.704028] [DEBUG] [LOCAL ] QS: Loaded 54522 existing records from primary storage. [2025-09-19T22:25:17.739612] [INFO ] [MAIN ] QS: Loaded 54522 primary data records. [2025-09-19T22:25:17.787412] [DEBUG] [LOCAL ] QSR: Loaded 53169 existing records from primary storage. [2025-09-19T22:25:17.817421] [INFO ] [MAIN ] QSR: Loaded 53169 primary data records. [2025-09-19T22:25:18.700209] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:18.702459] [INFO ] [MAIN ] QTWO: Generated 1820 derivative records from 39758 primary records. [2025-09-19T22:25:18.704972] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-19T22:25:18.743499] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:18.743204] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:18.747726] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1820 records). [2025-09-19T22:25:18.749334] [INFO ] [MAIN ] QSR: Generated 1820 derivative records from 53169 primary records. [2025-09-19T22:25:18.749519] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-19T22:25:18.748695] [INFO ] [MAIN ] QS: Generated 1820 derivative records from 54522 primary records. [2025-09-19T22:25:18.749673] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-19T22:25:18.749431] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-19T22:25:18.753099] [INFO ] [MAIN ] Derivative Progress: 1528/2093 symbols completed. QTWO took 1.1s. Estimated remaining: 3m 39s. Rate: 154.7 symbols/min [2025-09-19T22:25:18.788853] [DEBUG] [LOCAL ] QS: Derivative data saved (1820 records). [2025-09-19T22:25:18.789750] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-19T22:25:18.793484] [INFO ] [MAIN ] Derivative Progress: 1529/2093 symbols completed. QS took 1.2s. Estimated remaining: 3m 39s. Rate: 154.8 symbols/min [2025-09-19T22:25:18.790290] [DEBUG] [LOCAL ] QSR: Derivative data saved (1820 records). [2025-09-19T22:25:18.793870] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-19T22:25:18.796524] [INFO ] [MAIN ] Derivative Progress: 1530/2093 symbols completed. QSR took 1.2s. Estimated remaining: 3m 38s. Rate: 154.9 symbols/min [2025-09-19T22:25:18.797472] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:18.797245] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:18.797326] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:18.805570] [DEBUG] [LOCAL ] QVCD: Loaded 4688 existing records from primary storage. [2025-09-19T22:25:18.808479] [INFO ] [MAIN ] QVCD: Loaded 4688 primary data records. [2025-09-19T22:25:18.895867] [DEBUG] [LOCAL ] QVCC: Loaded 9212 existing records from primary storage. [2025-09-19T22:25:18.919564] [INFO ] [MAIN ] QVCC: Loaded 9212 primary data records. [2025-09-19T22:25:19.011442] [DEBUG] [LOCAL ] QUAD: Loaded 24482 existing records from primary storage. [2025-09-19T22:25:19.023410] [INFO ] [MAIN ] QUAD: Loaded 24482 primary data records. [2025-09-19T22:25:19.823500] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:19.824745] [INFO ] [MAIN ] QVCC: Generated 1820 derivative records from 9212 primary records. [2025-09-19T22:25:19.824901] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-19T22:25:19.822782] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:19.827067] [INFO ] [MAIN ] QVCD: Generated 1820 derivative records from 4688 primary records. [2025-09-19T22:25:19.827527] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-19T22:25:19.851579] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1820 records). [2025-09-19T22:25:19.857743] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-19T22:25:19.862979] [INFO ] [MAIN ] Derivative Progress: 1531/2093 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 38s. Rate: 154.7 symbols/min [2025-09-19T22:25:19.860481] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1820 records). [2025-09-19T22:25:19.863611] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-19T22:25:19.866008] [INFO ] [MAIN ] Derivative Progress: 1532/2093 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 37s. Rate: 154.8 symbols/min [2025-09-19T22:25:19.866157] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:19.874866] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:19.880350] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:19.881565] [INFO ] [MAIN ] QUAD: Generated 1820 derivative records from 24482 primary records. [2025-09-19T22:25:19.881795] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-19T22:25:19.898159] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1820 records). [2025-09-19T22:25:19.898432] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-19T22:25:19.900808] [INFO ] [MAIN ] Derivative Progress: 1533/2093 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 37s. Rate: 154.9 symbols/min [2025-09-19T22:25:19.901190] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:19.954256] [DEBUG] [LOCAL ] RA: Loaded 22056 existing records from primary storage. [2025-09-19T22:25:19.954861] [DEBUG] [LOCAL ] R: Loaded 30258 existing records from primary storage. [2025-09-19T22:25:19.954957] [INFO ] [MAIN ] R: Loaded 30258 primary data records. [2025-09-19T22:25:19.955033] [INFO ] [MAIN ] RA: Loaded 22056 primary data records. [2025-09-19T22:25:20.179154] [DEBUG] [LOCAL ] QXO: Loaded 53922 existing records from primary storage. [2025-09-19T22:25:20.190351] [INFO ] [MAIN ] QXO: Loaded 53922 primary data records. [2025-09-19T22:25:20.990855] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:20.992181] [INFO ] [MAIN ] RA: Generated 1820 derivative records from 22056 primary records. [2025-09-19T22:25:21.000281] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-19T22:25:21.007100] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:21.021027] [INFO ] [MAIN ] R: Generated 1820 derivative records from 30258 primary records. [2025-09-19T22:25:21.021884] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-19T22:25:21.054939] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:21.056970] [INFO ] [MAIN ] QXO: Generated 1820 derivative records from 53922 primary records. [2025-09-19T22:25:21.059548] [DEBUG] [LOCAL ] R: Derivative data saved (1820 records). [2025-09-19T22:25:21.058862] [DEBUG] [LOCAL ] RA: Derivative data saved (1820 records). [2025-09-19T22:25:21.059775] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-19T22:25:21.057757] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-19T22:25:21.062897] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-19T22:25:21.062806] [INFO ] [MAIN ] Derivative Progress: 1534/2093 symbols completed. RA took 1.2s. Estimated remaining: 3m 37s. Rate: 154.7 symbols/min [2025-09-19T22:25:21.066103] [INFO ] [MAIN ] Derivative Progress: 1535/2093 symbols completed. R took 1.2s. Estimated remaining: 3m 36s. Rate: 154.8 symbols/min [2025-09-19T22:25:21.065725] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:21.073799] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:21.083535] [DEBUG] [LOCAL ] QXO: Derivative data saved (1820 records). [2025-09-19T22:25:21.083758] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-19T22:25:21.086253] [INFO ] [MAIN ] Derivative Progress: 1536/2093 symbols completed. QXO took 1.2s. Estimated remaining: 3m 36s. Rate: 154.9 symbols/min [2025-09-19T22:25:21.087059] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:21.129884] [DEBUG] [LOCAL ] RACE: Loaded 33652 existing records from primary storage. [2025-09-19T22:25:21.139154] [INFO ] [MAIN ] RACE: Loaded 33652 primary data records. [2025-09-19T22:25:21.273231] [DEBUG] [LOCAL ] RAMP: Loaded 38311 existing records from primary storage. [2025-09-19T22:25:21.274332] [DEBUG] [LOCAL ] RBA: Loaded 46765 existing records from primary storage. [2025-09-19T22:25:21.275049] [INFO ] [MAIN ] RBA: Loaded 46765 primary data records. [2025-09-19T22:25:21.274572] [INFO ] [MAIN ] RAMP: Loaded 38311 primary data records. [2025-09-19T22:25:22.157871] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:22.158761] [INFO ] [MAIN ] RACE: Generated 1820 derivative records from 33652 primary records. [2025-09-19T22:25:22.158949] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-19T22:25:22.178444] [DEBUG] [LOCAL ] RACE: Derivative data saved (1820 records). [2025-09-19T22:25:22.178585] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-19T22:25:22.180467] [INFO ] [MAIN ] Derivative Progress: 1537/2093 symbols completed. RACE took 1.1s. Estimated remaining: 3m 36s. Rate: 154.8 symbols/min [2025-09-19T22:25:22.181323] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:22.203231] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:22.204567] [INFO ] [MAIN ] RAMP: Generated 1820 derivative records from 38311 primary records. [2025-09-19T22:25:22.208782] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-19T22:25:22.222848] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:22.231414] [INFO ] [MAIN ] RBA: Generated 1820 derivative records from 46765 primary records. [2025-09-19T22:25:22.232608] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-19T22:25:22.245591] [DEBUG] [LOCAL ] RBC: Loaded 15224 existing records from primary storage. [2025-09-19T22:25:22.245731] [INFO ] [MAIN ] RBC: Loaded 15224 primary data records. [2025-09-19T22:25:22.245283] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1820 records). [2025-09-19T22:25:22.246082] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-19T22:25:22.255972] [INFO ] [MAIN ] Derivative Progress: 1538/2093 symbols completed. RAMP took 1.2s. Estimated remaining: 3m 35s. Rate: 154.8 symbols/min [2025-09-19T22:25:22.278234] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:22.343958] [DEBUG] [LOCAL ] RBA: Derivative data saved (1820 records). [2025-09-19T22:25:22.354459] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-19T22:25:22.356962] [INFO ] [MAIN ] Derivative Progress: 1539/2093 symbols completed. RBA took 1.3s. Estimated remaining: 3m 35s. Rate: 154.9 symbols/min [2025-09-19T22:25:22.375856] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:22.439437] [DEBUG] [LOCAL ] RBOT: Loaded 5197 existing records from primary storage. [2025-09-19T22:25:22.440261] [INFO ] [MAIN ] RBOT: Loaded 5197 primary data records. [2025-09-19T22:25:22.781579] [DEBUG] [LOCAL ] RBLX: Loaded 54502 existing records from primary storage. [2025-09-19T22:25:22.938245] [INFO ] [MAIN ] RBLX: Loaded 54502 primary data records. [2025-09-19T22:25:23.193049] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:23.297750] [INFO ] [MAIN ] RBC: Generated 1820 derivative records from 15224 primary records. [2025-09-19T22:25:23.312041] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-19T22:25:23.333135] [DEBUG] [LOCAL ] RBC: Derivative data saved (1820 records). [2025-09-19T22:25:23.333979] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-19T22:25:23.336231] [INFO ] [MAIN ] Derivative Progress: 1540/2093 symbols completed. RBC took 1.2s. Estimated remaining: 3m 34s. Rate: 154.8 symbols/min [2025-09-19T22:25:23.336782] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:23.350195] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:23.351438] [INFO ] [MAIN ] RBOT: Generated 1820 derivative records from 5197 primary records. [2025-09-19T22:25:23.351965] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-19T22:25:23.368261] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1820 records). [2025-09-19T22:25:23.368524] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-19T22:25:23.370710] [INFO ] [MAIN ] Derivative Progress: 1541/2093 symbols completed. RBOT took 1.0s. Estimated remaining: 3m 34s. Rate: 154.8 symbols/min [2025-09-19T22:25:23.371181] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:23.389618] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:23.390472] [INFO ] [MAIN ] RBLX: Generated 1820 derivative records from 54502 primary records. [2025-09-19T22:25:23.390534] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-19T22:25:23.407116] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1820 records). [2025-09-19T22:25:23.407362] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-19T22:25:23.409943] [INFO ] [MAIN ] Derivative Progress: 1542/2093 symbols completed. RBLX took 1.1s. Estimated remaining: 3m 33s. Rate: 154.9 symbols/min [2025-09-19T22:25:23.410290] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:23.456638] [DEBUG] [LOCAL ] RBRK: Loaded 53851 existing records from primary storage. [2025-09-19T22:25:23.457451] [INFO ] [MAIN ] RBRK: Loaded 53851 primary data records. [2025-09-19T22:25:23.515236] [DEBUG] [LOCAL ] RC: Loaded 49839 existing records from primary storage. [2025-09-19T22:25:23.542767] [INFO ] [MAIN ] RC: Loaded 49839 primary data records. [2025-09-19T22:25:23.794073] [DEBUG] [LOCAL ] RCI: Loaded 49535 existing records from primary storage. [2025-09-19T22:25:23.988569] [INFO ] [MAIN ] RCI: Loaded 49535 primary data records. [2025-09-19T22:25:24.462522] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:24.464286] [INFO ] [MAIN ] RBRK: Generated 1820 derivative records from 53851 primary records. [2025-09-19T22:25:24.465858] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-19T22:25:24.499129] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1820 records). [2025-09-19T22:25:24.499295] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-19T22:25:24.498544] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:24.502845] [INFO ] [MAIN ] Derivative Progress: 1543/2093 symbols completed. RBRK took 1.2s. Estimated remaining: 3m 33s. Rate: 154.8 symbols/min [2025-09-19T22:25:24.504249] [INFO ] [MAIN ] RC: Generated 1820 derivative records from 49839 primary records. [2025-09-19T22:25:24.504574] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-19T22:25:24.520734] [DEBUG] [LOCAL ] RC: Derivative data saved (1820 records). [2025-09-19T22:25:24.520925] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-19T22:25:24.523137] [INFO ] [MAIN ] Derivative Progress: 1544/2093 symbols completed. RC took 1.2s. Estimated remaining: 3m 33s. Rate: 154.8 symbols/min [2025-09-19T22:25:24.538037] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:24.538575] [INFO ] [MAIN ] RCI: Generated 1820 derivative records from 49535 primary records. [2025-09-19T22:25:24.538634] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-19T22:25:24.554073] [DEBUG] [LOCAL ] RCI: Derivative data saved (1820 records). [2025-09-19T22:25:24.554140] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-19T22:25:24.556527] [INFO ] [MAIN ] Derivative Progress: 1545/2093 symbols completed. RCI took 1.1s. Estimated remaining: 3m 32s. Rate: 154.9 symbols/min [2025-09-19T22:25:24.557094] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:24.557271] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:24.557726] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:24.571308] [DEBUG] [LOCAL ] RCS: Loaded 11739 existing records from primary storage. [2025-09-19T22:25:24.571441] [INFO ] [MAIN ] RCS: Loaded 11739 primary data records. [2025-09-19T22:25:24.918726] [DEBUG] [LOCAL ] RCUS: Loaded 43509 existing records from primary storage. [2025-09-19T22:25:24.919036] [INFO ] [MAIN ] RCUS: Loaded 43509 primary data records. [2025-09-19T22:25:25.042863] [DEBUG] [LOCAL ] RDDT: Loaded 54564 existing records from primary storage. [2025-09-19T22:25:25.064206] [INFO ] [MAIN ] RDDT: Loaded 54564 primary data records. [2025-09-19T22:25:25.619893] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:25.620919] [INFO ] [MAIN ] RCS: Generated 1820 derivative records from 11739 primary records. [2025-09-19T22:25:25.621807] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-19T22:25:25.641751] [DEBUG] [LOCAL ] RCS: Derivative data saved (1820 records). [2025-09-19T22:25:25.641944] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-19T22:25:25.644201] [INFO ] [MAIN ] Derivative Progress: 1546/2093 symbols completed. RCS took 1.1s. Estimated remaining: 3m 32s. Rate: 154.8 symbols/min [2025-09-19T22:25:25.644872] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:25.663858] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:25.664725] [INFO ] [MAIN ] RCUS: Generated 1820 derivative records from 43509 primary records. [2025-09-19T22:25:25.664820] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-19T22:25:25.700194] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1820 records). [2025-09-19T22:25:25.700013] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:25.701061] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-19T22:25:25.700996] [INFO ] [MAIN ] RDDT: Generated 1820 derivative records from 54564 primary records. [2025-09-19T22:25:25.703412] [INFO ] [MAIN ] Derivative Progress: 1547/2093 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 32s. Rate: 154.8 symbols/min [2025-09-19T22:25:25.703497] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-19T22:25:25.715456] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:25.734244] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1820 records). [2025-09-19T22:25:25.734558] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-19T22:25:25.737053] [INFO ] [MAIN ] Derivative Progress: 1548/2093 symbols completed. RDDT took 1.2s. Estimated remaining: 3m 31s. Rate: 154.9 symbols/min [2025-09-19T22:25:25.750589] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:25.751324] [DEBUG] [LOCAL ] RDN: Loaded 45916 existing records from primary storage. [2025-09-19T22:25:25.751775] [INFO ] [MAIN ] RDN: Loaded 45916 primary data records. [2025-09-19T22:25:26.107499] [DEBUG] [LOCAL ] RDW: Loaded 52768 existing records from primary storage. [2025-09-19T22:25:26.108438] [INFO ] [MAIN ] RDW: Loaded 52768 primary data records. [2025-09-19T22:25:26.209090] [DEBUG] [LOCAL ] RDY: Loaded 47591 existing records from primary storage. [2025-09-19T22:25:26.221929] [INFO ] [MAIN ] RDY: Loaded 47591 primary data records. [2025-09-19T22:25:26.764326] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:26.767182] [INFO ] [MAIN ] RDN: Generated 1820 derivative records from 45916 primary records. [2025-09-19T22:25:26.768073] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-19T22:25:26.789013] [DEBUG] [LOCAL ] RDN: Derivative data saved (1820 records). [2025-09-19T22:25:26.789480] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-19T22:25:26.792338] [INFO ] [MAIN ] Derivative Progress: 1549/2093 symbols completed. RDN took 1.1s. Estimated remaining: 3m 31s. Rate: 154.8 symbols/min [2025-09-19T22:25:26.792767] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:26.810769] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:25:26.811786] [INFO ] [MAIN ] RDW: Generated 1819 derivative records from 52768 primary records. [2025-09-19T22:25:26.811987] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-19T22:25:26.852629] [DEBUG] [LOCAL ] RDW: Derivative data saved (1819 records). [2025-09-19T22:25:26.853366] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:26.854342] [INFO ] [MAIN ] RDY: Generated 1820 derivative records from 47591 primary records. [2025-09-19T22:25:26.854448] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-19T22:25:26.856590] [INFO ] [MAIN ] Derivative Progress: 1550/2093 symbols completed. RDW took 1.1s. Estimated remaining: 3m 30s. Rate: 154.8 symbols/min [2025-09-19T22:25:26.857177] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:26.856935] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-19T22:25:26.885892] [DEBUG] [LOCAL ] RDY: Derivative data saved (1820 records). [2025-09-19T22:25:26.886101] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-19T22:25:26.888794] [INFO ] [MAIN ] Derivative Progress: 1551/2093 symbols completed. RDY took 1.1s. Estimated remaining: 3m 30s. Rate: 154.9 symbols/min [2025-09-19T22:25:26.889118] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:26.908183] [DEBUG] [LOCAL ] RELX: Loaded 48561 existing records from primary storage. [2025-09-19T22:25:26.908407] [INFO ] [MAIN ] RELX: Loaded 48561 primary data records. [2025-09-19T22:25:27.055590] [DEBUG] [LOCAL ] RERE: Loaded 41496 existing records from primary storage. [2025-09-19T22:25:27.077636] [INFO ] [MAIN ] RERE: Loaded 41496 primary data records. [2025-09-19T22:25:27.434561] [DEBUG] [LOCAL ] RES: Loaded 48259 existing records from primary storage. [2025-09-19T22:25:27.446587] [INFO ] [MAIN ] RES: Loaded 48259 primary data records. [2025-09-19T22:25:27.985964] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:27.987469] [INFO ] [MAIN ] RELX: Generated 1820 derivative records from 48561 primary records. [2025-09-19T22:25:27.987787] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-19T22:25:28.011051] [DEBUG] [LOCAL ] RELX: Derivative data saved (1820 records). [2025-09-19T22:25:28.020030] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-19T22:25:28.026907] [INFO ] [MAIN ] Derivative Progress: 1552/2093 symbols completed. RELX took 1.2s. Estimated remaining: 3m 30s. Rate: 154.7 symbols/min [2025-09-19T22:25:28.027428] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:28.028733] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:28.030043] [INFO ] [MAIN ] RERE: Generated 1820 derivative records from 41496 primary records. [2025-09-19T22:25:28.030420] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-19T22:25:28.064175] [DEBUG] [LOCAL ] RERE: Derivative data saved (1820 records). [2025-09-19T22:25:28.064689] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-19T22:25:28.067398] [INFO ] [MAIN ] Derivative Progress: 1553/2093 symbols completed. RERE took 1.2s. Estimated remaining: 3m 29s. Rate: 154.8 symbols/min [2025-09-19T22:25:28.064924] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:28.067793] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:28.068772] [INFO ] [MAIN ] RES: Generated 1820 derivative records from 48259 primary records. [2025-09-19T22:25:28.069319] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-19T22:25:28.087425] [DEBUG] [LOCAL ] RES: Derivative data saved (1820 records). [2025-09-19T22:25:28.087585] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-19T22:25:28.090163] [INFO ] [MAIN ] Derivative Progress: 1554/2093 symbols completed. RES took 1.2s. Estimated remaining: 3m 29s. Rate: 154.9 symbols/min [2025-09-19T22:25:28.094988] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:28.112330] [DEBUG] [LOCAL ] REX: Loaded 14095 existing records from primary storage. [2025-09-19T22:25:28.112506] [INFO ] [MAIN ] REX: Loaded 14095 primary data records. [2025-09-19T22:25:28.259908] [DEBUG] [LOCAL ] REVG: Loaded 41886 existing records from primary storage. [2025-09-19T22:25:28.260198] [INFO ] [MAIN ] REVG: Loaded 41886 primary data records. [2025-09-19T22:25:28.634364] [DEBUG] [LOCAL ] REXR: Loaded 52797 existing records from primary storage. [2025-09-19T22:25:28.645818] [INFO ] [MAIN ] REXR: Loaded 52797 primary data records. [2025-09-19T22:25:29.219678] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:29.221455] [INFO ] [MAIN ] REX: Generated 1820 derivative records from 14095 primary records. [2025-09-19T22:25:29.221688] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-19T22:25:29.241482] [DEBUG] [LOCAL ] REX: Derivative data saved (1820 records). [2025-09-19T22:25:29.241827] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-19T22:25:29.243966] [INFO ] [MAIN ] Derivative Progress: 1555/2093 symbols completed. REX took 1.2s. Estimated remaining: 3m 29s. Rate: 154.7 symbols/min [2025-09-19T22:25:29.258550] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:29.259139] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:29.260301] [INFO ] [MAIN ] REVG: Generated 1820 derivative records from 41886 primary records. [2025-09-19T22:25:29.260795] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-19T22:25:29.294742] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:29.294343] [DEBUG] [LOCAL ] REVG: Derivative data saved (1820 records). [2025-09-19T22:25:29.295822] [INFO ] [MAIN ] REXR: Generated 1820 derivative records from 52797 primary records. [2025-09-19T22:25:29.295962] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-19T22:25:29.296320] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-19T22:25:29.298728] [INFO ] [MAIN ] Derivative Progress: 1556/2093 symbols completed. REVG took 1.3s. Estimated remaining: 3m 28s. Rate: 154.8 symbols/min [2025-09-19T22:25:29.299089] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:29.316845] [DEBUG] [LOCAL ] REXR: Derivative data saved (1820 records). [2025-09-19T22:25:29.317048] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-19T22:25:29.319926] [INFO ] [MAIN ] Derivative Progress: 1557/2093 symbols completed. REXR took 1.2s. Estimated remaining: 3m 28s. Rate: 154.9 symbols/min [2025-09-19T22:25:29.320411] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:29.344570] [DEBUG] [LOCAL ] RFI: Loaded 10657 existing records from primary storage. [2025-09-19T22:25:29.344819] [INFO ] [MAIN ] RFI: Loaded 10657 primary data records. [2025-09-19T22:25:29.462509] [DEBUG] [LOCAL ] REZI: Loaded 47558 existing records from primary storage. [2025-09-19T22:25:29.481864] [INFO ] [MAIN ] REZI: Loaded 47558 primary data records. [2025-09-19T22:25:29.760921] [DEBUG] [LOCAL ] RF: Loaded 54410 existing records from primary storage. [2025-09-19T22:25:29.791720] [INFO ] [MAIN ] RF: Loaded 54410 primary data records. [2025-09-19T22:25:30.337992] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:30.339302] [INFO ] [MAIN ] RFI: Generated 1820 derivative records from 10657 primary records. [2025-09-19T22:25:30.339609] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-19T22:25:30.359296] [DEBUG] [LOCAL ] RFI: Derivative data saved (1820 records). [2025-09-19T22:25:30.359435] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-19T22:25:30.361849] [INFO ] [MAIN ] Derivative Progress: 1558/2093 symbols completed. RFI took 1.0s. Estimated remaining: 3m 27s. Rate: 154.7 symbols/min [2025-09-19T22:25:30.376902] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:30.378797] [INFO ] [MAIN ] REZI: Generated 1820 derivative records from 47558 primary records. [2025-09-19T22:25:30.378884] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-19T22:25:30.406926] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:30.409354] [INFO ] [MAIN ] RF: Generated 1820 derivative records from 54410 primary records. [2025-09-19T22:25:30.409666] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-19T22:25:30.412296] [DEBUG] [LOCAL ] REZI: Derivative data saved (1820 records). [2025-09-19T22:25:30.412459] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-19T22:25:30.414745] [INFO ] [MAIN ] Derivative Progress: 1559/2093 symbols completed. REZI took 1.2s. Estimated remaining: 3m 27s. Rate: 154.8 symbols/min [2025-09-19T22:25:30.430545] [DEBUG] [LOCAL ] RF: Derivative data saved (1820 records). [2025-09-19T22:25:30.430628] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-19T22:25:30.434390] [INFO ] [MAIN ] Derivative Progress: 1560/2093 symbols completed. RF took 1.1s. Estimated remaining: 3m 26s. Rate: 154.9 symbols/min [2025-09-19T22:25:30.435255] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:30.435434] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:30.435066] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:30.446198] [DEBUG] [LOCAL ] RFM: Loaded 4122 existing records from primary storage. [2025-09-19T22:25:30.446446] [INFO ] [MAIN ] RFM: Loaded 4122 primary data records. [2025-09-19T22:25:30.509037] [DEBUG] [LOCAL ] RFMZ: Loaded 8608 existing records from primary storage. [2025-09-19T22:25:30.522935] [INFO ] [MAIN ] RFMZ: Loaded 8608 primary data records. [2025-09-19T22:25:30.522828] [DEBUG] [LOCAL ] RFL: Loaded 10839 existing records from primary storage. [2025-09-19T22:25:30.539596] [INFO ] [MAIN ] RFL: Loaded 10839 primary data records. [2025-09-19T22:25:31.497163] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:31.498234] [INFO ] [MAIN ] RFM: Generated 1820 derivative records from 4122 primary records. [2025-09-19T22:25:31.498514] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-19T22:25:31.525132] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:31.531098] [INFO ] [MAIN ] RFL: Generated 1820 derivative records from 10839 primary records. [2025-09-19T22:25:31.535948] [DEBUG] [LOCAL ] RFM: Derivative data saved (1820 records). [2025-09-19T22:25:31.536073] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-19T22:25:31.536174] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-19T22:25:31.538360] [INFO ] [MAIN ] Derivative Progress: 1561/2093 symbols completed. RFM took 1.1s. Estimated remaining: 3m 26s. Rate: 154.7 symbols/min [2025-09-19T22:25:31.539428] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:31.553719] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:31.561893] [INFO ] [MAIN ] RFMZ: Generated 1820 derivative records from 8608 primary records. [2025-09-19T22:25:31.566113] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-19T22:25:31.571477] [DEBUG] [LOCAL ] RFL: Derivative data saved (1820 records). [2025-09-19T22:25:31.571719] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-19T22:25:31.574450] [INFO ] [MAIN ] Derivative Progress: 1562/2093 symbols completed. RFL took 1.1s. Estimated remaining: 3m 26s. Rate: 154.8 symbols/min [2025-09-19T22:25:31.589915] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1820 records). [2025-09-19T22:25:31.590051] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:31.590378] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-19T22:25:31.593618] [INFO ] [MAIN ] Derivative Progress: 1563/2093 symbols completed. RFMZ took 1.2s. Estimated remaining: 3m 25s. Rate: 154.9 symbols/min [2025-09-19T22:25:31.594010] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:31.601049] [DEBUG] [LOCAL ] RGT: Loaded 2966 existing records from primary storage. [2025-09-19T22:25:31.601250] [INFO ] [MAIN ] RGT: Loaded 2966 primary data records. [2025-09-19T22:25:31.735799] [DEBUG] [LOCAL ] RGA: Loaded 30740 existing records from primary storage. [2025-09-19T22:25:31.736003] [INFO ] [MAIN ] RGA: Loaded 30740 primary data records. [2025-09-19T22:25:31.728454] [DEBUG] [LOCAL ] RGR: Loaded 20432 existing records from primary storage. [2025-09-19T22:25:31.736149] [INFO ] [MAIN ] RGR: Loaded 20432 primary data records. [2025-09-19T22:25:32.597231] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:32.600929] [INFO ] [MAIN ] RGT: Generated 1820 derivative records from 2966 primary records. [2025-09-19T22:25:32.601257] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-19T22:25:32.628279] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:32.629787] [INFO ] [MAIN ] RGR: Generated 1820 derivative records from 20432 primary records. [2025-09-19T22:25:32.630222] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-19T22:25:32.646273] [DEBUG] [LOCAL ] RGT: Derivative data saved (1820 records). [2025-09-19T22:25:32.646871] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:32.656934] [INFO ] [MAIN ] RGA: Generated 1820 derivative records from 30740 primary records. [2025-09-19T22:25:32.657087] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-19T22:25:32.660761] [INFO ] [MAIN ] Derivative Progress: 1564/2093 symbols completed. RGT took 1.1s. Estimated remaining: 3m 25s. Rate: 154.7 symbols/min [2025-09-19T22:25:32.661127] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:32.657215] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-19T22:25:32.685794] [DEBUG] [LOCAL ] RGR: Derivative data saved (1820 records). [2025-09-19T22:25:32.687712] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-19T22:25:32.690295] [INFO ] [MAIN ] Derivative Progress: 1565/2093 symbols completed. RGR took 1.1s. Estimated remaining: 3m 25s. Rate: 154.8 symbols/min [2025-09-19T22:25:32.691199] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:32.691611] [DEBUG] [LOCAL ] RGA: Derivative data saved (1820 records). [2025-09-19T22:25:32.691724] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-19T22:25:32.694523] [INFO ] [MAIN ] Derivative Progress: 1566/2093 symbols completed. RGA took 1.2s. Estimated remaining: 3m 24s. Rate: 154.9 symbols/min [2025-09-19T22:25:32.695016] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:32.775565] [DEBUG] [LOCAL ] RH: Loaded 48447 existing records from primary storage. [2025-09-19T22:25:32.776863] [INFO ] [MAIN ] RH: Loaded 48447 primary data records. [2025-09-19T22:25:32.776762] [DEBUG] [LOCAL ] RHP: Loaded 42353 existing records from primary storage. [2025-09-19T22:25:32.777360] [INFO ] [MAIN ] RHP: Loaded 42353 primary data records. [2025-09-19T22:25:32.912915] [DEBUG] [LOCAL ] RHI: Loaded 49966 existing records from primary storage. [2025-09-19T22:25:32.934627] [INFO ] [MAIN ] RHI: Loaded 49966 primary data records. [2025-09-19T22:25:33.788979] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:33.789989] [INFO ] [MAIN ] RHP: Generated 1820 derivative records from 42353 primary records. [2025-09-19T22:25:33.790195] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-19T22:25:33.814895] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:33.817297] [INFO ] [MAIN ] RH: Generated 1820 derivative records from 48447 primary records. [2025-09-19T22:25:33.817532] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-19T22:25:33.837007] [DEBUG] [LOCAL ] RHP: Derivative data saved (1820 records). [2025-09-19T22:25:33.838067] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-19T22:25:33.840054] [INFO ] [MAIN ] Derivative Progress: 1567/2093 symbols completed. RHP took 1.1s. Estimated remaining: 3m 24s. Rate: 154.7 symbols/min [2025-09-19T22:25:33.841020] [DEBUG] [LOCAL ] RH: Derivative data saved (1820 records). [2025-09-19T22:25:33.853674] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:33.853835] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-19T22:25:33.856866] [INFO ] [MAIN ] Derivative Progress: 1568/2093 symbols completed. RH took 1.2s. Estimated remaining: 3m 23s. Rate: 154.8 symbols/min [2025-09-19T22:25:33.857896] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:33.857694] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:33.859274] [INFO ] [MAIN ] RHI: Generated 1820 derivative records from 49966 primary records. [2025-09-19T22:25:33.859467] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-19T22:25:33.877697] [DEBUG] [LOCAL ] RHI: Derivative data saved (1820 records). [2025-09-19T22:25:33.877864] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-19T22:25:33.880835] [INFO ] [MAIN ] Derivative Progress: 1569/2093 symbols completed. RHI took 1.2s. Estimated remaining: 3m 23s. Rate: 154.9 symbols/min [2025-09-19T22:25:33.881198] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:33.941548] [DEBUG] [LOCAL ] RIG: Loaded 54450 existing records from primary storage. [2025-09-19T22:25:33.941899] [INFO ] [MAIN ] RIG: Loaded 54450 primary data records. [2025-09-19T22:25:34.091618] [DEBUG] [LOCAL ] RIO: Loaded 54177 existing records from primary storage. [2025-09-19T22:25:34.116442] [INFO ] [MAIN ] RIO: Loaded 54177 primary data records. [2025-09-19T22:25:34.176505] [DEBUG] [LOCAL ] RITM: Loaded 53575 existing records from primary storage. [2025-09-19T22:25:34.188786] [INFO ] [MAIN ] RITM: Loaded 53575 primary data records. [2025-09-19T22:25:34.953873] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:34.954965] [INFO ] [MAIN ] RIG: Generated 1820 derivative records from 54450 primary records. [2025-09-19T22:25:34.955630] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-19T22:25:34.975781] [DEBUG] [LOCAL ] RIG: Derivative data saved (1820 records). [2025-09-19T22:25:34.976749] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-19T22:25:34.978573] [INFO ] [MAIN ] Derivative Progress: 1570/2093 symbols completed. RIG took 1.1s. Estimated remaining: 3m 23s. Rate: 154.7 symbols/min [2025-09-19T22:25:34.979191] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:35.018586] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:35.019239] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:35.020217] [INFO ] [MAIN ] RIO: Generated 1820 derivative records from 54177 primary records. [2025-09-19T22:25:35.021106] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-19T22:25:35.020973] [INFO ] [MAIN ] RITM: Generated 1820 derivative records from 53575 primary records. [2025-09-19T22:25:35.025909] [DEBUG] [LOCAL ] RIV: Loaded 11910 existing records from primary storage. [2025-09-19T22:25:35.026904] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-19T22:25:35.027011] [INFO ] [MAIN ] RIV: Loaded 11910 primary data records. [2025-09-19T22:25:35.166801] [DEBUG] [LOCAL ] RIO: Derivative data saved (1820 records). [2025-09-19T22:25:35.175155] [DEBUG] [LOCAL ] RITM: Derivative data saved (1820 records). [2025-09-19T22:25:35.180745] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-19T22:25:35.168200] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-19T22:25:35.188524] [INFO ] [MAIN ] Derivative Progress: 1571/2093 symbols completed. RITM took 1.3s. Estimated remaining: 3m 22s. Rate: 154.8 symbols/min [2025-09-19T22:25:35.204433] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:35.204628] [INFO ] [MAIN ] Derivative Progress: 1572/2093 symbols completed. RIO took 1.3s. Estimated remaining: 3m 22s. Rate: 154.9 symbols/min [2025-09-19T22:25:35.215319] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:35.584425] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:35.585880] [INFO ] [MAIN ] RIV: Generated 1820 derivative records from 11910 primary records. [2025-09-19T22:25:35.611691] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-19T22:25:35.614464] [DEBUG] [LOCAL ] RJF: Loaded 47859 existing records from primary storage. [2025-09-19T22:25:35.615552] [INFO ] [MAIN ] RJF: Loaded 47859 primary data records. [2025-09-19T22:25:35.710575] [DEBUG] [LOCAL ] RIV: Derivative data saved (1820 records). [2025-09-19T22:25:35.743948] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-19T22:25:35.781458] [INFO ] [MAIN ] Derivative Progress: 1573/2093 symbols completed. RIV took 0.8s. Estimated remaining: 3m 21s. Rate: 154.8 symbols/min [2025-09-19T22:25:35.757238] [DEBUG] [LOCAL ] RKT: Loaded 54500 existing records from primary storage. [2025-09-19T22:25:35.800465] [INFO ] [MAIN ] RKT: Loaded 54500 primary data records. [2025-09-19T22:25:36.545368] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:36.546437] [INFO ] [MAIN ] RJF: Generated 1820 derivative records from 47859 primary records. [2025-09-19T22:25:36.546597] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-19T22:25:36.566765] [DEBUG] [LOCAL ] RJF: Derivative data saved (1820 records). [2025-09-19T22:25:36.580349] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-19T22:25:36.582945] [INFO ] [MAIN ] Derivative Progress: 1574/2093 symbols completed. RJF took 1.4s. Estimated remaining: 3m 21s. Rate: 154.7 symbols/min [2025-09-19T22:25:36.583638] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:36.584337] [INFO ] [MAIN ] RKT: Generated 1820 derivative records from 54500 primary records. [2025-09-19T22:25:36.584403] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-19T22:25:36.599941] [DEBUG] [LOCAL ] RKT: Derivative data saved (1820 records). [2025-09-19T22:25:36.600020] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-19T22:25:36.602064] [INFO ] [MAIN ] Derivative Progress: 1575/2093 symbols completed. RKT took 1.4s. Estimated remaining: 3m 21s. Rate: 154.8 symbols/min [2025-09-19T22:25:36.602551] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:36.602795] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:36.603274] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:36.656988] [DEBUG] [LOCAL ] RLI: Loaded 33794 existing records from primary storage. [2025-09-19T22:25:36.679708] [INFO ] [MAIN ] RLI: Loaded 33794 primary data records. [2025-09-19T22:25:36.702393] [DEBUG] [LOCAL ] RL: Loaded 42549 existing records from primary storage. [2025-09-19T22:25:36.748245] [INFO ] [MAIN ] RL: Loaded 42549 primary data records. [2025-09-19T22:25:36.853985] [DEBUG] [LOCAL ] RLJ: Loaded 49043 existing records from primary storage. [2025-09-19T22:25:36.951211] [INFO ] [MAIN ] RLJ: Loaded 49043 primary data records. [2025-09-19T22:25:37.731676] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:37.735399] [INFO ] [MAIN ] RLI: Generated 1820 derivative records from 33794 primary records. [2025-09-19T22:25:37.735707] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-19T22:25:37.757463] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:37.762500] [INFO ] [MAIN ] RL: Generated 1820 derivative records from 42549 primary records. [2025-09-19T22:25:37.762753] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-19T22:25:37.768153] [DEBUG] [LOCAL ] RLI: Derivative data saved (1820 records). [2025-09-19T22:25:37.779693] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-19T22:25:37.781567] [INFO ] [MAIN ] Derivative Progress: 1576/2093 symbols completed. RLI took 1.2s. Estimated remaining: 3m 21s. Rate: 154.6 symbols/min [2025-09-19T22:25:37.784309] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:37.790492] [DEBUG] [LOCAL ] RL: Derivative data saved (1820 records). [2025-09-19T22:25:37.791351] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-19T22:25:37.793660] [INFO ] [MAIN ] Derivative Progress: 1577/2093 symbols completed. RL took 1.2s. Estimated remaining: 3m 20s. Rate: 154.7 symbols/min [2025-09-19T22:25:37.807083] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:37.807035] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:37.808153] [INFO ] [MAIN ] RLJ: Generated 1820 derivative records from 49043 primary records. [2025-09-19T22:25:37.812952] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-19T22:25:37.829825] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1820 records). [2025-09-19T22:25:37.834659] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-19T22:25:37.837378] [INFO ] [MAIN ] Derivative Progress: 1578/2093 symbols completed. RLJ took 1.2s. Estimated remaining: 3m 20s. Rate: 154.8 symbols/min [2025-09-19T22:25:37.838198] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:37.838050] [DEBUG] [LOCAL ] RLTY: Loaded 11412 existing records from primary storage. [2025-09-19T22:25:37.838393] [INFO ] [MAIN ] RLTY: Loaded 11412 primary data records. [2025-09-19T22:25:37.965935] [DEBUG] [LOCAL ] RM: Loaded 7872 existing records from primary storage. [2025-09-19T22:25:37.982840] [INFO ] [MAIN ] RM: Loaded 7872 primary data records. [2025-09-19T22:25:38.103678] [DEBUG] [LOCAL ] RLX: Loaded 48839 existing records from primary storage. [2025-09-19T22:25:38.284910] [INFO ] [MAIN ] RLX: Loaded 48839 primary data records. [2025-09-19T22:25:38.866414] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:38.867270] [INFO ] [MAIN ] RLTY: Generated 1820 derivative records from 11412 primary records. [2025-09-19T22:25:38.867553] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-19T22:25:38.889802] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1820 records). [2025-09-19T22:25:38.890239] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-19T22:25:38.905728] [INFO ] [MAIN ] Derivative Progress: 1579/2093 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 19s. Rate: 154.6 symbols/min [2025-09-19T22:25:38.913873] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:38.914346] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:38.915827] [INFO ] [MAIN ] RM: Generated 1820 derivative records from 7872 primary records. [2025-09-19T22:25:38.916092] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-19T22:25:38.960929] [DEBUG] [LOCAL ] RM: Derivative data saved (1820 records). [2025-09-19T22:25:38.960035] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:38.961104] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-19T22:25:38.963807] [INFO ] [MAIN ] Derivative Progress: 1580/2093 symbols completed. RM took 1.1s. Estimated remaining: 3m 19s. Rate: 154.7 symbols/min [2025-09-19T22:25:38.964916] [INFO ] [MAIN ] RLX: Generated 1820 derivative records from 48839 primary records. [2025-09-19T22:25:38.964974] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:38.972281] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-19T22:25:38.972783] [DEBUG] [LOCAL ] RMAX: Loaded 22107 existing records from primary storage. [2025-09-19T22:25:38.972920] [INFO ] [MAIN ] RMAX: Loaded 22107 primary data records. [2025-09-19T22:25:39.109333] [DEBUG] [LOCAL ] RLX: Derivative data saved (1820 records). [2025-09-19T22:25:39.139452] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-19T22:25:39.180969] [INFO ] [MAIN ] Derivative Progress: 1581/2093 symbols completed. RLX took 1.4s. Estimated remaining: 3m 18s. Rate: 154.8 symbols/min [2025-09-19T22:25:39.291537] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:39.318536] [DEBUG] [LOCAL ] RMI: Loaded 4687 existing records from primary storage. [2025-09-19T22:25:39.318743] [INFO ] [MAIN ] RMI: Loaded 4687 primary data records. [2025-09-19T22:25:39.438483] [DEBUG] [LOCAL ] RMD: Loaded 43125 existing records from primary storage. [2025-09-19T22:25:39.459749] [INFO ] [MAIN ] RMD: Loaded 43125 primary data records. [2025-09-19T22:25:40.005609] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:40.007698] [INFO ] [MAIN ] RMAX: Generated 1820 derivative records from 22107 primary records. [2025-09-19T22:25:40.008099] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-19T22:25:40.026746] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1820 records). [2025-09-19T22:25:40.026996] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-19T22:25:40.029122] [INFO ] [MAIN ] Derivative Progress: 1582/2093 symbols completed. RMAX took 1.1s. Estimated remaining: 3m 18s. Rate: 154.6 symbols/min [2025-09-19T22:25:40.030126] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:40.057735] [DEBUG] [LOCAL ] RMM: Loaded 10324 existing records from primary storage. [2025-09-19T22:25:40.058196] [INFO ] [MAIN ] RMM: Loaded 10324 primary data records. [2025-09-19T22:25:40.053484] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:40.070150] [INFO ] [MAIN ] RMI: Generated 1820 derivative records from 4687 primary records. [2025-09-19T22:25:40.070380] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-19T22:25:40.194943] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:40.195419] [DEBUG] [LOCAL ] RMI: Derivative data saved (1820 records). [2025-09-19T22:25:40.201499] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-19T22:25:40.196183] [INFO ] [MAIN ] RMD: Generated 1820 derivative records from 43125 primary records. [2025-09-19T22:25:40.206760] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-19T22:25:40.208740] [INFO ] [MAIN ] Derivative Progress: 1583/2093 symbols completed. RMI took 0.9s. Estimated remaining: 3m 18s. Rate: 154.7 symbols/min [2025-09-19T22:25:40.209592] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:40.296708] [DEBUG] [LOCAL ] RMD: Derivative data saved (1820 records). [2025-09-19T22:25:40.414864] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-19T22:25:40.420711] [INFO ] [MAIN ] Derivative Progress: 1584/2093 symbols completed. RMD took 1.5s. Estimated remaining: 3m 17s. Rate: 154.7 symbols/min [2025-09-19T22:25:40.421386] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:40.426562] [DEBUG] [LOCAL ] RMMZ: Loaded 4862 existing records from primary storage. [2025-09-19T22:25:40.427514] [INFO ] [MAIN ] RMMZ: Loaded 4862 primary data records. [2025-09-19T22:25:40.608296] [DEBUG] [LOCAL ] RMT: Loaded 18024 existing records from primary storage. [2025-09-19T22:25:40.632208] [INFO ] [MAIN ] RMT: Loaded 18024 primary data records. [2025-09-19T22:25:41.105380] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:41.106542] [INFO ] [MAIN ] RMM: Generated 1820 derivative records from 10324 primary records. [2025-09-19T22:25:41.107496] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-19T22:25:41.133249] [DEBUG] [LOCAL ] RMM: Derivative data saved (1820 records). [2025-09-19T22:25:41.133601] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-19T22:25:41.135948] [INFO ] [MAIN ] Derivative Progress: 1585/2093 symbols completed. RMM took 1.1s. Estimated remaining: 3m 17s. Rate: 154.7 symbols/min [2025-09-19T22:25:41.152193] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:41.153445] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:41.154367] [INFO ] [MAIN ] RMMZ: Generated 1820 derivative records from 4862 primary records. [2025-09-19T22:25:41.154585] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-19T22:25:41.172353] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1820 records). [2025-09-19T22:25:41.172468] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-19T22:25:41.174853] [INFO ] [MAIN ] Derivative Progress: 1586/2093 symbols completed. RMMZ took 1.0s. Estimated remaining: 3m 17s. Rate: 154.8 symbols/min [2025-09-19T22:25:41.175257] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:41.194849] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:41.195839] [INFO ] [MAIN ] RMT: Generated 1820 derivative records from 18024 primary records. [2025-09-19T22:25:41.195967] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-19T22:25:41.227982] [DEBUG] [LOCAL ] RMT: Derivative data saved (1820 records). [2025-09-19T22:25:41.228250] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-19T22:25:41.231115] [INFO ] [MAIN ] Derivative Progress: 1587/2093 symbols completed. RMT took 0.8s. Estimated remaining: 3m 16s. Rate: 154.8 symbols/min [2025-09-19T22:25:41.231852] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:41.240053] [DEBUG] [LOCAL ] RNGR: Loaded 20800 existing records from primary storage. [2025-09-19T22:25:41.252535] [INFO ] [MAIN ] RNGR: Loaded 20800 primary data records. [2025-09-19T22:25:41.275731] [DEBUG] [LOCAL ] RNG: Loaded 48950 existing records from primary storage. [2025-09-19T22:25:41.291450] [INFO ] [MAIN ] RNG: Loaded 48950 primary data records. [2025-09-19T22:25:41.459475] [DEBUG] [LOCAL ] RNP: Loaded 16058 existing records from primary storage. [2025-09-19T22:25:41.483036] [INFO ] [MAIN ] RNP: Loaded 16058 primary data records. [2025-09-19T22:25:42.309062] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:42.310301] [INFO ] [MAIN ] RNG: Generated 1820 derivative records from 48950 primary records. [2025-09-19T22:25:42.310768] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-19T22:25:42.339273] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:42.341704] [INFO ] [MAIN ] RNGR: Generated 1820 derivative records from 20800 primary records. [2025-09-19T22:25:42.342142] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-19T22:25:42.359589] [DEBUG] [LOCAL ] RNG: Derivative data saved (1820 records). [2025-09-19T22:25:42.360218] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-19T22:25:42.363147] [INFO ] [MAIN ] Derivative Progress: 1588/2093 symbols completed. RNG took 1.2s. Estimated remaining: 3m 16s. Rate: 154.6 symbols/min [2025-09-19T22:25:42.366510] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1820 records). [2025-09-19T22:25:42.366728] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-19T22:25:42.369546] [INFO ] [MAIN ] Derivative Progress: 1589/2093 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 15s. Rate: 154.7 symbols/min [2025-09-19T22:25:42.384735] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:42.385395] [INFO ] [MAIN ] RNP: Generated 1820 derivative records from 16058 primary records. [2025-09-19T22:25:42.385461] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-19T22:25:42.402486] [DEBUG] [LOCAL ] RNP: Derivative data saved (1820 records). [2025-09-19T22:25:42.402606] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-19T22:25:42.405264] [INFO ] [MAIN ] Derivative Progress: 1590/2093 symbols completed. RNP took 1.2s. Estimated remaining: 3m 15s. Rate: 154.8 symbols/min [2025-09-19T22:25:42.405879] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:42.406276] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:42.406192] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:42.439218] [DEBUG] [LOCAL ] ROG: Loaded 23676 existing records from primary storage. [2025-09-19T22:25:42.439518] [INFO ] [MAIN ] ROG: Loaded 23676 primary data records. [2025-09-19T22:25:42.572823] [DEBUG] [LOCAL ] RNR: Loaded 35210 existing records from primary storage. [2025-09-19T22:25:42.580501] [INFO ] [MAIN ] RNR: Loaded 35210 primary data records. [2025-09-19T22:25:42.757079] [DEBUG] [LOCAL ] RNST: Loaded 37867 existing records from primary storage. [2025-09-19T22:25:42.763852] [INFO ] [MAIN ] RNST: Loaded 37867 primary data records. [2025-09-19T22:25:43.470573] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:43.472359] [INFO ] [MAIN ] ROG: Generated 1820 derivative records from 23676 primary records. [2025-09-19T22:25:43.472827] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-19T22:25:43.496054] [DEBUG] [LOCAL ] ROG: Derivative data saved (1820 records). [2025-09-19T22:25:43.497073] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-19T22:25:43.499906] [INFO ] [MAIN ] Derivative Progress: 1591/2093 symbols completed. ROG took 1.1s. Estimated remaining: 3m 15s. Rate: 154.7 symbols/min [2025-09-19T22:25:43.500523] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:43.515035] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:43.516329] [INFO ] [MAIN ] RNR: Generated 1820 derivative records from 35210 primary records. [2025-09-19T22:25:43.516756] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-19T22:25:43.550546] [DEBUG] [LOCAL ] RNR: Derivative data saved (1820 records). [2025-09-19T22:25:43.550369] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:43.550975] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-19T22:25:43.556687] [INFO ] [MAIN ] RNST: Generated 1820 derivative records from 37867 primary records. [2025-09-19T22:25:43.559356] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-19T22:25:43.559247] [INFO ] [MAIN ] Derivative Progress: 1592/2093 symbols completed. RNR took 1.2s. Estimated remaining: 3m 14s. Rate: 154.7 symbols/min [2025-09-19T22:25:43.569043] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:43.576394] [DEBUG] [LOCAL ] RNST: Derivative data saved (1820 records). [2025-09-19T22:25:43.576568] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-19T22:25:43.579325] [INFO ] [MAIN ] Derivative Progress: 1593/2093 symbols completed. RNST took 1.2s. Estimated remaining: 3m 14s. Rate: 154.8 symbols/min [2025-09-19T22:25:43.579686] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:43.622836] [DEBUG] [LOCAL ] ROK: Loaded 44736 existing records from primary storage. [2025-09-19T22:25:43.623150] [INFO ] [MAIN ] ROK: Loaded 44736 primary data records. [2025-09-19T22:25:43.804600] [DEBUG] [LOCAL ] RPM: Loaded 41664 existing records from primary storage. [2025-09-19T22:25:43.813530] [INFO ] [MAIN ] RPM: Loaded 41664 primary data records. [2025-09-19T22:25:44.149042] [DEBUG] [LOCAL ] ROL: Loaded 51014 existing records from primary storage. [2025-09-19T22:25:44.168822] [INFO ] [MAIN ] ROL: Loaded 51014 primary data records. [2025-09-19T22:25:44.669967] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:44.671582] [INFO ] [MAIN ] ROK: Generated 1820 derivative records from 44736 primary records. [2025-09-19T22:25:44.671800] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-19T22:25:44.686461] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:44.701015] [INFO ] [MAIN ] RPM: Generated 1820 derivative records from 41664 primary records. [2025-09-19T22:25:44.703262] [DEBUG] [LOCAL ] ROK: Derivative data saved (1820 records). [2025-09-19T22:25:44.703442] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-19T22:25:44.703368] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-19T22:25:44.706071] [INFO ] [MAIN ] Derivative Progress: 1594/2093 symbols completed. ROK took 1.2s. Estimated remaining: 3m 14s. Rate: 154.6 symbols/min [2025-09-19T22:25:44.706999] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:44.725583] [DEBUG] [LOCAL ] RPM: Derivative data saved (1820 records). [2025-09-19T22:25:44.725911] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-19T22:25:44.728123] [INFO ] [MAIN ] Derivative Progress: 1595/2093 symbols completed. RPM took 1.1s. Estimated remaining: 3m 13s. Rate: 154.7 symbols/min [2025-09-19T22:25:44.728533] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:44.746189] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:44.747058] [INFO ] [MAIN ] ROL: Generated 1820 derivative records from 51014 primary records. [2025-09-19T22:25:44.747186] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-19T22:25:44.771009] [DEBUG] [LOCAL ] ROL: Derivative data saved (1820 records). [2025-09-19T22:25:44.771246] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-19T22:25:44.773981] [INFO ] [MAIN ] Derivative Progress: 1596/2093 symbols completed. ROL took 1.2s. Estimated remaining: 3m 13s. Rate: 154.8 symbols/min [2025-09-19T22:25:44.774918] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:44.785240] [DEBUG] [LOCAL ] RQI: Loaded 29618 existing records from primary storage. [2025-09-19T22:25:44.785458] [INFO ] [MAIN ] RQI: Loaded 29618 primary data records. [2025-09-19T22:25:45.136473] [DEBUG] [LOCAL ] RRC: Loaded 53556 existing records from primary storage. [2025-09-19T22:25:45.151881] [INFO ] [MAIN ] RRC: Loaded 53556 primary data records. [2025-09-19T22:25:45.287723] [DEBUG] [LOCAL ] RRX: Loaded 41720 existing records from primary storage. [2025-09-19T22:25:45.309237] [INFO ] [MAIN ] RRX: Loaded 41720 primary data records. [2025-09-19T22:25:45.874409] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:45.875519] [INFO ] [MAIN ] RQI: Generated 1820 derivative records from 29618 primary records. [2025-09-19T22:25:45.875750] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-19T22:25:45.896876] [DEBUG] [LOCAL ] RQI: Derivative data saved (1820 records). [2025-09-19T22:25:45.898578] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-19T22:25:45.901305] [INFO ] [MAIN ] Derivative Progress: 1597/2093 symbols completed. RQI took 1.2s. Estimated remaining: 3m 12s. Rate: 154.6 symbols/min [2025-09-19T22:25:45.901848] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:45.916336] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:45.917122] [INFO ] [MAIN ] RRC: Generated 1820 derivative records from 53556 primary records. [2025-09-19T22:25:45.917286] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-19T22:25:45.936061] [DEBUG] [LOCAL ] RRC: Derivative data saved (1820 records). [2025-09-19T22:25:45.936909] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-19T22:25:45.938983] [INFO ] [MAIN ] Derivative Progress: 1598/2093 symbols completed. RRC took 1.2s. Estimated remaining: 3m 12s. Rate: 154.7 symbols/min [2025-09-19T22:25:45.939307] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:45.961144] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:45.962012] [INFO ] [MAIN ] RRX: Generated 1820 derivative records from 41720 primary records. [2025-09-19T22:25:45.963032] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-19T22:25:45.988618] [DEBUG] [LOCAL ] RSF: Loaded 4199 existing records from primary storage. [2025-09-19T22:25:45.990376] [DEBUG] [LOCAL ] RRX: Derivative data saved (1820 records). [2025-09-19T22:25:45.990896] [DEBUG] [LOCAL ] RS: Loaded 26305 existing records from primary storage. [2025-09-19T22:25:45.989195] [INFO ] [MAIN ] RSF: Loaded 4199 primary data records. [2025-09-19T22:25:45.991102] [INFO ] [MAIN ] RS: Loaded 26305 primary data records. [2025-09-19T22:25:45.991020] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-19T22:25:45.993887] [INFO ] [MAIN ] Derivative Progress: 1599/2093 symbols completed. RRX took 1.2s. Estimated remaining: 3m 11s. Rate: 154.8 symbols/min [2025-09-19T22:25:46.064245] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:46.650591] [DEBUG] [LOCAL ] RSG: Loaded 48173 existing records from primary storage. [2025-09-19T22:25:46.651392] [INFO ] [MAIN ] RSG: Loaded 48173 primary data records. [2025-09-19T22:25:46.806087] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:46.832578] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:46.861622] [INFO ] [MAIN ] RS: Generated 1820 derivative records from 26305 primary records. [2025-09-19T22:25:46.861773] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-19T22:25:46.862390] [INFO ] [MAIN ] RSF: Generated 1820 derivative records from 4199 primary records. [2025-09-19T22:25:46.988803] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-19T22:25:47.012913] [DEBUG] [LOCAL ] RS: Derivative data saved (1820 records). [2025-09-19T22:25:47.014346] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-19T22:25:47.019344] [INFO ] [MAIN ] Derivative Progress: 1600/2093 symbols completed. RS took 1.1s. Estimated remaining: 3m 11s. Rate: 154.6 symbols/min [2025-09-19T22:25:47.021179] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:47.024954] [DEBUG] [LOCAL ] RSF: Derivative data saved (1820 records). [2025-09-19T22:25:47.025223] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-19T22:25:47.027583] [INFO ] [MAIN ] Derivative Progress: 1601/2093 symbols completed. RSF took 1.1s. Estimated remaining: 3m 11s. Rate: 154.7 symbols/min [2025-09-19T22:25:47.028394] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:47.056114] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:47.065592] [INFO ] [MAIN ] RSG: Generated 1820 derivative records from 48173 primary records. [2025-09-19T22:25:47.066017] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-19T22:25:47.092299] [DEBUG] [LOCAL ] RSG: Derivative data saved (1820 records). [2025-09-19T22:25:47.102098] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-19T22:25:47.104518] [INFO ] [MAIN ] Derivative Progress: 1602/2093 symbols completed. RSG took 1.1s. Estimated remaining: 3m 10s. Rate: 154.8 symbols/min [2025-09-19T22:25:47.105419] [DEBUG] [LOCAL ] RSKD: Loaded 34859 existing records from primary storage. [2025-09-19T22:25:47.105801] [INFO ] [MAIN ] RSKD: Loaded 34859 primary data records. [2025-09-19T22:25:47.105863] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:47.213961] [DEBUG] [LOCAL ] RSI: Loaded 47971 existing records from primary storage. [2025-09-19T22:25:47.214211] [INFO ] [MAIN ] RSI: Loaded 47971 primary data records. [2025-09-19T22:25:47.614333] [DEBUG] [LOCAL ] RTO: Loaded 41208 existing records from primary storage. [2025-09-19T22:25:47.646391] [INFO ] [MAIN ] RTO: Loaded 41208 primary data records. [2025-09-19T22:25:48.183231] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:48.182970] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:48.184012] [INFO ] [MAIN ] RSI: Generated 1820 derivative records from 47971 primary records. [2025-09-19T22:25:48.184194] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-19T22:25:48.184865] [INFO ] [MAIN ] RSKD: Generated 1820 derivative records from 34859 primary records. [2025-09-19T22:25:48.184961] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-19T22:25:48.215237] [DEBUG] [LOCAL ] RSI: Derivative data saved (1820 records). [2025-09-19T22:25:48.215863] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-19T22:25:48.218367] [INFO ] [MAIN ] Derivative Progress: 1603/2093 symbols completed. RSI took 1.2s. Estimated remaining: 3m 10s. Rate: 154.6 symbols/min [2025-09-19T22:25:48.222119] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1820 records). [2025-09-19T22:25:48.222291] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-19T22:25:48.224267] [INFO ] [MAIN ] Derivative Progress: 1604/2093 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 10s. Rate: 154.7 symbols/min [2025-09-19T22:25:48.241417] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:48.242234] [INFO ] [MAIN ] RTO: Generated 1820 derivative records from 41208 primary records. [2025-09-19T22:25:48.242297] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-19T22:25:48.258429] [DEBUG] [LOCAL ] RTO: Derivative data saved (1820 records). [2025-09-19T22:25:48.258515] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-19T22:25:48.261196] [INFO ] [MAIN ] Derivative Progress: 1605/2093 symbols completed. RTO took 1.2s. Estimated remaining: 3m 9s. Rate: 154.8 symbols/min [2025-09-19T22:25:48.261994] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:48.262140] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:48.262600] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:48.301089] [DEBUG] [LOCAL ] RVT: Loaded 27865 existing records from primary storage. [2025-09-19T22:25:48.312282] [INFO ] [MAIN ] RVT: Loaded 27865 primary data records. [2025-09-19T22:25:48.465054] [DEBUG] [LOCAL ] RVLV: Loaded 48685 existing records from primary storage. [2025-09-19T22:25:48.470897] [INFO ] [MAIN ] RVLV: Loaded 48685 primary data records. [2025-09-19T22:25:48.555251] [DEBUG] [LOCAL ] RTX: Loaded 54491 existing records from primary storage. [2025-09-19T22:25:48.608602] [INFO ] [MAIN ] RTX: Loaded 54491 primary data records. [2025-09-19T22:25:49.299668] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:49.300993] [INFO ] [MAIN ] RVT: Generated 1820 derivative records from 27865 primary records. [2025-09-19T22:25:49.301160] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-19T22:25:49.318555] [DEBUG] [LOCAL ] RVT: Derivative data saved (1820 records). [2025-09-19T22:25:49.318793] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-19T22:25:49.320673] [INFO ] [MAIN ] Derivative Progress: 1606/2093 symbols completed. RVT took 1.1s. Estimated remaining: 3m 9s. Rate: 154.7 symbols/min [2025-09-19T22:25:49.320911] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:49.351663] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:49.351913] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:49.352699] [INFO ] [MAIN ] RTX: Generated 1820 derivative records from 54491 primary records. [2025-09-19T22:25:49.353294] [INFO ] [MAIN ] RVLV: Generated 1820 derivative records from 48685 primary records. [2025-09-19T22:25:49.353484] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-19T22:25:49.353556] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-19T22:25:49.388703] [DEBUG] [LOCAL ] RTX: Derivative data saved (1820 records). [2025-09-19T22:25:49.389465] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-19T22:25:49.393375] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1820 records). [2025-09-19T22:25:49.393236] [INFO ] [MAIN ] Derivative Progress: 1607/2093 symbols completed. RTX took 1.1s. Estimated remaining: 3m 8s. Rate: 154.7 symbols/min [2025-09-19T22:25:49.393638] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:49.393878] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-19T22:25:49.396751] [INFO ] [MAIN ] Derivative Progress: 1608/2093 symbols completed. RVLV took 1.1s. Estimated remaining: 3m 8s. Rate: 154.8 symbols/min [2025-09-19T22:25:49.397374] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:49.434764] [DEBUG] [LOCAL ] RVTY: Loaded 48310 existing records from primary storage. [2025-09-19T22:25:49.442990] [INFO ] [MAIN ] RVTY: Loaded 48310 primary data records. [2025-09-19T22:25:49.569350] [DEBUG] [LOCAL ] RWT: Loaded 41133 existing records from primary storage. [2025-09-19T22:25:49.602907] [INFO ] [MAIN ] RWT: Loaded 41133 primary data records. [2025-09-19T22:25:49.665363] [DEBUG] [LOCAL ] RXO: Loaded 48495 existing records from primary storage. [2025-09-19T22:25:49.855980] [INFO ] [MAIN ] RXO: Loaded 48495 primary data records. [2025-09-19T22:25:50.434182] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:50.435141] [INFO ] [MAIN ] RVTY: Generated 1820 derivative records from 48310 primary records. [2025-09-19T22:25:50.435315] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-19T22:25:50.453765] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1820 records). [2025-09-19T22:25:50.454036] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-19T22:25:50.455972] [INFO ] [MAIN ] Derivative Progress: 1609/2093 symbols completed. RVTY took 1.1s. Estimated remaining: 3m 8s. Rate: 154.7 symbols/min [2025-09-19T22:25:50.456327] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:50.470585] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:50.471341] [INFO ] [MAIN ] RWT: Generated 1820 derivative records from 41133 primary records. [2025-09-19T22:25:50.471463] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-19T22:25:50.497594] [DEBUG] [LOCAL ] RWT: Derivative data saved (1820 records). [2025-09-19T22:25:50.502578] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-19T22:25:50.505089] [INFO ] [MAIN ] Derivative Progress: 1610/2093 symbols completed. RWT took 1.1s. Estimated remaining: 3m 7s. Rate: 154.7 symbols/min [2025-09-19T22:25:50.505471] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:50.506558] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:50.506259] [INFO ] [MAIN ] RXO: Generated 1820 derivative records from 48495 primary records. [2025-09-19T22:25:50.506672] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-19T22:25:50.523619] [DEBUG] [LOCAL ] RXO: Derivative data saved (1820 records). [2025-09-19T22:25:50.523750] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-19T22:25:50.526613] [INFO ] [MAIN ] Derivative Progress: 1611/2093 symbols completed. RXO took 1.1s. Estimated remaining: 3m 7s. Rate: 154.8 symbols/min [2025-09-19T22:25:50.526983] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:50.579177] [DEBUG] [LOCAL ] RYAM: Loaded 35771 existing records from primary storage. [2025-09-19T22:25:50.580115] [DEBUG] [LOCAL ] RY: Loaded 48722 existing records from primary storage. [2025-09-19T22:25:50.580291] [INFO ] [MAIN ] RYAM: Loaded 35771 primary data records. [2025-09-19T22:25:50.580226] [INFO ] [MAIN ] RY: Loaded 48722 primary data records. [2025-09-19T22:25:50.818842] [DEBUG] [LOCAL ] RYAN: Loaded 44703 existing records from primary storage. [2025-09-19T22:25:50.844958] [INFO ] [MAIN ] RYAN: Loaded 44703 primary data records. [2025-09-19T22:25:51.550727] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:51.551498] [INFO ] [MAIN ] RY: Generated 1820 derivative records from 48722 primary records. [2025-09-19T22:25:51.551752] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-19T22:25:51.573783] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:51.578254] [INFO ] [MAIN ] RYAM: Generated 1820 derivative records from 35771 primary records. [2025-09-19T22:25:51.579337] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-19T22:25:51.598171] [DEBUG] [LOCAL ] RY: Derivative data saved (1820 records). [2025-09-19T22:25:51.598873] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-19T22:25:51.608812] [INFO ] [MAIN ] Derivative Progress: 1612/2093 symbols completed. RY took 1.2s. Estimated remaining: 3m 7s. Rate: 154.7 symbols/min [2025-09-19T22:25:51.614732] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:51.617515] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:51.618576] [INFO ] [MAIN ] RYAN: Generated 1820 derivative records from 44703 primary records. [2025-09-19T22:25:51.618712] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-19T22:25:51.623711] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1820 records). [2025-09-19T22:25:51.623998] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-19T22:25:51.633995] [INFO ] [MAIN ] Derivative Progress: 1613/2093 symbols completed. RYAM took 1.1s. Estimated remaining: 3m 6s. Rate: 154.8 symbols/min [2025-09-19T22:25:51.638274] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:51.649996] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1820 records). [2025-09-19T22:25:51.650237] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-19T22:25:51.653089] [INFO ] [MAIN ] Derivative Progress: 1614/2093 symbols completed. RYAN took 1.1s. Estimated remaining: 3m 6s. Rate: 154.8 symbols/min [2025-09-19T22:25:51.653517] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:51.664735] [DEBUG] [LOCAL ] RYI: Loaded 21926 existing records from primary storage. [2025-09-19T22:25:51.664883] [INFO ] [MAIN ] RYI: Loaded 21926 primary data records. [2025-09-19T22:25:51.739438] [DEBUG] [LOCAL ] RZB: Loaded 6406 existing records from primary storage. [2025-09-19T22:25:51.755071] [INFO ] [MAIN ] RZB: Loaded 6406 primary data records. [2025-09-19T22:25:52.246638] [DEBUG] [LOCAL ] RYN: Loaded 46475 existing records from primary storage. [2025-09-19T22:25:52.252885] [INFO ] [MAIN ] RYN: Loaded 46475 primary data records. [2025-09-19T22:25:52.725535] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:52.725338] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:25:52.727370] [INFO ] [MAIN ] RZB: Generated 1819 derivative records from 6406 primary records. [2025-09-19T22:25:52.728336] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-19T22:25:52.728280] [INFO ] [MAIN ] RYI: Generated 1820 derivative records from 21926 primary records. [2025-09-19T22:25:52.729075] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-19T22:25:52.758142] [DEBUG] [LOCAL ] RZB: Derivative data saved (1819 records). [2025-09-19T22:25:52.759145] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-19T22:25:52.762312] [INFO ] [MAIN ] Derivative Progress: 1615/2093 symbols completed. RZB took 1.1s. Estimated remaining: 3m 5s. Rate: 154.7 symbols/min [2025-09-19T22:25:52.762906] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:52.765361] [DEBUG] [LOCAL ] RYI: Derivative data saved (1820 records). [2025-09-19T22:25:52.767147] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-19T22:25:52.769473] [INFO ] [MAIN ] Derivative Progress: 1616/2093 symbols completed. RYI took 1.2s. Estimated remaining: 3m 5s. Rate: 154.8 symbols/min [2025-09-19T22:25:52.769837] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:52.785491] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:52.786398] [INFO ] [MAIN ] RYN: Generated 1820 derivative records from 46475 primary records. [2025-09-19T22:25:52.789689] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-19T22:25:52.789896] [DEBUG] [LOCAL ] RZC: Loaded 6940 existing records from primary storage. [2025-09-19T22:25:52.789988] [INFO ] [MAIN ] RZC: Loaded 6940 primary data records. [2025-09-19T22:25:52.926378] [DEBUG] [LOCAL ] RYN: Derivative data saved (1820 records). [2025-09-19T22:25:52.960540] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-19T22:25:52.993301] [INFO ] [MAIN ] Derivative Progress: 1617/2093 symbols completed. RYN took 1.4s. Estimated remaining: 3m 4s. Rate: 154.8 symbols/min [2025-09-19T22:25:53.124357] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:53.145923] [DEBUG] [LOCAL ] S: Loaded 54324 existing records from primary storage. [2025-09-19T22:25:53.146616] [INFO ] [MAIN ] S: Loaded 54324 primary data records. [2025-09-19T22:25:53.498304] [DEBUG] [LOCAL ] SA: Loaded 43662 existing records from primary storage. [2025-09-19T22:25:53.498729] [INFO ] [MAIN ] SA: Loaded 43662 primary data records. [2025-09-19T22:25:53.556241] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:53.578638] [INFO ] [MAIN ] RZC: Generated 1820 derivative records from 6940 primary records. [2025-09-19T22:25:53.601401] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-19T22:25:53.897309] [DEBUG] [LOCAL ] RZC: Derivative data saved (1820 records). [2025-09-19T22:25:53.897447] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-19T22:25:53.899689] [INFO ] [MAIN ] Derivative Progress: 1618/2093 symbols completed. RZC took 1.1s. Estimated remaining: 3m 4s. Rate: 154.7 symbols/min [2025-09-19T22:25:53.918286] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:53.919793] [INFO ] [MAIN ] S: Generated 1820 derivative records from 54324 primary records. [2025-09-19T22:25:53.920050] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-19T22:25:53.936975] [DEBUG] [LOCAL ] S: Derivative data saved (1820 records). [2025-09-19T22:25:53.937046] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-19T22:25:53.939351] [INFO ] [MAIN ] Derivative Progress: 1619/2093 symbols completed. S took 1.2s. Estimated remaining: 3m 4s. Rate: 154.8 symbols/min [2025-09-19T22:25:53.954163] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:53.954754] [INFO ] [MAIN ] SA: Generated 1820 derivative records from 43662 primary records. [2025-09-19T22:25:53.954814] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-19T22:25:53.970064] [DEBUG] [LOCAL ] SA: Derivative data saved (1820 records). [2025-09-19T22:25:53.970125] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-19T22:25:53.972787] [INFO ] [MAIN ] Derivative Progress: 1620/2093 symbols completed. SA took 0.9s. Estimated remaining: 3m 3s. Rate: 154.8 symbols/min [2025-09-19T22:25:53.973418] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:53.973514] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:53.973345] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:53.985420] [DEBUG] [LOCAL ] SABA: Loaded 9519 existing records from primary storage. [2025-09-19T22:25:53.985547] [INFO ] [MAIN ] SABA: Loaded 9519 primary data records. [2025-09-19T22:25:54.110243] [DEBUG] [LOCAL ] SAH: Loaded 22598 existing records from primary storage. [2025-09-19T22:25:54.110714] [INFO ] [MAIN ] SAH: Loaded 22598 primary data records. [2025-09-19T22:25:54.264969] [DEBUG] [LOCAL ] SAFE: Loaded 30915 existing records from primary storage. [2025-09-19T22:25:54.416969] [INFO ] [MAIN ] SAFE: Loaded 30915 primary data records. [2025-09-19T22:25:54.968413] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:54.969353] [INFO ] [MAIN ] SABA: Generated 1820 derivative records from 9519 primary records. [2025-09-19T22:25:54.969592] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-19T22:25:55.003820] [DEBUG] [LOCAL ] SABA: Derivative data saved (1820 records). [2025-09-19T22:25:55.004267] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-19T22:25:55.004630] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:55.005684] [INFO ] [MAIN ] SAH: Generated 1820 derivative records from 22598 primary records. [2025-09-19T22:25:55.006098] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-19T22:25:55.008255] [INFO ] [MAIN ] Derivative Progress: 1621/2093 symbols completed. SABA took 1.0s. Estimated remaining: 3m 3s. Rate: 154.7 symbols/min [2025-09-19T22:25:55.008864] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:55.041025] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:55.042535] [INFO ] [MAIN ] SAFE: Generated 1820 derivative records from 30915 primary records. [2025-09-19T22:25:55.043798] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-19T22:25:55.044001] [DEBUG] [LOCAL ] SAH: Derivative data saved (1820 records). [2025-09-19T22:25:55.049729] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-19T22:25:55.052627] [INFO ] [MAIN ] Derivative Progress: 1622/2093 symbols completed. SAH took 1.1s. Estimated remaining: 3m 3s. Rate: 154.8 symbols/min [2025-09-19T22:25:55.060390] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:55.075869] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1820 records). [2025-09-19T22:25:55.077005] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-19T22:25:55.077385] [DEBUG] [LOCAL ] SAM: Loaded 22014 existing records from primary storage. [2025-09-19T22:25:55.080062] [INFO ] [MAIN ] Derivative Progress: 1623/2093 symbols completed. SAFE took 1.1s. Estimated remaining: 3m 2s. Rate: 154.9 symbols/min [2025-09-19T22:25:55.080212] [INFO ] [MAIN ] SAM: Loaded 22014 primary data records. [2025-09-19T22:25:55.080461] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:55.437201] [DEBUG] [LOCAL ] SAN: Loaded 53804 existing records from primary storage. [2025-09-19T22:25:55.437973] [INFO ] [MAIN ] SAN: Loaded 53804 primary data records. [2025-09-19T22:25:55.558112] [DEBUG] [LOCAL ] SAND: Loaded 52509 existing records from primary storage. [2025-09-19T22:25:55.558566] [INFO ] [MAIN ] SAND: Loaded 52509 primary data records. [2025-09-19T22:25:56.118742] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:56.121368] [INFO ] [MAIN ] SAM: Generated 1820 derivative records from 22014 primary records. [2025-09-19T22:25:56.121811] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-19T22:25:56.147092] [DEBUG] [LOCAL ] SAM: Derivative data saved (1820 records). [2025-09-19T22:25:56.160343] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:56.161384] [INFO ] [MAIN ] SAN: Generated 1820 derivative records from 53804 primary records. [2025-09-19T22:25:56.160412] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-19T22:25:56.164879] [INFO ] [MAIN ] Derivative Progress: 1624/2093 symbols completed. SAM took 1.2s. Estimated remaining: 3m 2s. Rate: 154.7 symbols/min [2025-09-19T22:25:56.161588] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-19T22:25:56.165222] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:56.183621] [DEBUG] [LOCAL ] SAN: Derivative data saved (1820 records). [2025-09-19T22:25:56.183750] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-19T22:25:56.185668] [INFO ] [MAIN ] Derivative Progress: 1625/2093 symbols completed. SAN took 1.1s. Estimated remaining: 3m 1s. Rate: 154.8 symbols/min [2025-09-19T22:25:56.186081] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:56.203503] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:56.208526] [INFO ] [MAIN ] SAND: Generated 1820 derivative records from 52509 primary records. [2025-09-19T22:25:56.208773] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-19T22:25:56.229942] [DEBUG] [LOCAL ] SAR: Loaded 16703 existing records from primary storage. [2025-09-19T22:25:56.230861] [DEBUG] [LOCAL ] SAND: Derivative data saved (1820 records). [2025-09-19T22:25:56.231065] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-19T22:25:56.231156] [INFO ] [MAIN ] SAR: Loaded 16703 primary data records. [2025-09-19T22:25:56.233809] [INFO ] [MAIN ] Derivative Progress: 1626/2093 symbols completed. SAND took 1.2s. Estimated remaining: 3m 1s. Rate: 154.9 symbols/min [2025-09-19T22:25:56.245380] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:56.379289] [DEBUG] [LOCAL ] SAP: Loaded 50851 existing records from primary storage. [2025-09-19T22:25:56.426771] [INFO ] [MAIN ] SAP: Loaded 50851 primary data records. [2025-09-19T22:25:56.724841] [DEBUG] [LOCAL ] SARO: Loaded 49469 existing records from primary storage. [2025-09-19T22:25:56.748171] [INFO ] [MAIN ] SARO: Loaded 49469 primary data records. [2025-09-19T22:25:57.231144] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:57.233202] [INFO ] [MAIN ] SAR: Generated 1820 derivative records from 16703 primary records. [2025-09-19T22:25:57.233398] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-19T22:25:57.251476] [DEBUG] [LOCAL ] SAR: Derivative data saved (1820 records). [2025-09-19T22:25:57.254046] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-19T22:25:57.257146] [INFO ] [MAIN ] Derivative Progress: 1627/2093 symbols completed. SAR took 1.1s. Estimated remaining: 3m 1s. Rate: 154.7 symbols/min [2025-09-19T22:25:57.257502] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:57.273087] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:57.273860] [INFO ] [MAIN ] SAP: Generated 1820 derivative records from 50851 primary records. [2025-09-19T22:25:57.274069] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-19T22:25:57.302551] [DEBUG] [LOCAL ] SAP: Derivative data saved (1820 records). [2025-09-19T22:25:57.302865] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-19T22:25:57.305883] [INFO ] [MAIN ] Derivative Progress: 1628/2093 symbols completed. SAP took 1.1s. Estimated remaining: 3m 0s. Rate: 154.8 symbols/min [2025-09-19T22:25:57.306497] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:57.319867] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:57.321087] [INFO ] [MAIN ] SARO: Generated 1820 derivative records from 49469 primary records. [2025-09-19T22:25:57.321420] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-19T22:25:57.350546] [DEBUG] [LOCAL ] SARO: Derivative data saved (1820 records). [2025-09-19T22:25:57.349430] [DEBUG] [LOCAL ] SB: Loaded 34106 existing records from primary storage. [2025-09-19T22:25:57.350740] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-19T22:25:57.353747] [INFO ] [MAIN ] Derivative Progress: 1629/2093 symbols completed. SARO took 1.1s. Estimated remaining: 2m 60s. Rate: 154.9 symbols/min [2025-09-19T22:25:57.353942] [INFO ] [MAIN ] SB: Loaded 34106 primary data records. [2025-09-19T22:25:57.354271] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:57.491798] [DEBUG] [LOCAL ] SBI: Loaded 7869 existing records from primary storage. [2025-09-19T22:25:57.497670] [INFO ] [MAIN ] SBI: Loaded 7869 primary data records. [2025-09-19T22:25:57.671270] [DEBUG] [LOCAL ] SBH: Loaded 50554 existing records from primary storage. [2025-09-19T22:25:57.693932] [INFO ] [MAIN ] SBH: Loaded 50554 primary data records. [2025-09-19T22:25:58.384826] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:58.385881] [INFO ] [MAIN ] SB: Generated 1820 derivative records from 34106 primary records. [2025-09-19T22:25:58.385971] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-19T22:25:58.404909] [DEBUG] [LOCAL ] SB: Derivative data saved (1820 records). [2025-09-19T22:25:58.406423] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-19T22:25:58.409471] [INFO ] [MAIN ] Derivative Progress: 1630/2093 symbols completed. SB took 1.2s. Estimated remaining: 2m 60s. Rate: 154.7 symbols/min [2025-09-19T22:25:58.410894] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:58.425371] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:58.428136] [INFO ] [MAIN ] SBI: Generated 1820 derivative records from 7869 primary records. [2025-09-19T22:25:58.428914] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-19T22:25:58.455057] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:58.456818] [INFO ] [MAIN ] SBH: Generated 1820 derivative records from 50554 primary records. [2025-09-19T22:25:58.456915] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-19T22:25:58.461829] [DEBUG] [LOCAL ] SBR: Loaded 7374 existing records from primary storage. [2025-09-19T22:25:58.469982] [INFO ] [MAIN ] SBR: Loaded 7374 primary data records. [2025-09-19T22:25:58.568590] [DEBUG] [LOCAL ] SBI: Derivative data saved (1820 records). [2025-09-19T22:25:58.580139] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-19T22:25:58.593962] [INFO ] [MAIN ] Derivative Progress: 1631/2093 symbols completed. SBI took 1.2s. Estimated remaining: 2m 59s. Rate: 154.8 symbols/min [2025-09-19T22:25:58.624530] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:58.599398] [DEBUG] [LOCAL ] SBH: Derivative data saved (1820 records). [2025-09-19T22:25:58.627910] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-19T22:25:58.660817] [INFO ] [MAIN ] Derivative Progress: 1632/2093 symbols completed. SBH took 1.4s. Estimated remaining: 2m 59s. Rate: 154.8 symbols/min [2025-09-19T22:25:58.661298] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:58.801629] [DEBUG] [LOCAL ] SBSI: Loaded 14897 existing records from primary storage. [2025-09-19T22:25:58.801954] [INFO ] [MAIN ] SBSI: Loaded 14897 primary data records. [2025-09-19T22:25:59.036693] [DEBUG] [LOCAL ] SBS: Loaded 50107 existing records from primary storage. [2025-09-19T22:25:59.035911] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:59.144120] [INFO ] [MAIN ] SBS: Loaded 50107 primary data records. [2025-09-19T22:25:59.153250] [INFO ] [MAIN ] SBR: Generated 1820 derivative records from 7374 primary records. [2025-09-19T22:25:59.186523] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-19T22:25:59.488001] [DEBUG] [LOCAL ] SBR: Derivative data saved (1820 records). [2025-09-19T22:25:59.488520] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-19T22:25:59.490717] [INFO ] [MAIN ] Derivative Progress: 1633/2093 symbols completed. SBR took 1.1s. Estimated remaining: 2m 58s. Rate: 154.7 symbols/min [2025-09-19T22:25:59.511130] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:59.511894] [INFO ] [MAIN ] SBSI: Generated 1820 derivative records from 14897 primary records. [2025-09-19T22:25:59.512161] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-19T22:25:59.529004] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1820 records). [2025-09-19T22:25:59.529203] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-19T22:25:59.531510] [INFO ] [MAIN ] Derivative Progress: 1634/2093 symbols completed. SBSI took 0.9s. Estimated remaining: 2m 58s. Rate: 154.8 symbols/min [2025-09-19T22:25:59.546601] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:25:59.547159] [INFO ] [MAIN ] SBS: Generated 1820 derivative records from 50107 primary records. [2025-09-19T22:25:59.547220] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-19T22:25:59.562758] [DEBUG] [LOCAL ] SBS: Derivative data saved (1820 records). [2025-09-19T22:25:59.562817] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-19T22:25:59.565766] [INFO ] [MAIN ] Derivative Progress: 1635/2093 symbols completed. SBS took 1.0s. Estimated remaining: 2m 57s. Rate: 154.9 symbols/min [2025-09-19T22:25:59.566390] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:59.566329] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:59.566599] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:25:59.586402] [DEBUG] [LOCAL ] SCD: Loaded 12773 existing records from primary storage. [2025-09-19T22:25:59.587139] [INFO ] [MAIN ] SCD: Loaded 12773 primary data records. [2025-09-19T22:25:59.985015] [DEBUG] [LOCAL ] SCCO: Loaded 50123 existing records from primary storage. [2025-09-19T22:25:59.986619] [DEBUG] [LOCAL ] SBSW: Loaded 53695 existing records from primary storage. [2025-09-19T22:25:59.986923] [INFO ] [MAIN ] SCCO: Loaded 50123 primary data records. [2025-09-19T22:25:59.987044] [INFO ] [MAIN ] SBSW: Loaded 53695 primary data records. [2025-09-19T22:26:00.634518] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:00.636274] [INFO ] [MAIN ] SCD: Generated 1820 derivative records from 12773 primary records. [2025-09-19T22:26:00.636603] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-19T22:26:00.655345] [DEBUG] [LOCAL ] SCD: Derivative data saved (1820 records). [2025-09-19T22:26:00.655424] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-19T22:26:00.657723] [INFO ] [MAIN ] Derivative Progress: 1636/2093 symbols completed. SCD took 1.1s. Estimated remaining: 2m 57s. Rate: 154.7 symbols/min [2025-09-19T22:26:00.658328] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:00.677062] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:00.679845] [INFO ] [MAIN ] SBSW: Generated 1820 derivative records from 53695 primary records. [2025-09-19T22:26:00.680068] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-19T22:26:00.705925] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:00.707904] [INFO ] [MAIN ] SCCO: Generated 1820 derivative records from 50123 primary records. [2025-09-19T22:26:00.708343] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-19T22:26:00.728251] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1820 records). [2025-09-19T22:26:00.728391] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-19T22:26:00.732167] [INFO ] [MAIN ] Derivative Progress: 1637/2093 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 57s. Rate: 154.8 symbols/min [2025-09-19T22:26:00.732868] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:00.734993] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1820 records). [2025-09-19T22:26:00.735286] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-19T22:26:00.738879] [INFO ] [MAIN ] Derivative Progress: 1638/2093 symbols completed. SBSW took 1.2s. Estimated remaining: 2m 56s. Rate: 154.9 symbols/min [2025-09-19T22:26:00.739289] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:00.771435] [DEBUG] [LOCAL ] SCL: Loaded 15051 existing records from primary storage. [2025-09-19T22:26:00.771758] [INFO ] [MAIN ] SCL: Loaded 15051 primary data records. [2025-09-19T22:26:00.846910] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-09-19T22:26:00.869073] [INFO ] [MAIN ] SCHW: Loaded 54465 primary data records. [2025-09-19T22:26:01.157598] [DEBUG] [LOCAL ] SCI: Loaded 47400 existing records from primary storage. [2025-09-19T22:26:01.333514] [INFO ] [MAIN ] SCI: Loaded 47400 primary data records. [2025-09-19T22:26:01.841447] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:01.842815] [INFO ] [MAIN ] SCL: Generated 1820 derivative records from 15051 primary records. [2025-09-19T22:26:01.843005] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-19T22:26:01.856548] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:01.865355] [INFO ] [MAIN ] SCHW: Generated 1820 derivative records from 54465 primary records. [2025-09-19T22:26:01.869408] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-19T22:26:01.889823] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1820 records). [2025-09-19T22:26:01.891302] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-19T22:26:01.893776] [INFO ] [MAIN ] Derivative Progress: 1639/2093 symbols completed. SCHW took 1.2s. Estimated remaining: 2m 56s. Rate: 154.7 symbols/min [2025-09-19T22:26:01.895089] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:01.898004] [DEBUG] [LOCAL ] SCL: Derivative data saved (1820 records). [2025-09-19T22:26:01.902981] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-19T22:26:01.905010] [INFO ] [MAIN ] Derivative Progress: 1640/2093 symbols completed. SCL took 1.2s. Estimated remaining: 2m 56s. Rate: 154.8 symbols/min [2025-09-19T22:26:01.905535] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:01.919315] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:01.925267] [INFO ] [MAIN ] SCI: Generated 1820 derivative records from 47400 primary records. [2025-09-19T22:26:01.925492] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-19T22:26:01.946838] [DEBUG] [LOCAL ] SCM: Loaded 20453 existing records from primary storage. [2025-09-19T22:26:01.947501] [INFO ] [MAIN ] SCM: Loaded 20453 primary data records. [2025-09-19T22:26:01.992246] [DEBUG] [LOCAL ] SCI: Derivative data saved (1820 records). [2025-09-19T22:26:02.018698] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-19T22:26:02.037827] [INFO ] [MAIN ] Derivative Progress: 1641/2093 symbols completed. SCI took 1.3s. Estimated remaining: 2m 55s. Rate: 154.9 symbols/min [2025-09-19T22:26:02.064134] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:02.280028] [DEBUG] [LOCAL ] SCS: Loaded 43502 existing records from primary storage. [2025-09-19T22:26:02.280232] [INFO ] [MAIN ] SCS: Loaded 43502 primary data records. [2025-09-19T22:26:02.458823] [DEBUG] [LOCAL ] SD: Loaded 29680 existing records from primary storage. [2025-09-19T22:26:02.495941] [INFO ] [MAIN ] SD: Loaded 29680 primary data records. [2025-09-19T22:26:02.830974] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:02.945459] [INFO ] [MAIN ] SCM: Generated 1820 derivative records from 20453 primary records. [2025-09-19T22:26:02.954127] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-19T22:26:02.977016] [DEBUG] [LOCAL ] SCM: Derivative data saved (1820 records). [2025-09-19T22:26:02.977919] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-19T22:26:02.980310] [INFO ] [MAIN ] Derivative Progress: 1642/2093 symbols completed. SCM took 1.1s. Estimated remaining: 2m 55s. Rate: 154.7 symbols/min [2025-09-19T22:26:02.981806] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:02.995800] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:02.996463] [INFO ] [MAIN ] SCS: Generated 1820 derivative records from 43502 primary records. [2025-09-19T22:26:02.996706] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-19T22:26:03.020149] [DEBUG] [LOCAL ] SDHC: Loaded 10760 existing records from primary storage. [2025-09-19T22:26:03.022576] [INFO ] [MAIN ] SDHC: Loaded 10760 primary data records. [2025-09-19T22:26:03.054144] [DEBUG] [LOCAL ] SCS: Derivative data saved (1820 records). [2025-09-19T22:26:03.059349] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-19T22:26:03.061818] [INFO ] [MAIN ] Derivative Progress: 1643/2093 symbols completed. SCS took 1.2s. Estimated remaining: 2m 54s. Rate: 154.8 symbols/min [2025-09-19T22:26:03.062058] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:03.114383] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:03.120324] [INFO ] [MAIN ] SD: Generated 1820 derivative records from 29680 primary records. [2025-09-19T22:26:03.120498] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-19T22:26:03.211170] [DEBUG] [LOCAL ] SDHY: Loaded 10852 existing records from primary storage. [2025-09-19T22:26:03.235211] [INFO ] [MAIN ] SDHY: Loaded 10852 primary data records. [2025-09-19T22:26:03.465175] [DEBUG] [LOCAL ] SD: Derivative data saved (1820 records). [2025-09-19T22:26:03.465988] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-19T22:26:03.469226] [INFO ] [MAIN ] Derivative Progress: 1644/2093 symbols completed. SD took 1.4s. Estimated remaining: 2m 54s. Rate: 154.8 symbols/min [2025-09-19T22:26:03.485480] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:03.728434] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:03.739003] [INFO ] [MAIN ] SDHC: Generated 1819 derivative records from 10760 primary records. [2025-09-19T22:26:03.739266] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-19T22:26:03.768191] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1819 records). [2025-09-19T22:26:03.768996] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-19T22:26:03.771094] [INFO ] [MAIN ] Derivative Progress: 1645/2093 symbols completed. SDHC took 0.8s. Estimated remaining: 2m 54s. Rate: 154.8 symbols/min [2025-09-19T22:26:03.768828] [DEBUG] [LOCAL ] SDRL: Loaded 42790 existing records from primary storage. [2025-09-19T22:26:03.771257] [INFO ] [MAIN ] SDRL: Loaded 42790 primary data records. [2025-09-19T22:26:03.771581] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:03.889916] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:03.913141] [INFO ] [MAIN ] SDHY: Generated 1820 derivative records from 10852 primary records. [2025-09-19T22:26:03.939464] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-19T22:26:04.126851] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1820 records). [2025-09-19T22:26:04.128811] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-19T22:26:04.131528] [INFO ] [MAIN ] Derivative Progress: 1646/2093 symbols completed. SDHY took 1.1s. Estimated remaining: 2m 53s. Rate: 154.8 symbols/min [2025-09-19T22:26:04.132337] [DEBUG] [LOCAL ] SEE: Loaded 49178 existing records from primary storage. [2025-09-19T22:26:04.133134] [INFO ] [MAIN ] SEE: Loaded 49178 primary data records. [2025-09-19T22:26:04.132903] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:04.278229] [DEBUG] [LOCAL ] SEG: Loaded 14131 existing records from primary storage. [2025-09-19T22:26:04.327519] [INFO ] [MAIN ] SEG: Loaded 14131 primary data records. [2025-09-19T22:26:04.562487] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:04.581008] [INFO ] [MAIN ] SDRL: Generated 1820 derivative records from 42790 primary records. [2025-09-19T22:26:04.581684] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-19T22:26:04.807386] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1820 records). [2025-09-19T22:26:04.808292] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-19T22:26:04.810531] [INFO ] [MAIN ] Derivative Progress: 1647/2093 symbols completed. SDRL took 1.3s. Estimated remaining: 2m 53s. Rate: 154.8 symbols/min [2025-09-19T22:26:04.811186] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:04.830135] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:04.831260] [INFO ] [MAIN ] SEE: Generated 1820 derivative records from 49178 primary records. [2025-09-19T22:26:04.834009] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-19T22:26:04.868898] [DEBUG] [LOCAL ] SEE: Derivative data saved (1820 records). [2025-09-19T22:26:04.869107] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:04.869249] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-19T22:26:04.870016] [INFO ] [MAIN ] SEG: Generated 1820 derivative records from 14131 primary records. [2025-09-19T22:26:04.870151] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-19T22:26:04.872479] [INFO ] [MAIN ] Derivative Progress: 1648/2093 symbols completed. SEE took 1.1s. Estimated remaining: 2m 52s. Rate: 154.8 symbols/min [2025-09-19T22:26:04.899750] [DEBUG] [LOCAL ] SEG: Derivative data saved (1820 records). [2025-09-19T22:26:04.899888] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-19T22:26:04.902675] [INFO ] [MAIN ] Derivative Progress: 1649/2093 symbols completed. SEG took 0.8s. Estimated remaining: 2m 52s. Rate: 154.9 symbols/min [2025-09-19T22:26:04.917760] [DEBUG] [LOCAL ] SEI: Loaded 50377 existing records from primary storage. [2025-09-19T22:26:04.917870] [INFO ] [MAIN ] SEI: Loaded 50377 primary data records. [2025-09-19T22:26:05.234260] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:05.234994] [INFO ] [MAIN ] SEI: Generated 1820 derivative records from 50377 primary records. [2025-09-19T22:26:05.235060] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-19T22:26:05.251141] [DEBUG] [LOCAL ] SEI: Derivative data saved (1820 records). [2025-09-19T22:26:05.251204] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-19T22:26:05.253234] [INFO ] [MAIN ] Derivative Progress: 1650/2093 symbols completed. SEI took 0.4s. Estimated remaining: 2m 52s. Rate: 154.9 symbols/min [2025-09-19T22:26:05.254258] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:05.254339] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:05.254499] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:05.319364] [DEBUG] [LOCAL ] SEMR: Loaded 42380 existing records from primary storage. [2025-09-19T22:26:05.345337] [INFO ] [MAIN ] SEMR: Loaded 42380 primary data records. [2025-09-19T22:26:05.346185] [DEBUG] [LOCAL ] SEM: Loaded 43721 existing records from primary storage. [2025-09-19T22:26:05.358115] [DEBUG] [LOCAL ] SES: Loaded 52296 existing records from primary storage. [2025-09-19T22:26:05.358231] [INFO ] [MAIN ] SEM: Loaded 43721 primary data records. [2025-09-19T22:26:05.438821] [INFO ] [MAIN ] SES: Loaded 52296 primary data records. [2025-09-19T22:26:06.340795] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:06.342076] [INFO ] [MAIN ] SEMR: Generated 1820 derivative records from 42380 primary records. [2025-09-19T22:26:06.366581] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-19T22:26:06.367763] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:06.368938] [INFO ] [MAIN ] SEM: Generated 1820 derivative records from 43721 primary records. [2025-09-19T22:26:06.369083] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-19T22:26:06.370560] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:06.385924] [INFO ] [MAIN ] SES: Generated 1820 derivative records from 52296 primary records. [2025-09-19T22:26:06.393616] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-19T22:26:06.413911] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1820 records). [2025-09-19T22:26:06.414049] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-19T22:26:06.414922] [DEBUG] [LOCAL ] SEM: Derivative data saved (1820 records). [2025-09-19T22:26:06.416977] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-19T22:26:06.416834] [INFO ] [MAIN ] Derivative Progress: 1651/2093 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 51s. Rate: 154.7 symbols/min [2025-09-19T22:26:06.417798] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:06.420386] [INFO ] [MAIN ] Derivative Progress: 1652/2093 symbols completed. SEM took 1.2s. Estimated remaining: 2m 51s. Rate: 154.8 symbols/min [2025-09-19T22:26:06.421292] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:06.426086] [DEBUG] [LOCAL ] SES: Derivative data saved (1820 records). [2025-09-19T22:26:06.427432] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-19T22:26:06.429960] [INFO ] [MAIN ] Derivative Progress: 1653/2093 symbols completed. SES took 1.2s. Estimated remaining: 2m 50s. Rate: 154.9 symbols/min [2025-09-19T22:26:06.430416] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:06.434053] [DEBUG] [LOCAL ] SFB: Loaded 4115 existing records from primary storage. [2025-09-19T22:26:06.434236] [INFO ] [MAIN ] SFB: Loaded 4115 primary data records. [2025-09-19T22:26:06.659818] [DEBUG] [LOCAL ] SFBS: Loaded 21769 existing records from primary storage. [2025-09-19T22:26:06.680726] [INFO ] [MAIN ] SFBS: Loaded 21769 primary data records. [2025-09-19T22:26:06.859356] [DEBUG] [LOCAL ] SF: Loaded 42554 existing records from primary storage. [2025-09-19T22:26:06.877161] [INFO ] [MAIN ] SF: Loaded 42554 primary data records. [2025-09-19T22:26:07.446987] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:07.449364] [INFO ] [MAIN ] SFB: Generated 1820 derivative records from 4115 primary records. [2025-09-19T22:26:07.449883] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-19T22:26:07.467150] [DEBUG] [LOCAL ] SFB: Derivative data saved (1820 records). [2025-09-19T22:26:07.467364] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-19T22:26:07.469831] [INFO ] [MAIN ] Derivative Progress: 1654/2093 symbols completed. SFB took 1.0s. Estimated remaining: 2m 50s. Rate: 154.8 symbols/min [2025-09-19T22:26:07.470617] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:07.505065] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:07.505417] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:07.506269] [INFO ] [MAIN ] SFBS: Generated 1820 derivative records from 21769 primary records. [2025-09-19T22:26:07.506961] [INFO ] [MAIN ] SF: Generated 1820 derivative records from 42554 primary records. [2025-09-19T22:26:07.507030] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-19T22:26:07.507908] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-19T22:26:07.537233] [DEBUG] [LOCAL ] SF: Derivative data saved (1820 records). [2025-09-19T22:26:07.537959] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-19T22:26:07.541005] [INFO ] [MAIN ] Derivative Progress: 1655/2093 symbols completed. SF took 1.1s. Estimated remaining: 2m 50s. Rate: 154.8 symbols/min [2025-09-19T22:26:07.552006] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:07.555670] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1820 records). [2025-09-19T22:26:07.555779] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-19T22:26:07.558065] [INFO ] [MAIN ] Derivative Progress: 1656/2093 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 49s. Rate: 154.9 symbols/min [2025-09-19T22:26:07.558457] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:07.573991] [DEBUG] [LOCAL ] SFL: Loaded 46153 existing records from primary storage. [2025-09-19T22:26:07.574133] [INFO ] [MAIN ] SFL: Loaded 46153 primary data records. [2025-09-19T22:26:07.961545] [DEBUG] [LOCAL ] SGHC: Loaded 46162 existing records from primary storage. [2025-09-19T22:26:07.962395] [DEBUG] [LOCAL ] SG: Loaded 54238 existing records from primary storage. [2025-09-19T22:26:07.962516] [INFO ] [MAIN ] SGHC: Loaded 46162 primary data records. [2025-09-19T22:26:07.962604] [INFO ] [MAIN ] SG: Loaded 54238 primary data records. [2025-09-19T22:26:08.609999] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:08.611008] [INFO ] [MAIN ] SFL: Generated 1820 derivative records from 46153 primary records. [2025-09-19T22:26:08.612377] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-19T22:26:08.629943] [DEBUG] [LOCAL ] SFL: Derivative data saved (1820 records). [2025-09-19T22:26:08.630066] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-19T22:26:08.632323] [INFO ] [MAIN ] Derivative Progress: 1657/2093 symbols completed. SFL took 1.2s. Estimated remaining: 2m 49s. Rate: 154.8 symbols/min [2025-09-19T22:26:08.633081] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:08.657461] [DEBUG] [LOCAL ] SGU: Loaded 6721 existing records from primary storage. [2025-09-19T22:26:08.654262] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:08.657621] [INFO ] [MAIN ] SGU: Loaded 6721 primary data records. [2025-09-19T22:26:08.669540] [INFO ] [MAIN ] SG: Generated 1820 derivative records from 54238 primary records. [2025-09-19T22:26:08.679412] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-19T22:26:08.714953] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:08.742390] [INFO ] [MAIN ] SGHC: Generated 1820 derivative records from 46162 primary records. [2025-09-19T22:26:08.759486] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-19T22:26:08.825289] [DEBUG] [LOCAL ] SG: Derivative data saved (1820 records). [2025-09-19T22:26:08.857192] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-19T22:26:08.876379] [INFO ] [MAIN ] Derivative Progress: 1658/2093 symbols completed. SG took 1.3s. Estimated remaining: 2m 49s. Rate: 154.8 symbols/min [2025-09-19T22:26:08.883796] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:08.886473] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1820 records). [2025-09-19T22:26:08.886681] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-19T22:26:09.003415] [INFO ] [MAIN ] Derivative Progress: 1659/2093 symbols completed. SGHC took 1.4s. Estimated remaining: 2m 48s. Rate: 154.9 symbols/min [2025-09-19T22:26:09.003920] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:09.043975] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:09.046068] [DEBUG] [LOCAL ] SHCO: Loaded 26650 existing records from primary storage. [2025-09-19T22:26:09.045612] [INFO ] [MAIN ] SGU: Generated 1820 derivative records from 6721 primary records. [2025-09-19T22:26:09.046207] [INFO ] [MAIN ] SHCO: Loaded 26650 primary data records. [2025-09-19T22:26:09.046252] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-19T22:26:09.127612] [DEBUG] [LOCAL ] SGU: Derivative data saved (1820 records). [2025-09-19T22:26:09.159319] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-19T22:26:09.175345] [INFO ] [MAIN ] Derivative Progress: 1660/2093 symbols completed. SGU took 0.5s. Estimated remaining: 2m 48s. Rate: 154.9 symbols/min [2025-09-19T22:26:09.208184] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:09.241917] [DEBUG] [LOCAL ] SHAK: Loaded 49932 existing records from primary storage. [2025-09-19T22:26:09.250005] [INFO ] [MAIN ] SHAK: Loaded 49932 primary data records. [2025-09-19T22:26:09.772829] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:09.773738] [INFO ] [MAIN ] SHCO: Generated 1820 derivative records from 26650 primary records. [2025-09-19T22:26:09.773940] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-19T22:26:09.775095] [DEBUG] [LOCAL ] SHEL: Loaded 54452 existing records from primary storage. [2025-09-19T22:26:09.775873] [INFO ] [MAIN ] SHEL: Loaded 54452 primary data records. [2025-09-19T22:26:09.846445] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1820 records). [2025-09-19T22:26:09.895042] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-19T22:26:09.897735] [INFO ] [MAIN ] Derivative Progress: 1661/2093 symbols completed. SHCO took 0.9s. Estimated remaining: 2m 47s. Rate: 154.8 symbols/min [2025-09-19T22:26:09.898756] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:09.961435] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:09.992390] [INFO ] [MAIN ] SHAK: Generated 1820 derivative records from 49932 primary records. [2025-09-19T22:26:09.992512] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-19T22:26:10.128080] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1820 records). [2025-09-19T22:26:10.135666] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-19T22:26:10.138243] [INFO ] [MAIN ] Derivative Progress: 1662/2093 symbols completed. SHAK took 1.3s. Estimated remaining: 2m 47s. Rate: 154.9 symbols/min [2025-09-19T22:26:10.138826] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:10.151884] [DEBUG] [LOCAL ] SHG: Loaded 27955 existing records from primary storage. [2025-09-19T22:26:10.152035] [INFO ] [MAIN ] SHG: Loaded 27955 primary data records. [2025-09-19T22:26:10.518768] [DEBUG] [LOCAL ] SHO: Loaded 50584 existing records from primary storage. [2025-09-19T22:26:10.519196] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:10.519882] [INFO ] [MAIN ] SHO: Loaded 50584 primary data records. [2025-09-19T22:26:10.520694] [INFO ] [MAIN ] SHEL: Generated 1820 derivative records from 54452 primary records. [2025-09-19T22:26:10.520907] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-19T22:26:10.642760] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1820 records). [2025-09-19T22:26:10.642937] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-19T22:26:10.666886] [INFO ] [MAIN ] Derivative Progress: 1663/2093 symbols completed. SHEL took 1.5s. Estimated remaining: 2m 47s. Rate: 154.8 symbols/min [2025-09-19T22:26:10.857199] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:10.858249] [INFO ] [MAIN ] SHG: Generated 1820 derivative records from 27955 primary records. [2025-09-19T22:26:10.858431] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-19T22:26:10.875135] [DEBUG] [LOCAL ] SHG: Derivative data saved (1820 records). [2025-09-19T22:26:10.875426] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-19T22:26:10.877663] [INFO ] [MAIN ] Derivative Progress: 1664/2093 symbols completed. SHG took 1.0s. Estimated remaining: 2m 46s. Rate: 154.9 symbols/min [2025-09-19T22:26:10.893978] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:10.898538] [INFO ] [MAIN ] SHO: Generated 1820 derivative records from 50584 primary records. [2025-09-19T22:26:10.898691] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-19T22:26:10.914215] [DEBUG] [LOCAL ] SHO: Derivative data saved (1820 records). [2025-09-19T22:26:10.914273] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-19T22:26:10.916243] [INFO ] [MAIN ] Derivative Progress: 1665/2093 symbols completed. SHO took 0.8s. Estimated remaining: 2m 46s. Rate: 155.0 symbols/min [2025-09-19T22:26:10.916877] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:10.916752] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:10.917018] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:10.924674] [DEBUG] [LOCAL ] SHOC: Loaded 4258 existing records from primary storage. [2025-09-19T22:26:10.924942] [INFO ] [MAIN ] SHOC: Loaded 4258 primary data records. [2025-09-19T22:26:11.271176] [DEBUG] [LOCAL ] SID: Loaded 42784 existing records from primary storage. [2025-09-19T22:26:11.273682] [INFO ] [MAIN ] SID: Loaded 42784 primary data records. [2025-09-19T22:26:11.286159] [DEBUG] [LOCAL ] SHW: Loaded 51268 existing records from primary storage. [2025-09-19T22:26:11.319227] [INFO ] [MAIN ] SHW: Loaded 51268 primary data records. [2025-09-19T22:26:11.965941] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:11.967532] [INFO ] [MAIN ] SHOC: Generated 1819 derivative records from 4258 primary records. [2025-09-19T22:26:11.967974] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-19T22:26:11.988156] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1819 records). [2025-09-19T22:26:11.989056] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-19T22:26:11.991456] [INFO ] [MAIN ] Derivative Progress: 1666/2093 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 46s. Rate: 154.8 symbols/min [2025-09-19T22:26:11.992006] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:12.005738] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:12.006949] [INFO ] [MAIN ] SID: Generated 1820 derivative records from 42784 primary records. [2025-09-19T22:26:12.007082] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-19T22:26:12.029202] [DEBUG] [LOCAL ] SID: Derivative data saved (1820 records). [2025-09-19T22:26:12.041982] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-19T22:26:12.045367] [INFO ] [MAIN ] Derivative Progress: 1667/2093 symbols completed. SID took 1.1s. Estimated remaining: 2m 45s. Rate: 154.9 symbols/min [2025-09-19T22:26:12.042865] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:12.046722] [INFO ] [MAIN ] SHW: Generated 1820 derivative records from 51268 primary records. [2025-09-19T22:26:12.045874] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:12.046904] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-19T22:26:12.067454] [DEBUG] [LOCAL ] SHW: Derivative data saved (1820 records). [2025-09-19T22:26:12.067698] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-19T22:26:12.071550] [INFO ] [MAIN ] Derivative Progress: 1668/2093 symbols completed. SHW took 1.2s. Estimated remaining: 2m 45s. Rate: 155.0 symbols/min [2025-09-19T22:26:12.071954] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:12.099045] [DEBUG] [LOCAL ] SII: Loaded 23334 existing records from primary storage. [2025-09-19T22:26:12.099179] [INFO ] [MAIN ] SII: Loaded 23334 primary data records. [2025-09-19T22:26:12.219219] [DEBUG] [LOCAL ] SIG: Loaded 47367 existing records from primary storage. [2025-09-19T22:26:12.230756] [INFO ] [MAIN ] SIG: Loaded 47367 primary data records. [2025-09-19T22:26:12.568569] [DEBUG] [LOCAL ] SILA: Loaded 31717 existing records from primary storage. [2025-09-19T22:26:12.574773] [INFO ] [MAIN ] SILA: Loaded 31717 primary data records. [2025-09-19T22:26:13.112090] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:13.113466] [INFO ] [MAIN ] SII: Generated 1820 derivative records from 23334 primary records. [2025-09-19T22:26:13.113758] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-19T22:26:13.134232] [DEBUG] [LOCAL ] SII: Derivative data saved (1820 records). [2025-09-19T22:26:13.134740] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-19T22:26:13.136701] [INFO ] [MAIN ] Derivative Progress: 1669/2093 symbols completed. SII took 1.1s. Estimated remaining: 2m 44s. Rate: 154.8 symbols/min [2025-09-19T22:26:13.137089] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:13.150887] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:13.151713] [INFO ] [MAIN ] SIG: Generated 1820 derivative records from 47367 primary records. [2025-09-19T22:26:13.151936] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-19T22:26:13.168552] [DEBUG] [LOCAL ] SIG: Derivative data saved (1820 records). [2025-09-19T22:26:13.170972] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-19T22:26:13.173200] [INFO ] [MAIN ] Derivative Progress: 1670/2093 symbols completed. SIG took 1.2s. Estimated remaining: 2m 44s. Rate: 154.9 symbols/min [2025-09-19T22:26:13.173591] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:13.188179] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:13.188963] [INFO ] [MAIN ] SILA: Generated 1820 derivative records from 31717 primary records. [2025-09-19T22:26:13.189084] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-19T22:26:13.214839] [DEBUG] [LOCAL ] SILA: Derivative data saved (1820 records). [2025-09-19T22:26:13.215101] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-19T22:26:13.217818] [INFO ] [MAIN ] Derivative Progress: 1671/2093 symbols completed. SILA took 1.1s. Estimated remaining: 2m 43s. Rate: 155.0 symbols/min [2025-09-19T22:26:13.218919] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:13.234476] [DEBUG] [LOCAL ] SITC: Loaded 42271 existing records from primary storage. [2025-09-19T22:26:13.242421] [INFO ] [MAIN ] SITC: Loaded 42271 primary data records. [2025-09-19T22:26:13.373474] [DEBUG] [LOCAL ] SITE: Loaded 35827 existing records from primary storage. [2025-09-19T22:26:13.383982] [INFO ] [MAIN ] SITE: Loaded 35827 primary data records. [2025-09-19T22:26:13.748447] [DEBUG] [LOCAL ] SJM: Loaded 50900 existing records from primary storage. [2025-09-19T22:26:13.775477] [INFO ] [MAIN ] SJM: Loaded 50900 primary data records. [2025-09-19T22:26:14.248726] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:14.250354] [INFO ] [MAIN ] SITC: Generated 1820 derivative records from 42271 primary records. [2025-09-19T22:26:14.250470] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-19T22:26:14.270251] [DEBUG] [LOCAL ] SITC: Derivative data saved (1820 records). [2025-09-19T22:26:14.270404] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-19T22:26:14.272992] [INFO ] [MAIN ] Derivative Progress: 1672/2093 symbols completed. SITC took 1.1s. Estimated remaining: 2m 43s. Rate: 154.8 symbols/min [2025-09-19T22:26:14.273509] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:14.287532] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:14.288282] [INFO ] [MAIN ] SITE: Generated 1820 derivative records from 35827 primary records. [2025-09-19T22:26:14.288478] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-19T22:26:14.305696] [DEBUG] [LOCAL ] SITE: Derivative data saved (1820 records). [2025-09-19T22:26:14.305946] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-19T22:26:14.308260] [INFO ] [MAIN ] Derivative Progress: 1673/2093 symbols completed. SITE took 1.1s. Estimated remaining: 2m 43s. Rate: 154.9 symbols/min [2025-09-19T22:26:14.316498] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:14.340142] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:14.340582] [DEBUG] [LOCAL ] SJT: Loaded 22386 existing records from primary storage. [2025-09-19T22:26:14.340696] [INFO ] [MAIN ] SJT: Loaded 22386 primary data records. [2025-09-19T22:26:14.362204] [INFO ] [MAIN ] SJM: Generated 1820 derivative records from 50900 primary records. [2025-09-19T22:26:14.384369] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-19T22:26:14.556851] [DEBUG] [LOCAL ] SKE: Loaded 35981 existing records from primary storage. [2025-09-19T22:26:14.557208] [INFO ] [MAIN ] SKE: Loaded 35981 primary data records. [2025-09-19T22:26:14.559066] [DEBUG] [LOCAL ] SJM: Derivative data saved (1820 records). [2025-09-19T22:26:14.570288] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-19T22:26:14.751014] [INFO ] [MAIN ] Derivative Progress: 1674/2093 symbols completed. SJM took 1.5s. Estimated remaining: 2m 42s. Rate: 154.9 symbols/min [2025-09-19T22:26:14.784698] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:14.860998] [DEBUG] [LOCAL ] SKIL: Loaded 6478 existing records from primary storage. [2025-09-19T22:26:14.992919] [INFO ] [MAIN ] SKIL: Loaded 6478 primary data records. [2025-09-19T22:26:15.331850] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:15.332840] [INFO ] [MAIN ] SJT: Generated 1820 derivative records from 22386 primary records. [2025-09-19T22:26:15.333038] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-19T22:26:15.351360] [DEBUG] [LOCAL ] SJT: Derivative data saved (1820 records). [2025-09-19T22:26:15.352117] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-19T22:26:15.355208] [INFO ] [MAIN ] Derivative Progress: 1675/2093 symbols completed. SJT took 1.1s. Estimated remaining: 2m 42s. Rate: 154.8 symbols/min [2025-09-19T22:26:15.356748] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:15.373902] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:15.374971] [INFO ] [MAIN ] SKE: Generated 1820 derivative records from 35981 primary records. [2025-09-19T22:26:15.375153] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-19T22:26:15.399706] [DEBUG] [LOCAL ] SKE: Derivative data saved (1820 records). [2025-09-19T22:26:15.400108] [DEBUG] [LOCAL ] SKLZ: Loaded 12179 existing records from primary storage. [2025-09-19T22:26:15.400362] [INFO ] [MAIN ] SKLZ: Loaded 12179 primary data records. [2025-09-19T22:26:15.400439] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-19T22:26:15.402889] [INFO ] [MAIN ] Derivative Progress: 1676/2093 symbols completed. SKE took 1.1s. Estimated remaining: 2m 42s. Rate: 154.9 symbols/min [2025-09-19T22:26:15.424113] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:15.530547] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:15.552822] [INFO ] [MAIN ] SKIL: Generated 1820 derivative records from 6478 primary records. [2025-09-19T22:26:15.580305] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-19T22:26:15.795788] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1820 records). [2025-09-19T22:26:15.797156] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-19T22:26:15.800024] [INFO ] [MAIN ] Derivative Progress: 1677/2093 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 41s. Rate: 154.9 symbols/min [2025-09-19T22:26:15.800349] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:15.814281] [DEBUG] [LOCAL ] SKM: Loaded 35883 existing records from primary storage. [2025-09-19T22:26:15.814631] [INFO ] [MAIN ] SKM: Loaded 35883 primary data records. [2025-09-19T22:26:16.168845] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:16.169669] [DEBUG] [LOCAL ] SKT: Loaded 43272 existing records from primary storage. [2025-09-19T22:26:16.170669] [INFO ] [MAIN ] SKLZ: Generated 1820 derivative records from 12179 primary records. [2025-09-19T22:26:16.171412] [INFO ] [MAIN ] SKT: Loaded 43272 primary data records. [2025-09-19T22:26:16.171294] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-19T22:26:16.293917] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1820 records). [2025-09-19T22:26:16.299831] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-19T22:26:16.302480] [INFO ] [MAIN ] Derivative Progress: 1678/2093 symbols completed. SKLZ took 0.9s. Estimated remaining: 2m 41s. Rate: 154.9 symbols/min [2025-09-19T22:26:16.507026] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:16.507842] [INFO ] [MAIN ] SKM: Generated 1820 derivative records from 35883 primary records. [2025-09-19T22:26:16.507959] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-19T22:26:16.529027] [DEBUG] [LOCAL ] SKM: Derivative data saved (1820 records). [2025-09-19T22:26:16.529202] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-19T22:26:16.531672] [INFO ] [MAIN ] Derivative Progress: 1679/2093 symbols completed. SKM took 1.1s. Estimated remaining: 2m 40s. Rate: 154.9 symbols/min [2025-09-19T22:26:16.549170] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:16.549822] [INFO ] [MAIN ] SKT: Generated 1820 derivative records from 43272 primary records. [2025-09-19T22:26:16.549905] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-19T22:26:16.565608] [DEBUG] [LOCAL ] SKT: Derivative data saved (1820 records). [2025-09-19T22:26:16.565694] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-19T22:26:16.568060] [INFO ] [MAIN ] Derivative Progress: 1680/2093 symbols completed. SKT took 0.8s. Estimated remaining: 2m 40s. Rate: 155.0 symbols/min [2025-09-19T22:26:16.568972] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:16.568719] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:16.569166] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:16.593454] [DEBUG] [LOCAL ] SKYH: Loaded 16800 existing records from primary storage. [2025-09-19T22:26:16.593970] [INFO ] [MAIN ] SKYH: Loaded 16800 primary data records. [2025-09-19T22:26:16.788662] [DEBUG] [LOCAL ] SKY: Loaded 38269 existing records from primary storage. [2025-09-19T22:26:16.819085] [INFO ] [MAIN ] SKY: Loaded 38269 primary data records. [2025-09-19T22:26:17.012928] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-09-19T22:26:17.040589] [INFO ] [MAIN ] SLB: Loaded 54477 primary data records. [2025-09-19T22:26:17.652525] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:17.654183] [INFO ] [MAIN ] SKYH: Generated 1820 derivative records from 16800 primary records. [2025-09-19T22:26:17.654684] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-19T22:26:17.690937] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:17.691600] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1820 records). [2025-09-19T22:26:17.691751] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-19T22:26:17.692521] [INFO ] [MAIN ] SKY: Generated 1820 derivative records from 38269 primary records. [2025-09-19T22:26:17.694922] [INFO ] [MAIN ] Derivative Progress: 1681/2093 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 40s. Rate: 154.8 symbols/min [2025-09-19T22:26:17.695025] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-19T22:26:17.695393] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:17.715503] [DEBUG] [LOCAL ] SKY: Derivative data saved (1820 records). [2025-09-19T22:26:17.715838] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-19T22:26:17.718228] [INFO ] [MAIN ] Derivative Progress: 1682/2093 symbols completed. SKY took 1.1s. Estimated remaining: 2m 39s. Rate: 154.9 symbols/min [2025-09-19T22:26:17.730688] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:17.731937] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:17.732796] [INFO ] [MAIN ] SLB: Generated 1820 derivative records from 54477 primary records. [2025-09-19T22:26:17.732868] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-19T22:26:17.749930] [DEBUG] [LOCAL ] SLB: Derivative data saved (1820 records). [2025-09-19T22:26:17.750149] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-19T22:26:17.752910] [INFO ] [MAIN ] Derivative Progress: 1683/2093 symbols completed. SLB took 1.2s. Estimated remaining: 2m 39s. Rate: 155.0 symbols/min [2025-09-19T22:26:17.753257] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:17.780069] [DEBUG] [LOCAL ] SLF: Loaded 39801 existing records from primary storage. [2025-09-19T22:26:17.789281] [INFO ] [MAIN ] SLF: Loaded 39801 primary data records. [2025-09-19T22:26:18.013096] [DEBUG] [LOCAL ] SLG: Loaded 46335 existing records from primary storage. [2025-09-19T22:26:18.133731] [INFO ] [MAIN ] SLG: Loaded 46335 primary data records. [2025-09-19T22:26:18.134713] [DEBUG] [LOCAL ] SLGN: Loaded 40961 existing records from primary storage. [2025-09-19T22:26:18.134889] [INFO ] [MAIN ] SLGN: Loaded 40961 primary data records. [2025-09-19T22:26:18.764978] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:18.766597] [INFO ] [MAIN ] SLF: Generated 1820 derivative records from 39801 primary records. [2025-09-19T22:26:18.767634] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-19T22:26:18.791498] [DEBUG] [LOCAL ] SLF: Derivative data saved (1820 records). [2025-09-19T22:26:18.792387] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-19T22:26:18.794980] [INFO ] [MAIN ] Derivative Progress: 1684/2093 symbols completed. SLF took 1.1s. Estimated remaining: 2m 38s. Rate: 154.8 symbols/min [2025-09-19T22:26:18.797190] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:18.811774] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:18.825448] [INFO ] [MAIN ] SLGN: Generated 1820 derivative records from 40961 primary records. [2025-09-19T22:26:18.825626] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-19T22:26:18.826205] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:18.827252] [INFO ] [MAIN ] SLG: Generated 1820 derivative records from 46335 primary records. [2025-09-19T22:26:18.827560] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-19T22:26:18.843539] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1820 records). [2025-09-19T22:26:18.843902] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-19T22:26:18.853466] [INFO ] [MAIN ] Derivative Progress: 1685/2093 symbols completed. SLGN took 1.1s. Estimated remaining: 2m 38s. Rate: 154.9 symbols/min [2025-09-19T22:26:18.853877] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:18.864555] [DEBUG] [LOCAL ] SLG: Derivative data saved (1820 records). [2025-09-19T22:26:18.864847] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-19T22:26:18.867553] [INFO ] [MAIN ] Derivative Progress: 1686/2093 symbols completed. SLG took 1.1s. Estimated remaining: 2m 38s. Rate: 155.0 symbols/min [2025-09-19T22:26:18.867966] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:18.903374] [DEBUG] [LOCAL ] SLVM: Loaded 28435 existing records from primary storage. [2025-09-19T22:26:18.903748] [INFO ] [MAIN ] SLVM: Loaded 28435 primary data records. [2025-09-19T22:26:18.979288] [DEBUG] [LOCAL ] SLQT: Loaded 44891 existing records from primary storage. [2025-09-19T22:26:19.005512] [INFO ] [MAIN ] SLQT: Loaded 44891 primary data records. [2025-09-19T22:26:19.372876] [DEBUG] [LOCAL ] SM: Loaded 53092 existing records from primary storage. [2025-09-19T22:26:19.378960] [INFO ] [MAIN ] SM: Loaded 53092 primary data records. [2025-09-19T22:26:19.959265] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:19.960158] [INFO ] [MAIN ] SLVM: Generated 1820 derivative records from 28435 primary records. [2025-09-19T22:26:19.960476] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-19T22:26:19.979923] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1820 records). [2025-09-19T22:26:19.980100] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-19T22:26:19.982464] [INFO ] [MAIN ] Derivative Progress: 1687/2093 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 37s. Rate: 154.8 symbols/min [2025-09-19T22:26:19.990782] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:19.996807] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:19.997817] [INFO ] [MAIN ] SLQT: Generated 1820 derivative records from 44891 primary records. [2025-09-19T22:26:19.998788] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-19T22:26:20.032970] [DEBUG] [LOCAL ] SMBK: Loaded 8378 existing records from primary storage. [2025-09-19T22:26:20.033909] [INFO ] [MAIN ] SMBK: Loaded 8378 primary data records. [2025-09-19T22:26:20.027897] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:20.035784] [INFO ] [MAIN ] SM: Generated 1820 derivative records from 53092 primary records. [2025-09-19T22:26:20.036596] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-19T22:26:20.123730] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1820 records). [2025-09-19T22:26:20.162417] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-19T22:26:20.179994] [INFO ] [MAIN ] Derivative Progress: 1688/2093 symbols completed. SLQT took 1.4s. Estimated remaining: 2m 37s. Rate: 154.9 symbols/min [2025-09-19T22:26:20.186558] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:20.384220] [DEBUG] [LOCAL ] SM: Derivative data saved (1820 records). [2025-09-19T22:26:20.388520] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-19T22:26:20.392201] [INFO ] [MAIN ] Derivative Progress: 1689/2093 symbols completed. SM took 1.5s. Estimated remaining: 2m 36s. Rate: 154.9 symbols/min [2025-09-19T22:26:20.392766] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:20.403465] [DEBUG] [LOCAL ] SMC: Loaded 11624 existing records from primary storage. [2025-09-19T22:26:20.404048] [INFO ] [MAIN ] SMC: Loaded 11624 primary data records. [2025-09-19T22:26:20.746091] [DEBUG] [LOCAL ] SMFG: Loaded 48863 existing records from primary storage. [2025-09-19T22:26:20.746363] [INFO ] [MAIN ] SMFG: Loaded 48863 primary data records. [2025-09-19T22:26:20.841913] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:20.853458] [INFO ] [MAIN ] SMBK: Generated 1820 derivative records from 8378 primary records. [2025-09-19T22:26:20.870624] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-19T22:26:20.967862] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1820 records). [2025-09-19T22:26:20.968030] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-19T22:26:20.970169] [INFO ] [MAIN ] Derivative Progress: 1690/2093 symbols completed. SMBK took 1.0s. Estimated remaining: 2m 36s. Rate: 154.9 symbols/min [2025-09-19T22:26:21.080728] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:21.108569] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:21.109749] [INFO ] [MAIN ] SMC: Generated 1820 derivative records from 11624 primary records. [2025-09-19T22:26:21.110016] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-19T22:26:21.129150] [DEBUG] [LOCAL ] SMC: Derivative data saved (1820 records). [2025-09-19T22:26:21.129683] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-19T22:26:21.142218] [INFO ] [MAIN ] Derivative Progress: 1691/2093 symbols completed. SMC took 1.0s. Estimated remaining: 2m 36s. Rate: 154.9 symbols/min [2025-09-19T22:26:21.142947] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:21.160586] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:21.176833] [INFO ] [MAIN ] SMFG: Generated 1820 derivative records from 48863 primary records. [2025-09-19T22:26:21.177007] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-19T22:26:21.178213] [DEBUG] [LOCAL ] SMG: Loaded 44842 existing records from primary storage. [2025-09-19T22:26:21.178882] [INFO ] [MAIN ] SMG: Loaded 44842 primary data records. [2025-09-19T22:26:21.235771] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1820 records). [2025-09-19T22:26:21.242947] [DEBUG] [LOCAL ] SMHI: Loaded 14797 existing records from primary storage. [2025-09-19T22:26:21.263690] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-19T22:26:21.268963] [INFO ] [MAIN ] SMHI: Loaded 14797 primary data records. [2025-09-19T22:26:21.293305] [INFO ] [MAIN ] Derivative Progress: 1692/2093 symbols completed. SMFG took 0.9s. Estimated remaining: 2m 35s. Rate: 155.0 symbols/min [2025-09-19T22:26:21.314963] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:21.738852] [DEBUG] [LOCAL ] SMP: Loaded 20250 existing records from primary storage. [2025-09-19T22:26:21.739039] [INFO ] [MAIN ] SMP: Loaded 20250 primary data records. [2025-09-19T22:26:22.233582] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:22.235443] [INFO ] [MAIN ] SMG: Generated 1820 derivative records from 44842 primary records. [2025-09-19T22:26:22.235737] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-19T22:26:22.269120] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:22.271152] [INFO ] [MAIN ] SMHI: Generated 1820 derivative records from 14797 primary records. [2025-09-19T22:26:22.271881] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-19T22:26:22.273095] [DEBUG] [LOCAL ] SMG: Derivative data saved (1820 records). [2025-09-19T22:26:22.273828] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-19T22:26:22.284072] [INFO ] [MAIN ] Derivative Progress: 1693/2093 symbols completed. SMG took 1.3s. Estimated remaining: 2m 35s. Rate: 154.8 symbols/min [2025-09-19T22:26:22.294140] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1820 records). [2025-09-19T22:26:22.294424] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-19T22:26:22.296872] [INFO ] [MAIN ] Derivative Progress: 1694/2093 symbols completed. SMHI took 1.2s. Estimated remaining: 2m 35s. Rate: 154.9 symbols/min [2025-09-19T22:26:22.309982] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:22.310603] [INFO ] [MAIN ] SMP: Generated 1820 derivative records from 20250 primary records. [2025-09-19T22:26:22.310750] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-19T22:26:22.326581] [DEBUG] [LOCAL ] SMP: Derivative data saved (1820 records). [2025-09-19T22:26:22.326669] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-19T22:26:22.329238] [INFO ] [MAIN ] Derivative Progress: 1695/2093 symbols completed. SMP took 1.0s. Estimated remaining: 2m 34s. Rate: 155.0 symbols/min [2025-09-19T22:26:22.330177] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:22.330299] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:22.329990] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:22.372794] [DEBUG] [LOCAL ] SMWB: Loaded 33729 existing records from primary storage. [2025-09-19T22:26:22.372933] [INFO ] [MAIN ] SMWB: Loaded 33729 primary data records. [2025-09-19T22:26:22.574399] [DEBUG] [LOCAL ] SN: Loaded 50520 existing records from primary storage. [2025-09-19T22:26:22.547743] [DEBUG] [LOCAL ] SMRT: Loaded 45073 existing records from primary storage. [2025-09-19T22:26:22.583974] [INFO ] [MAIN ] SMRT: Loaded 45073 primary data records. [2025-09-19T22:26:22.583795] [INFO ] [MAIN ] SN: Loaded 50520 primary data records. [2025-09-19T22:26:23.379020] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:23.380220] [INFO ] [MAIN ] SMWB: Generated 1820 derivative records from 33729 primary records. [2025-09-19T22:26:23.380714] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-19T22:26:23.400399] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1820 records). [2025-09-19T22:26:23.402681] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-19T22:26:23.404819] [INFO ] [MAIN ] Derivative Progress: 1696/2093 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 34s. Rate: 154.8 symbols/min [2025-09-19T22:26:23.405626] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:23.425475] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:23.428663] [INFO ] [MAIN ] SMRT: Generated 1820 derivative records from 45073 primary records. [2025-09-19T22:26:23.429283] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-19T22:26:23.451049] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:23.452977] [INFO ] [MAIN ] SN: Generated 1820 derivative records from 50520 primary records. [2025-09-19T22:26:23.455820] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-19T22:26:23.476252] [DEBUG] [LOCAL ] SN: Derivative data saved (1820 records). [2025-09-19T22:26:23.476676] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-19T22:26:23.479885] [INFO ] [MAIN ] Derivative Progress: 1697/2093 symbols completed. SN took 1.1s. Estimated remaining: 2m 33s. Rate: 154.9 symbols/min [2025-09-19T22:26:23.487688] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:23.488566] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1820 records). [2025-09-19T22:26:23.489113] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-19T22:26:23.492046] [INFO ] [MAIN ] Derivative Progress: 1698/2093 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 33s. Rate: 155.0 symbols/min [2025-09-19T22:26:23.492573] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:23.505403] [DEBUG] [LOCAL ] SNA: Loaded 26834 existing records from primary storage. [2025-09-19T22:26:23.505722] [INFO ] [MAIN ] SNA: Loaded 26834 primary data records. [2025-09-19T22:26:23.546159] [DEBUG] [LOCAL ] SNDA: Loaded 4832 existing records from primary storage. [2025-09-19T22:26:23.579131] [INFO ] [MAIN ] SNDA: Loaded 4832 primary data records. [2025-09-19T22:26:24.056728] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-09-19T22:26:24.161915] [INFO ] [MAIN ] SNAP: Loaded 54576 primary data records. [2025-09-19T22:26:24.541486] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:24.542750] [INFO ] [MAIN ] SNA: Generated 1820 derivative records from 26834 primary records. [2025-09-19T22:26:24.543607] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-19T22:26:24.558408] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:24.572509] [INFO ] [MAIN ] SNDA: Generated 1820 derivative records from 4832 primary records. [2025-09-19T22:26:24.576112] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-19T22:26:24.577324] [DEBUG] [LOCAL ] SNA: Derivative data saved (1820 records). [2025-09-19T22:26:24.577787] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-19T22:26:24.580034] [INFO ] [MAIN ] Derivative Progress: 1699/2093 symbols completed. SNA took 1.2s. Estimated remaining: 2m 33s. Rate: 154.8 symbols/min [2025-09-19T22:26:24.581091] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:24.596795] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1820 records). [2025-09-19T22:26:24.597193] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-19T22:26:24.599723] [INFO ] [MAIN ] Derivative Progress: 1700/2093 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 32s. Rate: 154.9 symbols/min [2025-09-19T22:26:24.600327] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:24.618937] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:24.619827] [INFO ] [MAIN ] SNAP: Generated 1820 derivative records from 54576 primary records. [2025-09-19T22:26:24.619915] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-19T22:26:24.637343] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1820 records). [2025-09-19T22:26:24.637523] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-19T22:26:24.640139] [INFO ] [MAIN ] Derivative Progress: 1701/2093 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 32s. Rate: 155.0 symbols/min [2025-09-19T22:26:24.640557] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:24.677350] [DEBUG] [LOCAL ] SNDR: Loaded 41145 existing records from primary storage. [2025-09-19T22:26:24.677607] [INFO ] [MAIN ] SNDR: Loaded 41145 primary data records. [2025-09-19T22:26:24.802380] [DEBUG] [LOCAL ] SNN: Loaded 44955 existing records from primary storage. [2025-09-19T22:26:24.802701] [INFO ] [MAIN ] SNN: Loaded 44955 primary data records. [2025-09-19T22:26:25.175401] [DEBUG] [LOCAL ] SNV: Loaded 49657 existing records from primary storage. [2025-09-19T22:26:25.201536] [INFO ] [MAIN ] SNV: Loaded 49657 primary data records. [2025-09-19T22:26:25.753777] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:25.755389] [INFO ] [MAIN ] SNDR: Generated 1820 derivative records from 41145 primary records. [2025-09-19T22:26:25.755839] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-19T22:26:25.776359] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1820 records). [2025-09-19T22:26:25.778947] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-19T22:26:25.781187] [INFO ] [MAIN ] Derivative Progress: 1702/2093 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 32s. Rate: 154.8 symbols/min [2025-09-19T22:26:25.781508] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:25.797195] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:25.798142] [INFO ] [MAIN ] SNN: Generated 1820 derivative records from 44955 primary records. [2025-09-19T22:26:25.798308] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-19T22:26:25.815327] [DEBUG] [LOCAL ] SNN: Derivative data saved (1820 records). [2025-09-19T22:26:25.815586] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-19T22:26:25.818321] [INFO ] [MAIN ] Derivative Progress: 1703/2093 symbols completed. SNN took 1.2s. Estimated remaining: 2m 31s. Rate: 154.9 symbols/min [2025-09-19T22:26:25.818832] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:25.836809] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:25.837777] [INFO ] [MAIN ] SNV: Generated 1820 derivative records from 49657 primary records. [2025-09-19T22:26:25.837874] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-19T22:26:25.864321] [DEBUG] [LOCAL ] SNV: Derivative data saved (1820 records). [2025-09-19T22:26:25.864591] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-19T22:26:25.867360] [INFO ] [MAIN ] Derivative Progress: 1704/2093 symbols completed. SNV took 1.2s. Estimated remaining: 2m 31s. Rate: 155.0 symbols/min [2025-09-19T22:26:25.867788] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:25.882154] [DEBUG] [LOCAL ] SNX: Loaded 40267 existing records from primary storage. [2025-09-19T22:26:25.890873] [INFO ] [MAIN ] SNX: Loaded 40267 primary data records. [2025-09-19T22:26:26.037985] [DEBUG] [LOCAL ] SOBO: Loaded 40586 existing records from primary storage. [2025-09-19T22:26:26.103786] [INFO ] [MAIN ] SOBO: Loaded 40586 primary data records. [2025-09-19T22:26:26.347460] [DEBUG] [LOCAL ] SOC: Loaded 50981 existing records from primary storage. [2025-09-19T22:26:26.348370] [INFO ] [MAIN ] SOC: Loaded 50981 primary data records. [2025-09-19T22:26:26.914006] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:26.915371] [INFO ] [MAIN ] SNX: Generated 1820 derivative records from 40267 primary records. [2025-09-19T22:26:26.915469] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-19T22:26:26.934700] [DEBUG] [LOCAL ] SNX: Derivative data saved (1820 records). [2025-09-19T22:26:26.935764] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-19T22:26:26.938320] [INFO ] [MAIN ] Derivative Progress: 1705/2093 symbols completed. SNX took 1.2s. Estimated remaining: 2m 30s. Rate: 154.8 symbols/min [2025-09-19T22:26:26.938734] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:26.952721] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:26.953448] [INFO ] [MAIN ] SOBO: Generated 1820 derivative records from 40586 primary records. [2025-09-19T22:26:26.953773] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-19T22:26:26.974015] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1820 records). [2025-09-19T22:26:26.977372] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-19T22:26:26.979794] [INFO ] [MAIN ] Derivative Progress: 1706/2093 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 30s. Rate: 154.9 symbols/min [2025-09-19T22:26:26.980328] [DEBUG] [LOCAL ] SOJC: Loaded 5218 existing records from primary storage. [2025-09-19T22:26:26.980587] [INFO ] [MAIN ] SOJC: Loaded 5218 primary data records. [2025-09-19T22:26:26.999110] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:27.033377] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:27.055091] [INFO ] [MAIN ] SOC: Generated 1820 derivative records from 50981 primary records. [2025-09-19T22:26:27.063899] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-19T22:26:27.171240] [DEBUG] [LOCAL ] SOJD: Loaded 13155 existing records from primary storage. [2025-09-19T22:26:27.205047] [INFO ] [MAIN ] SOJD: Loaded 13155 primary data records. [2025-09-19T22:26:27.212796] [DEBUG] [LOCAL ] SOC: Derivative data saved (1820 records). [2025-09-19T22:26:27.233625] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-19T22:26:27.386543] [INFO ] [MAIN ] Derivative Progress: 1707/2093 symbols completed. SOC took 1.5s. Estimated remaining: 2m 30s. Rate: 154.9 symbols/min [2025-09-19T22:26:27.415562] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:27.543956] [DEBUG] [LOCAL ] SOJE: Loaded 9557 existing records from primary storage. [2025-09-19T22:26:27.699634] [INFO ] [MAIN ] SOJE: Loaded 9557 primary data records. [2025-09-19T22:26:27.907432] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:27.932858] [INFO ] [MAIN ] SOJC: Generated 1820 derivative records from 5218 primary records. [2025-09-19T22:26:28.040937] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-19T22:26:28.078013] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1820 records). [2025-09-19T22:26:28.078832] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-19T22:26:28.081151] [INFO ] [MAIN ] Derivative Progress: 1708/2093 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 29s. Rate: 154.8 symbols/min [2025-09-19T22:26:28.095012] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:28.095978] [INFO ] [MAIN ] SOJD: Generated 1820 derivative records from 13155 primary records. [2025-09-19T22:26:28.096079] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-19T22:26:28.116799] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1820 records). [2025-09-19T22:26:28.117083] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-19T22:26:28.119749] [INFO ] [MAIN ] Derivative Progress: 1709/2093 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 29s. Rate: 154.9 symbols/min [2025-09-19T22:26:28.135411] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:28.136033] [INFO ] [MAIN ] SOJE: Generated 1820 derivative records from 9557 primary records. [2025-09-19T22:26:28.136094] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-19T22:26:28.151234] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1820 records). [2025-09-19T22:26:28.151315] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-19T22:26:28.154233] [INFO ] [MAIN ] Derivative Progress: 1710/2093 symbols completed. SOJE took 0.7s. Estimated remaining: 2m 28s. Rate: 155.0 symbols/min [2025-09-19T22:26:28.155011] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:28.154937] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:28.155771] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:28.174536] [DEBUG] [LOCAL ] SOL: Loaded 13908 existing records from primary storage. [2025-09-19T22:26:28.174709] [INFO ] [MAIN ] SOL: Loaded 13908 primary data records. [2025-09-19T22:26:28.512088] [DEBUG] [LOCAL ] SON: Loaded 43516 existing records from primary storage. [2025-09-19T22:26:28.620382] [INFO ] [MAIN ] SON: Loaded 43516 primary data records. [2025-09-19T22:26:28.460515] [DEBUG] [LOCAL ] SOLV: Loaded 44919 existing records from primary storage. [2025-09-19T22:26:28.643544] [INFO ] [MAIN ] SOLV: Loaded 44919 primary data records. [2025-09-19T22:26:29.387429] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:29.514070] [INFO ] [MAIN ] SOL: Generated 1820 derivative records from 13908 primary records. [2025-09-19T22:26:29.525050] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-19T22:26:29.543354] [DEBUG] [LOCAL ] SOL: Derivative data saved (1820 records). [2025-09-19T22:26:29.544298] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-19T22:26:29.546719] [INFO ] [MAIN ] Derivative Progress: 1711/2093 symbols completed. SOL took 1.4s. Estimated remaining: 2m 28s. Rate: 154.8 symbols/min [2025-09-19T22:26:29.548250] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:29.579351] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:29.580606] [INFO ] [MAIN ] SON: Generated 1820 derivative records from 43516 primary records. [2025-09-19T22:26:29.580876] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-19T22:26:29.602212] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:29.610521] [INFO ] [MAIN ] SOLV: Generated 1820 derivative records from 44919 primary records. [2025-09-19T22:26:29.611764] [DEBUG] [LOCAL ] SON: Derivative data saved (1820 records). [2025-09-19T22:26:29.611882] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-19T22:26:29.612054] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-19T22:26:29.628362] [INFO ] [MAIN ] Derivative Progress: 1712/2093 symbols completed. SON took 1.5s. Estimated remaining: 2m 28s. Rate: 154.8 symbols/min [2025-09-19T22:26:29.629213] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:29.647584] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1820 records). [2025-09-19T22:26:29.651536] [DEBUG] [LOCAL ] SOR: Loaded 3015 existing records from primary storage. [2025-09-19T22:26:29.651762] [INFO ] [MAIN ] SOR: Loaded 3015 primary data records. [2025-09-19T22:26:29.648723] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-19T22:26:29.684348] [INFO ] [MAIN ] Derivative Progress: 1713/2093 symbols completed. SOLV took 1.5s. Estimated remaining: 2m 27s. Rate: 154.9 symbols/min [2025-09-19T22:26:29.711683] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:29.728683] [DEBUG] [LOCAL ] SONY: Loaded 54141 existing records from primary storage. [2025-09-19T22:26:29.729140] [INFO ] [MAIN ] SONY: Loaded 54141 primary data records. [2025-09-19T22:26:29.873954] [DEBUG] [LOCAL ] SOS: Loaded 7689 existing records from primary storage. [2025-09-19T22:26:29.901638] [INFO ] [MAIN ] SOS: Loaded 7689 primary data records. [2025-09-19T22:26:30.687025] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:30.689210] [INFO ] [MAIN ] SOR: Generated 1820 derivative records from 3015 primary records. [2025-09-19T22:26:30.689589] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-19T22:26:30.715055] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:30.718403] [DEBUG] [LOCAL ] SOR: Derivative data saved (1820 records). [2025-09-19T22:26:30.719438] [INFO ] [MAIN ] SONY: Generated 1820 derivative records from 54141 primary records. [2025-09-19T22:26:30.719532] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-19T22:26:30.719623] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-19T22:26:30.721805] [INFO ] [MAIN ] Derivative Progress: 1714/2093 symbols completed. SOR took 1.1s. Estimated remaining: 2m 27s. Rate: 154.8 symbols/min [2025-09-19T22:26:30.723690] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:30.750364] [DEBUG] [LOCAL ] SONY: Derivative data saved (1820 records). [2025-09-19T22:26:30.750566] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-19T22:26:30.758354] [INFO ] [MAIN ] Derivative Progress: 1715/2093 symbols completed. SONY took 1.2s. Estimated remaining: 2m 26s. Rate: 154.9 symbols/min [2025-09-19T22:26:30.758726] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:30.759124] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:30.760139] [INFO ] [MAIN ] SOS: Generated 1820 derivative records from 7689 primary records. [2025-09-19T22:26:30.760306] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-19T22:26:30.776629] [DEBUG] [LOCAL ] SOS: Derivative data saved (1820 records). [2025-09-19T22:26:30.776878] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-19T22:26:30.779600] [INFO ] [MAIN ] Derivative Progress: 1716/2093 symbols completed. SOS took 1.1s. Estimated remaining: 2m 26s. Rate: 154.9 symbols/min [2025-09-19T22:26:30.780147] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:30.810121] [DEBUG] [LOCAL ] SPB: Loaded 34660 existing records from primary storage. [2025-09-19T22:26:30.810455] [DEBUG] [LOCAL ] SPE: Loaded 6519 existing records from primary storage. [2025-09-19T22:26:30.810863] [INFO ] [MAIN ] SPE: Loaded 6519 primary data records. [2025-09-19T22:26:30.810765] [INFO ] [MAIN ] SPB: Loaded 34660 primary data records. [2025-09-19T22:26:31.069895] [DEBUG] [LOCAL ] SPCE: Loaded 50549 existing records from primary storage. [2025-09-19T22:26:31.101629] [INFO ] [MAIN ] SPCE: Loaded 50549 primary data records. [2025-09-19T22:26:31.867073] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:31.879912] [INFO ] [MAIN ] SPB: Generated 1820 derivative records from 34660 primary records. [2025-09-19T22:26:31.880014] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-19T22:26:31.880372] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:31.881428] [INFO ] [MAIN ] SPE: Generated 1820 derivative records from 6519 primary records. [2025-09-19T22:26:31.881512] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-19T22:26:31.907129] [DEBUG] [LOCAL ] SPB: Derivative data saved (1820 records). [2025-09-19T22:26:31.910542] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-19T22:26:31.922363] [INFO ] [MAIN ] Derivative Progress: 1717/2093 symbols completed. SPB took 1.2s. Estimated remaining: 2m 26s. Rate: 154.8 symbols/min [2025-09-19T22:26:31.929770] [DEBUG] [LOCAL ] SPE: Derivative data saved (1820 records). [2025-09-19T22:26:31.930128] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:31.930562] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:31.930281] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-19T22:26:31.934176] [INFO ] [MAIN ] SPCE: Generated 1820 derivative records from 50549 primary records. [2025-09-19T22:26:31.933230] [INFO ] [MAIN ] Derivative Progress: 1718/2093 symbols completed. SPE took 1.2s. Estimated remaining: 2m 25s. Rate: 154.8 symbols/min [2025-09-19T22:26:31.934282] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-19T22:26:31.938526] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:31.958883] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1820 records). [2025-09-19T22:26:31.959081] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-19T22:26:31.961970] [INFO ] [MAIN ] Derivative Progress: 1719/2093 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 25s. Rate: 154.9 symbols/min [2025-09-19T22:26:31.962357] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:32.000630] [DEBUG] [LOCAL ] SPH: Loaded 18734 existing records from primary storage. [2025-09-19T22:26:32.013147] [INFO ] [MAIN ] SPH: Loaded 18734 primary data records. [2025-09-19T22:26:32.151123] [DEBUG] [LOCAL ] SPGI: Loaded 46568 existing records from primary storage. [2025-09-19T22:26:32.167053] [INFO ] [MAIN ] SPGI: Loaded 46568 primary data records. [2025-09-19T22:26:32.173269] [DEBUG] [LOCAL ] SPG: Loaded 51198 existing records from primary storage. [2025-09-19T22:26:32.203338] [INFO ] [MAIN ] SPG: Loaded 51198 primary data records. [2025-09-19T22:26:32.985374] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:32.986547] [INFO ] [MAIN ] SPH: Generated 1820 derivative records from 18734 primary records. [2025-09-19T22:26:32.986817] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-19T22:26:33.003554] [DEBUG] [LOCAL ] SPH: Derivative data saved (1820 records). [2025-09-19T22:26:33.004545] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-19T22:26:33.008098] [INFO ] [MAIN ] Derivative Progress: 1720/2093 symbols completed. SPH took 1.0s. Estimated remaining: 2m 25s. Rate: 154.8 symbols/min [2025-09-19T22:26:33.008817] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:33.023927] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:33.025446] [INFO ] [MAIN ] SPGI: Generated 1820 derivative records from 46568 primary records. [2025-09-19T22:26:33.025677] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-19T22:26:33.039074] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:33.050999] [INFO ] [MAIN ] SPG: Generated 1820 derivative records from 51198 primary records. [2025-09-19T22:26:33.051525] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-19T22:26:33.080383] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1820 records). [2025-09-19T22:26:33.081006] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-19T22:26:33.084021] [INFO ] [MAIN ] Derivative Progress: 1721/2093 symbols completed. SPGI took 1.1s. Estimated remaining: 2m 24s. Rate: 154.9 symbols/min [2025-09-19T22:26:33.084614] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:33.097825] [DEBUG] [LOCAL ] SPG: Derivative data saved (1820 records). [2025-09-19T22:26:33.099144] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-19T22:26:33.102829] [INFO ] [MAIN ] Derivative Progress: 1722/2093 symbols completed. SPG took 1.2s. Estimated remaining: 2m 24s. Rate: 154.9 symbols/min [2025-09-19T22:26:33.103392] [DEBUG] [LOCAL ] SPHR: Loaded 40825 existing records from primary storage. [2025-09-19T22:26:33.103955] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:33.103909] [INFO ] [MAIN ] SPHR: Loaded 40825 primary data records. [2025-09-19T22:26:33.210969] [DEBUG] [LOCAL ] SPMC: Loaded 5772 existing records from primary storage. [2025-09-19T22:26:33.231564] [INFO ] [MAIN ] SPMC: Loaded 5772 primary data records. [2025-09-19T22:26:33.548089] [DEBUG] [LOCAL ] SPIR: Loaded 38051 existing records from primary storage. [2025-09-19T22:26:33.554702] [INFO ] [MAIN ] SPIR: Loaded 38051 primary data records. [2025-09-19T22:26:34.162713] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:34.164274] [INFO ] [MAIN ] SPHR: Generated 1820 derivative records from 40825 primary records. [2025-09-19T22:26:34.164777] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-19T22:26:34.181393] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1820 records). [2025-09-19T22:26:34.181602] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-19T22:26:34.184572] [INFO ] [MAIN ] Derivative Progress: 1723/2093 symbols completed. SPHR took 1.2s. Estimated remaining: 2m 23s. Rate: 154.8 symbols/min [2025-09-19T22:26:34.202741] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:34.203868] [INFO ] [MAIN ] SPMC: Generated 1819 derivative records from 5772 primary records. [2025-09-19T22:26:34.203951] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-19T22:26:34.222690] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1819 records). [2025-09-19T22:26:34.222905] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-19T22:26:34.225467] [INFO ] [MAIN ] Derivative Progress: 1724/2093 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 23s. Rate: 154.9 symbols/min [2025-09-19T22:26:34.237906] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:34.238476] [INFO ] [MAIN ] SPIR: Generated 1820 derivative records from 38051 primary records. [2025-09-19T22:26:34.238535] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-19T22:26:34.254188] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1820 records). [2025-09-19T22:26:34.254245] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-19T22:26:34.257005] [INFO ] [MAIN ] Derivative Progress: 1725/2093 symbols completed. SPIR took 1.2s. Estimated remaining: 2m 23s. Rate: 154.9 symbols/min [2025-09-19T22:26:34.257794] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:34.257948] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:34.258264] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:34.315629] [DEBUG] [LOCAL ] SPNT: Loaded 35307 existing records from primary storage. [2025-09-19T22:26:34.315953] [INFO ] [MAIN ] SPNT: Loaded 35307 primary data records. [2025-09-19T22:26:34.453793] [DEBUG] [LOCAL ] SPR: Loaded 42074 existing records from primary storage. [2025-09-19T22:26:34.459529] [DEBUG] [LOCAL ] SPOT: Loaded 51750 existing records from primary storage. [2025-09-19T22:26:34.470020] [INFO ] [MAIN ] SPOT: Loaded 51750 primary data records. [2025-09-19T22:26:34.459709] [INFO ] [MAIN ] SPR: Loaded 42074 primary data records. [2025-09-19T22:26:35.330168] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:35.332045] [INFO ] [MAIN ] SPNT: Generated 1820 derivative records from 35307 primary records. [2025-09-19T22:26:35.332423] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-19T22:26:35.376047] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1820 records). [2025-09-19T22:26:35.376187] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-19T22:26:35.378089] [INFO ] [MAIN ] Derivative Progress: 1726/2093 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 22s. Rate: 154.8 symbols/min [2025-09-19T22:26:35.374011] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:35.379183] [INFO ] [MAIN ] SPOT: Generated 1820 derivative records from 51750 primary records. [2025-09-19T22:26:35.392255] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:35.392553] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-19T22:26:35.392966] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:35.395176] [INFO ] [MAIN ] SPR: Generated 1820 derivative records from 42074 primary records. [2025-09-19T22:26:35.395364] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-19T22:26:35.412239] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1820 records). [2025-09-19T22:26:35.425554] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-19T22:26:35.429617] [INFO ] [MAIN ] Derivative Progress: 1727/2093 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 22s. Rate: 154.8 symbols/min [2025-09-19T22:26:35.433717] [DEBUG] [LOCAL ] SPR: Derivative data saved (1820 records). [2025-09-19T22:26:35.433878] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:35.437947] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-19T22:26:35.440713] [INFO ] [MAIN ] Derivative Progress: 1728/2093 symbols completed. SPR took 1.2s. Estimated remaining: 2m 21s. Rate: 154.9 symbols/min [2025-09-19T22:26:35.438212] [DEBUG] [LOCAL ] SPRU: Loaded 8469 existing records from primary storage. [2025-09-19T22:26:35.441053] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:35.441368] [INFO ] [MAIN ] SPRU: Loaded 8469 primary data records. [2025-09-19T22:26:35.559745] [DEBUG] [LOCAL ] SPXX: Loaded 9123 existing records from primary storage. [2025-09-19T22:26:35.559936] [INFO ] [MAIN ] SPXX: Loaded 9123 primary data records. [2025-09-19T22:26:35.717205] [DEBUG] [LOCAL ] SPXC: Loaded 23780 existing records from primary storage. [2025-09-19T22:26:35.851563] [INFO ] [MAIN ] SPXC: Loaded 23780 primary data records. [2025-09-19T22:26:36.462686] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:36.464041] [INFO ] [MAIN ] SPRU: Generated 1820 derivative records from 8469 primary records. [2025-09-19T22:26:36.464930] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-19T22:26:36.487238] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:36.495576] [INFO ] [MAIN ] SPXX: Generated 1820 derivative records from 9123 primary records. [2025-09-19T22:26:36.494925] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1820 records). [2025-09-19T22:26:36.495892] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-19T22:26:36.496741] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-19T22:26:36.498752] [INFO ] [MAIN ] Derivative Progress: 1729/2093 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 21s. Rate: 154.8 symbols/min [2025-09-19T22:26:36.499103] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:36.515129] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1820 records). [2025-09-19T22:26:36.515436] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-19T22:26:36.517876] [INFO ] [MAIN ] Derivative Progress: 1730/2093 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 21s. Rate: 154.9 symbols/min [2025-09-19T22:26:36.518265] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:36.534667] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:36.536905] [INFO ] [MAIN ] SPXC: Generated 1820 derivative records from 23780 primary records. [2025-09-19T22:26:36.537026] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-19T22:26:36.553878] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1820 records). [2025-09-19T22:26:36.553965] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-19T22:26:36.556601] [INFO ] [MAIN ] Derivative Progress: 1731/2093 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 20s. Rate: 154.9 symbols/min [2025-09-19T22:26:36.563709] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:36.584696] [DEBUG] [LOCAL ] SQNS: Loaded 25593 existing records from primary storage. [2025-09-19T22:26:36.584867] [INFO ] [MAIN ] SQNS: Loaded 25593 primary data records. [2025-09-19T22:26:36.702150] [DEBUG] [LOCAL ] SQM: Loaded 49335 existing records from primary storage. [2025-09-19T22:26:36.710553] [INFO ] [MAIN ] SQM: Loaded 49335 primary data records. [2025-09-19T22:26:36.890022] [DEBUG] [LOCAL ] SR: Loaded 33089 existing records from primary storage. [2025-09-19T22:26:37.016111] [INFO ] [MAIN ] SR: Loaded 33089 primary data records. [2025-09-19T22:26:37.576520] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:37.578185] [INFO ] [MAIN ] SQNS: Generated 1820 derivative records from 25593 primary records. [2025-09-19T22:26:37.590532] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-19T22:26:37.592322] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:37.600325] [INFO ] [MAIN ] SQM: Generated 1820 derivative records from 49335 primary records. [2025-09-19T22:26:37.600452] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-19T22:26:37.623349] [DEBUG] [LOCAL ] SQM: Derivative data saved (1820 records). [2025-09-19T22:26:37.624159] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-19T22:26:37.626661] [INFO ] [MAIN ] Derivative Progress: 1732/2093 symbols completed. SQM took 1.1s. Estimated remaining: 2m 20s. Rate: 154.8 symbols/min [2025-09-19T22:26:37.629296] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1820 records). [2025-09-19T22:26:37.629442] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-19T22:26:37.631747] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:37.631600] [INFO ] [MAIN ] Derivative Progress: 1733/2093 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 19s. Rate: 154.9 symbols/min [2025-09-19T22:26:37.633990] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:37.655848] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:37.657068] [INFO ] [MAIN ] SR: Generated 1820 derivative records from 33089 primary records. [2025-09-19T22:26:37.657291] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-19T22:26:37.677253] [DEBUG] [LOCAL ] SR: Derivative data saved (1820 records). [2025-09-19T22:26:37.677417] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-19T22:26:37.680695] [INFO ] [MAIN ] Derivative Progress: 1734/2093 symbols completed. SR took 1.1s. Estimated remaining: 2m 19s. Rate: 155.0 symbols/min [2025-09-19T22:26:37.681350] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:37.688478] [DEBUG] [LOCAL ] SREA: Loaded 10548 existing records from primary storage. [2025-09-19T22:26:37.688859] [INFO ] [MAIN ] SREA: Loaded 10548 primary data records. [2025-09-19T22:26:38.079632] [DEBUG] [LOCAL ] SRFM: Loaded 35580 existing records from primary storage. [2025-09-19T22:26:38.095184] [INFO ] [MAIN ] SRFM: Loaded 35580 primary data records. [2025-09-19T22:26:38.096711] [DEBUG] [LOCAL ] SRE: Loaded 54202 existing records from primary storage. [2025-09-19T22:26:38.118766] [INFO ] [MAIN ] SRE: Loaded 54202 primary data records. [2025-09-19T22:26:38.732617] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:38.733715] [INFO ] [MAIN ] SREA: Generated 1820 derivative records from 10548 primary records. [2025-09-19T22:26:38.734055] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-19T22:26:38.751630] [DEBUG] [LOCAL ] SREA: Derivative data saved (1820 records). [2025-09-19T22:26:38.751998] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-19T22:26:38.754569] [INFO ] [MAIN ] Derivative Progress: 1735/2093 symbols completed. SREA took 1.1s. Estimated remaining: 2m 19s. Rate: 154.8 symbols/min [2025-09-19T22:26:38.755052] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:38.780118] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:38.781170] [INFO ] [MAIN ] SRFM: Generated 1820 derivative records from 35580 primary records. [2025-09-19T22:26:38.793871] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-19T22:26:38.794282] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:38.800909] [DEBUG] [LOCAL ] SRG: Loaded 16424 existing records from primary storage. [2025-09-19T22:26:38.801963] [INFO ] [MAIN ] SRE: Generated 1820 derivative records from 54202 primary records. [2025-09-19T22:26:38.809109] [INFO ] [MAIN ] SRG: Loaded 16424 primary data records. [2025-09-19T22:26:38.812797] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-19T22:26:38.828332] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1820 records). [2025-09-19T22:26:38.853829] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-19T22:26:38.891922] [INFO ] [MAIN ] Derivative Progress: 1736/2093 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 18s. Rate: 154.9 symbols/min [2025-09-19T22:26:38.927053] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:38.936240] [DEBUG] [LOCAL ] SRE: Derivative data saved (1820 records). [2025-09-19T22:26:38.940173] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-19T22:26:38.943479] [INFO ] [MAIN ] Derivative Progress: 1737/2093 symbols completed. SRE took 1.3s. Estimated remaining: 2m 18s. Rate: 154.9 symbols/min [2025-09-19T22:26:38.954947] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:39.162227] [DEBUG] [LOCAL ] SRV: Loaded 7878 existing records from primary storage. [2025-09-19T22:26:39.162411] [INFO ] [MAIN ] SRV: Loaded 7878 primary data records. [2025-09-19T22:26:39.246103] [DEBUG] [LOCAL ] SRI: Loaded 28412 existing records from primary storage. [2025-09-19T22:26:39.258454] [INFO ] [MAIN ] SRI: Loaded 28412 primary data records. [2025-09-19T22:26:39.837236] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:39.838172] [INFO ] [MAIN ] SRG: Generated 1820 derivative records from 16424 primary records. [2025-09-19T22:26:39.839340] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-19T22:26:39.857873] [DEBUG] [LOCAL ] SRG: Derivative data saved (1820 records). [2025-09-19T22:26:39.858090] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-19T22:26:39.860587] [INFO ] [MAIN ] Derivative Progress: 1738/2093 symbols completed. SRG took 1.1s. Estimated remaining: 2m 18s. Rate: 154.8 symbols/min [2025-09-19T22:26:39.880267] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:39.881013] [INFO ] [MAIN ] SRV: Generated 1820 derivative records from 7878 primary records. [2025-09-19T22:26:39.881204] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-19T22:26:39.899292] [DEBUG] [LOCAL ] SRV: Derivative data saved (1820 records). [2025-09-19T22:26:39.900165] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-19T22:26:39.903043] [INFO ] [MAIN ] Derivative Progress: 1739/2093 symbols completed. SRV took 0.9s. Estimated remaining: 2m 17s. Rate: 154.9 symbols/min [2025-09-19T22:26:39.916486] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:39.917265] [INFO ] [MAIN ] SRI: Generated 1820 derivative records from 28412 primary records. [2025-09-19T22:26:39.917344] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-19T22:26:39.933954] [DEBUG] [LOCAL ] SRI: Derivative data saved (1820 records). [2025-09-19T22:26:39.934048] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-19T22:26:39.937006] [INFO ] [MAIN ] Derivative Progress: 1740/2093 symbols completed. SRI took 1.0s. Estimated remaining: 2m 17s. Rate: 155.0 symbols/min [2025-09-19T22:26:39.937744] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:39.937590] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:39.938024] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:39.973989] [DEBUG] [LOCAL ] SSD: Loaded 22766 existing records from primary storage. [2025-09-19T22:26:39.984742] [INFO ] [MAIN ] SSD: Loaded 22766 primary data records. [2025-09-19T22:26:40.128254] [DEBUG] [LOCAL ] SSB: Loaded 43549 existing records from primary storage. [2025-09-19T22:26:40.129797] [DEBUG] [LOCAL ] SSL: Loaded 41764 existing records from primary storage. [2025-09-19T22:26:40.128528] [INFO ] [MAIN ] SSB: Loaded 43549 primary data records. [2025-09-19T22:26:40.135917] [INFO ] [MAIN ] SSL: Loaded 41764 primary data records. [2025-09-19T22:26:41.016976] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:41.018881] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:41.021105] [INFO ] [MAIN ] SSD: Generated 1820 derivative records from 22766 primary records. [2025-09-19T22:26:41.022844] [INFO ] [MAIN ] SSL: Generated 1820 derivative records from 41764 primary records. [2025-09-19T22:26:41.023178] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-19T22:26:41.023242] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-19T22:26:41.044979] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:41.055454] [INFO ] [MAIN ] SSB: Generated 1820 derivative records from 43549 primary records. [2025-09-19T22:26:41.058353] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-19T22:26:41.065871] [DEBUG] [LOCAL ] SSD: Derivative data saved (1820 records). [2025-09-19T22:26:41.066265] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-19T22:26:41.069866] [INFO ] [MAIN ] Derivative Progress: 1741/2093 symbols completed. SSD took 1.1s. Estimated remaining: 2m 16s. Rate: 154.8 symbols/min [2025-09-19T22:26:41.072812] [DEBUG] [LOCAL ] SSL: Derivative data saved (1820 records). [2025-09-19T22:26:41.073457] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-19T22:26:41.073009] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:41.083814] [INFO ] [MAIN ] Derivative Progress: 1742/2093 symbols completed. SSL took 1.1s. Estimated remaining: 2m 16s. Rate: 154.9 symbols/min [2025-09-19T22:26:41.084208] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:41.092978] [DEBUG] [LOCAL ] SSB: Derivative data saved (1820 records). [2025-09-19T22:26:41.093176] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-19T22:26:41.096187] [INFO ] [MAIN ] Derivative Progress: 1743/2093 symbols completed. SSB took 1.2s. Estimated remaining: 2m 16s. Rate: 155.0 symbols/min [2025-09-19T22:26:41.096734] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:41.108057] [DEBUG] [LOCAL ] SST: Loaded 12554 existing records from primary storage. [2025-09-19T22:26:41.108189] [INFO ] [MAIN ] SST: Loaded 12554 primary data records. [2025-09-19T22:26:41.332870] [DEBUG] [LOCAL ] SSTK: Loaded 27464 existing records from primary storage. [2025-09-19T22:26:41.395853] [INFO ] [MAIN ] SSTK: Loaded 27464 primary data records. [2025-09-19T22:26:41.581622] [DEBUG] [LOCAL ] ST: Loaded 50609 existing records from primary storage. [2025-09-19T22:26:41.633078] [INFO ] [MAIN ] ST: Loaded 50609 primary data records. [2025-09-19T22:26:42.160117] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:42.161686] [INFO ] [MAIN ] SST: Generated 1820 derivative records from 12554 primary records. [2025-09-19T22:26:42.161837] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-19T22:26:42.180695] [DEBUG] [LOCAL ] SST: Derivative data saved (1820 records). [2025-09-19T22:26:42.182174] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-19T22:26:42.184801] [INFO ] [MAIN ] Derivative Progress: 1744/2093 symbols completed. SST took 1.1s. Estimated remaining: 2m 15s. Rate: 154.8 symbols/min [2025-09-19T22:26:42.185979] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:42.208115] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:42.209386] [INFO ] [MAIN ] SSTK: Generated 1820 derivative records from 27464 primary records. [2025-09-19T22:26:42.211390] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-19T22:26:42.239059] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:42.240358] [INFO ] [MAIN ] ST: Generated 1820 derivative records from 50609 primary records. [2025-09-19T22:26:42.240535] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-19T22:26:42.272955] [DEBUG] [LOCAL ] ST: Derivative data saved (1820 records). [2025-09-19T22:26:42.273670] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1820 records). [2025-09-19T22:26:42.273786] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-19T22:26:42.276775] [INFO ] [MAIN ] Derivative Progress: 1745/2093 symbols completed. ST took 1.2s. Estimated remaining: 2m 15s. Rate: 154.9 symbols/min [2025-09-19T22:26:42.277205] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:42.276894] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-19T22:26:42.279682] [INFO ] [MAIN ] Derivative Progress: 1746/2093 symbols completed. SSTK took 1.2s. Estimated remaining: 2m 14s. Rate: 155.0 symbols/min [2025-09-19T22:26:42.280447] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:42.298846] [DEBUG] [LOCAL ] STAG: Loaded 50788 existing records from primary storage. [2025-09-19T22:26:42.299085] [INFO ] [MAIN ] STAG: Loaded 50788 primary data records. [2025-09-19T22:26:42.422910] [DEBUG] [LOCAL ] STC: Loaded 18188 existing records from primary storage. [2025-09-19T22:26:42.431809] [INFO ] [MAIN ] STC: Loaded 18188 primary data records. [2025-09-19T22:26:42.634250] [DEBUG] [LOCAL ] STE: Loaded 36040 existing records from primary storage. [2025-09-19T22:26:42.749299] [INFO ] [MAIN ] STE: Loaded 36040 primary data records. [2025-09-19T22:26:43.316496] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:43.317974] [INFO ] [MAIN ] STAG: Generated 1820 derivative records from 50788 primary records. [2025-09-19T22:26:43.319002] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-19T22:26:43.352297] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:43.351883] [DEBUG] [LOCAL ] STAG: Derivative data saved (1820 records). [2025-09-19T22:26:43.353353] [INFO ] [MAIN ] STC: Generated 1820 derivative records from 18188 primary records. [2025-09-19T22:26:43.353458] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-19T22:26:43.355590] [INFO ] [MAIN ] Derivative Progress: 1747/2093 symbols completed. STAG took 1.2s. Estimated remaining: 2m 14s. Rate: 154.8 symbols/min [2025-09-19T22:26:43.355976] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-19T22:26:43.357035] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:43.387783] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:43.389369] [INFO ] [MAIN ] STE: Generated 1820 derivative records from 36040 primary records. [2025-09-19T22:26:43.390038] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-19T22:26:43.391973] [DEBUG] [LOCAL ] STC: Derivative data saved (1820 records). [2025-09-19T22:26:43.392310] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-19T22:26:43.395155] [INFO ] [MAIN ] Derivative Progress: 1748/2093 symbols completed. STC took 1.1s. Estimated remaining: 2m 14s. Rate: 154.9 symbols/min [2025-09-19T22:26:43.412812] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:43.431893] [DEBUG] [LOCAL ] STE: Derivative data saved (1820 records). [2025-09-19T22:26:43.432414] [DEBUG] [LOCAL ] STEL: Loaded 24158 existing records from primary storage. [2025-09-19T22:26:43.432731] [INFO ] [MAIN ] STEL: Loaded 24158 primary data records. [2025-09-19T22:26:43.432610] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-19T22:26:43.435383] [INFO ] [MAIN ] Derivative Progress: 1749/2093 symbols completed. STE took 1.2s. Estimated remaining: 2m 13s. Rate: 155.0 symbols/min [2025-09-19T22:26:43.457053] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:43.628911] [DEBUG] [LOCAL ] STEW: Loaded 16621 existing records from primary storage. [2025-09-19T22:26:43.760215] [DEBUG] [LOCAL ] STEM: Loaded 40808 existing records from primary storage. [2025-09-19T22:26:43.754027] [INFO ] [MAIN ] STEW: Loaded 16621 primary data records. [2025-09-19T22:26:43.779877] [INFO ] [MAIN ] STEM: Loaded 40808 primary data records. [2025-09-19T22:26:44.434981] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:44.437047] [INFO ] [MAIN ] STEL: Generated 1820 derivative records from 24158 primary records. [2025-09-19T22:26:44.438362] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-19T22:26:44.456600] [DEBUG] [LOCAL ] STEL: Derivative data saved (1820 records). [2025-09-19T22:26:44.457296] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-19T22:26:44.459528] [INFO ] [MAIN ] Derivative Progress: 1750/2093 symbols completed. STEL took 1.1s. Estimated remaining: 2m 13s. Rate: 154.8 symbols/min [2025-09-19T22:26:44.460145] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:44.491125] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:44.497259] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:44.501678] [INFO ] [MAIN ] STEM: Generated 1820 derivative records from 40808 primary records. [2025-09-19T22:26:44.501932] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-19T22:26:44.502673] [INFO ] [MAIN ] STEW: Generated 1820 derivative records from 16621 primary records. [2025-09-19T22:26:44.503865] [DEBUG] [LOCAL ] STK: Loaded 9554 existing records from primary storage. [2025-09-19T22:26:44.504260] [INFO ] [MAIN ] STK: Loaded 9554 primary data records. [2025-09-19T22:26:44.532588] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-19T22:26:44.649042] [DEBUG] [LOCAL ] STEW: Derivative data saved (1820 records). [2025-09-19T22:26:44.665071] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-19T22:26:44.686993] [INFO ] [MAIN ] Derivative Progress: 1751/2093 symbols completed. STEW took 1.2s. Estimated remaining: 2m 13s. Rate: 154.9 symbols/min [2025-09-19T22:26:44.726413] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:44.727184] [DEBUG] [LOCAL ] STEM: Derivative data saved (1820 records). [2025-09-19T22:26:44.727322] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-19T22:26:44.837636] [INFO ] [MAIN ] Derivative Progress: 1752/2093 symbols completed. STEM took 1.4s. Estimated remaining: 2m 12s. Rate: 154.9 symbols/min [2025-09-19T22:26:44.846602] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:44.876870] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:44.877615] [INFO ] [MAIN ] STK: Generated 1820 derivative records from 9554 primary records. [2025-09-19T22:26:44.877708] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-19T22:26:44.893926] [DEBUG] [LOCAL ] STK: Derivative data saved (1820 records). [2025-09-19T22:26:44.894053] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-19T22:26:44.921882] [INFO ] [MAIN ] Derivative Progress: 1753/2093 symbols completed. STK took 0.5s. Estimated remaining: 2m 12s. Rate: 155.0 symbols/min [2025-09-19T22:26:44.957477] [DEBUG] [LOCAL ] STM: Loaded 54368 existing records from primary storage. [2025-09-19T22:26:44.958549] [DEBUG] [LOCAL ] STLA: Loaded 54326 existing records from primary storage. [2025-09-19T22:26:44.958672] [INFO ] [MAIN ] STLA: Loaded 54326 primary data records. [2025-09-19T22:26:44.957672] [INFO ] [MAIN ] STM: Loaded 54368 primary data records. [2025-09-19T22:26:45.591334] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:45.592135] [INFO ] [MAIN ] STM: Generated 1820 derivative records from 54368 primary records. [2025-09-19T22:26:45.592278] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-19T22:26:45.620860] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:45.622466] [INFO ] [MAIN ] STLA: Generated 1820 derivative records from 54326 primary records. [2025-09-19T22:26:45.622814] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-19T22:26:45.634968] [DEBUG] [LOCAL ] STM: Derivative data saved (1820 records). [2025-09-19T22:26:45.637933] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-19T22:26:45.641009] [INFO ] [MAIN ] Derivative Progress: 1754/2093 symbols completed. STM took 0.8s. Estimated remaining: 2m 11s. Rate: 154.9 symbols/min [2025-09-19T22:26:45.645282] [DEBUG] [LOCAL ] STLA: Derivative data saved (1820 records). [2025-09-19T22:26:45.645359] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-19T22:26:45.647505] [INFO ] [MAIN ] Derivative Progress: 1755/2093 symbols completed. STLA took 0.9s. Estimated remaining: 2m 11s. Rate: 155.0 symbols/min [2025-09-19T22:26:45.648006] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:45.648106] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:45.648591] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:45.661986] [DEBUG] [LOCAL ] STRV: Loaded 11850 existing records from primary storage. [2025-09-19T22:26:45.662161] [INFO ] [MAIN ] STRV: Loaded 11850 primary data records. [2025-09-19T22:26:45.783048] [DEBUG] [LOCAL ] STN: Loaded 23504 existing records from primary storage. [2025-09-19T22:26:45.797778] [INFO ] [MAIN ] STN: Loaded 23504 primary data records. [2025-09-19T22:26:46.085976] [DEBUG] [LOCAL ] STNG: Loaded 44844 existing records from primary storage. [2025-09-19T22:26:46.144126] [INFO ] [MAIN ] STNG: Loaded 44844 primary data records. [2025-09-19T22:26:46.707209] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:46.708899] [INFO ] [MAIN ] STRV: Generated 1819 derivative records from 11850 primary records. [2025-09-19T22:26:46.709091] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-19T22:26:46.729636] [DEBUG] [LOCAL ] STRV: Derivative data saved (1819 records). [2025-09-19T22:26:46.729762] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-19T22:26:46.731916] [INFO ] [MAIN ] Derivative Progress: 1756/2093 symbols completed. STRV took 1.1s. Estimated remaining: 2m 11s. Rate: 154.8 symbols/min [2025-09-19T22:26:46.732511] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:46.756742] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:46.758698] [INFO ] [MAIN ] STN: Generated 1820 derivative records from 23504 primary records. [2025-09-19T22:26:46.758997] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-19T22:26:46.792801] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:46.794396] [INFO ] [MAIN ] STNG: Generated 1820 derivative records from 44844 primary records. [2025-09-19T22:26:46.794902] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-19T22:26:46.815007] [DEBUG] [LOCAL ] STNG: Derivative data saved (1820 records). [2025-09-19T22:26:46.815552] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-19T22:26:46.818490] [INFO ] [MAIN ] Derivative Progress: 1757/2093 symbols completed. STNG took 1.2s. Estimated remaining: 2m 10s. Rate: 154.9 symbols/min [2025-09-19T22:26:46.819296] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:46.820870] [DEBUG] [LOCAL ] STN: Derivative data saved (1820 records). [2025-09-19T22:26:46.821734] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-19T22:26:46.837638] [INFO ] [MAIN ] Derivative Progress: 1758/2093 symbols completed. STN took 1.2s. Estimated remaining: 2m 10s. Rate: 155.0 symbols/min [2025-09-19T22:26:46.838040] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:46.865962] [DEBUG] [LOCAL ] STT: Loaded 51945 existing records from primary storage. [2025-09-19T22:26:46.866260] [INFO ] [MAIN ] STT: Loaded 51945 primary data records. [2025-09-19T22:26:46.967424] [DEBUG] [LOCAL ] STVN: Loaded 26950 existing records from primary storage. [2025-09-19T22:26:46.991684] [INFO ] [MAIN ] STVN: Loaded 26950 primary data records. [2025-09-19T22:26:47.332886] [DEBUG] [LOCAL ] STWD: Loaded 52662 existing records from primary storage. [2025-09-19T22:26:47.351935] [INFO ] [MAIN ] STWD: Loaded 52662 primary data records. [2025-09-19T22:26:47.843998] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:47.848341] [INFO ] [MAIN ] STT: Generated 1820 derivative records from 51945 primary records. [2025-09-19T22:26:47.848771] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-19T22:26:47.881356] [DEBUG] [LOCAL ] STT: Derivative data saved (1820 records). [2025-09-19T22:26:47.881674] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-19T22:26:47.878227] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:47.884855] [INFO ] [MAIN ] Derivative Progress: 1759/2093 symbols completed. STT took 1.2s. Estimated remaining: 2m 9s. Rate: 154.8 symbols/min [2025-09-19T22:26:47.885781] [INFO ] [MAIN ] STVN: Generated 1820 derivative records from 26950 primary records. [2025-09-19T22:26:47.886237] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:47.886055] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-19T22:26:47.905031] [DEBUG] [LOCAL ] STVN: Derivative data saved (1820 records). [2025-09-19T22:26:47.905789] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-19T22:26:47.908095] [INFO ] [MAIN ] Derivative Progress: 1760/2093 symbols completed. STVN took 1.1s. Estimated remaining: 2m 9s. Rate: 154.9 symbols/min [2025-09-19T22:26:47.910589] [DEBUG] [LOCAL ] STXD: Loaded 1378 existing records from primary storage. [2025-09-19T22:26:47.911148] [INFO ] [MAIN ] STXD: Loaded 1378 primary data records. [2025-09-19T22:26:47.910962] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:48.023030] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:48.040613] [INFO ] [MAIN ] STWD: Generated 1820 derivative records from 52662 primary records. [2025-09-19T22:26:48.043271] [DEBUG] [LOCAL ] STXE: Loaded 2277 existing records from primary storage. [2025-09-19T22:26:48.040779] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-19T22:26:48.064413] [INFO ] [MAIN ] STXE: Loaded 2277 primary data records. [2025-09-19T22:26:48.402140] [DEBUG] [LOCAL ] STWD: Derivative data saved (1820 records). [2025-09-19T22:26:48.402602] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-19T22:26:48.426331] [INFO ] [MAIN ] Derivative Progress: 1761/2093 symbols completed. STWD took 1.6s. Estimated remaining: 2m 9s. Rate: 154.9 symbols/min [2025-09-19T22:26:48.461319] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:48.612675] [DEBUG] [LOCAL ] STXG: Loaded 2705 existing records from primary storage. [2025-09-19T22:26:48.613926] [INFO ] [MAIN ] STXG: Loaded 2705 primary data records. [2025-09-19T22:26:48.763604] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:48.821360] [INFO ] [MAIN ] STXD: Generated 1819 derivative records from 1378 primary records. [2025-09-19T22:26:48.821721] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-19T22:26:48.957074] [DEBUG] [LOCAL ] STXD: Derivative data saved (1819 records). [2025-09-19T22:26:48.970066] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-19T22:26:48.973456] [INFO ] [MAIN ] Derivative Progress: 1762/2093 symbols completed. STXD took 1.1s. Estimated remaining: 2m 8s. Rate: 154.9 symbols/min [2025-09-19T22:26:48.971273] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:48.974470] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:48.975372] [INFO ] [MAIN ] STXE: Generated 1819 derivative records from 2277 primary records. [2025-09-19T22:26:48.977367] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-19T22:26:48.993291] [DEBUG] [LOCAL ] STXK: Loaded 1547 existing records from primary storage. [2025-09-19T22:26:48.995856] [DEBUG] [LOCAL ] STXE: Derivative data saved (1819 records). [2025-09-19T22:26:48.996303] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-19T22:26:48.996225] [INFO ] [MAIN ] STXK: Loaded 1547 primary data records. [2025-09-19T22:26:48.999227] [INFO ] [MAIN ] Derivative Progress: 1763/2093 symbols completed. STXE took 1.1s. Estimated remaining: 2m 8s. Rate: 154.9 symbols/min [2025-09-19T22:26:49.020691] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:49.107393] [DEBUG] [LOCAL ] STXT: Loaded 2655 existing records from primary storage. [2025-09-19T22:26:49.114017] [INFO ] [MAIN ] STXT: Loaded 2655 primary data records. [2025-09-19T22:26:49.247959] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:49.290304] [INFO ] [MAIN ] STXG: Generated 1819 derivative records from 2705 primary records. [2025-09-19T22:26:49.430857] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-19T22:26:49.625298] [DEBUG] [LOCAL ] STXG: Derivative data saved (1819 records). [2025-09-19T22:26:49.640734] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-19T22:26:49.643848] [INFO ] [MAIN ] Derivative Progress: 1764/2093 symbols completed. STXG took 1.2s. Estimated remaining: 2m 7s. Rate: 154.9 symbols/min [2025-09-19T22:26:49.644354] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:49.652374] [DEBUG] [LOCAL ] STXV: Loaded 1708 existing records from primary storage. [2025-09-19T22:26:49.652862] [INFO ] [MAIN ] STXV: Loaded 1708 primary data records. [2025-09-19T22:26:50.021779] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:50.025339] [INFO ] [MAIN ] STXK: Generated 1819 derivative records from 1547 primary records. [2025-09-19T22:26:50.025675] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-19T22:26:50.048222] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:50.054128] [INFO ] [MAIN ] STXT: Generated 1819 derivative records from 2655 primary records. [2025-09-19T22:26:50.059587] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-19T22:26:50.059918] [DEBUG] [LOCAL ] STXK: Derivative data saved (1819 records). [2025-09-19T22:26:50.060949] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-19T22:26:50.063166] [INFO ] [MAIN ] Derivative Progress: 1765/2093 symbols completed. STXK took 1.1s. Estimated remaining: 2m 7s. Rate: 154.9 symbols/min [2025-09-19T22:26:50.075483] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:50.081551] [DEBUG] [LOCAL ] STXT: Derivative data saved (1819 records). [2025-09-19T22:26:50.081986] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-19T22:26:50.084966] [INFO ] [MAIN ] Derivative Progress: 1766/2093 symbols completed. STXT took 1.1s. Estimated remaining: 2m 7s. Rate: 155.0 symbols/min [2025-09-19T22:26:50.085309] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:50.101537] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:26:50.102376] [INFO ] [MAIN ] STXV: Generated 1819 derivative records from 1708 primary records. [2025-09-19T22:26:50.102440] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-19T22:26:50.118995] [DEBUG] [LOCAL ] STXV: Derivative data saved (1819 records). [2025-09-19T22:26:50.119160] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-19T22:26:50.121679] [INFO ] [MAIN ] Derivative Progress: 1767/2093 symbols completed. STXV took 0.5s. Estimated remaining: 2m 6s. Rate: 155.0 symbols/min [2025-09-19T22:26:50.122000] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:50.202396] [DEBUG] [LOCAL ] STZ: Loaded 53045 existing records from primary storage. [2025-09-19T22:26:50.203686] [INFO ] [MAIN ] STZ: Loaded 53045 primary data records. [2025-09-19T22:26:50.204396] [DEBUG] [LOCAL ] SU: Loaded 54240 existing records from primary storage. [2025-09-19T22:26:50.225627] [INFO ] [MAIN ] SU: Loaded 54240 primary data records. [2025-09-19T22:26:50.390162] [DEBUG] [LOCAL ] SUI: Loaded 42841 existing records from primary storage. [2025-09-19T22:26:50.418289] [INFO ] [MAIN ] SUI: Loaded 42841 primary data records. [2025-09-19T22:26:51.183179] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:51.184797] [INFO ] [MAIN ] STZ: Generated 1820 derivative records from 53045 primary records. [2025-09-19T22:26:51.184941] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-19T22:26:51.181313] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:51.186474] [INFO ] [MAIN ] SU: Generated 1820 derivative records from 54240 primary records. [2025-09-19T22:26:51.186886] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-19T22:26:51.207163] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:51.212520] [INFO ] [MAIN ] SUI: Generated 1820 derivative records from 42841 primary records. [2025-09-19T22:26:51.212626] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-19T22:26:51.217199] [DEBUG] [LOCAL ] STZ: Derivative data saved (1820 records). [2025-09-19T22:26:51.217959] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-19T22:26:51.220232] [INFO ] [MAIN ] Derivative Progress: 1768/2093 symbols completed. STZ took 1.1s. Estimated remaining: 2m 6s. Rate: 154.9 symbols/min [2025-09-19T22:26:51.250189] [DEBUG] [LOCAL ] SUI: Derivative data saved (1820 records). [2025-09-19T22:26:51.250304] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-19T22:26:51.252883] [INFO ] [MAIN ] Derivative Progress: 1769/2093 symbols completed. SUI took 1.1s. Estimated remaining: 2m 5s. Rate: 154.9 symbols/min [2025-09-19T22:26:51.254259] [DEBUG] [LOCAL ] SU: Derivative data saved (1820 records). [2025-09-19T22:26:51.254340] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-19T22:26:51.256691] [INFO ] [MAIN ] Derivative Progress: 1770/2093 symbols completed. SU took 1.2s. Estimated remaining: 2m 5s. Rate: 155.0 symbols/min [2025-09-19T22:26:51.257322] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:51.257409] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:51.257879] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:51.317154] [DEBUG] [LOCAL ] SUN: Loaded 37807 existing records from primary storage. [2025-09-19T22:26:51.317845] [INFO ] [MAIN ] SUN: Loaded 37807 primary data records. [2025-09-19T22:26:51.436093] [DEBUG] [LOCAL ] SUPV: Loaded 47686 existing records from primary storage. [2025-09-19T22:26:51.456260] [INFO ] [MAIN ] SUPV: Loaded 47686 primary data records. [2025-09-19T22:26:51.456098] [DEBUG] [LOCAL ] SUZ: Loaded 46596 existing records from primary storage. [2025-09-19T22:26:51.456861] [INFO ] [MAIN ] SUZ: Loaded 46596 primary data records. [2025-09-19T22:26:52.378421] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:52.379852] [INFO ] [MAIN ] SUN: Generated 1820 derivative records from 37807 primary records. [2025-09-19T22:26:52.380140] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-19T22:26:52.400148] [DEBUG] [LOCAL ] SUN: Derivative data saved (1820 records). [2025-09-19T22:26:52.400304] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-19T22:26:52.403226] [INFO ] [MAIN ] Derivative Progress: 1771/2093 symbols completed. SUN took 1.1s. Estimated remaining: 2m 5s. Rate: 154.9 symbols/min [2025-09-19T22:26:52.417856] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:52.418183] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:52.430922] [INFO ] [MAIN ] SUPV: Generated 1820 derivative records from 47686 primary records. [2025-09-19T22:26:52.431018] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-19T22:26:52.440346] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:52.441263] [INFO ] [MAIN ] SUZ: Generated 1820 derivative records from 46596 primary records. [2025-09-19T22:26:52.445279] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-19T22:26:52.450342] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1820 records). [2025-09-19T22:26:52.450736] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-19T22:26:52.453187] [INFO ] [MAIN ] Derivative Progress: 1772/2093 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 4s. Rate: 154.9 symbols/min [2025-09-19T22:26:52.464869] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:52.469083] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1820 records). [2025-09-19T22:26:52.469541] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-19T22:26:52.472043] [INFO ] [MAIN ] Derivative Progress: 1773/2093 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 4s. Rate: 155.0 symbols/min [2025-09-19T22:26:52.472431] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:52.507342] [DEBUG] [LOCAL ] SVV: Loaded 40046 existing records from primary storage. [2025-09-19T22:26:52.507597] [INFO ] [MAIN ] SVV: Loaded 40046 primary data records. [2025-09-19T22:26:52.691134] [DEBUG] [LOCAL ] SWK: Loaded 53276 existing records from primary storage. [2025-09-19T22:26:52.730768] [INFO ] [MAIN ] SWK: Loaded 53276 primary data records. [2025-09-19T22:26:52.878279] [DEBUG] [LOCAL ] SW: Loaded 53944 existing records from primary storage. [2025-09-19T22:26:52.960189] [INFO ] [MAIN ] SW: Loaded 53944 primary data records. [2025-09-19T22:26:53.507277] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:53.508358] [INFO ] [MAIN ] SVV: Generated 1820 derivative records from 40046 primary records. [2025-09-19T22:26:53.508796] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-19T22:26:53.525692] [DEBUG] [LOCAL ] SVV: Derivative data saved (1820 records). [2025-09-19T22:26:53.526729] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-19T22:26:53.528806] [INFO ] [MAIN ] Derivative Progress: 1774/2093 symbols completed. SVV took 1.1s. Estimated remaining: 2m 4s. Rate: 154.9 symbols/min [2025-09-19T22:26:53.529564] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:53.546686] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:53.547585] [INFO ] [MAIN ] SWK: Generated 1820 derivative records from 53276 primary records. [2025-09-19T22:26:53.547834] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-19T22:26:53.566233] [DEBUG] [LOCAL ] SWK: Derivative data saved (1820 records). [2025-09-19T22:26:53.566459] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-19T22:26:53.568930] [INFO ] [MAIN ] Derivative Progress: 1775/2093 symbols completed. SWK took 1.1s. Estimated remaining: 2m 3s. Rate: 155.0 symbols/min [2025-09-19T22:26:53.569558] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:53.590593] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:53.591468] [INFO ] [MAIN ] SW: Generated 1820 derivative records from 53944 primary records. [2025-09-19T22:26:53.591660] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-19T22:26:53.614763] [DEBUG] [LOCAL ] SWX: Loaded 31786 existing records from primary storage. [2025-09-19T22:26:53.618856] [INFO ] [MAIN ] SWX: Loaded 31786 primary data records. [2025-09-19T22:26:53.618669] [DEBUG] [LOCAL ] SW: Derivative data saved (1820 records). [2025-09-19T22:26:53.619030] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-19T22:26:53.632759] [INFO ] [MAIN ] Derivative Progress: 1776/2093 symbols completed. SW took 1.2s. Estimated remaining: 2m 3s. Rate: 155.0 symbols/min [2025-09-19T22:26:53.673900] [DEBUG] [LOCAL ] SWZ: Loaded 6224 existing records from primary storage. [2025-09-19T22:26:53.673578] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:53.674018] [INFO ] [MAIN ] SWZ: Loaded 6224 primary data records. [2025-09-19T22:26:54.285093] [DEBUG] [LOCAL ] SXC: Loaded 42389 existing records from primary storage. [2025-09-19T22:26:54.285358] [INFO ] [MAIN ] SXC: Loaded 42389 primary data records. [2025-09-19T22:26:54.617462] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:54.618428] [INFO ] [MAIN ] SWX: Generated 1820 derivative records from 31786 primary records. [2025-09-19T22:26:54.619304] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-19T22:26:54.633557] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:54.645614] [INFO ] [MAIN ] SWZ: Generated 1820 derivative records from 6224 primary records. [2025-09-19T22:26:54.646382] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-19T22:26:54.651001] [DEBUG] [LOCAL ] SWX: Derivative data saved (1820 records). [2025-09-19T22:26:54.651131] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-19T22:26:54.653319] [INFO ] [MAIN ] Derivative Progress: 1777/2093 symbols completed. SWX took 1.1s. Estimated remaining: 2m 2s. Rate: 154.9 symbols/min [2025-09-19T22:26:54.668556] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1820 records). [2025-09-19T22:26:54.668667] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:54.669664] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-19T22:26:54.672399] [INFO ] [MAIN ] Derivative Progress: 1778/2093 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 2s. Rate: 155.0 symbols/min [2025-09-19T22:26:54.672808] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:54.698936] [DEBUG] [LOCAL ] SXI: Loaded 11589 existing records from primary storage. [2025-09-19T22:26:54.699209] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:54.700060] [INFO ] [MAIN ] SXC: Generated 1820 derivative records from 42389 primary records. [2025-09-19T22:26:54.700586] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-19T22:26:54.699406] [INFO ] [MAIN ] SXI: Loaded 11589 primary data records. [2025-09-19T22:26:54.865051] [DEBUG] [LOCAL ] SXT: Loaded 29369 existing records from primary storage. [2025-09-19T22:26:54.879746] [INFO ] [MAIN ] SXT: Loaded 29369 primary data records. [2025-09-19T22:26:55.042299] [DEBUG] [LOCAL ] SXC: Derivative data saved (1820 records). [2025-09-19T22:26:55.083722] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-19T22:26:55.092698] [INFO ] [MAIN ] Derivative Progress: 1779/2093 symbols completed. SXC took 1.4s. Estimated remaining: 2m 2s. Rate: 155.0 symbols/min [2025-09-19T22:26:55.137686] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:55.403413] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:55.404436] [INFO ] [MAIN ] SXI: Generated 1820 derivative records from 11589 primary records. [2025-09-19T22:26:55.404829] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-19T22:26:55.421671] [DEBUG] [LOCAL ] SXI: Derivative data saved (1820 records). [2025-09-19T22:26:55.422015] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-19T22:26:55.424077] [INFO ] [MAIN ] Derivative Progress: 1780/2093 symbols completed. SXI took 0.8s. Estimated remaining: 2m 1s. Rate: 155.0 symbols/min [2025-09-19T22:26:55.424556] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:55.445079] [DEBUG] [LOCAL ] SYF: Loaded 54240 existing records from primary storage. [2025-09-19T22:26:55.445608] [INFO ] [MAIN ] SYF: Loaded 54240 primary data records. [2025-09-19T22:26:55.486227] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:55.516013] [INFO ] [MAIN ] SXT: Generated 1820 derivative records from 29369 primary records. [2025-09-19T22:26:55.546616] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-19T22:26:55.657827] [DEBUG] [LOCAL ] SXT: Derivative data saved (1820 records). [2025-09-19T22:26:55.798516] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-19T22:26:55.814073] [INFO ] [MAIN ] Derivative Progress: 1781/2093 symbols completed. SXT took 1.1s. Estimated remaining: 2m 1s. Rate: 155.0 symbols/min [2025-09-19T22:26:55.815020] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:55.832953] [DEBUG] [LOCAL ] SYK: Loaded 47843 existing records from primary storage. [2025-09-19T22:26:55.833442] [INFO ] [MAIN ] SYK: Loaded 47843 primary data records. [2025-09-19T22:26:56.218094] [DEBUG] [LOCAL ] SYY: Loaded 54029 existing records from primary storage. [2025-09-19T22:26:56.218303] [INFO ] [MAIN ] SYY: Loaded 54029 primary data records. [2025-09-19T22:26:56.342744] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:56.359573] [INFO ] [MAIN ] SYF: Generated 1820 derivative records from 54240 primary records. [2025-09-19T22:26:56.425596] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-19T22:26:56.577487] [DEBUG] [LOCAL ] SYF: Derivative data saved (1820 records). [2025-09-19T22:26:56.577806] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-19T22:26:56.579894] [INFO ] [MAIN ] Derivative Progress: 1782/2093 symbols completed. SYF took 1.4s. Estimated remaining: 2m 0s. Rate: 154.9 symbols/min [2025-09-19T22:26:56.581017] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:56.599688] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:56.600516] [INFO ] [MAIN ] SYK: Generated 1820 derivative records from 47843 primary records. [2025-09-19T22:26:56.600896] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-19T22:26:56.618739] [DEBUG] [LOCAL ] SYK: Derivative data saved (1820 records). [2025-09-19T22:26:56.619048] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-19T22:26:56.622240] [INFO ] [MAIN ] Derivative Progress: 1783/2093 symbols completed. SYK took 1.2s. Estimated remaining: 2m 0s. Rate: 155.0 symbols/min [2025-09-19T22:26:56.642214] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:56.642925] [INFO ] [MAIN ] SYY: Generated 1820 derivative records from 54029 primary records. [2025-09-19T22:26:56.643068] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-19T22:26:56.672502] [DEBUG] [LOCAL ] SYY: Derivative data saved (1820 records). [2025-09-19T22:26:56.672724] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-19T22:26:56.674943] [INFO ] [MAIN ] Derivative Progress: 1784/2093 symbols completed. SYY took 0.9s. Estimated remaining: 1m 60s. Rate: 155.0 symbols/min [2025-09-19T22:26:56.694001] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-09-19T22:26:56.694140] [INFO ] [MAIN ] T: Loaded 54578 primary data records. [2025-09-19T22:26:57.009584] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:57.010291] [INFO ] [MAIN ] T: Generated 1820 derivative records from 54578 primary records. [2025-09-19T22:26:57.010356] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-19T22:26:57.026241] [DEBUG] [LOCAL ] T: Derivative data saved (1820 records). [2025-09-19T22:26:57.026310] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-19T22:26:57.028476] [INFO ] [MAIN ] Derivative Progress: 1785/2093 symbols completed. T took 0.4s. Estimated remaining: 1m 59s. Rate: 155.0 symbols/min [2025-09-19T22:26:57.029068] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:57.029205] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:57.029252] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:57.120207] [DEBUG] [LOCAL ] TAL: Loaded 52924 existing records from primary storage. [2025-09-19T22:26:57.120457] [INFO ] [MAIN ] TAL: Loaded 52924 primary data records. [2025-09-19T22:26:57.167006] [DEBUG] [LOCAL ] TAC: Loaded 43676 existing records from primary storage. [2025-09-19T22:26:57.212440] [INFO ] [MAIN ] TAC: Loaded 43676 primary data records. [2025-09-19T22:26:57.242209] [DEBUG] [LOCAL ] TAK: Loaded 50690 existing records from primary storage. [2025-09-19T22:26:57.253339] [INFO ] [MAIN ] TAK: Loaded 50690 primary data records. [2025-09-19T22:26:58.137493] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:58.139192] [INFO ] [MAIN ] TAL: Generated 1820 derivative records from 52924 primary records. [2025-09-19T22:26:58.140245] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-19T22:26:58.172031] [DEBUG] [LOCAL ] TAL: Derivative data saved (1820 records). [2025-09-19T22:26:58.171954] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:58.180926] [INFO ] [MAIN ] TAC: Generated 1820 derivative records from 43676 primary records. [2025-09-19T22:26:58.180039] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-19T22:26:58.181073] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-19T22:26:58.187375] [INFO ] [MAIN ] Derivative Progress: 1786/2093 symbols completed. TAL took 1.2s. Estimated remaining: 1m 59s. Rate: 154.9 symbols/min [2025-09-19T22:26:58.189309] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:58.189504] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:58.201444] [INFO ] [MAIN ] TAK: Generated 1820 derivative records from 50690 primary records. [2025-09-19T22:26:58.204705] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-19T22:26:58.205845] [DEBUG] [LOCAL ] TAC: Derivative data saved (1820 records). [2025-09-19T22:26:58.207035] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-19T22:26:58.211235] [INFO ] [MAIN ] Derivative Progress: 1787/2093 symbols completed. TAC took 1.2s. Estimated remaining: 1m 58s. Rate: 155.0 symbols/min [2025-09-19T22:26:58.223269] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:58.227959] [DEBUG] [LOCAL ] TAK: Derivative data saved (1820 records). [2025-09-19T22:26:58.228109] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-19T22:26:58.230606] [INFO ] [MAIN ] Derivative Progress: 1788/2093 symbols completed. TAK took 1.2s. Estimated remaining: 1m 58s. Rate: 155.0 symbols/min [2025-09-19T22:26:58.231109] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:58.246444] [DEBUG] [LOCAL ] TBB: Loaded 11863 existing records from primary storage. [2025-09-19T22:26:58.246565] [INFO ] [MAIN ] TBB: Loaded 11863 primary data records. [2025-09-19T22:26:58.607732] [DEBUG] [LOCAL ] TALO: Loaded 51587 existing records from primary storage. [2025-09-19T22:26:58.622668] [INFO ] [MAIN ] TALO: Loaded 51587 primary data records. [2025-09-19T22:26:58.635796] [DEBUG] [LOCAL ] TAP: Loaded 53624 existing records from primary storage. [2025-09-19T22:26:58.657114] [INFO ] [MAIN ] TAP: Loaded 53624 primary data records. [2025-09-19T22:26:59.269915] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:59.271734] [INFO ] [MAIN ] TBB: Generated 1820 derivative records from 11863 primary records. [2025-09-19T22:26:59.272192] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-19T22:26:59.290717] [DEBUG] [LOCAL ] TBB: Derivative data saved (1820 records). [2025-09-19T22:26:59.290924] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-19T22:26:59.293188] [INFO ] [MAIN ] Derivative Progress: 1789/2093 symbols completed. TBB took 1.1s. Estimated remaining: 1m 58s. Rate: 154.9 symbols/min [2025-09-19T22:26:59.293729] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:59.312474] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:59.314592] [INFO ] [MAIN ] TALO: Generated 1820 derivative records from 51587 primary records. [2025-09-19T22:26:59.314802] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-19T22:26:59.342598] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:26:59.343868] [INFO ] [MAIN ] TAP: Generated 1820 derivative records from 53624 primary records. [2025-09-19T22:26:59.345079] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-19T22:26:59.347841] [DEBUG] [LOCAL ] TALO: Derivative data saved (1820 records). [2025-09-19T22:26:59.348077] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-19T22:26:59.357302] [INFO ] [MAIN ] Derivative Progress: 1790/2093 symbols completed. TALO took 1.2s. Estimated remaining: 1m 57s. Rate: 155.0 symbols/min [2025-09-19T22:26:59.357685] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:59.375066] [DEBUG] [LOCAL ] TAP: Derivative data saved (1820 records). [2025-09-19T22:26:59.375303] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-19T22:26:59.377493] [INFO ] [MAIN ] Derivative Progress: 1791/2093 symbols completed. TAP took 1.2s. Estimated remaining: 1m 57s. Rate: 155.0 symbols/min [2025-09-19T22:26:59.377836] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:26:59.401415] [DEBUG] [LOCAL ] TBN: Loaded 3109 existing records from primary storage. [2025-09-19T22:26:59.398705] [DEBUG] [LOCAL ] TBBB: Loaded 36426 existing records from primary storage. [2025-09-19T22:26:59.401753] [INFO ] [MAIN ] TBBB: Loaded 36426 primary data records. [2025-09-19T22:26:59.401851] [INFO ] [MAIN ] TBN: Loaded 3109 primary data records. [2025-09-19T22:26:59.502079] [DEBUG] [LOCAL ] TBI: Loaded 23061 existing records from primary storage. [2025-09-19T22:26:59.530589] [INFO ] [MAIN ] TBI: Loaded 23061 primary data records. [2025-09-19T22:27:00.391759] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:00.392480] [INFO ] [MAIN ] TBN: Generated 1820 derivative records from 3109 primary records. [2025-09-19T22:27:00.392934] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-19T22:27:00.408034] [DEBUG] [LOCAL ] TBN: Derivative data saved (1820 records). [2025-09-19T22:27:00.409039] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-19T22:27:00.411549] [INFO ] [MAIN ] Derivative Progress: 1792/2093 symbols completed. TBN took 1.0s. Estimated remaining: 1m 57s. Rate: 154.9 symbols/min [2025-09-19T22:27:00.411951] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:00.427401] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:00.428925] [INFO ] [MAIN ] TBI: Generated 1820 derivative records from 23061 primary records. [2025-09-19T22:27:00.429078] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-19T22:27:00.449286] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:00.453745] [INFO ] [MAIN ] TBBB: Generated 1820 derivative records from 36426 primary records. [2025-09-19T22:27:00.454105] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-19T22:27:00.470377] [DEBUG] [LOCAL ] TBI: Derivative data saved (1820 records). [2025-09-19T22:27:00.470602] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-19T22:27:00.473012] [INFO ] [MAIN ] Derivative Progress: 1793/2093 symbols completed. TBI took 1.1s. Estimated remaining: 1m 56s. Rate: 155.0 symbols/min [2025-09-19T22:27:00.477633] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1820 records). [2025-09-19T22:27:00.477758] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:00.477957] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-19T22:27:00.480562] [INFO ] [MAIN ] Derivative Progress: 1794/2093 symbols completed. TBBB took 1.2s. Estimated remaining: 1m 56s. Rate: 155.0 symbols/min [2025-09-19T22:27:00.480884] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:00.503753] [DEBUG] [LOCAL ] TDF: Loaded 6581 existing records from primary storage. [2025-09-19T22:27:00.503910] [INFO ] [MAIN ] TDF: Loaded 6581 primary data records. [2025-09-19T22:27:00.640111] [DEBUG] [LOCAL ] TD: Loaded 53049 existing records from primary storage. [2025-09-19T22:27:00.661333] [INFO ] [MAIN ] TD: Loaded 53049 primary data records. [2025-09-19T22:27:00.923353] [DEBUG] [LOCAL ] TDC: Loaded 47741 existing records from primary storage. [2025-09-19T22:27:00.940037] [INFO ] [MAIN ] TDC: Loaded 47741 primary data records. [2025-09-19T22:27:01.499067] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:01.500223] [INFO ] [MAIN ] TDF: Generated 1820 derivative records from 6581 primary records. [2025-09-19T22:27:01.500419] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-19T22:27:01.520492] [DEBUG] [LOCAL ] TDF: Derivative data saved (1820 records). [2025-09-19T22:27:01.528456] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-19T22:27:01.530609] [INFO ] [MAIN ] Derivative Progress: 1795/2093 symbols completed. TDF took 1.0s. Estimated remaining: 1m 55s. Rate: 154.9 symbols/min [2025-09-19T22:27:01.537206] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:01.536850] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:01.540945] [INFO ] [MAIN ] TD: Generated 1820 derivative records from 53049 primary records. [2025-09-19T22:27:01.541233] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-19T22:27:01.567516] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:01.569498] [INFO ] [MAIN ] TDC: Generated 1820 derivative records from 47741 primary records. [2025-09-19T22:27:01.569635] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-19T22:27:01.581731] [DEBUG] [LOCAL ] TD: Derivative data saved (1820 records). [2025-09-19T22:27:01.582988] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-19T22:27:01.585585] [INFO ] [MAIN ] Derivative Progress: 1796/2093 symbols completed. TD took 1.2s. Estimated remaining: 1m 55s. Rate: 155.0 symbols/min [2025-09-19T22:27:01.588694] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:01.598108] [DEBUG] [LOCAL ] TDC: Derivative data saved (1820 records). [2025-09-19T22:27:01.598385] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-19T22:27:01.601019] [INFO ] [MAIN ] Derivative Progress: 1797/2093 symbols completed. TDC took 1.1s. Estimated remaining: 1m 55s. Rate: 155.1 symbols/min [2025-09-19T22:27:01.601444] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:01.645076] [DEBUG] [LOCAL ] TDOC: Loaded 54132 existing records from primary storage. [2025-09-19T22:27:01.645457] [INFO ] [MAIN ] TDOC: Loaded 54132 primary data records. [2025-09-19T22:27:01.826508] [DEBUG] [LOCAL ] TDS: Loaded 43487 existing records from primary storage. [2025-09-19T22:27:01.859202] [INFO ] [MAIN ] TDS: Loaded 43487 primary data records. [2025-09-19T22:27:01.895304] [DEBUG] [LOCAL ] TDW: Loaded 46386 existing records from primary storage. [2025-09-19T22:27:01.901576] [INFO ] [MAIN ] TDW: Loaded 46386 primary data records. [2025-09-19T22:27:02.720116] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:02.721199] [INFO ] [MAIN ] TDOC: Generated 1820 derivative records from 54132 primary records. [2025-09-19T22:27:02.722850] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-19T22:27:02.740916] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1820 records). [2025-09-19T22:27:02.741339] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-19T22:27:02.743196] [INFO ] [MAIN ] Derivative Progress: 1798/2093 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 54s. Rate: 154.9 symbols/min [2025-09-19T22:27:02.776928] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:02.776572] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:02.777873] [INFO ] [MAIN ] TDW: Generated 1820 derivative records from 46386 primary records. [2025-09-19T22:27:02.778607] [INFO ] [MAIN ] TDS: Generated 1820 derivative records from 43487 primary records. [2025-09-19T22:27:02.778852] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-19T22:27:02.778776] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-19T22:27:02.807937] [DEBUG] [LOCAL ] TDW: Derivative data saved (1820 records). [2025-09-19T22:27:02.808532] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-19T22:27:02.810977] [INFO ] [MAIN ] Derivative Progress: 1799/2093 symbols completed. TDW took 1.2s. Estimated remaining: 1m 54s. Rate: 155.0 symbols/min [2025-09-19T22:27:02.814042] [DEBUG] [LOCAL ] TDS: Derivative data saved (1820 records). [2025-09-19T22:27:02.814105] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-19T22:27:02.816832] [INFO ] [MAIN ] Derivative Progress: 1800/2093 symbols completed. TDS took 1.2s. Estimated remaining: 1m 53s. Rate: 155.0 symbols/min [2025-09-19T22:27:02.817441] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:02.817530] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:02.817672] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:02.830626] [DEBUG] [LOCAL ] TEAF: Loaded 7367 existing records from primary storage. [2025-09-19T22:27:02.830827] [INFO ] [MAIN ] TEAF: Loaded 7367 primary data records. [2025-09-19T22:27:02.912989] [DEBUG] [LOCAL ] TDY: Loaded 23259 existing records from primary storage. [2025-09-19T22:27:02.931453] [INFO ] [MAIN ] TDY: Loaded 23259 primary data records. [2025-09-19T22:27:03.494094] [DEBUG] [LOCAL ] TECK: Loaded 54219 existing records from primary storage. [2025-09-19T22:27:03.495621] [INFO ] [MAIN ] TECK: Loaded 54219 primary data records. [2025-09-19T22:27:03.822068] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:03.823637] [INFO ] [MAIN ] TEAF: Generated 1820 derivative records from 7367 primary records. [2025-09-19T22:27:03.823895] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-19T22:27:03.857367] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:03.857023] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1820 records). [2025-09-19T22:27:03.858279] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-19T22:27:03.858187] [INFO ] [MAIN ] TDY: Generated 1820 derivative records from 23259 primary records. [2025-09-19T22:27:03.860410] [INFO ] [MAIN ] Derivative Progress: 1801/2093 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 53s. Rate: 154.9 symbols/min [2025-09-19T22:27:03.860631] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-19T22:27:03.861356] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:03.879741] [DEBUG] [LOCAL ] TDY: Derivative data saved (1820 records). [2025-09-19T22:27:03.879962] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-19T22:27:03.882413] [INFO ] [MAIN ] Derivative Progress: 1802/2093 symbols completed. TDY took 1.1s. Estimated remaining: 1m 53s. Rate: 155.0 symbols/min [2025-09-19T22:27:03.883117] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:03.902255] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:03.903016] [INFO ] [MAIN ] TECK: Generated 1820 derivative records from 54219 primary records. [2025-09-19T22:27:03.903247] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-19T22:27:03.940109] [DEBUG] [LOCAL ] TEI: Loaded 20713 existing records from primary storage. [2025-09-19T22:27:03.939674] [DEBUG] [LOCAL ] TECK: Derivative data saved (1820 records). [2025-09-19T22:27:03.940578] [INFO ] [MAIN ] TEI: Loaded 20713 primary data records. [2025-09-19T22:27:03.940830] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-19T22:27:03.948255] [INFO ] [MAIN ] Derivative Progress: 1803/2093 symbols completed. TECK took 1.1s. Estimated remaining: 1m 52s. Rate: 155.1 symbols/min [2025-09-19T22:27:04.000212] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:04.045124] [DEBUG] [LOCAL ] TEF: Loaded 38107 existing records from primary storage. [2025-09-19T22:27:04.058628] [INFO ] [MAIN ] TEF: Loaded 38107 primary data records. [2025-09-19T22:27:04.640234] [DEBUG] [LOCAL ] TEL: Loaded 51925 existing records from primary storage. [2025-09-19T22:27:04.641498] [INFO ] [MAIN ] TEL: Loaded 51925 primary data records. [2025-09-19T22:27:04.666056] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:04.686859] [INFO ] [MAIN ] TEI: Generated 1820 derivative records from 20713 primary records. [2025-09-19T22:27:04.699344] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-19T22:27:04.802801] [DEBUG] [LOCAL ] TEI: Derivative data saved (1820 records). [2025-09-19T22:27:04.817040] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-19T22:27:04.827545] [INFO ] [MAIN ] Derivative Progress: 1804/2093 symbols completed. TEI took 0.9s. Estimated remaining: 1m 52s. Rate: 154.9 symbols/min [2025-09-19T22:27:04.858895] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:05.006274] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:05.007241] [INFO ] [MAIN ] TEF: Generated 1820 derivative records from 38107 primary records. [2025-09-19T22:27:05.007407] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-19T22:27:05.025621] [DEBUG] [LOCAL ] TEF: Derivative data saved (1820 records). [2025-09-19T22:27:05.026334] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-19T22:27:05.030609] [INFO ] [MAIN ] Derivative Progress: 1805/2093 symbols completed. TEF took 1.2s. Estimated remaining: 1m 51s. Rate: 155.0 symbols/min [2025-09-19T22:27:05.031198] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:05.061723] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:05.062431] [INFO ] [MAIN ] TEL: Generated 1820 derivative records from 51925 primary records. [2025-09-19T22:27:05.062681] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-19T22:27:05.078762] [DEBUG] [LOCAL ] TEN: Loaded 31614 existing records from primary storage. [2025-09-19T22:27:05.094260] [INFO ] [MAIN ] TEN: Loaded 31614 primary data records. [2025-09-19T22:27:05.094774] [DEBUG] [LOCAL ] TEL: Derivative data saved (1820 records). [2025-09-19T22:27:05.100551] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-19T22:27:05.116934] [INFO ] [MAIN ] Derivative Progress: 1806/2093 symbols completed. TEL took 1.1s. Estimated remaining: 1m 51s. Rate: 155.1 symbols/min [2025-09-19T22:27:05.117194] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:05.117810] [DEBUG] [LOCAL ] TEO: Loaded 22044 existing records from primary storage. [2025-09-19T22:27:05.151188] [INFO ] [MAIN ] TEO: Loaded 22044 primary data records. [2025-09-19T22:27:05.764927] [DEBUG] [LOCAL ] TEVA: Loaded 54412 existing records from primary storage. [2025-09-19T22:27:05.765547] [INFO ] [MAIN ] TEVA: Loaded 54412 primary data records. [2025-09-19T22:27:06.132154] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:06.146460] [INFO ] [MAIN ] TEN: Generated 1820 derivative records from 31614 primary records. [2025-09-19T22:27:06.146718] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-19T22:27:06.145719] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:06.148113] [INFO ] [MAIN ] TEO: Generated 1820 derivative records from 22044 primary records. [2025-09-19T22:27:06.148675] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-19T22:27:06.177913] [DEBUG] [LOCAL ] TEN: Derivative data saved (1820 records). [2025-09-19T22:27:06.178280] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-19T22:27:06.180639] [INFO ] [MAIN ] Derivative Progress: 1807/2093 symbols completed. TEN took 1.4s. Estimated remaining: 1m 51s. Rate: 154.9 symbols/min [2025-09-19T22:27:06.181337] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:06.184369] [DEBUG] [LOCAL ] TEO: Derivative data saved (1820 records). [2025-09-19T22:27:06.185005] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-19T22:27:06.187113] [INFO ] [MAIN ] Derivative Progress: 1808/2093 symbols completed. TEO took 1.2s. Estimated remaining: 1m 50s. Rate: 155.0 symbols/min [2025-09-19T22:27:06.187753] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:06.206469] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:06.207669] [INFO ] [MAIN ] TEVA: Generated 1820 derivative records from 54412 primary records. [2025-09-19T22:27:06.207848] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-19T22:27:06.224745] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1820 records). [2025-09-19T22:27:06.224912] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-19T22:27:06.227152] [INFO ] [MAIN ] Derivative Progress: 1809/2093 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 50s. Rate: 155.1 symbols/min [2025-09-19T22:27:06.227556] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:06.271412] [DEBUG] [LOCAL ] TEX: Loaded 45628 existing records from primary storage. [2025-09-19T22:27:06.271627] [INFO ] [MAIN ] TEX: Loaded 45628 primary data records. [2025-09-19T22:27:06.409883] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-09-19T22:27:06.410570] [INFO ] [MAIN ] TFC: Loaded 54447 primary data records. [2025-09-19T22:27:06.505331] [DEBUG] [LOCAL ] TFII: Loaded 35312 existing records from primary storage. [2025-09-19T22:27:06.543780] [INFO ] [MAIN ] TFII: Loaded 35312 primary data records. [2025-09-19T22:27:07.289569] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:07.291406] [INFO ] [MAIN ] TEX: Generated 1820 derivative records from 45628 primary records. [2025-09-19T22:27:07.292114] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-19T22:27:07.325665] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:07.327045] [INFO ] [MAIN ] TFC: Generated 1820 derivative records from 54447 primary records. [2025-09-19T22:27:07.327254] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-19T22:27:07.326019] [DEBUG] [LOCAL ] TEX: Derivative data saved (1820 records). [2025-09-19T22:27:07.328911] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-19T22:27:07.331164] [INFO ] [MAIN ] Derivative Progress: 1810/2093 symbols completed. TEX took 1.1s. Estimated remaining: 1m 50s. Rate: 154.9 symbols/min [2025-09-19T22:27:07.341068] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:07.349874] [DEBUG] [LOCAL ] TFC: Derivative data saved (1820 records). [2025-09-19T22:27:07.358068] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-19T22:27:07.365789] [INFO ] [MAIN ] Derivative Progress: 1811/2093 symbols completed. TFC took 1.2s. Estimated remaining: 1m 49s. Rate: 155.0 symbols/min [2025-09-19T22:27:07.363487] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:07.366882] [INFO ] [MAIN ] TFII: Generated 1820 derivative records from 35312 primary records. [2025-09-19T22:27:07.367140] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:07.367257] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-19T22:27:07.401081] [DEBUG] [LOCAL ] TFIN: Loaded 23958 existing records from primary storage. [2025-09-19T22:27:07.401810] [INFO ] [MAIN ] TFIN: Loaded 23958 primary data records. [2025-09-19T22:27:07.402390] [DEBUG] [LOCAL ] TFII: Derivative data saved (1820 records). [2025-09-19T22:27:07.407694] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-19T22:27:07.416974] [INFO ] [MAIN ] Derivative Progress: 1812/2093 symbols completed. TFII took 1.2s. Estimated remaining: 1m 49s. Rate: 155.1 symbols/min [2025-09-19T22:27:07.427967] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:07.552878] [DEBUG] [LOCAL ] TFPM: Loaded 37558 existing records from primary storage. [2025-09-19T22:27:07.569273] [INFO ] [MAIN ] TFPM: Loaded 37558 primary data records. [2025-09-19T22:27:07.920553] [DEBUG] [LOCAL ] TFX: Loaded 38306 existing records from primary storage. [2025-09-19T22:27:07.926473] [INFO ] [MAIN ] TFX: Loaded 38306 primary data records. [2025-09-19T22:27:08.495501] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:08.497565] [INFO ] [MAIN ] TFIN: Generated 1820 derivative records from 23958 primary records. [2025-09-19T22:27:08.498144] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-19T22:27:08.519080] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1820 records). [2025-09-19T22:27:08.519300] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-19T22:27:08.521360] [INFO ] [MAIN ] Derivative Progress: 1813/2093 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 48s. Rate: 154.9 symbols/min [2025-09-19T22:27:08.545095] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:08.546456] [INFO ] [MAIN ] TFPM: Generated 1820 derivative records from 37558 primary records. [2025-09-19T22:27:08.546739] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-19T22:27:08.572531] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1820 records). [2025-09-19T22:27:08.572956] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-19T22:27:08.575403] [INFO ] [MAIN ] Derivative Progress: 1814/2093 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 48s. Rate: 155.0 symbols/min [2025-09-19T22:27:08.588219] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:08.588919] [INFO ] [MAIN ] TFX: Generated 1820 derivative records from 38306 primary records. [2025-09-19T22:27:08.588983] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-19T22:27:08.604979] [DEBUG] [LOCAL ] TFX: Derivative data saved (1820 records). [2025-09-19T22:27:08.605070] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-19T22:27:08.607317] [INFO ] [MAIN ] Derivative Progress: 1815/2093 symbols completed. TFX took 1.2s. Estimated remaining: 1m 48s. Rate: 155.0 symbols/min [2025-09-19T22:27:08.607992] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:08.608756] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:08.608816] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:08.621206] [DEBUG] [LOCAL ] TG: Loaded 10626 existing records from primary storage. [2025-09-19T22:27:08.621346] [INFO ] [MAIN ] TG: Loaded 10626 primary data records. [2025-09-19T22:27:08.948947] [DEBUG] [LOCAL ] TGLS: Loaded 28984 existing records from primary storage. [2025-09-19T22:27:08.958439] [INFO ] [MAIN ] TGLS: Loaded 28984 primary data records. [2025-09-19T22:27:09.078317] [DEBUG] [LOCAL ] TGNA: Loaded 49434 existing records from primary storage. [2025-09-19T22:27:09.079095] [INFO ] [MAIN ] TGNA: Loaded 49434 primary data records. [2025-09-19T22:27:09.618718] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:09.620820] [INFO ] [MAIN ] TG: Generated 1820 derivative records from 10626 primary records. [2025-09-19T22:27:09.621101] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-19T22:27:09.638680] [DEBUG] [LOCAL ] TG: Derivative data saved (1820 records). [2025-09-19T22:27:09.639434] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-19T22:27:09.642137] [INFO ] [MAIN ] Derivative Progress: 1816/2093 symbols completed. TG took 1.0s. Estimated remaining: 1m 47s. Rate: 154.9 symbols/min [2025-09-19T22:27:09.642923] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:09.667460] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:09.668535] [INFO ] [MAIN ] TGLS: Generated 1820 derivative records from 28984 primary records. [2025-09-19T22:27:09.668815] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-19T22:27:09.695275] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1820 records). [2025-09-19T22:27:09.695720] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-19T22:27:09.715689] [INFO ] [MAIN ] Derivative Progress: 1817/2093 symbols completed. TGLS took 1.1s. Estimated remaining: 1m 47s. Rate: 155.0 symbols/min [2025-09-19T22:27:09.721734] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:09.722081] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:09.723433] [INFO ] [MAIN ] TGNA: Generated 1820 derivative records from 49434 primary records. [2025-09-19T22:27:09.723673] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-19T22:27:09.751862] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1820 records). [2025-09-19T22:27:09.752024] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-19T22:27:09.756178] [INFO ] [MAIN ] Derivative Progress: 1818/2093 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 46s. Rate: 155.1 symbols/min [2025-09-19T22:27:09.756437] [DEBUG] [LOCAL ] TGS: Loaded 32870 existing records from primary storage. [2025-09-19T22:27:09.756755] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:09.757025] [INFO ] [MAIN ] TGS: Loaded 32870 primary data records. [2025-09-19T22:27:10.155988] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-09-19T22:27:10.156427] [INFO ] [MAIN ] TGT: Loaded 54558 primary data records. [2025-09-19T22:27:10.235999] [DEBUG] [LOCAL ] THC: Loaded 48988 existing records from primary storage. [2025-09-19T22:27:10.248183] [INFO ] [MAIN ] THC: Loaded 48988 primary data records. [2025-09-19T22:27:10.811164] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:10.812993] [INFO ] [MAIN ] TGS: Generated 1820 derivative records from 32870 primary records. [2025-09-19T22:27:10.813509] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-19T22:27:10.833278] [DEBUG] [LOCAL ] TGS: Derivative data saved (1820 records). [2025-09-19T22:27:10.833565] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-19T22:27:10.836213] [INFO ] [MAIN ] Derivative Progress: 1819/2093 symbols completed. TGS took 1.2s. Estimated remaining: 1m 46s. Rate: 154.9 symbols/min [2025-09-19T22:27:10.837728] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:10.855905] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:10.856764] [INFO ] [MAIN ] TGT: Generated 1820 derivative records from 54558 primary records. [2025-09-19T22:27:10.857029] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-19T22:27:10.884607] [DEBUG] [LOCAL ] TGT: Derivative data saved (1820 records). [2025-09-19T22:27:10.884798] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-19T22:27:10.887099] [INFO ] [MAIN ] Derivative Progress: 1820/2093 symbols completed. TGT took 1.2s. Estimated remaining: 1m 46s. Rate: 155.0 symbols/min [2025-09-19T22:27:10.908078] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:10.907745] [DEBUG] [LOCAL ] THG: Loaded 22479 existing records from primary storage. [2025-09-19T22:27:10.908959] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:10.908549] [INFO ] [MAIN ] THG: Loaded 22479 primary data records. [2025-09-19T22:27:10.910372] [INFO ] [MAIN ] THC: Generated 1820 derivative records from 48988 primary records. [2025-09-19T22:27:10.922210] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-19T22:27:11.016384] [DEBUG] [LOCAL ] THIR: Loaded 2187 existing records from primary storage. [2025-09-19T22:27:11.034392] [INFO ] [MAIN ] THIR: Loaded 2187 primary data records. [2025-09-19T22:27:11.036145] [DEBUG] [LOCAL ] THC: Derivative data saved (1820 records). [2025-09-19T22:27:11.098367] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-19T22:27:11.165204] [INFO ] [MAIN ] Derivative Progress: 1821/2093 symbols completed. THC took 1.4s. Estimated remaining: 1m 45s. Rate: 155.0 symbols/min [2025-09-19T22:27:11.342437] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:11.430067] [DEBUG] [LOCAL ] THLV: Loaded 1690 existing records from primary storage. [2025-09-19T22:27:11.552118] [INFO ] [MAIN ] THLV: Loaded 1690 primary data records. [2025-09-19T22:27:11.900224] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:11.900662] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:27:11.902897] [INFO ] [MAIN ] THIR: Generated 1819 derivative records from 2187 primary records. [2025-09-19T22:27:11.901639] [INFO ] [MAIN ] THG: Generated 1820 derivative records from 22479 primary records. [2025-09-19T22:27:11.903305] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-19T22:27:11.903105] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-19T22:27:11.932585] [DEBUG] [LOCAL ] THG: Derivative data saved (1820 records). [2025-09-19T22:27:11.933736] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-19T22:27:11.936150] [INFO ] [MAIN ] Derivative Progress: 1822/2093 symbols completed. THG took 1.1s. Estimated remaining: 1m 45s. Rate: 154.9 symbols/min [2025-09-19T22:27:11.937667] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:11.939123] [DEBUG] [LOCAL ] THIR: Derivative data saved (1819 records). [2025-09-19T22:27:11.939350] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-19T22:27:11.941618] [INFO ] [MAIN ] Derivative Progress: 1823/2093 symbols completed. THIR took 1.0s. Estimated remaining: 1m 45s. Rate: 155.0 symbols/min [2025-09-19T22:27:11.942543] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:11.961836] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-19T22:27:11.962846] [INFO ] [MAIN ] THLV: Generated 1818 derivative records from 1690 primary records. [2025-09-19T22:27:11.962998] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-19T22:27:11.986616] [DEBUG] [LOCAL ] THLV: Derivative data saved (1818 records). [2025-09-19T22:27:11.986954] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-19T22:27:11.989341] [INFO ] [MAIN ] Derivative Progress: 1824/2093 symbols completed. THLV took 0.6s. Estimated remaining: 1m 44s. Rate: 155.1 symbols/min [2025-09-19T22:27:11.990007] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:12.009601] [DEBUG] [LOCAL ] THQ: Loaded 24661 existing records from primary storage. [2025-09-19T22:27:12.009798] [INFO ] [MAIN ] THQ: Loaded 24661 primary data records. [2025-09-19T22:27:12.114002] [DEBUG] [LOCAL ] THO: Loaded 43130 existing records from primary storage. [2025-09-19T22:27:12.134532] [INFO ] [MAIN ] THO: Loaded 43130 primary data records. [2025-09-19T22:27:12.212078] [DEBUG] [LOCAL ] THR: Loaded 20422 existing records from primary storage. [2025-09-19T22:27:12.273754] [INFO ] [MAIN ] THR: Loaded 20422 primary data records. [2025-09-19T22:27:13.117875] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:13.123743] [INFO ] [MAIN ] THQ: Generated 1820 derivative records from 24661 primary records. [2025-09-19T22:27:13.124705] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-19T22:27:13.124534] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:13.125561] [INFO ] [MAIN ] THO: Generated 1820 derivative records from 43130 primary records. [2025-09-19T22:27:13.126707] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-19T22:27:13.159627] [DEBUG] [LOCAL ] THQ: Derivative data saved (1820 records). [2025-09-19T22:27:13.160527] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-19T22:27:13.163244] [INFO ] [MAIN ] Derivative Progress: 1825/2093 symbols completed. THQ took 1.2s. Estimated remaining: 1m 44s. Rate: 154.9 symbols/min [2025-09-19T22:27:13.164054] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:13.179387] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:13.180685] [INFO ] [MAIN ] THR: Generated 1820 derivative records from 20422 primary records. [2025-09-19T22:27:13.181416] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-19T22:27:13.181789] [DEBUG] [LOCAL ] THO: Derivative data saved (1820 records). [2025-09-19T22:27:13.183116] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-19T22:27:13.185423] [INFO ] [MAIN ] Derivative Progress: 1826/2093 symbols completed. THO took 1.2s. Estimated remaining: 1m 43s. Rate: 155.0 symbols/min [2025-09-19T22:27:13.193284] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:13.203234] [DEBUG] [LOCAL ] THR: Derivative data saved (1820 records). [2025-09-19T22:27:13.203494] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-19T22:27:13.205908] [INFO ] [MAIN ] Derivative Progress: 1827/2093 symbols completed. THR took 1.2s. Estimated remaining: 1m 43s. Rate: 155.1 symbols/min [2025-09-19T22:27:13.206273] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:13.234119] [DEBUG] [LOCAL ] THW: Loaded 19372 existing records from primary storage. [2025-09-19T22:27:13.234337] [INFO ] [MAIN ] THW: Loaded 19372 primary data records. [2025-09-19T22:27:13.341836] [DEBUG] [LOCAL ] THS: Loaded 38516 existing records from primary storage. [2025-09-19T22:27:13.362759] [INFO ] [MAIN ] THS: Loaded 38516 primary data records. [2025-09-19T22:27:13.524988] [DEBUG] [LOCAL ] TIMB: Loaded 37541 existing records from primary storage. [2025-09-19T22:27:13.652769] [INFO ] [MAIN ] TIMB: Loaded 37541 primary data records. [2025-09-19T22:27:14.334964] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:14.336306] [INFO ] [MAIN ] THW: Generated 1820 derivative records from 19372 primary records. [2025-09-19T22:27:14.351087] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-19T22:27:14.351272] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:14.353048] [INFO ] [MAIN ] THS: Generated 1820 derivative records from 38516 primary records. [2025-09-19T22:27:14.353361] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-19T22:27:14.389200] [DEBUG] [LOCAL ] THW: Derivative data saved (1820 records). [2025-09-19T22:27:14.389696] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-19T22:27:14.390637] [DEBUG] [LOCAL ] THS: Derivative data saved (1820 records). [2025-09-19T22:27:14.393599] [INFO ] [MAIN ] Derivative Progress: 1828/2093 symbols completed. THW took 1.2s. Estimated remaining: 1m 43s. Rate: 154.9 symbols/min [2025-09-19T22:27:14.393860] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-19T22:27:14.397031] [INFO ] [MAIN ] Derivative Progress: 1829/2093 symbols completed. THS took 1.2s. Estimated remaining: 1m 42s. Rate: 155.0 symbols/min [2025-09-19T22:27:14.410531] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:14.411230] [INFO ] [MAIN ] TIMB: Generated 1820 derivative records from 37541 primary records. [2025-09-19T22:27:14.411295] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-19T22:27:14.427096] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1820 records). [2025-09-19T22:27:14.427165] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-19T22:27:14.430307] [INFO ] [MAIN ] Derivative Progress: 1830/2093 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 42s. Rate: 155.0 symbols/min [2025-09-19T22:27:14.430983] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:14.431377] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:14.431160] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:14.441976] [DEBUG] [LOCAL ] TISI: Loaded 3916 existing records from primary storage. [2025-09-19T22:27:14.442146] [INFO ] [MAIN ] TISI: Loaded 3916 primary data records. [2025-09-19T22:27:14.583616] [DEBUG] [LOCAL ] TIXT: Loaded 31649 existing records from primary storage. [2025-09-19T22:27:14.633459] [INFO ] [MAIN ] TIXT: Loaded 31649 primary data records. [2025-09-19T22:27:14.885096] [DEBUG] [LOCAL ] TJX: Loaded 54453 existing records from primary storage. [2025-09-19T22:27:14.892582] [INFO ] [MAIN ] TJX: Loaded 54453 primary data records. [2025-09-19T22:27:15.485423] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:15.486292] [INFO ] [MAIN ] TISI: Generated 1820 derivative records from 3916 primary records. [2025-09-19T22:27:15.486389] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-19T22:27:15.503779] [DEBUG] [LOCAL ] TISI: Derivative data saved (1820 records). [2025-09-19T22:27:15.504017] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-19T22:27:15.506425] [INFO ] [MAIN ] Derivative Progress: 1831/2093 symbols completed. TISI took 1.1s. Estimated remaining: 1m 41s. Rate: 154.9 symbols/min [2025-09-19T22:27:15.507069] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:15.524057] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:15.527030] [INFO ] [MAIN ] TIXT: Generated 1820 derivative records from 31649 primary records. [2025-09-19T22:27:15.527921] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-19T22:27:15.553566] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:15.555110] [INFO ] [MAIN ] TJX: Generated 1820 derivative records from 54453 primary records. [2025-09-19T22:27:15.555282] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-19T22:27:15.578786] [DEBUG] [LOCAL ] TJX: Derivative data saved (1820 records). [2025-09-19T22:27:15.589843] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-19T22:27:15.589936] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1820 records). [2025-09-19T22:27:15.592572] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-19T22:27:15.592327] [INFO ] [MAIN ] Derivative Progress: 1832/2093 symbols completed. TJX took 1.2s. Estimated remaining: 1m 41s. Rate: 155.0 symbols/min [2025-09-19T22:27:15.595862] [INFO ] [MAIN ] Derivative Progress: 1833/2093 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 41s. Rate: 155.0 symbols/min [2025-09-19T22:27:15.595999] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:15.596599] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:15.611122] [DEBUG] [LOCAL ] TK: Loaded 40472 existing records from primary storage. [2025-09-19T22:27:15.611371] [INFO ] [MAIN ] TK: Loaded 40472 primary data records. [2025-09-19T22:27:15.952338] [DEBUG] [LOCAL ] TKC: Loaded 38470 existing records from primary storage. [2025-09-19T22:27:15.961533] [INFO ] [MAIN ] TKC: Loaded 38470 primary data records. [2025-09-19T22:27:16.102171] [DEBUG] [LOCAL ] TKO: Loaded 45040 existing records from primary storage. [2025-09-19T22:27:16.118681] [INFO ] [MAIN ] TKO: Loaded 45040 primary data records. [2025-09-19T22:27:16.696006] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:16.698021] [INFO ] [MAIN ] TK: Generated 1820 derivative records from 40472 primary records. [2025-09-19T22:27:16.701367] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-19T22:27:16.724301] [DEBUG] [LOCAL ] TK: Derivative data saved (1820 records). [2025-09-19T22:27:16.724571] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-19T22:27:16.739562] [INFO ] [MAIN ] Derivative Progress: 1834/2093 symbols completed. TK took 1.2s. Estimated remaining: 1m 40s. Rate: 154.9 symbols/min [2025-09-19T22:27:16.740215] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:16.740549] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:16.742026] [INFO ] [MAIN ] TKC: Generated 1820 derivative records from 38470 primary records. [2025-09-19T22:27:16.743555] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-19T22:27:16.762509] [DEBUG] [LOCAL ] TKC: Derivative data saved (1820 records). [2025-09-19T22:27:16.762658] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-19T22:27:16.764800] [INFO ] [MAIN ] Derivative Progress: 1835/2093 symbols completed. TKC took 1.2s. Estimated remaining: 1m 40s. Rate: 155.0 symbols/min [2025-09-19T22:27:16.765260] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:16.782505] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:16.783308] [INFO ] [MAIN ] TKO: Generated 1820 derivative records from 45040 primary records. [2025-09-19T22:27:16.783484] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-19T22:27:16.800441] [DEBUG] [LOCAL ] TKO: Derivative data saved (1820 records). [2025-09-19T22:27:16.800636] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-19T22:27:16.812946] [INFO ] [MAIN ] Derivative Progress: 1836/2093 symbols completed. TKO took 1.2s. Estimated remaining: 1m 39s. Rate: 155.0 symbols/min [2025-09-19T22:27:16.813432] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:16.829602] [DEBUG] [LOCAL ] TKR: Loaded 40746 existing records from primary storage. [2025-09-19T22:27:16.829924] [INFO ] [MAIN ] TKR: Loaded 40746 primary data records. [2025-09-19T22:27:16.969744] [DEBUG] [LOCAL ] TLYS: Loaded 17139 existing records from primary storage. [2025-09-19T22:27:16.976428] [INFO ] [MAIN ] TLYS: Loaded 17139 primary data records. [2025-09-19T22:27:16.976301] [DEBUG] [LOCAL ] TLK: Loaded 40539 existing records from primary storage. [2025-09-19T22:27:17.004400] [INFO ] [MAIN ] TLK: Loaded 40539 primary data records. [2025-09-19T22:27:17.831147] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:17.832371] [INFO ] [MAIN ] TKR: Generated 1820 derivative records from 40746 primary records. [2025-09-19T22:27:17.832612] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-19T22:27:17.852338] [DEBUG] [LOCAL ] TKR: Derivative data saved (1820 records). [2025-09-19T22:27:17.864874] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-19T22:27:17.867732] [INFO ] [MAIN ] Derivative Progress: 1837/2093 symbols completed. TKR took 1.1s. Estimated remaining: 1m 39s. Rate: 154.9 symbols/min [2025-09-19T22:27:17.868029] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:17.865435] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:17.871536] [INFO ] [MAIN ] TLYS: Generated 1820 derivative records from 17139 primary records. [2025-09-19T22:27:17.871834] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-19T22:27:17.895337] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:17.902508] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1820 records). [2025-09-19T22:27:17.903388] [INFO ] [MAIN ] TLK: Generated 1820 derivative records from 40539 primary records. [2025-09-19T22:27:17.903601] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-19T22:27:17.903749] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-19T22:27:17.906039] [INFO ] [MAIN ] Derivative Progress: 1838/2093 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 39s. Rate: 155.0 symbols/min [2025-09-19T22:27:17.907243] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:17.930333] [DEBUG] [LOCAL ] TLK: Derivative data saved (1820 records). [2025-09-19T22:27:17.930425] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-19T22:27:17.933238] [INFO ] [MAIN ] Derivative Progress: 1839/2093 symbols completed. TLK took 1.2s. Estimated remaining: 1m 38s. Rate: 155.0 symbols/min [2025-09-19T22:27:17.933776] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:17.973113] [DEBUG] [LOCAL ] TM: Loaded 37448 existing records from primary storage. [2025-09-19T22:27:17.973292] [INFO ] [MAIN ] TM: Loaded 37448 primary data records. [2025-09-19T22:27:18.214787] [DEBUG] [LOCAL ] TMHC: Loaded 46324 existing records from primary storage. [2025-09-19T22:27:18.359272] [INFO ] [MAIN ] TMHC: Loaded 46324 primary data records. [2025-09-19T22:27:18.368274] [DEBUG] [LOCAL ] TME: Loaded 53980 existing records from primary storage. [2025-09-19T22:27:18.380372] [INFO ] [MAIN ] TME: Loaded 53980 primary data records. [2025-09-19T22:27:19.020171] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:19.021120] [INFO ] [MAIN ] TM: Generated 1820 derivative records from 37448 primary records. [2025-09-19T22:27:19.023033] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-19T22:27:19.046978] [DEBUG] [LOCAL ] TM: Derivative data saved (1820 records). [2025-09-19T22:27:19.048386] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-19T22:27:19.054082] [INFO ] [MAIN ] Derivative Progress: 1840/2093 symbols completed. TM took 1.2s. Estimated remaining: 1m 38s. Rate: 154.9 symbols/min [2025-09-19T22:27:19.062453] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:19.076723] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:19.083520] [INFO ] [MAIN ] TME: Generated 1820 derivative records from 53980 primary records. [2025-09-19T22:27:19.082765] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:19.084507] [INFO ] [MAIN ] TMHC: Generated 1820 derivative records from 46324 primary records. [2025-09-19T22:27:19.083735] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-19T22:27:19.085584] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-19T22:27:19.121035] [DEBUG] [LOCAL ] TME: Derivative data saved (1820 records). [2025-09-19T22:27:19.121952] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-19T22:27:19.128172] [INFO ] [MAIN ] Derivative Progress: 1841/2093 symbols completed. TME took 1.2s. Estimated remaining: 1m 38s. Rate: 154.9 symbols/min [2025-09-19T22:27:19.129070] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1820 records). [2025-09-19T22:27:19.129321] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:19.129185] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-19T22:27:19.131443] [INFO ] [MAIN ] Derivative Progress: 1842/2093 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 37s. Rate: 155.0 symbols/min [2025-09-19T22:27:19.132036] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:19.190942] [DEBUG] [LOCAL ] TMO: Loaded 53102 existing records from primary storage. [2025-09-19T22:27:19.191220] [INFO ] [MAIN ] TMO: Loaded 53102 primary data records. [2025-09-19T22:27:19.307777] [DEBUG] [LOCAL ] TNET: Loaded 29575 existing records from primary storage. [2025-09-19T22:27:19.313632] [DEBUG] [LOCAL ] TNK: Loaded 35945 existing records from primary storage. [2025-09-19T22:27:19.325179] [INFO ] [MAIN ] TNK: Loaded 35945 primary data records. [2025-09-19T22:27:19.325276] [INFO ] [MAIN ] TNET: Loaded 29575 primary data records. [2025-09-19T22:27:20.190352] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:20.191461] [INFO ] [MAIN ] TMO: Generated 1820 derivative records from 53102 primary records. [2025-09-19T22:27:20.191821] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-19T22:27:20.227817] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:20.230358] [INFO ] [MAIN ] TNK: Generated 1820 derivative records from 35945 primary records. [2025-09-19T22:27:20.230546] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-19T22:27:20.239075] [DEBUG] [LOCAL ] TMO: Derivative data saved (1820 records). [2025-09-19T22:27:20.251721] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:20.256059] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-19T22:27:20.260498] [INFO ] [MAIN ] Derivative Progress: 1843/2093 symbols completed. TMO took 1.2s. Estimated remaining: 1m 37s. Rate: 154.9 symbols/min [2025-09-19T22:27:20.257126] [INFO ] [MAIN ] TNET: Generated 1820 derivative records from 29575 primary records. [2025-09-19T22:27:20.261528] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-19T22:27:20.280026] [DEBUG] [LOCAL ] TNET: Derivative data saved (1820 records). [2025-09-19T22:27:20.280391] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-19T22:27:20.283049] [INFO ] [MAIN ] Derivative Progress: 1844/2093 symbols completed. TNET took 1.2s. Estimated remaining: 1m 36s. Rate: 155.0 symbols/min [2025-09-19T22:27:20.283984] [DEBUG] [LOCAL ] TNK: Derivative data saved (1820 records). [2025-09-19T22:27:20.284178] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-19T22:27:20.287025] [INFO ] [MAIN ] Derivative Progress: 1845/2093 symbols completed. TNK took 1.2s. Estimated remaining: 1m 36s. Rate: 155.0 symbols/min [2025-09-19T22:27:20.288034] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:20.287959] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:20.287633] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:20.365862] [DEBUG] [LOCAL ] TNL: Loaded 42508 existing records from primary storage. [2025-09-19T22:27:20.366757] [INFO ] [MAIN ] TNL: Loaded 42508 primary data records. [2025-09-19T22:27:20.451433] [DEBUG] [LOCAL ] TOST: Loaded 54461 existing records from primary storage. [2025-09-19T22:27:20.494252] [INFO ] [MAIN ] TOST: Loaded 54461 primary data records. [2025-09-19T22:27:20.521616] [DEBUG] [LOCAL ] TOL: Loaded 51876 existing records from primary storage. [2025-09-19T22:27:20.537061] [INFO ] [MAIN ] TOL: Loaded 51876 primary data records. [2025-09-19T22:27:21.413105] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:21.416545] [INFO ] [MAIN ] TNL: Generated 1820 derivative records from 42508 primary records. [2025-09-19T22:27:21.416733] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-19T22:27:21.448914] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:21.451776] [INFO ] [MAIN ] TOST: Generated 1820 derivative records from 54461 primary records. [2025-09-19T22:27:21.452590] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-19T22:27:21.484292] [DEBUG] [LOCAL ] TNL: Derivative data saved (1820 records). [2025-09-19T22:27:21.489536] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:21.494241] [DEBUG] [LOCAL ] TOST: Derivative data saved (1820 records). [2025-09-19T22:27:21.494560] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-19T22:27:21.495708] [INFO ] [MAIN ] TOL: Generated 1820 derivative records from 51876 primary records. [2025-09-19T22:27:21.494370] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-19T22:27:21.497820] [INFO ] [MAIN ] Derivative Progress: 1846/2093 symbols completed. TNL took 1.2s. Estimated remaining: 1m 36s. Rate: 154.9 symbols/min [2025-09-19T22:27:21.501446] [INFO ] [MAIN ] Derivative Progress: 1847/2093 symbols completed. TOST took 1.2s. Estimated remaining: 1m 35s. Rate: 154.9 symbols/min [2025-09-19T22:27:21.501733] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-19T22:27:21.502971] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:21.501873] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:21.522095] [DEBUG] [LOCAL ] TOL: Derivative data saved (1820 records). [2025-09-19T22:27:21.522356] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-19T22:27:21.524938] [INFO ] [MAIN ] Derivative Progress: 1848/2093 symbols completed. TOL took 1.2s. Estimated remaining: 1m 35s. Rate: 155.0 symbols/min [2025-09-19T22:27:21.525578] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:21.587875] [DEBUG] [LOCAL ] TPB: Loaded 25347 existing records from primary storage. [2025-09-19T22:27:21.588727] [INFO ] [MAIN ] TPB: Loaded 25347 primary data records. [2025-09-19T22:27:21.646811] [DEBUG] [LOCAL ] TPC: Loaded 39544 existing records from primary storage. [2025-09-19T22:27:21.667994] [INFO ] [MAIN ] TPC: Loaded 39544 primary data records. [2025-09-19T22:27:21.761255] [DEBUG] [LOCAL ] TPH: Loaded 45991 existing records from primary storage. [2025-09-19T22:27:21.805327] [INFO ] [MAIN ] TPH: Loaded 45991 primary data records. [2025-09-19T22:27:22.897762] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:22.913613] [INFO ] [MAIN ] TPC: Generated 1820 derivative records from 39544 primary records. [2025-09-19T22:27:22.914371] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-19T22:27:22.914841] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:22.928488] [INFO ] [MAIN ] TPB: Generated 1820 derivative records from 25347 primary records. [2025-09-19T22:27:22.929051] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-19T22:27:22.937270] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:22.950782] [INFO ] [MAIN ] TPH: Generated 1820 derivative records from 45991 primary records. [2025-09-19T22:27:22.954133] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-19T22:27:22.960873] [DEBUG] [LOCAL ] TPB: Derivative data saved (1820 records). [2025-09-19T22:27:22.961275] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-19T22:27:22.976185] [INFO ] [MAIN ] Derivative Progress: 1849/2093 symbols completed. TPB took 1.5s. Estimated remaining: 1m 35s. Rate: 154.8 symbols/min [2025-09-19T22:27:22.983384] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:22.986063] [DEBUG] [LOCAL ] TPC: Derivative data saved (1820 records). [2025-09-19T22:27:22.986483] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-19T22:27:22.990329] [INFO ] [MAIN ] Derivative Progress: 1850/2093 symbols completed. TPC took 1.5s. Estimated remaining: 1m 34s. Rate: 154.9 symbols/min [2025-09-19T22:27:22.991740] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:22.999097] [DEBUG] [LOCAL ] TPH: Derivative data saved (1820 records). [2025-09-19T22:27:23.002638] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-19T22:27:23.005880] [INFO ] [MAIN ] Derivative Progress: 1851/2093 symbols completed. TPH took 1.5s. Estimated remaining: 1m 34s. Rate: 154.9 symbols/min [2025-09-19T22:27:23.006315] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:23.013326] [DEBUG] [LOCAL ] TPL: Loaded 12621 existing records from primary storage. [2025-09-19T22:27:23.013450] [INFO ] [MAIN ] TPL: Loaded 12621 primary data records. [2025-09-19T22:27:23.345130] [DEBUG] [LOCAL ] TPVG: Loaded 27486 existing records from primary storage. [2025-09-19T22:27:23.345909] [INFO ] [MAIN ] TPVG: Loaded 27486 primary data records. [2025-09-19T22:27:23.467232] [DEBUG] [LOCAL ] TPR: Loaded 54265 existing records from primary storage. [2025-09-19T22:27:23.471859] [INFO ] [MAIN ] TPR: Loaded 54265 primary data records. [2025-09-19T22:27:24.011298] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:24.012532] [INFO ] [MAIN ] TPL: Generated 1820 derivative records from 12621 primary records. [2025-09-19T22:27:24.012676] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-19T22:27:24.031551] [DEBUG] [LOCAL ] TPL: Derivative data saved (1820 records). [2025-09-19T22:27:24.031838] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-19T22:27:24.033928] [INFO ] [MAIN ] Derivative Progress: 1852/2093 symbols completed. TPL took 1.1s. Estimated remaining: 1m 33s. Rate: 154.8 symbols/min [2025-09-19T22:27:24.034188] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:24.056761] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:24.060280] [DEBUG] [LOCAL ] TPYP: Loaded 8107 existing records from primary storage. [2025-09-19T22:27:24.060588] [INFO ] [MAIN ] TPYP: Loaded 8107 primary data records. [2025-09-19T22:27:24.061350] [INFO ] [MAIN ] TPVG: Generated 1820 derivative records from 27486 primary records. [2025-09-19T22:27:24.099464] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-19T22:27:24.205024] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:27:24.204713] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1820 records). [2025-09-19T22:27:24.221818] [INFO ] [MAIN ] TPR: Generated 1819 derivative records from 54265 primary records. [2025-09-19T22:27:24.215908] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-19T22:27:24.232195] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-19T22:27:24.257142] [INFO ] [MAIN ] Derivative Progress: 1853/2093 symbols completed. TPVG took 1.3s. Estimated remaining: 1m 33s. Rate: 154.8 symbols/min [2025-09-19T22:27:24.303827] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:24.433341] [DEBUG] [LOCAL ] TPR: Derivative data saved (1819 records). [2025-09-19T22:27:24.435432] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-19T22:27:24.438129] [INFO ] [MAIN ] Derivative Progress: 1854/2093 symbols completed. TPR took 1.4s. Estimated remaining: 1m 33s. Rate: 154.9 symbols/min [2025-09-19T22:27:24.439121] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:24.443439] [DEBUG] [LOCAL ] TPZ: Loaded 5353 existing records from primary storage. [2025-09-19T22:27:24.444086] [INFO ] [MAIN ] TPZ: Loaded 5353 primary data records. [2025-09-19T22:27:24.580734] [DEBUG] [LOCAL ] TR: Loaded 18499 existing records from primary storage. [2025-09-19T22:27:24.649027] [INFO ] [MAIN ] TR: Loaded 18499 primary data records. [2025-09-19T22:27:24.995095] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:25.017729] [INFO ] [MAIN ] TPYP: Generated 1820 derivative records from 8107 primary records. [2025-09-19T22:27:25.018152] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-19T22:27:25.152459] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1820 records). [2025-09-19T22:27:25.153739] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-19T22:27:25.156019] [INFO ] [MAIN ] Derivative Progress: 1855/2093 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 32s. Rate: 154.8 symbols/min [2025-09-19T22:27:25.156781] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:25.186502] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:25.191431] [DEBUG] [LOCAL ] TRAK: Loaded 9553 existing records from primary storage. [2025-09-19T22:27:25.191614] [INFO ] [MAIN ] TRAK: Loaded 9553 primary data records. [2025-09-19T22:27:25.198488] [INFO ] [MAIN ] TPZ: Generated 1820 derivative records from 5353 primary records. [2025-09-19T22:27:25.224134] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-19T22:27:25.349078] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:25.355618] [INFO ] [MAIN ] TR: Generated 1820 derivative records from 18499 primary records. [2025-09-19T22:27:25.355741] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-19T22:27:25.354915] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1820 records). [2025-09-19T22:27:25.388429] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-19T22:27:25.406944] [INFO ] [MAIN ] Derivative Progress: 1856/2093 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 32s. Rate: 154.8 symbols/min [2025-09-19T22:27:25.414048] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:25.550570] [DEBUG] [LOCAL ] TR: Derivative data saved (1820 records). [2025-09-19T22:27:25.550825] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-19T22:27:25.553345] [INFO ] [MAIN ] Derivative Progress: 1857/2093 symbols completed. TR took 1.1s. Estimated remaining: 1m 31s. Rate: 154.9 symbols/min [2025-09-19T22:27:25.554556] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:25.570048] [DEBUG] [LOCAL ] TRC: Loaded 16277 existing records from primary storage. [2025-09-19T22:27:25.570429] [INFO ] [MAIN ] TRC: Loaded 16277 primary data records. [2025-09-19T22:27:25.895551] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:25.897286] [INFO ] [MAIN ] TRAK: Generated 1820 derivative records from 9553 primary records. [2025-09-19T22:27:25.909734] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-19T22:27:25.912566] [DEBUG] [LOCAL ] TREX: Loaded 50744 existing records from primary storage. [2025-09-19T22:27:25.912722] [INFO ] [MAIN ] TREX: Loaded 50744 primary data records. [2025-09-19T22:27:25.976947] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1820 records). [2025-09-19T22:27:25.998410] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-19T22:27:26.012383] [INFO ] [MAIN ] Derivative Progress: 1858/2093 symbols completed. TRAK took 0.9s. Estimated remaining: 1m 31s. Rate: 154.9 symbols/min [2025-09-19T22:27:26.244900] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:26.245989] [INFO ] [MAIN ] TRC: Generated 1820 derivative records from 16277 primary records. [2025-09-19T22:27:26.246245] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-19T22:27:26.264243] [DEBUG] [LOCAL ] TRC: Derivative data saved (1820 records). [2025-09-19T22:27:26.264558] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-19T22:27:26.266896] [INFO ] [MAIN ] Derivative Progress: 1859/2093 symbols completed. TRC took 0.9s. Estimated remaining: 1m 31s. Rate: 154.9 symbols/min [2025-09-19T22:27:26.283500] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:26.284082] [INFO ] [MAIN ] TREX: Generated 1820 derivative records from 50744 primary records. [2025-09-19T22:27:26.284142] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-19T22:27:26.299414] [DEBUG] [LOCAL ] TREX: Derivative data saved (1820 records). [2025-09-19T22:27:26.299477] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-19T22:27:26.301550] [INFO ] [MAIN ] Derivative Progress: 1860/2093 symbols completed. TREX took 0.7s. Estimated remaining: 1m 30s. Rate: 155.0 symbols/min [2025-09-19T22:27:26.302382] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:26.302457] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:26.302306] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:26.382241] [DEBUG] [LOCAL ] TRN: Loaded 38047 existing records from primary storage. [2025-09-19T22:27:26.384033] [DEBUG] [LOCAL ] TRNO: Loaded 44882 existing records from primary storage. [2025-09-19T22:27:26.384266] [INFO ] [MAIN ] TRNO: Loaded 44882 primary data records. [2025-09-19T22:27:26.384342] [INFO ] [MAIN ] TRN: Loaded 38047 primary data records. [2025-09-19T22:27:26.586106] [DEBUG] [LOCAL ] TRGP: Loaded 51625 existing records from primary storage. [2025-09-19T22:27:26.602770] [INFO ] [MAIN ] TRGP: Loaded 51625 primary data records. [2025-09-19T22:27:27.394155] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:27.399693] [INFO ] [MAIN ] TRNO: Generated 1820 derivative records from 44882 primary records. [2025-09-19T22:27:27.400197] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-19T22:27:27.401073] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:27.403968] [INFO ] [MAIN ] TRN: Generated 1820 derivative records from 38047 primary records. [2025-09-19T22:27:27.412748] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-19T22:27:27.443142] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:27.445102] [INFO ] [MAIN ] TRGP: Generated 1820 derivative records from 51625 primary records. [2025-09-19T22:27:27.450359] [DEBUG] [LOCAL ] TRN: Derivative data saved (1820 records). [2025-09-19T22:27:27.446247] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1820 records). [2025-09-19T22:27:27.450573] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-19T22:27:27.450472] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-19T22:27:27.450740] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-19T22:27:27.453726] [INFO ] [MAIN ] Derivative Progress: 1861/2093 symbols completed. TRN took 1.2s. Estimated remaining: 1m 30s. Rate: 154.8 symbols/min [2025-09-19T22:27:27.454227] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:27.456636] [INFO ] [MAIN ] Derivative Progress: 1862/2093 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 29s. Rate: 154.9 symbols/min [2025-09-19T22:27:27.472800] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1820 records). [2025-09-19T22:27:27.468526] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:27.473023] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-19T22:27:27.476792] [INFO ] [MAIN ] Derivative Progress: 1863/2093 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 29s. Rate: 155.0 symbols/min [2025-09-19T22:27:27.481166] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:27.562271] [DEBUG] [LOCAL ] TROX: Loaded 52525 existing records from primary storage. [2025-09-19T22:27:27.560738] [DEBUG] [LOCAL ] TRTX: Loaded 37925 existing records from primary storage. [2025-09-19T22:27:27.562679] [INFO ] [MAIN ] TRTX: Loaded 37925 primary data records. [2025-09-19T22:27:27.562557] [INFO ] [MAIN ] TROX: Loaded 52525 primary data records. [2025-09-19T22:27:27.734448] [DEBUG] [LOCAL ] TRP: Loaded 52906 existing records from primary storage. [2025-09-19T22:27:27.747375] [INFO ] [MAIN ] TRP: Loaded 52906 primary data records. [2025-09-19T22:27:28.567618] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:28.568946] [INFO ] [MAIN ] TRTX: Generated 1820 derivative records from 37925 primary records. [2025-09-19T22:27:28.570903] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-19T22:27:28.602521] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:28.603668] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1820 records). [2025-09-19T22:27:28.616564] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-19T22:27:28.616467] [INFO ] [MAIN ] TROX: Generated 1820 derivative records from 52525 primary records. [2025-09-19T22:27:28.618861] [INFO ] [MAIN ] Derivative Progress: 1864/2093 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 29s. Rate: 154.8 symbols/min [2025-09-19T22:27:28.619301] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:28.617144] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-19T22:27:28.620097] [INFO ] [MAIN ] TRP: Generated 1820 derivative records from 52906 primary records. [2025-09-19T22:27:28.620215] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-19T22:27:28.621680] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:28.653953] [DEBUG] [LOCAL ] TROX: Derivative data saved (1820 records). [2025-09-19T22:27:28.654091] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-19T22:27:28.656919] [INFO ] [MAIN ] Derivative Progress: 1865/2093 symbols completed. TROX took 1.2s. Estimated remaining: 1m 28s. Rate: 154.9 symbols/min [2025-09-19T22:27:28.653595] [DEBUG] [LOCAL ] TRP: Derivative data saved (1820 records). [2025-09-19T22:27:28.657351] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:28.657497] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-19T22:27:28.659693] [INFO ] [MAIN ] Derivative Progress: 1866/2093 symbols completed. TRP took 1.2s. Estimated remaining: 1m 28s. Rate: 155.0 symbols/min [2025-09-19T22:27:28.660356] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:28.734889] [DEBUG] [LOCAL ] TS: Loaded 52447 existing records from primary storage. [2025-09-19T22:27:28.735066] [INFO ] [MAIN ] TS: Loaded 52447 primary data records. [2025-09-19T22:27:28.866204] [DEBUG] [LOCAL ] TRU: Loaded 51951 existing records from primary storage. [2025-09-19T22:27:28.882158] [INFO ] [MAIN ] TRU: Loaded 51951 primary data records. [2025-09-19T22:27:28.887865] [DEBUG] [LOCAL ] TRV: Loaded 49097 existing records from primary storage. [2025-09-19T22:27:28.954676] [INFO ] [MAIN ] TRV: Loaded 49097 primary data records. [2025-09-19T22:27:29.726924] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:29.728195] [INFO ] [MAIN ] TS: Generated 1820 derivative records from 52447 primary records. [2025-09-19T22:27:29.728344] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-19T22:27:29.747240] [DEBUG] [LOCAL ] TS: Derivative data saved (1820 records). [2025-09-19T22:27:29.749258] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-19T22:27:29.752162] [INFO ] [MAIN ] Derivative Progress: 1867/2093 symbols completed. TS took 1.1s. Estimated remaining: 1m 28s. Rate: 154.8 symbols/min [2025-09-19T22:27:29.753045] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:29.766975] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:29.767916] [INFO ] [MAIN ] TRU: Generated 1820 derivative records from 51951 primary records. [2025-09-19T22:27:29.767989] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-19T22:27:29.788324] [DEBUG] [LOCAL ] TRU: Derivative data saved (1820 records). [2025-09-19T22:27:29.788517] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-19T22:27:29.791287] [INFO ] [MAIN ] Derivative Progress: 1868/2093 symbols completed. TRU took 1.2s. Estimated remaining: 1m 27s. Rate: 154.9 symbols/min [2025-09-19T22:27:29.791821] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:29.805871] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:29.807494] [INFO ] [MAIN ] TRV: Generated 1820 derivative records from 49097 primary records. [2025-09-19T22:27:29.819718] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-19T22:27:29.840321] [DEBUG] [LOCAL ] TSI: Loaded 8745 existing records from primary storage. [2025-09-19T22:27:29.850539] [INFO ] [MAIN ] TSI: Loaded 8745 primary data records. [2025-09-19T22:27:29.884529] [DEBUG] [LOCAL ] TRV: Derivative data saved (1820 records). [2025-09-19T22:27:29.883902] [DEBUG] [LOCAL ] TSE: Loaded 29327 existing records from primary storage. [2025-09-19T22:27:29.909119] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-19T22:27:29.920495] [INFO ] [MAIN ] Derivative Progress: 1869/2093 symbols completed. TRV took 1.3s. Estimated remaining: 1m 27s. Rate: 155.0 symbols/min [2025-09-19T22:27:29.932363] [INFO ] [MAIN ] TSE: Loaded 29327 primary data records. [2025-09-19T22:27:29.949002] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:30.493247] [DEBUG] [LOCAL ] TSLX: Loaded 35905 existing records from primary storage. [2025-09-19T22:27:30.495468] [INFO ] [MAIN ] TSLX: Loaded 35905 primary data records. [2025-09-19T22:27:30.870927] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:30.871926] [INFO ] [MAIN ] TSI: Generated 1820 derivative records from 8745 primary records. [2025-09-19T22:27:30.872128] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-19T22:27:30.893198] [DEBUG] [LOCAL ] TSI: Derivative data saved (1820 records). [2025-09-19T22:27:30.893776] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-19T22:27:30.895822] [INFO ] [MAIN ] Derivative Progress: 1870/2093 symbols completed. TSI took 1.1s. Estimated remaining: 1m 26s. Rate: 154.8 symbols/min [2025-09-19T22:27:30.896281] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:30.911002] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:30.912119] [INFO ] [MAIN ] TSE: Generated 1820 derivative records from 29327 primary records. [2025-09-19T22:27:30.912357] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-19T22:27:30.930374] [DEBUG] [LOCAL ] TSE: Derivative data saved (1820 records). [2025-09-19T22:27:30.930575] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-19T22:27:30.933237] [INFO ] [MAIN ] Derivative Progress: 1871/2093 symbols completed. TSE took 1.2s. Estimated remaining: 1m 26s. Rate: 154.9 symbols/min [2025-09-19T22:27:30.933666] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:30.950347] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:30.951105] [INFO ] [MAIN ] TSLX: Generated 1820 derivative records from 35905 primary records. [2025-09-19T22:27:30.951169] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-19T22:27:30.967766] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1820 records). [2025-09-19T22:27:30.967956] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-19T22:27:30.970423] [INFO ] [MAIN ] Derivative Progress: 1872/2093 symbols completed. TSLX took 1.0s. Estimated remaining: 1m 26s. Rate: 155.0 symbols/min [2025-09-19T22:27:30.970729] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:30.985593] [DEBUG] [LOCAL ] TSQ: Loaded 12203 existing records from primary storage. [2025-09-19T22:27:30.985786] [INFO ] [MAIN ] TSQ: Loaded 12203 primary data records. [2025-09-19T22:27:31.172913] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-09-19T22:27:31.214741] [INFO ] [MAIN ] TSM: Loaded 54599 primary data records. [2025-09-19T22:27:31.448512] [DEBUG] [LOCAL ] TSN: Loaded 53612 existing records from primary storage. [2025-09-19T22:27:31.461752] [INFO ] [MAIN ] TSN: Loaded 53612 primary data records. [2025-09-19T22:27:32.012785] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:32.015283] [INFO ] [MAIN ] TSQ: Generated 1820 derivative records from 12203 primary records. [2025-09-19T22:27:32.015680] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-19T22:27:32.044750] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:32.047109] [INFO ] [MAIN ] TSM: Generated 1820 derivative records from 54599 primary records. [2025-09-19T22:27:32.050302] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1820 records). [2025-09-19T22:27:32.050384] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-19T22:27:32.050505] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-19T22:27:32.053244] [INFO ] [MAIN ] Derivative Progress: 1873/2093 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 25s. Rate: 154.8 symbols/min [2025-09-19T22:27:32.072829] [DEBUG] [LOCAL ] TSM: Derivative data saved (1820 records). [2025-09-19T22:27:32.073014] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-19T22:27:32.075264] [INFO ] [MAIN ] Derivative Progress: 1874/2093 symbols completed. TSM took 1.2s. Estimated remaining: 1m 25s. Rate: 154.9 symbols/min [2025-09-19T22:27:32.088303] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:32.088919] [INFO ] [MAIN ] TSN: Generated 1820 derivative records from 53612 primary records. [2025-09-19T22:27:32.088981] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-19T22:27:32.104232] [DEBUG] [LOCAL ] TSN: Derivative data saved (1820 records). [2025-09-19T22:27:32.104289] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-19T22:27:32.106876] [INFO ] [MAIN ] Derivative Progress: 1875/2093 symbols completed. TSN took 1.2s. Estimated remaining: 1m 24s. Rate: 155.0 symbols/min [2025-09-19T22:27:32.107342] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:32.107615] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:32.108342] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:32.179156] [DEBUG] [LOCAL ] TT: Loaded 48717 existing records from primary storage. [2025-09-19T22:27:32.179859] [INFO ] [MAIN ] TT: Loaded 48717 primary data records. [2025-09-19T22:27:32.250318] [DEBUG] [LOCAL ] TTC: Loaded 43603 existing records from primary storage. [2025-09-19T22:27:32.276185] [INFO ] [MAIN ] TTC: Loaded 43603 primary data records. [2025-09-19T22:27:32.390266] [DEBUG] [LOCAL ] TTE: Loaded 52436 existing records from primary storage. [2025-09-19T22:27:32.460751] [INFO ] [MAIN ] TTE: Loaded 52436 primary data records. [2025-09-19T22:27:33.227121] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:33.227902] [INFO ] [MAIN ] TT: Generated 1820 derivative records from 48717 primary records. [2025-09-19T22:27:33.228151] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-19T22:27:33.247854] [DEBUG] [LOCAL ] TT: Derivative data saved (1820 records). [2025-09-19T22:27:33.248026] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-19T22:27:33.249874] [INFO ] [MAIN ] Derivative Progress: 1876/2093 symbols completed. TT took 1.1s. Estimated remaining: 1m 24s. Rate: 154.8 symbols/min [2025-09-19T22:27:33.250525] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:33.264128] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:33.265169] [INFO ] [MAIN ] TTC: Generated 1820 derivative records from 43603 primary records. [2025-09-19T22:27:33.266127] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-19T22:27:33.296113] [DEBUG] [LOCAL ] TTC: Derivative data saved (1820 records). [2025-09-19T22:27:33.296401] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:33.297267] [INFO ] [MAIN ] TTE: Generated 1820 derivative records from 52436 primary records. [2025-09-19T22:27:33.296594] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-19T22:27:33.297410] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-19T22:27:33.299768] [INFO ] [MAIN ] Derivative Progress: 1877/2093 symbols completed. TTC took 1.2s. Estimated remaining: 1m 24s. Rate: 154.9 symbols/min [2025-09-19T22:27:33.308236] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:33.316965] [DEBUG] [LOCAL ] TTE: Derivative data saved (1820 records). [2025-09-19T22:27:33.317122] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-19T22:27:33.320519] [INFO ] [MAIN ] Derivative Progress: 1878/2093 symbols completed. TTE took 1.2s. Estimated remaining: 1m 23s. Rate: 155.0 symbols/min [2025-09-19T22:27:33.321037] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:33.354558] [DEBUG] [LOCAL ] TTI: Loaded 45947 existing records from primary storage. [2025-09-19T22:27:33.354957] [INFO ] [MAIN ] TTI: Loaded 45947 primary data records. [2025-09-19T22:27:33.691872] [DEBUG] [LOCAL ] TU: Loaded 50687 existing records from primary storage. [2025-09-19T22:27:33.718588] [DEBUG] [LOCAL ] TUYA: Loaded 47368 existing records from primary storage. [2025-09-19T22:27:33.719629] [INFO ] [MAIN ] TUYA: Loaded 47368 primary data records. [2025-09-19T22:27:33.718711] [INFO ] [MAIN ] TU: Loaded 50687 primary data records. [2025-09-19T22:27:34.369208] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:34.371271] [INFO ] [MAIN ] TTI: Generated 1820 derivative records from 45947 primary records. [2025-09-19T22:27:34.371388] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-19T22:27:34.405144] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:34.406711] [INFO ] [MAIN ] TUYA: Generated 1820 derivative records from 47368 primary records. [2025-09-19T22:27:34.406804] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-19T22:27:34.408089] [DEBUG] [LOCAL ] TTI: Derivative data saved (1820 records). [2025-09-19T22:27:34.408418] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-19T22:27:34.411512] [INFO ] [MAIN ] Derivative Progress: 1879/2093 symbols completed. TTI took 1.2s. Estimated remaining: 1m 23s. Rate: 154.8 symbols/min [2025-09-19T22:27:34.425262] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:34.428597] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1820 records). [2025-09-19T22:27:34.429086] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-19T22:27:34.431531] [INFO ] [MAIN ] Derivative Progress: 1880/2093 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 23s. Rate: 154.9 symbols/min [2025-09-19T22:27:34.432074] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:34.445405] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:34.446311] [INFO ] [MAIN ] TU: Generated 1820 derivative records from 50687 primary records. [2025-09-19T22:27:34.446460] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-19T22:27:34.465391] [DEBUG] [LOCAL ] TVC: Loaded 3577 existing records from primary storage. [2025-09-19T22:27:34.466318] [INFO ] [MAIN ] TVC: Loaded 3577 primary data records. [2025-09-19T22:27:34.556035] [DEBUG] [LOCAL ] TU: Derivative data saved (1820 records). [2025-09-19T22:27:34.572620] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-19T22:27:34.575828] [INFO ] [MAIN ] Derivative Progress: 1881/2093 symbols completed. TU took 1.3s. Estimated remaining: 1m 22s. Rate: 155.0 symbols/min [2025-09-19T22:27:34.587513] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:34.679927] [DEBUG] [LOCAL ] TV: Loaded 43675 existing records from primary storage. [2025-09-19T22:27:34.832284] [DEBUG] [LOCAL ] TVE: Loaded 2875 existing records from primary storage. [2025-09-19T22:27:34.824384] [INFO ] [MAIN ] TV: Loaded 43675 primary data records. [2025-09-19T22:27:34.832954] [INFO ] [MAIN ] TVE: Loaded 2875 primary data records. [2025-09-19T22:27:35.474891] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:35.477171] [INFO ] [MAIN ] TVC: Generated 1820 derivative records from 3577 primary records. [2025-09-19T22:27:35.477530] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-19T22:27:35.494568] [DEBUG] [LOCAL ] TVC: Derivative data saved (1820 records). [2025-09-19T22:27:35.494883] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-19T22:27:35.496894] [INFO ] [MAIN ] Derivative Progress: 1882/2093 symbols completed. TVC took 1.1s. Estimated remaining: 1m 22s. Rate: 154.8 symbols/min [2025-09-19T22:27:35.497602] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:35.518958] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-09-19T22:27:35.532694] [INFO ] [MAIN ] TVE: Generated 1818 derivative records from 2875 primary records. [2025-09-19T22:27:35.533282] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-19T22:27:35.534002] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:35.535477] [INFO ] [MAIN ] TV: Generated 1820 derivative records from 43675 primary records. [2025-09-19T22:27:35.535885] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-19T22:27:35.572462] [DEBUG] [LOCAL ] TV: Derivative data saved (1820 records). [2025-09-19T22:27:35.572915] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-19T22:27:35.575552] [INFO ] [MAIN ] Derivative Progress: 1883/2093 symbols completed. TV took 1.2s. Estimated remaining: 1m 21s. Rate: 154.9 symbols/min [2025-09-19T22:27:35.586780] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:35.588985] [DEBUG] [LOCAL ] TWI: Loaded 35388 existing records from primary storage. [2025-09-19T22:27:35.590038] [INFO ] [MAIN ] TWI: Loaded 35388 primary data records. [2025-09-19T22:27:35.611606] [DEBUG] [LOCAL ] TVE: Derivative data saved (1818 records). [2025-09-19T22:27:35.621955] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-19T22:27:35.637411] [INFO ] [MAIN ] Derivative Progress: 1884/2093 symbols completed. TVE took 1.1s. Estimated remaining: 1m 21s. Rate: 155.0 symbols/min [2025-09-19T22:27:35.663847] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:35.724599] [DEBUG] [LOCAL ] TWN: Loaded 3371 existing records from primary storage. [2025-09-19T22:27:35.758713] [INFO ] [MAIN ] TWN: Loaded 3371 primary data records. [2025-09-19T22:27:36.126283] [DEBUG] [LOCAL ] TWLO: Loaded 53497 existing records from primary storage. [2025-09-19T22:27:36.186735] [INFO ] [MAIN ] TWLO: Loaded 53497 primary data records. [2025-09-19T22:27:36.575742] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:36.577976] [INFO ] [MAIN ] TWI: Generated 1820 derivative records from 35388 primary records. [2025-09-19T22:27:36.578372] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-19T22:27:36.599467] [DEBUG] [LOCAL ] TWI: Derivative data saved (1820 records). [2025-09-19T22:27:36.599711] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-19T22:27:36.601913] [INFO ] [MAIN ] Derivative Progress: 1885/2093 symbols completed. TWI took 1.1s. Estimated remaining: 1m 21s. Rate: 154.9 symbols/min [2025-09-19T22:27:36.616453] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:36.616796] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:36.618473] [INFO ] [MAIN ] TWN: Generated 1820 derivative records from 3371 primary records. [2025-09-19T22:27:36.618681] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-19T22:27:36.650308] [DEBUG] [LOCAL ] TWN: Derivative data saved (1820 records). [2025-09-19T22:27:36.650588] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-19T22:27:36.653340] [INFO ] [MAIN ] Derivative Progress: 1886/2093 symbols completed. TWN took 1.0s. Estimated remaining: 1m 20s. Rate: 154.9 symbols/min [2025-09-19T22:27:36.653739] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:36.650951] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:36.655019] [INFO ] [MAIN ] TWLO: Generated 1820 derivative records from 53497 primary records. [2025-09-19T22:27:36.655199] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-19T22:27:36.671939] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1820 records). [2025-09-19T22:27:36.672100] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-19T22:27:36.674435] [INFO ] [MAIN ] Derivative Progress: 1887/2093 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 20s. Rate: 155.0 symbols/min [2025-09-19T22:27:36.674875] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:36.705161] [DEBUG] [LOCAL ] TX: Loaded 24231 existing records from primary storage. [2025-09-19T22:27:36.718732] [INFO ] [MAIN ] TX: Loaded 24231 primary data records. [2025-09-19T22:27:36.731708] [DEBUG] [LOCAL ] TWO: Loaded 48924 existing records from primary storage. [2025-09-19T22:27:36.743112] [INFO ] [MAIN ] TWO: Loaded 48924 primary data records. [2025-09-19T22:27:37.050092] [DEBUG] [LOCAL ] TXNM: Loaded 44698 existing records from primary storage. [2025-09-19T22:27:37.116279] [INFO ] [MAIN ] TXNM: Loaded 44698 primary data records. [2025-09-19T22:27:37.768388] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:37.770480] [INFO ] [MAIN ] TX: Generated 1820 derivative records from 24231 primary records. [2025-09-19T22:27:37.772395] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-19T22:27:37.803785] [DEBUG] [LOCAL ] TX: Derivative data saved (1820 records). [2025-09-19T22:27:37.800052] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:37.803960] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-19T22:27:37.806097] [INFO ] [MAIN ] Derivative Progress: 1888/2093 symbols completed. TX took 1.2s. Estimated remaining: 1m 19s. Rate: 154.8 symbols/min [2025-09-19T22:27:37.807353] [INFO ] [MAIN ] TWO: Generated 1820 derivative records from 48924 primary records. [2025-09-19T22:27:37.807717] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-19T22:27:37.824553] [DEBUG] [LOCAL ] TWO: Derivative data saved (1820 records). [2025-09-19T22:27:37.824901] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-19T22:27:37.828187] [INFO ] [MAIN ] Derivative Progress: 1889/2093 symbols completed. TWO took 1.2s. Estimated remaining: 1m 19s. Rate: 154.9 symbols/min [2025-09-19T22:27:37.844056] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:37.844795] [INFO ] [MAIN ] TXNM: Generated 1820 derivative records from 44698 primary records. [2025-09-19T22:27:37.844859] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-19T22:27:37.860287] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1820 records). [2025-09-19T22:27:37.860347] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-19T22:27:37.862524] [INFO ] [MAIN ] Derivative Progress: 1890/2093 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 19s. Rate: 155.0 symbols/min [2025-09-19T22:27:37.863614] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:37.863310] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:37.864131] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:37.875898] [DEBUG] [LOCAL ] TY: Loaded 7780 existing records from primary storage. [2025-09-19T22:27:37.876085] [INFO ] [MAIN ] TY: Loaded 7780 primary data records. [2025-09-19T22:27:37.992082] [DEBUG] [LOCAL ] TXO: Loaded 18968 existing records from primary storage. [2025-09-19T22:27:37.992639] [INFO ] [MAIN ] TXO: Loaded 18968 primary data records. [2025-09-19T22:27:38.398827] [DEBUG] [LOCAL ] TXT: Loaded 50523 existing records from primary storage. [2025-09-19T22:27:38.420879] [INFO ] [MAIN ] TXT: Loaded 50523 primary data records. [2025-09-19T22:27:38.941260] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:38.943339] [INFO ] [MAIN ] TY: Generated 1820 derivative records from 7780 primary records. [2025-09-19T22:27:38.943613] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-19T22:27:38.963322] [DEBUG] [LOCAL ] TY: Derivative data saved (1820 records). [2025-09-19T22:27:38.971012] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-19T22:27:38.976253] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:38.978537] [INFO ] [MAIN ] Derivative Progress: 1891/2093 symbols completed. TY took 1.1s. Estimated remaining: 1m 18s. Rate: 154.8 symbols/min [2025-09-19T22:27:38.979091] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:38.979957] [INFO ] [MAIN ] TXO: Generated 1820 derivative records from 18968 primary records. [2025-09-19T22:27:38.980297] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-19T22:27:38.998059] [DEBUG] [LOCAL ] TXO: Derivative data saved (1820 records). [2025-09-19T22:27:38.998172] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-19T22:27:39.001235] [INFO ] [MAIN ] Derivative Progress: 1892/2093 symbols completed. TXO took 1.1s. Estimated remaining: 1m 18s. Rate: 154.9 symbols/min [2025-09-19T22:27:39.001744] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:39.026970] [DEBUG] [LOCAL ] TYG: Loaded 14677 existing records from primary storage. [2025-09-19T22:27:39.027310] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:39.027618] [INFO ] [MAIN ] TYG: Loaded 14677 primary data records. [2025-09-19T22:27:39.028352] [INFO ] [MAIN ] TXT: Generated 1820 derivative records from 50523 primary records. [2025-09-19T22:27:39.028579] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-19T22:27:39.142449] [DEBUG] [LOCAL ] TXT: Derivative data saved (1820 records). [2025-09-19T22:27:39.159995] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-19T22:27:39.160461] [DEBUG] [LOCAL ] TYL: Loaded 22841 existing records from primary storage. [2025-09-19T22:27:39.168626] [INFO ] [MAIN ] TYL: Loaded 22841 primary data records. [2025-09-19T22:27:39.163279] [INFO ] [MAIN ] Derivative Progress: 1893/2093 symbols completed. TXT took 1.3s. Estimated remaining: 1m 17s. Rate: 155.0 symbols/min [2025-09-19T22:27:39.208698] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:39.754594] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:39.755874] [INFO ] [MAIN ] TYG: Generated 1820 derivative records from 14677 primary records. [2025-09-19T22:27:39.754254] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-09-19T22:27:39.756148] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-19T22:27:39.757123] [INFO ] [MAIN ] U: Loaded 54579 primary data records. [2025-09-19T22:27:39.858729] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:39.866117] [INFO ] [MAIN ] TYL: Generated 1820 derivative records from 22841 primary records. [2025-09-19T22:27:39.858392] [DEBUG] [LOCAL ] TYG: Derivative data saved (1820 records). [2025-09-19T22:27:39.871358] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-19T22:27:39.882675] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-19T22:27:39.896564] [INFO ] [MAIN ] Derivative Progress: 1894/2093 symbols completed. TYG took 0.9s. Estimated remaining: 1m 17s. Rate: 154.9 symbols/min [2025-09-19T22:27:39.897125] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:39.931263] [DEBUG] [LOCAL ] TYL: Derivative data saved (1820 records). [2025-09-19T22:27:39.941800] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-19T22:27:39.958458] [INFO ] [MAIN ] Derivative Progress: 1895/2093 symbols completed. TYL took 1.0s. Estimated remaining: 1m 17s. Rate: 155.0 symbols/min [2025-09-19T22:27:39.998592] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:40.161926] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:40.162702] [INFO ] [MAIN ] U: Generated 1820 derivative records from 54579 primary records. [2025-09-19T22:27:40.162842] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-19T22:27:40.206189] [DEBUG] [LOCAL ] U: Derivative data saved (1820 records). [2025-09-19T22:27:40.205541] [DEBUG] [LOCAL ] UA: Loaded 51145 existing records from primary storage. [2025-09-19T22:27:40.206359] [INFO ] [MAIN ] UA: Loaded 51145 primary data records. [2025-09-19T22:27:40.206428] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-19T22:27:40.208620] [INFO ] [MAIN ] Derivative Progress: 1896/2093 symbols completed. U took 1.0s. Estimated remaining: 1m 16s. Rate: 155.0 symbols/min [2025-09-19T22:27:40.220264] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:40.337815] [DEBUG] [LOCAL ] UAN: Loaded 5615 existing records from primary storage. [2025-09-19T22:27:40.381037] [INFO ] [MAIN ] UAN: Loaded 5615 primary data records. [2025-09-19T22:27:40.337495] [DEBUG] [LOCAL ] UAA: Loaded 54290 existing records from primary storage. [2025-09-19T22:27:40.419846] [INFO ] [MAIN ] UAA: Loaded 54290 primary data records. [2025-09-19T22:27:41.215175] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:41.216681] [INFO ] [MAIN ] UA: Generated 1820 derivative records from 51145 primary records. [2025-09-19T22:27:41.216898] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-19T22:27:41.238002] [DEBUG] [LOCAL ] UA: Derivative data saved (1820 records). [2025-09-19T22:27:41.239065] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-19T22:27:41.241138] [INFO ] [MAIN ] Derivative Progress: 1897/2093 symbols completed. UA took 1.3s. Estimated remaining: 1m 16s. Rate: 154.9 symbols/min [2025-09-19T22:27:41.241610] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:41.267512] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:41.268681] [INFO ] [MAIN ] UAN: Generated 1820 derivative records from 5615 primary records. [2025-09-19T22:27:41.268886] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:41.269547] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-19T22:27:41.269497] [INFO ] [MAIN ] UAA: Generated 1820 derivative records from 54290 primary records. [2025-09-19T22:27:41.270489] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-19T22:27:41.298106] [DEBUG] [LOCAL ] UAA: Derivative data saved (1820 records). [2025-09-19T22:27:41.300604] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-19T22:27:41.301152] [DEBUG] [LOCAL ] UAN: Derivative data saved (1820 records). [2025-09-19T22:27:41.303672] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-19T22:27:41.303578] [INFO ] [MAIN ] Derivative Progress: 1898/2093 symbols completed. UAA took 1.3s. Estimated remaining: 1m 16s. Rate: 154.9 symbols/min [2025-09-19T22:27:41.306411] [INFO ] [MAIN ] Derivative Progress: 1899/2093 symbols completed. UAN took 1.1s. Estimated remaining: 1m 15s. Rate: 155.0 symbols/min [2025-09-19T22:27:41.306336] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:41.306789] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:41.394240] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-09-19T22:27:41.394478] [INFO ] [MAIN ] UBER: Loaded 54586 primary data records. [2025-09-19T22:27:41.395286] [DEBUG] [LOCAL ] UBS: Loaded 53254 existing records from primary storage. [2025-09-19T22:27:41.426935] [INFO ] [MAIN ] UBS: Loaded 53254 primary data records. [2025-09-19T22:27:41.590435] [DEBUG] [LOCAL ] UCB: Loaded 38738 existing records from primary storage. [2025-09-19T22:27:41.638681] [INFO ] [MAIN ] UCB: Loaded 38738 primary data records. [2025-09-19T22:27:42.349447] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:42.355078] [INFO ] [MAIN ] UBER: Generated 1820 derivative records from 54586 primary records. [2025-09-19T22:27:42.355434] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:42.356164] [INFO ] [MAIN ] UBS: Generated 1820 derivative records from 53254 primary records. [2025-09-19T22:27:42.355259] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-19T22:27:42.356702] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-19T22:27:42.386366] [DEBUG] [LOCAL ] UBER: Derivative data saved (1820 records). [2025-09-19T22:27:42.390621] [DEBUG] [LOCAL ] UBS: Derivative data saved (1820 records). [2025-09-19T22:27:42.390861] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-19T22:27:42.390799] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-19T22:27:42.400490] [INFO ] [MAIN ] Derivative Progress: 1900/2093 symbols completed. UBS took 1.1s. Estimated remaining: 1m 15s. Rate: 154.9 symbols/min [2025-09-19T22:27:42.407548] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:42.407727] [INFO ] [MAIN ] Derivative Progress: 1901/2093 symbols completed. UBER took 1.2s. Estimated remaining: 1m 14s. Rate: 154.9 symbols/min [2025-09-19T22:27:42.408061] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:42.408459] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:42.409357] [INFO ] [MAIN ] UCB: Generated 1820 derivative records from 38738 primary records. [2025-09-19T22:27:42.409964] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-19T22:27:42.427069] [DEBUG] [LOCAL ] UCB: Derivative data saved (1820 records). [2025-09-19T22:27:42.427183] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-19T22:27:42.429280] [INFO ] [MAIN ] Derivative Progress: 1902/2093 symbols completed. UCB took 1.1s. Estimated remaining: 1m 14s. Rate: 155.0 symbols/min [2025-09-19T22:27:42.429573] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:42.440289] [DEBUG] [LOCAL ] UFI: Loaded 8403 existing records from primary storage. [2025-09-19T22:27:42.440421] [INFO ] [MAIN ] UFI: Loaded 8403 primary data records. [2025-09-19T22:27:42.730675] [DEBUG] [LOCAL ] UE: Loaded 43638 existing records from primary storage. [2025-09-19T22:27:42.745399] [DEBUG] [LOCAL ] UDR: Loaded 52563 existing records from primary storage. [2025-09-19T22:27:42.745532] [INFO ] [MAIN ] UE: Loaded 43638 primary data records. [2025-09-19T22:27:42.837112] [INFO ] [MAIN ] UDR: Loaded 52563 primary data records. [2025-09-19T22:27:43.453815] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:43.454711] [INFO ] [MAIN ] UFI: Generated 1820 derivative records from 8403 primary records. [2025-09-19T22:27:43.454816] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-19T22:27:43.472384] [DEBUG] [LOCAL ] UFI: Derivative data saved (1820 records). [2025-09-19T22:27:43.472609] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-19T22:27:43.474600] [INFO ] [MAIN ] Derivative Progress: 1903/2093 symbols completed. UFI took 1.0s. Estimated remaining: 1m 14s. Rate: 154.9 symbols/min [2025-09-19T22:27:43.494180] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:43.494973] [INFO ] [MAIN ] UDR: Generated 1820 derivative records from 52563 primary records. [2025-09-19T22:27:43.495115] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-19T22:27:43.507989] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:43.508765] [INFO ] [MAIN ] UE: Generated 1820 derivative records from 43638 primary records. [2025-09-19T22:27:43.516024] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-19T22:27:43.536864] [DEBUG] [LOCAL ] UDR: Derivative data saved (1820 records). [2025-09-19T22:27:43.539374] [DEBUG] [LOCAL ] UE: Derivative data saved (1820 records). [2025-09-19T22:27:43.538695] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-19T22:27:43.541531] [INFO ] [MAIN ] Derivative Progress: 1904/2093 symbols completed. UDR took 1.1s. Estimated remaining: 1m 13s. Rate: 154.9 symbols/min [2025-09-19T22:27:43.541761] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-19T22:27:43.543950] [INFO ] [MAIN ] Derivative Progress: 1905/2093 symbols completed. UE took 1.1s. Estimated remaining: 1m 13s. Rate: 155.0 symbols/min [2025-09-19T22:27:43.544433] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:43.544664] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:43.544846] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:43.564556] [DEBUG] [LOCAL ] UHAL: Loaded 16672 existing records from primary storage. [2025-09-19T22:27:43.564740] [INFO ] [MAIN ] UHAL: Loaded 16672 primary data records. [2025-09-19T22:27:43.920421] [DEBUG] [LOCAL ] UGP: Loaded 43183 existing records from primary storage. [2025-09-19T22:27:43.919821] [DEBUG] [LOCAL ] UGI: Loaded 51298 existing records from primary storage. [2025-09-19T22:27:43.921970] [INFO ] [MAIN ] UGP: Loaded 43183 primary data records. [2025-09-19T22:27:43.921628] [INFO ] [MAIN ] UGI: Loaded 51298 primary data records. [2025-09-19T22:27:44.557916] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:44.559045] [INFO ] [MAIN ] UHAL: Generated 1820 derivative records from 16672 primary records. [2025-09-19T22:27:44.559216] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-19T22:27:44.577806] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1820 records). [2025-09-19T22:27:44.579000] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-19T22:27:44.581077] [INFO ] [MAIN ] Derivative Progress: 1906/2093 symbols completed. UHAL took 1.0s. Estimated remaining: 1m 12s. Rate: 154.9 symbols/min [2025-09-19T22:27:44.581501] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:44.615746] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:44.616348] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:44.617723] [INFO ] [MAIN ] UGI: Generated 1820 derivative records from 51298 primary records. [2025-09-19T22:27:44.617108] [INFO ] [MAIN ] UGP: Generated 1820 derivative records from 43183 primary records. [2025-09-19T22:27:44.617934] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-19T22:27:44.618014] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-19T22:27:44.648778] [DEBUG] [LOCAL ] UGI: Derivative data saved (1820 records). [2025-09-19T22:27:44.650335] [DEBUG] [LOCAL ] UGP: Derivative data saved (1820 records). [2025-09-19T22:27:44.650272] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-19T22:27:44.652303] [INFO ] [MAIN ] Derivative Progress: 1907/2093 symbols completed. UGI took 1.1s. Estimated remaining: 1m 12s. Rate: 155.0 symbols/min [2025-09-19T22:27:44.652522] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-19T22:27:44.654764] [INFO ] [MAIN ] Derivative Progress: 1908/2093 symbols completed. UGP took 1.1s. Estimated remaining: 1m 12s. Rate: 155.0 symbols/min [2025-09-19T22:27:44.664585] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:44.655070] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:44.690485] [DEBUG] [LOCAL ] UHT: Loaded 10206 existing records from primary storage. [2025-09-19T22:27:44.696463] [INFO ] [MAIN ] UHT: Loaded 10206 primary data records. [2025-09-19T22:27:44.696830] [DEBUG] [LOCAL ] UI: Loaded 12760 existing records from primary storage. [2025-09-19T22:27:44.709244] [DEBUG] [LOCAL ] UHS: Loaded 42032 existing records from primary storage. [2025-09-19T22:27:44.718990] [INFO ] [MAIN ] UI: Loaded 12760 primary data records. [2025-09-19T22:27:44.730526] [INFO ] [MAIN ] UHS: Loaded 42032 primary data records. [2025-09-19T22:27:45.662802] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:45.663787] [INFO ] [MAIN ] UHT: Generated 1820 derivative records from 10206 primary records. [2025-09-19T22:27:45.664827] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-19T22:27:45.709889] [DEBUG] [LOCAL ] UHT: Derivative data saved (1820 records). [2025-09-19T22:27:45.709797] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:45.710910] [INFO ] [MAIN ] UI: Generated 1820 derivative records from 12760 primary records. [2025-09-19T22:27:45.710209] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-19T22:27:45.711278] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-19T22:27:45.711213] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:45.713852] [INFO ] [MAIN ] Derivative Progress: 1909/2093 symbols completed. UHT took 1.1s. Estimated remaining: 1m 11s. Rate: 154.9 symbols/min [2025-09-19T22:27:45.715086] [INFO ] [MAIN ] UHS: Generated 1820 derivative records from 42032 primary records. [2025-09-19T22:27:45.722375] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-19T22:27:45.722456] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:45.743619] [DEBUG] [LOCAL ] UI: Derivative data saved (1820 records). [2025-09-19T22:27:45.746680] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-19T22:27:45.747258] [DEBUG] [LOCAL ] UHS: Derivative data saved (1820 records). [2025-09-19T22:27:45.749593] [INFO ] [MAIN ] Derivative Progress: 1910/2093 symbols completed. UI took 1.1s. Estimated remaining: 1m 11s. Rate: 155.0 symbols/min [2025-09-19T22:27:45.750093] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:45.749845] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-19T22:27:45.752590] [INFO ] [MAIN ] Derivative Progress: 1911/2093 symbols completed. UHS took 1.2s. Estimated remaining: 1m 10s. Rate: 155.1 symbols/min [2025-09-19T22:27:45.752857] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:45.785636] [DEBUG] [LOCAL ] UIS: Loaded 37722 existing records from primary storage. [2025-09-19T22:27:45.785938] [INFO ] [MAIN ] UIS: Loaded 37722 primary data records. [2025-09-19T22:27:45.951351] [DEBUG] [LOCAL ] ULS: Loaded 39734 existing records from primary storage. [2025-09-19T22:27:45.993595] [INFO ] [MAIN ] ULS: Loaded 39734 primary data records. [2025-09-19T22:27:46.045112] [DEBUG] [LOCAL ] UL: Loaded 53844 existing records from primary storage. [2025-09-19T22:27:46.175277] [INFO ] [MAIN ] UL: Loaded 53844 primary data records. [2025-09-19T22:27:46.816021] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:46.817295] [INFO ] [MAIN ] UIS: Generated 1820 derivative records from 37722 primary records. [2025-09-19T22:27:46.817617] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-19T22:27:46.835835] [DEBUG] [LOCAL ] UIS: Derivative data saved (1820 records). [2025-09-19T22:27:46.837079] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-19T22:27:46.838911] [INFO ] [MAIN ] Derivative Progress: 1912/2093 symbols completed. UIS took 1.1s. Estimated remaining: 1m 10s. Rate: 154.9 symbols/min [2025-09-19T22:27:46.840241] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:46.855018] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:46.855700] [INFO ] [MAIN ] ULS: Generated 1820 derivative records from 39734 primary records. [2025-09-19T22:27:46.855889] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-19T22:27:46.874594] [DEBUG] [LOCAL ] ULS: Derivative data saved (1820 records). [2025-09-19T22:27:46.874965] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-19T22:27:46.877177] [INFO ] [MAIN ] Derivative Progress: 1913/2093 symbols completed. ULS took 1.1s. Estimated remaining: 1m 10s. Rate: 155.0 symbols/min [2025-09-19T22:27:46.890323] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:46.890614] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:46.891469] [INFO ] [MAIN ] UL: Generated 1820 derivative records from 53844 primary records. [2025-09-19T22:27:46.891586] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-19T22:27:46.908613] [DEBUG] [LOCAL ] UL: Derivative data saved (1820 records). [2025-09-19T22:27:46.908754] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-19T22:27:46.910996] [INFO ] [MAIN ] Derivative Progress: 1914/2093 symbols completed. UL took 1.2s. Estimated remaining: 1m 9s. Rate: 155.1 symbols/min [2025-09-19T22:27:46.911409] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:46.955878] [DEBUG] [LOCAL ] UMC: Loaded 53507 existing records from primary storage. [2025-09-19T22:27:46.956146] [INFO ] [MAIN ] UMC: Loaded 53507 primary data records. [2025-09-19T22:27:46.982871] [DEBUG] [LOCAL ] UNF: Loaded 11981 existing records from primary storage. [2025-09-19T22:27:46.999927] [INFO ] [MAIN ] UNF: Loaded 11981 primary data records. [2025-09-19T22:27:47.073549] [DEBUG] [LOCAL ] UMH: Loaded 33497 existing records from primary storage. [2025-09-19T22:27:47.089110] [INFO ] [MAIN ] UMH: Loaded 33497 primary data records. [2025-09-19T22:27:47.916858] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:47.917823] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:47.918532] [INFO ] [MAIN ] UMC: Generated 1820 derivative records from 53507 primary records. [2025-09-19T22:27:47.919221] [INFO ] [MAIN ] UNF: Generated 1820 derivative records from 11981 primary records. [2025-09-19T22:27:47.919363] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-19T22:27:47.919304] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-19T22:27:47.953468] [DEBUG] [LOCAL ] UNF: Derivative data saved (1820 records). [2025-09-19T22:27:47.953676] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-19T22:27:47.955855] [INFO ] [MAIN ] Derivative Progress: 1915/2093 symbols completed. UNF took 1.0s. Estimated remaining: 1m 9s. Rate: 154.9 symbols/min [2025-09-19T22:27:47.952085] [DEBUG] [LOCAL ] UMC: Derivative data saved (1820 records). [2025-09-19T22:27:47.968444] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-19T22:27:47.971027] [INFO ] [MAIN ] Derivative Progress: 1916/2093 symbols completed. UMC took 1.1s. Estimated remaining: 1m 9s. Rate: 155.0 symbols/min [2025-09-19T22:27:47.968397] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:47.971427] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:47.972215] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:47.973179] [INFO ] [MAIN ] UMH: Generated 1820 derivative records from 33497 primary records. [2025-09-19T22:27:47.973346] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-19T22:27:47.990442] [DEBUG] [LOCAL ] UMH: Derivative data saved (1820 records). [2025-09-19T22:27:47.990569] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-19T22:27:47.992869] [INFO ] [MAIN ] Derivative Progress: 1917/2093 symbols completed. UMH took 1.1s. Estimated remaining: 1m 8s. Rate: 155.1 symbols/min [2025-09-19T22:27:47.993214] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:48.042379] [DEBUG] [LOCAL ] UNFI: Loaded 42573 existing records from primary storage. [2025-09-19T22:27:48.052950] [INFO ] [MAIN ] UNFI: Loaded 42573 primary data records. [2025-09-19T22:27:48.188822] [DEBUG] [LOCAL ] UNH: Loaded 54573 existing records from primary storage. [2025-09-19T22:27:48.188152] [DEBUG] [LOCAL ] UNM: Loaded 49543 existing records from primary storage. [2025-09-19T22:27:48.194835] [INFO ] [MAIN ] UNM: Loaded 49543 primary data records. [2025-09-19T22:27:48.205237] [INFO ] [MAIN ] UNH: Loaded 54573 primary data records. [2025-09-19T22:27:49.097037] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:49.098753] [INFO ] [MAIN ] UNFI: Generated 1820 derivative records from 42573 primary records. [2025-09-19T22:27:49.098848] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-19T22:27:49.131052] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:49.130778] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1820 records). [2025-09-19T22:27:49.132094] [INFO ] [MAIN ] UNM: Generated 1820 derivative records from 49543 primary records. [2025-09-19T22:27:49.132186] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-19T22:27:49.131375] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-19T22:27:49.134977] [INFO ] [MAIN ] Derivative Progress: 1918/2093 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 8s. Rate: 154.9 symbols/min [2025-09-19T22:27:49.150740] [DEBUG] [LOCAL ] UNM: Derivative data saved (1820 records). [2025-09-19T22:27:49.151833] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-19T22:27:49.155081] [INFO ] [MAIN ] Derivative Progress: 1919/2093 symbols completed. UNM took 1.2s. Estimated remaining: 1m 7s. Rate: 155.0 symbols/min [2025-09-19T22:27:49.169264] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:49.170202] [INFO ] [MAIN ] UNH: Generated 1820 derivative records from 54573 primary records. [2025-09-19T22:27:49.170275] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-19T22:27:49.186707] [DEBUG] [LOCAL ] UNH: Derivative data saved (1820 records). [2025-09-19T22:27:49.186812] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-19T22:27:49.189164] [INFO ] [MAIN ] Derivative Progress: 1920/2093 symbols completed. UNH took 1.2s. Estimated remaining: 1m 7s. Rate: 155.1 symbols/min [2025-09-19T22:27:49.189937] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:49.189734] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:49.190823] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:49.196528] [DEBUG] [LOCAL ] UNMA: Loaded 3790 existing records from primary storage. [2025-09-19T22:27:49.196827] [INFO ] [MAIN ] UNMA: Loaded 3790 primary data records. [2025-09-19T22:27:49.542926] [DEBUG] [LOCAL ] UP: Loaded 43694 existing records from primary storage. [2025-09-19T22:27:49.543772] [INFO ] [MAIN ] UP: Loaded 43694 primary data records. [2025-09-19T22:27:49.651801] [DEBUG] [LOCAL ] UNP: Loaded 53996 existing records from primary storage. [2025-09-19T22:27:49.684591] [INFO ] [MAIN ] UNP: Loaded 53996 primary data records. [2025-09-19T22:27:50.204164] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:50.205852] [INFO ] [MAIN ] UNMA: Generated 1820 derivative records from 3790 primary records. [2025-09-19T22:27:50.205971] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-19T22:27:50.224098] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1820 records). [2025-09-19T22:27:50.224442] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-19T22:27:50.226793] [INFO ] [MAIN ] Derivative Progress: 1921/2093 symbols completed. UNMA took 1.0s. Estimated remaining: 1m 7s. Rate: 154.9 symbols/min [2025-09-19T22:27:50.227283] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:50.246802] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:50.248075] [INFO ] [MAIN ] UP: Generated 1820 derivative records from 43694 primary records. [2025-09-19T22:27:50.248365] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-19T22:27:50.268753] [DEBUG] [LOCAL ] UP: Derivative data saved (1820 records). [2025-09-19T22:27:50.281564] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-19T22:27:50.282079] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:50.284393] [INFO ] [MAIN ] Derivative Progress: 1922/2093 symbols completed. UP took 1.1s. Estimated remaining: 1m 6s. Rate: 155.0 symbols/min [2025-09-19T22:27:50.285322] [INFO ] [MAIN ] UNP: Generated 1820 derivative records from 53996 primary records. [2025-09-19T22:27:50.285809] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:50.286197] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-19T22:27:50.303410] [DEBUG] [LOCAL ] UNP: Derivative data saved (1820 records). [2025-09-19T22:27:50.303591] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-19T22:27:50.305911] [INFO ] [MAIN ] Derivative Progress: 1923/2093 symbols completed. UNP took 1.1s. Estimated remaining: 1m 6s. Rate: 155.1 symbols/min [2025-09-19T22:27:50.306248] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:50.346094] [DEBUG] [LOCAL ] UPS: Loaded 54490 existing records from primary storage. [2025-09-19T22:27:50.346441] [INFO ] [MAIN ] UPS: Loaded 54490 primary data records. [2025-09-19T22:27:50.495086] [DEBUG] [LOCAL ] URI: Loaded 37373 existing records from primary storage. [2025-09-19T22:27:50.535550] [INFO ] [MAIN ] URI: Loaded 37373 primary data records. [2025-09-19T22:27:50.521716] [DEBUG] [LOCAL ] USA: Loaded 36841 existing records from primary storage. [2025-09-19T22:27:50.588001] [INFO ] [MAIN ] USA: Loaded 36841 primary data records. [2025-09-19T22:27:51.365701] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:51.367314] [INFO ] [MAIN ] UPS: Generated 1820 derivative records from 54490 primary records. [2025-09-19T22:27:51.368128] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-19T22:27:51.385676] [DEBUG] [LOCAL ] UPS: Derivative data saved (1820 records). [2025-09-19T22:27:51.385890] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-19T22:27:51.387807] [INFO ] [MAIN ] Derivative Progress: 1924/2093 symbols completed. UPS took 1.2s. Estimated remaining: 1m 5s. Rate: 154.9 symbols/min [2025-09-19T22:27:51.388449] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:51.406742] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:51.408955] [INFO ] [MAIN ] URI: Generated 1820 derivative records from 37373 primary records. [2025-09-19T22:27:51.409133] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-19T22:27:51.443677] [DEBUG] [LOCAL ] URI: Derivative data saved (1820 records). [2025-09-19T22:27:51.443846] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-19T22:27:51.444085] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:51.444869] [INFO ] [MAIN ] USA: Generated 1820 derivative records from 36841 primary records. [2025-09-19T22:27:51.447746] [INFO ] [MAIN ] Derivative Progress: 1925/2093 symbols completed. URI took 1.2s. Estimated remaining: 1m 5s. Rate: 155.0 symbols/min [2025-09-19T22:27:51.447967] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-19T22:27:51.448273] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:51.466515] [DEBUG] [LOCAL ] USAC: Loaded 23461 existing records from primary storage. [2025-09-19T22:27:51.469483] [INFO ] [MAIN ] USAC: Loaded 23461 primary data records. [2025-09-19T22:27:51.507627] [DEBUG] [LOCAL ] USA: Derivative data saved (1820 records). [2025-09-19T22:27:51.542407] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-19T22:27:51.550414] [INFO ] [MAIN ] Derivative Progress: 1926/2093 symbols completed. USA took 1.2s. Estimated remaining: 1m 5s. Rate: 155.1 symbols/min [2025-09-19T22:27:51.567624] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:51.829958] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-09-19T22:27:51.830518] [INFO ] [MAIN ] USB: Loaded 54468 primary data records. [2025-09-19T22:27:51.974020] [DEBUG] [LOCAL ] USFD: Loaded 52005 existing records from primary storage. [2025-09-19T22:27:51.984862] [INFO ] [MAIN ] USFD: Loaded 52005 primary data records. [2025-09-19T22:27:52.496548] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:52.498297] [INFO ] [MAIN ] USAC: Generated 1820 derivative records from 23461 primary records. [2025-09-19T22:27:52.498608] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-19T22:27:52.518141] [DEBUG] [LOCAL ] USAC: Derivative data saved (1820 records). [2025-09-19T22:27:52.519093] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-19T22:27:52.521365] [INFO ] [MAIN ] Derivative Progress: 1927/2093 symbols completed. USAC took 1.1s. Estimated remaining: 1m 4s. Rate: 154.9 symbols/min [2025-09-19T22:27:52.521683] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:52.548306] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:52.549188] [INFO ] [MAIN ] USB: Generated 1820 derivative records from 54468 primary records. [2025-09-19T22:27:52.549412] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-19T22:27:52.558598] [DEBUG] [LOCAL ] USNA: Loaded 18648 existing records from primary storage. [2025-09-19T22:27:52.575305] [DEBUG] [LOCAL ] USB: Derivative data saved (1820 records). [2025-09-19T22:27:52.575615] [INFO ] [MAIN ] USNA: Loaded 18648 primary data records. [2025-09-19T22:27:52.575843] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-19T22:27:52.583835] [INFO ] [MAIN ] Derivative Progress: 1928/2093 symbols completed. USB took 1.1s. Estimated remaining: 1m 4s. Rate: 155.0 symbols/min [2025-09-19T22:27:52.584238] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:52.675502] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:52.687429] [INFO ] [MAIN ] USFD: Generated 1820 derivative records from 52005 primary records. [2025-09-19T22:27:52.702021] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-19T22:27:52.966179] [DEBUG] [LOCAL ] USFD: Derivative data saved (1820 records). [2025-09-19T22:27:52.975488] [DEBUG] [LOCAL ] USPH: Loaded 16866 existing records from primary storage. [2025-09-19T22:27:52.975840] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-19T22:27:52.978636] [INFO ] [MAIN ] USPH: Loaded 16866 primary data records. [2025-09-19T22:27:52.978483] [INFO ] [MAIN ] Derivative Progress: 1929/2093 symbols completed. USFD took 1.4s. Estimated remaining: 1m 3s. Rate: 155.0 symbols/min [2025-09-19T22:27:52.990595] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:53.309307] [DEBUG] [LOCAL ] UTF: Loaded 28882 existing records from primary storage. [2025-09-19T22:27:53.309789] [INFO ] [MAIN ] UTF: Loaded 28882 primary data records. [2025-09-19T22:27:53.550449] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:53.551859] [INFO ] [MAIN ] USNA: Generated 1820 derivative records from 18648 primary records. [2025-09-19T22:27:53.700561] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-19T22:27:53.732485] [DEBUG] [LOCAL ] USNA: Derivative data saved (1820 records). [2025-09-19T22:27:53.739636] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-19T22:27:53.740697] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:53.744131] [INFO ] [MAIN ] Derivative Progress: 1930/2093 symbols completed. USNA took 1.2s. Estimated remaining: 1m 3s. Rate: 154.9 symbols/min [2025-09-19T22:27:53.741854] [INFO ] [MAIN ] USPH: Generated 1820 derivative records from 16866 primary records. [2025-09-19T22:27:53.745402] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:53.745484] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-19T22:27:53.764064] [DEBUG] [LOCAL ] USPH: Derivative data saved (1820 records). [2025-09-19T22:27:53.764332] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-19T22:27:53.766731] [INFO ] [MAIN ] Derivative Progress: 1931/2093 symbols completed. USPH took 1.2s. Estimated remaining: 1m 3s. Rate: 155.0 symbols/min [2025-09-19T22:27:53.767786] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:53.814256] [DEBUG] [LOCAL ] UTL: Loaded 11073 existing records from primary storage. [2025-09-19T22:27:53.815111] [INFO ] [MAIN ] UTL: Loaded 11073 primary data records. [2025-09-19T22:27:53.815013] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:53.867076] [INFO ] [MAIN ] UTF: Generated 1820 derivative records from 28882 primary records. [2025-09-19T22:27:53.897507] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-19T22:27:53.976407] [DEBUG] [LOCAL ] UTI: Loaded 41259 existing records from primary storage. [2025-09-19T22:27:53.975578] [DEBUG] [LOCAL ] UTF: Derivative data saved (1820 records). [2025-09-19T22:27:54.004383] [INFO ] [MAIN ] UTI: Loaded 41259 primary data records. [2025-09-19T22:27:53.995629] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-19T22:27:54.032278] [INFO ] [MAIN ] Derivative Progress: 1932/2093 symbols completed. UTF took 1.0s. Estimated remaining: 1m 2s. Rate: 155.0 symbols/min [2025-09-19T22:27:54.038256] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:54.523838] [DEBUG] [LOCAL ] UTZ: Loaded 45430 existing records from primary storage. [2025-09-19T22:27:54.525060] [INFO ] [MAIN ] UTZ: Loaded 45430 primary data records. [2025-09-19T22:27:54.525375] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:54.558979] [INFO ] [MAIN ] UTL: Generated 1820 derivative records from 11073 primary records. [2025-09-19T22:27:54.577762] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-19T22:27:54.648299] [DEBUG] [LOCAL ] UTL: Derivative data saved (1820 records). [2025-09-19T22:27:54.652111] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-19T22:27:54.654567] [INFO ] [MAIN ] Derivative Progress: 1933/2093 symbols completed. UTL took 0.9s. Estimated remaining: 1m 2s. Rate: 155.0 symbols/min [2025-09-19T22:27:54.830016] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:54.893998] [INFO ] [MAIN ] UTI: Generated 1820 derivative records from 41259 primary records. [2025-09-19T22:27:54.902572] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-19T22:27:54.920471] [DEBUG] [LOCAL ] UTI: Derivative data saved (1820 records). [2025-09-19T22:27:54.920705] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-19T22:27:54.923354] [INFO ] [MAIN ] Derivative Progress: 1934/2093 symbols completed. UTI took 1.2s. Estimated remaining: 1m 2s. Rate: 155.0 symbols/min [2025-09-19T22:27:54.943055] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:54.943604] [INFO ] [MAIN ] UTZ: Generated 1820 derivative records from 45430 primary records. [2025-09-19T22:27:54.943686] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-19T22:27:54.958995] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1820 records). [2025-09-19T22:27:54.959052] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-19T22:27:54.961104] [INFO ] [MAIN ] Derivative Progress: 1935/2093 symbols completed. UTZ took 0.9s. Estimated remaining: 1m 1s. Rate: 155.1 symbols/min [2025-09-19T22:27:54.961794] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:54.961947] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:54.962845] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:54.996400] [DEBUG] [LOCAL ] UVV: Loaded 22592 existing records from primary storage. [2025-09-19T22:27:54.996048] [DEBUG] [LOCAL ] UVE: Loaded 22135 existing records from primary storage. [2025-09-19T22:27:54.996630] [INFO ] [MAIN ] UVV: Loaded 22592 primary data records. [2025-09-19T22:27:55.008073] [INFO ] [MAIN ] UVE: Loaded 22135 primary data records. [2025-09-19T22:27:55.505503] [DEBUG] [LOCAL ] UWMC: Loaded 53493 existing records from primary storage. [2025-09-19T22:27:55.585734] [INFO ] [MAIN ] UWMC: Loaded 53493 primary data records. [2025-09-19T22:27:55.977013] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:55.978292] [INFO ] [MAIN ] UVV: Generated 1820 derivative records from 22592 primary records. [2025-09-19T22:27:55.978441] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-19T22:27:55.993373] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:56.001190] [INFO ] [MAIN ] UVE: Generated 1820 derivative records from 22135 primary records. [2025-09-19T22:27:56.001386] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-19T22:27:56.022224] [DEBUG] [LOCAL ] UVV: Derivative data saved (1820 records). [2025-09-19T22:27:56.025283] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-19T22:27:56.029933] [INFO ] [MAIN ] Derivative Progress: 1936/2093 symbols completed. UVV took 1.1s. Estimated remaining: 1m 1s. Rate: 154.9 symbols/min [2025-09-19T22:27:56.030848] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:56.030477] [DEBUG] [LOCAL ] UVE: Derivative data saved (1820 records). [2025-09-19T22:27:56.031213] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-19T22:27:56.033525] [INFO ] [MAIN ] Derivative Progress: 1937/2093 symbols completed. UVE took 1.1s. Estimated remaining: 1m 0s. Rate: 155.0 symbols/min [2025-09-19T22:27:56.034346] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:56.061598] [DEBUG] [LOCAL ] UZE: Loaded 7573 existing records from primary storage. [2025-09-19T22:27:56.062094] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:56.062181] [INFO ] [MAIN ] UZE: Loaded 7573 primary data records. [2025-09-19T22:27:56.099982] [INFO ] [MAIN ] UWMC: Generated 1820 derivative records from 53493 primary records. [2025-09-19T22:27:56.078048] [DEBUG] [LOCAL ] UZD: Loaded 6411 existing records from primary storage. [2025-09-19T22:27:56.118345] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-19T22:27:56.134818] [INFO ] [MAIN ] UZD: Loaded 6411 primary data records. [2025-09-19T22:27:56.291476] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1820 records). [2025-09-19T22:27:56.307361] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-19T22:27:56.388510] [INFO ] [MAIN ] Derivative Progress: 1938/2093 symbols completed. UWMC took 1.4s. Estimated remaining: 60.0s. Rate: 155.0 symbols/min [2025-09-19T22:27:56.530054] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:56.799348] [DEBUG] [LOCAL ] UZF: Loaded 6540 existing records from primary storage. [2025-09-19T22:27:56.800346] [INFO ] [MAIN ] UZF: Loaded 6540 primary data records. [2025-09-19T22:27:57.156296] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:57.157391] [INFO ] [MAIN ] UZE: Generated 1820 derivative records from 7573 primary records. [2025-09-19T22:27:57.158148] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-19T22:27:57.179344] [DEBUG] [LOCAL ] UZE: Derivative data saved (1820 records). [2025-09-19T22:27:57.179634] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-19T22:27:57.182202] [INFO ] [MAIN ] Derivative Progress: 1939/2093 symbols completed. UZE took 1.1s. Estimated remaining: 59.6s. Rate: 154.9 symbols/min [2025-09-19T22:27:57.196160] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:57.196912] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:27:57.198329] [INFO ] [MAIN ] UZD: Generated 1819 derivative records from 6411 primary records. [2025-09-19T22:27:57.198539] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-19T22:27:57.217600] [DEBUG] [LOCAL ] UZD: Derivative data saved (1819 records). [2025-09-19T22:27:57.218181] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-19T22:27:57.220515] [INFO ] [MAIN ] Derivative Progress: 1940/2093 symbols completed. UZD took 1.2s. Estimated remaining: 59.2s. Rate: 155.0 symbols/min [2025-09-19T22:27:57.220911] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:57.250936] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:57.252089] [INFO ] [MAIN ] UZF: Generated 1820 derivative records from 6540 primary records. [2025-09-19T22:27:57.252254] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-19T22:27:57.296934] [DEBUG] [LOCAL ] UZF: Derivative data saved (1820 records). [2025-09-19T22:27:57.297246] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-19T22:27:57.300026] [INFO ] [MAIN ] Derivative Progress: 1941/2093 symbols completed. UZF took 0.9s. Estimated remaining: 58.8s. Rate: 155.1 symbols/min [2025-09-19T22:27:57.300516] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:57.315637] [DEBUG] [LOCAL ] VAC: Loaded 35334 existing records from primary storage. [2025-09-19T22:27:57.316232] [INFO ] [MAIN ] VAC: Loaded 35334 primary data records. [2025-09-19T22:27:57.390044] [DEBUG] [LOCAL ] V: Loaded 54543 existing records from primary storage. [2025-09-19T22:27:57.416905] [INFO ] [MAIN ] V: Loaded 54543 primary data records. [2025-09-19T22:27:57.846240] [DEBUG] [LOCAL ] VAL: Loaded 51276 existing records from primary storage. [2025-09-19T22:27:57.866962] [INFO ] [MAIN ] VAL: Loaded 51276 primary data records. [2025-09-19T22:27:58.371190] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:58.380990] [INFO ] [MAIN ] VAC: Generated 1820 derivative records from 35334 primary records. [2025-09-19T22:27:58.381925] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-19T22:27:58.388021] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:58.389106] [INFO ] [MAIN ] V: Generated 1820 derivative records from 54543 primary records. [2025-09-19T22:27:58.389624] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-19T22:27:58.419785] [DEBUG] [LOCAL ] VAC: Derivative data saved (1820 records). [2025-09-19T22:27:58.420546] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-19T22:27:58.423797] [INFO ] [MAIN ] Derivative Progress: 1942/2093 symbols completed. VAC took 1.2s. Estimated remaining: 58.5s. Rate: 154.9 symbols/min [2025-09-19T22:27:58.424842] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:58.431814] [DEBUG] [LOCAL ] V: Derivative data saved (1820 records). [2025-09-19T22:27:58.432081] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-19T22:27:58.442049] [INFO ] [MAIN ] Derivative Progress: 1943/2093 symbols completed. V took 1.3s. Estimated remaining: 58.1s. Rate: 155.0 symbols/min [2025-09-19T22:27:58.447622] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:58.447894] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:58.448842] [INFO ] [MAIN ] VAL: Generated 1820 derivative records from 51276 primary records. [2025-09-19T22:27:58.449498] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-19T22:27:58.467712] [DEBUG] [LOCAL ] VAL: Derivative data saved (1820 records). [2025-09-19T22:27:58.469385] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-19T22:27:58.472061] [INFO ] [MAIN ] Derivative Progress: 1944/2093 symbols completed. VAL took 1.2s. Estimated remaining: 57.7s. Rate: 155.1 symbols/min [2025-09-19T22:27:58.472416] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:58.477611] [DEBUG] [LOCAL ] VATE: Loaded 5992 existing records from primary storage. [2025-09-19T22:27:58.477784] [INFO ] [MAIN ] VATE: Loaded 5992 primary data records. [2025-09-19T22:27:58.601573] [DEBUG] [LOCAL ] VBF: Loaded 7212 existing records from primary storage. [2025-09-19T22:27:58.628457] [INFO ] [MAIN ] VBF: Loaded 7212 primary data records. [2025-09-19T22:27:58.766682] [DEBUG] [LOCAL ] VALE: Loaded 54474 existing records from primary storage. [2025-09-19T22:27:58.935340] [INFO ] [MAIN ] VALE: Loaded 54474 primary data records. [2025-09-19T22:27:59.498009] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:59.500512] [INFO ] [MAIN ] VATE: Generated 1820 derivative records from 5992 primary records. [2025-09-19T22:27:59.500732] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-19T22:27:59.525189] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:59.529077] [INFO ] [MAIN ] VBF: Generated 1820 derivative records from 7212 primary records. [2025-09-19T22:27:59.529231] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-19T22:27:59.550999] [DEBUG] [LOCAL ] VBF: Derivative data saved (1820 records). [2025-09-19T22:27:59.551508] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-19T22:27:59.561954] [INFO ] [MAIN ] Derivative Progress: 1945/2093 symbols completed. VBF took 1.1s. Estimated remaining: 57.3s. Rate: 154.9 symbols/min [2025-09-19T22:27:59.570839] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:59.573272] [DEBUG] [LOCAL ] VATE: Derivative data saved (1820 records). [2025-09-19T22:27:59.574076] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:27:59.573705] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-19T22:27:59.575096] [INFO ] [MAIN ] VALE: Generated 1820 derivative records from 54474 primary records. [2025-09-19T22:27:59.575275] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-19T22:27:59.577861] [INFO ] [MAIN ] Derivative Progress: 1946/2093 symbols completed. VATE took 1.1s. Estimated remaining: 56.9s. Rate: 155.0 symbols/min [2025-09-19T22:27:59.578394] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:59.606756] [DEBUG] [LOCAL ] VALE: Derivative data saved (1820 records). [2025-09-19T22:27:59.607053] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-19T22:27:59.609636] [INFO ] [MAIN ] Derivative Progress: 1947/2093 symbols completed. VALE took 1.2s. Estimated remaining: 56.5s. Rate: 155.1 symbols/min [2025-09-19T22:27:59.610199] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:27:59.617638] [DEBUG] [LOCAL ] VCV: Loaded 13645 existing records from primary storage. [2025-09-19T22:27:59.617841] [INFO ] [MAIN ] VCV: Loaded 13645 primary data records. [2025-09-19T22:27:59.738206] [DEBUG] [LOCAL ] VEL: Loaded 13150 existing records from primary storage. [2025-09-19T22:27:59.760612] [INFO ] [MAIN ] VEL: Loaded 13150 primary data records. [2025-09-19T22:28:00.081797] [DEBUG] [LOCAL ] VEEV: Loaded 48195 existing records from primary storage. [2025-09-19T22:28:00.082050] [INFO ] [MAIN ] VEEV: Loaded 48195 primary data records. [2025-09-19T22:28:00.673574] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:00.674936] [INFO ] [MAIN ] VCV: Generated 1820 derivative records from 13645 primary records. [2025-09-19T22:28:00.675198] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-19T22:28:00.694929] [DEBUG] [LOCAL ] VCV: Derivative data saved (1820 records). [2025-09-19T22:28:00.696415] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-19T22:28:00.699008] [INFO ] [MAIN ] Derivative Progress: 1948/2093 symbols completed. VCV took 1.1s. Estimated remaining: 56.2s. Rate: 154.9 symbols/min [2025-09-19T22:28:00.713769] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:28:00.715992] [INFO ] [MAIN ] VEL: Generated 1819 derivative records from 13150 primary records. [2025-09-19T22:28:00.717845] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-19T22:28:00.740952] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:00.745205] [INFO ] [MAIN ] VEEV: Generated 1820 derivative records from 48195 primary records. [2025-09-19T22:28:00.745291] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-19T22:28:00.749335] [DEBUG] [LOCAL ] VEL: Derivative data saved (1819 records). [2025-09-19T22:28:00.749778] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-19T22:28:00.752078] [INFO ] [MAIN ] Derivative Progress: 1949/2093 symbols completed. VEL took 1.1s. Estimated remaining: 55.7s. Rate: 155.0 symbols/min [2025-09-19T22:28:00.768165] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1820 records). [2025-09-19T22:28:00.768272] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-19T22:28:00.771417] [INFO ] [MAIN ] Derivative Progress: 1950/2093 symbols completed. VEEV took 1.2s. Estimated remaining: 55.3s. Rate: 155.1 symbols/min [2025-09-19T22:28:00.771963] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:00.772180] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:00.772547] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:00.781498] [DEBUG] [LOCAL ] VGI: Loaded 5317 existing records from primary storage. [2025-09-19T22:28:00.781686] [INFO ] [MAIN ] VGI: Loaded 5317 primary data records. [2025-09-19T22:28:01.183939] [DEBUG] [LOCAL ] VET: Loaded 44937 existing records from primary storage. [2025-09-19T22:28:01.184161] [INFO ] [MAIN ] VET: Loaded 44937 primary data records. [2025-09-19T22:28:01.309884] [DEBUG] [LOCAL ] VFC: Loaded 54389 existing records from primary storage. [2025-09-19T22:28:01.314547] [INFO ] [MAIN ] VFC: Loaded 54389 primary data records. [2025-09-19T22:28:01.866809] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:01.868105] [INFO ] [MAIN ] VGI: Generated 1820 derivative records from 5317 primary records. [2025-09-19T22:28:01.868634] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-19T22:28:01.884105] [DEBUG] [LOCAL ] VGI: Derivative data saved (1820 records). [2025-09-19T22:28:01.884273] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-19T22:28:01.890278] [INFO ] [MAIN ] Derivative Progress: 1951/2093 symbols completed. VGI took 1.1s. Estimated remaining: 55.0s. Rate: 154.9 symbols/min [2025-09-19T22:28:01.891299] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:01.905637] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:01.906763] [INFO ] [MAIN ] VET: Generated 1820 derivative records from 44937 primary records. [2025-09-19T22:28:01.906970] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-19T22:28:01.928821] [DEBUG] [LOCAL ] VET: Derivative data saved (1820 records). [2025-09-19T22:28:01.929036] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-19T22:28:01.931974] [INFO ] [MAIN ] Derivative Progress: 1952/2093 symbols completed. VET took 1.2s. Estimated remaining: 54.6s. Rate: 155.0 symbols/min [2025-09-19T22:28:01.934265] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:01.955547] [DEBUG] [LOCAL ] VGM: Loaded 18478 existing records from primary storage. [2025-09-19T22:28:01.956817] [INFO ] [MAIN ] VGM: Loaded 18478 primary data records. [2025-09-19T22:28:01.954897] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:01.957886] [INFO ] [MAIN ] VFC: Generated 1820 derivative records from 54389 primary records. [2025-09-19T22:28:01.969982] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-19T22:28:01.993290] [DEBUG] [LOCAL ] VHI: Loaded 3016 existing records from primary storage. [2025-09-19T22:28:02.006011] [INFO ] [MAIN ] VHI: Loaded 3016 primary data records. [2025-09-19T22:28:02.088579] [DEBUG] [LOCAL ] VFC: Derivative data saved (1820 records). [2025-09-19T22:28:02.118788] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-19T22:28:02.161716] [INFO ] [MAIN ] Derivative Progress: 1953/2093 symbols completed. VFC took 1.4s. Estimated remaining: 54.2s. Rate: 155.0 symbols/min [2025-09-19T22:28:02.204164] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:02.684769] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:02.685609] [INFO ] [MAIN ] VGM: Generated 1820 derivative records from 18478 primary records. [2025-09-19T22:28:02.686126] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-19T22:28:02.703454] [DEBUG] [LOCAL ] VGM: Derivative data saved (1820 records). [2025-09-19T22:28:02.703880] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-19T22:28:02.706197] [INFO ] [MAIN ] Derivative Progress: 1954/2093 symbols completed. VGM took 0.8s. Estimated remaining: 53.8s. Rate: 155.0 symbols/min [2025-09-19T22:28:02.706702] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:02.743137] [DEBUG] [LOCAL ] VICI: Loaded 54428 existing records from primary storage. [2025-09-19T22:28:02.743592] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:28:02.744675] [INFO ] [MAIN ] VICI: Loaded 54428 primary data records. [2025-09-19T22:28:02.745009] [INFO ] [MAIN ] VHI: Generated 1819 derivative records from 3016 primary records. [2025-09-19T22:28:02.766238] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-19T22:28:02.884044] [DEBUG] [LOCAL ] VHI: Derivative data saved (1819 records). [2025-09-19T22:28:02.936521] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-19T22:28:03.048405] [INFO ] [MAIN ] Derivative Progress: 1955/2093 symbols completed. VHI took 1.1s. Estimated remaining: 53.4s. Rate: 155.0 symbols/min [2025-09-19T22:28:03.111854] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:03.133571] [DEBUG] [LOCAL ] VIK: Loaded 53290 existing records from primary storage. [2025-09-19T22:28:03.134439] [INFO ] [MAIN ] VIK: Loaded 53290 primary data records. [2025-09-19T22:28:03.487293] [DEBUG] [LOCAL ] VIPS: Loaded 52155 existing records from primary storage. [2025-09-19T22:28:03.488809] [INFO ] [MAIN ] VIPS: Loaded 52155 primary data records. [2025-09-19T22:28:03.615174] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:03.622544] [INFO ] [MAIN ] VICI: Generated 1820 derivative records from 54428 primary records. [2025-09-19T22:28:03.638299] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-19T22:28:03.717497] [DEBUG] [LOCAL ] VICI: Derivative data saved (1820 records). [2025-09-19T22:28:03.717698] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-19T22:28:03.720132] [INFO ] [MAIN ] Derivative Progress: 1956/2093 symbols completed. VICI took 1.5s. Estimated remaining: 53.1s. Rate: 154.9 symbols/min [2025-09-19T22:28:03.845720] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:03.860903] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:03.861701] [INFO ] [MAIN ] VIK: Generated 1820 derivative records from 53290 primary records. [2025-09-19T22:28:03.861803] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-19T22:28:03.880384] [DEBUG] [LOCAL ] VIK: Derivative data saved (1820 records). [2025-09-19T22:28:03.880478] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-19T22:28:03.882580] [INFO ] [MAIN ] Derivative Progress: 1957/2093 symbols completed. VIK took 1.2s. Estimated remaining: 52.7s. Rate: 155.0 symbols/min [2025-09-19T22:28:03.882938] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:03.909559] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:03.910567] [INFO ] [MAIN ] VIPS: Generated 1820 derivative records from 52155 primary records. [2025-09-19T22:28:03.910751] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-19T22:28:03.948700] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1820 records). [2025-09-19T22:28:03.949020] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-19T22:28:03.951598] [INFO ] [MAIN ] Derivative Progress: 1958/2093 symbols completed. VIPS took 0.8s. Estimated remaining: 52.2s. Rate: 155.0 symbols/min [2025-09-19T22:28:03.952125] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:03.968355] [DEBUG] [LOCAL ] VIST: Loaded 46710 existing records from primary storage. [2025-09-19T22:28:03.980424] [INFO ] [MAIN ] VIST: Loaded 46710 primary data records. [2025-09-19T22:28:04.026416] [DEBUG] [LOCAL ] VIRT: Loaded 47718 existing records from primary storage. [2025-09-19T22:28:04.053489] [INFO ] [MAIN ] VIRT: Loaded 47718 primary data records. [2025-09-19T22:28:04.653950] [DEBUG] [LOCAL ] VIV: Loaded 46060 existing records from primary storage. [2025-09-19T22:28:04.663906] [INFO ] [MAIN ] VIV: Loaded 46060 primary data records. [2025-09-19T22:28:05.047368] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:05.049059] [INFO ] [MAIN ] VIST: Generated 1820 derivative records from 46710 primary records. [2025-09-19T22:28:05.049161] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-19T22:28:05.069013] [DEBUG] [LOCAL ] VIST: Derivative data saved (1820 records). [2025-09-19T22:28:05.069310] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-19T22:28:05.071707] [INFO ] [MAIN ] Derivative Progress: 1959/2093 symbols completed. VIST took 1.2s. Estimated remaining: 51.9s. Rate: 154.9 symbols/min [2025-09-19T22:28:05.073348] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:05.087884] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:05.089120] [INFO ] [MAIN ] VIRT: Generated 1820 derivative records from 47718 primary records. [2025-09-19T22:28:05.089331] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-19T22:28:05.111209] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1820 records). [2025-09-19T22:28:05.111358] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-19T22:28:05.113414] [INFO ] [MAIN ] Derivative Progress: 1960/2093 symbols completed. VIRT took 1.3s. Estimated remaining: 51.5s. Rate: 155.0 symbols/min [2025-09-19T22:28:05.113973] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:05.125795] [DEBUG] [LOCAL ] VKQ: Loaded 17758 existing records from primary storage. [2025-09-19T22:28:05.138689] [INFO ] [MAIN ] VKQ: Loaded 17758 primary data records. [2025-09-19T22:28:05.150894] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:05.189685] [INFO ] [MAIN ] VIV: Generated 1820 derivative records from 46060 primary records. [2025-09-19T22:28:05.231513] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-19T22:28:05.264545] [DEBUG] [LOCAL ] VLN: Loaded 28581 existing records from primary storage. [2025-09-19T22:28:05.272921] [INFO ] [MAIN ] VLN: Loaded 28581 primary data records. [2025-09-19T22:28:05.318303] [DEBUG] [LOCAL ] VIV: Derivative data saved (1820 records). [2025-09-19T22:28:05.371365] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-19T22:28:05.414906] [INFO ] [MAIN ] Derivative Progress: 1961/2093 symbols completed. VIV took 1.5s. Estimated remaining: 51.1s. Rate: 155.0 symbols/min [2025-09-19T22:28:05.588864] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:05.850226] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:05.851254] [INFO ] [MAIN ] VKQ: Generated 1820 derivative records from 17758 primary records. [2025-09-19T22:28:05.851354] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-19T22:28:05.873058] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1820 records). [2025-09-19T22:28:05.887063] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-19T22:28:05.889484] [INFO ] [MAIN ] Derivative Progress: 1962/2093 symbols completed. VKQ took 0.8s. Estimated remaining: 50.7s. Rate: 155.0 symbols/min [2025-09-19T22:28:05.890025] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:05.903663] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:05.905590] [INFO ] [MAIN ] VLN: Generated 1820 derivative records from 28581 primary records. [2025-09-19T22:28:05.906047] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-19T22:28:05.907505] [DEBUG] [LOCAL ] VLO: Loaded 53871 existing records from primary storage. [2025-09-19T22:28:05.907969] [INFO ] [MAIN ] VLO: Loaded 53871 primary data records. [2025-09-19T22:28:06.005002] [DEBUG] [LOCAL ] VLN: Derivative data saved (1820 records). [2025-09-19T22:28:06.026841] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-19T22:28:06.029071] [INFO ] [MAIN ] Derivative Progress: 1963/2093 symbols completed. VLN took 0.9s. Estimated remaining: 50.3s. Rate: 155.0 symbols/min [2025-09-19T22:28:06.250628] [DEBUG] [LOCAL ] VLRS: Loaded 41690 existing records from primary storage. [2025-09-19T22:28:06.250945] [INFO ] [MAIN ] VLRS: Loaded 41690 primary data records. [2025-09-19T22:28:06.581332] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:06.582494] [INFO ] [MAIN ] VLO: Generated 1820 derivative records from 53871 primary records. [2025-09-19T22:28:06.582720] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-19T22:28:06.600111] [DEBUG] [LOCAL ] VLO: Derivative data saved (1820 records). [2025-09-19T22:28:06.600436] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-19T22:28:06.602794] [INFO ] [MAIN ] Derivative Progress: 1964/2093 symbols completed. VLO took 1.0s. Estimated remaining: 49.9s. Rate: 155.0 symbols/min [2025-09-19T22:28:06.619852] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:06.620441] [INFO ] [MAIN ] VLRS: Generated 1820 derivative records from 41690 primary records. [2025-09-19T22:28:06.620500] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-19T22:28:06.636208] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1820 records). [2025-09-19T22:28:06.636269] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-19T22:28:06.638280] [INFO ] [MAIN ] Derivative Progress: 1965/2093 symbols completed. VLRS took 0.7s. Estimated remaining: 49.5s. Rate: 155.1 symbols/min [2025-09-19T22:28:06.638850] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:06.639081] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:06.639869] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:06.647035] [DEBUG] [LOCAL ] VLT: Loaded 4756 existing records from primary storage. [2025-09-19T22:28:06.647185] [INFO ] [MAIN ] VLT: Loaded 4756 primary data records. [2025-09-19T22:28:07.017055] [DEBUG] [LOCAL ] VMC: Loaded 44671 existing records from primary storage. [2025-09-19T22:28:07.018714] [DEBUG] [LOCAL ] VLTO: Loaded 46744 existing records from primary storage. [2025-09-19T22:28:07.019006] [INFO ] [MAIN ] VMC: Loaded 44671 primary data records. [2025-09-19T22:28:07.019234] [INFO ] [MAIN ] VLTO: Loaded 46744 primary data records. [2025-09-19T22:28:07.715622] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:07.717419] [INFO ] [MAIN ] VLT: Generated 1820 derivative records from 4756 primary records. [2025-09-19T22:28:07.717809] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-19T22:28:07.735996] [DEBUG] [LOCAL ] VLT: Derivative data saved (1820 records). [2025-09-19T22:28:07.736804] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-19T22:28:07.739127] [INFO ] [MAIN ] Derivative Progress: 1966/2093 symbols completed. VLT took 1.1s. Estimated remaining: 49.2s. Rate: 154.9 symbols/min [2025-09-19T22:28:07.741078] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:07.770931] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:07.779230] [INFO ] [MAIN ] VMC: Generated 1820 derivative records from 44671 primary records. [2025-09-19T22:28:07.779474] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-19T22:28:07.779808] [DEBUG] [LOCAL ] VMI: Loaded 15739 existing records from primary storage. [2025-09-19T22:28:07.780767] [INFO ] [MAIN ] VMI: Loaded 15739 primary data records. [2025-09-19T22:28:07.805216] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:07.809822] [INFO ] [MAIN ] VLTO: Generated 1820 derivative records from 46744 primary records. [2025-09-19T22:28:07.812011] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-19T22:28:07.929711] [DEBUG] [LOCAL ] VMC: Derivative data saved (1820 records). [2025-09-19T22:28:07.937990] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1820 records). [2025-09-19T22:28:07.942510] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-19T22:28:07.942613] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-19T22:28:07.945189] [INFO ] [MAIN ] Derivative Progress: 1967/2093 symbols completed. VMC took 1.3s. Estimated remaining: 48.8s. Rate: 154.9 symbols/min [2025-09-19T22:28:07.958607] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:07.963836] [INFO ] [MAIN ] Derivative Progress: 1968/2093 symbols completed. VLTO took 1.3s. Estimated remaining: 48.4s. Rate: 155.0 symbols/min [2025-09-19T22:28:07.964293] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:08.162072] [DEBUG] [LOCAL ] VNCE: Loaded 6697 existing records from primary storage. [2025-09-19T22:28:08.162254] [INFO ] [MAIN ] VNCE: Loaded 6697 primary data records. [2025-09-19T22:28:08.284627] [DEBUG] [LOCAL ] VMO: Loaded 21300 existing records from primary storage. [2025-09-19T22:28:08.285227] [INFO ] [MAIN ] VMO: Loaded 21300 primary data records. [2025-09-19T22:28:08.840299] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:08.851696] [INFO ] [MAIN ] VMI: Generated 1820 derivative records from 15739 primary records. [2025-09-19T22:28:08.852000] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-19T22:28:08.872338] [DEBUG] [LOCAL ] VMI: Derivative data saved (1820 records). [2025-09-19T22:28:08.873417] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-19T22:28:08.875930] [INFO ] [MAIN ] Derivative Progress: 1969/2093 symbols completed. VMI took 1.1s. Estimated remaining: 48.0s. Rate: 154.9 symbols/min [2025-09-19T22:28:08.877727] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:08.900447] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:08.901615] [INFO ] [MAIN ] VNCE: Generated 1820 derivative records from 6697 primary records. [2025-09-19T22:28:08.901827] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-19T22:28:08.921122] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1820 records). [2025-09-19T22:28:08.921266] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-19T22:28:08.923583] [INFO ] [MAIN ] Derivative Progress: 1970/2093 symbols completed. VNCE took 1.0s. Estimated remaining: 47.6s. Rate: 155.0 symbols/min [2025-09-19T22:28:08.925818] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:08.944828] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:08.945819] [INFO ] [MAIN ] VMO: Generated 1820 derivative records from 21300 primary records. [2025-09-19T22:28:08.945922] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-19T22:28:08.974672] [DEBUG] [LOCAL ] VMO: Derivative data saved (1820 records). [2025-09-19T22:28:08.974820] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-19T22:28:08.977269] [INFO ] [MAIN ] Derivative Progress: 1971/2093 symbols completed. VMO took 1.0s. Estimated remaining: 47.2s. Rate: 155.0 symbols/min [2025-09-19T22:28:08.977961] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:08.994917] [DEBUG] [LOCAL ] VNO: Loaded 49719 existing records from primary storage. [2025-09-19T22:28:08.995211] [INFO ] [MAIN ] VNO: Loaded 49719 primary data records. [2025-09-19T22:28:09.106566] [DEBUG] [LOCAL ] VOC: Loaded 9108 existing records from primary storage. [2025-09-19T22:28:09.128124] [INFO ] [MAIN ] VOC: Loaded 9108 primary data records. [2025-09-19T22:28:09.344579] [DEBUG] [LOCAL ] VNT: Loaded 44922 existing records from primary storage. [2025-09-19T22:28:09.501066] [INFO ] [MAIN ] VNT: Loaded 44922 primary data records. [2025-09-19T22:28:10.060312] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:10.062511] [INFO ] [MAIN ] VNO: Generated 1820 derivative records from 49719 primary records. [2025-09-19T22:28:10.062721] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-19T22:28:10.097775] [DEBUG] [LOCAL ] VNO: Derivative data saved (1820 records). [2025-09-19T22:28:10.097934] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-19T22:28:10.100071] [INFO ] [MAIN ] Derivative Progress: 1972/2093 symbols completed. VNO took 1.2s. Estimated remaining: 46.9s. Rate: 154.9 symbols/min [2025-09-19T22:28:10.097239] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:10.100599] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:10.101517] [INFO ] [MAIN ] VOC: Generated 1820 derivative records from 9108 primary records. [2025-09-19T22:28:10.101620] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-19T22:28:10.120792] [DEBUG] [LOCAL ] VOC: Derivative data saved (1820 records). [2025-09-19T22:28:10.133912] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-19T22:28:10.136631] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:10.136228] [INFO ] [MAIN ] Derivative Progress: 1973/2093 symbols completed. VOC took 1.2s. Estimated remaining: 46.5s. Rate: 155.0 symbols/min [2025-09-19T22:28:10.137039] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:10.137848] [INFO ] [MAIN ] VNT: Generated 1820 derivative records from 44922 primary records. [2025-09-19T22:28:10.138020] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-19T22:28:10.156674] [DEBUG] [LOCAL ] VNT: Derivative data saved (1820 records). [2025-09-19T22:28:10.156972] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-19T22:28:10.159701] [INFO ] [MAIN ] Derivative Progress: 1974/2093 symbols completed. VNT took 1.2s. Estimated remaining: 46.1s. Rate: 155.0 symbols/min [2025-09-19T22:28:10.169863] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:10.181821] [DEBUG] [LOCAL ] VPV: Loaded 5457 existing records from primary storage. [2025-09-19T22:28:10.182694] [INFO ] [MAIN ] VPV: Loaded 5457 primary data records. [2025-09-19T22:28:10.201959] [DEBUG] [LOCAL ] VPG: Loaded 17438 existing records from primary storage. [2025-09-19T22:28:10.202282] [INFO ] [MAIN ] VPG: Loaded 17438 primary data records. [2025-09-19T22:28:10.246016] [DEBUG] [LOCAL ] VOYA: Loaded 43581 existing records from primary storage. [2025-09-19T22:28:10.327757] [INFO ] [MAIN ] VOYA: Loaded 43581 primary data records. [2025-09-19T22:28:11.220499] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:11.224332] [INFO ] [MAIN ] VPG: Generated 1820 derivative records from 17438 primary records. [2025-09-19T22:28:11.224717] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-19T22:28:11.264075] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:11.267730] [DEBUG] [LOCAL ] VPG: Derivative data saved (1820 records). [2025-09-19T22:28:11.267849] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-19T22:28:11.268168] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:11.270297] [INFO ] [MAIN ] Derivative Progress: 1975/2093 symbols completed. VPG took 1.1s. Estimated remaining: 45.7s. Rate: 154.9 symbols/min [2025-09-19T22:28:11.271154] [INFO ] [MAIN ] VOYA: Generated 1820 derivative records from 43581 primary records. [2025-09-19T22:28:11.272176] [INFO ] [MAIN ] VPV: Generated 1820 derivative records from 5457 primary records. [2025-09-19T22:28:11.271531] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-19T22:28:11.271394] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:11.272366] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-19T22:28:11.301957] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1820 records). [2025-09-19T22:28:11.305733] [DEBUG] [LOCAL ] VPV: Derivative data saved (1820 records). [2025-09-19T22:28:11.305831] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-19T22:28:11.305925] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-19T22:28:11.308174] [INFO ] [MAIN ] Derivative Progress: 1976/2093 symbols completed. VOYA took 1.2s. Estimated remaining: 45.3s. Rate: 155.0 symbols/min [2025-09-19T22:28:11.311092] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:11.311680] [INFO ] [MAIN ] Derivative Progress: 1977/2093 symbols completed. VPV took 1.1s. Estimated remaining: 44.9s. Rate: 155.0 symbols/min [2025-09-19T22:28:11.311969] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:11.333996] [DEBUG] [LOCAL ] VRTS: Loaded 9146 existing records from primary storage. [2025-09-19T22:28:11.334148] [INFO ] [MAIN ] VRTS: Loaded 9146 primary data records. [2025-09-19T22:28:11.447599] [DEBUG] [LOCAL ] VRE: Loaded 35333 existing records from primary storage. [2025-09-19T22:28:11.453478] [INFO ] [MAIN ] VRE: Loaded 35333 primary data records. [2025-09-19T22:28:11.819663] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-09-19T22:28:11.852719] [INFO ] [MAIN ] VRT: Loaded 54533 primary data records. [2025-09-19T22:28:12.355000] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:12.356577] [INFO ] [MAIN ] VRTS: Generated 1820 derivative records from 9146 primary records. [2025-09-19T22:28:12.357167] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-19T22:28:12.374957] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1820 records). [2025-09-19T22:28:12.375151] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-19T22:28:12.377404] [INFO ] [MAIN ] Derivative Progress: 1978/2093 symbols completed. VRTS took 1.1s. Estimated remaining: 44.5s. Rate: 154.9 symbols/min [2025-09-19T22:28:12.395446] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:12.396210] [INFO ] [MAIN ] VRE: Generated 1820 derivative records from 35333 primary records. [2025-09-19T22:28:12.396362] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-19T22:28:12.412988] [DEBUG] [LOCAL ] VRE: Derivative data saved (1820 records). [2025-09-19T22:28:12.413872] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-19T22:28:12.416052] [INFO ] [MAIN ] Derivative Progress: 1979/2093 symbols completed. VRE took 1.1s. Estimated remaining: 44.1s. Rate: 155.0 symbols/min [2025-09-19T22:28:12.430886] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:12.431510] [INFO ] [MAIN ] VRT: Generated 1820 derivative records from 54533 primary records. [2025-09-19T22:28:12.431592] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-19T22:28:12.447689] [DEBUG] [LOCAL ] VRT: Derivative data saved (1820 records). [2025-09-19T22:28:12.447761] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-19T22:28:12.451519] [INFO ] [MAIN ] Derivative Progress: 1980/2093 symbols completed. VRT took 1.1s. Estimated remaining: 43.7s. Rate: 155.1 symbols/min [2025-09-19T22:28:12.452552] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:12.452692] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:12.452435] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:12.530470] [DEBUG] [LOCAL ] VSH: Loaded 49479 existing records from primary storage. [2025-09-19T22:28:12.530755] [INFO ] [MAIN ] VSH: Loaded 49479 primary data records. [2025-09-19T22:28:12.668279] [DEBUG] [LOCAL ] VSCO: Loaded 53670 existing records from primary storage. [2025-09-19T22:28:12.668861] [INFO ] [MAIN ] VSCO: Loaded 53670 primary data records. [2025-09-19T22:28:12.685303] [DEBUG] [LOCAL ] VST: Loaded 54500 existing records from primary storage. [2025-09-19T22:28:12.697147] [INFO ] [MAIN ] VST: Loaded 54500 primary data records. [2025-09-19T22:28:13.601061] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:13.602534] [INFO ] [MAIN ] VSH: Generated 1820 derivative records from 49479 primary records. [2025-09-19T22:28:13.602751] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-19T22:28:13.626663] [DEBUG] [LOCAL ] VSH: Derivative data saved (1820 records). [2025-09-19T22:28:13.627095] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-19T22:28:13.636534] [INFO ] [MAIN ] Derivative Progress: 1981/2093 symbols completed. VSH took 1.2s. Estimated remaining: 43.4s. Rate: 154.9 symbols/min [2025-09-19T22:28:13.642130] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:13.642354] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:13.643119] [INFO ] [MAIN ] VSCO: Generated 1820 derivative records from 53670 primary records. [2025-09-19T22:28:13.643308] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-19T22:28:13.670838] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:13.676136] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1820 records). [2025-09-19T22:28:13.676303] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-19T22:28:13.674790] [INFO ] [MAIN ] VST: Generated 1820 derivative records from 54500 primary records. [2025-09-19T22:28:13.676438] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-19T22:28:13.678585] [INFO ] [MAIN ] Derivative Progress: 1982/2093 symbols completed. VSCO took 1.2s. Estimated remaining: 43.0s. Rate: 155.0 symbols/min [2025-09-19T22:28:13.679590] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:13.697943] [DEBUG] [LOCAL ] VST: Derivative data saved (1820 records). [2025-09-19T22:28:13.698128] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-19T22:28:13.700888] [INFO ] [MAIN ] Derivative Progress: 1983/2093 symbols completed. VST took 1.2s. Estimated remaining: 42.6s. Rate: 155.0 symbols/min [2025-09-19T22:28:13.701464] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:13.749799] [DEBUG] [LOCAL ] VSTS: Loaded 49735 existing records from primary storage. [2025-09-19T22:28:13.750115] [INFO ] [MAIN ] VSTS: Loaded 49735 primary data records. [2025-09-19T22:28:13.868556] [DEBUG] [LOCAL ] VTEX: Loaded 44131 existing records from primary storage. [2025-09-19T22:28:13.889808] [INFO ] [MAIN ] VTEX: Loaded 44131 primary data records. [2025-09-19T22:28:14.086072] [DEBUG] [LOCAL ] VTLE: Loaded 49395 existing records from primary storage. [2025-09-19T22:28:14.259149] [INFO ] [MAIN ] VTLE: Loaded 49395 primary data records. [2025-09-19T22:28:15.059450] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:15.062420] [INFO ] [MAIN ] VSTS: Generated 1820 derivative records from 49735 primary records. [2025-09-19T22:28:15.063578] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-19T22:28:15.092004] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1820 records). [2025-09-19T22:28:15.092372] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-19T22:28:15.094955] [INFO ] [MAIN ] Derivative Progress: 1984/2093 symbols completed. VSTS took 1.5s. Estimated remaining: 42.2s. Rate: 154.8 symbols/min [2025-09-19T22:28:15.096157] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:15.131282] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:15.140709] [INFO ] [MAIN ] VTEX: Generated 1820 derivative records from 44131 primary records. [2025-09-19T22:28:15.152681] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-19T22:28:15.152557] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:15.154780] [INFO ] [MAIN ] VTLE: Generated 1820 derivative records from 49395 primary records. [2025-09-19T22:28:15.154883] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-19T22:28:15.193529] [DEBUG] [LOCAL ] VTMX: Loaded 17636 existing records from primary storage. [2025-09-19T22:28:15.204217] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1820 records). [2025-09-19T22:28:15.204770] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-19T22:28:15.208445] [INFO ] [MAIN ] Derivative Progress: 1985/2093 symbols completed. VTLE took 1.5s. Estimated remaining: 41.8s. Rate: 154.9 symbols/min [2025-09-19T22:28:15.209309] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:15.204952] [INFO ] [MAIN ] VTMX: Loaded 17636 primary data records. [2025-09-19T22:28:15.217827] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1820 records). [2025-09-19T22:28:15.245601] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-19T22:28:15.293709] [INFO ] [MAIN ] Derivative Progress: 1986/2093 symbols completed. VTEX took 1.6s. Estimated remaining: 41.4s. Rate: 154.9 symbols/min [2025-09-19T22:28:15.299795] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:15.354494] [DEBUG] [LOCAL ] VTN: Loaded 7254 existing records from primary storage. [2025-09-19T22:28:15.367374] [INFO ] [MAIN ] VTN: Loaded 7254 primary data records. [2025-09-19T22:28:15.725402] [DEBUG] [LOCAL ] VTOL: Loaded 20110 existing records from primary storage. [2025-09-19T22:28:15.732548] [INFO ] [MAIN ] VTOL: Loaded 20110 primary data records. [2025-09-19T22:28:16.293398] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:16.294336] [INFO ] [MAIN ] VTMX: Generated 1820 derivative records from 17636 primary records. [2025-09-19T22:28:16.294579] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-19T22:28:16.315334] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1820 records). [2025-09-19T22:28:16.315597] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-19T22:28:16.330385] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:16.331373] [INFO ] [MAIN ] VTN: Generated 1820 derivative records from 7254 primary records. [2025-09-19T22:28:16.330005] [INFO ] [MAIN ] Derivative Progress: 1987/2093 symbols completed. VTMX took 1.2s. Estimated remaining: 41.1s. Rate: 154.8 symbols/min [2025-09-19T22:28:16.331671] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-19T22:28:16.332611] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:16.362740] [DEBUG] [LOCAL ] VTN: Derivative data saved (1820 records). [2025-09-19T22:28:16.363396] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:16.363135] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-19T22:28:16.365899] [INFO ] [MAIN ] Derivative Progress: 1988/2093 symbols completed. VTN took 1.2s. Estimated remaining: 40.7s. Rate: 154.9 symbols/min [2025-09-19T22:28:16.366977] [INFO ] [MAIN ] VTOL: Generated 1820 derivative records from 20110 primary records. [2025-09-19T22:28:16.367174] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:16.367383] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-19T22:28:16.392738] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1820 records). [2025-09-19T22:28:16.392961] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-19T22:28:16.395500] [INFO ] [MAIN ] Derivative Progress: 1989/2093 symbols completed. VTOL took 1.1s. Estimated remaining: 40.3s. Rate: 155.0 symbols/min [2025-09-19T22:28:16.396031] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:16.408247] [DEBUG] [LOCAL ] VTS: Loaded 30856 existing records from primary storage. [2025-09-19T22:28:16.408497] [INFO ] [MAIN ] VTS: Loaded 30856 primary data records. [2025-09-19T22:28:16.571498] [DEBUG] [LOCAL ] VVR: Loaded 30653 existing records from primary storage. [2025-09-19T22:28:16.605157] [INFO ] [MAIN ] VVR: Loaded 30653 primary data records. [2025-09-19T22:28:16.792639] [DEBUG] [LOCAL ] VVV: Loaded 50881 existing records from primary storage. [2025-09-19T22:28:16.818301] [INFO ] [MAIN ] VVV: Loaded 50881 primary data records. [2025-09-19T22:28:17.414872] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:17.416020] [INFO ] [MAIN ] VTS: Generated 1820 derivative records from 30856 primary records. [2025-09-19T22:28:17.416430] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-19T22:28:17.435141] [DEBUG] [LOCAL ] VTS: Derivative data saved (1820 records). [2025-09-19T22:28:17.436461] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-19T22:28:17.439587] [INFO ] [MAIN ] Derivative Progress: 1990/2093 symbols completed. VTS took 1.1s. Estimated remaining: 39.9s. Rate: 154.8 symbols/min [2025-09-19T22:28:17.440057] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:17.469373] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:17.469944] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:17.470941] [INFO ] [MAIN ] VVR: Generated 1820 derivative records from 30653 primary records. [2025-09-19T22:28:17.471078] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-19T22:28:17.471883] [INFO ] [MAIN ] VVV: Generated 1820 derivative records from 50881 primary records. [2025-09-19T22:28:17.472891] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-19T22:28:17.510312] [DEBUG] [LOCAL ] VVR: Derivative data saved (1820 records). [2025-09-19T22:28:17.506914] [DEBUG] [LOCAL ] VVV: Derivative data saved (1820 records). [2025-09-19T22:28:17.510584] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-19T22:28:17.512683] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-19T22:28:17.512597] [INFO ] [MAIN ] Derivative Progress: 1991/2093 symbols completed. VVR took 1.1s. Estimated remaining: 39.5s. Rate: 154.9 symbols/min [2025-09-19T22:28:17.515515] [INFO ] [MAIN ] Derivative Progress: 1992/2093 symbols completed. VVV took 1.1s. Estimated remaining: 39.1s. Rate: 155.0 symbols/min [2025-09-19T22:28:17.515738] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:17.515989] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:17.524674] [DEBUG] [LOCAL ] VVX: Loaded 23754 existing records from primary storage. [2025-09-19T22:28:17.524858] [INFO ] [MAIN ] VVX: Loaded 23754 primary data records. [2025-09-19T22:28:17.901685] [DEBUG] [LOCAL ] VYX: Loaded 49925 existing records from primary storage. [2025-09-19T22:28:17.901982] [INFO ] [MAIN ] VYX: Loaded 49925 primary data records. [2025-09-19T22:28:18.020157] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-09-19T22:28:18.032319] [INFO ] [MAIN ] VZ: Loaded 54571 primary data records. [2025-09-19T22:28:18.591212] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:18.592870] [INFO ] [MAIN ] VVX: Generated 1820 derivative records from 23754 primary records. [2025-09-19T22:28:18.593609] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-19T22:28:18.612407] [DEBUG] [LOCAL ] VVX: Derivative data saved (1820 records). [2025-09-19T22:28:18.612520] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-19T22:28:18.614635] [INFO ] [MAIN ] Derivative Progress: 1993/2093 symbols completed. VVX took 1.2s. Estimated remaining: 38.8s. Rate: 154.8 symbols/min [2025-09-19T22:28:18.633149] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:18.633930] [INFO ] [MAIN ] VYX: Generated 1820 derivative records from 49925 primary records. [2025-09-19T22:28:18.634116] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-19T22:28:18.651019] [DEBUG] [LOCAL ] VYX: Derivative data saved (1820 records). [2025-09-19T22:28:18.651593] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-19T22:28:18.655870] [INFO ] [MAIN ] Derivative Progress: 1994/2093 symbols completed. VYX took 1.1s. Estimated remaining: 38.3s. Rate: 154.9 symbols/min [2025-09-19T22:28:18.670914] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:18.671625] [INFO ] [MAIN ] VZ: Generated 1820 derivative records from 54571 primary records. [2025-09-19T22:28:18.671714] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-19T22:28:18.687611] [DEBUG] [LOCAL ] VZ: Derivative data saved (1820 records). [2025-09-19T22:28:18.687722] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-19T22:28:18.690464] [INFO ] [MAIN ] Derivative Progress: 1995/2093 symbols completed. VZ took 1.2s. Estimated remaining: 37.9s. Rate: 155.0 symbols/min [2025-09-19T22:28:18.691354] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:18.691172] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:18.691727] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:18.737473] [DEBUG] [LOCAL ] WAL: Loaded 46225 existing records from primary storage. [2025-09-19T22:28:18.748617] [INFO ] [MAIN ] WAL: Loaded 46225 primary data records. [2025-09-19T22:28:18.885547] [DEBUG] [LOCAL ] WAB: Loaded 45019 existing records from primary storage. [2025-09-19T22:28:18.896735] [INFO ] [MAIN ] WAB: Loaded 45019 primary data records. [2025-09-19T22:28:18.967518] [DEBUG] [LOCAL ] W: Loaded 54290 existing records from primary storage. [2025-09-19T22:28:18.998099] [INFO ] [MAIN ] W: Loaded 54290 primary data records. [2025-09-19T22:28:19.806086] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:19.810035] [INFO ] [MAIN ] WAL: Generated 1820 derivative records from 46225 primary records. [2025-09-19T22:28:19.810452] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-19T22:28:19.839574] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:19.839357] [DEBUG] [LOCAL ] WAL: Derivative data saved (1820 records). [2025-09-19T22:28:19.840067] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-19T22:28:19.842637] [INFO ] [MAIN ] Derivative Progress: 1996/2093 symbols completed. WAL took 1.2s. Estimated remaining: 37.6s. Rate: 154.8 symbols/min [2025-09-19T22:28:19.840748] [INFO ] [MAIN ] WAB: Generated 1820 derivative records from 45019 primary records. [2025-09-19T22:28:19.843084] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-19T22:28:19.843851] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:19.863461] [DEBUG] [LOCAL ] WAB: Derivative data saved (1820 records). [2025-09-19T22:28:19.863761] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-19T22:28:19.866110] [INFO ] [MAIN ] Derivative Progress: 1997/2093 symbols completed. WAB took 1.2s. Estimated remaining: 37.2s. Rate: 154.9 symbols/min [2025-09-19T22:28:19.878663] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:19.879528] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:19.880224] [INFO ] [MAIN ] W: Generated 1820 derivative records from 54290 primary records. [2025-09-19T22:28:19.880430] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-19T22:28:19.897606] [DEBUG] [LOCAL ] W: Derivative data saved (1820 records). [2025-09-19T22:28:19.897810] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-19T22:28:19.900099] [INFO ] [MAIN ] Derivative Progress: 1998/2093 symbols completed. W took 1.2s. Estimated remaining: 36.8s. Rate: 155.0 symbols/min [2025-09-19T22:28:19.900479] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:19.923723] [DEBUG] [LOCAL ] WBX: Loaded 13473 existing records from primary storage. [2025-09-19T22:28:19.923857] [INFO ] [MAIN ] WBX: Loaded 13473 primary data records. [2025-09-19T22:28:20.053831] [DEBUG] [LOCAL ] WAT: Loaded 35678 existing records from primary storage. [2025-09-19T22:28:20.077613] [INFO ] [MAIN ] WAT: Loaded 35678 primary data records. [2025-09-19T22:28:20.126172] [DEBUG] [LOCAL ] WBS: Loaded 49586 existing records from primary storage. [2025-09-19T22:28:20.186610] [INFO ] [MAIN ] WBS: Loaded 49586 primary data records. [2025-09-19T22:28:20.910133] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:20.911296] [INFO ] [MAIN ] WBX: Generated 1820 derivative records from 13473 primary records. [2025-09-19T22:28:20.911413] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-19T22:28:20.927119] [DEBUG] [LOCAL ] WBX: Derivative data saved (1820 records). [2025-09-19T22:28:20.927687] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-19T22:28:20.929597] [INFO ] [MAIN ] Derivative Progress: 1999/2093 symbols completed. WBX took 1.0s. Estimated remaining: 36.4s. Rate: 154.8 symbols/min [2025-09-19T22:28:20.930098] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:20.949853] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:20.950871] [INFO ] [MAIN ] WAT: Generated 1820 derivative records from 35678 primary records. [2025-09-19T22:28:20.951083] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-19T22:28:20.964755] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:20.977208] [INFO ] [MAIN ] WBS: Generated 1820 derivative records from 49586 primary records. [2025-09-19T22:28:20.979101] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-19T22:28:20.998715] [DEBUG] [LOCAL ] WAT: Derivative data saved (1820 records). [2025-09-19T22:28:20.998933] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-19T22:28:20.998617] [DEBUG] [LOCAL ] WBS: Derivative data saved (1820 records). [2025-09-19T22:28:21.001313] [INFO ] [MAIN ] Derivative Progress: 2000/2093 symbols completed. WAT took 1.2s. Estimated remaining: 36.0s. Rate: 154.9 symbols/min [2025-09-19T22:28:20.999047] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-19T22:28:21.001618] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:21.003944] [INFO ] [MAIN ] Derivative Progress: 2001/2093 symbols completed. WBS took 1.1s. Estimated remaining: 35.6s. Rate: 155.0 symbols/min [2025-09-19T22:28:21.004737] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:21.032237] [DEBUG] [LOCAL ] WCC: Loaded 40867 existing records from primary storage. [2025-09-19T22:28:21.037055] [INFO ] [MAIN ] WCC: Loaded 40867 primary data records. [2025-09-19T22:28:21.165395] [DEBUG] [LOCAL ] WD: Loaded 23877 existing records from primary storage. [2025-09-19T22:28:21.171492] [INFO ] [MAIN ] WD: Loaded 23877 primary data records. [2025-09-19T22:28:21.469738] [DEBUG] [LOCAL ] WCN: Loaded 48820 existing records from primary storage. [2025-09-19T22:28:21.491575] [INFO ] [MAIN ] WCN: Loaded 48820 primary data records. [2025-09-19T22:28:22.087796] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:22.090060] [INFO ] [MAIN ] WCC: Generated 1820 derivative records from 40867 primary records. [2025-09-19T22:28:22.092030] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-19T22:28:22.124433] [DEBUG] [LOCAL ] WCC: Derivative data saved (1820 records). [2025-09-19T22:28:22.124740] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-19T22:28:22.123127] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:22.128063] [INFO ] [MAIN ] Derivative Progress: 2002/2093 symbols completed. WCC took 1.2s. Estimated remaining: 35.3s. Rate: 154.8 symbols/min [2025-09-19T22:28:22.129805] [INFO ] [MAIN ] WD: Generated 1820 derivative records from 23877 primary records. [2025-09-19T22:28:22.130047] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:22.130314] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-19T22:28:22.163481] [DEBUG] [LOCAL ] WD: Derivative data saved (1820 records). [2025-09-19T22:28:22.164148] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-19T22:28:22.163820] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:22.166433] [INFO ] [MAIN ] Derivative Progress: 2003/2093 symbols completed. WD took 1.2s. Estimated remaining: 34.9s. Rate: 154.9 symbols/min [2025-09-19T22:28:22.167249] [INFO ] [MAIN ] WCN: Generated 1820 derivative records from 48820 primary records. [2025-09-19T22:28:22.167622] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:22.167859] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-19T22:28:22.189435] [DEBUG] [LOCAL ] WCN: Derivative data saved (1820 records). [2025-09-19T22:28:22.194822] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-19T22:28:22.198631] [INFO ] [MAIN ] Derivative Progress: 2004/2093 symbols completed. WCN took 1.2s. Estimated remaining: 34.5s. Rate: 155.0 symbols/min [2025-09-19T22:28:22.199022] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:22.195964] [DEBUG] [LOCAL ] WDH: Loaded 16817 existing records from primary storage. [2025-09-19T22:28:22.199600] [INFO ] [MAIN ] WDH: Loaded 16817 primary data records. [2025-09-19T22:28:22.324821] [DEBUG] [LOCAL ] WDI: Loaded 21570 existing records from primary storage. [2025-09-19T22:28:22.330798] [INFO ] [MAIN ] WDI: Loaded 21570 primary data records. [2025-09-19T22:28:22.675521] [DEBUG] [LOCAL ] WDS: Loaded 44456 existing records from primary storage. [2025-09-19T22:28:22.686964] [INFO ] [MAIN ] WDS: Loaded 44456 primary data records. [2025-09-19T22:28:23.203167] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:23.205485] [INFO ] [MAIN ] WDH: Generated 1820 derivative records from 16817 primary records. [2025-09-19T22:28:23.205982] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-19T22:28:23.225986] [DEBUG] [LOCAL ] WDH: Derivative data saved (1820 records). [2025-09-19T22:28:23.226219] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-19T22:28:23.228473] [INFO ] [MAIN ] Derivative Progress: 2005/2093 symbols completed. WDH took 1.1s. Estimated remaining: 34.1s. Rate: 154.8 symbols/min [2025-09-19T22:28:23.229102] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:23.246991] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:23.249924] [INFO ] [MAIN ] WDI: Generated 1820 derivative records from 21570 primary records. [2025-09-19T22:28:23.250125] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-19T22:28:23.271705] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:23.277988] [INFO ] [MAIN ] WDS: Generated 1820 derivative records from 44456 primary records. [2025-09-19T22:28:23.282728] [DEBUG] [LOCAL ] WEA: Loaded 7581 existing records from primary storage. [2025-09-19T22:28:23.282482] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-19T22:28:23.284277] [INFO ] [MAIN ] WEA: Loaded 7581 primary data records. [2025-09-19T22:28:23.285865] [DEBUG] [LOCAL ] WDI: Derivative data saved (1820 records). [2025-09-19T22:28:23.297849] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-19T22:28:23.347156] [DEBUG] [LOCAL ] WDS: Derivative data saved (1820 records). [2025-09-19T22:28:23.371810] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-19T22:28:23.363010] [INFO ] [MAIN ] Derivative Progress: 2006/2093 symbols completed. WDI took 1.2s. Estimated remaining: 33.7s. Rate: 154.9 symbols/min [2025-09-19T22:28:23.419917] [INFO ] [MAIN ] Derivative Progress: 2007/2093 symbols completed. WDS took 1.2s. Estimated remaining: 33.3s. Rate: 154.9 symbols/min [2025-09-19T22:28:23.428322] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:23.432900] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:23.692991] [DEBUG] [LOCAL ] WEAV: Loaded 42702 existing records from primary storage. [2025-09-19T22:28:23.707158] [INFO ] [MAIN ] WEAV: Loaded 42702 primary data records. [2025-09-19T22:28:23.706921] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:23.708158] [INFO ] [MAIN ] WEA: Generated 1820 derivative records from 7581 primary records. [2025-09-19T22:28:23.719805] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-19T22:28:23.863948] [DEBUG] [LOCAL ] WEC: Loaded 52982 existing records from primary storage. [2025-09-19T22:28:23.877714] [INFO ] [MAIN ] WEC: Loaded 52982 primary data records. [2025-09-19T22:28:23.872424] [DEBUG] [LOCAL ] WEA: Derivative data saved (1820 records). [2025-09-19T22:28:23.932794] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-19T22:28:23.973885] [INFO ] [MAIN ] Derivative Progress: 2008/2093 symbols completed. WEA took 0.7s. Estimated remaining: 32.9s. Rate: 154.9 symbols/min [2025-09-19T22:28:24.440141] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:24.441158] [INFO ] [MAIN ] WEAV: Generated 1820 derivative records from 42702 primary records. [2025-09-19T22:28:24.441417] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-19T22:28:24.458410] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1820 records). [2025-09-19T22:28:24.458674] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-19T22:28:24.460750] [INFO ] [MAIN ] Derivative Progress: 2009/2093 symbols completed. WEAV took 1.0s. Estimated remaining: 32.5s. Rate: 154.9 symbols/min [2025-09-19T22:28:24.476122] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:24.476798] [INFO ] [MAIN ] WEC: Generated 1820 derivative records from 52982 primary records. [2025-09-19T22:28:24.476862] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-19T22:28:24.492779] [DEBUG] [LOCAL ] WEC: Derivative data saved (1820 records). [2025-09-19T22:28:24.492897] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-19T22:28:24.495144] [INFO ] [MAIN ] Derivative Progress: 2010/2093 symbols completed. WEC took 1.1s. Estimated remaining: 32.1s. Rate: 155.0 symbols/min [2025-09-19T22:28:24.495948] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:24.496019] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:24.496830] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:24.558895] [DEBUG] [LOCAL ] WEX: Loaded 36192 existing records from primary storage. [2025-09-19T22:28:24.559127] [INFO ] [MAIN ] WEX: Loaded 36192 primary data records. [2025-09-19T22:28:24.696126] [DEBUG] [LOCAL ] WES: Loaded 48807 existing records from primary storage. [2025-09-19T22:28:24.710793] [INFO ] [MAIN ] WES: Loaded 48807 primary data records. [2025-09-19T22:28:24.738856] [DEBUG] [LOCAL ] WELL: Loaded 53136 existing records from primary storage. [2025-09-19T22:28:24.793146] [INFO ] [MAIN ] WELL: Loaded 53136 primary data records. [2025-09-19T22:28:25.629574] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:25.634173] [INFO ] [MAIN ] WEX: Generated 1820 derivative records from 36192 primary records. [2025-09-19T22:28:25.634635] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-19T22:28:25.649239] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:25.661794] [INFO ] [MAIN ] WES: Generated 1820 derivative records from 48807 primary records. [2025-09-19T22:28:25.664288] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-19T22:28:25.666673] [DEBUG] [LOCAL ] WEX: Derivative data saved (1820 records). [2025-09-19T22:28:25.667166] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-19T22:28:25.668943] [INFO ] [MAIN ] Derivative Progress: 2011/2093 symbols completed. WEX took 1.2s. Estimated remaining: 31.8s. Rate: 154.8 symbols/min [2025-09-19T22:28:25.677753] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:25.687845] [DEBUG] [LOCAL ] WES: Derivative data saved (1820 records). [2025-09-19T22:28:25.689043] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-19T22:28:25.692218] [INFO ] [MAIN ] Derivative Progress: 2012/2093 symbols completed. WES took 1.2s. Estimated remaining: 31.4s. Rate: 154.9 symbols/min [2025-09-19T22:28:25.692601] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:25.707155] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:25.707952] [INFO ] [MAIN ] WELL: Generated 1820 derivative records from 53136 primary records. [2025-09-19T22:28:25.711096] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-19T22:28:25.731102] [DEBUG] [LOCAL ] WF: Loaded 11233 existing records from primary storage. [2025-09-19T22:28:25.732474] [DEBUG] [LOCAL ] WELL: Derivative data saved (1820 records). [2025-09-19T22:28:25.732726] [INFO ] [MAIN ] WF: Loaded 11233 primary data records. [2025-09-19T22:28:25.732631] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-19T22:28:25.740671] [INFO ] [MAIN ] Derivative Progress: 2013/2093 symbols completed. WELL took 1.2s. Estimated remaining: 31.0s. Rate: 154.9 symbols/min [2025-09-19T22:28:25.774587] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:26.127875] [DEBUG] [LOCAL ] WFC: Loaded 54528 existing records from primary storage. [2025-09-19T22:28:26.128331] [DEBUG] [LOCAL ] WFG: Loaded 25529 existing records from primary storage. [2025-09-19T22:28:26.129294] [INFO ] [MAIN ] WFC: Loaded 54528 primary data records. [2025-09-19T22:28:26.129609] [INFO ] [MAIN ] WFG: Loaded 25529 primary data records. [2025-09-19T22:28:26.790080] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:26.791557] [INFO ] [MAIN ] WF: Generated 1820 derivative records from 11233 primary records. [2025-09-19T22:28:26.791733] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-19T22:28:26.820061] [DEBUG] [LOCAL ] WF: Derivative data saved (1820 records). [2025-09-19T22:28:26.820495] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-19T22:28:26.823031] [INFO ] [MAIN ] Derivative Progress: 2014/2093 symbols completed. WF took 1.2s. Estimated remaining: 30.6s. Rate: 154.8 symbols/min [2025-09-19T22:28:26.823639] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:26.843744] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:26.846297] [INFO ] [MAIN ] WFG: Generated 1820 derivative records from 25529 primary records. [2025-09-19T22:28:26.847126] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-19T22:28:26.873600] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:26.878879] [INFO ] [MAIN ] WFC: Generated 1820 derivative records from 54528 primary records. [2025-09-19T22:28:26.879093] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-19T22:28:26.877944] [DEBUG] [LOCAL ] WFG: Derivative data saved (1820 records). [2025-09-19T22:28:26.879274] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-19T22:28:26.882012] [INFO ] [MAIN ] Derivative Progress: 2015/2093 symbols completed. WFG took 1.1s. Estimated remaining: 30.2s. Rate: 154.9 symbols/min [2025-09-19T22:28:26.882437] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:26.908529] [DEBUG] [LOCAL ] WFC: Derivative data saved (1820 records). [2025-09-19T22:28:26.908783] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-19T22:28:26.911357] [INFO ] [MAIN ] Derivative Progress: 2016/2093 symbols completed. WFC took 1.2s. Estimated remaining: 29.8s. Rate: 154.9 symbols/min [2025-09-19T22:28:26.911758] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:26.927343] [DEBUG] [LOCAL ] WGO: Loaded 40204 existing records from primary storage. [2025-09-19T22:28:26.927734] [INFO ] [MAIN ] WGO: Loaded 40204 primary data records. [2025-09-19T22:28:27.295688] [DEBUG] [LOCAL ] WH: Loaded 46601 existing records from primary storage. [2025-09-19T22:28:27.297237] [INFO ] [MAIN ] WH: Loaded 46601 primary data records. [2025-09-19T22:28:27.297899] [DEBUG] [LOCAL ] WHD: Loaded 41385 existing records from primary storage. [2025-09-19T22:28:27.297992] [INFO ] [MAIN ] WHD: Loaded 41385 primary data records. [2025-09-19T22:28:28.007080] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:28.008158] [INFO ] [MAIN ] WGO: Generated 1820 derivative records from 40204 primary records. [2025-09-19T22:28:28.008691] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-19T22:28:28.027079] [DEBUG] [LOCAL ] WGO: Derivative data saved (1820 records). [2025-09-19T22:28:28.027307] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-19T22:28:28.029823] [INFO ] [MAIN ] Derivative Progress: 2017/2093 symbols completed. WGO took 1.2s. Estimated remaining: 29.5s. Rate: 154.8 symbols/min [2025-09-19T22:28:28.030437] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:28.042299] [DEBUG] [LOCAL ] WHG: Loaded 3455 existing records from primary storage. [2025-09-19T22:28:28.054432] [INFO ] [MAIN ] WHG: Loaded 3455 primary data records. [2025-09-19T22:28:28.109036] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:28.141959] [INFO ] [MAIN ] WHD: Generated 1820 derivative records from 41385 primary records. [2025-09-19T22:28:28.148807] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-19T22:28:28.141149] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:28.154743] [INFO ] [MAIN ] WH: Generated 1820 derivative records from 46601 primary records. [2025-09-19T22:28:28.155670] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-19T22:28:28.259184] [DEBUG] [LOCAL ] WHD: Derivative data saved (1820 records). [2025-09-19T22:28:28.281198] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-19T22:28:28.408076] [INFO ] [MAIN ] Derivative Progress: 2018/2093 symbols completed. WHD took 1.5s. Estimated remaining: 29.1s. Rate: 154.8 symbols/min [2025-09-19T22:28:28.410008] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:28.414493] [DEBUG] [LOCAL ] WH: Derivative data saved (1820 records). [2025-09-19T22:28:28.414875] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-19T22:28:28.418594] [INFO ] [MAIN ] Derivative Progress: 2019/2093 symbols completed. WH took 1.5s. Estimated remaining: 28.7s. Rate: 154.9 symbols/min [2025-09-19T22:28:28.419416] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:28.428127] [DEBUG] [LOCAL ] WIA: Loaded 4942 existing records from primary storage. [2025-09-19T22:28:28.428368] [INFO ] [MAIN ] WIA: Loaded 4942 primary data records. [2025-09-19T22:28:28.784035] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:28.786079] [INFO ] [MAIN ] WHG: Generated 1820 derivative records from 3455 primary records. [2025-09-19T22:28:28.786248] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-19T22:28:28.796501] [DEBUG] [LOCAL ] WHR: Loaded 48879 existing records from primary storage. [2025-09-19T22:28:28.796975] [INFO ] [MAIN ] WHR: Loaded 48879 primary data records. [2025-09-19T22:28:28.863377] [DEBUG] [LOCAL ] WHG: Derivative data saved (1820 records). [2025-09-19T22:28:28.877939] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-19T22:28:28.880294] [INFO ] [MAIN ] Derivative Progress: 2020/2093 symbols completed. WHG took 0.9s. Estimated remaining: 28.3s. Rate: 154.9 symbols/min [2025-09-19T22:28:28.913848] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:29.124451] [DEBUG] [LOCAL ] WINN: Loaded 12083 existing records from primary storage. [2025-09-19T22:28:29.133567] [INFO ] [MAIN ] WINN: Loaded 12083 primary data records. [2025-09-19T22:28:29.261246] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:29.279106] [INFO ] [MAIN ] WIA: Generated 1820 derivative records from 4942 primary records. [2025-09-19T22:28:29.306497] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-19T22:28:29.479410] [DEBUG] [LOCAL ] WIA: Derivative data saved (1820 records). [2025-09-19T22:28:29.479748] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-19T22:28:29.481878] [INFO ] [MAIN ] Derivative Progress: 2021/2093 symbols completed. WIA took 1.1s. Estimated remaining: 27.9s. Rate: 154.8 symbols/min [2025-09-19T22:28:29.484829] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:29.500564] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:29.501400] [INFO ] [MAIN ] WHR: Generated 1820 derivative records from 48879 primary records. [2025-09-19T22:28:29.501499] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-19T22:28:29.518903] [DEBUG] [LOCAL ] WHR: Derivative data saved (1820 records). [2025-09-19T22:28:29.519306] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-19T22:28:29.521615] [INFO ] [MAIN ] Derivative Progress: 2022/2093 symbols completed. WHR took 1.1s. Estimated remaining: 27.5s. Rate: 154.9 symbols/min [2025-09-19T22:28:29.522424] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:29.540774] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:28:29.541536] [INFO ] [MAIN ] WINN: Generated 1819 derivative records from 12083 primary records. [2025-09-19T22:28:29.541685] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-19T22:28:29.588281] [DEBUG] [LOCAL ] WINN: Derivative data saved (1819 records). [2025-09-19T22:28:29.589548] [DEBUG] [LOCAL ] WIW: Loaded 21115 existing records from primary storage. [2025-09-19T22:28:29.589758] [INFO ] [MAIN ] WIW: Loaded 21115 primary data records. [2025-09-19T22:28:29.588581] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-19T22:28:29.593335] [INFO ] [MAIN ] Derivative Progress: 2023/2093 symbols completed. WINN took 0.7s. Estimated remaining: 27.1s. Rate: 155.0 symbols/min [2025-09-19T22:28:29.657507] [DEBUG] [LOCAL ] WIT: Loaded 53032 existing records from primary storage. [2025-09-19T22:28:29.701478] [INFO ] [MAIN ] WIT: Loaded 53032 primary data records. [2025-09-19T22:28:30.280182] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:30.282180] [INFO ] [MAIN ] WIW: Generated 1820 derivative records from 21115 primary records. [2025-09-19T22:28:30.282360] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-19T22:28:30.295410] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:30.304217] [INFO ] [MAIN ] WIT: Generated 1820 derivative records from 53032 primary records. [2025-09-19T22:28:30.307209] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-19T22:28:30.311935] [DEBUG] [LOCAL ] WIW: Derivative data saved (1820 records). [2025-09-19T22:28:30.319006] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-19T22:28:30.321725] [INFO ] [MAIN ] Derivative Progress: 2024/2093 symbols completed. WIW took 0.8s. Estimated remaining: 26.7s. Rate: 154.9 symbols/min [2025-09-19T22:28:30.328396] [DEBUG] [LOCAL ] WIT: Derivative data saved (1820 records). [2025-09-19T22:28:30.328458] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-19T22:28:30.330958] [INFO ] [MAIN ] Derivative Progress: 2025/2093 symbols completed. WIT took 0.8s. Estimated remaining: 26.3s. Rate: 155.0 symbols/min [2025-09-19T22:28:30.331590] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:30.331510] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:30.331874] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:30.388160] [DEBUG] [LOCAL ] WK: Loaded 37113 existing records from primary storage. [2025-09-19T22:28:30.398834] [INFO ] [MAIN ] WK: Loaded 37113 primary data records. [2025-09-19T22:28:30.399493] [DEBUG] [LOCAL ] WKC: Loaded 35885 existing records from primary storage. [2025-09-19T22:28:30.399679] [INFO ] [MAIN ] WKC: Loaded 35885 primary data records. [2025-09-19T22:28:30.479242] [DEBUG] [LOCAL ] WLK: Loaded 45890 existing records from primary storage. [2025-09-19T22:28:30.511482] [INFO ] [MAIN ] WLK: Loaded 45890 primary data records. [2025-09-19T22:28:31.441665] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:31.442802] [INFO ] [MAIN ] WK: Generated 1820 derivative records from 37113 primary records. [2025-09-19T22:28:31.443232] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-19T22:28:31.460297] [DEBUG] [LOCAL ] WK: Derivative data saved (1820 records). [2025-09-19T22:28:31.460634] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-19T22:28:31.465637] [INFO ] [MAIN ] Derivative Progress: 2026/2093 symbols completed. WK took 1.1s. Estimated remaining: 26.0s. Rate: 154.8 symbols/min [2025-09-19T22:28:31.474497] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:31.501922] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:31.502442] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:31.504310] [INFO ] [MAIN ] WLK: Generated 1820 derivative records from 45890 primary records. [2025-09-19T22:28:31.504703] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-19T22:28:31.506930] [INFO ] [MAIN ] WKC: Generated 1820 derivative records from 35885 primary records. [2025-09-19T22:28:31.507582] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-19T22:28:31.543399] [DEBUG] [LOCAL ] WKC: Derivative data saved (1820 records). [2025-09-19T22:28:31.544770] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-19T22:28:31.551005] [INFO ] [MAIN ] Derivative Progress: 2027/2093 symbols completed. WKC took 1.2s. Estimated remaining: 25.6s. Rate: 154.9 symbols/min [2025-09-19T22:28:31.555790] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:31.556849] [DEBUG] [LOCAL ] WLKP: Loaded 6645 existing records from primary storage. [2025-09-19T22:28:31.558684] [INFO ] [MAIN ] WLKP: Loaded 6645 primary data records. [2025-09-19T22:28:31.604617] [DEBUG] [LOCAL ] WLK: Derivative data saved (1820 records). [2025-09-19T22:28:31.626408] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-19T22:28:31.641567] [INFO ] [MAIN ] Derivative Progress: 2028/2093 symbols completed. WLK took 1.3s. Estimated remaining: 25.2s. Rate: 154.9 symbols/min [2025-09-19T22:28:31.647590] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:31.911850] [DEBUG] [LOCAL ] WLY: Loaded 31011 existing records from primary storage. [2025-09-19T22:28:31.912170] [INFO ] [MAIN ] WLY: Loaded 31011 primary data records. [2025-09-19T22:28:32.291844] [DEBUG] [LOCAL ] WM: Loaded 51728 existing records from primary storage. [2025-09-19T22:28:32.292400] [INFO ] [MAIN ] WM: Loaded 51728 primary data records. [2025-09-19T22:28:32.635448] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:32.646489] [INFO ] [MAIN ] WLKP: Generated 1820 derivative records from 6645 primary records. [2025-09-19T22:28:32.647165] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-19T22:28:32.671107] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1820 records). [2025-09-19T22:28:32.672081] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-19T22:28:32.675921] [INFO ] [MAIN ] Derivative Progress: 2029/2093 symbols completed. WLKP took 1.2s. Estimated remaining: 24.8s. Rate: 154.8 symbols/min [2025-09-19T22:28:32.677233] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:32.692282] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:32.694274] [INFO ] [MAIN ] WLY: Generated 1820 derivative records from 31011 primary records. [2025-09-19T22:28:32.694410] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-19T22:28:32.710815] [DEBUG] [LOCAL ] WLY: Derivative data saved (1820 records). [2025-09-19T22:28:32.711284] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-19T22:28:32.713721] [INFO ] [MAIN ] Derivative Progress: 2030/2093 symbols completed. WLY took 1.2s. Estimated remaining: 24.4s. Rate: 154.9 symbols/min [2025-09-19T22:28:32.714033] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:32.737317] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:32.738147] [INFO ] [MAIN ] WM: Generated 1820 derivative records from 51728 primary records. [2025-09-19T22:28:32.738289] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-19T22:28:32.753326] [DEBUG] [LOCAL ] WMK: Loaded 14783 existing records from primary storage. [2025-09-19T22:28:32.756922] [INFO ] [MAIN ] WMK: Loaded 14783 primary data records. [2025-09-19T22:28:32.760535] [DEBUG] [LOCAL ] WM: Derivative data saved (1820 records). [2025-09-19T22:28:32.816758] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-19T22:28:32.847193] [INFO ] [MAIN ] Derivative Progress: 2031/2093 symbols completed. WM took 1.2s. Estimated remaining: 24.0s. Rate: 154.9 symbols/min [2025-09-19T22:28:32.880749] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:32.912930] [DEBUG] [LOCAL ] WMB: Loaded 54451 existing records from primary storage. [2025-09-19T22:28:32.945289] [INFO ] [MAIN ] WMB: Loaded 54451 primary data records. [2025-09-19T22:28:33.412415] [DEBUG] [LOCAL ] WMS: Loaded 40206 existing records from primary storage. [2025-09-19T22:28:33.422160] [INFO ] [MAIN ] WMS: Loaded 40206 primary data records. [2025-09-19T22:28:33.757584] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:33.758554] [INFO ] [MAIN ] WMK: Generated 1820 derivative records from 14783 primary records. [2025-09-19T22:28:33.758838] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-19T22:28:33.777580] [DEBUG] [LOCAL ] WMK: Derivative data saved (1820 records). [2025-09-19T22:28:33.778279] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-19T22:28:33.780927] [INFO ] [MAIN ] Derivative Progress: 2032/2093 symbols completed. WMK took 1.1s. Estimated remaining: 23.6s. Rate: 154.8 symbols/min [2025-09-19T22:28:33.781334] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:33.801282] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:33.802385] [INFO ] [MAIN ] WMB: Generated 1820 derivative records from 54451 primary records. [2025-09-19T22:28:33.802695] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-19T22:28:33.822246] [DEBUG] [LOCAL ] WMB: Derivative data saved (1820 records). [2025-09-19T22:28:33.823234] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-19T22:28:33.825688] [INFO ] [MAIN ] Derivative Progress: 2033/2093 symbols completed. WMB took 1.1s. Estimated remaining: 23.2s. Rate: 154.9 symbols/min [2025-09-19T22:28:33.826422] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:33.843292] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:33.844269] [INFO ] [MAIN ] WMS: Generated 1820 derivative records from 40206 primary records. [2025-09-19T22:28:33.844416] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-19T22:28:33.878986] [DEBUG] [LOCAL ] WMS: Derivative data saved (1820 records). [2025-09-19T22:28:33.879188] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-19T22:28:33.882006] [INFO ] [MAIN ] Derivative Progress: 2034/2093 symbols completed. WMS took 1.0s. Estimated remaining: 22.8s. Rate: 154.9 symbols/min [2025-09-19T22:28:33.883288] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:33.899624] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-09-19T22:28:33.908985] [INFO ] [MAIN ] WMT: Loaded 54580 primary data records. [2025-09-19T22:28:34.027873] [DEBUG] [LOCAL ] WNC: Loaded 41029 existing records from primary storage. [2025-09-19T22:28:34.039475] [INFO ] [MAIN ] WNC: Loaded 41029 primary data records. [2025-09-19T22:28:34.382811] [DEBUG] [LOCAL ] WNS: Loaded 40320 existing records from primary storage. [2025-09-19T22:28:34.383428] [INFO ] [MAIN ] WNS: Loaded 40320 primary data records. [2025-09-19T22:28:34.928214] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:34.929436] [INFO ] [MAIN ] WMT: Generated 1820 derivative records from 54580 primary records. [2025-09-19T22:28:34.929954] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-19T22:28:34.949793] [DEBUG] [LOCAL ] WMT: Derivative data saved (1820 records). [2025-09-19T22:28:34.950081] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-19T22:28:34.952334] [INFO ] [MAIN ] Derivative Progress: 2035/2093 symbols completed. WMT took 1.2s. Estimated remaining: 22.5s. Rate: 154.8 symbols/min [2025-09-19T22:28:34.953105] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:34.966910] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:28:34.968069] [INFO ] [MAIN ] WNC: Generated 1819 derivative records from 41029 primary records. [2025-09-19T22:28:34.968323] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-19T22:28:34.985529] [DEBUG] [LOCAL ] WNC: Derivative data saved (1819 records). [2025-09-19T22:28:34.985985] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-19T22:28:34.989475] [INFO ] [MAIN ] Derivative Progress: 2036/2093 symbols completed. WNC took 1.2s. Estimated remaining: 22.1s. Rate: 154.9 symbols/min [2025-09-19T22:28:34.990964] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:35.006157] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:35.007081] [INFO ] [MAIN ] WNS: Generated 1820 derivative records from 40320 primary records. [2025-09-19T22:28:35.007179] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-19T22:28:35.023140] [DEBUG] [LOCAL ] WNS: Derivative data saved (1820 records). [2025-09-19T22:28:35.023216] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-19T22:28:35.025822] [INFO ] [MAIN ] Derivative Progress: 2037/2093 symbols completed. WNS took 1.1s. Estimated remaining: 21.7s. Rate: 154.9 symbols/min [2025-09-19T22:28:35.026104] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:35.066332] [DEBUG] [LOCAL ] WOR: Loaded 25115 existing records from primary storage. [2025-09-19T22:28:35.066518] [INFO ] [MAIN ] WOR: Loaded 25115 primary data records. [2025-09-19T22:28:35.132314] [DEBUG] [LOCAL ] WOLF: Loaded 54312 existing records from primary storage. [2025-09-19T22:28:35.154743] [INFO ] [MAIN ] WOLF: Loaded 54312 primary data records. [2025-09-19T22:28:35.176076] [DEBUG] [LOCAL ] WOW: Loaded 30308 existing records from primary storage. [2025-09-19T22:28:35.197473] [INFO ] [MAIN ] WOW: Loaded 30308 primary data records. [2025-09-19T22:28:36.086450] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:36.089245] [INFO ] [MAIN ] WOR: Generated 1820 derivative records from 25115 primary records. [2025-09-19T22:28:36.089499] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-19T22:28:36.115816] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:36.117516] [INFO ] [MAIN ] WOLF: Generated 1820 derivative records from 54312 primary records. [2025-09-19T22:28:36.117725] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-19T22:28:36.122325] [DEBUG] [LOCAL ] WOR: Derivative data saved (1820 records). [2025-09-19T22:28:36.132480] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-19T22:28:36.135250] [INFO ] [MAIN ] Derivative Progress: 2038/2093 symbols completed. WOR took 1.1s. Estimated remaining: 21.3s. Rate: 154.8 symbols/min [2025-09-19T22:28:36.154907] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:36.156186] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1820 records). [2025-09-19T22:28:36.156963] [INFO ] [MAIN ] WOW: Generated 1820 derivative records from 30308 primary records. [2025-09-19T22:28:36.157076] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-19T22:28:36.159399] [INFO ] [MAIN ] Derivative Progress: 2039/2093 symbols completed. WOLF took 1.2s. Estimated remaining: 20.9s. Rate: 154.9 symbols/min [2025-09-19T22:28:36.159509] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-19T22:28:36.175095] [DEBUG] [LOCAL ] WOW: Derivative data saved (1820 records). [2025-09-19T22:28:36.175161] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-19T22:28:36.177959] [INFO ] [MAIN ] Derivative Progress: 2040/2093 symbols completed. WOW took 1.2s. Estimated remaining: 20.5s. Rate: 155.0 symbols/min [2025-09-19T22:28:36.178502] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:36.178883] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:36.178981] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:36.213871] [DEBUG] [LOCAL ] WPP: Loaded 34181 existing records from primary storage. [2025-09-19T22:28:36.214006] [INFO ] [MAIN ] WPP: Loaded 34181 primary data records. [2025-09-19T22:28:36.435620] [DEBUG] [LOCAL ] WPC: Loaded 49468 existing records from primary storage. [2025-09-19T22:28:36.449807] [INFO ] [MAIN ] WPC: Loaded 49468 primary data records. [2025-09-19T22:28:36.568799] [DEBUG] [LOCAL ] WPM: Loaded 53489 existing records from primary storage. [2025-09-19T22:28:36.610344] [INFO ] [MAIN ] WPM: Loaded 53489 primary data records. [2025-09-19T22:28:37.209413] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:37.210420] [INFO ] [MAIN ] WPP: Generated 1820 derivative records from 34181 primary records. [2025-09-19T22:28:37.210623] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-19T22:28:37.229562] [DEBUG] [LOCAL ] WPP: Derivative data saved (1820 records). [2025-09-19T22:28:37.229990] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-19T22:28:37.232326] [INFO ] [MAIN ] Derivative Progress: 2041/2093 symbols completed. WPP took 1.1s. Estimated remaining: 20.2s. Rate: 154.8 symbols/min [2025-09-19T22:28:37.232711] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:37.252435] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:37.265373] [INFO ] [MAIN ] WPC: Generated 1820 derivative records from 49468 primary records. [2025-09-19T22:28:37.265708] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-19T22:28:37.266760] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:37.267541] [INFO ] [MAIN ] WPM: Generated 1820 derivative records from 53489 primary records. [2025-09-19T22:28:37.274732] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-19T22:28:37.283873] [DEBUG] [LOCAL ] WPC: Derivative data saved (1820 records). [2025-09-19T22:28:37.284219] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-19T22:28:37.293700] [INFO ] [MAIN ] Derivative Progress: 2042/2093 symbols completed. WPC took 1.1s. Estimated remaining: 19.8s. Rate: 154.9 symbols/min [2025-09-19T22:28:37.298069] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:37.303031] [DEBUG] [LOCAL ] WPM: Derivative data saved (1820 records). [2025-09-19T22:28:37.303207] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-19T22:28:37.305858] [INFO ] [MAIN ] Derivative Progress: 2043/2093 symbols completed. WPM took 1.1s. Estimated remaining: 19.4s. Rate: 155.0 symbols/min [2025-09-19T22:28:37.306425] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:37.342393] [DEBUG] [LOCAL ] WRB: Loaded 51351 existing records from primary storage. [2025-09-19T22:28:37.342713] [INFO ] [MAIN ] WRB: Loaded 51351 primary data records. [2025-09-19T22:28:37.457943] [DEBUG] [LOCAL ] WS: Loaded 24295 existing records from primary storage. [2025-09-19T22:28:37.470281] [INFO ] [MAIN ] WS: Loaded 24295 primary data records. [2025-09-19T22:28:37.863920] [DEBUG] [LOCAL ] WRBY: Loaded 51650 existing records from primary storage. [2025-09-19T22:28:37.982962] [INFO ] [MAIN ] WRBY: Loaded 51650 primary data records. [2025-09-19T22:28:38.403780] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:38.404948] [INFO ] [MAIN ] WRB: Generated 1820 derivative records from 51351 primary records. [2025-09-19T22:28:38.405271] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-19T22:28:38.424424] [DEBUG] [LOCAL ] WRB: Derivative data saved (1820 records). [2025-09-19T22:28:38.425078] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-19T22:28:38.427732] [INFO ] [MAIN ] Derivative Progress: 2044/2093 symbols completed. WRB took 1.2s. Estimated remaining: 19.0s. Rate: 154.8 symbols/min [2025-09-19T22:28:38.428127] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:38.446841] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:38.447667] [INFO ] [MAIN ] WS: Generated 1820 derivative records from 24295 primary records. [2025-09-19T22:28:38.447841] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-19T22:28:38.464597] [DEBUG] [LOCAL ] WS: Derivative data saved (1820 records). [2025-09-19T22:28:38.464897] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-19T22:28:38.468046] [INFO ] [MAIN ] Derivative Progress: 2045/2093 symbols completed. WS took 1.2s. Estimated remaining: 18.6s. Rate: 154.9 symbols/min [2025-09-19T22:28:38.469301] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:38.483790] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:38.484533] [INFO ] [MAIN ] WRBY: Generated 1820 derivative records from 51650 primary records. [2025-09-19T22:28:38.484613] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-19T22:28:38.502010] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1820 records). [2025-09-19T22:28:38.516499] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-19T22:28:38.519136] [INFO ] [MAIN ] Derivative Progress: 2046/2093 symbols completed. WRBY took 1.2s. Estimated remaining: 18.2s. Rate: 154.9 symbols/min [2025-09-19T22:28:38.519828] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:38.537759] [DEBUG] [LOCAL ] WSO: Loaded 25021 existing records from primary storage. [2025-09-19T22:28:38.538830] [INFO ] [MAIN ] WSO: Loaded 25021 primary data records. [2025-09-19T22:28:38.628400] [DEBUG] [LOCAL ] WSM: Loaded 50753 existing records from primary storage. [2025-09-19T22:28:38.656894] [INFO ] [MAIN ] WSM: Loaded 50753 primary data records. [2025-09-19T22:28:38.756672] [DEBUG] [LOCAL ] WSR: Loaded 23914 existing records from primary storage. [2025-09-19T22:28:38.801523] [INFO ] [MAIN ] WSR: Loaded 23914 primary data records. [2025-09-19T22:28:39.679450] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:39.680899] [INFO ] [MAIN ] WSO: Generated 1820 derivative records from 25021 primary records. [2025-09-19T22:28:39.681177] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-19T22:28:39.698893] [DEBUG] [LOCAL ] WSO: Derivative data saved (1820 records). [2025-09-19T22:28:39.699377] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-19T22:28:39.701448] [INFO ] [MAIN ] Derivative Progress: 2047/2093 symbols completed. WSO took 1.2s. Estimated remaining: 17.8s. Rate: 154.8 symbols/min [2025-09-19T22:28:39.702102] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:39.721834] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:39.735234] [INFO ] [MAIN ] WSR: Generated 1820 derivative records from 23914 primary records. [2025-09-19T22:28:39.736025] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-19T22:28:39.735952] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:39.737680] [INFO ] [MAIN ] WSM: Generated 1820 derivative records from 50753 primary records. [2025-09-19T22:28:39.738101] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-19T22:28:39.754300] [DEBUG] [LOCAL ] WSR: Derivative data saved (1820 records). [2025-09-19T22:28:39.754415] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-19T22:28:39.756913] [INFO ] [MAIN ] Derivative Progress: 2048/2093 symbols completed. WSR took 1.2s. Estimated remaining: 17.4s. Rate: 154.9 symbols/min [2025-09-19T22:28:39.757176] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:39.773898] [DEBUG] [LOCAL ] WSM: Derivative data saved (1820 records). [2025-09-19T22:28:39.774069] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-19T22:28:39.776500] [INFO ] [MAIN ] Derivative Progress: 2049/2093 symbols completed. WSM took 1.3s. Estimated remaining: 17.0s. Rate: 154.9 symbols/min [2025-09-19T22:28:39.777005] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:39.805081] [DEBUG] [LOCAL ] WST: Loaded 38506 existing records from primary storage. [2025-09-19T22:28:39.805403] [INFO ] [MAIN ] WST: Loaded 38506 primary data records. [2025-09-19T22:28:40.162353] [DEBUG] [LOCAL ] WT: Loaded 48283 existing records from primary storage. [2025-09-19T22:28:40.162634] [INFO ] [MAIN ] WT: Loaded 48283 primary data records. [2025-09-19T22:28:40.163314] [DEBUG] [LOCAL ] WTI: Loaded 44421 existing records from primary storage. [2025-09-19T22:28:40.195301] [INFO ] [MAIN ] WTI: Loaded 44421 primary data records. [2025-09-19T22:28:40.841568] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:40.842812] [INFO ] [MAIN ] WST: Generated 1820 derivative records from 38506 primary records. [2025-09-19T22:28:40.842969] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-19T22:28:40.862562] [DEBUG] [LOCAL ] WST: Derivative data saved (1820 records). [2025-09-19T22:28:40.863008] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-19T22:28:40.865303] [INFO ] [MAIN ] Derivative Progress: 2050/2093 symbols completed. WST took 1.2s. Estimated remaining: 16.7s. Rate: 154.8 symbols/min [2025-09-19T22:28:40.866378] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:40.899972] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:40.900442] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:40.901223] [INFO ] [MAIN ] WT: Generated 1820 derivative records from 48283 primary records. [2025-09-19T22:28:40.901829] [INFO ] [MAIN ] WTI: Generated 1820 derivative records from 44421 primary records. [2025-09-19T22:28:40.902009] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-19T22:28:40.902097] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-19T22:28:40.934349] [DEBUG] [LOCAL ] WTI: Derivative data saved (1820 records). [2025-09-19T22:28:40.936141] [DEBUG] [LOCAL ] WT: Derivative data saved (1820 records). [2025-09-19T22:28:40.935534] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-19T22:28:40.938924] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-19T22:28:40.938802] [INFO ] [MAIN ] Derivative Progress: 2051/2093 symbols completed. WTI took 1.2s. Estimated remaining: 16.3s. Rate: 154.9 symbols/min [2025-09-19T22:28:40.941682] [INFO ] [MAIN ] Derivative Progress: 2052/2093 symbols completed. WT took 1.2s. Estimated remaining: 15.9s. Rate: 154.9 symbols/min [2025-09-19T22:28:40.941608] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:40.942312] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:40.983163] [DEBUG] [LOCAL ] WTRG: Loaded 51709 existing records from primary storage. [2025-09-19T22:28:40.983508] [INFO ] [MAIN ] WTRG: Loaded 51709 primary data records. [2025-09-19T22:28:41.023355] [DEBUG] [LOCAL ] WTS: Loaded 18952 existing records from primary storage. [2025-09-19T22:28:41.035927] [INFO ] [MAIN ] WTS: Loaded 18952 primary data records. [2025-09-19T22:28:41.307422] [DEBUG] [LOCAL ] WTTR: Loaded 45823 existing records from primary storage. [2025-09-19T22:28:41.424886] [INFO ] [MAIN ] WTTR: Loaded 45823 primary data records. [2025-09-19T22:28:41.989274] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:41.990887] [INFO ] [MAIN ] WTRG: Generated 1820 derivative records from 51709 primary records. [2025-09-19T22:28:41.991015] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-19T22:28:42.021666] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1820 records). [2025-09-19T22:28:42.021566] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:42.022926] [INFO ] [MAIN ] WTS: Generated 1820 derivative records from 18952 primary records. [2025-09-19T22:28:42.022187] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-19T22:28:42.025153] [INFO ] [MAIN ] Derivative Progress: 2053/2093 symbols completed. WTRG took 1.2s. Estimated remaining: 15.5s. Rate: 154.8 symbols/min [2025-09-19T22:28:42.025234] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-19T22:28:42.042419] [DEBUG] [LOCAL ] WTS: Derivative data saved (1820 records). [2025-09-19T22:28:42.042497] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-19T22:28:42.045087] [INFO ] [MAIN ] Derivative Progress: 2054/2093 symbols completed. WTS took 1.1s. Estimated remaining: 15.1s. Rate: 154.9 symbols/min [2025-09-19T22:28:42.060994] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:42.061744] [INFO ] [MAIN ] WTTR: Generated 1820 derivative records from 45823 primary records. [2025-09-19T22:28:42.061822] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-19T22:28:42.077944] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1820 records). [2025-09-19T22:28:42.078009] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-19T22:28:42.080533] [INFO ] [MAIN ] Derivative Progress: 2055/2093 symbols completed. WTTR took 1.1s. Estimated remaining: 14.7s. Rate: 154.9 symbols/min [2025-09-19T22:28:42.081297] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:42.081083] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:42.081159] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:42.160129] [DEBUG] [LOCAL ] WU: Loaded 54225 existing records from primary storage. [2025-09-19T22:28:42.160310] [INFO ] [MAIN ] WU: Loaded 54225 primary data records. [2025-09-19T22:28:42.291254] [DEBUG] [LOCAL ] WWW: Loaded 49891 existing records from primary storage. [2025-09-19T22:28:42.303149] [INFO ] [MAIN ] WWW: Loaded 49891 primary data records. [2025-09-19T22:28:42.302755] [DEBUG] [LOCAL ] WY: Loaded 53892 existing records from primary storage. [2025-09-19T22:28:42.349946] [INFO ] [MAIN ] WY: Loaded 53892 primary data records. [2025-09-19T22:28:43.211736] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:43.213423] [INFO ] [MAIN ] WU: Generated 1820 derivative records from 54225 primary records. [2025-09-19T22:28:43.215266] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-19T22:28:43.231275] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:43.256450] [INFO ] [MAIN ] WWW: Generated 1820 derivative records from 49891 primary records. [2025-09-19T22:28:43.260515] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:43.256755] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-19T22:28:43.262037] [INFO ] [MAIN ] WY: Generated 1820 derivative records from 53892 primary records. [2025-09-19T22:28:43.262169] [DEBUG] [LOCAL ] WU: Derivative data saved (1820 records). [2025-09-19T22:28:43.262243] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-19T22:28:43.262851] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-19T22:28:43.272915] [INFO ] [MAIN ] Derivative Progress: 2056/2093 symbols completed. WU took 1.2s. Estimated remaining: 14.3s. Rate: 154.8 symbols/min [2025-09-19T22:28:43.288784] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:43.296185] [DEBUG] [LOCAL ] WY: Derivative data saved (1820 records). [2025-09-19T22:28:43.297347] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-19T22:28:43.300679] [INFO ] [MAIN ] Derivative Progress: 2057/2093 symbols completed. WY took 1.2s. Estimated remaining: 13.9s. Rate: 154.8 symbols/min [2025-09-19T22:28:43.301763] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:43.302678] [DEBUG] [LOCAL ] WWW: Derivative data saved (1820 records). [2025-09-19T22:28:43.302832] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-19T22:28:43.306140] [INFO ] [MAIN ] Derivative Progress: 2058/2093 symbols completed. WWW took 1.2s. Estimated remaining: 13.6s. Rate: 154.9 symbols/min [2025-09-19T22:28:43.306817] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:43.350287] [DEBUG] [LOCAL ] XFLT: Loaded 30468 existing records from primary storage. [2025-09-19T22:28:43.350602] [INFO ] [MAIN ] XFLT: Loaded 30468 primary data records. [2025-09-19T22:28:43.488298] [DEBUG] [LOCAL ] XHR: Loaded 45098 existing records from primary storage. [2025-09-19T22:28:43.504855] [INFO ] [MAIN ] XHR: Loaded 45098 primary data records. [2025-09-19T22:28:43.758673] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-09-19T22:28:43.786131] [INFO ] [MAIN ] XOM: Loaded 54573 primary data records. [2025-09-19T22:28:44.413466] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:44.414795] [INFO ] [MAIN ] XFLT: Generated 1820 derivative records from 30468 primary records. [2025-09-19T22:28:44.415093] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-19T22:28:44.435082] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1820 records). [2025-09-19T22:28:44.435681] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-19T22:28:44.450892] [INFO ] [MAIN ] Derivative Progress: 2059/2093 symbols completed. XFLT took 1.2s. Estimated remaining: 13.2s. Rate: 154.8 symbols/min [2025-09-19T22:28:44.448856] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:44.452079] [INFO ] [MAIN ] XHR: Generated 1820 derivative records from 45098 primary records. [2025-09-19T22:28:44.452208] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-19T22:28:44.454248] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:44.480325] [DEBUG] [LOCAL ] XHR: Derivative data saved (1820 records). [2025-09-19T22:28:44.485832] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:44.486401] [INFO ] [MAIN ] XOM: Generated 1820 derivative records from 54573 primary records. [2025-09-19T22:28:44.486460] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-19T22:28:44.485265] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-19T22:28:44.489205] [INFO ] [MAIN ] Derivative Progress: 2060/2093 symbols completed. XHR took 1.2s. Estimated remaining: 12.8s. Rate: 154.8 symbols/min [2025-09-19T22:28:44.489541] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:44.508942] [DEBUG] [LOCAL ] XOM: Derivative data saved (1820 records). [2025-09-19T22:28:44.509263] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-19T22:28:44.512191] [INFO ] [MAIN ] Derivative Progress: 2061/2093 symbols completed. XOM took 1.2s. Estimated remaining: 12.4s. Rate: 154.9 symbols/min [2025-09-19T22:28:44.512551] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:44.534846] [DEBUG] [LOCAL ] XPER: Loaded 30079 existing records from primary storage. [2025-09-19T22:28:44.534993] [INFO ] [MAIN ] XPER: Loaded 30079 primary data records. [2025-09-19T22:28:44.876704] [DEBUG] [LOCAL ] XPEV: Loaded 54422 existing records from primary storage. [2025-09-19T22:28:44.891939] [INFO ] [MAIN ] XPEV: Loaded 54422 primary data records. [2025-09-19T22:28:44.893219] [DEBUG] [LOCAL ] XPO: Loaded 48980 existing records from primary storage. [2025-09-19T22:28:44.926364] [INFO ] [MAIN ] XPO: Loaded 48980 primary data records. [2025-09-19T22:28:45.532275] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:45.534954] [INFO ] [MAIN ] XPER: Generated 1820 derivative records from 30079 primary records. [2025-09-19T22:28:45.535940] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-19T22:28:45.553473] [DEBUG] [LOCAL ] XPER: Derivative data saved (1820 records). [2025-09-19T22:28:45.553663] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-19T22:28:45.555854] [INFO ] [MAIN ] Derivative Progress: 2062/2093 symbols completed. XPER took 1.1s. Estimated remaining: 12.0s. Rate: 154.8 symbols/min [2025-09-19T22:28:45.556459] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:45.576233] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:45.577017] [INFO ] [MAIN ] XPEV: Generated 1820 derivative records from 54422 primary records. [2025-09-19T22:28:45.577211] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-19T22:28:45.598604] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1820 records). [2025-09-19T22:28:45.598953] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-19T22:28:45.613437] [INFO ] [MAIN ] Derivative Progress: 2063/2093 symbols completed. XPEV took 1.1s. Estimated remaining: 11.6s. Rate: 154.8 symbols/min [2025-09-19T22:28:45.614219] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:45.624194] [INFO ] [MAIN ] XPO: Generated 1820 derivative records from 48980 primary records. [2025-09-19T22:28:45.623378] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:45.624359] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-19T22:28:45.641132] [DEBUG] [LOCAL ] XPO: Derivative data saved (1820 records). [2025-09-19T22:28:45.641335] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-19T22:28:45.644187] [INFO ] [MAIN ] Derivative Progress: 2064/2093 symbols completed. XPO took 1.1s. Estimated remaining: 11.2s. Rate: 154.9 symbols/min [2025-09-19T22:28:45.645170] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:45.660185] [DEBUG] [LOCAL ] XPOF: Loaded 39424 existing records from primary storage. [2025-09-19T22:28:45.660441] [INFO ] [MAIN ] XPOF: Loaded 39424 primary data records. [2025-09-19T22:28:46.005054] [DEBUG] [LOCAL ] XPRO: Loaded 46874 existing records from primary storage. [2025-09-19T22:28:46.003799] [DEBUG] [LOCAL ] XYF: Loaded 28022 existing records from primary storage. [2025-09-19T22:28:46.005302] [INFO ] [MAIN ] XYF: Loaded 28022 primary data records. [2025-09-19T22:28:46.005394] [INFO ] [MAIN ] XPRO: Loaded 46874 primary data records. [2025-09-19T22:28:46.708600] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:46.709619] [INFO ] [MAIN ] XPOF: Generated 1820 derivative records from 39424 primary records. [2025-09-19T22:28:46.709985] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-19T22:28:46.739012] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1820 records). [2025-09-19T22:28:46.744837] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-19T22:28:46.744690] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:46.747124] [INFO ] [MAIN ] Derivative Progress: 2065/2093 symbols completed. XPOF took 1.2s. Estimated remaining: 10.9s. Rate: 154.8 symbols/min [2025-09-19T22:28:46.748568] [INFO ] [MAIN ] XYF: Generated 1820 derivative records from 28022 primary records. [2025-09-19T22:28:46.748709] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-19T22:28:46.747833] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:46.768635] [DEBUG] [LOCAL ] XYF: Derivative data saved (1820 records). [2025-09-19T22:28:46.780886] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-19T22:28:46.783486] [INFO ] [MAIN ] Derivative Progress: 2066/2093 symbols completed. XYF took 1.1s. Estimated remaining: 10.5s. Rate: 154.8 symbols/min [2025-09-19T22:28:46.783830] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:46.784200] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:46.785006] [INFO ] [MAIN ] XPRO: Generated 1820 derivative records from 46874 primary records. [2025-09-19T22:28:46.785552] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-19T22:28:46.803436] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1820 records). [2025-09-19T22:28:46.803732] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-19T22:28:46.806540] [INFO ] [MAIN ] Derivative Progress: 2067/2093 symbols completed. XPRO took 1.2s. Estimated remaining: 10.1s. Rate: 154.9 symbols/min [2025-09-19T22:28:46.806938] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:46.845886] [DEBUG] [LOCAL ] YALA: Loaded 37704 existing records from primary storage. [2025-09-19T22:28:46.846748] [INFO ] [MAIN ] YALA: Loaded 37704 primary data records. [2025-09-19T22:28:46.954105] [DEBUG] [LOCAL ] XYL: Loaded 48923 existing records from primary storage. [2025-09-19T22:28:46.984215] [INFO ] [MAIN ] XYL: Loaded 48923 primary data records. [2025-09-19T22:28:47.052486] [DEBUG] [LOCAL ] YELP: Loaded 46049 existing records from primary storage. [2025-09-19T22:28:47.104708] [INFO ] [MAIN ] YELP: Loaded 46049 primary data records. [2025-09-19T22:28:47.847521] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:47.848477] [INFO ] [MAIN ] YALA: Generated 1820 derivative records from 37704 primary records. [2025-09-19T22:28:47.849015] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-19T22:28:47.882406] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:47.883725] [DEBUG] [LOCAL ] YALA: Derivative data saved (1820 records). [2025-09-19T22:28:47.883997] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-19T22:28:47.884799] [INFO ] [MAIN ] XYL: Generated 1820 derivative records from 48923 primary records. [2025-09-19T22:28:47.887043] [INFO ] [MAIN ] Derivative Progress: 2068/2093 symbols completed. YALA took 1.1s. Estimated remaining: 9.7s. Rate: 154.8 symbols/min [2025-09-19T22:28:47.887174] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-19T22:28:47.918204] [DEBUG] [LOCAL ] XYL: Derivative data saved (1820 records). [2025-09-19T22:28:47.918934] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-19T22:28:47.922182] [INFO ] [MAIN ] Derivative Progress: 2069/2093 symbols completed. XYL took 1.2s. Estimated remaining: 9.3s. Rate: 154.9 symbols/min [2025-09-19T22:28:47.918861] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:47.923025] [INFO ] [MAIN ] YELP: Generated 1820 derivative records from 46049 primary records. [2025-09-19T22:28:47.923237] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-19T22:28:47.938595] [DEBUG] [LOCAL ] YELP: Derivative data saved (1820 records). [2025-09-19T22:28:47.938691] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-19T22:28:47.941195] [INFO ] [MAIN ] Derivative Progress: 2070/2093 symbols completed. YELP took 1.1s. Estimated remaining: 8.9s. Rate: 154.9 symbols/min [2025-09-19T22:28:47.942054] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:47.942132] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:47.942332] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:47.995722] [DEBUG] [LOCAL ] YEXT: Loaded 44073 existing records from primary storage. [2025-09-19T22:28:48.009091] [INFO ] [MAIN ] YEXT: Loaded 44073 primary data records. [2025-09-19T22:28:48.180569] [DEBUG] [LOCAL ] YETI: Loaded 53251 existing records from primary storage. [2025-09-19T22:28:48.208685] [DEBUG] [LOCAL ] YMM: Loaded 53484 existing records from primary storage. [2025-09-19T22:28:48.208853] [INFO ] [MAIN ] YMM: Loaded 53484 primary data records. [2025-09-19T22:28:48.218530] [INFO ] [MAIN ] YETI: Loaded 53251 primary data records. [2025-09-19T22:28:49.067019] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:49.068039] [INFO ] [MAIN ] YEXT: Generated 1820 derivative records from 44073 primary records. [2025-09-19T22:28:49.068364] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-19T22:28:49.088292] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1820 records). [2025-09-19T22:28:49.088665] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-19T22:28:49.093718] [INFO ] [MAIN ] Derivative Progress: 2071/2093 symbols completed. YEXT took 1.2s. Estimated remaining: 8.5s. Rate: 154.8 symbols/min [2025-09-19T22:28:49.106826] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:49.108118] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:49.107550] [INFO ] [MAIN ] YETI: Generated 1820 derivative records from 53251 primary records. [2025-09-19T22:28:49.109148] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-19T22:28:49.128164] [DEBUG] [LOCAL ] YETI: Derivative data saved (1820 records). [2025-09-19T22:28:49.130123] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-19T22:28:49.132706] [INFO ] [MAIN ] Derivative Progress: 2072/2093 symbols completed. YETI took 1.2s. Estimated remaining: 8.1s. Rate: 154.8 symbols/min [2025-09-19T22:28:49.133243] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:49.147053] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:49.147815] [INFO ] [MAIN ] YMM: Generated 1820 derivative records from 53484 primary records. [2025-09-19T22:28:49.147995] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-19T22:28:49.164440] [DEBUG] [LOCAL ] YMM: Derivative data saved (1820 records). [2025-09-19T22:28:49.164594] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-19T22:28:49.167315] [INFO ] [MAIN ] Derivative Progress: 2073/2093 symbols completed. YMM took 1.2s. Estimated remaining: 7.7s. Rate: 154.9 symbols/min [2025-09-19T22:28:49.167615] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:49.195401] [DEBUG] [LOCAL ] YRD: Loaded 12830 existing records from primary storage. [2025-09-19T22:28:49.195525] [INFO ] [MAIN ] YRD: Loaded 12830 primary data records. [2025-09-19T22:28:49.306319] [DEBUG] [LOCAL ] YOU: Loaded 50675 existing records from primary storage. [2025-09-19T22:28:49.335751] [INFO ] [MAIN ] YOU: Loaded 50675 primary data records. [2025-09-19T22:28:49.422112] [DEBUG] [LOCAL ] YPF: Loaded 51232 existing records from primary storage. [2025-09-19T22:28:49.484863] [INFO ] [MAIN ] YPF: Loaded 51232 primary data records. [2025-09-19T22:28:50.210210] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:50.211421] [INFO ] [MAIN ] YRD: Generated 1820 derivative records from 12830 primary records. [2025-09-19T22:28:50.212100] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-19T22:28:50.245217] [DEBUG] [LOCAL ] YRD: Derivative data saved (1820 records). [2025-09-19T22:28:50.245613] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:50.246851] [INFO ] [MAIN ] YOU: Generated 1820 derivative records from 50675 primary records. [2025-09-19T22:28:50.246952] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-19T22:28:50.245960] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-19T22:28:50.266786] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:50.266161] [INFO ] [MAIN ] Derivative Progress: 2074/2093 symbols completed. YRD took 1.1s. Estimated remaining: 7.4s. Rate: 154.8 symbols/min [2025-09-19T22:28:50.274872] [INFO ] [MAIN ] YPF: Generated 1820 derivative records from 51232 primary records. [2025-09-19T22:28:50.279099] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:50.281475] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-19T22:28:50.283464] [DEBUG] [LOCAL ] YOU: Derivative data saved (1820 records). [2025-09-19T22:28:50.284574] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-19T22:28:50.287322] [INFO ] [MAIN ] Derivative Progress: 2075/2093 symbols completed. YOU took 1.2s. Estimated remaining: 7.0s. Rate: 154.8 symbols/min [2025-09-19T22:28:50.287799] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:50.304614] [DEBUG] [LOCAL ] YPF: Derivative data saved (1820 records). [2025-09-19T22:28:50.304721] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-19T22:28:50.307235] [INFO ] [MAIN ] Derivative Progress: 2076/2093 symbols completed. YPF took 1.2s. Estimated remaining: 6.6s. Rate: 154.9 symbols/min [2025-09-19T22:28:50.307547] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:50.336232] [DEBUG] [LOCAL ] YSG: Loaded 24955 existing records from primary storage. [2025-09-19T22:28:50.336461] [INFO ] [MAIN ] YSG: Loaded 24955 primary data records. [2025-09-19T22:28:50.753740] [DEBUG] [LOCAL ] YUMC: Loaded 53504 existing records from primary storage. [2025-09-19T22:28:50.754700] [INFO ] [MAIN ] YUMC: Loaded 53504 primary data records. [2025-09-19T22:28:50.754593] [DEBUG] [LOCAL ] YUM: Loaded 52076 existing records from primary storage. [2025-09-19T22:28:50.777451] [INFO ] [MAIN ] YUM: Loaded 52076 primary data records. [2025-09-19T22:28:51.406521] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:51.407721] [INFO ] [MAIN ] YSG: Generated 1820 derivative records from 24955 primary records. [2025-09-19T22:28:51.408964] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-19T22:28:51.428846] [DEBUG] [LOCAL ] YSG: Derivative data saved (1820 records). [2025-09-19T22:28:51.429513] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-19T22:28:51.431811] [INFO ] [MAIN ] Derivative Progress: 2077/2093 symbols completed. YSG took 1.2s. Estimated remaining: 6.2s. Rate: 154.8 symbols/min [2025-09-19T22:28:51.432618] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:51.477145] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:51.477429] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:51.478518] [INFO ] [MAIN ] YUMC: Generated 1820 derivative records from 53504 primary records. [2025-09-19T22:28:51.478629] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-19T22:28:51.479583] [INFO ] [MAIN ] YUM: Generated 1820 derivative records from 52076 primary records. [2025-09-19T22:28:51.480088] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-19T22:28:51.512938] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1820 records). [2025-09-19T22:28:51.516317] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-19T22:28:51.520347] [INFO ] [MAIN ] Derivative Progress: 2078/2093 symbols completed. YUMC took 1.2s. Estimated remaining: 5.8s. Rate: 154.8 symbols/min [2025-09-19T22:28:51.521225] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:51.521349] [DEBUG] [LOCAL ] YUM: Derivative data saved (1820 records). [2025-09-19T22:28:51.521895] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-19T22:28:51.524742] [INFO ] [MAIN ] Derivative Progress: 2079/2093 symbols completed. YUM took 1.2s. Estimated remaining: 5.4s. Rate: 154.9 symbols/min [2025-09-19T22:28:51.525119] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:51.555212] [DEBUG] [LOCAL ] ZEPP: Loaded 16473 existing records from primary storage. [2025-09-19T22:28:51.555349] [INFO ] [MAIN ] ZEPP: Loaded 16473 primary data records. [2025-09-19T22:28:51.675455] [DEBUG] [LOCAL ] ZBH: Loaded 51968 existing records from primary storage. [2025-09-19T22:28:51.679164] [INFO ] [MAIN ] ZBH: Loaded 51968 primary data records. [2025-09-19T22:28:52.049885] [DEBUG] [LOCAL ] ZETA: Loaded 54375 existing records from primary storage. [2025-09-19T22:28:52.055451] [INFO ] [MAIN ] ZETA: Loaded 54375 primary data records. [2025-09-19T22:28:52.618891] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:52.620702] [INFO ] [MAIN ] ZEPP: Generated 1820 derivative records from 16473 primary records. [2025-09-19T22:28:52.621838] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-19T22:28:52.647139] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:52.652327] [INFO ] [MAIN ] ZBH: Generated 1820 derivative records from 51968 primary records. [2025-09-19T22:28:52.652624] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-19T22:28:52.651439] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1820 records). [2025-09-19T22:28:52.655446] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-19T22:28:52.658111] [INFO ] [MAIN ] Derivative Progress: 2080/2093 symbols completed. ZEPP took 1.1s. Estimated remaining: 5.0s. Rate: 154.8 symbols/min [2025-09-19T22:28:52.658843] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:52.689577] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1820 records). [2025-09-19T22:28:52.689810] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-19T22:28:52.688257] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:52.693352] [INFO ] [MAIN ] ZETA: Generated 1820 derivative records from 54375 primary records. [2025-09-19T22:28:52.692094] [INFO ] [MAIN ] Derivative Progress: 2081/2093 symbols completed. ZBH took 1.3s. Estimated remaining: 4.7s. Rate: 154.8 symbols/min [2025-09-19T22:28:52.693696] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-19T22:28:52.693890] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:52.711034] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1820 records). [2025-09-19T22:28:52.711319] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-19T22:28:52.719919] [INFO ] [MAIN ] Derivative Progress: 2082/2093 symbols completed. ZETA took 1.2s. Estimated remaining: 4.3s. Rate: 154.9 symbols/min [2025-09-19T22:28:52.720285] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:52.753099] [DEBUG] [LOCAL ] ZH: Loaded 27557 existing records from primary storage. [2025-09-19T22:28:52.765074] [INFO ] [MAIN ] ZH: Loaded 27557 primary data records. [2025-09-19T22:28:52.797770] [DEBUG] [LOCAL ] ZGN: Loaded 41448 existing records from primary storage. [2025-09-19T22:28:52.809933] [INFO ] [MAIN ] ZGN: Loaded 41448 primary data records. [2025-09-19T22:28:53.310897] [DEBUG] [LOCAL ] ZIM: Loaded 54331 existing records from primary storage. [2025-09-19T22:28:53.428888] [INFO ] [MAIN ] ZIM: Loaded 54331 primary data records. [2025-09-19T22:28:53.858088] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:53.861163] [INFO ] [MAIN ] ZH: Generated 1820 derivative records from 27557 primary records. [2025-09-19T22:28:53.861497] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-19T22:28:53.887738] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:53.891050] [INFO ] [MAIN ] ZGN: Generated 1820 derivative records from 41448 primary records. [2025-09-19T22:28:53.893110] [DEBUG] [LOCAL ] ZH: Derivative data saved (1820 records). [2025-09-19T22:28:53.893300] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-19T22:28:53.895445] [INFO ] [MAIN ] Derivative Progress: 2083/2093 symbols completed. ZH took 1.2s. Estimated remaining: 3.9s. Rate: 154.7 symbols/min [2025-09-19T22:28:53.891393] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-19T22:28:53.913258] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1820 records). [2025-09-19T22:28:53.913391] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-19T22:28:53.916155] [INFO ] [MAIN ] Derivative Progress: 2084/2093 symbols completed. ZGN took 1.3s. Estimated remaining: 3.5s. Rate: 154.8 symbols/min [2025-09-19T22:28:53.934466] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:53.935178] [INFO ] [MAIN ] ZIM: Generated 1820 derivative records from 54331 primary records. [2025-09-19T22:28:53.935240] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-19T22:28:53.951378] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1820 records). [2025-09-19T22:28:53.951446] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-19T22:28:53.954057] [INFO ] [MAIN ] Derivative Progress: 2085/2093 symbols completed. ZIM took 1.2s. Estimated remaining: 3.1s. Rate: 154.9 symbols/min [2025-09-19T22:28:53.954994] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:53.954932] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:53.955268] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:53.967985] [DEBUG] [LOCAL ] ZKH: Loaded 8186 existing records from primary storage. [2025-09-19T22:28:53.968091] [INFO ] [MAIN ] ZKH: Loaded 8186 primary data records. [2025-09-19T22:28:54.161058] [DEBUG] [LOCAL ] ZK: Loaded 40821 existing records from primary storage. [2025-09-19T22:28:54.195594] [INFO ] [MAIN ] ZK: Loaded 40821 primary data records. [2025-09-19T22:28:54.217287] [DEBUG] [LOCAL ] ZIP: Loaded 45168 existing records from primary storage. [2025-09-19T22:28:54.373681] [INFO ] [MAIN ] ZIP: Loaded 45168 primary data records. [2025-09-19T22:28:55.013723] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-09-19T22:28:55.014716] [INFO ] [MAIN ] ZKH: Generated 1819 derivative records from 8186 primary records. [2025-09-19T22:28:55.014809] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-19T22:28:55.033542] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1819 records). [2025-09-19T22:28:55.033807] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-19T22:28:55.036120] [INFO ] [MAIN ] Derivative Progress: 2086/2093 symbols completed. ZKH took 1.1s. Estimated remaining: 2.7s. Rate: 154.8 symbols/min [2025-09-19T22:28:55.036806] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:55.057721] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:55.071182] [INFO ] [MAIN ] ZIP: Generated 1820 derivative records from 45168 primary records. [2025-09-19T22:28:55.071300] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-19T22:28:55.072031] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:55.073589] [INFO ] [MAIN ] ZK: Generated 1820 derivative records from 40821 primary records. [2025-09-19T22:28:55.073938] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-19T22:28:55.090288] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1820 records). [2025-09-19T22:28:55.101634] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-19T22:28:55.108430] [DEBUG] [LOCAL ] ZK: Derivative data saved (1820 records). [2025-09-19T22:28:55.108663] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-19T22:28:55.105476] [INFO ] [MAIN ] Derivative Progress: 2087/2093 symbols completed. ZIP took 1.2s. Estimated remaining: 2.3s. Rate: 154.8 symbols/min [2025-09-19T22:28:55.111785] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:55.111885] [INFO ] [MAIN ] Derivative Progress: 2088/2093 symbols completed. ZK took 1.2s. Estimated remaining: 1.9s. Rate: 154.9 symbols/min [2025-09-19T22:28:55.112394] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:55.157419] [DEBUG] [LOCAL ] ZTR: Loaded 17033 existing records from primary storage. [2025-09-19T22:28:55.157570] [INFO ] [MAIN ] ZTR: Loaded 17033 primary data records. [2025-09-19T22:28:55.158510] [DEBUG] [LOCAL ] ZTO: Loaded 50870 existing records from primary storage. [2025-09-19T22:28:55.170048] [INFO ] [MAIN ] ZTO: Loaded 50870 primary data records. [2025-09-19T22:28:55.802771] [DEBUG] [LOCAL ] ZTS: Loaded 53760 existing records from primary storage. [2025-09-19T22:28:55.803023] [INFO ] [MAIN ] ZTS: Loaded 53760 primary data records. [2025-09-19T22:28:56.164036] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:56.172843] [INFO ] [MAIN ] ZTO: Generated 1820 derivative records from 50870 primary records. [2025-09-19T22:28:56.178411] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:56.179107] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-19T22:28:56.180108] [INFO ] [MAIN ] ZTR: Generated 1820 derivative records from 17033 primary records. [2025-09-19T22:28:56.180203] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-19T22:28:56.213822] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1820 records). [2025-09-19T22:28:56.215735] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1820 records). [2025-09-19T22:28:56.215864] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-19T22:28:56.215925] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-19T22:28:56.221572] [INFO ] [MAIN ] Derivative Progress: 2089/2093 symbols completed. ZTO took 1.2s. Estimated remaining: 1.6s. Rate: 154.7 symbols/min [2025-09-19T22:28:56.224881] [INFO ] [MAIN ] Derivative Progress: 2090/2093 symbols completed. ZTR took 1.1s. Estimated remaining: 1.2s. Rate: 154.8 symbols/min [2025-09-19T22:28:56.224772] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:56.225257] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-19T22:28:56.248225] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:56.249185] [INFO ] [MAIN ] ZTS: Generated 1820 derivative records from 53760 primary records. [2025-09-19T22:28:56.249304] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-19T22:28:56.272840] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1820 records). [2025-09-19T22:28:56.273004] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-19T22:28:56.275360] [INFO ] [MAIN ] Derivative Progress: 2091/2093 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 154.9 symbols/min [2025-09-19T22:28:56.310318] [DEBUG] [LOCAL ] ZVIA: Loaded 35851 existing records from primary storage. [2025-09-19T22:28:56.322330] [INFO ] [MAIN ] ZVIA: Loaded 35851 primary data records. [2025-09-19T22:28:56.358734] [DEBUG] [LOCAL ] ZWS: Loaded 43136 existing records from primary storage. [2025-09-19T22:28:56.400118] [INFO ] [MAIN ] ZWS: Loaded 43136 primary data records. [2025-09-19T22:28:57.068874] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:57.069896] [INFO ] [MAIN ] ZWS: Generated 1820 derivative records from 43136 primary records. [2025-09-19T22:28:57.070053] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-19T22:28:57.084924] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-09-19T22:28:57.093166] [INFO ] [MAIN ] ZVIA: Generated 1820 derivative records from 35851 primary records. [2025-09-19T22:28:57.094421] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-19T22:28:57.102133] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1820 records). [2025-09-19T22:28:57.111146] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-19T22:28:57.116508] [INFO ] [MAIN ] Derivative Progress: 2092/2093 symbols completed. ZWS took 0.9s. Estimated remaining: 0.4s. Rate: 154.8 symbols/min [2025-09-19T22:28:57.121302] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1820 records). [2025-09-19T22:28:57.121400] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-19T22:28:57.126585] [INFO ] [MAIN ] Derivative Progress: 2093/2093 symbols completed. ZVIA took 0.9s. Estimated remaining: 0.0s. Rate: 154.9 symbols/min [2025-09-19T22:28:57.128291] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 31s [2025-09-19T22:28:57.128627] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2093/2093 symbols) [2025-09-19T22:28:57.793803] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2093/2093 @ 100.00%)' [2025-09-19T22:28:57.795098] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-19T22:28:57.795377] [INFO ] [STATE ] Last completion updated: 2025-09-19T22:28:57.795201